Senior Data Engineer

We are seeking a highly skilled and experienced Senior Data Engineer to design, build, and maintain scalable data pipelines for a large-scale private cloud infrastructure.

Requirements

• Design, develop, and maintain scalable data pipelines for ingestion, transformation, and delivery of structured and unstructured data
• Build and optimize real-time streaming architectures using Apache Kafka and related ecosystem tools
• Develop and manage ETL/ELT workflows using dbt (dbt Labs) to support analytics, reporting, and AI/ML model training
• Collaborate with AI/ML teams to build feature stores and prepare training datasets at scale
• Ensure data quality, integrity, and governance through monitoring, validation, automated testing frameworks, and metadata management using DataHub
• Implement and maintain data quality validation across pipelines (e.g. Great Expectations) to ensure correctness, completeness, consistency, and freshness of data at every stage
• Optimize data storage and processing solutions within a private cloud environment (OpenStack, Ceph, Kubernetes)
• Build and manage observability and monitoring solutions with strong emphasis on the ELK stack (Elasticsearch, Logstash, Kibana) and Prometheus as core platforms, complemented by OpenTelemetry for distributed tracing and telemetry collection
• Mentor junior engineers and contribute to engineering best practices and technical documentation

Benefits

• Generous Paid Time Off
• 401k Matching
• Retirement Plan
• Visa Sponsorship
• Four Day Work Week
• Generous Parental Leave
• Tuition Reimbursement
• Relocation Assistance