Data Engineer (Databricks)

We are looking for a Data Engineer to join our Data Engineering Center of Excellence (CoE), responsible for designing, building, and scaling robust data pipelines and data products on Databricks using PySpark and Python.

Requirements

• Design, develop, and maintain scalable data pipelines in Databricks using PySpark
• Build data products that support machine learning, MLOps, and analytics use cases
• Work with data stored in ADLS Gen2 and SAP HANA Data Lake (Delta/Parquet formats)
• Implement and maintain data quality checks (schema validation, deduplication, enrichment, tagging)
• Collaborate with ML engineers, data scientists, and business stakeholders to translate requirements into data solutions
• Contribute to engineering best practices, including version control, CI/CD, testing, and monitoring

Benefits

• Constant learning and skill growth
• Great benefits
• Wellbeing and flexibility
• Inclusive and diverse work environment

Tagged as: Python