Data Engineer – Databricks

We are looking for a Data Engineer – Databricks to join our Innovation Development team. As a core member of the team, you will design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark. You will also support data platform migration activities, assess, plan, and execute end-to-end migration strategies, and collaborate with cross-functional teams to understand data requirements and implement scalable solutions.

Requirements

• Design, develop, and maintain ETL/ELT pipelines using Databricks Delta Lake and Apache Spark
• Support data platform migration activities
• Assess, plan, and execute end-to-end migration strategies
• Build and manage AWS-based data pipelines using AWS Glue, S3, and related ETL services
• Implement data workflows using Databricks notebooks, jobs, and AWS Glue workflows
• Create and optimize data models for both batch and streaming data processing
• Develop and maintain data quality frameworks and monitoring systems during and post-migration
• Collaborate with cross-functional teams
• Write efficient SQL queries and optimize performance of existing queries
• Implement data security and governance practices aligned with organizational standards
• Build and maintain documentation for data processes, migration runbooks, and architectures

Benefits

• Flexible working arrangements
• Range of benefits
• Training and education support