Lead Data Engineer H/F

We are looking for a highly qualified Lead Data Engineer to join our team and contribute to the evolution of our data infrastructure for the launch of a new product.

Requirements

• Design, build, and maintain an evolving and high-performance data infrastructure to meet business needs.
• Define and implement best practices for data architecture, storage, and processing pipelines.
• Optimize data ingestion, transformation, and activation to ensure efficiency and scalability.
• Lead the data warehouse and data lake strategy, ensuring smooth integration of structured and unstructured data.
• Guide the development of ETL workflows using tools like Airflow, dbt, Apache Spark, or KaWa.
• Implement and manage batch and real-time data processing pipelines.
• Improve data reliability, quality, and accessibility through robust monitoring and logging.
• Develop and enforce data governance policies, ensuring compliance with security and confidentiality standards (GDPR).
• Use cloud services for evolving data processing and storage.
• Optimize infrastructure costs while maintaining high availability and performance.
• Research and implement emerging technologies to improve data processing and analysis capabilities.
• Define team objectives, roadmaps, and delivery timelines in collaboration with stakeholders.
• Promote continuous workflow improvement, automation, and documentation.

Tagged as: Pipeline Management