We are looking for a highly qualified Lead Data Engineer to join our team and contribute to the evolution of our data infrastructure for the launch of a new product.
Requirements
- Design, build, and maintain an evolving and high-performance data infrastructure to meet business needs.
- Define and implement best practices for data architecture, storage, and processing pipelines.
- Optimize data ingestion, transformation, and activation to ensure efficiency and scalability.
- Lead the data warehouse and data lake strategy, ensuring smooth integration of structured and unstructured data.
- Guide the development of ETL workflows using tools like Airflow, dbt, Apache Spark, or KaWa.
- Implement and manage batch and real-time data processing pipelines.
- Improve data reliability, quality, and accessibility through robust monitoring and logging.
- Develop and enforce data governance policies, ensuring compliance with security and confidentiality standards (GDPR).
- Use cloud services for evolving data processing and storage.
- Optimize infrastructure costs while maintaining high availability and performance.
- Research and implement emerging technologies to improve data processing and analysis capabilities.
- Define team objectives, roadmaps, and delivery timelines in collaboration with stakeholders.
- Promote continuous workflow improvement, automation, and documentation.
Follow us on social media