Data Engineer

Role Overview

As a Data Engineer, you will ensure that data from various sources is reliable, scalable, and available for the teams that work with it. You will build not only data solutions, but create a foundation on which colleagues can rely daily.

What You Will Do

You will work on the further development of the central data platform of Lely, combining software engineering, cloud technology, and operational ownership. You will develop maintainable and testable solutions, automate processes, and ensure that data is available when the business needs it.

Why It Might Be a Fit

You will be involved in the entire life cycle of data solutions, from designing reliable data ingestion solutions and integrating new data sources to solving production incidents. You will take ownership of the reliability of production environments through monitoring, incident analysis, root-cause analysis, and cost control.

Requirements

• Strong Python engineering skills with experience in object-oriented programming, modular architectures, and testable code.
• Strong SQL skills for data extraction, transformation, and validation within data ingestion processes.
• Experience with unlocking data from various sources, including APIs, SQL databases, and file-based sources such as FTP/SFTP.
• Hands-on experience with Databricks, including Workflows, Spark, Delta Lake, and Unity Catalog.
• Knowledge of Delta Lake and data warehouse patterns such as CDC, SCD Type 2, incremental loading, and deduplication.
• Experience with unit testing and integration testing to realize robust and reliable solutions.
• Experience with CI/CD processes and tooling such as GitLab.
• Knowledge of cloud technologies, preferably within the Azure ecosystem.
• Experience with monitoring, incident debugging, and ensuring reliable production environments.
• A pragmatic attitude towards AI-supported software development and engineering.

Benefits

• Up to 8 weeks of vacation per year
• A strong pension scheme
• A salary between €5,015 and €7,163 gross per month
• Clear growth opportunities compared to your starting salary
• Extensive development opportunities
• Use of extensive sports facilities daily
• Participation in Hyrox training or personal training
• Free shuttle bus from and to the metro in Maassluis
• Celebrations of successes, such as jubilees and Christmas parties

Tagged as: Python, SQL