Data Engineer

Role Overview

The Data Engineer will be part of a dedicated team that will clarify accountability to better enable crucial products needed to support program-level transparency and efficiency in data migration, data architecture design, and analytics. The role will involve harmonizing data migration, collecting data in a consistent way, and decreasing data migration complexity.

What You Will Do

The Data Engineer will be responsible for implementing data pipelines across D365 into DataLake and Synapse Analysis, holding workshops to determine common and specific data attribution for each scheme, and defining a common set of semantics being managed and reflected in the data architecture.

Why It Might Be a Fit

The ideal candidate will have a strong project delivery toolset experience in data integration tools, experience with processing large volumes of complex data, and a strong understanding of data modelling, data structures, databases, and processes.

Requirements

• Minimum 7 years experience as a data engineer within the data and analytics domain
• Strong project delivery toolset experience in data integration tools
• Experience with processing large volumes of complex data
• Ability to assess complexity of data (volume, structure, relationship etc.)
• Strong understanding of data modelling, data structures, databases, and processes
• Implemented Azure DecOps CI/CD with custom parameters for build and release pipelines for Data Factory, Synapse, and data lake artifacts
• Hands on technical expertise implementing and delivering data solutions and pipelines in Azure
• Hands on technical expertise working with DataLake and Synapse Analytics
• Hands on technical expertise working with Dynamics 365 Dataverse and SQL data sources
• Hands on technical expertise setting up DevOps automation using tools such as GitHub etc.
• Experience building data profiling, data cleansing and data engineering frameworks
• Exceptional communication, documentation, and presentation skills