IT Data Engineer

Role Overview

Design, develop, and deliver large-scale data systems, data processing, and data transformation pipelines. Collaborate with stakeholders to understand business needs and work closely with business to deliver enterprise-grade datasets that are reliable, flexible, scalable, and provide low cost of ownership.

What You Will Do

Extract data from various sources, transform it into a usable format, and load it into Azure data lake using ADF pipelines, Databricks, Pyspark, and SQL. Design and build data models – star schema, snowflake. Understand common analytical data models like Kimball. Build physical data models that align with best practice and requirements.

Why It Might Be a Fit

Perform data management tasks. Recommend ways to improve data reliability, efficiency, and quality.

Requirements

• Master’s degree in Computer Science, IT/IS, or related field of study
• Two (2) years of work experience in the job offered or related occupation
• Enterprise integration patterns (EIP)
• Data warehouse modeling
• ETL processes
• Database management
• Development and data warehouse requirements gathering, analysis, and design
• Cloud native Modern Data Engineering projects
• Designing, building, and deploying scalable data pipelines
• Python
• Pyspark
• Spark SQL
• Analytical data models such as Kimball

Benefits

• Health, dental, and vision coverage
• 401(k) with generous company match
• Employer paid employee assistance program
• Employer paid short term and long term disability
• Employer paid life insurance
• Flex spending
• Paid vacation
• Paid sick days
• Paid holidays