Data Engineer

Data Engineer responsible for owning, developing, and publishing enterprise MDM data model, providing leadership and guidance on MDM/DQ best practices, and designing scalable and reliable data pipelines for machine learning.

Requirements

• Owns, develops, and publishes enterprise MDM data model
• Aligns technical architecture framework with requirements defined by the Delivery team
• Provides leadership and guidance with MDM/DQ best practices, governance, standards, and conventions
• Manages MDM and Databricks deployment lifecycle
• Designs and implements scalable and reliable data pipelines for machine learning using Apache Spark, Delta Lake, MLflow, and other Databricks services
• Evaluates and recommends new and emerging MDM/DQ technologies, methodologies, and standards
• Ensures consistency and compatibility with all other system technology components
• Mentors MDM Modelers and leads data modeling/quality efforts
• Conducts technical design reviews