Senior Data Engineer (REMOTE OR HYBRID MA)

The Hanover is seeking a Senior Data Engineer to join their team. The role will involve designing, developing, implementing, optimizing, and maintaining data integrations, pipelines, and solutions. The ideal candidate will have experience in data engineering and best practices for data storage, integration, transformation, and access within Azure and on-premises platforms.

Requirements

• Proven experience in data engineering and best practices for data storage, integration, transformation, and access within Azure and on-premises platforms.
• Proven expertise in designing and implementing data solutions utilizing Azure Resources (Azure Data Factory, Azure Synapse, ADLS, etc)
• Strong experience with data integration, ETL processes, and data warehousing.
• Advanced proficiency in SQL, Python, and PowerShell.
• Proven knowledge of data modeling, governance, and data engineering best practices and patterns.
• Hands-on experience with optimizing data ingestion pipelines and notebooks for scale, performance, reliability, and cost efficiency.
• Familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST).
• Strong problem-solving, communication, and collaboration skills.
• Ability to create documentation for data processes and solutions.
• Ensure data security and compliance with industry standards.
• Experienced in agile development methodologies and DevOps best practices.
• Git/Github experience for CI/CD.
• Coaching, mentoring, and technical guidance for junior team members.
• Analytical skills for profiling and analyzing large data sets.
• Critical thinking and attention to detail.
• Debugging skills for data solution issues.
• Collaborate with data scientists, analysts, and stakeholders.
• Monitor and maintain data pipelines.
• Design, develop, and test data mapping with transformation rules.
• Ensure data quality and reliability.
• Develop and maintain documentation for data integration and ETL solutions.

Benefits

• Medical, dental, vision, life, and disability insurance
• 401K with a company match
• Tuition reimbursement
• PTO
• Company paid holidays
• Flexible work arrangements
• Cultural Awareness Day in support of IDE
• On-site medical/wellness center (Worcester only)

Tagged as: Data Analysis, Python, SQL