Data Engineer

Role Overview

The Data Engineer plays a central role within the Software Engineering team, responsible for building and maintaining the data pipelines that feed the firm’s Microsoft Fabric Data Lakehouse. Working closely with the Data Architect, this role ingests, transforms, and curates data from the firm’s core business systems through a medallion architecture to deliver trusted, analytics-ready datasets that power reporting, business intelligence, and AI-driven applications across the firm.

What You Will Do

Design, build, test, and maintain ETL/ELT pipelines that ingest data from the firm’s enterprise systems into the Microsoft Fabric Data Lakehouse, using Data Factory pipelines, and Spark notebooks. Implement and maintain the bronze, silver, and gold layers of the firm’s medallion architecture, covering raw ingestion, cleansing and conformance, and curated analytics-ready models.

Why It Might Be a Fit

The ideal candidate will have 3-5+ years of hands-on ETL/ELT or data engineering experience building and supporting production data pipelines, with a strong T-SQL skills, proficiency in Python and PySpark, and experience with incremental load, change data capture, and slowly changing dimension patterns.

Requirements

• 3-5+ years of hands-on ETL/ELT or data engineering experience building and supporting production data pipelines
• Microsoft Fabric experience is preferred but not required
• Strong T-SQL skills, with proven hands-on experience in MS SQL Server including query optimization and performance tuning
• Proficiency in Python and PySpark, or a demonstrated ability to ramp up quickly on Spark-based transformation
• Experience with incremental load, change data capture, and slowly changing dimension patterns
• Rigorous approach to data quality, including validation, reconciliation, and alerting
• Familiarity with source control (Git) and CI/CD practices for data artifacts
• Experience building, maintaining, and supporting analytics models for reporting
• Power BI development experience a plus, including semantic models, DAX, and report delivery

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• Prescription drug insurance
• Life insurance
• Disability insurance
• FSAs
• 401K
• Paid time off