Seeking an experienced Azure Data Engineer to support the migration of an existing on prem/Azure VM–hosted SQL Server and SSIS estate into Azure Data Factory (ADF).
Requirements
- Azure & Data Platform
- Strong hands-on experience with Azure Data Factory
- Experience designing pipelines, parameterized templates, reusable datasets, linked services, triggers & scheduling, monitoring, logging and error handling in ADF
- CI/CD for ADF (ARM/Bicep/Terraform or Azure DevOps/GitHub)
- SQL & ETL
- Deep experience with SQL Server Integration Services
- Proven experience migrating pipelines to ADF
- ETL/ELT design patterns
- Data transformation and ingestion from files (Excel, CSV, flat files)
- Azure Infrastructure
- Experience working with Azure Virtual Machines, Storage accounts / Blob / ADLS
- Assessing existing pipelines and producing migration approaches
- Lift & shift vs refactor decision making
- Consolidating similar jobs into parameterized pipelines
- Designing modular, reusable ADF components
- Batch delivery / phased releases
- Unit testing & data validation
- Documentation and knowledge transfer
- Providing best practice guidance and mentoring
Benefits
- Paid Time Off
- Other benefits not specified
Follow us on social media