Role Overview
The role is for a Senior Data Engineer with experience in DataStage, Teradata, and SQL, to migrate data to Azure Databricks. The engineer will require strong experience in data migration, reconciliation, and validation, as well as unit testing and production support.
What You Will Do
The Senior Data Engineer will be responsible for migrating data from DataStage to Azure Databricks, using tools such as Teradata utilities, JDBC/ODBC connectivity, and ADLS Gen2, Delta Tables, and Unity Catalog.
Why It Might Be a Fit
The ideal candidate will have strong experience in data migration, reconciliation, and validation, as well as unit testing and production support. They will also require experience in Azure Databricks and Spark SQL.
Requirements
- Strong experience in IBM DataStage, Teradata & SQL
- Azure Databricks / Spark SQL
- Teradata utilities – BTEQ & TPT
- JDBC/ODBC connectivity
- Data migration, reconciliation & validation
- ADLS Gen2, Delta Tables & Unity Catalog
- Unit Testing, SIT, UAT & Production Support
To apply for this job please visit linkedin.com.
Follow us on social media