Data Engineer

Role Overview

The Data Solutions Engineer – II, Enabling Functions Data responsible for designing, developing and operations support/maintaining the data assets and data products, evolution of the datasets and data products in the Enterprise Data lake supporting Enabling Functions (HR, Finance, Law, Compliance, Procurement, etc).

What You Will Do

Accountable for enhancing and delivering high quality, data products and analytic ready data solutions for Enabling Functions, developing cloud-based (AWS) data pipelines to facilitate data processing and analysis, building end to end data ETL pipelines from data integration -> data processing -> data integration -> visualization.

Why It Might Be a Fit

The ideal candidate will have a strong background in data engineering, and data systems/data products be comfortable working with both structured and unstructured data, prior domain experience with enterprise functions (HR/ Finance/ Compliance/ Procurement) is a big plus.

Requirements

• 3-5 years of experience in information technology field in developing AWS cloud native data lakes and ecosystems including some production support experience
• Hands on experience with programming and analytics capabilities using some AWS (Amazon Web Services) Native Services (Glue Studio, Athena, Redshift, Postgres DB etc.)
• Programming skills in languages such as Python, Pytorch, etc.
• Atleast 1-2 years of experience in an onshore offshore delivery model
• Solid programming skills in Python and Spark and strong proficiency in Cloud – AWS
• Knowledge of data security and privacy best practices
• Experience with SQL and database technologies such as MySQL, PostgreSQL etc.
• Hands-on experience with Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and Databricks Workflows for building and managing scalable data pipelines.
• Strong experience in Databricks development and optimization, including PySpark/SQL, cluster and job configuration, performance tuning, and implementing production-grade data pipelines.

Benefits

• Comprehensive benefits

Tagged as: Python, SQL