Senior Principal Engineer – Data Engineering

We are seeking a Senior Principal Engineer – Data Engineering to join our Mercer Team at Marsh. The role is based in Noida/Gurgaon and involves designing and implementing scalable data pipelines and AI-based solutions using Databricks. The successful candidate will work on cutting-edge cloud and hybrid data projects, transforming raw data into meaningful insights and AI Analytics.

Requirements

• Develop and maintain data pipelines using Databricks and the Medallion Architecture (Bronze, Silver, Gold layers).
• Design AI-based Solution using Databricks Genie and E2E integration.
• Knowledge of exposing/consuming Databricks features via API using cloud-native tools or other application.
• Write data transformation scripts using Python and PySpark.
• Store and manage real-time data in AWS S3 and integrate with other cloud-based services.
• Use SQL to query, clean, and manipulate large datasets.
• Collaborate with cross-functional teams to ensure data is accessible for business intelligence and analytics.
• Monitor and troubleshoot data pipelines for performance and reliability.
• Document data processes and follow best practices for scalability and maintainability.
• Ingest and process structured and unstructured data across batch and streaming sources.

Benefits

• Professional development opportunities
• Interesting work
• Supportive leaders
• Vibrant and inclusive culture
• Range of career opportunities
• Benefits and rewards to enhance well-being