Sopra Steria is a leading European technology player seeking a Senior Databricks Data Engineer to contribute to the development of modern data architectures, designing, developing, and implementing scalable data pipelines, and managing Delta Lake, with expertise in Apache Spark, cloud services, and data governance.
Requirements
- Design, develop, and implement scalable and high-performance data pipelines
- Coordinate workload optimization with Data Scientists and Data Architects
- Lead the design of the Medallion architecture (Bronze, Silver, Gold) and manage Delta Lake
- Resolve technical bottlenecks and ensure the delivery of robust solutions for large volumes of data (Batch and Streaming)
- Expertise in developing complex data pipelines using Apache Spark (PySpark, Spark SQL, Scala)
- Managing Data Lakehouses, data governance and security, collaboration, automation, and monitoring
- Strong background in cloud services and technologies, particularly Microsoft Azure
Benefits
- Generous Paid Time Off
- 401k Matching
- Retirement Plan
- Visa Sponsorship
- Four Day Work Week
- Generous Parental Leave
- Tuition Reimbursement
- Relocation Assistance
To apply for this job please visit jobs.smartrecruiters.com.
Follow us on social media