Design, build, and deploy scalable and secure data engineering pipelines using the Databricks platform on Azure, and partner with clients to understand their data needs and develop innovative solutions.
Requirements
- Design and develop robust pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog
- Build real-time event-driven solutions with tools such as Kafka and Azure Event Hubs
- Apply DevOps principles to develop CI/CD pipelines using Azure DevOps, Jenkins, or GitHub Actions
- Collaborate with clients and stakeholders to translate data needs into strategic technical solutions
- Champion clean code, data lifecycle optimisation, and software engineering best practices
Benefits
- Discretionary bonus
- Competitive pension
- Health insurance
- Life insurance
- Critical illness cover
- Mental health support
- Family-friendly leave policies
- Family care
- Holiday flexibility
- Continuous learning opportunities
- Healthcare access
- Extra perks
To apply for this job please visit job-boards.greenhouse.io.
Follow us on social media