We’re looking for a Senior Data Engineer with experience in Azure Databricks, data processing, and API development. You will design and implement scalable data pipelines, develop services and APIs, and build infrastructure using IaC tools.
Requirements
- 5+ years of experience with Azure Databricks: Unity Catalog, Apache Spark / PySpark, Databricks Asset Bundles.
- Advanced Python (OOP) skills.
- Experience building backend APIs using FastAPI and/or Flask.
- Strong experience with Infrastructure as Code (IaC): BICEP and/or Terraform
- Solid experience with data processing at scale.
- Strong knowledge of SQL.
- Experience with NumPy and Pandas.
Follow us on social media