Senior Data Engineer

On Site Full TimeSydney, New South Wales, AustraliaNCS Group

We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines on Azure-based cloud platforms.

Requirements

  • Design, build, and optimize scalable, reliable data pipelines using Azure Databricks, PySpark, and Delta Lake to support large-scale data transformation and analytics needs.
  • Develop and maintain complex SQL and Python code for data ingestion, transformation, validation, and quality checks across cloud data platforms.
  • Implement end-to-end pipelines leveraging Azure services such as ADLS and Azure Data Factory, while configuring and managing Databricks notebooks, workflows, jobs, and clusters for performance and cost efficiency.
  • Apply CI/CD best practices to deliver production-grade data engineering solutions, monitor and troubleshoot pipeline performance, and collaborate closely with stakeholders to translate business requirements into robust, secure, and high-quality data solutions.

Benefits

  • Paid parental leave
  • Initiatives focused on well-being
  • Discounted health insurance
  • Discounts on various products and services
  • Regular recognition and rewards for high performance

To apply for this job please visit jobs.smartrecruiters.com.


You can apply to this job and others using your online resume. Click the link below to submit your online resume and email your application to this employer.

Tired of manual job applications?

JobCopilot auto-applies to thousands of RevOps and GTM roles on your behalf — so you can focus on interviews, not applications.

Applying for this role?

Tailor your resume to this exact role — hiring managers notice the difference.

Latest articles on the blog

RECRUITERS!

Reduce the risk of your recruitment process (applicant quality, long and inefficient process) by selecting from a relevant pool of candidates.

POST A NEW JOB NOW!