DataOps Engineer

DataOps Engineer responsible for building and maintaining efficient, reliable, and automated data pipelines and systems to ensure seamless data flow across the IBDF. Collaborates with cross-functional teams to optimize data operations and troubleshoot incidents.

Requirements

• Experience in building and maintaining data pipelines using tools like Apache Airflow, Spark or BigQuery.
• Strong knowledge of database management systems (SQL, and NoSQL, e.g. PostgreSQL, MySQL, MongoDB).
• Familiarity with automation and monitoring tools to ensure data infrastructure performance (e.g. Cloud Logging, Apache Airflow).
• Knowledge of agile methodologies for project management and delivery.
• Excellent collaboration skills with operational and infrastructure teams.
• Attention to detail to troubleshoot and fix system errors.
• Time management skills to respond to incidents efficiently.
• Proactive mindset to optimize and improve existing processes.
• 3-5 years of experience in DataOps or data engineering roles focused on pipelines.
• Proven expertise in managing cloud-based data infrastructure (AWS, Azure, GCP).
• Previous experience working with DataOps or DataOps methodologies.

Benefits

• Competitive benefits