Data Engineer

Role Overview

Join our team as a skilled Data Engineer to design, develop, and maintain scalable and efficient data pipelines and infrastructure to support our data-driven initiatives.

What You Will Do

Implement, maintain, and evolve cloud-based Big Data products and services, design and implement ETL processes, analyze data warehouses, and write large amounts of code.

Why It Might Be a Fit

We’re looking for a team player with strong communication skills, ability to adapt and learn different technologies, and desire to learn fast and pick up latest technologies and tools.

Requirements

• At least 2 years relevant work experience
• Working experience in software development using Java, Scala, or Python
• Extensive experience in implementing scalable and reliable ETL pipelines using Big Data Technologies such as Apache Spark, Hadoop, AWS Glue
• Experience transforming data in various formats (JSON, CSV, PARQUET, YAML, Avro, Orc)
• Experience managing and scheduling workflows (Apache Airflow experience is preferred)
• Experience with working on SQL Databases (Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes are preferred)
• Ability to analyze and simplify complex code and algorithms in Java, Scala or Python
• Ability to adapt and learn different technologies that best solves the problem regardless of whether it is written in Python, Java, Scala, etc.
• Ability to perform ad-hoc complex SQL queries and query optimization
• Team player with strong communication skills
• Desire to learn fast and pick up latest technologies and tools
• Experience with data visualization software (Tableau preferred) is a plus
• Experience with Kubernetes and Machine Learning is a plus

Tagged as: BigQuery, Data Analysis, Data Visualization, Python, SQL