Senior Data Engineer

Role Overview

As a Senior Data Engineer at Talent Insider, you will connect diverse data sources, ensure data consistency and quality, and optimize data pipelines for reporting. You will partner with engineering and business teams to build data solutions that meet their specific needs and requirements.

What You Will Do

Your main responsibilities will include building bridges between various data sources, ensuring data accuracy and consistency, designing and maintaining data pipelines for timely and accurate reporting, and developing scalable and optimized data solutions.

Why It Might Be a Fit

This role requires over 1-4 years of experience with building data pipelines, handson experience with SQL/Python/Java/Scala programming, and experience with cloud computing platforms and Big Data tools.

Requirements

• Over 1-4 years of experience with building data pipelines or data ingestion for both Batch/Streaming data from different sources to data warehouse / data lake
• Handson experience/knowledge with SQL/Python/Java/Scala programming, understanding of SQL is a must
• Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, Bigquery), Azure (Blob/Azure, Synapse) etc.
• Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto)
• Data pipelines & orchestration tool (Ozzie, Airflow, Nifi)