Data Engineer

Role Overview

Join Stefanini as a Data Engineer, working with a team to design, develop, and maintain data pipelines, implementing data processing and storage solutions on Google Cloud Platform.

What You Will Do

Design and develop data pipelines, implement data processing and storage solutions, participate in data platform migration and modernization processes, and collaborate with various teams.

Why It Might Be a Fit

The ideal candidate will have experience with Google Cloud Platform, data modeling, and transformation, as well as a strong understanding of data governance and quality.

Requirements

• Primary stack: Google Cloud Platform (GCP). BigQuery. Cloud Storage. Dataflow and/or Dataproc. Pub/Sub. Python. Advanced SQL. Apache Spark/PySpark. Data pipeline ETL/ELT development. Data modeling and transformation. Airflow/Cloud Composer for orchestration.
• Desired knowledge: DBT and/or Dataform. Terraform. Git and CI/CD processes. Data Lake/Data Warehouse/Lakehouse. Hadoop and/or Kafka. Relational and NoSQL databases. Machine Learning and/or Vertex AI. Data governance and quality.

Tagged as: BigQuery, Python, SQL