Data Engineer

Role Overview

The Data Engineer will work on data pipeline, BigQuery, DataLake, and large data models & queries. They will design schemas, partitioning strategies, data quality frameworks, and access controls for the enterprise data lake. The Data Engineer will also develop batch sync pipelines and implement Web SDK streaming pipelines.

What You Will Do

The Data Engineer will develop batch sync pipelines between BigQuery, Oracle CDP, and Adobe CDP to enable profile, audience, and event data exchange. They will also implement Web SDK streaming pipelines feeding real-time behavioral data into Adobe CDP.

Why It Might Be a Fit

The Data Engineer will work on developing schema-aligned, optimized SQL queries delivering fast execution and efficient data retrieval across BigQuery workloads. They will also ingest intent data provider and advertising platform feeds into BigQuery and onward to Adobe CDP for activation.

Requirements

• Working experience on data pipeline, BigQuery, DataLake, working with large data modals & queries
• Designing schemas, partitioning strategies, data quality frameworks, and access controls for the enterprise data lake
• Developing batch sync pipelines between BigQuery, Oracle CDP, and Adobe CDP
• Implementing Web SDK streaming pipelines feeding real-time behavioral data into Adobe CDP
• Developing schema-aligned, optimized SQL queries delivering fast execution and efficient data retrieval across BigQuery workloads
• Ingesting intent data provider and advertising platform feeds into BigQuery and onward to Adobe CDP for activation