GCP Data Engineer, AVP

Job Description for GCP Data Engineer, AVP: Design, develop and maintain data pipelines using Python and SQL programming language on GCP. Perform end-to-end development of integrations, data preparation/synthesization/transformation, data quality, data storage workloads, and advanced data analytics.

Requirements

• Design, develop and maintain data pipelines using Python and SQL programming language on GCP
• Expertise on API development and integration
• Experience on writing SQL queries and optimizing it
• Strong programming skills with Python
• Experience with GCP Composer or Apache airflow
• Hands-on experience on streaming data pipelines
• Worked on near real-time services like Pub Sub/Kafka
• Proven experience on app development and hosting over cloud platform with help of Docker (preferably GCP, cloud run)
• A willingness to accept failures, learn and try again
• Experience in Agile methodologies, ETL, ELT, Data movement and Data processing skills
• Work with Cloud Composer to manage and process batch data jobs efficiently
• Develop and optimize complex SQL queries for data analysis, extraction, and transformation
• Develop and deploy google cloud services using Terraform
• Consume and Hosting REST API using Python
• Build and deploy AI and RAG pipelines
• Design, build and deploy agentic workflows
• Operationalize AI applications
• Monitor and troubleshoot data pipelines, resolving any issues in a timely manner
• Ensure team collaboration using Jira, Confluence, and other tools
• Ability to quickly learn new any existing technologies Strong problem-solving skills
• Write advanced SQL and Python scripts
• Strategize novel approaches for designing, implementing, deploying robust and scalable ai systems

Benefits

• Best in class leave policy
• Gender neutral parental leaves
• 100% reimbursement under childcare assistance benefit (gender neutral)
• Sponsorship for Industry relevant certifications and education
• Employee Assistance Program for you and your family members
• Comprehensive Hospitalization Insurance for you and your dependents
• Accident and Term life Insurance
• Complementary Health screening for 35 yrs. and above