Role Overview
The AI Data Engineer will specialize in building and optimizing machine learning data pipelines, focusing on AI model tracking, lifecycle management, and integration with AI governance systems.
What You Will Do
Design and implement specialized data pipelines for AI model metadata, training data lineage, and model performance metrics tracking. Build data infrastructure on Databricks leveraging Spark for large-scale distributed dataset processing.
Why It Might Be a Fit
This role combines data engineering expertise with AI/ML knowledge to support the organization’s broader data and AI infrastructure initiatives.
Requirements
- 5+ years of hands-on experience in data engineering, with at least 2 years focused on AI/ML workloads.
- Expert proficiency in Python and experience with ML frameworks such as PyTorch, TensorFlow, or scikit-learn.
- Strong experience with Databricks, Apache Spark, and distributed computing for ML workflows.
- Deep understanding of the machine learning lifecycle, including model training, deployment, and monitoring processes.
- Experience with feature engineering, data preprocessing techniques, and ML data pipelines.
- Knowledge of vector databases, embeddings, and similarity search for AI applications.
- Proficiency in SQL for structured and unstructured data management.
- Understanding of data governance, model governance, and AI ethics principles.
- Strong analytical and problem-solving capabilities with attention to data quality.
- Excellent collaboration skills for working with data scientists, ML engineers, and architects.
- Bachelor’s or Master’s degree in Computer Science, Data Science, Machine Learning, or related field.
Benefits
- Health & Wellness: Health care coverage designed for the mind and body.
- Flexible Downtime: Generous time off helps keep you energized for your time on.
- Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
- Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
- Family Friendly Perks: It’s not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
- Beyond the Basics: From retail discounts to referral incentive awards—small perks can make a big difference.
To apply for this job please visit spgi.wd5.myworkdayjobs.com.
Follow us on social media