Product Operations Manager, Model Quality

Role Overview

We are seeking a Product Operations Manager to drive model quality across all Meta surfaces. The team is building and operating autonomous agents that handle end-to-end workflows with minimal human intervention. The role is expected to set strategy for LLM models, determine areas of investment for increasing accuracy, advise leadership on impending risks, and define roadmaps and reporting strategy.

What You Will Do

The Product Operations Manager will be responsible for managing and evaluating AI solutions and infrastructure to improve precision, prevent drift, and maintain real-time observability. They will build and maintain industry-wide expertise, develop effective cross-functional relationships, advise engineering and cross-functional partners on areas of investment, and determine staffing needs.

Why It Might Be a Fit

The ideal candidate will have experience building or deploying AI/ML solutions, LLM model quality, or automation in production workflows. They will be able to design AI workflows that operate effectively within enterprise data sensitivity constraints, balancing quality and privacy principles.

Requirements

• Bachelor’s degree in a directly related field, or equivalent practical experience
• 7+ years of experience in strategy, operations, consulting, or data analysis
• Analytical experience using data to tell a story and influence product direction using intermediate to advanced SQL
• Experience building or deploying AI/ML solutions, LLM model quality or automation in production workflows
• Strong communication skills with ability to influence multiple cross-functional stakeholders and senior leadership
• Experience breaking down ambiguous issues into component parts to develop solutions
• Ability to design AI workflows that operate effectively within enterprise data sensitivity constraints, balancing quality and privacy principles

Benefits

• Bonus
• Equity
• Dental insurance
• Vision insurance
• Paid holidays

Tagged as: Data Analysis, SQL