Agent Operations Engineer (LLMOps)

On Site Full TimeCalifornia, United StatesMomcozy

Role Overview

We are building local engineering teams in Singapore and the United States and are looking for an Agent Operations Engineer with strong AI application knowledge and solid operations engineering skills. You will own the production stability, quality, and ongoing operations of our AI agent products.

What You Will Do

Own production operations of AI agents, build an agent performance monitoring system, lead incident triage and root-cause analysis, manage staged rollouts, maintain and optimize prompt templates, establish a Bad Case collection, and own safety and compliance checks for agents.

Why It Might Be a Fit

We expect you to deeply understand the engineering characteristics of LLM applications, establish standardized agent operations practices, and maintain strong sensitivity to user experience and business outcomes.

Requirements

  • 3+ years in software development, operations, or technical support, with AI / LLM project experience
  • Solid understanding of LLM application engineering: prompt engineering, RAG, function calling, streaming, and context management
  • Production operations experience with monitoring, alerting, log analysis, troubleshooting, and incident response
  • Proficient in Python for writing operations scripts, data processing, and automation
  • Working knowledge of LLM fundamentals and common issues (hallucination, latency variance, cost control, safety boundaries)
  • Experience with A/B testing and evaluation, including experiment design and result analysis
  • Strong analytical and problem-solving skills in complex systems
  • Professional fluency in both English and Chinese, including technical discussions, meetings, and written documentation
  • Ability to work effectively across cultures, countries, and time zones

Tagged as:

To apply for this job please visit linkedin.com.

RevOps Careers Favicon

Get the latest RevOps jobs every Monday.

No noise. Just the best GTM roles, curated weekly.

We don’t spam! Read our privacy policy for more info.

Get the full Role Intel for this job

ReLoop.me’s full Role Intel shows the real level behind the title, an estimated pay range, a must-have checklist and the questions to ask before you apply.

Tired of manual job applications?

JobCopilot auto-applies to thousands of RevOps and GTM roles on your behalf — so you can focus on interviews, not applications.

Applying for this role?

Tailor your resume to this exact role — hiring managers notice the difference.

Latest articles on the blog

RECRUITERS!

Reduce the risk of your recruitment process (applicant quality, long and inefficient process) by selecting from a relevant pool of candidates.

POST A NEW JOB NOW!