AI Operations & QA Tester – Overnight Coverage

Remote Full TimeUnited States (Remote)WhyBrilliant

Role Overview

The role involves owning end-to-end overnight operational quality, prompt analysis, and QA monitoring across all live customer channels. The candidate will work with high autonomy and ownership, ensuring uninterrupted quality for live AI insurance agents.

What You Will Do

The candidate will monitor live AI customer conversations, evaluate AI responses against insurance guidelines, inspect system prompts and logs, run regression test suites, and deliver concise handover shift reports.

Why It Might Be a Fit

The ideal candidate will have 2+ years of QA or structured software/AI testing experience, be an AI-native professional, and have strong written communication skills.

Requirements

  • 2+ years of QA or structured software/AI testing experience
  • AI-native professional comfortable reading system prompts and evaluating LLM outputs
  • Highly autonomous operator thriving in dedicated asynchronous ~21:00–06:00 UTC shifts
  • Strong written communicator who logs clean, evidence-backed bug reports
  • Regulated industry background (fintech, insurance, legal) is a strong plus
  • Professional German proficiency (C1+) is a significant advantage

Benefits

  • Extreme operational autonomy with high ownership over critical live systems
  • Zero corporate red tape: no steering committees, no endless sprints, same-day deployments
  • Direct impact working on cutting-edge production AI applications serving real customers
  • Flexible remote schedule ideally suited for daytime/afternoon hours in APAC and Americas timezones

To apply for this job please visit linkedin.com.

RevOps Careers Favicon

Get the latest RevOps jobs every Monday.

No noise. Just the best GTM roles, curated weekly.

We don’t spam! Read our privacy policy for more info.

Get the full Role Intel for this job

ReLoop.me’s full Role Intel shows the real level behind the title, an estimated pay range, a must-have checklist and the questions to ask before you apply.

Tired of manual job applications?

JobCopilot auto-applies to thousands of RevOps and GTM roles on your behalf — so you can focus on interviews, not applications.

Applying for this role?

Tailor your resume to this exact role — hiring managers notice the difference.

Latest articles on the blog

RECRUITERS!

Reduce the risk of your recruitment process (applicant quality, long and inefficient process) by selecting from a relevant pool of candidates.

POST A NEW JOB NOW!