AI Operations Analyst

Role Overview

The AI Operations Analyst manages day-to-day operational analysis and monitoring for AI applications and AI agents, helping maintain reliable, secure, transparent, and cost-effective services. The role combines hands-on investigation, dashboard and reporting ownership, incident coordination, and continuous improvement of established operational processes.

What You Will Do

Own routine monitoring of AI applications and agents, analysing logs, traces, model and tool calls, retrieval steps, latency, failures, and token consumption to identify service issues. Investigate incidents using logs and traces, develop evidence-based hypotheses, and coordinate next steps while following approved access and sensitive-data handling procedures.

Why It Might Be a Fit

The role requires a practical understanding of AI or machine learning applications, with experience supporting AI-enabled services or analysing their operational data. Working proficiency with scripting language, APIs, and structured data analysis, including automation of routine operational tasks. Ability to independently manage assigned operational activities, investigate ambiguous issues, recommend improvements, and recognise when specialist escalation is required.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Data Analytics, Artificial Intelligence, or a related discipline, or equivalent relevant experience.
• 3–5 years of relevant experience in IT operations, application support, operational analytics, DevOps, or a related technical area, including hands-on responsibility for monitoring, incident investigation, or service reporting.
• Practical understanding of AI or machine learning applications, with experience supporting AI-enabled services or analysing their operational data.
• Working proficiency with scripting language, APIs, and structured data analysis, including automation of routine operational tasks.
• Hands-on familiarity with cloud services, version control, and software delivery processes; ability to work within established testing and change-management practices.
• Experience using dashboards, logs, metrics, and traces to investigate incidents, explain service trends, and improve operational reporting.
• Working understanding of generative AI application patterns, including prompts, model responses, RAG, and tool calling, and their implications for monitoring and troubleshooting.
• Working knowledge of secure data handling, access controls, privacy-aware logging, and operational audit evidence.
• Ability to independently manage assigned operational activities, investigate ambiguous issues, recommend improvements, and recognise when specialist escalation is required.
• Clear technical communication, effective cross-team coordination, and strong documentation and follow-through skills.

Benefits

• Annual bonus with set target (% of pay) depending on pay grade / location
• Vacation days
• Parental leave for a minimum of 12 weeks
• Bereavement leave
• Caregiver leave
• Volunteer leave
• Well-being reimbursement
• Programs for financial, physical and mental health
• Service anniversary and recognition awards
• Insurance plans

Tagged as: Data Analysis