LANG: |
// ONLINE PRESENCE

Shaun McIlroy

AI Product Quality Lead

Investigating how AI and product systems behave in real-world environments. Building frameworks that make that behaviour measurable and reliable.

View all work Get in touch
CURRENT.FOCUS --:--:--
FOCUS LLM EVALUATIONS
GOAL AI SYSTEM RELIABILITY
PROJECT DATA CONNECTORS [HS]
PLAY PHOTOGRAPHY
LIFE ADVENTURES WITH FAMILY
LEARNING JAPANESE

Latest Updates

View all updates →

Featured Work

View all →

AI Answers for Email

2026 IN DEV

Defined escalation rules, exclusion boundaries, and safe-answer categories for the expansion of Help Scout's AI Answers into email workflows, establishing guardrails for when the system should respond and when it should defer to human support.

AI QualityProduct SafetyWorkflow Design
VIEW PROJECT →

AI Answers

2025

Output quality and reliability lead for Help Scout's AI Answers. Designed the evaluation framework used to assess response quality, drove prompt improvements across response types, and monitored production outputs to ensure stable, reliable performance.

LLM EvaluationPrompt EngineeringAI Quality
VIEW PROJECT →

Advanced Triage Programme

2024

Onboarding structure, investigation process, and coaching approach enabling teammates to build confidence and capability in complex technical investigations.

Process DesignCoachingRoot Cause Analysis

Photos

View gallery →
Long exposure photograph of a Tokyo boulevard at night, red and white light trails stretching into the distance
Tokyo, Japan
Family with baby smiling in front of the torii gate tunnel at Fushimi Inari shrine in Kyoto
Fushimi Inari, Kyoto
Close-up of a weathered stone kitsune fox guardian statue wearing a pink bib at Fushimi Inari shrine
Fushimi Inari, Kyoto
Baby sitting on a tree stump in front of a large Totoro statue at Donguri Kyowakoku, Tokyo Skytree Town Soramachi
Donguri Kyowakoku, Soramachi

Resume

Full work history, skills, and background.

Download Resume