15.S50 · Session 9 · Monitoring Agents, Domain Expert Leaders

The case, Session 9

A lean working document. No company is signed and no speaker is listed, which makes this the one case where the candidates are already known: two of my own client deployments, disclosed as such below. Drafted now: the tension, the candidate comparison, the debate armed with cited evidence, and the interview guides. Each section notes what fills in once a company is real.

01 · The tension

What this is a case of

  • domain expert who used to do the work now supervises agents that do it -> goals, boundaries, oversight of systems that plan, decide, execute
  • the shift: manual engagement -> abstract, information-mediated oversight
  • central tension in March's vocabulary (1991, Organization Science): exploiting current capabilities vs exploring evolving potential
  • the decision the case carries -> where the authority line sits today, and what evidence should move it
  • framework payoff = the supervisory learning arc (judgment and capability rising together)

When the company signs: the interviews establish the real authority line, the overrides that moved it, and the moment the domain expert first disagreed with the system and was right, or wrong.

02 · The formula

The case anatomy, and the disclosure gate

Same gates as every case in this course, with one that belongs to me.

GATE 0

The disclosure

Mine to clear first
  • both candidates run systems I built through hamz.ai -> Kate hears this first, before either is proposed
  • framed as what it is: unusual access, a builder's view of the stack, a conflict managed in the open
  • protagonist = the client's domain leader, not me; my role = technical backstory, in the case if she wants it
GATES 1–2

Agreement, then the feasibility filter

Candidates known
  • open question for both: client publicity appetite (budget for a framing trade; it already happened on the IBM case)
  • the $250K/yr and ~90% faster figures are client-side claims, not verifiable in code -> stay out of all material until the client confirms
GATES 3–6

Interviews, framing, debate, framework

Drafted below
  • protagonist -> joint interview; my builder's-view note openly labeled
  • debate poles in section 5 (cited evidence); override logs + interviews arm them with the company's own
03 · Company TBD

The two candidates, compared

Lead first. Both are real deployments with domain experts supervising daily.

Lead · the business-aviation operator
Dispatchers supervise a pre-flight feasibility engine: a 17-check decision engine where agents classify NOTAMs, validate aircraft-against-runway compatibility, and scan for disruptive events, behind a deterministic check engine with fallback chains (verified in the codebase). The supervision stakes are safety-relevant, which is exactly what makes the domain-expert story rich: what a dispatcher confirms, what he overrides, and what he has stopped checking himself. Risks: aviation clearance culture, and the story needs the operator comfortable naming near-misses.
Backup · the physiotherapy clinic
Clinicians supervise a patient-intake agent with an unusually clean monitoring story, verified in code: a shadow A/B harness for testing changes on live traffic without acting on it, drift detection with a deterministic dispatcher that overrides the model when it wanders, a red-flag checklist the AI pre-checks but a clinician must confirm, and a tamper-evident audit chain. Risks: smaller stakes, smaller company, and the supervision arc is younger.

The choice may also turn on scheduling and on which client says yes first. The comparison is written so either can carry the case.

04 · The hook

Opening scene, drafted lean

Written for the aviation lead; swaps cleanly to the clinic if the choice flips.

For eleven years [NAME] had made the call himself: runway by runway, NOTAM by NOTAM, the whole feasibility picture assembled by hand before anyone quoted the trip. Now the engine did it in minutes, seventeen checks, each one green, amber, or red, and his name was still the one on the release. In his first week of supervising instead of doing, he overrode the system twice. The first time he was right, and the team called it proof the human was still essential. The second time he was wrong, and nobody called it anything at all. The question he brought to [MONTH]'s ops review was not whether the engine worked. It was what, exactly, he was still checking, and how he would know when to stop.

When the company signs: the real overrides, the real dates, the decision point the board or ops review actually faced.

05 · The debate

The two board memos

Each pole armed with cited evidence now, and with the company's own once the interviews run.

Memo A · Widen the agent's authority now
The claim: the checks hold, the backlog is real, and the human layer is thinner than it looks, reviewers drift into confirming rather than checking, so holding authority buys less safety than it appears to. The evidence: the system's own record, run counts, catch rates, override rates that fall as trust calibrates, plus the operational cost of every decision waiting on a person. The risk Memo B will cite: falling override rates can mean rising trust or decaying vigilance, and the log alone cannot tell you which.
Memo B · Hold authority until supervision matures
The claim: the supervisor's judgment is the asset, and it decays exactly when the agent improves. The evidence: Bainbridge's ironies of automation (1983, Automatica), the skills you need to oversee automation erode once you stop doing the work; Lee and See on trust calibration (2004, Human Factors), trust must track actual capability, not fluency; Endsley's out-of-the-loop problem, the supervisor who is out of practice is slowest exactly when the system fails. The risk Memo A will cite: a supervision regime that never widens authority changes nothing about the work.
06 · Exhibits

Exhibits, named and waiting

What each will hold. EX A can be drafted from the systems now; the rest wait on the company.

EX A · The supervision arc
Stage by stage, what the domain expert sees, what he decides, and what decides without him, from the deployed system's actual mechanisms. Draftable now, confirmed in interviews.
EX B · The override log
Overrides over time, split by outcome: the human was right, the human was wrong, nobody ever checked. The case's most important number. [COMPANY DATA]
EX C · Roles, before and after
What the domain expert's week was before the agent, and what it is now, hours, tasks, and the checks he has consciously stopped doing. [COMPANY DATA]
07 · The scarce input

Interview guides

Five to six questions each, tagged to exhibits. Protagonist interview is joint.

Protagonist, the domain leader · joint interview

The first thing he stopped checking himself and how that felt (EX C), the override he was right about and the one he was wrong about (EX B), what he looks at every morning versus what he trusts blind (EX A), what evidence would make him widen the agent's authority, and what he is teaching the next dispatcher or clinician now that the doing is gone.

Dispatcher / clinician · solo

A day in the supervision seat as it actually runs (EX A), the last time the system surprised him, whether confirming ever slides into rubber-stamping, honestly, and what the red flag or amber check means to him versus what the manual says it means.

Operations manager · solo

How the authority line got set and by whom (EX A), what the override log gets used for, if anything (EX B), and how a new hire learns supervision when there is no doing left to apprentice on.

Builder's note · me, disclosed

What the system was designed to surface versus what its users actually look at, where the monitoring is real and where it is decoration, written openly as the vendor's view and labeled that way in the case packet.

08 · The second use

From case to article

The supervision half of the monitoring article: the arc from doing to overseeing, anchored by a real domain expert with a real override log. Same transcripts, two artifacts, cleared for both uses at once.