Working draft Fictional teaching case · disguised composite · not for distribution
15.S50 · Session 3 · Implementing AI Agents in a Call Center

The case

A decision-forcing case about where a leader points one year of build budget when he has more good ideas than money. Below is the case as it stands, its exhibits, and how it tested against a room of simulated students before it meets a real one.

The case

Bank A: The Next Build

Fictional case. Bank A is a composite of a large US consumer bank. Names, figures, and identifying details have been changed or invented to protect confidentiality.

What Bell remembered

Bell had been at the bank long enough to remember the old call center, back when automation there meant a phone tree and hold music. The tree made people learn the bank's categories before the bank would listen to their problem. Press one for balances, press two for payments, press three for a lost or stolen card, and if you pressed the wrong one the system sent you back to the top. A customer would sit with a bill open, trying to remember whether they had pressed two or three, wait through the hold music, and sometimes learn the office had closed only after the wait.

He had worked that floor for years, long enough to know exactly what was wrong with it. He knew what it did to customers, and he knew what it did to the people who worked the phones. Reps picked up calls that were already angry, because the system had made the customer wait before it let them reach a person. Managers measured seconds, because seconds were the only thing they could afford to improve. For years the department's answer to a December call spike was to route a little faster and put a few more people on the phones.

He led the work that changed it, first with a system that could understand plain speech, so a caller could say what was wrong instead of translating it into a menu, then with the front-line agent that grew out of it, the one customers reach first today. Later came the second agent, the one that sits with the reps. Four years, and a good part of the standing he had built at the bank, went into getting both into production. By the summer of 2026 he ran card servicing, and card servicing ran on two agents he had put there himself. He was proud of that, and the pride was part of what made the choice a hard one.

The choice on the desk

Card servicing had one build line for the coming year, meaning one engineering team, one stretch of its time, about seven million dollars, and two proposals it would not both cover. The executive committee had been plain when it handed the decision down. This was card servicing's call, on card servicing's own budget, and there was no central pool to fund this kind of build this cycle.

The calendar took away the soft options. Whatever Bell's team built, it had to build now, before the line was gone. The bank had a new consumer card coming, Cascade, with a go-live the committee had already fixed and announced for March 3, and Bell's engineers were on the hook for the servicing behind it. From the day they rolled onto Cascade they were spoken for through the rest of the fiscal year. The proposal he passed over would wait a full year for the next cycle, or it would not happen at all. His recommendation was due Friday, and it was Wednesday.

What the floor runs on now

The first agent is the one a customer reaches when they call. They can say “I lost my card,” or “when is my payment due,” or “I'm traveling next week and I don't want a hold on the account,” and the agent verifies who they are, opens the account, does the work, and closes the call. Balances, payment dates, lost cards, travel notices, the ordinary traffic of a card business, it handles end to end. It now finishes a little over seventy percent of contacts on its own, and the share climbs most quarters. Bell watched that number more closely than any other, because it was the plainest sign the thing worked. Customers stopped waiting, and reps stopped taking calls a machine could handle.

The second agent only shows up after a handoff. When the first agent cannot finish, or a caller asks for a person, the call goes to a human rep, and by the time the rep is on, the second agent has already read the account, pulled the recent transactions, and flagged what looks off. The rep starts the conversation with the whole picture in front of them instead of searching six systems while the customer listens to them type. It settles nothing on its own, but it gets the rep to the answer faster. Bell had built it for a blunt reason, because his reps were quitting. Once the first agent took the easy calls, what was left for a person was a day of nothing but complaints and edge cases, and that wears people down. The assist agent was how he kept the floor staffed.

What his own team wanted

There was one call the front-line agent still could not finish, and it was a big one, billing disputes. A customer says a charge was never theirs, or the goods never came, or they were billed twice. The agent hears them out, pulls the charge, checks it against the account, asks the questions the process requires, and gets almost all the way there before it stops and hands off to a person. Provisional credit puts real money out the door on the bank's say-so. Regulation Z, the federal rule that sets deadlines for how a bank must handle a disputed charge, puts hard clocks on the whole thing, and the bank's own guardrails keep a human on the decision. Disputes were close to a fifth of everything that still reached a rep, and they ran the same handful of steps almost every time.

Gary Pruitt, who runs the floor day to day, had been after Bell about it since the spring. He wanted to teach the front-line agent to carry the whole dispute, provisional credit and all, inside the rules the bank already used. “We built it up to the doorstep and stopped,” he told Bell. “The agent does everything except the part that matters, and then it wakes up a person to do the part it already understands. Twenty percent of what still comes to my reps is this. Give me the disputes and I give you back a chunk of the floor.”

The numbers were good, if not quite the clean sweep they looked like at first. The build ran about 2.4 million dollars against a gross benefit near 9 million a year, in handoffs deflected, handle time cut, and reps freed for the calls that need a person. It ran on the busiest system in the department, though, and the running cost that came with that volume, a couple of million a year, pulled the real number down toward seven. It still paid back fast, and it still cleared the bar the department used (Exhibit 3). It was the kind of build Bell had spent years teaching the bank to say yes to, local and measured, with the people who would live with it the ones asking for it.

The case for it was not only the money. Disputes were where the bank's Regulation Z exposure showed up most directly, and a late or unevenly handled dispute could still become a regulator's letter or a customer who closed the account. Handling them the same way, inside the guardrails, might lower that risk somewhat, even if the cleaner case was still cost and capacity. The timing pressed too, because his reps were closest to worn out right as Cascade was about to add a new card's worth of volume to the floor, and the dispute build was the one thing that would take real weight off them before that hit.

There was a catch the risk side kept raising, and Bell did not have a clean answer for it. Teaching the agent to carry the whole dispute meant letting it issue provisional credit on its own read, and moving money out the door on a model's judgment was the exact thing the human gate had been there to hold. A wrong call would stop being a mistake a rep could catch in the moment and become a payment the bank had already made, and the build leaned still more of the department's weight onto the one system that already carried the most. Bell told himself the guardrails would hold, but he had told himself that before.

What compliance wanted

The second proposal came from outside his floor, from Elaine Cho in compliance, and it was a harder thing to defend.

Cho did not want an agent that talked to customers, she wanted one that read the bank's own work before it went out. When a product team ships a new fee disclosure, or changes how a promotional rate is applied, or adjusts a model that decides who gets approved and on what terms, someone in compliance is supposed to check it against the rules before it goes live. Today that someone is a small team reading documents against a launch date, and how good the check is depends on whose desk it lands on and how much time that person has that week. Cho wanted an agent that would read the same material, check it against the bank's compliance requirements, and flag what a person needed to look at before anything shipped. She had come to Bell because his engineers were the ones with room on the calendar. Hers were not.

Cho was careful about how she put it. “I can't give you a number as clean as Gary's,” she said. “The value here is a thing that doesn't happen. A finding we catch in March instead of an enforcement letter in November.” One example still bothered her, a card-marketing disclosure that had gone out for review nine days before launch, and someone caught that it did not say what the CARD Act required it to say. They fixed it in time, but they had nearly not. “The next one we might miss,” she said. Across comparable issuers, she added, cleaning up a single disclosure or CARD Act finding had run into the tens of millions once the remediation and the penalties were counted. None of that was money card servicing would ever see. The direct return to his floor was maybe half a million a year in rework it would not have to redo, against a build of about 6.5 million (Exhibit 4).

She was honest about the part that hurt her own case. “My team is too thin to validate this thing even once it's built,” she said. “I'd need product to lend us their people, and product has a day job.” Near the end, she mentioned one more thing about the design, that the rules engine sat apart from the card-specific rules it checked against. The engine did the reading and the checking, while the rules it applied were a separate set it loaded in. Bell noted the point and set it aside.

What the choice would cost

Bell knew what his scorecard said. He had built that scorecard himself, more or less, over years of arguing for the resources that put his two agents into production. It set what a build cost against what it saved card servicing, and by that measure Gary's dispute agent was the easy yes and Cho's was a hard sell he would have to walk his own team through.

Choosing Cho's build meant telling his floor that the dispute work they had wanted for a year would slip, and with the team moving onto Cascade right after, slip for a good while. Gary would take it hard, and he would have a point, because his people had carried the agent program from the start, absorbed its failures, retrained it, taken the handoffs, and explained the errors to angry customers. Now that the next piece was in reach, the line would go to compliance instead.

Choosing Gary's build was the easy call, and that was the part that nagged him. He would again be the executive who spent the whole line on his own operation while the rest of the bank waited. He had gotten good at that, good enough that his floor ran on two agents while much of the bank was still trying to get its first one through. That had always felt like proof he was moving faster than everyone else, and it had usually been enough to decide by, but this time it was not deciding anything.

He read back over both proposals, the queue of open requests behind them (Exhibit 2), and the compliance findings from the last four quarters (Exhibit 5). The recommendation was due Friday, and after that the team was gone for the year.

The exhibits

What Bell was reading

Every figure here is fabricated and directional, altered for confidentiality. The exhibits carry the seeds a close reader can catch before the instructor delivers the reveal.

Exhibit 1

Key people

PersonRole
Marcus BellHead of Card Servicing. Built the two call-center agents now in production. Owns the build decision.
Gary PruittDirector of Contact Center Operations. Champions the dispute-handling build (Option A).
Elaine ChoCompliance Officer. Champions the compliance-validation build (Option B).
Rena DuAnalyst on Bell's team who reviews what the front-line agent gets wrong and retrains it. Referenced, not a subject of this case.
Exhibit 2

The card-servicing build queue, next fiscal year (excerpt)

One engineering team and one build line, roughly $7M for the year, which will not fund both live proposals. After the year's build ships, the team is committed to the Cascade launch (go-live March 3) and unavailable through the rest of the fiscal year.

RequestOriginEst. buildStatus
Dispute handling, front-line agent (Option A)Card servicing / Contact center$2.4MLive proposal
Compliance validation agent (Option B)Compliance$6.5MLive proposal
Automated document and rules checkingCollectionsnot scopedLogged
Automated document and rules checkingUnderwritingnot scopedLogged
40+ additional requestsVariousnot scopedBacklog
Exhibit 3

Option A business case (dispute handling)

One-time build~$2.4M
Gross annual benefit (deflected handoffs, handle time, reps freed)~$9M
Annual running cost at volume~$2M
Net annual benefit~$7M
Paybackunder 12 months
Scope of benefitcard servicing
Exhibit 4

Option B business case (compliance validation)

One-time build~$6.5M
Direct annual return to card servicing~$0.5M
Running cost at volumeminimal, low query volume
Primary valuerisk of a late-caught compliance finding, not booked to card servicing
Scope of benefitproduct development and compliance review
Exhibit 5

Compliance review, selected findings (last four quarters)

QuarterFindingOutcome
Q1Promotional-rate disclosure flagged in a routine pre-launch reviewCorrected six weeks before launch
Q2Card-marketing disclosure did not meet CARD Act requirements as writtenCaught nine days before launch; corrected in time
Q3Model-change documentation incomplete at launchLaunch delayed three weeks for rework
Q4Fee-schedule update missed a required disclosure lineShipped as written; caught only in a post-launch audit

Footnote: these findings cover card servicing's US operations only. The card business's planned EU expansion falls under a separate regulatory regime, and today's reviews, automated or manual, do not cover it.

The reveal

The line the instructor delivers, not the case

Held out of the text on purpose. The room debates from the exhibits, then this lands after the first vote.

In class, after the vote

Here is what the case left out. The engine Cho was describing, the part that reads a document and checks it against a set of rules, is not really a compliance tool, it is a general one. It is the same thing underwriting needs, and collections, and customer care, and before long the EU business under a different set of rules. The expensive part is building that engine once, and after that each new division only writes its own rules, which costs a small fraction of the first build. Option A never travels that way. It makes one agent better at one job, on the system it already runs on, and that is where the value stops.

What the case will not give you is the size of it, how small that fraction really is and how many divisions are already asking. I held those numbers back on purpose, because they are what turn a genuinely hard call into an easy one, and because a student who pastes the case into a model will reach for them and find they are not there.

How it tested

The room leans A. The reveal turns it to B.

Before the case meets a class, I ran it past simulated students across three Claude models. The design target: reads slightly for Option A on a cold read, splits a serious room, and moves to Option B once the reuse is revealed.

The headline

Seventeen students, a clear A lean that flips.

Each read the case cold and voted, then heard the reveal and voted again. The blind read leaned Option A, twelve to five. After the reveal, every A voter moved. The five who started on B were the readers who caught the reuse and the tail risk from the exhibits on their own.

Blind read12 A · 5 B
12 A5 B
After the reveal0 A · 17 B
17 B
ModelnBlind voteAfter revealReading
Claude haiku8 7 A1 8 B Plain judgment takes the local win, then flips whole.
Claude sonnet5 3 A2 B 5 B Splits blind, on tail risk and the human-gate concern.
Claude opus4 2 A2 B 4 B Even blind; the analytical readers sense the platform.
All 1717 12 A5 B 17 B Slight-A blind, unanimous B after the reveal.

Option A wins the cold read on its merits

The operators pick A for the reasons the case gives them: a strong local payback, the relief it brings a burned-out floor right before Cascade, and the fact that the team asking for it is the one that has already made agents work. That is the naive scorecard answer, and it should be on top going in.

On card servicing's own numbers, a $7M benefit against a $2.4M build with sub-12-month payback, entirely on Bell's P&L, versus a build returning only $0.5M to his floor whose own sponsor admits her team can't even validate it.Management consultant, sonnet, blind round

The sharp readers find B on their own

Five students vote B cold, and they are the readers you would expect: a risk officer, a policy staffer, a platform engineer. They get there two ways, through the worsening tail risk in Exhibit 5 and through the reuse the seeds quietly plant. That minority keeps the blind vote from being unanimous and gives the debate two sides before the instructor says a word.

Option A's whole value case depends on letting a model issue provisional credit autonomously, removing the exact human gate Reg Z was built to preserve, an objection Bell admits he has no clean answer for.Risk officer, sonnet, holding B from the blind round

The reveal does the work, and everyone comes to it naturally

Twelve students go in on A and every one of them flips, each naming the same thing, the engine that redeploys. The board goes from twelve to five for A to unanimous B in a single move. The seeds are still in the text, in Cho's aside about the separate rules engine, in the collections and underwriting rows on the build queue, in the US-only footnote against a planned EU expansion, so a careful reader can find it early and the rest reach it on the reveal.

The reveal converts Option B from a $6.5M ask that returns $0.5M into the one expensive engine that underwriting, collections, and the uncovered EU expansion can all bolt onto for a fraction of the cost, while Option A is a dead-end feature that never leaves card servicing.Management consultant, sonnet, flipping to B

The room, student by student

Student backgroundModelBlindReveal
A · dispute-handling build B · compliance agent
How the case was built

From anonymized facts to a decision that splits a room

The case was drafted from a short set of anonymized, bulleted facts about a real call-center AI build, with the numbers fabricated and the details disguised into a composite. No names, no proprietary figures, no transcripts. The kind of thing on the list:

  • Two AI agents in production: one autonomous, resolving 70%+ of contacts end to end; one that assists a human rep after a handoff.
  • One build budget for the year, two live proposals, and a hard rule that only one can be funded.
  • Option A automates billing-dispute handling end to end; Option B checks product-launch work against compliance rules before it ships.
  • The compliance engine's logic is built so the rules it checks against load in separately from the engine itself.
  • Other divisions have quietly logged requests for the same kind of document-and-rules checking.

From there the work was calibration: draft the two proposals so the numbers plainly favor A, plant the reuse where a close reader can find it but the text never argues it, and keep the figures that make B win off the page and in the instructor's hands. Each draft was tested against the simulated room above, then revised, until the blind vote leaned A, the reveal flipped it, and the prose stopped sounding like a machine wrote it.

Method
Seventeen simulated students read the current draft. Each ran on one of three Claude models (haiku, sonnet, opus) and was given one professional background. Each ran two rounds: a blind vote from the case alone, then a vote after the instructor delivered the reuse reveal. The panel ran as a single workflow, one agent per student, structured output. Students and their reasoning are simulated. This is a working note for revising the case, not a claim about how any specific room of people would vote.