← All Projects
06
Case Study 06 — Health Benefits · Research & Service Design

BENEFITFOCUS

Thirty thousand calls a year from members navigating a benefits system during the worst week of their lives. We found the four causes.

Benefitfocus — AI Accuracy Benchmark
Client
Benefitfocus
Engagement
Research & Design
Focus
QLE Journey
Methods
Mixed · AI-Assisted
Impact
$40K / 30s
01 — The Situation

THIRTY THOUSAND CALLS
A YEAR.

Benefitfocus came to us with a number and a target: 30,000 annual call-centre calls about Qualifying Life Events, and a mandate to reduce them without degrading the member experience.

A QLE is the moment a life change — a birth, a death, a divorce — alters someone's benefits eligibility. It is, by definition, the moment a member is least equipped to navigate a complex administrative system. They are frequently calling from a hospital.

The brief was framed as call deflection. We treated it as a research question: what is actually generating the calls?

The Strategic Question

"Are members calling because the platform is unclear — or because no platform should be the only support at the hardest moment of someone's year?"

02 — Approach

FORMATIVE, THEN
EVALUATIVE.

We combined foundational research with an iterative design-and-test cycle, applying generative AI to transcript analysis at a scale manual coding could not reach.

01

DISCOVER

User interviews, competitive analysis, and a literature review to establish where QLE processes fail across the category.

02

ANALYSE

47 call-centre transcripts coded for theme, purpose, and emotional trend — validated against three AI tools before trusting any of them.

03

DESIGN

First-round high-fidelity designs, then an unmoderated Maze usability test to surface errors before investing further.

04

VALIDATE

A/B testing after iteration, then a moderated Figma prototype test with call-centre agents over Zoom.

User Interviews Competitive Analysis Literature Review AI Transcript Analysis Unmoderated Testing A/B Testing Moderated Prototype Test
03 — AI-Assisted Analysis

AUTOMATE — BUT
VERIFY FIRST.

47 transcripts covering 29 birth-related and 8 death-related QLEs, selected across eight weeks by Benefitfocus researchers. To prepare for analysing thousands rather than dozens, we needed automation we could defend.

So we benchmarked three tools against manually coded ground truth before trusting any output. The spread was wide enough to justify the test on its own.

AI-Assisted Analysis — Accuracy Benchmark
ChatGPT 4o at 37%, Data Analyst at 87%, Marvin AI at 100%
A 37% accuracy rate would have produced a confident, well-formatted, completely wrong set of findings. The benchmark cost a day and protected the entire engagement.
04 — What We Found

FOUR CAUSES,
ONE PATTERN.

The calls were not random. They clustered into four causes, and all four share a root: the platform expects familiarity with a process members only encounter during a crisis.

Cause 01

TRANSPARENCY

Members were unfamiliar with the QLE process until it affected them personally. There is no gradual onboarding to a system you only touch during a birth or a death — the first encounter is the high-stakes one.

Cause 02

DOCUMENTATION

Users could not determine which documents a QLE required or how to submit them effectively. Requirements vary by state and by employer, and the platform surfaced neither context.

Cause 03

DEADLINES

Missing a QLE deadline can forfeit coverage entirely. Members were calling to confirm dates the platform already knew but had not made legible.

Cause 04

GUIDANCE

Members emphasised wanting direct human contact over navigating alone. This is not a failure of the interface — it is a signal about what the moment demands, and a system that ignores it generates calls by design.

From the Transcripts

"They are sometimes in the hospital, so they're needing that extra assistance."

"Sometimes people call and say I need you to add my baby to coverage, goodbye."

— Call-centre agents, moderated sessions

From the engagement

THE RESEARCH DECK

The full research trail — UXR goals, study details, the AI accuracy benchmark, call-centre findings, testing heatmaps, and the Document Center design solutions.

01 UXR goals
UXR goals
02 User study details
User study details
03 Generative AI benchmark
Generative AI benchmark
04 Call centre details
Call centre details
05 Research details — testing
Research details — testing
06 Learning
Learning
07 Design solutions
Design solutions
08 Impact
Impact
Click any artifact to enlarge
8 artifacts · scroll to browse
05 — Design Response

ERROR PREVENTION
OVER ERROR RECOVERY.

The redesign targeted the Document Center — the single screen where transparency, documentation, and deadlines all converge.

// Transparency

FULL SELECTION FREEDOM

Members choose dependants' benefits directly, with errors in selection, upload, and deadline tracking caught at the point of action rather than surfaced afterwards.

// Documentation

REQUIREMENTS MADE EXPLICIT

A missing-documents banner states exactly what a given QLE needs — birth certificate, social security card — with per-dependant upload status visible at a glance.

// Deadlines

DATES ATTACHED TO DOCUMENTS

Each outstanding item carries its own deadline inline. The member never has to reconstruct which date governs which document.

// Guidance

AGENT COMMENTS IN-PLATFORM

When a document is denied, the agent's reason appears against the file itself — resolving in-product what previously required a phone call to understand.

Because requirements vary by state and employer, automated visual cues and alerts do the work a member cannot reasonably be expected to do themselves. The design goal was making the requirement hard to miss, not making the error easy to fix.

PROTOTYPE

THE SOLUTION,
IN HAND.

THE DOCUMENT CENTER

Interactive prototype

The four causes of the 30,000 calls, resolved in the interface. Left shows what generated the call; right shows the proposed state. Tap the right-hand screen to advance.

Current · Benefitplace
Document Center
All documents
An undifferentiated list. No indication that a qualifying event is in progress, or what it requires.
Cause 01 · Transparency
The member does not know what the process expects of them.
—
Upload
Add document
Document type
Select type…
Who is this for?
Select…
Cause 02 · Documentation
No statement of what is actually required.
Upload
Benefits
Enrollment
period
A single global deadline, stated once, disconnected from the individual items it applies to.
Cause 03 · Deadlines
Member must reconstruct which date governs which document.
—
Status
Document
denied
oliverbirthcertificate.pdf
Issue
No reason given. The only route to understanding why is the call centre.
Cause 04 · Guidance
Call support
Proposed
Birth QLE · in progress
What we need
from you
2 of 5 complete · 14 days remaining
✓
Address proof
Approved
✓
✓
Benefit form
Approved
✓
Continue
Missing · Oliver P.
2 documents
still needed
Required · due Oct 13
Birth certificate
Required · due Jan 14
Social security card
Requirements shown are specific to your state and plan.
Upload birth certificate
Your deadlines
Nothing will
lapse
!
Birth certificate
Due in 6 days · Oct 13
2
Social security card
Due Jan 14
Reminders
7, 3, and 1 day before
Set reminders
Comment from agent
Here's what
to fix
Agent · Oct 5
This file was denied because the document you uploaded has the name "Thomas" not "Oliver." Please have the correct document uploaded by March 21st.
Resolved without a call
Re-upload correct file
The process made legible before it is needed. Members were unfamiliar with QLEs until one affected them personally — the first encounter is always the high-stakes one.
06 — Impact

WHAT IT'S
WORTH.

Projected Impact — Call Deflection Model
$40K
Recovered per 30 seconds saved per call
50%
Modelled reduction in QLE call volume
100%
Transcript classification accuracy achieved
47
Transcripts analysed across 8 weeks
The client asked us to reduce calls. The research found that some of those calls were people asking for a human at the hardest moment of their year — and the design had to answer that honestly rather than deflect it.

The outcome was not a wall between members and support. It was removing the 30,000 calls that existed because the platform withheld information it already had — and leaving the ones where a person genuinely needs a person.

← Sales Navigator Semilla →