top of page
uintent company logo

HEALTHCARE, FORMATIVE EVALUATION, SUMMATIVE STUDY

"Good Enough?": Balancing compliance and pragmatism in medical device user research


6

MIN

Jun 25, 2025

At uintent we live in two worlds, the human factors world of medical devices and the user experience world of all other, non-regulated industries. We have compared both and seen tremendous differences. Medical device companies spend 2.5 times the money for a formative study compared to non-regulated industries and their projects take one third more time. But most stunning is that medical device manufacturers only spend 15% of their budgets for other methods than formative or summative evaluations, while all other industries spend 54% into other UX methodologies, such as early user research or benchmarking.


At the 5th Annual European Medical Device Human Factors and Usability Engineering Conference, my colleague Tabea Daunus and I tackled this head-on in our talk: “Good enough (?)” - a deep dive into how to balance compliance with practical, efficient research strategies.


Here’s what we shared and why it matters for anyone working on healthcare UX.


Start Before It’s Perfect

The best time to begin user research? Sooner than you think.

Too many teams wait until the product is "ready" before involving users. But early-stage insights are where the real impact happens. They help:

  • Integrate real user needs into product design, increasing acceptance

  • Reveal actual user workflows and context, not just assumptions

  • Avoid wasting time and money on features that don't work in the real world


Case in point:One of our clients developed a device's handling process based on insights from a large hospital in Germany and planned to launch globally. During formative testing, they discovered:

  • The process didn’t work in smaller hospitals

  • Infrastructure assumed in the design didn’t exist elsewhere

  • Workflows varied significantly between countries


It was a wake-up call and it came just in time.

 

Skip the Paperwork (At First)

We’ve seen promising projects get stalled by documentation overload.

There’s a misconception that every study must include formal protocols, ethics approval, and 80-page reports. That’s just not true, especially in the early stages.

Enter what we call “stealth mode.”

Rather than running a full-blown formative simulated use test, you can position early research as:

  • Market research

  • Contextual inquiry

  • Exploratory expert review

  • Heuristic or task analysis


These methods are fast, flexible, and fully supported by regulatory guidance (yes, even FDA). They’re designed to uncover use-related problems, not tick regulatory boxes. No protocol? No problem. Just don’t label it what it’s not.

The goal here is simple: learn fast, improve fast.

 

“But My Device Is Too Complex…”

We hear this often. But in reality, complexity is exactly why early, agile testing is essential.

Trust your users. They can think abstractly.


You can:

  • Use paper prototypes or 3D prints

  • Test just one interaction or step

  • Simulate complex environments creatively


For example, in one project, we needed to simulate a C-bow used in cath labs. The problem? No cath lab availability. The solution? We recreated the C-bow out of cardboard and ran the study in a standard usability lab. Same insights. Big savings.


Beyond that, build your internal resources:

  • Create databases for what works (and what doesn’t)

  • Build reusable design libraries

  • Collect extra data (e.g., anthropomorphic measurements) when you already have users on-site


In short: complexity isn’t a barrier. It’s a reason to start smarter.

 

Be Smart With Summative Testing

Summative studies are often seen as rigid and untouchable but even here, there's room for creativity and efficiency.


Here are some ways to make them work harder for you:

  • Split your summative into two waves. If something goes wrong in the first few sessions, hit pause. Reclassify those sessions as formative, fix the issues, and avoid wasting time and money.

  • Build in a safety break. Don’t wait until the end to realize there’s a major problem. Plan a checkpoint midway through your field phase.

  • Exploit your studies. If participants are already onsite and there is still time left, don’t let them go right after the summative study ends. Once the validation session is complete, stop recording and begin a follow-up study (i.e on marketing topics or other, related products that are currently in development.).

  • Adapt your environment creatively. As with our cardboard cath lab story: sometimes a clever setup saves weeks of delay and thousands in lab fees.


And remember: if your product isn’t headed for the U.S., challenge whether U.S.-style testing is really needed. Not all products need to follow FDA guidelines to the letter.

 

Final Thoughts: What’s Actually Good Enough?

The goal isn’t to cut corners. It’s to make smart, intentional choices using all the leeway the regulatory frameworks already provide.


To recap:

  • Don’t limit yourself to usability testing, explore other valid research methods.

  • Start small. Start scrappy. It still counts.

  • Not every formative needs a protocol and full documentation.

  • You can test early, even for complex devices.

  • Reuse knowledge. Gather extra insights whenever you can.

  • Know your users early, it’ll save you a lot later.

  • Exploit summative setups by adding other study elements.

  • Build in safety breaks to pivot if needed.

  • Challenge formalities, especially outside the U.S..


At uintent, this is how we work: lean where possible, rigorous where necessary, and always focused on user value.


Want to know what “good enough” looks like for your device? Let’s talk. 🗨

Abstract futuristic illustration of a person facing a glowing tower of documents and flowing data streams.

AI Tools UX Research: How Do These Tools Handle Large Documents?

LLM, CHAT GPT, HOW-TO

Illustration of Donald Trump with raised hand in front of an abstract digital background suggesting speech bubbles and data structures.

Donald Trump Prompt: How Provocative AI Prompts Affect UX Budgets

AI & UXR, PROMPTS, STAKEHOLDER MANAGEMENT

Driver's point of view looking at a winding country road surrounded by green vegetation. The steering wheel, dashboard and rear-view mirror are visible in the foreground.

The Final Hurdle: How Unsafe Automation Undermines Trust in Adas

AUTOMATION, AUTOMOTIVE UX, AUTONOMOUS DRIVING, GAMIFICATION, TRENDS

Illustration of a person standing at a fork in the road with two equal paths.

Will AI Replace UX Jobs? What a Study of 200,000 AI Conversations Really Shows

HUMAN VS AI, RESEARCH, AI & UXR

Close-up of a premium tweeter speaker in a car dashboard with perforated metal surface.

The Passenger Who Always Listens: Why We Are Reluctant to Trust Our Cars When They Talk

AUTOMOTIVE UX, VOICE ASSISTANTS

Keyhole in a dark surface revealing an abstract, colorful UX research interface.

Evaluating AI Results in UX Research: How to Navigate the Black Box

AI & UXR, HOW-TO, HUMAN VS AI

A car cockpit manufactured by Audi. It features a digital display and numerous buttons on the steering wheel.

Haptic Certainty vs. Digital Temptation: The Battle for the Best Controls in Cars

AUTOMOTIVE UX, AUTONOMOUS DRIVING, CONNECTIVITY, GAMIFICATION

Digital illustration of a classical building facade with columns, supported by visible scaffolding, symbolising a fragile, purely superficial front.

UX & AI: How "UX Potemkin" Undermines Your Research and Design Decisions

AI & UXR, HUMAN VS AI, LLM, UX

Silhouette of a diver descending into deep blue water – a metaphor for in-depth research.

Deep Research AI | How to use ChatGPT effectively for UX work

CHAT GPT, HOW-TO, RESEARCH, AI & UXR

A referee holds up a scorecard labeled “Yupp.ai” between two stylized AI chatbots in a boxing ring – a symbolic image for fair user-based comparison of AI models.

How Yupp Uses Feedback to Fairly Evaluate AI Models – And What UX Professionals Can Learn From It

AI & UXR, CHAT GPT, HUMAN VS AI, LLM

A brown book entitled ‘Don't Make Me Think’ by Steve Krug lies on a small table. Light shines through the window.

Why UX Research Is Losing Credibility - And How We Can Regain It

UX, UX QUALITY, UX METHODS

3D illustration of a digital marketplace with colorful prompt stalls and a figure selecting a prompt card.

Buying, sharing, selling prompts – what prompt marketplaces offer today (and why this is relevant for UX)

AI & UXR, PROMPTS

Robot holds two signs: “ISO 9241 – 7 principles” and “ISO 9241 – 10 principles”

ChatGPT Hallucinates – Despite Anti-Hallucination Prompt

AI & UXR, HUMAN VS AI, CHAT GPT

Strawberry being sliced by a knife, stylized illustration.

Why AI Sometimes Can’t Count to 3 – And What That Has to Do With Tokens

AI & UXR, TOKEN, LLM

Square motif divided in the middle: on the left, a grey, stylised brain above a seated person working on a laptop in dark grey tones; on the right, a bright blue, networked brain above a standing person in front of a holographic interface on a dark background.

GPT-5 Is Here: Does This UX AI Really Change Everything for Researchers?

AI & UXR, CHAT GPT

Surreal AI image with data streams, crossed-out “User Expirince” and the text “ChatGPT kann jetzt Text in Bild”.

When AI Paints Pictures – And Suddenly Knows How to Spell

AI & UXR, CHAT GPT, HUMAN VS AI

Human and AI co-create a glowing tree on the screen, set against a dark, surreal background.

When the Text Is Too Smooth: How to Make AI Language More Human

AI & UXR, AI WRITING, CHAT GPT, HUMAN VS AI

Futuristic illustration: Human facing a glowing humanoid AI against a digital backdrop.

Not Science Fiction – AI Is Becoming Independent

AI & UXR, CHAT GPT

Illustration of an AI communicating with a human, symbolizing the persuasive power of artificial intelligence.

Between Argument and Influence – How Persuasive Can AI Be?

AI & UXR, CHAT GPT, LLM

A two-dimensional cartoon woman stands in front of a human-sized mobile phone displaying health apps. To her right is a box with a computer on it showing an ECG.

Digital Health Apps & Interfaces: Why Good UX Determines Whether Patients Really Benefit

HEALTHCARE, MHEALTH, TRENDS, UX METHODS

 RELATED ARTICLES YOU MIGHT ENJOY 

AUTHOR

Wolfgang Waxenberger

Wolfgang started his career as a UX professional in 2004 after completing his MA in Political Science and Sociology. He led SirValUse Consulting and GfK's UX department for 10 years before founding uintent. Wolfgang's focus is on automotive and healthcare research.

bottom of page