top of page
uintent company logo

HEALTHCARE, FORMATIVE EVALUATION, SUMMATIVE STUDY

"Good Enough?": Balancing compliance and pragmatism in medical device user research


6

MIN

Jun 25, 2025

At uintent we live in two worlds, the human factors world of medical devices and the user experience world of all other, non-regulated industries. We have compared both and seen tremendous differences. Medical device companies spend 2.5 times the money for a formative study compared to non-regulated industries and their projects take one third more time. But most stunning is that medical device manufacturers only spend 15% of their budgets for other methods than formative or summative evaluations, while all other industries spend 54% into other UX methodologies, such as early user research or benchmarking.


At the 5th Annual European Medical Device Human Factors and Usability Engineering Conference, my colleague Tabea Daunus and I tackled this head-on in our talk: “Good enough (?)” - a deep dive into how to balance compliance with practical, efficient research strategies.


Here’s what we shared and why it matters for anyone working on healthcare UX.


Start Before It’s Perfect

The best time to begin user research? Sooner than you think.

Too many teams wait until the product is "ready" before involving users. But early-stage insights are where the real impact happens. They help:

  • Integrate real user needs into product design, increasing acceptance

  • Reveal actual user workflows and context, not just assumptions

  • Avoid wasting time and money on features that don't work in the real world


Case in point:One of our clients developed a device's handling process based on insights from a large hospital in Germany and planned to launch globally. During formative testing, they discovered:

  • The process didn’t work in smaller hospitals

  • Infrastructure assumed in the design didn’t exist elsewhere

  • Workflows varied significantly between countries


It was a wake-up call and it came just in time.

 

Skip the Paperwork (At First)

We’ve seen promising projects get stalled by documentation overload.

There’s a misconception that every study must include formal protocols, ethics approval, and 80-page reports. That’s just not true, especially in the early stages.

Enter what we call “stealth mode.”

Rather than running a full-blown formative simulated use test, you can position early research as:

  • Market research

  • Contextual inquiry

  • Exploratory expert review

  • Heuristic or task analysis


These methods are fast, flexible, and fully supported by regulatory guidance (yes, even FDA). They’re designed to uncover use-related problems, not tick regulatory boxes. No protocol? No problem. Just don’t label it what it’s not.

The goal here is simple: learn fast, improve fast.

 

“But My Device Is Too Complex…”

We hear this often. But in reality, complexity is exactly why early, agile testing is essential.

Trust your users. They can think abstractly.


You can:

  • Use paper prototypes or 3D prints

  • Test just one interaction or step

  • Simulate complex environments creatively


For example, in one project, we needed to simulate a C-bow used in cath labs. The problem? No cath lab availability. The solution? We recreated the C-bow out of cardboard and ran the study in a standard usability lab. Same insights. Big savings.


Beyond that, build your internal resources:

  • Create databases for what works (and what doesn’t)

  • Build reusable design libraries

  • Collect extra data (e.g., anthropomorphic measurements) when you already have users on-site


In short: complexity isn’t a barrier. It’s a reason to start smarter.

 

Be Smart With Summative Testing

Summative studies are often seen as rigid and untouchable but even here, there's room for creativity and efficiency.


Here are some ways to make them work harder for you:

  • Split your summative into two waves. If something goes wrong in the first few sessions, hit pause. Reclassify those sessions as formative, fix the issues, and avoid wasting time and money.

  • Build in a safety break. Don’t wait until the end to realize there’s a major problem. Plan a checkpoint midway through your field phase.

  • Exploit your studies. If participants are already onsite and there is still time left, don’t let them go right after the summative study ends. Once the validation session is complete, stop recording and begin a follow-up study (i.e on marketing topics or other, related products that are currently in development.).

  • Adapt your environment creatively. As with our cardboard cath lab story: sometimes a clever setup saves weeks of delay and thousands in lab fees.


And remember: if your product isn’t headed for the U.S., challenge whether U.S.-style testing is really needed. Not all products need to follow FDA guidelines to the letter.

 

Final Thoughts: What’s Actually Good Enough?

The goal isn’t to cut corners. It’s to make smart, intentional choices using all the leeway the regulatory frameworks already provide.


To recap:

  • Don’t limit yourself to usability testing, explore other valid research methods.

  • Start small. Start scrappy. It still counts.

  • Not every formative needs a protocol and full documentation.

  • You can test early, even for complex devices.

  • Reuse knowledge. Gather extra insights whenever you can.

  • Know your users early, it’ll save you a lot later.

  • Exploit summative setups by adding other study elements.

  • Build in safety breaks to pivot if needed.

  • Challenge formalities, especially outside the U.S..


At uintent, this is how we work: lean where possible, rigorous where necessary, and always focused on user value.


Want to know what “good enough” looks like for your device? Let’s talk. 🗨

Illustration of a lightbulb surrounded by abstract symbols like a question mark, cloud, speech bubble, and cross – symbolizing creative ideas and critical thinking.

Why Prompts That Produce Bias and Hallucinations Can Sometimes Be Helpful

AI & UXR, CHAT GPT, HUMAN VS AI, OPEN AI

Abstract pastel-colored illustration showing a stylized brain and geometric shapes – symbolizing AI and bias.

AI, Bias and the Power of Questions: How to Get Better Answers With Smart Prompts

AI & UXR, CHAT GPT

A woman inside a gear is surrounded by icons representing global connectivity, collaboration, innovation, and user focus – all linked by arrows. Uses soft, bright colors from a modern UI color palette.

Automate UX? Yes, Please! Why Zapier and n8n Are Real Super Tools for UX Teams

CHAT GPT, TOOLS, AUTOMATION, AI & UXR

A 2D Image of a man, pointing to a screen with a surgical robot on it.

Surgical Robotics and UX: Why Usability Is Key to or Success

HEALTHCARE, TRENDS, UX METHODS

Podcast cover for episode 2 of “Beyond Your Business: Transitions” with two photos of Tara at different life stages.

Episode 5: The Future Starts Now – UX in Transition and Tara Right in the Middle of It

UX, BACKSTORY

Podcast cover for episode 2 of “Beyond Your Business: Transitions” with two photos of Tara at different life stages.

Episode 4: A New Outlook on Life – Tara, the Transition and Becoming Visible

UX

Isometric illustration of digital health devices, including a blood glucose meter, thermometer, smartphone with health data, blood sample, and medicine bottle.

Telemedicine 2025: Between Potential and Practice – How UX Research Strengthens Healthcare

DIGITISATION, HEALTHCARE, MHEALTH

Stylized illustration of a brain and a neural network representing AI and machine thinking.

How a Transformer Thinks – And Why It Hallucinates

AI & UXR, LLM, HUMAN VS AI, OPEN AI

Split Image with a confused man on the left with the titel "before" that looks on to a screen that says "AI". On the right is a men that looks  content on the same screen and has the titel "After UX Testing".

AI Diagnostics in Transition: Between Technological Precision and Human Trust

HEALTHCARE, TRENDS, UX METHODS

Podcast cover for episode 2 of “Beyond Your Business: Transitions” with two photos of Tara at different life stages.

Episode 3: From Corporate Life Back to Freedom: How Frustration Led to the Idea for Resight

UX, BACKSTORY

Podcast cover for episode 2 of “Beyond Your Business: Transitions” with two photos of Tara at different life stages.

Episode 2: Self-Denial, Growth and Crises: The Second Phase of Sirvaluse – And of Tara

UX, BACKSTORY

Colorful 3D illustration of a digital workspace with data and tools.

Making Better Use of UX Knowledge: What Repository Tools Can Do – And What They Can’t

AI & UXR, TOOLS, CHAT GPT, LLM, OPEN AI

Three stylized characters with speech bubbles on a blue background – “Chattable Personas”.

Artificial Users, Real Insights? How Generative Agents Could Change the Field of UX

AI & UXR, HUMAN VS AI, LLM, TRENDS, UX METHODS, PERSONAS

Surgeon in the clinical operating room, surrounded by a sterile surgical environment, lots of equipment and monitors

"Good Enough?": Balancing compliance and pragmatism in medical device user research

HEALTHCARE, FORMATIVE EVALUATION, SUMMATIVE STUDY

Colorful illustration of a robot with a document and pencil on a light background.

Write More Clearly With Wolf-Schneider AI – A Self-Experiment

AI & UXR, OPEN AI

Dark designed picture as a podcast announcement. A picture of a baby and a man is shown.

Episode 1: ‘Inside and Out’ – A Podcast Series About Change, Responsibility and Self-Discovery

UX, BACKSTORY

Illustration with five colorful icons on a dark background, representing different AI systems.
Top left: Brain and lightbulb – “GenAI: Creativity”.
Top center: Book with magnifying glass – “RAG: Knowledge”.
Top right: Flowchart diagram – “MCP: Structure”.
Bottom left: Code window with arrow – “Function Calling: Access”.
Bottom right: Smiling robot – “Agents: Assistance”.

Five Types of AI Systems – And What They Do for Us

AI & UXR, CHAT GPT, LLM, OPEN AI

Illustration of a stylized brain (LLM) between a human profile and a bookshelf with a magnifying glass – symbolizes AI accessing external knowledge.

RAGSs Against Hallucinations – Well Thought Out, but Not Good Enough?

AI & UXR, CHAT GPT, LLM

Two people sit at a breakfast table using a tablet with the 'ZEITKOMPASS' app by Inclusys, which displays a colorful daily schedule and clock. The table is set with bread rolls, fruit, and coffee.

UX for Good With INCLUSYS: How We Learned to Better Understand Barriers in Everyday Life

ACCESSIBILITY, ADVANTAGES USER RESEARCH, RESEARCH, UX FOR GOOD

Woman in an orange shirt sits on a blue couch and looks at an interviewer and is laughing.

UX in Healthcare: The Essentials of Conducting Interviews With Patients

BEST PRACTICES, HEALTHCARE, RESEARCH, UX INSIGHTS

 RELATED ARTICLES YOU MIGHT ENJOY 

AUTHOR

Wolfgang Waxenberger

Wolfgang started his career as a UX professional in 2004 after completing his MA in Political Science and Sociology. He led SirValUse Consulting and GfK's UX department for 10 years before founding uintent. Wolfgang's focus is on automotive and healthcare research.

bottom of page