top of page
uintent company logo

HEALTHCARE, FORMATIVE EVALUATION, SUMMATIVE STUDY

"Good Enough?": Balancing compliance and pragmatism in medical device user research


6

MIN

Jun 25, 2025

At uintent we live in two worlds, the human factors world of medical devices and the user experience world of all other, non-regulated industries. We have compared both and seen tremendous differences. Medical device companies spend 2.5 times the money for a formative study compared to non-regulated industries and their projects take one third more time. But most stunning is that medical device manufacturers only spend 15% of their budgets for other methods than formative or summative evaluations, while all other industries spend 54% into other UX methodologies, such as early user research or benchmarking.


At the 5th Annual European Medical Device Human Factors and Usability Engineering Conference, my colleague Tabea Daunus and I tackled this head-on in our talk: “Good enough (?)” - a deep dive into how to balance compliance with practical, efficient research strategies.


Here’s what we shared and why it matters for anyone working on healthcare UX.


Start Before It’s Perfect

The best time to begin user research? Sooner than you think.

Too many teams wait until the product is "ready" before involving users. But early-stage insights are where the real impact happens. They help:

  • Integrate real user needs into product design, increasing acceptance

  • Reveal actual user workflows and context, not just assumptions

  • Avoid wasting time and money on features that don't work in the real world


Case in point:One of our clients developed a device's handling process based on insights from a large hospital in Germany and planned to launch globally. During formative testing, they discovered:

  • The process didn’t work in smaller hospitals

  • Infrastructure assumed in the design didn’t exist elsewhere

  • Workflows varied significantly between countries


It was a wake-up call and it came just in time.

 

Skip the Paperwork (At First)

We’ve seen promising projects get stalled by documentation overload.

There’s a misconception that every study must include formal protocols, ethics approval, and 80-page reports. That’s just not true, especially in the early stages.

Enter what we call “stealth mode.”

Rather than running a full-blown formative simulated use test, you can position early research as:

  • Market research

  • Contextual inquiry

  • Exploratory expert review

  • Heuristic or task analysis


These methods are fast, flexible, and fully supported by regulatory guidance (yes, even FDA). They’re designed to uncover use-related problems, not tick regulatory boxes. No protocol? No problem. Just don’t label it what it’s not.

The goal here is simple: learn fast, improve fast.

 

“But My Device Is Too Complex…”

We hear this often. But in reality, complexity is exactly why early, agile testing is essential.

Trust your users. They can think abstractly.


You can:

  • Use paper prototypes or 3D prints

  • Test just one interaction or step

  • Simulate complex environments creatively


For example, in one project, we needed to simulate a C-bow used in cath labs. The problem? No cath lab availability. The solution? We recreated the C-bow out of cardboard and ran the study in a standard usability lab. Same insights. Big savings.


Beyond that, build your internal resources:

  • Create databases for what works (and what doesn’t)

  • Build reusable design libraries

  • Collect extra data (e.g., anthropomorphic measurements) when you already have users on-site


In short: complexity isn’t a barrier. It’s a reason to start smarter.

 

Be Smart With Summative Testing

Summative studies are often seen as rigid and untouchable but even here, there's room for creativity and efficiency.


Here are some ways to make them work harder for you:

  • Split your summative into two waves. If something goes wrong in the first few sessions, hit pause. Reclassify those sessions as formative, fix the issues, and avoid wasting time and money.

  • Build in a safety break. Don’t wait until the end to realize there’s a major problem. Plan a checkpoint midway through your field phase.

  • Exploit your studies. If participants are already onsite and there is still time left, don’t let them go right after the summative study ends. Once the validation session is complete, stop recording and begin a follow-up study (i.e on marketing topics or other, related products that are currently in development.).

  • Adapt your environment creatively. As with our cardboard cath lab story: sometimes a clever setup saves weeks of delay and thousands in lab fees.


And remember: if your product isn’t headed for the U.S., challenge whether U.S.-style testing is really needed. Not all products need to follow FDA guidelines to the letter.

 

Final Thoughts: What’s Actually Good Enough?

The goal isn’t to cut corners. It’s to make smart, intentional choices using all the leeway the regulatory frameworks already provide.


To recap:

  • Don’t limit yourself to usability testing, explore other valid research methods.

  • Start small. Start scrappy. It still counts.

  • Not every formative needs a protocol and full documentation.

  • You can test early, even for complex devices.

  • Reuse knowledge. Gather extra insights whenever you can.

  • Know your users early, it’ll save you a lot later.

  • Exploit summative setups by adding other study elements.

  • Build in safety breaks to pivot if needed.

  • Challenge formalities, especially outside the U.S..


At uintent, this is how we work: lean where possible, rigorous where necessary, and always focused on user value.


Want to know what “good enough” looks like for your device? Let’s talk. 🗨

Silhouette of a diver descending into deep blue water – a metaphor for in-depth research.

Deep Research AI | How to use ChatGPT effectively for UX work

CHAT GPT, HOW-TO, RESEARCH, AI & UXR

A referee holds up a scorecard labeled “Yupp.ai” between two stylized AI chatbots in a boxing ring – a symbolic image for fair user-based comparison of AI models.

How Yupp Uses Feedback to Fairly Evaluate AI Models – And What UX Professionals Can Learn From It

AI & UXR, CHAT GPT, HUMAN VS AI, LLM

3D illustration of a digital marketplace with colorful prompt stalls and a figure selecting a prompt card.

Buying, sharing, selling prompts – what prompt marketplaces offer today (and why this is relevant for UX)

AI & UXR, PROMPTS

Robot holds two signs: “ISO 9241 – 7 principles” and “ISO 9241 – 10 principles”

ChatGPT Hallucinates – Despite Anti-Hallucination Prompt

AI & UXR, HUMAN VS AI, CHAT GPT

Strawberry being sliced by a knife, stylized illustration.

Why AI Sometimes Can’t Count to 3 – And What That Has to Do With Tokens

AI & UXR, TOKEN, LLM

Square motif divided in the middle: on the left, a grey, stylised brain above a seated person working on a laptop in dark grey tones; on the right, a bright blue, networked brain above a standing person in front of a holographic interface on a dark background.

GPT-5 Is Here: Does This UX AI Really Change Everything for Researchers?

AI & UXR, CHAT GPT

Surreal AI image with data streams, crossed-out “User Expirince” and the text “ChatGPT kann jetzt Text in Bild”.

When AI Paints Pictures – And Suddenly Knows How to Spell

AI & UXR, CHAT GPT, HUMAN VS AI

Human and AI co-create a glowing tree on the screen, set against a dark, surreal background.

When the Text Is Too Smooth: How to Make AI Language More Human

AI & UXR, AI WRITING, CHAT GPT, HUMAN VS AI

Futuristic illustration: Human facing a glowing humanoid AI against a digital backdrop.

Not Science Fiction – AI Is Becoming Independent

AI & UXR, CHAT GPT

Illustration of an AI communicating with a human, symbolizing the persuasive power of artificial intelligence.

Between Argument and Influence – How Persuasive Can AI Be?

AI & UXR, CHAT GPT, LLM

A two-dimensional cartoon woman stands in front of a human-sized mobile phone displaying health apps. To her right is a box with a computer on it showing an ECG.

Digital Health Apps & Interfaces: Why Good UX Determines Whether Patients Really Benefit

HEALTHCARE, MHEALTH, TRENDS, UX METHODS

Illustration of a red hand symbolically prioritizing “Censorship” over “User Privacy” in the context of DeepSeek, with the Chinese flag in the background.

Censorship Meets AI: What Deepseek Is Hiding About Human Rights – And Why This Affects UX

AI & UXR, LLM, OPEN AI

Isometric flat-style illustration depicting global UX study logistics with parcels, checklist, video calls, and location markers over a world map.

What It Takes to Get It Right: Global Study Logistics in UX Research for Medical Devices

HEALTHCARE, UX METHODS, UX LOGISTICS

Surreal, glowing illustration of an AI language model as a brain, influenced by a hand – symbolizing manipulation by external forces.

Propaganda Chatbots - When AI Suddenly Speaks Russian

AI & UXR, LLM

Illustration of seven animals representing different thinking and prompting styles in UX work.

Welcome to the Prompt Zoo

AI & UXR, PROMPTS, UX

A two-dimensional image of a man sitting at a desk with an open laptop displaying a health symbol. In the background hangs a poster with a DNA strand.

UX Regulatory Compliance: Why Usability Drives Medtech Certification

HEALTHCARE, REGULATIONS

Illustration of a lightbulb surrounded by abstract symbols like a question mark, cloud, speech bubble, and cross – symbolizing creative ideas and critical thinking.

Why Prompts That Produce Bias and Hallucinations Can Sometimes Be Helpful

AI & UXR, CHAT GPT, HUMAN VS AI, OPEN AI

Illustration of a man at a laptop, surrounded by symbols of global medical research: world map with location markers, monitor with a medical cross, patient file, and stethoscope.

Global UX Research in Medical Technology: International User Research as a Factor for Success

HEALTHCARE, MHEALTH, REGULATIONS

Abstract pastel-colored illustration showing a stylized brain and geometric shapes – symbolizing AI and bias.

AI, Bias and the Power of Questions: How to Get Better Answers With Smart Prompts

AI & UXR, CHAT GPT

A woman inside a gear is surrounded by icons representing global connectivity, collaboration, innovation, and user focus – all linked by arrows. Uses soft, bright colors from a modern UI color palette.

Automate UX? Yes, Please! Why Zapier and n8n Are Real Super Tools for UX Teams

CHAT GPT, TOOLS, AUTOMATION, AI & UXR

 RELATED ARTICLES YOU MIGHT ENJOY 

AUTHOR

Wolfgang Waxenberger

Wolfgang started his career as a UX professional in 2004 after completing his MA in Political Science and Sociology. He led SirValUse Consulting and GfK's UX department for 10 years before founding uintent. Wolfgang's focus is on automotive and healthcare research.

bottom of page