top of page
uintent company logo

HEALTHCARE, FORMATIVE EVALUATION, SUMMATIVE STUDY

"Good Enough?": Balancing compliance and pragmatism in medical device user research


6

MIN

Jun 25, 2025

At uintent we live in two worlds, the human factors world of medical devices and the user experience world of all other, non-regulated industries. We have compared both and seen tremendous differences. Medical device companies spend 2.5 times the money for a formative study compared to non-regulated industries and their projects take one third more time. But most stunning is that medical device manufacturers only spend 15% of their budgets for other methods than formative or summative evaluations, while all other industries spend 54% into other UX methodologies, such as early user research or benchmarking.


At the 5th Annual European Medical Device Human Factors and Usability Engineering Conference, my colleague Tabea Daunus and I tackled this head-on in our talk: “Good enough (?)” - a deep dive into how to balance compliance with practical, efficient research strategies.


Here’s what we shared and why it matters for anyone working on healthcare UX.


Start Before It’s Perfect

The best time to begin user research? Sooner than you think.

Too many teams wait until the product is "ready" before involving users. But early-stage insights are where the real impact happens. They help:

  • Integrate real user needs into product design, increasing acceptance

  • Reveal actual user workflows and context, not just assumptions

  • Avoid wasting time and money on features that don't work in the real world


Case in point:One of our clients developed a device's handling process based on insights from a large hospital in Germany and planned to launch globally. During formative testing, they discovered:

  • The process didn’t work in smaller hospitals

  • Infrastructure assumed in the design didn’t exist elsewhere

  • Workflows varied significantly between countries


It was a wake-up call and it came just in time.

 

Skip the Paperwork (At First)

We’ve seen promising projects get stalled by documentation overload.

There’s a misconception that every study must include formal protocols, ethics approval, and 80-page reports. That’s just not true, especially in the early stages.

Enter what we call “stealth mode.”

Rather than running a full-blown formative simulated use test, you can position early research as:

  • Market research

  • Contextual inquiry

  • Exploratory expert review

  • Heuristic or task analysis


These methods are fast, flexible, and fully supported by regulatory guidance (yes, even FDA). They’re designed to uncover use-related problems, not tick regulatory boxes. No protocol? No problem. Just don’t label it what it’s not.

The goal here is simple: learn fast, improve fast.

 

“But My Device Is Too Complex…”

We hear this often. But in reality, complexity is exactly why early, agile testing is essential.

Trust your users. They can think abstractly.


You can:

  • Use paper prototypes or 3D prints

  • Test just one interaction or step

  • Simulate complex environments creatively


For example, in one project, we needed to simulate a C-bow used in cath labs. The problem? No cath lab availability. The solution? We recreated the C-bow out of cardboard and ran the study in a standard usability lab. Same insights. Big savings.


Beyond that, build your internal resources:

  • Create databases for what works (and what doesn’t)

  • Build reusable design libraries

  • Collect extra data (e.g., anthropomorphic measurements) when you already have users on-site


In short: complexity isn’t a barrier. It’s a reason to start smarter.

 

Be Smart With Summative Testing

Summative studies are often seen as rigid and untouchable but even here, there's room for creativity and efficiency.


Here are some ways to make them work harder for you:

  • Split your summative into two waves. If something goes wrong in the first few sessions, hit pause. Reclassify those sessions as formative, fix the issues, and avoid wasting time and money.

  • Build in a safety break. Don’t wait until the end to realize there’s a major problem. Plan a checkpoint midway through your field phase.

  • Exploit your studies. If participants are already onsite and there is still time left, don’t let them go right after the summative study ends. Once the validation session is complete, stop recording and begin a follow-up study (i.e on marketing topics or other, related products that are currently in development.).

  • Adapt your environment creatively. As with our cardboard cath lab story: sometimes a clever setup saves weeks of delay and thousands in lab fees.


And remember: if your product isn’t headed for the U.S., challenge whether U.S.-style testing is really needed. Not all products need to follow FDA guidelines to the letter.

 

Final Thoughts: What’s Actually Good Enough?

The goal isn’t to cut corners. It’s to make smart, intentional choices using all the leeway the regulatory frameworks already provide.


To recap:

  • Don’t limit yourself to usability testing, explore other valid research methods.

  • Start small. Start scrappy. It still counts.

  • Not every formative needs a protocol and full documentation.

  • You can test early, even for complex devices.

  • Reuse knowledge. Gather extra insights whenever you can.

  • Know your users early, it’ll save you a lot later.

  • Exploit summative setups by adding other study elements.

  • Build in safety breaks to pivot if needed.

  • Challenge formalities, especially outside the U.S..


At uintent, this is how we work: lean where possible, rigorous where necessary, and always focused on user value.


Want to know what “good enough” looks like for your device? Let’s talk. 🗨

Futuristic illustration of three floating AI tools: a glowing spark, a transparent workspace cube with layered documents, and a crystalline gear, connected by golden lines against a deep navy background.

Prompt, Project, or Skill? Which AI Tool Truly Accelerates Your UX Research

AI & UXR

Glowing futuristic shield made of UI elements repels digital threats in dark space.

UX Research As Risk Management: Why We Finally Need To Change Our Language

HOW-TO, UX, UX QUALITY

Person at desk between chaotic and structured data streams, central light focus

UX & AI: The Best Newsletters and Podcasts – My Personal Selection

AI & UXR

Futuristic digital illustration: A glowing golden certification seal floating against a deep navy background, surrounded by AR interface fragments and a faint headset silhouette – symbolizing trust and validation in medical technology.

Trust, but Verified: Why Medical Certification Matters for AR, VR, and Mr in Medtech

HEALTHCARE, HUMAN-CENTERED DESIGN, UX

Floating semi-transparent AR interface with minimal medical data and anatomical visuals, glowing in cyan and gold against a dark futuristic background.

Making the Magic Usable: Why Usability Engineering Matters for AR, VR, and MR in Medtech

HEALTHCARE, MHEALTH

A futuristic, symbolic illustration shows a person standing on a glowing bridge between two worlds: on the left, a warmly lit hospital room with a bed and medical equipment; on the right, an immersive digital space featuring a holographic human body with organs glowing in cyan and orange tones. Both sides are connected by flowing streams of light, set against a deep navy blue background with soft violet transitions.

Reality, Reimagined: How AR, VR, and Mr Are Finding Their Way Into Medtech

DIGITISATION, HEALTHCARE

A glowing golden trophy floats above a gap, while small figures below work on user research and wireframes, untouched by its light.

Understanding UX AI Benchmarks: What HLE and METR Really Tell Us About AI Tools

AI & UXR

Futuristic digital illustration on a deep navy background: a human hand holding a warm glowing pencil and a cyan-lit robotic hand both reach toward a radiant central data cluster. Surrounded by stacked documents and a network of connected nodes, the scene symbolizes collaboration between human interpretation and digital information processing.

NotebookLM in UX Research: An Honest Assessment of a Specialized AI Tool

AI & UXR, HOW-TO, LLM

Futuristic glowing cylinder divided into segments by golden barriers.

Introducing Gated Salami Prompting: Why You Should Slice Complex LLM Tasks Into Smaller Pieces

CHAT GPT, HOW-TO, LLM, PROMPTS

Futuristic square illustration on deep navy background: a glowing golden speech bubble dissolves into particles that partially reassemble incorrectly, surrounded by energy arcs, luminous nodes, and a stylized digital head—symbolizing LLM hallucinations.

Fictitious Quotes, Lost Nuances: The Hallucination Problem in Qualitative Analysis With Llms

CHAT GPT, HOW-TO, LLM, OPEN AI, PROMPTS, TOKEN, UX METHODS

Surreal futuristic illustration of a glowing digital head with data streams, charts, and evaluation symbols representing AI evaluation methodology.

How do we know that our prompt is doing a good job? Why UX research needs an evaluation methodology for AI-based analysis

AI WRITING, DIGITISATION, HOW-TO, PROMPTS

A surreal, futuristic illustration featuring a translucent human profile with a glowing brain connected by flowing data streams to a hovering, golden crystal.

Prompt Psychology Exposed: Why “Tipping” ChatGPT Sometimes Works

CHAT GPT, HOW-TO, LLM, UX

Surreal, futuristic illustration of a person seen from behind standing in a glowing digital cityscape.

System Prompts in UX Research: What You Need to Know About Invisible AI Control

PROMPTS, RESEARCH, UX, UX INSIGHTS

Abstract futuristic illustration of a person, various videos, and notes.

Summarizing YouTube Videos With AI: Three Tools Put to the Test in UX Research

LLM, UX, HOW-TO

two folded hands holding a growing plant

UX For a Better World: We Are Giving Away a UX Research Project to Non-profit Organisations and Sustainable Companies!

UX INSIGHTS, UX FOR GOOD, TRENDS, RESEARCH

Abstract futuristic illustration of a person facing a glowing tower of documents and flowing data streams.

AI Tools UX Research: How Do These Tools Handle Large Documents?

LLM, CHAT GPT, HOW-TO

Illustration of Donald Trump with raised hand in front of an abstract digital background suggesting speech bubbles and data structures.

Donald Trump Prompt: How Provocative AI Prompts Affect UX Budgets

AI & UXR, PROMPTS, STAKEHOLDER MANAGEMENT

Driver's point of view looking at a winding country road surrounded by green vegetation. The steering wheel, dashboard and rear-view mirror are visible in the foreground.

The Final Hurdle: How Unsafe Automation Undermines Trust in Adas

AUTOMATION, AUTOMOTIVE UX, AUTONOMOUS DRIVING, GAMIFICATION, TRENDS

Illustration of a person standing at a fork in the road with two equal paths.

Will AI Replace UX Jobs? What a Study of 200,000 AI Conversations Really Shows

HUMAN VS AI, RESEARCH, AI & UXR

Close-up of a premium tweeter speaker in a car dashboard with perforated metal surface.

The Passenger Who Always Listens: Why We Are Reluctant to Trust Our Cars When They Talk

AUTOMOTIVE UX, VOICE ASSISTANTS

Related Articles you might enjoy

AUTHOR

Wolfgang Waxenberger

Wolfgang started his career as a UX professional in 2004 after completing his MA in Political Science and Sociology. He led SirValUse Consulting and GfK's UX department for 10 years before founding uintent. Wolfgang's focus is on automotive and healthcare research.

bottom of page