top of page
uintent company logo

HEALTHCARE, FORMATIVE EVALUATION, PRODUCT DEVELOPMENT

Beyond Formative and Summative Evaluations

In the healthcare space, there is a big focus from our clients on formative and summative evaluations, because they are legal requirements to get the 510(k) / CE mark approval of their product, so that it can be marketed. When a formative evaluation is conducted, the expectation is to identify and improve usability issues and user experiences during development.

4

MIN

Apr 20, 2021

Often, formative evaluations show that the product has issues that could have been prevented before even reaching the formative stage. There are several steps before conducting formative evaluations that, in our opinion, are of utmost importance to design a good product that is actually ready for formative testing. Even though some upfront investment is needed, ensuring that these steps have been followed ultimately saves time and money, by reducing the amount of effort to correct the product during formative evaluations, and can potentially reduce the need to re-evaluate the product in another/several rounds of formative evaluation – basically, the goal is to have a well-designed product when entering the formative evaluation phase, and to have the lowest amount of changes made to it after the formative evaluation.

 

DIFFERENT STEPS IN FORMATIVE EVALUATIONS:


The different steps that, in our opinion should be performed before any formative evaluation of a product are:

  • Understand who the end users are – this is important for new products for which there is no clearly defined end user population yet, or when there is a need to assess whether certain users could become end users, e.g. “can severe Rheumatoid Arthritis patients handle a new type of autoinjector”. A variety of methods can be used to assess this, ranging from simple telephone interviews, to face to face interviews, to focus groups etc.

  • Understand who the competitors are, and how their products are perceived by end users. As above, several methods can be used to assess this.

  • Understand the end users’ needs (what would be the ideal experiences) to highlight gaps and opportunities – what are the use cases, the pains and gains, the preferences, the most important features etc. As above, several methods can be used to assess this.

  • Understand how end users might work together and how it can impact product design (for example in an operating room, how do the different specialties interact with similar products) – this can be achieved with the observation of user experiences in a real-world setting. The outcome is an overview of the people, touchpoints, interactions, and emotion drivers that define the experience. Photos and videos of users interacting with the product help understand the reality.

  • Understand the user environment and key contextual factors potentially needing to be considered in product design.

  • Strategy and Design workshops

  • UX Design

                            

However, clients’ needs also need to be part of the equation, as one team’s needs and focus might not reflect another team’s needs and focus. Strategy and design workshops can be conducted to iron out the product design requirements and define clear guidelines upfront. These workshops can be conducted with a variety of relevant stakeholders and are usually informed by previous research or already available sources from the client. The output could be strategy / journey maps guiding new developments as well as first interaction and design concepts to inform the translation into usable concepts.

Once the end user requirements, and the client’s requirements are clear, it is time to start the design of the product. Iterative task-based usability testing should be performed to refine design concepts, to ensure that the product going into formative testing is as refined as can be, based on the initial input from the users and the client.

 

CONCLUSION


The product that needs to be tested in formative evaluations can only be as good as the sum of the previous designs and developments. All steps that come before the formative evaluation are therefore critical and should never be rushed. Making sure the product takes into account both user and client needs is paradigm to ensure a smooth formative and summative evaluation process and a good final product.

A humorous image on AI quality assessment: A robot with data charts observes a confused hamster in front of facial recognition, a pizza with glue, and a rock labeled as "food."

Anecdotal Evidence or Systematic AI Research – The Current Situation and What Still Needs to Be Done

AI & UXR, CHAT GPT, HUMAN VS AI, OPEN AI

Futuristic cosmic scene featuring the glowing number 42 at the center, surrounded by abstract technological and galactic elements.

What ‘42’ Teaches Us About Change Management and UX

AI & UXR, CHAT GPT, OPEN AI, UX

An abstract humanoid outline formed of handwritten notes, books, and flowing ink lines in soft pastel tones, surrounded by a cozy study environment.

Who Are We Talking To? How the Image of ChatGPT Influences Our Communication

AI & UXR, CHAT GPT, HUMAN VS AI, OPEN AI

Illustration of the Turing Test with a human and robotic face connected by chat symbols.

Why Artificial Intelligence Still Can’t Pass the Turing Test

AI & UXR, CHAT GPT, HUMAN VS AI, OPEN AI

two folded hands holding a growing plant

UX For a Better World: We Are Giving Away a UX Research Project to Non-profit Organisations and Sustainable Companies!

UX INSIGHTS, UX FOR GOOD, TRENDS, RESEARCH

Two humanoid robots in a futuristic studio reflecting on their existence. Dark atmosphere with a digital backdrop.

Does an AI Understand Its Own Existential Crisis?

AI & UXR, CHAT GPT

Several people laugh at an AI robot screen displaying "Error 404: Humor not found," surrounded by speech bubbles, coding symbols, and books about humor.

Does an AI Understand Jokes?

AI & UXR, CHAT GPT

A futuristic book with a glowing cover, surrounded by digital light streams and AI symbols like networks and binary code.

Everywhere All At Once – How AI is Changing Our World and What We Can Gain

AI & UXR, CHAT GPT, OPEN AI

Symbols for New Year's resolutions, motivation, and AI support.

Successfully Implement New Year’s Resolutions and Discover Personal Motivators With ChatGPT

AI & UXR

A brain, half sharp, half pixelated, symbolises remembering and forgetting. Subtle ChatGPT logo in the background.

Remembering and forgetting with ChatGPT - A guide for beginners

AI & UXR

A cozy Christmas table with a laptop, gifts, a cup of cocoa, and festive decorations, showcasing creativity and humor for the holidays.

The ‘Christmas Prompts’ - Practical & Fun Ideas for the Festive Season

AI & UXR, TRENDS

A futuristic humanoid figure made of glowing digital code fades into a neural network background, symbolizing AI and consciousness.

Hollywood’s as AIs vs ChatGPT: What Film AIs Have In Common With ChatGPT (And What They Don’t)

AI & UXR, CHAT GPT, HUMAN VS AI

Medieval image of a scholar with a scroll, surrounded by floating symbols representing errors and hallucinations.

Calculating With AI: A Story of Mistakes and Coincidences.

AI & UXR, OPEN AI, HUMAN VS AI

A dark, satanic-themed image featuring a menacing devil's head with horns, surrounded by gothic and occult symbols, including pentagrams and flames. The phrase 'The Devil is in the Details' appears in bold gothic font in the center, with red and black colors dominating the background.

Everything You Need to Know About Tokens, Data Volumes and Processing in ChatGPT

AI & UXR

Colourful image with typewriter, speech bubbles and pen representing different writing styles; background with fonts in varying typefaces for style diversity.

Your Own Writing Style and ChatGPT: A Guide to Proper Communication

AI & UXR

A women yells at a robot.

Being Nice Helps - Not Only With People, but Also With AI

AI & UXR

A face split down the middle with the left half being a robot and the right half a woman.

Male, Female, Neutral? On a Journey of Discovery With an AI - Of ‘Neutrality’ and Gender Roles

AI & UXR

A floating robot between many symbols of the English and German language.

German or English? How the Choice of Language Influences the Quality of AI Answers

AI & UXR

Image of a podcast cover on the topic of quality in UX research with two women on the cover.

Podcast: Why the quality of UX research can sometimes be a challenge

UX, UX INSIGHTS, UX QUALITY

Two people sitting at a table in a office in front of a laptop and discussing

Why User Research Is Essential: The Most Common Objections and How to Refute Them

UX INSIGHTS, STAKEHOLDER MANAGEMENT, OBJECTION HANDLING, ADVANTAGES USER RESEARCH

 RELATED ARTICLES YOU MIGHT ENJOY 

AUTHOR

uintent

We are an international, employee-owned UX and usability research agency based in Hamburg & Munich, founded in 2018. We have UX Labs directly on site at our offices and have a network of partners to rent labs elsewhere as well. Our team consists of industry pioneers with more than 20 years of experience as well as young professionals. We have conducted research on every continent and have seen thousands of interfaces - from early, non-functional paper prototypes to production models. We draw on a wide variety of qualitative and quantitative research methods. Because we value quality, confidentiality, availability and integrity of information, we are ISO 9001 certified and TISAX®️ participants.

We are part of ReSight Global where we are united with our sister companies in the USA, UK, India, China, and Japan. Moreover, we are a member of the UXalliance, a global network of partner agencies.

                

bottom of page