What to change
Require comparable conditions before accepting the claimed improvement. Ask for the exact route, tool configuration and repeated observations used on both sides. If the original conditions cannot be reproduced, describe the new result as a new baseline rather than a proven change. Preserve representative test evidence with the release record so the next supplier can repeat it without relying on an unexplained screenshot of a favourable score.
A worked example
Illustrative example
Illustrative test: The supplier reruns both versions using one agreed testing setup.
How to check the result
The improvement claim is supported by a reproducible comparison.
A mistake to avoid
Choosing the best after-run and worst before-run exaggerates a noisy result.
Your action checklist
Use these checks to prepare a discussion with your team or supplier. Tick a check when you have recorded the decision or evidence, rather than when a feature has simply been promised.
Entries stay in this page and are not submitted to Kay & Co. Download your notes before leaving; the page does not save them.
Further reading
These primary sources provide additional context for the project decisions above.
Related decisions
Turn the brief into a working service
Kay & Co. can help you scope the work, design the experience and deliver the right solution for your organisation.
Explore support & operations services or discuss your project.
Try the free Healthcare Digital Planner to find your starting priority.