axbom’s Twitter Archive—№ 21,653

I keep hearing "testing with 5 users unveils 85% of usability problems". Who defines 100% ?! Is there an endgame? Seriously curious. #ux
Permalink On twitter.com ♻️ 4 Retweets ❤️ 4 Favorites 2017 Jul 11 Mood -1 🙁

…in reply to @axbom
And I know the original source is Nielsen, but there is very little info on what a usability test is; magnitude, time or number of features.
Permalink On twitter.com ❤️ 1 Favorite 2017 Jul 11 Mood 0

…in reply to @axbom
In this article: nngroup.com/articles/why-you-only-need-to-test-with-5-users/
Permalink On twitter.com ❤️ 1 Favorite 2017 Jul 11 Mood 0

…in reply to @axbom
The premise at least seems to be that all things remain equal between studies... which in my experience is rarely the case in real life.
Permalink On twitter.com ❤️ 1 Favorite 2017 Jul 11 Mood 0

…in reply to @axbom
There seems to be a lot of assumption about when a usability test is carried out (w/ regards to website lifespan) and how it is carried out.
Permalink On twitter.com ❤️ 1 Favorite 2017 Jul 11 Mood 0

…in reply to @axbom
I understand how the math makes sense in a lab environment ceteris paribus, but UX is affected by many factors not even addressed in tests.
Permalink On twitter.com 2017 Jul 11 Mood -1 🙁

…in reply to @axbom
My worry here is that this "rule" tends to undercut what UX brings to the table.
Permalink On twitter.com 2017 Jul 11 Mood -3 🙁

…in reply to @axbom
Companies will go: "let's test with 5 users and fix 85% of the problems". And be done with it and not test again in a year.
Permalink On twitter.com 2017 Jul 11 Mood -2 🙁

…in reply to @axbom
"Fixing" will of course create new problems as will changes in environment, other touchpoints and competing activities.
Permalink On twitter.com 2017 Jul 11 Mood -2 🙁

…in reply to @axbom
Making UX a numbers game diminishes a need to always be chasing design faults. They are never 100% fixed because the world is never static.
Permalink On twitter.com ♻️ 1 Retweets ❤️ 2 Favorites 2017 Jul 11 Mood 0

…in reply to @axbom
Yes, I get what Nielsen means but the approach needs to be much more clarified and wrapped in disclaimers.
Permalink On twitter.com 2017 Jul 11 Mood +1 🙂

…in reply to @axbom
Our focus has to be goal fulfillment, not measuring how many usability problems are fixed.
Permalink On twitter.com 2017 Jul 11 Mood 0

…in reply to @axbom
There, I think I'm done now... 😂
On twitter.com ❤️ 1 Favorite 2017 Jul 11 Mood +1 🙂

…in reply to @axbom
If you want to read the original article and study: dl.acm.org/citation.cfm?id=169166
Permalink On twitter.com ❤️ 1 Favorite 2017 Jul 11 Mood +1 🙂

…in reply to @axbom
Working on a revised wording...
Permalink On twitter.com ❤️ 2 Favorites 2017 Jul 12 Mood 0