Quick & effective remote user testing

Quick & effective remote user testing
Insights Conference
28 March 2015
UX / web / information design
mattish.com
Hello, I’m Matt
This workshop
‣
An intro to user testing
‣
Design testing with Usabilityhub
‣
Prototype testing with Skype
‣
Website & app testing with usertesting.com
‣
Q&A
Why user test?
‣
Quantitative data (analytics, metrics) only tells you the what
‣
Qualitative data like user testing helps understand the why
‣
Get outside perspectives – beginner’s mindset
‣
Reach real users/customers and understand them better
‣
Understand what they like and want
Traditional user testing
Going remote
Best practice
‣
Recruit smartly
‣
Mimic real life usage – let them drive
‣
Nudge them if they get stuck
‣
No leading questions
‣
Encourage honesty
‣
Observe actions
‣
Get videos for later
Best practice – post-test
1. Record it
2. Watch it back, highlight key points
3. Spot the repeated patterns/issues – make clips
4. Pull together a doc with the key issues, link to clips
5. Prioritise and fix the issues...
Testing through the design process
Design
Usabilityhub
Prototype
Skype
Build
usertesting.com
Testing through the design process
Design
Usabilityhub
Prototype
Skype
Build
usertesting.com
What?
‣
Usabilityhub – quick design testing
‣
Five second test – first impressions, key messages
‣
Preference test – compare two designs, lightweight A/B testing
‣
Click test – call to action elements, links
‣
Nav flow test – multiple click tests, create funnels, navigation
How?
1. Upload jpgs or pngs
2. Set up your instructions (and post-test questions)
3. Pick how many users
4. Emailed when all your results are in
Cost?
‣
Free…
‣
…by doing tests for other people
‣
Or $0.75–$1.00 per participant in your test if you’re lazy
Testing tip
‣
Avoid leading questions or scenarios
‣
“You want to book a family holiday for you and your children for the
easter break. How would you do that?”
‣
NOT “Go to the home page of awesomeholidays.com and click ‘special
offers’ then click ‘easter holidays’”
Demo
Testing through the design process
Design
Usabilityhub
Prototype
Skype
Build
usertesting.com
What?
‣
DIY remote testing
‣
For clickable prototypes
‣
More on Keynote for prototyping: https://www.gv.com/lib/theproduct-design-sprint-prototypeday4
‣
To reach users you know or have contacted via Skype
How?
1. Make your prototype clickable (as HTML or PDF)
2. Organise a Skype call and send them the prototype beforehand
3. Call them up on Skype
4. Share the user’s screen with yourself
5. Record it with Quicktime
6. Carry out the test
Cost?
‣
100% free
Testing tip
‣
Watch what they do more than what they say
‣
Avoid asking testers to suggest new features or solve the problem
Demo
Testing through the design process
Design
Usabilityhub
Prototype
Skype
Build
usertesting.com
What?
‣
usertesting.com is for user tests of a site or app
‣
Carried out by a panel of users around the world
‣
Get back videos of them testing with audio of talking aloud thoughts
‣
Can make clips and share the videos
How?
1. Supply your URL
2. Pick your users and devices
3. Write your test and introductory scenario
4. Set the test running
5. Videos emailed to you as tests are completed
Cost?
‣
$49 per user
‣
Discounts for bulk credit purchases
‣
Enterprise pricing available
‣
Can try out on peek.usertesting.com for free
Testing tip
‣
Five testers is all you need
‣
More here: http://www.nngroup.com/articles/how-many-test-users/
Usability
problems
found
Number of test users
Demo
Thanks!
‣
Questions?
‣
Slides, articles & newsletter at mattish.com/insights
‣
[email protected] for an email chat
‣
@ishmatt on Twitter