Usability Report for Surfline Mobile App

Usability Report for Surfline Mobile App Nick Powers April 26th, 2015 What is Sur+line? Surfline is a website that allows surfers to check the surf report at various surf breaks around their area. They give detailed informaHon from buoy readings to a live web cam of the waves to a high level report. With phones becoming more and more popular, they know they need to improve their mobile app. 2 Participants Six people were interviewed in this usability study and really fit into three different personas: •  Daily surfer -­‐ Surf almost every day; understands the buoys and cares about all the informaHon being reported •  Weekend warrior – Full Hme worker, surfs mainly on the weekends and gets a weekday session in every now and then. Understands majority of reports but not buoy readings •  Surf vaca5oner – Rarely surfs and usually will only surf when traveling; checks Surfline before trips; really only cares about size and condiHon, will someHmes look at wind and Hde. 3 What was tested? There were 3 major tasks that the parHcipants were told to do with quesHons for feedback at each step. •  Check the surf report for your favorite surf spot •  Check the surf forecast for 2 days in advance •  Watch a Surfline featured video 4 Task 1: Check the surf report for your favorite surf spot Finding: When coming to this page, eyes immediately jump to the white text in the center of the page. AXer a few seconds of not knowing where to go, they found the search icon. Recommenda5on: Make search more obvious for people on the first page. Put a buYon in middle instead of having text tell them to search for buYon 5 Task 1: Check the surf report for your favorite surf spot Good: Once people found where to search, they found searching very easy Finding: “Why do I have to add a spot to a favorite? Can I just view a spot with out making it a favorite?” Recommenda5on: Make it so you can search a surf spot without making it a favorite. 6 Task 1: Check the surf report for your favorite surf spot Recommenda5on: People seemed to pause at this point wondering why it didn’t confirm this step was already done since they just added this spot. 7 Task 1: Check the surf report for your favorite surf spot Good: It seemed very straight forward to click the spot to view the forecast for it. 8 Task 1 : Check the surf report for your favorite surf spot Good: “The webcam is the only reason I use Surfline”. Good job of pueng it at the top. Good: “The color coordinaHon works really well with current condiHons and allows users to get used to color associaHon” Finding: There was no way to close out of an ad when viewing webcam in full screen. Recommenda5on: Allow users to exit ads as well. Finding: Half the people missed the Hdes and didn’t find them unHl I asked them to search for it. Recommenda5on: It may help to make this text bigger 9 Task 1: Check the surf report for your favorite surf spot Finding: Only one person stopped and read this text and they said they wouldn’t stop and read it before checking the report Recommenda5on: Move the Surfline expert’s report to the boYom where the advanced user would want to view 10 Task 1: Check the surf report for your favorite surf spot Finding: 0/6 people said they would share a report. Recommenda5on: I recommend moving it to the boYom “Really like the graphics and visuals. Wish it went before the text” Finding: A few people said they don’t really know what the direcHon means. Recommenda5on: They would rather know if its offshore, cross-­‐shore, or onshore. Possible a ranking for good to poor wind as well. Finding: A couple people said this Hde informaHon isn’t enough for them to want. Also it is not next to the other low and high Hde informaHon. It seems people preferred the Hde graph below. Recommenda5on: The Hde graph near this arrow for them to easily associate with it. 11 MulHple people liked the use of rising vs. falling Hde. Task 1: Check the surf report for your favorite surf spot Good: Advanced users liked the buoy informaHon, and the basic users didn’t even care about it. They all said “It would be cool if I understood it”. Maybe a link to a blog post explaining how it works for the curious beginner. Finding: This text was way to small. 6/6 people said they struggled to read the numbers. Half the people tried to Hlt their phone to zoom. They also tried to use to fingers to zoom in. Recommenda5on: I like the idea of clicking to see full screen. 12 Task 2: Check the surf forecast for 2 days in advance Finding: It was not obvious that you could click on the Wednesday and get the forecast. Need to do a beYer job making it clear what day the page is as well as making the next day look clickable. Recommenda5on: Shade the day bar into the open condiHons bar so its more obvious we are on Monday and there are tabs. Good: Everyone really liked the colors and how its associated with the condiHons. Finding: Everyone struggled finding the forecast page and the bars that are at the top are not clear. 3 people said they look like wi-­‐fi signal. Recommenda5on: Make it clearer that this takes you to the forecast. Finding: Everyone tried to click on these days and didn’t know why they were greyed out. Recommenda5on: Make them clickable but have upsell message on their and explain why its grey. 13 Task 2: Check the surf forecast for 2 days in advance Finding: Very hard to read. Recommenda5on: Make text bigger or clickable for full screen. Good: People really like this Hde graph and think it is very clear. 14 Task 2: Check the surf forecast for 2 days in advance Finding: Users said the graph is cool graph but some of the users didn’t get it. Recommenda5on: A legend would be very helpful. 15 Task 2: Check the surf forecast for 2 days in advance Good: Users said they liked it or they didn’t care to read it but said they could see how it is useful. I think it is in the right spot and belongs below the other informaHon. 16 Task 3: Watch a Sur+line featured video Good: It was easy for everyone to navigate to the videos. 17 Task 3: Watch a Sur+line featured video Good: Very easy for people to see the video they wanted. 18 Thank You! Appendix Test Plan Page 1 Test%Plan%
Surfline%Mobile%App%
!
Overview'
Surfline!is!a!website!that!allows!surfers!to!check!the!surf!report!at!various!surf!
breaks!around!their!area.!They!give!detailed!information!from!buoy!readings!to!a!
web!cam!of!the!waves!to!a!high!level!report!saying!the!height!and!a!surf!reporter’s!
description.!They!also!have!a!mobile!app!that!allows!surfers!to!check!the!waves!
from!their!phones!and!tablets.!
!
Study'Goals'and'Objectives'
The!purpose!of!this!study!is!to!find!how!easy!it!is!for!first!time!users!to!check!the!
surf!in!Surfline’s!Mobile!App.!!
1. Select!your!favorite!surf!spots!
2. Check!the!surf!for!your!favorite!surf!spot!
3. Check!the!forecast!for!the!next!3!days!
!
Logistics'
The!tests!should!be!quick!since!we!really!want!to!optimize!the!experience!for!
checking!the!surf!through!the!app.!I!would!expect!the!test!to!go!from!15G30!minutes.!
I!will!test!with!surfers!of!all!different!ages!from!retiree!to!teenager.!I!want!to!test!
with!different!types!of!surfers!as!well!(shortboarders!vs.!longboarders)!to!see!if!
there!is!a!difference!in!the!way!they!check!the!surf.!
!
Test'Session'Structure'
1.
2.
3.
4.
5.
6.
7.
Introduction!
Interview!to!get!demographic!information!as!well!as!surfing!characteristics!
Tasks!
If!time!permits!–!Additional!Tasks!(view!Surfline!posted!videos)!
Questions!from!observer!
Post!Test!Questionnaire!
Debrief!with!participant!reviewing!experience!and!providing!incentive!
!
Moderator'Guide'–'Test'Guide'
1. Open!app!(if!app!is!downloaded!yet,!have!them!download!it.!App!is!free)!
2. Igonre!the!help!menu!to!get!started.!We!want!to!improve!how!easy!it!is!
without!the!help!
!
Select%your%favorite%surf%spots%
1. Check!the!surf!for!at!least!two!of!your!favorite!surf!spots!from!different!sub!
regions!(time!how!long!it!takes!while!watching!where!they!click)!
2. *If!Stuck*!Click!the!search!bar!
3. *If!Stuck*!Select!region,!sub!region,!and!surf!spot!
4. *If!Stuck*!Click!Done!
21 Test Plan Page 2 !
Check%surf%for%favorite%surf%spot%
1. Select!your!favorite!surf!spot!and!check!the!surf!report!
2. From!the!surf!report,!would!you!surf!this!day?!When!would!you!go!out!to!surf!
based!on!the!report?!
Check%your%next%favorite%surf%spot%
1. Check!the!report!for!your!next!favorite!spot!
2. From!the!surf!report,!would!you!surf!this!day?!When!would!you!go!out!to!surf!
based!on!the!report?!
!
Check%the%forecast%for%your%surf%region%
1. For!your!region,!check!the!surf!for!the!next!few!days.!%
2. Would!you!surf!or!not!surf!the!next!few!days!based!on!the!report?!Why?%
!
If%additional%time,%go%watch%a%Surfline%featured%video%
%
Post<test'Questionnaire'
Please!answer!the!following!questions!honestly!about!your!experience!with!Surfline.!
Your!answers!will!remain!anonymized.!
!
Surfline!Survey!
!
Would!you!use!Surfline!to!check!the!surf!before!surfing!in!the!future?!
! Yes!
! Maybe!
! No!
!
22 Test Plan Page 3 How!difficult!was!it!to!complete!the!following!tasks?!
!
Very!Difficult!
Difficult!
Neutral!
Easy!
Very!Easy!
1.!Select!your!
favorite!surf!
spot!
! !
! !
! !
! !
! !
2.!Check!the!
report!for!
your!saved!
surf!spots!
! !
! !
! !
! !
! !
3.!Check!
report!for!
another!surf!
spot!
! !
! !
! !
! !
! !
4.!Check!the!
surf!report!
for!the!next!
few!days!
! !
! !
! !
! !
! !
5.!(optional)!
Watch!a!
featured!
surfline!video!
! !
! !
! !
! !
! !
!
!
How!frequently!would!you!use!surfline!before!going!surfing?!
! Every!time!
! Most!times!
! Half!the!time!
! Every!once!in!a!while!
! Never!
!
What!are!your!three!favorite!things!about!the!Surfline!mobile!app?!
1.!! !
!
!
!
!
!
!
!
!
!
!
2.! !
!
!
!
!
!
!
!
!
!
!
3.!! !
!
!
!
!
!
!
!
!
!
!
!
What!are!your!three!least!favorite!things!about!the!Surfline!mobile!app?!
1.! !
!
!
!
!
!
!
!
!
!
!
2.! !
!
!
!
!
!
!
!
!
!
!
3.!! !
!
!
!
!
!
!
!
!
!
!
!
How!could!Surfline!improve!the!user!experience!to!allow!you!to!check!the!surf!
easier!and!get!the!answer!you!want?!!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
!
23 Participant Personal Data Person Name Age Years Surfing Frequency Persona P1 Ryan 23 10 Every few months Surf VacaHoner P2 Rob 36 2 Every few months Surf VacaHoner P3 Jim 54 30 Every few months Surf VacaHoner P4 Dylan 23 5 Few Hmes a week Weekend Warrior P5 Brennan 24 4 On weekends Weekend Warrior P6 James 6 Almost every day Daily Surfer 24 24