Discussion Guide - Lo-Fi Usability test
Research Objectives
Have user connect with other fans or the artist;
Have the user experience the concert;
Have the user connect with fans after the show.
Evaluative test:
“ Good afternoon, thank you for your time with us. My name is Helene and this is my teammate Karina, who will take notes of our interview. As you know, we are developing a prototype of our application in which our users, who attend virtual live shows, can experience similar feelings caused at live festivals. Would you mind if I recorded this interview? The recording will only be used for this purpose and your identity will remain confidential.
I want to clarify that due this early stage of development not everything is clickable but I would like you to interact with the website as naturally as possible.
Before we start to navigate on the app , I ‘d like to ask you a few questions:
Pos covid, what app are you using to know about virtual live shows? Why?
Before we dive in I’d like to share details about the scenario.
“ You bought a ticket from a new app for a live show by your favorite singer. To access a valuable part of the site you had to wait for the arrival of a wristband. Finally, it arrived and you already scanned it.
Task 1: After you scanned the wristband:
Could you show me how you would connect with other fans? Think loud
Could you show me how you would connect with the artist?
Questions after task 1:
Could you tell me how you felt during this process?
Is the navigation understood? If not why?
Is any part of this process unnecessary for you? If yes, can you explain what part and why?
Task 2: The big day has just arrived and finally you are going to watch the virtual live show of one of the artists that you love.
Could you show me how would you access the show?
Could you show me what kind of interactions you can experience during the show?
Questions after task 2:
Could you tell me how you felt during this process?
Is this experience what you expected? If not what experience have you expected?
Task 3: The show has passed and now you feel the need to continue sharing your experience with other fans.
Could you show me how would you do to connect with fans after the show?
Questions after task 3:
Could you tell me how you felt during this process?
Is it the app that you expected? If not why?
How do you think you can improve it?
Do you have any question from us?
Thank you for your participation
Greyscale Usability Report
Executive Summary
The purpose of this test is to see how the user would access a concert using the new and improved Live from Home app. This test helps us define paint points in this gray scale prototype.
Key Findings
Change the term ‘Interaction’
100% of users were confused about the term ‘interaction’
Navigation Needs work
Users thought the navigation of the app needs work (Add a back button)
Users liked how the layout worked
Users felt the app seemed straightforward but the copy could use work so things weren’t as confusing
Methodology
Outreach & Screening
The user testing was done through zoom. They all took it on a computer. A total of 3 users were tested on the Greyscale Prototype.
Participant Profiles
Number of Users - 3
Date of Test - nov 16, 2020
Age of Users - 20’s - 30’s
Testing Setup, Moderation & Post-Task Questions
Goal of the user test (Greyscale)
Have users connect with other fans before the show
Have users interact with the artists
Have users connect with other fans after the show
Task One
This first part of the questions is about a pre show phase. " Can you show me how you would connect with other fans before the show" .
Task Two
Now we are in the second part that is about connecting with the artist. "Can you show me how you would interact with the artist?”
Task Three
The third and last part is all about the post-show experience. "The show has passed and now can you show me how you would connect with other fans".
Results
Task One
User is trying to interact with other fans before the show begins.
What’s working What’s not working
Easy to find where the chat function was Assigned chat room was confusing
Copy is good Users didn’t want to chat with other fans during the show
Task Two
Users are trying to interact with the artists.
What’s working What’s not working
Users like the idea of leaving requests. What does ‘interact’ with the artist mean?
Some users had difficulty finding where to interact with the artist.
Task Three
Users attempt to connect with other fans after the show.
What’s working What’s not working
Nothing (?) Unable to locate a method of connecting with other fans
Copy is confusing
Additional Takeaways
What’s Working What’s not working
App seems straightforward The Copy needs better work
Users loved the wristband Navigation needs work
No one knows what ‘interaction’ means
Recommendations & Actions
Need to reimagine what interaction with artists and fans looks like
Need to change copy to be less confusing
Need to rework the navigation