Mobile Device Usability Testing

by

mobile-usability-testing-setupI am working on a project which calls for the following:

“… think through the process of setting up and conducting a usability test for mobile devices … you will design the location and test protocols, including any logistical and equipment considerations necessary to conduct a real test.”

I found “A Big Nerd Ranch Tech Talk: Mobile Usability Testing,” by Jenn Downs (watch it below), provides a helpful starting point for someone thinking about setting up a mobile usability test — that’s where I am right now, at least. I am at the beginning stages of figuring out the best ways to set up the test. It’s necessary to know these basic steps, because here’s the scenario I am working through:

The company you work for has a web site that used to meet the needs of most of its users. That was until almost everyone started using phones and tablets to look up products, services, locations and price. The analytics team at your company was surprised to see that in the past year, 15% of the company traffic is from iPads and other tablets, 20% is from iPhones and 30% is from Android devices.

So now nearly two-thirds of the company web traffic is on mobile devices. Everyone just assumed that the current web site would scale properly on mobile devices and that people would be able to get what they needed. Unfortunately, that’s not the case. The customer support center is getting inundated with calls concerning problems finding information while trying to use the desktop site on a mobile browser. It’s time to fix this. The company has decided that it needs to create a responsive design that adjusts to device type and screen resolution, and work on dedicated apps for iOS and Android that display web pages.

But first they want to do some testing on mobile devices to see what areas customers struggle with. There is budget for this project, but no one seems to know how to record mobile device interactions properly. As the UX member of the team it is up to you to create a mobile usability setup in the current usability lab. Your job is to create a setup that will provide great results.”

As a web producer for a news content website, I know all too well about the shift to mobile. Companies, including media companies, continue to struggle with this shift. Right now, if your site is not responsive, forget it. You’re either mobile friendly or you’re dead. So, this is an extremely important task for the company and it deserves top-notch UX research from the beginning.

As stated: I am now working to design/create/plan a mobile usability test setup that will provide great results for this company.

I will keep you posted. Here’s that video:

Unmoderated Remote Usability Test Findings: Wunderground.com

by


Here is a presentation about the findings from an unmoderated remote usability test for Wunderground.com. If you would like to take the test, click here.

View the presentation PDF here.

On findings

Wunderground.com is easy to use for simple tasks such as looking up a city’s 10-day forecast, finding the radar for your area or looking up historic weather data.

However, this test showed some areas of concern, none the least of which is the fact that 0 of 6 participants had used this site before. All of them had experience with looking up weather forecasts and radar online, but not one had ever used Wunderground.com to do so.

Moreover, this specific weather site’s radar is lacking. Users want simpler, more straight-forward radar which he or she understands.

The remote, unmoderated usability test allowed us to keep the participants in their own setting where they could take the test on their own time. They thought aloud, which offered some of the best qualitative data from this test.

Watch the presentation above for more.

Creating An Unmoderated Remote Usability Test

by

This week, I created three tasks for an unmoderated remote usability test for wunderground.com.

If you’d like to take the test, go here. It shouldn’t take more than 10 minutes to complete.

This exercise helped me understand the importance of setting up close-ended tasks for such a test. The follow-up questions are just as important so we can learn the most about the participants, which will help in analysis of the results.

I will circle back with the results and my analysis.

UPDATE: Here are the findings.