Michael DeVries

Sr. User Experience Researcher and Analyst

| Portfolio Highlights
| Heuristic Evaluations | Measuring Experience | Leading UX | Usability Testing
Bill difficulties
Usability Testing in the Lab: Sprint and Nextel Telecom Bills

Overview

Do you pay much attention to your wireless phone bill after the first few paper invoices, or do you sign up to pay it automatically because you don't want the hassle of trying to figure it out? The goal of the study was to review the current bills, and then to evaluate new designs.


Research Design


Example of one of the bill page redesigns used in testingThe invoice to the right is an example of one of the prototypes used during the study. The general study outline included the following:

  • Primary variables:
    • Invoice type:
      • Old Sprint
      • Old Nextel
      • New Sprint
    • Bill Scenarios:
      • One phone, everything is fine
      • One phone, there is a problem
      • Multiple phones on one plan
      • Multiple phones on multiple plans
    • Customer type:
      • Sprint or Nextel customer
      • Competitive carrier customer

  • Measures
    • Task performance (pass/fail)
    • Perceived clarity of content (understand/confused)
    • Perceived availability of content (available/missing)
    • Time on task
    • Task path
    • Usability issues



Accomplishments

The evaluations indicated that the new designs were an improvement over the older designs, but that there was still work to accomplish. This Kansas City Star article takes note of bill design change. (PDF)


Building on That

A more notable finding came from an insight I had after the first rounds of testing. In reviewing how users get their bills paid, data trends showed that considerable effort was exerted in splitting bills. For example, how do you split the taxes and minutes used. As a result, I added probing questions on to the end of the study concerning how customers go about paying their bills, particularly in a splitting scenario. My findings indicated that indeed, there were specific trends in how user's split their bills. This finding eventually lead to the design of a special section in the bill that presented different options on how to split the bill along with the calculations. A patent was submitted for the calculation method.


Skills

  • Ability to see new trends in the data and willingness to pursue them to understand their impact
  • Experimental Design
  • Lab usability testing for prototypes (plan, design materials, identify tasks, facilitate study, statistics, report)
  • Screener development and working with external recruiting vendors
  • Synthesizing findings into actionable design recommendations
  • Designing new user experience measurements

Back to Portfolio Highlights
More...
Usability Testing

Copyright 2010 Michael DeVries