Orange iterative mobile prototype testing

• The brief
• How we responded to the brief
• What we did
• The outcomes
• Timing

Download this case study in PDF format

The Brief

Orange is one of the main mobile phone networks and broadband providers in the UK. Having recently redeveloped and launched their homepage after iterative testing with WUP, Orange are developing their mobile site. Orange wished to carry out a number of iterative mobile user testing sessions on prototype designs to identify improvements before the launch of the new mobile site.

How we responded to the brief
We proposed testing with 6 testers for each round of testing, representing Orange’s target audience. These were a mix of male and female users, who regularly use mobile websites on smart phones. The clickable prototype was uploaded onto the device in preparation for the testing.

What we did

We discussed the objectives of each round of testing with the project manager, prepared a facilitation guide to include typical user journeys and agreed which mobile device would be used for the testing. We recruited 6 testers for each round of testing.

The testing was conducted in our purpose built studios in Chippenham. We used the latest in mobile eyetracking technology – a Tobii X120 and mobile device stand. This enabled us to gain an insight into the usability issues by watching the eye movements in ‘real time’ and easily identify which elements on the mobile site caught the users’ attention and which did not.

The session was recorded (audio recording and screen capture displaying the users’ hand movements and gestures). Following the testing, a report was provided detailing the outcomes of the research plus the DVDs of the research sessions.

The outcomes

Overall, the mobile site was well presented and helped to reinforce Orange’s brand values. All users said that they would use the mobile site once it has been launched. The research identified c. 20 usability issues per user testing session, which informed the mobile site development prior to the next round of testing. Sessions explored the labelling used and the type of content users wanted on the mobile site.

Iterative testing enabled improvements to be made between designs and the changes made were tested with ‘real’ users.

WUP has its own tester recruitment team and purpose built studios, allowing us to adopt an agile approach to iterative testing.

“Thank you very much for the report, this went down very well when I presented it the stakeholders and it was encouraging the testers responded well to the header“

Ginette Reshamwala, Orange

Timing

Each round of testing was conducted at regular intervals during 2011, each taking approxamately 3 weeks to complete from recruitment to delivering the final report. Our agile approach meant that the testing fitted in with Orange’s flexible project plan.

Contact us for more information on how WUP can help you with mobile testing.

Return to top