Our design group has continued developing our User Interface Design in much the same way as we did in stages 1 & 2.
In stage 2, our task is to perform user testing to try to improve upon the design we developed in stage 2. My primary role was to create the Test plan. We held a group meeting during which we discussed what information we wanted to gather, and what specifically we felt needed testing. From these discussions, I documented the test plan, with the exception of the test script which Cameron wrote, since he was going to be the Moderator. I also had the idea of creating a score card for scoring each user against each task. By using numerical values wherever possible, I felt sure this would simplify our analysis.
While developing the test plan, it became clear to me that we needed to test more than just the structural design. This was because our test group were children in the ages of 5-12. I felt that they needed a more hands on demonstration of the games, and the customisation of their character. Without these elements, the testing would be dull for them and unlikely to hold their interest. I also felt that this would give us a better idea of the interest they had in these elements than simply asking.
As a result of this epiphany, Scott created a paper prototype of the character customisation, while I developed a basic, though incomplete android app as a functional prototype of the games.
On the day of testing, I acted as an observer, using the prepared scorecard to take notes and rank each of our tasks according to how hesitant, uncertain and how much deviation from the expected task the user was. Each of these values was collected as a number from 1 to 5, allowing a simple statistical analysis. We also collected more anecdotal evidence as notes, while taking particular note of anything the user particularly liked or disliked.
This approach meant that I was able to collate and analyse all of the data within 45 minutes to an hour of the conclusion of testing.
Want to read more?
You can read more about what I discovered through the testing process by reading my reflection.