TESTING Maraya

I made a flowchart which shows how an already existing app works. I have chosen to have a look at the app 'NightSet' because it is connected to my user group - partygoers. As it allows people to discover the best party in town, broadcast their night to the public in real-time and meet like-minded people.

Close up of the sections of the Flowchart.

What are you going to test?

Is the design of the app appealing to the user?
Is the user going to be interested in using the app?
Is is suitable for young users?
If there is a function to connect your phone via bluetooth to an interactive poster, will the user use it?
If you have to turn on your location, is the user going to agree to use this function?

Which prototype are you making?

I would like to make a paper version of the prototype because that way it Will br easier to make different versions and try it on people + I will be able to have a look at the old versions I have made.

Where will you test?

I would like to test it, firstly, at home in a sort of a 'studio' environment and if I have enough time left at the end, I would like to try it in the environment of the bus, going to the club.

Who will be your testers?

I am going to test the young partygoers who use the bus as a transport to the club and to go back home.

How will you document you test?

I would like to record the tests with a camera, so that I have the visual expressions and the voice comments mentioned by the user.

What are you going to test?

If the functions are understandable?
Is the user finding the right places to click?
Are the instructions understandable?
Are 30 seconds enough for memorising the picture?
If the user has the chance to upload its final 'drawing' on a website, will he use it?

Which prototype are you making?

I would like to do an analogue and a digital version for the prototypes. I would do the analogue version because I will have the chance to see how it will look like in its real size (or at least a close enough size). The digital version I will do because there I will mainly focus on the real design and how it looks on a screen because after all the poster will be interactive screen.

Where will you test?

I will test the prototype at home because I am not currently in the Netherlands and it will not be relevant enough to test it with the night bus in my home country, mainly because the artworks are not here. Moreover, because of the Corona virus, the night bus is still not working in my home country.

Who will be your testers?

The testers which I have chosen are young people who have used the night bus in the past for transport to the club and back home. They are as well in the age group with which I am working for the project - 18 to 25.

How will you document you test?

Since the testers are not willing to be filmed with a camera while testing the prototype, I will take notes on what their comments are, so that I can fix the issues later.

As I mentioned in my test plan, the testers were not willing to be filmed while using the prototype. Thus, I have made some notes and took some screenshots of the errors which occurred during the testing. I took the advise of Maytal and Arjen to not explain anything about the product and let the user decide what has to be done, so that I can see if the instructions and the icons are understandable enough.

The first tester is a 21-year-old boy who has used the night bus as a transport to the club and going back home. He came home and tested the prototype on his phone.

The first thing he noted is that he does not exactly understand what he has to do with the map and the pins. That is why I added the instruction 'Choose a pin'.

Moreover, he said that the pins are way too small and it was hard for him to click on them, even though I explained that this will be on a big screen and not on the phone. That is why I had to make them bigger and make a rectangular, transparent background so that it is more easy to press them.

As he had chosen a more 'easy' artwork by chance, he had enough time (in time frame of 2 minutes) to make the quick pixelated sketch of the artwork. He even asked me if he can add his initials or it has to be anonymous. This made me think that there can be a space where the person can write his name or initials.

When the boy went to the 'Reader' side he asked me if he can zoom in the pictures in the above right corners. That is why I have added an 'expanding' icon and make a new page where the picture was expanding.

IN THE FUTURE I WOULD MAKE MORE TEST ON THE PROTOTYPE AND WITH MORE TESTERS.

The second tester is a 20-year-old girl who as well has used the night bus, even more than the boy. She as well came home to test it, however she tested it on my computer.

The thing she noted was that there is no way back once you start which for her is an issue and she gave me an example: 'What if I have started the game and the bus comes. I have to go back home and I would leave it open because there will be no 'X' to close it and when the next person comes, he will be confused why this is not working properly.' And she is completely right about that, don't know why I have not thought of it, but that is why I am testing the prototype. But the thing is that my idea was to make the person to get through the whole process and not be able to stop it and start all over again just because, for example, he forgot how the artwork was looking. However, she do have a point and I agree that there has to be a 'Back' button.

Another issue she had was the limited time for making the pixelated sketch. That is why I decided to leave it open without a time frame and with a 'Continue' button, so that the person can end it whenever he feels ready.

It was important for if the girl will find the function for expanding the pictures in the 'Reader' section because I have made them white and was not sure if they are not blending with the background of the pictures. She found it and said that they are visible enough.