Testing of the wip/mlundblad/transit-routing branch.

Test 1 2016-06-28

Participant: Woman, 28 years old, Gothenburg, Product Manager, IT

Was able to complete the task

  • Have used GNOME Maps very little in the past.
  • Wants to get the route from her home, where she's currently at, to the place for her yoga class later in the day.
  • Searches for the name of the yoga studio, but is unable to find it.
  • Is unsure about the name of the street.
  • Searches for a street name nearby, "Nordostpassagen".
  • Identifies the building of the yoga studio on the map.
  • Wants to move the pin to that location, but it doesn't work. She's not sure why.
  • Right clicks on the spot instead and chooses to route to there.
  • In the search results she gets a number string. Thinks they might be coordinates.
  • Thinks it's really weird that she get a number series instead of the address.
  • Have issues focusing the field properly.
  • "Now it's focused...maybe?"
  • Drags and drops the order of the to and from.
  • Tries to change the time in the public transportation pane. Tries to use a dot between the numbers.
  • "Why doesn't it accept the time?"
  • Has some issues with the calendar focus. She's annoyed that she has to double click. Expects it to be single click.
  • Goes back to the to and from fields.
  • Maps suggests to leave from another bus stop that she's used to. Her apartment is in between two stops.
  • Looks at the bus path on the map and thinks it looks wrong. "The car goes on the road, but it looks like the buses go through the houses"
  • Finds the expand route in the sidebar.
  • "Where do I get off? Is it at Masthugget?"
  • "It would be good if I could zoom closer."
  • Expects focus when pressing the walking part of the route in the sidebar.
  • "Where do I turn left?"
  • Finds the expand route button too small and hard to hit.
  • "Tiny annoying buttons"
  • "Why is the to and from icons different colors in the sidebar and on the map?"
  • Successfully finds the right time and bus in the end

Test 2 2016-06-29

Participant: Man, 33 years old, Gothenburg, Scientific Consultant, IT

Was able to complete the task

  • Have used GNOME Maps a tiny bit in the past.
  • Is at Norra Ågatan and wants to find the time to get home again later in the evening.
  • Starts by exploring the menus.
  • Sees the "You are here" marker and says it guessed the wrong location.
  • Brings up the sidebar.
  • Tries to find the location.
  • Tries to drag and drop the to and from fields. Accidentaly clears the fields.
  • Runs into focus issues. Gets the wrong field.
  • Finds the order of the street name and street number weird.
  • Didn't dive into the route.
  • Wants to drag and drop the pin.
  • Accidentaly removes the wrong entry in a 3-way route.
  • "I want to remove the top one, but I can't"
  • Runs into focus issues with the input.
  • Expected highlight on hovering on entrys. Finds that would be good when comparing different routes.
  • Successfully finds the right tram and time in the end.

Test 3 2016-06-30

Participant: Man, 32 years old, Gothenburg, IT Engineer

Was able to complete the task.

  • Have used GNOME Maps before briefly
  • Wants to get the route from our current location at a café at Ullevi Norra to his apartment at Vågmästareplatsen at the end of the day.
  • Uses the search box.
  • Finds the number of search results overwelming
  • Picks the result with the tram symbol on it
  • A popup shows up on the map
  • Looks at the map and confirms that the location is correct.
  • Unsure about where to go from here.
  • "I expect something like Google Maps where it says Directions to Here"
  • Looks over the icons. "Two of them look very similar". Hovers over them to get a tooltip. "It's not the share one, so it must be the other one"
  • "Add to route sounds confusing to me"
  • Presses the route button
  • "Excellent"
  • Changes the From to Svingeln instead of the current location, since he's going to walk to Svingeln and be there for an hour before he heads back home
  • Opens a menu and picks "Arrive". He sets the arrive time at 18:30
  • "Why wasn't the best route selected automatically? Nothing shows up on the map"
  • "I don't see the origin and goal locations"
  • "Oh, look! The bus is swimming over the river instead of going over the bridge"
  • Successfully finds the right bus and time in the end.

Test 4 2016-07-04

Participant: Man, 36 years old, Gothenburg, Care Assistant Was able to complete the task.

  • First time using GNOME and GNOME Maps.
  • "The UI looks very clean"
  • Used to live in the city of Borås before, so does the task of figuring out how and when to get to his old apartment.
  • Types "Marielundsgatan 11"
  • No results.
  • Tries the query "Marielundsgatan 11, Borås"
  • No results.
  • Tries to search only for "Borås Resecentrum" instead. The city's main bus station.
  • "How do I get there exactly"
  • Right clicks the map. Reads through the menu.
  • "I'm looking for Route to Here, but I can't find it"
  • Recognizes the Go to Current Location symbol in the top left corner from his cell phone.
  • Ends up in the current location
  • Right clicks and chooses Route from here.
  • Types "Borås" in the To field in the sidebar.
  • "19:30 is too soon"
  • Gets a number of results.
  • Dives in to one of the routes and tries to click one of the steps.
  • Is surprised it doesn't expand by clicking on it.
  • One of the steps is "Borås Centralstation"
  • Thinks that's weird, because the bus station and the central station is the same place pretty much.
  • Explains how it looks around there.
  • Gets the task to try and get to the same address, but tomorrow instead.
  • Types "2000" in the time box.
  • "Weird that the times are not in chronological order, that they are backwards compared to the app I usually use, but actually it's better like this"

Test 5 2016-07-06'''

Participant: Woman, 34 years old, Gothenburg, Illustrator

Was able to complete some tasks

  • First time using GNOME and GNOME Maps.
  • Wants to go to Masthuggstorget from her studio in Kviberg.
  • Recognizes the route symbol from some other app. Thinks she recognizes it from Google Maps.
  • "This looks familiar"
  • Opens the sidebar
  • Is able to recognize the symbols for Walking, Biking, Car and Public Transportation.
  • Clicks the current location on the map.
  • Clicks the route symbol.
  • Clicks the biking symbol in the sidebar and inputs Masthuggstorget in the to field.
  • "I wish there was something for alternate paths"
  • "But yes, we were supposed to test public transportation today"
  • Clicks the Public Transportation symbol.
  • Wants to be there at 14:00. Types "1400"
  • Compare different alternatives.
  • Expands a individual route "This is actually really neat"
  • "I hate riding the bus, so lets check for a tram"
  • Successfully finds a good alternative with tram.
  • "I want to try something more complicated"
  • When typing in the To input box, it suddently changes focus to the From field. The participant is focused on the keyboard, so she doesn't notice at first.
  • "Uh, what happened now?"
  • Closes the whole application by accident. Opens it up again.
  • Inputs Alingsås in the To box. There is an entry for "Alingsås", but when she selects it as the destination things just blinks and the field emties.
  • "Uh, that's weird. Doesn't it like Alingsås? What if we try Borås instead?"
  • The input randomly moves from the To to the From field again.
  • "It jumps again. Do I accidentaly trigger a shorcut or something like that?"
  • Successfully finds the Borås central station.
  • "I want to try Alignsås again"
  • Types Alingsås in the To box and selects another entry that she did before in the suggestions.
  • "It seems like it doesn't like the Alignsås-entry with a clock next to it"
  • "Now I want to try to get to Styrsö"
  • Same thing happens as before, the To entry just blanks when she selects "Styrsö"
  • Problems with the focus jumping around again.
  • She tries to go to the destination Vrångö instead. It's successful.
  • When asked to identify the icons for the different means of transportation, she identifies them correctly.

Design/Apps/Maps/PublicTransportation/UserTesting (last edited 2016-07-07 09:55:01 by AndreasNilsson)