Skip to content

Mini Usability Test Results

Cornelius Schumacher edited this page Jun 3, 2016 · 2 revisions

Results for the Mini-Usability-Test.

User 1

Task 1

User searches for "report". Search doesn't show results, only ads (not clear why, maybe a bug?). User falls back to browser search, finds "cutereport" (first hit), goes to details, clicks on home page, is happy.

Task 2

User uses browser search to search for "zip", finds quazip, goes to home page, tries to find out from the information there, if it's for Windows, looks at dependencies. User didn't notice the platforms attribute on the details page. User is not clear, if it would work.

Task 3

User clicks on commercial header, looks at gcf (404 error, meta data needs to be fixed). Then realizes that he wanted to click on the line below, kdchart, goes to home page, finds the information, is happy.

Task 4

Browser search on home page for "qtrest", no results, because it's not listed under stable libraries, scrolling around, going to Google to search for it, gets a result. User goes back to inqlude web site, clicks on the "all" section, browser search finds qtrest now. On the details page there is no information about the stability. User is not sure if qtrest is stable.

Interview

Tasks

User would look for new libraries (e.g. latest releases recommended by other users). Publishing own libraries would be interesting as well.

General comments

  • Tags with categories would help (chart, report, rest).
  • The changing order of the category titles ("stable", "development", etc.) is a bit confusing
  • Highlighting a row on the list would make it easier to click the right link
  • Showing the "all" view by default might help with getting a full overview and making the browser search more helpful

User 2

Task 1

User clicked on "x" next to seach field, does nothing. The Google logo in the search field makes the user cautious.

User searches for "report", clicks on first result "curereport", click on "source" link, is happy.

Task 2

User searches for "zip", finds quazip, checks the platform list, windows is not listed there. Goes back to results list. User is a bit confused by the search results being opened in a new browser tab. The search results also show overview pages, not only the details pages, that's confusing, browser search for zip. User would like to have some filter for constraining search results to windows.

User uses Google to search for Qt library doing zip on windows, finds quazip. It does windows, the meta data on Inqlude is actually not correct.

Task 3

User searches for "chart", would like to filter for attributes, but finds kdchart, clicks on the details, sees that it's commercial, is happy with the result.

Task 4

User uses the search box for searching for "qtrest", clicks on the home page, looks at releases on GitHub, sees "beta" in the README, concludes that there is no stable release. Browser searches for "stable" in the details page on Inqlude, no results.

Interview

Tasks

  • Looking up libraries according to subject areas

General comments

  • The logo should link to the home page
  • Tags would help
  • An own search instead of the Google search might give better results
  • Edit link is cool
  • Web site is straightforward, serves its purpose

User 3

Task 1

User sees cutereport on the front page, clicks it, is happy

Task 2

User searches for "zip", only gets an empty page (seems to be a bug). Then users tries alternative terms, "archive" doesn't give any usable results, because it's in the title of the page ("qt library archive"), so all pages are listed as result. User looks for criteria to search for, such as windows. After quite a bit of experimenting the user goes to scrolling through the front page and using browser search, finds quazip. The details page doesn't list Linux and the last update there is quite old, so user doesn't consider it further.

Task 3

User knows kdchart, searches for it in the search field, empty results (bug again). Then the user uses browser search on the stable page, no results, then goes to the commercial page and finds it there.

Task 4

Searching for qtrest with the search field, finds it. The details don't show stability or version. User then goes through the stable, development, and unreleased pages, and searches there with browser search to find that there is no stable version.

Interview

Tasks

  • Search tool, although the user doesn't have confidence that the data is up to date, would probably check with Google.

General comments

  • Not clear how the data is updated, how reliable it is
  • Most important information is there
  • Site looks ok on a phone, but is a bit small
  • Maybe it would help to have cmake flags listed for users to help how to use the library

Conclusion

  • Search is not reliable
  • Search results are not specific enough, having overview pages in there doesn't help
  • Some way to filter for specific attributes or tags would help with finding libraries
  • For using the browser search the different sections are inconvenient
  • Searching is the more heavily used approach to find libraries than browsing
  • Stability should be added as an attribute to the details page
  • Meta data needs to be updated in some cases