#15 Not sorted (UI test results)

[Evgeny Bogdanov]

Remarks from EC-TEL:
● “+” to add a space is not clear at first
● clipboard was not clear to both of them
○ solution: copy to clipboard in the context menu
● drag’n drop not clear at first to add people to a course
○ drag’n drop on the course straight away does not work
■ drag’n drop should probably work on all items where it makes sense and maybe have an indication whether you can drop something there or not (e.g. change the dragging icon)
○ while drag’n dropping it often occurs that the page that is dragged opens and that confuses people because they leave the course
■ I can not redo this with a mouse and keyboard maybe it is something related to using a mousepad
● the use of the clipboard often throws a message when something is already added.
○ I think this disturbs the work and is actually not doing very useful work, so I would remove the messagebox and just do nothing when it is added twice.
○ One person expected that if something is dragged from the clipboard it would disappear (remove) from the clipboard.
○ the grey drag’ n drop field is not large enough, maybe it takes to much precision to add to the clipboard. Maybe the clipboard could be collapsed on mouse over?
● The clipboard stays open sometimes when you drag something out of it. This confuses people, because they can not see the search functionality anymore.
● When trying to search, they look at the dropdown next to “People”, “Assets”, etc. and try using the filter function, maybe some search functionality could be added here...
● Search results appear in the same spot as the actual content of a space. This confuses them, because it looks like the content is part of the space...
● People-Assets-Spaces-Tools relations can be added to themselves recursively, which can be confusing.
● People do not use recommendations unless they somehow found where they are (which is not bad necessarily, I think, because recommendations are after all an advanced feature)
○ none of the users used the big recommendation zone at the bottom (we do not have enough test persons to make this hard, but it can be an indication)
● Editing the course settings also appears to be troublesome, because they both try to use the pencil icon to edit the settings
● One of them did not find the external view on the paper mockups.

Tasks (overall 21 minutes)

3) Create a course “Astrophysics course” as a space. (find a way to create space - 2min12seconds)
Was hard to understand that “plus” means “create”
Solution: (Graaasp Introduction or “create” button next to space)

4) Add users to your course (discover drag and drop – 1 minute, I mentioned clipboard after user spend 1min30sec without success and got lost, then 40 seconds to realize it )

After user understood how to create item, it was hard to understand how to add an existing item. (It took some time to understand that drag-and-drop can be used, then user didn’t know how to copy item: I had to tell that he can use clipboard for it)
Solution: (Graaasp Introduction of drag-and-drop/clipboard or/and “copy to clipboard” and “copy to spaces” in the context menu)

a) Find and add “Denis Gillet” (he is already linked to your profile)
b) Find and add “Evgeny Bogdanov” (he exists in the system)
c) Find and add “Na Li” (she exists in the system and your know that she is linked to “Evgeny Bogdanov”)

5) Add assets to your course (I mentioned “How to find stuff” after user spend 50sec without success trying to find assets “Big Bang” and got lost)
(I had to mention search area since user was confused where to find assets)
Solution: no yet
a) Find and add “Big Bang” (it exists in the system)
b) Find and add “Theoretical Astrophysics” (it exists in the system)
b) Create “Solar system” (does not exist yet)

6) Add tools to your course
a) Find and add “RSS astrophysics” (it exists in the system)
b) Create “Astrophysics Papers Search”
This tool should have format “google gadget” and url should be as follows: http://hosting.gmodules.com/ig/gadgets/file/105978444972560765198/ads.xml

7) Open the settings window for your course (it will be just a blank page) (fast)

8) Filter the recommendations by word “Astrophysics” (Didn't notice recommendations at the bottom, tried to do the task on the top.)
Solution: (remove recommendations from the top or bottom)

For the next two tasks you are given four pictures and you should explain your actions on those pictures

9) Switch from context view to widget view (Did not understand well the difference)

10) Open your course outside the Graaasp and give URL for the course to your students (Was hard to find that Standalone view is in the “Switch view” area, user also didn’t understand well the concept of standalone view at first)

General comments:

First part (1-7) took 13 minutes
Second part (9-19) took 8 minutes

After user understood the concepts of creating an item, searching for it and moving items through clipboard, the tasks were done very quickly.

User was trying to click on triangles in Favorites, Clipboard.
Solution: (remove triangles)

Tried to find in context menu a way to move things.

When moving items from clipboard to the spaces list, he tried to just drop items
on the spaces list (grey selection area is very small and he didn't notice it, also no "drop me here" exists for this block)
Solution: (make the grey highlight for spaces bigger, add “Drop me here” for spaces area)

User also tried to drag a person from user profile to a space icon (at the user profile page)

User also felt as he needed to clean a clipboard after every step of adding item.
Solution: Remove item automatically from clipboard, when drop happens

User found users Evgeny and Li Na in Denis’s profile and added them both into clipboard, so he didn’t use search to find them.

User didn’t seem to have a problem with navigation. He was always using “back“ button of a browser to go to the previous item.

For recommendations: user said that he was looking at the upper part of a screen. He suggested to have a pointer at the top recommendations saying: “Look down”