Module: ENSURE SITE USABILITY - 3755R
Learning Objectives:
1. Design a user test. 3. Evaluate a user test.
2. Conduct a user test. 4. Document results.
Task: 1 of 2
Weight: 60%
Due Date: Week 6
Introductory page for the Web Site Usability page on your project site must include the following content:
A short explanation of what web site Usability is. 20 marks
Usability refers to the ease with which a User Interface can be used by its intended audience to achieve defined goals. Usability incorporates many factors: design, functionality, structure, information architecture, and more.
According to Redfern Services, Glossary of Terms,
"Usability is a multidimensional attribute that relates to the impact a product has on its end-users. In general it refers to the efficiency with which a customer can do their tasks with the product, and their overall satisfaction with that process. Usability should be considered from a systems perspective including the hardware and software interfaces, the documentation, packaging, and any other component of the system and processes surrounding it that affects the user."
According to the International Standards Organization (ISO),
"Usability is the extent to which a product can be used by specified users to achieve specified goals with effectiveness, efficiency and satisfaction in a specified context of use." ISO 9241-11: Guidance on Usability (1998)
Users should not have to think too hard when using a website. Usabililty Evaluation Criteria consists of the following:
- Ease of Learning - How quickly and easily can a user - who is unfamiliar with the user interface of the website - learn it sufficiently enough to achieve basic and moderate tasks.
- Efficiency of Use - If when a user has become experienced at how to use the interface, how quickly and easily can the user accomplish task?
- Memorability - Once the user has visited the site and used the interface before, can they recall enough about the interface to navigate effectivey on the next visit or do they have to relearn the steps they took to complete the task previously.
- Error Frequency & Severity - When do errors on the site occur; are they errors produced by user input or produced by a non-user fault in the interface; what is the severity of the errors occurringe and how does the system and/or users recover from these errors.
- Subjective Satisfaction - How much the user enjoys using the site.
How is it identified and/or used within the development of a web sites lifecycle? 20 marks
A usable website should follow the following guidelines:
An effective website...
- Allows customers/users to achieve their goals.
- Has a high conversion rate.
- Meets business objectives.
- Delivers a positive brand image.
An efficient website...
- Provides answers quickly.
- Follows a logical sequence.
- Doesn't waste resources.
- Requires less content management time.
A satisfied user...
- Achieves their purpose or goal in visiting the site.
- Enjoys their experience while visiting the site.
- Speak of the site to others.
- Return to the site again.
What are the benefits of conducting usability tests and to whom are the results beneficial and why. 20 marks
Web designers, coders, and developers often forget that they are not typical users, they have a far more extensive knowledge of the website than the average user will ever have. Experts in any field typically use terminology and jargon that are alien to customers. After working on a project for any time it is easy to forget that others are not as familiar with it and have difficulty following the terminology or logic. There may be aspects of the website that are confusing to customers, so it is therefore important to take a step back and check the usability of the site regularly. By doing so, and updating the site accordingly, the website interface becomes a more positive and less frustrating experience for users, encouraging them to return and become further accustomed to the site.
It should be professionally written and presented and visually this page should adhere to good design principles and correspond with the rest of your project site. The whole site must adhere to good information architectural standards. This page will have approximately 250 words.
Design and Deliver a Usability Test
Task: 2 of 2
Weight: 30%
Due Date: Week 7
Design and conduct a usability test for either a large site such as the phong.com, www.microsoft.com or a large bank. You will need to find someone in the class who does not have experience with the site you are testing to conduct the test on and also one outside participant. You must also make yourself available to be a test subject for someone else in the group.
As part of your preliminary design you must identify all of the websites businesses critical functions. You then need to conduct your usability test on 2 specific tasks which should be samples of business critical functions on 2 participants as identified above.
You must design, deliver and document your usability test according to excepted conventions and as per examples provided. After you have conducted and documented your test you must write an evaluation of your test results and include any recommendations, Identify usability problems and solutions, Identify problem severity and/or identify software bugs. You should also sort problems by priority and frequency.
Chosen Site: Microsoft.com
Critical Business Functions: Selling far from perfected software to a cleverly manipulated market; dribbling out patches, updates and service packs to fix said software; providing superb online support as a pacifiier to hush people and stop the questions; simultaneously existing as the virus and innoculation; to outdo Apple.com, which while is Apple, is still far more exciting and cheerful to visit and nearly as functional.
User One: AMDME aka Kane
Action/Specific |
Comments/Observations |
Recommendations |
12:04:22 Begin Task |
Microsoft Plus |
|
1. Types in Microsoft.com in the address bar and gets there instantly! |
“Watch this, it will take five seconds.”
|
None. |
2. Types in Microsoft Plus into MS Search. |
“This is too easy.” Subject appears to have no problem navigating the website. |
None. |
3. Clicks on first result in MS Search which is Microsoft Plus Home. |
"See?" |
None. |
4. Is landed at the Microsoft Plus webpage, task successfully completed five seconds later. |
"What next?" |
None. |
12:04:27 End Task |
|
|
12:09:01 Begin Task |
JS for Horizontal Navigation Bar |
|
1. Types in Microsoft.com in the address bar and gets there instantly! |
“What am I looking for again?” Subject laughing manically. Subject given set Task again. "Oh yeah." |
None. |
2. Clicks on “Developer Tools” and is taken to MSDN part of Microsoft Network. |
“Watch this it will take five seconds.” Subjects eyes are teary from laughter. |
Help/Tips/Advice paragraph teaching a brief understanding of keywords for users who need reminding XD |
3. Types in “Javascript for Horizontal Nav Bar” into MS Search. |
Subject's attention span starting to wander. |
More exciting colours. |
4. Got three irrelevant results. |
“Oh f@#k.” Subject settles down some. Subject is unsurprised and appears very bored by this result. Timeout before task was achieved. |
MSN should offer alternative keywords or related articles. Documents should have more relevant titles to come up in related searches. Subject needs better manners. |
12:19:54 End Task |
|
|
User Two: Layla
Action/Specific |
Comments/Observations |
Recommendations |
12:22:40 Begin Task |
MSN Messenger 7.5 |
|
1. Types in Microsoft.com in the address bar and gets there instantly! |
Subject didn't have any problem locating the website, logical conclusion or effective advertising, we'll never know. |
None. |
2. Types in “MSN Messenger 7.5 Download” into MS Search, returns 8,340 results in 0.03 seconds. |
Subject appears at ease on this website, however subject comments on how "blue" everything on Microsoft is, and that it could be considered depressing. Tester suggests that perhaps Subject is onto something. |
Less blue, less depression, less Microsoft Feel. More colour and excitement -before- you reach |
3. Clicks on first result in MS Search which is Messenger 7.5. |
Goal achieved. |
None. |
12:22:52 End Task |
|
|
12:28:48 Begin Task |
Windows Media Player 11 |
|
1. Types in Microsoft.com in the address bar and gets there instantly! |
Subject defines the site at first guess. |
None. |
2. Types in “WMP11” into MS Search. |
Subject at first glance locates the search field and targets. |
None. |
3. Clicks on first result in MS Search which is Windows Media Player 11, there were 6 results in 0.01 seconds. |
Microsoft site is efficient and relatively easy to navigate if user knows what they are looking for. |
None. |
12:28:51 End Task |
|
|
Usability Evalution
Microsoft.com have a strong website with extremely efficient usability. The site appears to be very easy to navigate for users with a good general experience in locating things on websites. The site has very clear and concise navigation that is consistant throughout, following logical sequences with a quick response. Its pages are to the point and at a glance most if not all pages deliver the expected result. This encourages easy learning of navigation because the user is quickly accustomed to receiving accurate and relevant responses.
In regard to the local site search engine, while the Microsoft website returns constructive and useful results, the MSDN website is stricter on keywords which seems to inhibit lazy users. Abbreviations and slang to be included as related search terms would prove useful to pulling up relevant documents where users have entered a similiar yet different keyword. Possibilities within the easy reach of Microsoft are offered corrections of keywords as done by Google, which would help a user who is either consciously or unconsciously using a typo, incorrect or abbreviated term/keyword. Some searches threw back results with pages that were irrelevantly named, poorly described or a dreadful combination of both. Some care of file names, page titles and descriptions should be taken to assist in retrieving useful search results.
Users tested seemed highly uninterested in the site itself, and were not motivated to further explore. While Microsoft might be an effective site when the user is hunting for something known, it appears to hinder users who aren't entirely sure what they are hunting for. Of course, if a user doesn't know what they're looking for, they will either find something else and think that was it, or not find it at all. The website doesn't appeal as a site for general browsing, it doesn't have the cheer that pulls interest. Whether this is due to the corporate, liberal blue hues that the site is drenched in or a lack of excitement in the content itself, either way it does not seem to hold user interest any longer than the completion of their purpose in being there.
Overall Microsoft.com is fantastically usable to users who know what they want, and, apart from MSDN from a programmers perspective, totally mind-numbingly boring.
