CPSC 681 Research Methodologies in HCI Saul Greenberg, Instructor

Contents

Heuristic Evaluation

Written by:

Kevin Baker for partial requirements for Computer Science 681 : Research Methodologies. March, 1997

What is a heuristic evaluation?

A heuristic evaluation is a usability engineering method that helps to identify usability problems in a user interface (UI) design.  It specifically involves a small set of evaluators examining the interface and judging its compliance with recognized usability principles (the "heuristics")[11,12,13].  The main goal of heuristic evaluations is to identify any problems associated with the design of user interfaces.  Jakob Nielsen developed this method on the basis of several years of experience with teaching and consulting about usability engineering [10].

Heuristic evaluation falls into the category of usability inspection methods.  These methods use judgement as a source of feedback when evaluating specific elements of a user interface [7].  Other inspection techniques include cognitive walkthroughs, guideline reviews and pluralistic walkthroughs.  Heuristic evaluation is less formal as compared to these other methods and is intended as a "discount usability engineering" method [11,13].  With the creation of a discount usability method, Nielsen has provided a means of performing "some" usability engineering even if it may not always be the absolutely "best" method or necessarily give perfect results [12].  This is essential since constraints on usability engineering lifecycles usually force the use of evaluation methods that are quick, cheap, and easy to use.  For these reasons, heuristic evaluations have become a very popular tool when evaluating UI design.

Contents of this Web site:

1. What are heuristics?

This section defines heuristics and the advantages of using them, over guidelines, for heuristic evaluations. Also there is a detailed description of the ten original heuristics developed by Jakob Nielsen and Rolf Molich.

2. Trade-offs regarding heuristic evaluations

There are several logistical issues involving trade-offs that must be worked out before a heuristic evaluation can be performed:

• Number of Evaluators
• Expertise of Evaluators
• Scenarios vs. Self-guided Exploration
• Individuals vs. Teams

3. How to perform a heuristic evaluation

The heuristic evaluation process involves three phases:  the orientation, the evaluation process, and the debriefing session.

4. Results from a heuristic evaluation

Potential results from heuristic evaluations and trends that occur.

5. Rating the severity of usability problems

The first step of any heuristic evaluation is to identify usability problems in a user interface.  Severity ratings help prioritize problems since not all of them can be fixed. .

6. When to perform a heuristic evaluation

At what stage of the usability engineering cycle should an evaluator perform a heuristic evaluation?  This section provides advice for this question.

7. Advantages and Disadvantages of heuristic evaluations

The advantages and disadvantages of performing a heuristic evaluation.

8. Heuristic evaluations and other evaluation techniques

How do heuristic evaluations compare with other usability inspection and testing methods?  See how heuristic evaluations rank in comparison to the other methods.

9.An example of a heuristic evaluation

Reading about heuristic evaluations is only the first step; practicing this technique will further enhance your skills with it.  Try the following example.  

10.References and Links to Other Sites

A list of references used to develop this website along with some links to other sites with useful information on heuristic evaluations.  Including Jakob Nielsen's own site!