Process for User-centered Development

From Computing and Software Wiki

Revision as of 19:12, 23 November 2009

Write introduction here.

Early Focus on Users

The Need for User Input

The objectives of the end users should be of paramount importance to software developers, as the the mere existance of a developers software is the accomplish the end users said objectives. As such, user objectives should be ascertained and analyzed in the earliest part of the software development cycle. With this approach, developers can maximize the conciseness of their software while simultaneously providing more users with more function. Early user input will help bring focus to the project, however users must be kept abreast of further modifications and additions throughout the rest of the software development cycle. This way users can be assured that features do not digress from their original intentions and developers can remain focused on the desired feature set as the project inevitably evolves.

Methods of Focus

End User Input

Users as a collective are a complex entity, however focus should remain on their explicit needs in order to deliver effective software. Specifically, the people who will physically use the product should be the ones that are consulted, not a "proxy" user meant to represent the user base as a whole. A "proxy" user could be defined as a licensee who distributes software across a system but does not use it, and/or a person who manages users of the software. Their feedback rarely contains information relevant to end user experience since they do not use the software themselves, even though they might be paying for it or distributing it.

User Behaviour Modelling

While the features provided by a piece of software are important, how users interact with these features should be modelled. When designing a project, the circumstances of the user should be analyzed and modelled in order to provide an interface appropriate to the level of comprehension of the end users. Things such as users' work environment, their behaviour characteristics, and the nature of the users' work itself should be analyzed and considered when making design decisions; such decisions should be run by users to assure effective progress.

Systematic Information Gathering and Analysis

Consistancy is a desired attribute in a software system, and such an approach should be taken during the development stage in order to assure it. When aquiring user input, developers need to take extra care to ensure that the method of extraction is as consistant as possible. This way, comparisons between user input can be directly made, either quantatively or qualitively. This will avoid ambiguity in the analysis and implementation of user feedback.

Usability Experts

Experts in the field of usability are important people in the user-centred development cycle. They significantly ease the formalization of developer-client communication, and can provide usability training on several tiers of the development heirarchy. Usability experts can work with designers, providing feedback as development happens; they can also interact with end users in ways that disambiguate their needs, resulting in feedback that is more helpful for developers and designers. This allows team members to remain focused on their particular areas of expertise, preventing inaccurate or redundant usability information or modifications from accruing.

Empirical Testing

Empirical testing of the user-centered development consists mainly of usability testing with tests that can be quantified, which focus primarily on user feedback from interaction with the product. These tests are mainly based on user interaction with the interface as opposed to non-user based tests. Some non-user based tests are expert review, compliance reviews, heuristic evaluations, and cognitive walkthroughs. These tests are based on the review of an ‘expert’ or check to see if usability of the product satisfy a checklist or group of well-known principles, such as Shneiderman’s 8 golden rules or Norman’s 4 principles of usability among others. The main concern of non-user based tests is that users are not actually giving feedback about the interface, instead it is the ‘experts’ who are giving feedback who claim to know what users will accept, which of course is not always the case. Whereas, user-based testing could include user surveys, performance-based, think-aloud protocol, or co-discovery learning, with each test having its pros and cons.

User-based Tests

User Survey. A user survey will have the user use a prototype and then fill out a survey based on their experience. In this case, the answers the user provides will be restricted to what they are allowed to choose as answers, which allow for quick gathering of data. It can be said that user surveys are easy to conduct remotely, but relies heavily self-reported data.

Performance-based. Performance-based tests will have the user complete a specific task using a prototype of the interface. The data gathered will be based on the user experience of performing the given task with the prototype. This type of test is good for comparative evaluations, but is not a complete picture of usability and could be misleading.

Think-aloud protocol. Think-aloud protocol consists of having the user say what is on their mind while they are using the interface and trying to accomplish a task. The idea is to discover the thought processes involved in using the interface. This method can capture the user’s understanding, but cannot be used to evaluate performance, because of its disruptive nature.

Co-discovery Learning. Co-discovery learning is a modified version of think-aloud, in the sense that the user will still think-aloud, but will be working with another person to accomplish a task, with the aim being to allow the user to more naturally verbalize their thoughts. It is more revealing, but potentially more difficult to conduct.

Purpose of Testing

Testing is believed to serve two main purposes. According to Galitz(Galitz 1997, p. 592):

• First, it establishes a communication bridge between developers and users. Through testing, the developer learns about the user’s goals, perceptions, questions and problems. Through testing, the user is exposed to the capabilities of the system early on, before design is solidified.
• Second, testing is used to evaluate a product. It can identify potential problems in design at a point in the development process where they can be more easily addressed. Testing also enables comparison of alternative versions of a design element, when a clear direction is not immediately evident. How well the interface and screens meets user needs and expectations can also be assessed.

The second purpose of testing mentions enabling a comparison of alternative versions of design. This is mainly what the empirical method is based on in user-centered design, the ability to gather and compare quantifiable data.

Key Reasons to Test

• Developers and users possess different models
• Developer’s Intuitions are not always correct
• There is no average user
• It’s impossible to predict usability from appearance
• Design Standards and guidelines are not sufficient
• Informal feedback is inadequate
• Products build in pieces almost always have system-level inconsistencies
• Problems found late are more difficult and expensive to fix
• Problems fixed during development mean reduced support costs later
• Advantages over a competitive product can be achieved

This is not an exhaustive list of reasons to test, but are key ones that Galitz mentions and are certainly relevant in interface design and usability (Galitz 1997, p.592-593).

Analyze and Retest

Once the first test has been done, it is now important to analyze the data and establish benchmarks for further testing. Problems will be discovered and once they have been resolved to the satisfaction of the designers, the prototype must be changed to reflect this resolution. Once the prototype is ready, another test can be done to gather more data and once again adjust benchmarks and the prototype until designers are satisfied. This is a main component of iterative design.

Limitations

Although it seems empirical testing can solve many design problems, it should be noted that testing has its limitations. Rubin and Chisnell, point out that testing is always an artificial situation in the sense that the very act of conducting a study can itself affect the results. Test results do not prove that a product works, in that it is not a guarantee, but only a probability that results were not due to chance. Participants are rarely fully representative of the target population. Testing is not always the best technique to use, since at different stages it may be unnecessary to bring in many participants to reveal the obvious. Testing is just that, a test, which only accounts for hours of use. Even with these limitations Rubin and Chisnell (Handbook of Usability Testing 2008, pg. 26) also note that used correctly, testing will almost always bring to light potential problems, when done carefully and correctly.

Iterative Design

Introduction

When designing a user interface, it is almost impossible to obtain an interface without any usability issues in a single attempt. To solve this problem, the development team can use a method called iterative design. This method is applied in the development of a new product (typically a software with a user interface). It consists of developing it by a succession of iterations. Iterations are used to improve the current interface by collecting users feedback from a prototype of the interface, correct usability issues raised by them by creating a new prototype, then start a new iteration. Thus, this is a summary of what an iteration should be:

• Prepare a prototype design of the product
• Present this design to a set of potential users
• Collect problems noticed by users
• Refine design based on users point of view

Iterative design is about refinement: Each iteration brings improvements to the whole project by solving usability issues. This method puts quality in the centre of the development process. Indeed, by refining step by step the design, you obtain a product totally in appropriateness to its future users needs.

It explains why it fits totally with User Interface development and design. The development of a good user interface is mostly the result of a good understanding of its users needs and behaviour. As it's hard for a user interface designer to get a perfect understanding of them, the iterative design method allows him to base his work on users feedback. Thus, usability issues will be corrected easily. These feedbacks can also be used for the development of future projects.

Websites are a good example of iterative method usage: Web masters generally propose a new website design and collect user's feedback by email or with a dedicated topic on the website forum to improve it. For software development, it is different as it is impossible to propose an unfinished or unadapted product to the customer. The iterative design method is used to perfect the design before the software release along the development period, especially during testing phases.

Benefits

Advantages related to iterative design are numerous.

• Inconsistencies around application design are detected earlier than with a traditional development method.
• Most of the usability issues will be solved: we don't have to patch the application, we release directly a perfectly adapted product.
• Better understanding of users needs
• Testing phase is easier to plan as the testing team will proceed by iterations: iterative design fits perfectly with AGILE development methods.
• Better knowledge about the current project status: good visibility of the project advancements
• Keep an history of mistakes done in the past to do better on future projects

Disadvantages

One of the problem of iterative design is its cost if you exaggerate the number of iterations. Indeed, each iteration takes a lot of time and time is critical as expensive in software development. It will avoid patching the software in the future but can become really expensive if too many iterations are performed. Jakob Nielsen has realized experiences about the number of iterations that should be performed by a user interface designer. According to his opinion, developers should realize three iterations to obtain an interface adapted to users needs without spending a lot of time and money.

References

• Object Modelling for User Centered Development and User Interface Design: The Wisdom Approach

• User Centered Design and Development

• Notes on User Centered Design Process (UCD)

• User Centered Design

• Iterative Design (Wikipedia)

• Iterative Design by Jakob Nielsen

• Galitz, W (1997). The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques, Wiley Publishing.

• Chisnell and Rubin (2008). Handbook of Usability Testing, Second Edition: How to Plan, Design, and Conduct Effective Tests, Wiley Publishing.