Evaluating Software Usability – Think it out loud

“Think it out loud” methodology – user verbalises their through processes. Useful, for example, when user is navigating a complex UI and they have some familiarity with it and are perhaps performing one than more operation at the same time. This HCI (Human-Computer Interface) evaluation process evolved from design based Continue Reading

Potential problems gathering information by observation

Practice To be used effectively, observation requires great deal of practice. Observer presence Presence of observer will affect behaviours, therefore disturbances must be minimised. Objectivity Difficult to remain objective – therefore ethical – when asking detailed questions to enhance understanding. Element of chance Chance event occurring may be taken as Continue Reading

Collecting Data and Information – Observation Techniques

Interviews and questionnaires valuable ways to gather information. Both reliant on accuracy & honesty of answers relating to persons behaviour and beliefs which is a weakness with both approaches. Observation is alternative technique. Observe behaviours first-hand and analyse by quantitative or qualitative means. Observation used by everyone. Examples: Consumer comparing Continue Reading

Pilot testing

Having designed questionnaire/survey it is necessary to carry out pilot test/study. This enables any defects/problems/ambiguities in structure and questions, including leading questions, to be identified before it is circulated to full sample of respondents. Pilot study undertaken in two phases: Asking colleagues for their opinion Using sample population from intended Continue Reading

Internet or Intranet surveys

The Internet and internal networks provide a means to gather responses from a far wider audience than traditional methods in a shorter timeframe. Technology however has ethical considerations such as potentially excluding respondents who do not have access to the Internet, limiting respondents to only those with access to the Continue Reading

Methods

Research method needs both practical & ethical consideration. Will method lead to appropriate/valid results or will it bias them? The questions posed can lead respondents to provide certain answers, e.g. “What is your religion?” – to avoid leading should be asked – “Do you have a religion?” followed by “If Continue Reading

Topic

Some topics more dubious than others e.g. hacking or causing deceit. Some areas such as banking present hurdle which will not likely be overcome when trying to gather data or even permission to gather data. Topics that will not get approval include those related to pornography, terrorism or criminal activity.