Users’ Quality Ratings of Handheld devices:Users’ Quality Ratings of Handheld devices:
Supervisor: Dr. Gary Burnett
Student: Hsin-Wei Chen
Investigating the Most Important Sense among Investigating the Most Important Sense among Vision, Hearing and TouchVision, Hearing and Touch
Disser
tation
2006
Disser
tation
2006
11/09/2006 Dissertation 2006 Hisin-Wei Chen 2
AgendaAgenda
IntroductionResearch BackgroundResearch MotivesResearch PurposesResearch Process
Literature ReviewUser InterfaceHuman-computer InteractionHCI-HumanHCI-Technology
MethodologyField ExperimentParticipantsStudy Equipment
Analysis and DiscussionObjective ResultsSubjective Results
ConclusionConclusionLimitations and Future Study
11/09/2006 Dissertation 2006 Hisin-Wei Chen 3
Research Background Research Background 11
The high-speed growth of technology The great increase in consumers’ needs
Mobility Portability
IntroductionBackground Motives Purposes Process
Handheld devices
Desktops
Mobile phonesPortabil
ity
LaptopsPalmtop
s
Handheld
devices
Source: Weiss (2002), pp. 3
11/09/2006 Dissertation 2006 Hisin-Wei Chen 4
Research Background Research Background 22
The important information designers need
Designers shall try to understand users of products (Norman, 1988).
Humans perceives quality through three primary senses: visual, hearing and touch senses (Wickens et al., 1998).
IntroductionBackground Motives Purposes Process
11/09/2006 Dissertation 2006 Hisin-Wei Chen 5
Research MotivesResearch Motives
In practice Human perception of quality A better design of product
In research Human senses: single and multi-sensory
modalities In car switches (Burnett and Irune, 2005) -->
Computing devices
IntroductionBackground Motives Purposes
Process
Visual issuesHearing issuesTouch issues
11/09/2006 Dissertation 2006 Hisin-Wei Chen 6
Research PurposesResearch Purposes
Observe the current design of handheld devices (Mobile phones).
Investigate the relative contribution of three primary senses to the perception of quality.
Make suggestions to the manufacturers.
IntroductionBackground Motives Purposes Process
11/09/2006 Dissertation 2006 Hisin-Wei Chen 7
Research Process Research Process 11
IntroductionBackground Motives Purposes Process
Literature Review
Observation
Literature Review
ObservationProblems DefinitionProblems Definition
Pilot Experiment Design
Pilot Experiment Design
Pilot Experiment Implementation
Pilot Experiment Implementation
Pilot Experiment Evaluation
Pilot Experiment Evaluation
2. Pilot Experiment Conduction
1. Problem Definition
Not Accepted
Accepted
11/09/2006 Dissertation 2006 Hisin-Wei Chen 8
Research Process Research Process 22
IntroductionBackground Motives Purposes Process
User trialsUser trials QuestionnaireQuestionnaire
Statistical analysesStatistical analyses
ConclusionSuggestions
ConclusionSuggestions
Accepted
Experiment DesignExperiment Design
3. Experiment conduction
4. Analysis and Discussion
5. Conclusion
11/09/2006 Dissertation 2006 Hisin-Wei Chen 9
LLiterature review frameworkiterature review framework
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
Interface
Interaction-Perception
Interface
Interaction-Perception
Handheld devices
Handheld devicesUsersUsers
Input
Output
Humans Technology
PrimarySenses
QualityRating
11/09/2006 Dissertation 2006 Hisin-Wei Chen 10
LLiterature review frameworkiterature review framework
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
Handheld devices
Handheld devicesUsersUsers
Input
Output
Humans Technology
PrimarySenses
QualityRating
11/09/2006 Dissertation 2006 Hisin-Wei Chen 11
LLiterature review frameworkiterature review framework
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
Handheld devices
Handheld devicesUsersUsers
Input
Output
Humans Technology
PrimarySenses
QualityRating
11/09/2006 Dissertation 2006 Hisin-Wei Chen 12
User Interface User Interface 11
Definition of user interface
NOT just today’s graphical user interfaces (GUIs)
User interface is the way that users achieve their goals with a product in relation to what you do and how a device responds. (Raskin, 2003; Hackos and Redish , 1998)
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
11/09/2006 Dissertation 2006 Hisin-Wei Chen 13
User Interface User Interface 22
Types of user interface (Lindholm et al., 2003)
Hardware User Interface (Hardware UI)The hardware UI contains the layout of control devices and display screens, snap-on cover mechanism and accessory connectors.
Software User Interface (Software UI)The software user interface contains the layout of the menu structures, interaction logic, control key combinations and other system design.
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
11/09/2006 Dissertation 2006 Hisin-Wei Chen 14
Human-Computer Interaction Human-Computer Interaction (HCI) (HCI) 11
Definition of HCI
The interaction between humans and computers includes not only the interface between them, but also all interactive objects (Hartson , 1998).
HCI is the study of interactions between users and handheld devices, such as mobile phones in this study.
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
11/09/2006 Dissertation 2006 Hisin-Wei Chen 15
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
Human-Computer Interaction Human-Computer Interaction (HCI) (HCI) 22
Goals of HCI
High Usability
Definition of usabilityThe extent to which a product can be used by specified users with effectiveness, efficiency, and satisfaction in a specified context of use. (ISO 9241)
--> The scope of human-focued quality
High effectivenessHigh efficiencyHigh satisfaction
11/09/2006 Dissertation 2006 Hisin-Wei Chen 16
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
SENSORYREGISTER
SENSORYREGISTER
Perception
Perception
Attention Resource
Attention Resource
ThoughtDecision Making
ThoughtDecision Making
LONG-TERM MEMORYLONG-TERM MEMORY
WORKINGMEMORY
WORKINGMEMORY
ResponseSelectio
n
ResponseSelectio
n
ResponseExecutio
n
ResponseExecutio
n
Feedback
Stimul
i
Source: Raskin (2003), pp. 147; Eberts (1994), pp. 166
HCI-Human HCI-Human 11 Generic model of human information processing
11/09/2006 Dissertation 2006 Hisin-Wei Chen 17
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
HCI-Human HCI-Human 22
Three primary senses Vision
Vision is the dominant sense that users use when interacting with computers (Sutcliffe, 1995; Johnson et al., 2006).
HearingVision and touch, can easily dominate the sense of hearing, or even diminish it (Dix, 1998; Riederer, 2001; Guttman et al., 2005).
TouchTouch is the most important senses to the perception in in-car switches (Burnett and Irune, 2005).
11/09/2006 Dissertation 2006 Hisin-Wei Chen 18
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
Source: Steenkamp (1990), pp.323
Cues in the environment
Cues in the environment
Intrinsic quality cue beliefs
Intrinsic quality cue beliefs
Extrinsic quality cue beliefs
Extrinsic quality cue beliefs
Experience quality attribute beliefs
Experience quality attribute beliefs
Credence quality attribute beliefs
Credence quality attribute beliefs
Perceivedquality
Perceivedquality
Personal and situational factors
Personal and situational factors
HCI-Human HCI-Human 33 Quality Perception Process Conceptual Model
11/09/2006 Dissertation 2006 Hisin-Wei Chen 19
HCI-TechnologyHCI-Technology
Handheld devices (Weiss, 2002) Handheld devices are computing and
communication devices. Handheld devices are usable and useful held
in one person’s hand.
Types of handheld devices Mobile phones Pages Personal Digital Assistants (PDAs)
Literature ReviewUser Interface HCI HCI-Human HCI-Tech
11/09/2006 Dissertation 2006 Hisin-Wei Chen 20
ExperimentsExperiments
Pilot experiment To avoid unexpected variables affecting the
results of the actual experiment. Acquire all of the suggestions and information
from the pilot experiment participants.
Field experiment Unlike the laboratory experiment, a field
experiment would not control all o the other variables precisely.
A field experiment could be an effective form of research method for mobile HCI research (Love, 2005).
Field experiment Participants Study equipment
Methodology
11/09/2006 Dissertation 2006 Hisin-Wei Chen 21
Participants Participants 11
Field experiment Participants Study equipment
Methodology
Nationalities of participants
5
9
7
4
3
11
1 1
BritishTaiwaneseChineseGreekTurkishGermanCypriotChileanBrazilian
Non-Asian
Asian
11/09/2006 Dissertation 2006 Hisin-Wei Chen 22
Field experiment Participants Study equipment
Methodology
Non-Asian
Asian
Participants Participants 22
No. The order of conditions (mobiles in random orders)
1~8 Only hearing Only touch Only visionAll
9~16 Only touch Only hearing Only visionAll
17~24Hearing & Touch
Touch & VisionHearing & Vision
All
25~32Hearing & Touch
Hearing & Vision
Touch & VisionAll
Note: Males and females/ Non-Asian and Asian are distributed in the same ratio.
11/09/2006 Dissertation 2006 Hisin-Wei Chen 23
Study Equipment Study Equipment 11
Only vision, only hearing, only touch and all senses
Field experiment Participants Study equipment
Methodology
11/09/2006 Dissertation 2006 Hisin-Wei Chen 24
Study Equipment Study Equipment 22
No vision, no hearing, no touch and all senses
Field experiment Participants Study equipment
Methodology
11/09/2006 Dissertation 2006 Hisin-Wei Chen 25
Objective Results Objective Results 11
Quality mean ratings / preference analysis Mobile phone D is most appealing to participants Vision and touch make most contributions and
hearing makes less contribution to the perception of quality.
Correlation analysis Vision is the most important sense Hearing is the less important sense
Objective results Subjective results
Analysis and Discussion
11/09/2006 Dissertation 2006 Hisin-Wei Chen 26
Objective Results Objective Results 22
Regression analysis Mobile phone A
Only Vision make the most contribution to the perception of quality.
Mobile phone D Vision and touch make most contribution to the
perception of quality
Interesting topic: Why touch also plays important role on
perception of quality for mobile phone D?
Objective results Subjective results
Analysis and Discussion
11/09/2006 Dissertation 2006 Hisin-Wei Chen 27
Objective Results Objective Results 33
Objective results Subjective results
Analysis and Discussion
The keypads
11/09/2006 Dissertation 2006 Hisin-Wei Chen 28
Subjective ResultsSubjective Results
Why are the important senses for handheld devices (e.g. vision and touch) and for in-car switches (e.g. touch) are different?
Emotional issues Capability issues Social issues (Vincent,
2005)
Emotional values and capabilities Vision --> Emotional values Touch --> Capabilities
Objective results Subjective results
Analysis and Discussion
11/09/2006 Dissertation 2006 Hisin-Wei Chen 29
ConclusionConclusion
Vision is the most important sense for perceiving the quality of handheld devices.
Touch is the second most important sense in the perception of quality.
Hearing contributes less to the perception of quality.
ConclusionConclusion Limitations and future study
11/09/2006 Dissertation 2006 Hisin-Wei Chen 30
Limitations and Future StudyLimitations and Future Study
Observations The important characteristics of vision and
touch
Experimental design Laboratory experiment implemented Software user interface included Extrinsic quality cues/ Credence quality
attributes included
Entities selection Other devices selected (e.g. Pages, PDAs)
ConclusionConclusion Limitations and future study
Thank you for your listening!Thank you for your listening!