School of something FACULTY OF OTHER Facing Complexity Using AAC in Human User Interface Design...

School of somethingFACULTY OF OTHER

Facing ComplexityUsing AAC in Human User Interface Design

Lisa-Dionne MorrisSchool of Mechanical Engineeringl.d.morris@leeds.ac.uk

Communication Matters Conference 201126 September 2011

Project aims

The aim of this individual part of the project was to design and develop an improved human user interface. The objective was that the interface worked with the operational procedures associated with a NEWLY DESIGNED electronic appliance used for dispensing medication.

Technology

Users

Compliance

Palliative Care

Socio-Technical System

Cognitive and Intellectual decline

Project theme

The theme is Facing Complexity with a focus on how to face the complexity of human interaction with new and emerging objects and technological systems. Following the theme of Donald A. Norman's latest book, where the paradigm of simplicity is questioned in relations to the design of human user interfaces. In user interface design, the risk is to make interaction unmanageable, in which complexity can appear suddenly, catching people by surprise.

Existing units

2 versions of COMPLEXITY

Humans want DEVICES to enable CHOICE. We need levels of complexity we do not want confusion. We need understandable devices and User Interface and Produce Designers need to understand how DIFFERENT HUMANS think.

X

Confusion, Frustration, Disorder

Cognitive

Complexity

Perceptual

Complexity

The final unit

Interface Design

Research scope

(AAC)-Makaton Vocabulary Language Programme

-Signs-Symbols

-Spoken Word

User Interface Design

-Mediated communication

-interaction design

Humans-Thinking

Process Skills-Cognitive capabilities

Argument

Implementation and utilisation of Makaton Vocabulary Language Programme, a system of alternative and augmentative communication (AAC), might provide principles and procedures for technology enhanced learning for users with reduce cognitive and intellectual capabilities, this might offer a design intervention technique that was appropriate for people with reduced cognitive capabilities thus, providing a more sustainable interface.

Literature review on complexity

User Interface

Human-Machine Loop

In a very simple way, the human-machine loop has been associated with concepts such as speed, accuracy and integrity in the flow of information round the human-machine loop Pheasant (1986). The typical modality pattern is of sight as the primary input/receptive mode, and movement and sight as the primary output/expressive mode. The focus of this particular view is human computer interaction through a graphic user interface.

Human Machine

Displays

Controls

Accessibility channel

Receptive Mode (Input)

The display gives visual support and prompting and provides objects of reference plus auditory clues for interaction

Machine Human

Displays

Controls

Expressive Mode (Output)

Access controls are predominately symbol and text solutions plus audio re-enforcement

Reduced cognitive and intellectual skills

Visuo-motor

•With this in mind, input (receptive) language and output (expressive) language is a less dominate trait in cognitive and intellectual impairment Romski et al (1997) and information-processing in the brain is best stimiuateld by sight and movement Barrie (1997)

Perception

•Maximum possible distinction between visual language items and recognition of language structure based on an operator’s linguistic codes Walker et al. (1985)

Semantic-symbolic

•Thus, the semantic-symbolic complexity is reduced if the chosen semantic-symbolic parameters include certain key semantic relationships, commonly expressed in early learnt language of an operational procedure Lahey et al. (1997).

Three basic complexity parameters associated with reduced cognitive and intellectual skills

Definition of access control capabilities

Access Control Capabilities and Communication Channels used by Operators with Cognitive and Intellectual Difficulties

Operators demonstrate intentions by feeling and looking at user interfaces and by seeking verbal re-enforcement of the task. Successful interaction may use touch, sight and audio communication channels. To support access of an operational user interface designers must consider the use of appropriate size, colour and style of receptive and expressive language. Also, consider the use of touch, sight and verbal operational and sequence re-enforcement to make choices.

The total design process

Interface design

Interface design for patient and personal helper

Findings

The implementation of verbal audio features supported the content of the screen, which enhances user’s cognitive processing.

The implementation of animated or dynamic elements enhanced the ‘static’ interface.

User preferences and language defined at the beginning of the design process, reduced the overall navigational elements of the interface

Reducing complexity

Visual support such as, prompting objects of reference and auditory clues needed for receptive modes.

Receptive language should combine visual clue such as colour or flashing lights to indicate the next operational procedure. A linear operational sequence indicates next operational procedures. Symbol and text solutions plus audio re-enforcement of operational sequence needed to support

expressive modes. Additional, alternative or adaptive access channels may be required .

Further work

School of somethingFACULTY OF OTHER

Facing ComplexityLisa-Dionne MorrisSchool of Mechanical Engineeringl.d.morris@leeds.ac.uk

Thank you!

Any questions?