The User Interface Design for the Sign Language Interpreter in a Remote Sign Language Interpretation...

The User Interface Design for the Sign Language Interpreter in a Remote Sign Language Interpretation System

Hiroki Minagawa, Ichiro Naito, Nobuko Kato, Hiroshi Murakami, and Yasushi Ishihara

Tsukuba College of Technology, Japan

E-mail: minagawa@a.tsukuba-tech.ac.jp

①

Concept The Necessity of Remote Sign Language

Interpretation The number of interpreters is not enough. Special knowledge is required of

interpreters.(Ex. Lecture of University)

The Spread of Broadband Networks The Necessity of Considering a System

Design

②

Experiment System

No Time Delay

No Quality Loss

③

Experiment SystemAssumed System

Internet Audio Video

DeafPerson

HearingPerson

Interpreter

Deaf Person- Hearing Person

④

DeafPerson

HearingPerson

Usual Interpretation Remote Interpretation

Interpretation Room

Voice

Audio Video

SignLanguage

Interpreter

⑤

Usual Interpretation Remote Interpretation

Interpretation Room

Scene

DeafPerson

HearingPerson

Interpreter

RealizedSystem

Results○ Remote interpretation was successful.

○ The feeling of refusal to the system was lost as it was used.(Interpreter, Deaf Person, Hearing Person)

○ A scenery monitor was necessary for the interpreter.○ The interpreter found the hearing person’s

appearance well.× Interpretation could not be obtained while the

deaf person was not looking at the monitor.× Eye contact was difficult for the interpreter.

⑥

Hearing Lecturer- Deaf Students

⑦

Usual Interpretation Remote Interpretation

Interpretation Room

DeafStudents

HearingLecturer

Interpreter Voice

Sign Language

⑧

Lecture Room

DeafStudents

HearingLecturer

LectureNote

InterpreterInterpretation Room

Scene

RealizedSystem

Interpretation Supporters

Results○ Remote interpretation was successful.○ A scenery monitor of the lecture room was

necessary for the interpreter as a main monitor.○ The interpreter found the lecturer’s appearance well.× The character on a white board could not be read.× The interpreter sometimes mistook right and left.

○ Merit of Remote Sign Language Interpretation○ The interpretation supporters could read two or more

students' sign language.○ The lecture note could be placed near the

interpreter.

⑨

⑩

Usual Interpretation Remote Interpretation

Interpretation Room

DeafLecturer

HearingStudents

Interpreter

Voice

SignLanguage

Deaf Lecturer- Hearing Students

⑪

LectureNote

Deaf Lecturer

HearingStudents

Interpreter

Lecture Room

Interpretation Room

Scene

RealizedSystem

InterpretationSupporters

Results

○ Remote interpretation was successful.○ A scenery monitor of the students was

necessary for the interpreter.○ The interpreter was able to see students'

expression.

× Interpretation failed when the lecturer disappeared from the monitor.

× Interpretation could not be obtained while the lecturer had turned to the white board.

⑫

Other Applications

Multi-point Meeting With Sign Language Possibility of a Low Cost Remote Sign

Language Interpretation System

⑬

⑭

Personal Sign Language Interpreter Pocket Interpreter Secret Interpreter

Future Subjects The Method of the Information Support for the

Interpreter Hearing Person’s Expression Relation Between the Deaf Person and the Hearing Person Detailed Information on the Scene As a Lecture Note

How to Show the Interpreter’s Video to the Deaf Person

Actual System Design Sign Language Interpretation Server System Mobile Client System

Estimation of Total Cost

⑮