Embed Size (px)
Citation preview
The User Interface Design for the Sign Language Interpreter in a Remote Sign Language Interpretation System
Hiroki Minagawa, Ichiro Naito, Nobuko Kato, Hiroshi Murakami, and Yasushi Ishihara
Tsukuba College of Technology, Japan
E-mail: [email protected]
①
Concept The Necessity of Remote Sign Language
Interpretation The number of interpreters is not enough. Special knowledge is required of
interpreters.(Ex. Lecture of University)
The Spread of Broadband Networks The Necessity of Considering a System
Design
②
Experiment System
No Time Delay
No Quality Loss
③
Experiment SystemAssumed System
Internet Audio Video
DeafPerson
HearingPerson
Interpreter
Deaf Person- Hearing Person
④
DeafPerson
HearingPerson
Usual Interpretation Remote Interpretation
Interpretation Room
Voice
Audio Video
SignLanguage
Interpreter
⑤
Usual Interpretation Remote Interpretation
Interpretation Room
Scene
DeafPerson
HearingPerson
Interpreter
RealizedSystem
Results○ Remote interpretation was successful.
○ The feeling of refusal to the system was lost as it was used.(Interpreter, Deaf Person, Hearing Person)
○ A scenery monitor was necessary for the interpreter.○ The interpreter found the hearing person’s
appearance well.× Interpretation could not be obtained while the
deaf person was not looking at the monitor.× Eye contact was difficult for the interpreter.
⑥
Hearing Lecturer- Deaf Students
⑦
Usual Interpretation Remote Interpretation
Interpretation Room
DeafStudents
HearingLecturer
Interpreter Voice
Sign Language
⑧
Lecture Room
DeafStudents
HearingLecturer
LectureNote
InterpreterInterpretation Room
Scene
RealizedSystem
Interpretation Supporters
Results○ Remote interpretation was successful.○ A scenery monitor of the lecture room was
necessary for the interpreter as a main monitor.○ The interpreter found the lecturer’s appearance well.× The character on a white board could not be read.× The interpreter sometimes mistook right and left.
○ Merit of Remote Sign Language Interpretation○ The interpretation supporters could read two or more
students' sign language.○ The lecture note could be placed near the
interpreter.
⑨
⑩
Usual Interpretation Remote Interpretation
Interpretation Room
DeafLecturer
HearingStudents
Interpreter
Voice
SignLanguage
Deaf Lecturer- Hearing Students
⑪
LectureNote
Deaf Lecturer
HearingStudents
Interpreter
Lecture Room
Interpretation Room
Scene
RealizedSystem
InterpretationSupporters
Results
○ Remote interpretation was successful.○ A scenery monitor of the students was
necessary for the interpreter.○ The interpreter was able to see students'
expression.
× Interpretation failed when the lecturer disappeared from the monitor.
× Interpretation could not be obtained while the lecturer had turned to the white board.
⑫
Other Applications
Multi-point Meeting With Sign Language Possibility of a Low Cost Remote Sign
Language Interpretation System
⑬
⑭
Personal Sign Language Interpreter Pocket Interpreter Secret Interpreter
Future Subjects The Method of the Information Support for the
Interpreter Hearing Person’s Expression Relation Between the Deaf Person and the Hearing Person Detailed Information on the Scene As a Lecture Note
How to Show the Interpreter’s Video to the Deaf Person
Actual System Design Sign Language Interpretation Server System Mobile Client System
Estimation of Total Cost
⑮
