Embed Size (px)
DESCRIPTION
What is it? Nowadays traveling has become accessible for most people who seek to experience different cultures. In some countries around the world, it is common to find citizens that speak only their native language. What if to enhance the experience of another culture is about understanding each other? Though people tend to find ways expressing themselves by using gestures for communication purposes, the message is not always clear. The aim of this project is to merge the gap between different cultures and to create a better understanding by using the naturally gestures and translating them into visual representations. By doing so, a mutual ground of communication is created between people who speak different languages. Pictogest is a connected device that helps you to communicate in an easier way by enhancing your personal gestures and displays them through a visual representation, according to your personal database. How it works? In situations where language becomes the ultimate barrier, gestures could be used to explain oneself. Pictogest uses a Kinect in order to capture the gestures; they are translated into visuals that vary from pictograms, pictures from personal databases and text as well. To be able to detect the gestures, the user must use the “control gestures” (start, stop, repeat, etc..) in order to give a meaning to the output. Visual instructions are shown on the user’s mobile screen. Users could choose to save visual instructions in the archive or send them to another user. Value & potential The values of Pictogest can be defined in two different categories, one for the end users and the other one for the stakeholders. In the first category, the values range from a more personalized explanation, to the possibility of saving instructions in a personal archive, to potentially learn from another human being’s experience and an enjoyable experience while using the interface. In the second category, the values range from collecting data using people’s experience that are archived and the possibility of understanding different behaviors from different cultures. Pictogest’s potential future could consist of embedding the interactive system in smartphones. It could also comprise creating a website containing the databases saved by users and using Pictogest for different purposes as well.
Citation preview
Project Leader: Claudio Moderini
Project Assistant: Nima Gazestani
Group Members: Eray Alan, Hadar Geva & Rana Mansour
Master in Interaction Design 2013/2014
25/10/13
Intro
Culture: manifestations
of human intellectual
achievement
collectively.
Understanding:
ability to understand &
Comprehend something.
aware of other people's
feelings.
The boundaries between the two areas still hold
a gap with the present solutions.
What is the main focus to narrow this gap?
How to interact with each other to create a better way to communicate?
Research
Problems and opportunities
Research
Inspiration
sixthsense #gesture recognition
Yang Liu #culture
Xu Bing #visual translation
Concept
When people travel, they tend to use
gestures to communicate with each other,
however some gestures are different
according to every culture.
In order to reach a middle ground,
Pictogest captures gestures and translates
them into visual elements to facilitate
the communication.
#Communication #Gesture recognition
#Visualization #Travelling
How it works?
1 2
4
6
7
5
3
8
"How to
drink Tequila?"
Generate
visual
instructions
Use gestures
Gesture
translation
with databases
How it works?
1 2 3 4 5 6 7
"How to drink Tequila?" - Gestures
Example
” What is this ?“
Eray Alans’s guide
) (
Start Stop
Interface
Interface
Interface
Interface
Interface
Interface
Interface
Interface
Interaction modalities
”Ricotta“
”Ricotta“
Interaction modalities
Technicality
Database: Filters the inputKinect: Captures gestures
Mobile Device:
Visualizes the gestures
Mesh
Value and potential
Possible Future
Ž� pictogest website
Ž� build in device
Ž� used for other purposes
For Stakeholders
Ž� Collecting data using
people’s experience
Ž� understanding different
behaviors from different
countries
For end users
Ž� more personalized explanation
Ž� saved instructions )archive(
Ž� learning process from person
not machine
Ž� fun & easy to use
