Spatiotemporal Information ProcessingNo.1History of computer and relationship between Virtual Reality and Spatiotemporal Information Processing

Kazuhiko HAMAMOTO

Dept. of Information Media Technology,

School of Information and Telecommunication Eng.,

Tokai University, Japan

Contents

Syllabus

What is “Spatiotemporal Information Processing” ?

What is “Virtual Reality” ? Progress of computer and change of its

interface Virtual Reality and its 3 components

Syllabus -Theme and Keywords-

Theme Format and Processing of Spatiotemporal

Information and its application Keywords

Virtual Reality Wearable Computer Telexistence

Syllabus -abstract-

History of computer and relationship with Virtual Reality as human interface

Technique to process spatiotemporal information in computer How to get the information What is the format ?

A concept or an outlook on information processing which might be changed by the spatiotemporal Information processing technique. What will come when the real space could be used as

information space

What is “Spatiotemporal Information Processing” ?

As traditional information processing 4-D information processing in a computer Interface : keyboard and mouse Acquisition, save, processing (retrieval,

recognition, etc.) By New modality of devices

Interface : VR, wearable computer Change of the role of computer

1st Computer in the world

ENIAC, 1946, Feb.(Electronic Numerical Integrator And Calculator)

ENIAC was conceived and designed by John Mauchly and J. Presper Eckert of the University of Pennsylvania

Moore’s Law computers will either double in power at

the same price or halve in cost for the same power every 18 months.

rapid progress of computerENIAC 1946 -> Now..?!

History of Computer is different from …

1946

2010

1903

2010

1946

Moore’s Law computers will either double in power at

the same price or halve in cost for the same power every 18 months.

rapid progress of computerENIAC 1946 -> Now..?!

change of the information which can be dealt with computer

Question : progress of computer

Please fill in the blanks.

yearMemory

orderKind of

informationInterface devices

1980 K byte

1990 M byte

2000 G byte

2000 -- T byte

character

image

movie

space

keyboardkeyboard, mouse

and pen tablet

keyboard, mouseand pen tablet

The five senses

Space processing …?

Advanced computer will be able to deal with “space”.

What interface devices are appropriate ? What is needed for space processing ?

KeyboardMouseTabletDisplay (CRT or LCD)

Five senses Interface Position sensing systemSmall I/O devices (e.g. wearable computer)

Virtual Reality

To access the space which computer deals with by human sense

Ordinary behavior of person is used as interface to computer.

Virtual Reality

What is the meaning of “Virtual” ?～ What is a common word ? ～

Virtual

Virtual moneyVirtual money

VirtualVirtualClassroomClassroom

Virtual PresidentVirtual President

Question

Please fill in the blanks

Virtualantonym

synonym

nominal,supposed

imaginaryreal

Meaning of “Virtual”

Existing in essence or effect though not in actual fact or form

Previous examples, again

Virtual money

Virtual classroom

Virtual President

What is the meaning of “Reality” ?

“Reality” in VR is NOT universal truth. “Reality” exists around us and can be felt through our

five senses. The feeling is NOT recognition of an object, itself. A phenomenon of an object can be recognized

through five senses. The world recognized by people is a kind of virtual

world by the sense organs Appropriate combination of input to five senses can let

people believe their own presence in a virtual space

Example of human sense

Human vision sense We can feel “electromagnetic wave” whose

wavelength is from 400nm to 750nm Human hearing sense

We can feel “air vibrations” whose frequency is less than 20kHz

We cannot feel all range of color or sound

Definition of “Virtual Reality”

What is not actual, but has the same essence as actual thing

The world where we can access by the five senses and human behavior can be used as human interface directly

First proponent of “Virtual Reality” isJ.Lanier, USA, in 1987

3 elements of Virtual Reality

3D Environment 3D virtual space is “natural” for human

senses. Real-Time Interaction

Real time response of computer to action of person

Autonomy Virtual space exists even if people (user)

doesn’t exist.

Sensing system Detection of motion (head, eyeball, trunk, upper

limbs and lower limbs) in real 3D space and input to computer

Simulation system Creation of virtual space, and calculation of motion

of virtual objects and real-virtual matching

Display system (Realistic display) Display of not only visual but aural, tactile and

olfactory information, and stimulus of sense organs

3 components for Virtual Reality

The relationship among 3 components

Person

real space virtual space

Simulation system

Display system

Sensing system

computer

Virtual Reality in Spatiotemporal information processing

VR can present “Human Interface” which lets people recognize space information as “real space” Various human sense modalities are used. Presence and real-time interaction is

realized. “Mass communication path” between

user and computer is realized by VR VR can change the role of a computer.

What is “Spatiotemporal Information Processing” ?

As traditional information processing 4-D information processing in a computer Interface : keyboard and mouse Acquisition, save, processing (retrieval, recognition,

etc.) By New modality of devices

Interface : VR, wearable computer Change of the role of computer

From “AI : Artificial Intelligence” to IA : Intelligence Amplification”

question

answer

Conventional InformationProcessing (AI)

Mass-communicationPath (VR)

Information processing unitby effective combination of Computer and user

Information Processing by New modality (IA)

What is “Spatiotemporal Information Processing” ?

Spatiotemporal Information Processing is realized by New Modality (=VR) Mass-communication path between computer

and user can be realized. Computer power is added to human power.

More large human power is produced. Information in the brain is output to computer.

The result is returned to the brain. This process can create “Intelligence”.

What is “Spatiotemporal Information Processing” ?