Augmented and Virtual Reality - Massachusetts Institute of ... Augmented Reality (AR) mixed reality

  • View
    0

  • Download
    0

Embed Size (px)

Text of Augmented and Virtual Reality - Massachusetts Institute of ... Augmented Reality (AR) mixed reality

  • Augmented and Virtual Reality 6.S063 Engineering Interaction Technologies Prof. Stefanie Mueller | MIT CSAIL | HCI Engineering Group

  • Augmented Reality (AR)

    mixed reality

    real environment augmented reality (AR) augmented virtuality (AV) virtual reality (VR)

    AR supplements the real world VR replaces the real world

  • let’s look at the very beginning…

  • not quite the first…

    when was the first AR/VR headset developed?

    2012 - Occulus Rift

  • 1965: Ivan Sutherland - ”Sword of Damocles” (first video headset)

  • binocular display (both eyes) displayed output

    1965: Ivan Sutherland - ”Sword of Damocles” (first video headset)

  • • too heave to carry, thus suspended from ceiling

    • designed for helicopter pilots to have light synchronized with head movement when flying in the dark

    • included head & eye tracking

    1965: Ivan Sutherland - ”Sword of Damocles” (first video headset)

  • a room where the computer can control the existence of matter

    ‘the ultimate display’::

    (Ivan Sutherland, 1965)

  • Ivan created the first head mounted display…

    but the idea of augmenting human senses has already around a bit longer…

  • 1965: Marc Heiling - Sensorama (even before Sutherland)

    • stereoscopic display • vibrating seat • body tilting • fragrance generating system • wind generation

  • 1985: NASA virtual environment work station

    first data glove

  • 1985: NASA virtual environment work station

  • 1985: NASA virtual environment work station

  • 1985: NASA virtual environment work station

  • any ideas which tech advances made AR/VR suddenly mass-available in the last 5-10 years?

  • • small and light-weight displays became low-cost • mobile computing: small & powerful computers for graphics

  • 1996: Columbia - Mobile AR ”Touring Machine:”

    first mobile system

  • 2000+: consumer AR / VR

    commodity devices are finally sufficiently powerful, small, inexpensive

  • what’s next in terms of technology? how does the next AR/VR hardware look like?

  • AR contact lenses (many challenges, max. 8 pixel right now)

  • display technologies

  • Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial

    hand-held display

    spatial see-through

    display

    head- worn

    display

    retinal display

    projector

    projector

    [Ramesh Raskar]

  • retinal display Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial

    hand-held display

    spatial see-through

    display

    head- worn

    display

    retinal display

    projector

    projector

  • [NaturalVue, ColorMax]

    future • AR with digital overlay • future: VR

    today • multifocal lenses • color blindness lenses • sensor lenses for body information

  • head-worn displays Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial

    hand-held display

    spatial see-through

    display

    head- worn

    display

    retinal display

    projector

    projector

  • Vuzix Star 1200XL

    optical see-through: • you see the real-world with your eyes in

    the same way as using regular glasses • on top digital content is displayed

  • using a cellphone and materials from the workshop, how would you build an optical see-through display?

    draw it on paper.

  • smart phone display

    real world

    semi-transparent mirror

    optical see-through:

  • optical see-through:

    display

    mirror

  • what are some of the benefits and drawbacks of optical see through?

  • • real world is full resolution and FOV • if you run out of battery, you still see something

    benefits::

    • no control over real world • you cannot display sth behind a real world object • virtual/real worlds focus at different distances

  • Vuzix Wrap 1200AR

    video see-through: • real world is captured with cameras • camera image is digitally enhanced • you look at the camera image

  • full control over image you can display something behind a real world object

    real world is low resolution and low field of view (FOV)

    benefits::

  • field of view (FOV): here HoloLens, FOV < 100 degree)

  • hand-held displays Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial

    hand-held display

    spatial see-through

    display

    head- worn

    display

    retinal display

    projector

    projector

  • kind of video see-through device camera captures real world, then displays it on screen

  • markers help to align multiple devices

  • spatial augmented reality (SAR) Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial

    hand-held display

    spatial see-through

    display

    head- worn

    display

    retinal display

    projector

    projector

  • spatial AR: • project onto real-world objects • no need to wear or hold something • digital content directly in the real-world

  • spatial AR: • camera: find out where the object is • projector: enhance with digital content

    [SoftAR, Punpongsanon]

  • Head%attached))))))))))Body%attached)))))))))))))))))))))Spatial

    hand-held display

    spatial see-through

    display

    head- worn

    display

    retinal display

    projector

    projector

    ? [Ramesh Raskar]

  • if spatial AR brings digital content closer to the real-world object, what would be the next logical step in terms of technology?

  • everything becomes a ‘display’ the future?

  • “The ultimate display would, of course, be a room within which the computer can control the existence of matter.

    A chair displayed in such a room would be good enough to sit in. Handcuffs displayed in such a room would be confining, and a bullet displayed in such a room would be fatal.”

    — I. Sutherland, The Ultimate Display, Proc. IFIP 65, 506–508, 1965

    and maybe even a ‘physical display’…

  • any many more interesting questions..

  • Liwei Chan: Frontface

  • Yoichi Ochiai: Augmented Mom

  • that’s it for today…

  • until wednesday • laser cut business card (HW1) • setup your micro-controller on your computer (HW2) • connect your micro-controller to wifi (HW3)

    Jared’s tuesday office hour: 4.15 - 6pm

  • end.