1. WORKSHOP EMBODIED VISION Augmented and Virtual Reality in Unity3D

2. Hello world EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Robin de Lange Part-time PhD student @ Media Technology Part-time entrepreneur Studies Physi cs Philoso phy Artifici al Intellig enceMedia Technology 3. What are we going to do? EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D - What is Unity3D? - Unity3D interface and project overview - Creating a simple scene - Scripting: Hello world application Introduction Getting started with Unity3D - Idea for this workshop - How to install Unity plugin - Demonstration of demo Oculus Rift sce - Creating a simple Oculus Rift scene Virtual Reality: Oculus Rift Augmented Reality: Vuforia - Installing Vuforia library - Run a Vuforia demo application Individual/teamwork - Making everything work, experimenting for assignment - Tutorials and questions! 4. Introduction: Graduation project EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Augmented Reality prototype that supports mathematical skills 5. Introduction: Graduation project EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Main goal: raise questions and discussion - How would this change our mathematical understanding? - How can AR headsets change the way we solve problems? - Will we be able to solve more complex problems by off-loading part of the cognitive load? - How should education change in response to the rise of these new tools? Similar approach in PhD research 6. Introduction: Other projects EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Started using Unity3D for other projects Scan childrens books View 3d cloud with opinions Add own reviews Together with Berber de Vries 7. Introduction: Other projects EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D 3 Oktoberapp App around Leidens Ontzet Android and iOS Only GUI: timetable, soundboard, etc. 8. Introduction: Other projects EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Brainstorm: Live EEG data visualization for Oculus Rift Together with Eva Delincakova & Bert Spaan @ Hack the Brain hackathon 9. Getting started: What is Unity? EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Lets ask David Helgason, one of the founders of Unity. http://www.youtube.com/watch?v=4mtz AXSiR1w 10. Getting started: Why use Unity? EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Not only for games, also for other interactive environments Very easy multiple platform output. No restriction in mobile apps Integration with devices as Rift, Kinect and Emotiv EPOC Integration with 3D modelling software: Blender/3ds Max/Maya/. 11. Getting started: Why use Unity? EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Active community of millions Thousands of models, scripts and plugins via Asset Store Many tutorials and guides available Nice combination of 3D environment and scripting Environment meant for collaboration between 12. Getting started: Non- game projects EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D BitGym http://www.youtube.com/watch?v=0r9V57 cTovI Bike configurator http://www.bikeconfig.com/ Physics demo http://www.coffeeshopphysics.com/magne todynamics/index.php?demo=VanDeGraaff Example 13. Getting started: Project and Interface Overview EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D START UNITY 14. Getting started: Oculus Rift example EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Download from: https://developer.oculusvr.com/ Signing up required, use Dropbox link otherwise If Rift is connected: run OculusConfigUtil Rift not required for development Import OculusUnityIntegration package i project 15. Getting started: AR with Vuforia EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Introduction videos: https://developer.vuforia.com/resource s/sample-apps/features Instruction on downloading and installing Vuforia library: https://developer.vuforia.com//resource s/sdk/unity?d=aw2 16. Individual/teamwork: Assignment EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D During the lectures you have learned about many different special and visual effects used in film and the different goals (such as: distraction, shock, spectacle, narrative, integration, immersion) that can be reached by applying these effects. For this assignment you are challenged to make use of the visual effects offered by Augmented and Virtual Reality to support one (or more) of these goals you find most interesting. Since learning Unity3D is an essential part of this Groups: 1-3 persons 17. Individual/teamwork: Assignment EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Use AR/VR visuals for goals like shock, spectacle and discontinuity, similar to early days of film Explore the effect of editing in AR/VR Ideas: 18. Individual/teamwork: Learn more EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D Now: Get Vuforia and/or Oculus Rift working Experiment with examples Follow a few tutorials Think about assignment Ask questions! Later: Feel free to contact me www.robindelange.com for details. 19. Individual/teamwork: Learn more EMBODIED VISION: AUGMENTED AND VIRTUAL REALITY IN UNITY3D General Unity tutorials: http://unity3d.com/learn http://www.unity3dstudent.com/ Vuforia: https://developer.vuforia.com/resources/tutorials Graphical User Interface: NGUI http://www.tasharen.com/?page_id=140 Data visualization: https://vimeo.com/59696565 http://catlikecoding.com/unity/tutorials/graphs/