The X170 protocol as a vehicle for 3D sound control

Presented by Shane Haw Supervisor: Professor Richard FossEmail: g08h4123@campus.ru.ac.za

1. A Brief Overview of my Research.2. Object Orientated Approach3. System Design4. Demonstration5. Future Work6. Questions

Brief Overview• 3D Sound Control or Sound Localization• Combination of 3 technologies:– HCI (Human Computer Interaction) : A

capturing of 3D coordinates– Computer Graphics: A displaying of 3D

coordinates– Real-time Multimedia: converting the

distances between coordinates to volumes

Object Oriented Approach

• Cyclic Approach:– Use Case Diagram– Requirements Specification– Textual Scenarios– Noun Derivations– Class Diagram / Object Model– Sequence Diagrams

System Design

• Technologies used:– HCI: The Microsoft Kinect with the Microsoft

Kinect SDK (beta).– Computer Graphics: Google Sketchup with its

Ruby API– Real-time Multimedia: AES-X170 Protocol

Overall Structure

Audio Networking• The AES-X170 Protocol is a control protocol– Allows the accessing and setting of remote

parameters, which allows the volume levels of channels to be set.

– The volume parameters within the evaluation box are found at the crosspoints between the 1st and 2nd Bus.

Audio Networking

Audio Networking

Audio Networking

Computer Graphics• Google Sketchup provides the means of

displaying the 3D coordinates• A simple, click and drag approach to

building models• Google Sketchup provides a Ruby API• Plugin Folder• Scripts can then be interacted with

through the use of tcp sockets

Computer Graphics

Human Computer Interaction• Microsoft Kinect• The SDK released on the 24th of June 2011• Provides skeletal tracking– Provides the 3 dimensional coordinates of several

preset skeletal joints

Human Computer Interaction

Demonstration

Future Work• The ability to edit portions of old saves• Gesture recognition for track selection rather

than GUI interface• The adding of further speakers and some

effects such as reverberation for better sound localization

Questions ?