Upload
hunter-lindsay
View
216
Download
0
Tags:
Embed Size (px)
Citation preview
• Learnware Network description• Project concerns and components• Remote Sign Language Interpretation� Questions
Technical Details (Jeremy)• Music teaching and recording • Intelligent Classroom� Questions
Project Overview (John)
Learnware Network Description
• Educational network on CA*net 3• Production and distribution of educational
materials and tools • Materials and tools use high-quality digital
audio and video
Project Main Concerns
• Engineering, networking and streaming technology issues
• Optimization of hardware and software for high quality audio and video
• Broadcast studio SMPTE 259M uncompressed SDI video (200+ Mbps)
• Recording studio quality uncompressed multichannel 96kHz, 24 bit audio
Learnware Components
• Music and Audio• Negotiation Simulation• Classroom Teaching in Engineering• Related project:
Remote Sign Language Interpretation
Music and Audio
• multi-channel surround sound • studio sharing• composition collaboration• master classes• shared performances• shared recording sessions
Montreal
Los Angeles
12 channels, 96kHz, 24
bits/channel
Music and Audio• Sept. 2000: McGill – USC Shared Recording
Music and Audio• Nov. 2001: McGill – HEC Violin Duet
Music and Audio• Mar. 2002: Pinchas Zukerman Master Class
Negotiation Simulation
• teach negotiation skills• existing CD-ROM application• conversion to Java for web delivery• video delivery creates heavy system load
Negotiation Simulation
Classroom Teaching
• augmented videoconference teaching• automatic recording and indexing of
lecture for later retrieval• instructor tracking• automatic far-end camera control
Remote Sign Language Interpretation• Related project• Physician and deaf patient in hospital• Interpreter in another city• DV video and audio• 3 compressed video streams • Software decompression
Sign Language
• Technical issues• Social factors• Intelligent Classroom Overview� Questions
Part II
Music Video Recorded via Internet2
• Palo Alto, CA (Nov. 6)--To demonstrate the broadband capabilities of Internet2, a network technologies development program being led by over 180 universities, musicians and engineers at college campuses throughout the United States recently collaborated on a music video recording session via the network.
• But…
Where we’re going
• same idea, but no cheating -- “real” interaction– remote instruction, master classes– distributed rehearsal and performance– studio sharing, recording sessions– remote sign-language interpretation – collaborative engineering design
• all at high-resolution, low-latency
27.6 Mbps
Recording Studio that Spans a ContinentAES 109th demo, Sept. 23, 2000
The “Frères Jacques” experiment• RISQ 2000:
“low-latency” MPEG-2 videoconferencing
“Playing Together” experiment• MPEG-2 Remote Master Class, Dec. 8,
2000
Pinchas Zukerman, Columbia U, NYC
Wu Ji, Canarie ARDNOC, Ottawa
Tolerated Synchronicity
compress transmit
100 20 4030 50 7060 80ms
speed of light: Mtl-LA
net latency Mtl-LA
networks
smallensemble
large ensemble
lip synch
musicalactivity
* This figure is a theoretical “best-case” scenario. Actual performance may vary based on local hardware. The manufacturer makes no warranties, either express or implied, and cannot be held liable for any damages resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included.
MPEG*acquire
Size *does* matter: The Big Picture
• high-res* video• high-fidelity audio• multi-channel
surround• large (life-size?)
picture
Starting to feel more like “being there”?
Remote Classroom Teaching
Robust Person Tracking
Detecting Raised Arms
Questions?
• McGill Advanced Learnware:– http://www.mcgill.ca/icc/canarie/learnWare/
• Remote Sign Language Interpretation– http://www.mcgill.ca/icc/canarie/signLanguage/
• Network Audio Streaming:– http://www.cim.mcgill.ca/~jer/research/aes
• Intelligent Classroom:– http://www.cim.mcgill.ca/~jer/research/iroom