Embed Size (px)
Citation preview
Acoustic Art:Revolutionizing The Way
You Listen To PicturesMatt Clark (Image Analysis Expert)
Jay Davis (Spring Team Lead)Kyle Kearney (Fall Team Lead)Vince Tilanus (Client Liaison)
Louis Piano (Client)
Will French (Industry Rep., Jive Software)
Dr. Karen Ward (Faculty Advisor)
Introduction• Music out of images• Beau Lotto (TED Talk)• Visuals in sound therapy
Beau Lotto: Optical illusions show -how we see - Oct 2009. Ted.com
Why?
• Take an idea a step further
• Novel concept
• Combining abstract ideas
• Microsoft Imagine Cup
Image As Blocks
Design: Image analysis
• Edge Detection-Sobel Edge Detection
• Texture Analysis- Haar wavelet (Discrete Wavelet Transform)
• Dominant Color-most common color (mode)
• Average Brightness-average all pixels (mean)
(Sobel, 1991)
Life After Edge Detection
Design: Image analysis
• Edge Detection-Sobel Edge Detection
• Texture Analysis- Haar wavelet (Discrete Wavelet Transform)
• Dominant Color-most common color (mode)
• Average Brightness-average all pixels (mean)
(Sobel, 1991)
Texture Analysis
Design: Image analysis
• Edge Detection-Sobel Edge Detection
• Texture Analysis- Haar wavelet (Discrete Wavelet Transform)
• Dominant Color-most common color (mode)
• Average Brightness-average all pixels (mean)
Dominant Color and Average Brightness
Design: Music Generation
• Take input from image analysis.
• Configurable instruments-user can edit and composer will use.
• Multiple composers.o Naive Pentatonico Music Theoretical
Naïve Pentatonic Composer
• Just brightness
• Pentatonic scaleo Guaranteed to have notes not clash
Music Theoretical Composer
• Apply basic music theory.• Use all available image characteristics• Generate:
o Rhythmo Melodyo Counter-melodyo Harmonyo Basslineo Volumeo Scaleo Key Change
Demonstration
Accomplishments
• Combined two forms of creative expression oVisual ArtoMusic
• Created a complex algorithm from scratch
Conclusion
• What next? oMTC updates and modificationsoGUI progress displayoNext year senior project?
Questions?
