Acoustic Art: Revolutionizing The Way You Listen To Pictures Matt Clark (Image Analysis Expert) Jay...

Acoustic Art:Revolutionizing The Way

You Listen To PicturesMatt Clark (Image Analysis Expert)

Jay Davis (Spring Team Lead)Kyle Kearney (Fall Team Lead)Vince Tilanus (Client Liaison)

Louis Piano (Client)

Will French (Industry Rep., Jive Software)

Dr. Karen Ward (Faculty Advisor)

Introduction• Music out of images• Beau Lotto (TED Talk)• Visuals in sound therapy

Beau Lotto: Optical illusions show  -how we see - Oct 2009. Ted.com

Why?

• Take an idea a step further 

• Novel concept

• Combining abstract ideas

• Microsoft Imagine Cup

Image As Blocks

Design: Image analysis

• Edge Detection-Sobel Edge Detection

• Texture Analysis- Haar wavelet (Discrete Wavelet Transform)

• Dominant Color-most common color (mode)

• Average Brightness-average all pixels (mean)

(Sobel, 1991)

Life After Edge Detection

Design: Image analysis

• Edge Detection-Sobel Edge Detection

• Texture Analysis- Haar wavelet (Discrete Wavelet Transform)

• Dominant Color-most common color (mode)

• Average Brightness-average all pixels (mean)

(Sobel, 1991)

Texture Analysis

Design: Image analysis

• Edge Detection-Sobel Edge Detection

• Texture Analysis- Haar wavelet (Discrete Wavelet Transform)

• Dominant Color-most common color (mode)

• Average Brightness-average all pixels (mean)

Dominant Color and Average Brightness

Design: Music Generation

• Take input from image analysis.

• Configurable instruments-user can edit and composer will use.

• Multiple composers.o  Naive Pentatonico Music Theoretical

Naïve Pentatonic Composer

• Just brightness

• Pentatonic scaleo Guaranteed to have notes not clash

Music Theoretical Composer

• Apply basic music theory.• Use all available image characteristics• Generate:

o Rhythmo Melodyo Counter-melodyo Harmonyo Basslineo Volumeo Scaleo Key Change

Demonstration

Accomplishments

• Combined two forms of creative expression oVisual ArtoMusic

• Created a complex algorithm from scratch

Conclusion

• What next? oMTC updates and modificationsoGUI progress displayoNext year senior project?

Questions?