Understanding the Emotional Impact of Images

Jia JIAComputer Science, Tsinghua University

Joint work with Xiaohui WANG, Peiyun HU, Sen WU, Jie TANG and Lianhong CAI

Framework: Images -Aesthetic Effects -Emotions

Model: Factor Graphs for images in Social Networks

App1: Emotion Distribution on Flickr

Before Thanksgiving 2011 VS During Thanksgiving holiday

Happy, Cheerful, and Peaceful 100,000 Images from Flickr

App2: Modify Images with Emotional Words

Happy

Natural

Clear

Original Image

Summe

r?

Autumn

?

Winter

?

More than 180 different effects

“Emotion Modifier”Welcome to download from iTunes Store!

https://itunes.apple.com/us/app/emotion-modifier/id571639316

Thank you for your attention!

Any Question?

APP for iPad (support IOS 5.x ) : Emotion Modifier.

Free Download! From https://itunes.apple.com/us/app/emotion-modifier/id571639316

Modeling Emotions via Aesthetic Effects

How to characterize levels of emotional impact?

We propose a novel notion of using aesthetic effects (quantified in image-scale space) as an intermediate layer to model the high level emotional semantics of images.

MiddleLevel

HighLevel

What affective model to predict the emotional impact?

Large-scale Dataset: 100,000 images in social networks with comments as emotional tag.

Model: semi-supervised factor graph model to incorporate color-based features, aesthetic effect, social features and emotional impact.

Jie Tang, et al., Learning to Infer Social Ties in Large Networks. In proceeding of ECML-PKDD 2011

Modeling Social Networkvia Factor Graphs