Mapping the Sensorial Layers of a City

Eureka Presentation

ROSSANO SCHIFANELLA

@NYC Center for Data Science

MAPPING THE SENSORIAL LAYERS OF A CITY

Dec 14rd, 2016

Eureka Presentation

Who am I?

Eureka Presentation

DISTRIBUTED SYSTEMS RECOMMENDER SYSTEMS

TURIN

@UNITO

Eureka Presentation

NETWORK SCIENCE HUMAN COMPUTING

CROWDSOURCING

BLOOMINGTON

@IU

Eureka Presentation

LONDON

BARCELONA

URBAN COMPUTING MACHINE LEARNING

BEHAVIOURAL STUDIES COMPUTATIONAL *

NEW YORK

@Yahoo

Eureka Presentation

CAMBRIDGE

URBAN COMPUTING COMPUTATIONAL SOCIAL SCIENCE

@Nokia Bell Labs

Eureka Presentation

WORLD URBANIZATION PROSPECTS: THE 2014 REVISION @UNITED NATIONS

HUMANITY IS URBAN

30% 54% 66%1950 2014 2050

Eureka Presentation

EFFICIENT.SUSTAINABLE.SMART

Eureka Presentation

SHAKESPEARE, CORIOLANUS

“ WHAT IS A CITY BUT PEOPLE? ”

Eureka Presentation

EFFICIENT.SUSTAINABLE.SMART

SOCIAL.HEALTHY.HAPPY+

HOW DIGITAL DATA CAN BE USED TO STUDY URBAN PHENOMENA AT SCALE

Eureka Presentation

URBAN SENSING

CULTURALSOCIAL ECONOMIC

POLICY MAKERSAPPS DEV

URBAN DESIGNERS

HOW THE PHYSICAL CONTEXT AFFECTS ACTIONS AND, ULTIMATELY, WELL BEING.

Eureka Presentation

SMELLY MAPSHow does a city smell?

CHATTY MAPSHow does a city sound?

HAPPY MAPSHow visually pleasant is a city?

1

2

3

HAPPY MAPS

GET THE SHORT AND PLEASANT ROUTE

H y p e r Tex t 2 0 1 4

A

B

SHORTEST

SHORT and PLEASANT

Eureka Presentation

HOW?

URBANGEMS.ORG: online web game collect a ground truth on collective perception of quiet, beautiful and happy urban sceneries.

COLLECT URBAN PERCEPTIONS IN LONDON

Eureka Presentation

Eureka Presentation

HOW?


Paths are weighted not only on distance but also on how pleasant they are.

GENERATE EMOTIONALLY-AWARE ROUTES

-Path from Euston Square and Tate Modern -3 situations (happy, quiet, beauty scenarios) -4 paths to vote on a Likert scale (paths are

unlabeled)

SURVEY IN LONDON

-Peaceful, historical, and distinctive are good urban qualities

-Busy is the most frequently mentioned negative quality.

-No consensus on contrasting qualities (e.g., historical/charming vs. busy) or experience drastic changes over time (e.g., busy during the week, and lovely in the weekend).

TAKEAWAYS


Eureka Presentation

coordinates

WHERE

WHENtimestamp

WHATtext+visual+audio

WHOauthor

WHYintent, context

(lon, lat, t)

TREEPEOPLE

GRASS

STREET

TRASH BINSTREET LIGHT

Wonderful day at the park #nature

Eureka Presentation

HOW?

Can we predict beauty scores out of social media?

GENERALIZATION USING SOCIAL MEDIA

-For each street segment we extract: -Number of pictures (density), number of

views, of favorites, of comments, and tags -Tags (LIWC dictionary, 72 categories)

-Extract features that are significantly correlated with beauty scores -Example: density, ’posemo’, ‘negemo’, ‘swear’,

‘anx’ (anxiety), ‘sad’, and ‘anger’ LIWC categories

-Build a linear model to predict beauty

METHOD

7M geolocated photos in London

DATA


Paths are weighted not only on distance but also on how pleasant they are.

GENERATE EMOTIONALLY-AWARE ROUTES


Eureka Presentation

IS WALKABILITY QUANTIFIABLE?W W W 2 0 1 5

HOW DOES A CITY SMELL?

SMELLY MAPS

ICWSM 2015

Eureka Presentation 25

Humans discriminates up to 1 Trillion odorsScience 2014


Yet, city planning can discriminate only a few bad odors

Why this negative perspective?



Smell WalksAmsterdam, Pamplona, Glasgow, Edinburgh, Newport, Paris, New York, Singapore


PHOTOS

436KTWEETS

1.7MPHOTOS

17M

DATA

London + Barcelona

30

DOG CAT30

BIRD

10 5

31

CO-OCCURENCE NETWORK

32

EMERGENCE OF CLUSTERS

33

ANIMALS

EMISSIONSFOOD

NATURE


Victoria Henshaw

URBAN SMELLSCAPE AROMA WHEELPositive + Negative smells


Presence of nature, food, etc. tags

OPEN STREET MAPS

Air quality indicators

CITY OFFICIALS

VALIDATIONDo the smellscape powered by social media is

consistent with offline and online external data?

40

AIR POLLUTION vs SMELL in LONDON

-0,50

-0,38

-0,25

-0,13

0,00

0,13

0,25

0,38

0,50

NO2 PM10 PM2,5

-0,13-0,08

-0,33

0,17

0,350,47

Emissions Nature

CO

RR

ELA

TIO

N

Results are consistent across platforms and cities

41

OSM NATURAL TAGS

-0,23

-0,15

-0,08

0,00

0,08

0,15

0,23

0,30

0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

Emissions smell Nature smell

# OF TAGS FOR STREET SEGMENT

CO

RR

ELA

TIO

N

42

OSM FOOD TAGS

-0,10

0,00

0,10

0,20

0,30

0 10 20 30 40 50 60 70 80 90 100

Food smell

# OF TAGS FOR STREET SEGMENT

CO

RR

ELA

TIO

N


HOW DOES THE URBAN SMELLSCAPE CHANGE THROUGH TIME AND SPACE?ICWSM 2016

CHATTY MAPS

HOW DOES A CITY SOUND?

RSOS 2016


URBAN SOUNDSCAPE WHEELBeyond noise



EMOTIONS

To model sentiment we adopt the EmoLex lexicon that follows the 8 primary emotions from Plutchik’s psychoevolutionary theory.

Eureka Presentation

EMISSIONS

WASTECORRELATION BETWEEN EMOTIONS AND SMELLS

FOOD

NATURE

Eureka Presentation

MUSIC

HUMAN

TRAFFIC

CORRELATION BETWEEN EMOTIONS AND SOUNDS

Eureka Presentation

MUSIC

Music triggers both joy and sadness

EMOTIONS

SONIC

OLFACTORY

VISUAL

URBAN FABRIC


DEMO

GOODCITYLIFE.ORG

ECONOMIC CAPITAL

CULTURAL CAPITAL

SOCIAL CAPITAL

MAPPING CULTURAL EXPRESSIONS AT NEIGHBORHOOD LEVEL AND CORRELATING IT WITH MEASURES OF ECONOMIC DEVELOPMENT

THERE IS MUCH MORE

MAPPING INNOVATION, WEALTH, AND ECONOMIC ACTIVITIES AT DIFFERENT GEOGRAPHICAL GRANULARITIES

MAPPING SOCIAL INTERACTIONS AND SOCIETAL PHENOMENA, ENVIRONMENTAL ISSUES, INDOOR/OUTDOOR ACTIVITIES

Eureka Presentation

Questions?

@rschifan

http://www.di.unito.it/~schifane

[email protected]

Presentations & Public Speaking

Mapping the Sensorial Layers of a City