Impact workshopEDCR 2016December 13

Workshop screenplay

BP 2017CC BY-SA

● Introduction Impact (Harry) (20 min)● Introduction case (Marco) (10 min)● Exercise 1: Looking through the lense (20 min)● Exercise 2: The Impact Pathway (20 min)● Exercise 3: Defining Performance Indicators (20 min)● The Pitch (30 min)

Introduction Impact FrameworkHarry, 20 m

France, Public Domain1588,  Bibliothèque municipale de Lyon

Hendrik Goltzius

Le dragon dévorant les compagnons de Cadmus

IMPACTMeasure what is important, don't make

important what you can measure. ~ Robert McNamara ~

Pion

eering

Institutio

ns

Innovation

Social Cultural

Economic

Impkt

Basecamp

(impkt.tools)

Ac

tiv

itie

sO

utp

uts

Ou

tco

mesIMPACT

The Promised Land

We are here

Scotland, CC BY-NC-SARoyal Museums Greenwich

National Maritme Museum

Scotiae tabula (map of Scotland)

Pion

eering

Institutio

ns

Innovation

Social Cultural

Economic

Impkt

BasecampCommunity

Existence

Legacy

Utility

Learning

Ac

tiv

itie

sO

utp

uts

Ou

tco

mesIMPACT

Pion

eering

Institutio

ns

Innovation

Social Cultural

Economic

Impkt

BasecampCommunity

Existence

Legacy

Utility

Learning

Ac

tiv

itie

sO

utp

uts

Ou

tco

mesIMPACT

Pion

eering

Institutio

ns

Innovation

Social Cultural

Economic

Impkt

BasecampCommunity

Existence

Legacy

Utility

Learning

Ac

tiv

itie

sO

utp

uts

Ou

tco

mesIMPACT

Pion

eering

Institutio

ns

Innovation

Social Cultural

Economic

Impkt

BasecampCommunity

Existence

Legacy

Utility

Learning

Ac

tiv

itie

sO

utp

uts

Ou

tco

mesIMPACT

Pion

eering

Institutio

ns

Innovation

Social Cultural

Economic

Impkt

BasecampCommunity

Existence

Legacy

Utility

Learning

Ac

tiv

itie

sO

utp

uts

Ou

tco

mesIMPACT

Impact definition

BP 2017CC BY-SA

‘Impact is a heightened form of evaluation that seeks to measure beyond performance or success indicators to demonstrate the measurable outcomes that can demonstrate a significant change for people affected by the existence of your institution and its activities.’

~ Professor Simon Tanner

Impact Areas

BP 2017CC BY-SA

ImpactCC BY-SA

EDUCATED

Impact Pathway

ImpactCC BY-SA

EDUCATED

Impact Pathway

ImpactCC BY-SA

KPI

# of digitised objects

EDUCATED

Impact Pathway

KPI

How many people indicate increased awareness of the other sides of the

story?

ImpactCC BY-SA

Impact Lenses

ImpactCC BY-SA

Impact Lenses

BP 2017CC BY-SA

Survey and interviews

BP 2017CC BY-SA

1.517 responses, 393 were deemed valid; representing 151 users and 242 non-users

Outputs

BP 2017CC BY-SA

Data set FilmCase study

pro.europeana.eu/publication/impact-assessment-case-study

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Lenses, definitions

BP 2017CC BY-SA

Did we have impact?

BP 2017CC BY-SA

Introduction AssignmentMarco, 10 m

France, Public Domain1588,  Bibliothèque municipale de Lyon

Hendrik Goltzius

Le dragon dévorant les compagnons de Cadmus

Picture this...

BP 2017CC BY-SA

Put yourself in the shoes of a staff member of the Scottish Historic Photo Museum, a moderately popular museum, especially with the local population.

The Scottish Historic Photo Museum

You( b )

You( a )

Your new boss

BP 2017CC BY-SA

The new director is inspired by the open data success of other museums, such as the Rijksmuseum Amsterdam, the Staatsmuseum in Copenhagen and the Museum für Kunst und Gewerbe in Hamburg.

She feels that the historic photographic collection of the museum can have a far wider impact on user groups, especially the collection on the industrial revolution and the emancipation of Scottish labourers.

A Director with ambition

New mission statement

BP 2017CC BY-SA

“The museum is opening up its collection of 100k photographs online to enhance awareness and understanding of the history of the city as a major centre in textiles, garment-making, carpet manufacturing, leather processing, furniture-making, pottery, food, drink and cigarette making and printing and publishing, not only with the local and regional communities, but also for anyone across the world with an interest in Scottish history, the industrial revolution, urban development, etc.”

BP 2017CC BY-SA

The SHPM has already digitised ca. 100.000 historic photographs, which are currently available online in a custom built database with a simple search interface (and not findable in Google).

You are assigned to the project to make sure that this unique digital collection gets the widest impact possible by publishing it as open data.

How are you going to prove to your director at the end of the project that you have been able to achieve just that?

The proof of the pudding is in the eating

Excercise 1: Looking through a lenseGroups, 20 min

France, Public Domain1588,  Bibliothèque municipale de Lyon

Hendrik Goltzius

Le dragon dévorant les compagnons de Cadmus

BP 2017CC BY-SA

There will be 5 subgroups. Each group will represent a particular professional perspective and will assess impact by looking through a particular lens:

1. Educator: The Learning lens2. Data manager: The Utility lens3. Curator: The Legacy lens4. Public Relations Officer: The Existence lens5. Chair of the Friends Association: The Community lens

Five perspectives

Looking through a lense

BP 2017CC BY-SA

What kind of impact do you expect to see if you look through your lense?

Excercise 2: Create an Impact PathwayGroups, 20 min

France, Public Domain1588,  Bibliothèque municipale de Lyon

Hendrik Goltzius

Le dragon dévorant les compagnons de Cadmus

The Impact Pathway

BP 2017CC BY-SA

What kind of activities, outputs and outcomes should you be looking for to maximise impact?

● Outputs are the direct products of the digital resource being measured. They consist of data, both in statistical quantitative form and qualitative evidence modes. Outputs therefore often talk to performance measures or monitoring information.

● Outcomes are the specific changes and consequences evaluated for things such as behaviours, knowledge, skills, status, wealth, wellbeing, or effectiveness to mention a few instances.

BP 2017CC BY-SA

Impact pathway

Stuff you do Products & services Changed behaviour Desired resultWhat makes you tick

Excercise 3: Performance & pitch prepGroups, 20 min

France, Public Domain1588,  Bibliothèque municipale de Lyon

Hendrik Goltzius

Le dragon dévorant les compagnons de Cadmus

BP 2017CC BY-SA

The new director is inspired by the open data success of other museums, such as the Rijksmuseum Amsterdam, the Staatsmuseum in Copenhagen and the Museum für Kunst und Gewerbe in Hamburg.

She feels that the historic photographic collection of the museum can have a far wider impact on user groups, especially the collection on the industrial revolution and the emancipation of Scottish labourers.

A Director with ambition

Performance indicators

BP 2017CC BY-SA

What should you measure or collect to measure outcomes (rather than output)?

Excercise 4: Pitch!Groups, 5 min each

France, Public Domain1588,  Bibliothèque municipale de Lyon

Hendrik Goltzius

Le dragon dévorant les compagnons de Cadmus

21 October 2016