Guidelines for the Evaluation von MM Programmes EvaMM Timo Finke RUTH Guidelines for the Evaluation of Mobility Management Programmes EvaMM Handlungsleitfaden

Guidelines for the Evaluation von MM Programmes

EvaMM

Timo Finke

RUTH

Guidelines for the

Evaluation of Mobility Management Programmes

EvaMM

Handlungsleitfaden für dieEvaluation von

Mobilitätsmanagement-Programmen

EvaMM

Timo Finke

Timo Finke Department of Traffic ManagementCity of Düsseldorf

ECOMM 2009

San Sebastián


EvaMM

Timo Finke

RUTH ECOMM 2009, San Sebastián2

Aim of EvaMM

Set up guidelines for practitioners to evaluate MM programmes

• to demonstrate success of MM to programme provider, sponsors, critics and public

• to support the programme manager in daily work

• to include all facets of MM into its evaluation (e.g. awareness campaigns, MM services)

• to sum up programme costs for comparison with alternative measures

• to allow comparison of success between programmes by standardised evaluation

• to document your success!


EvaMM

Timo Finke


Definition Mobility Management

[EPOMM, 2008]

Mobility Management (MM) is a concept to promote sustainable transport and manage the demand for car use by changing travellers' attitudes and behaviour.

At the core of MM are „soft“ measures like information and communication, organising services and coordinating activities of different partners.

„Soft” measures most often enhance the effectiveness of „hard“ measures withing urban transport (e.g. new tram lines, new roads and new bike lanes). Mobility Mangement measures (in comparison to „hard“ measures) do not necessarily require large financial investments and may have a high benefit-cost ratio.


EvaMM

Timo Finke


Phases of Behaviour Change

Pre-Contemplation

Contemplation

Preparation

Actionand

Maintenance

Decision

Initiation


EvaMM

Timo Finke


Assessment Levels of EvaMM

Pre-Contemplation

Contemplation

Preparation

Actionand

Maintenance

A

B

Awareness raising – problems + solutions

Acceptance of personal responsibility

C

D

E

Use of MM-Services

Satisfaction with MM-Services

General acceptance of travel alternatives

F

G

Alternative individual travel behaviour

Satisfaction with travel alternatives

Decision

Initiation

M1 Intention to change behaviour

M2 Start of alternative travel behaviour


EvaMM

Timo Finke


Assessment levels of EvaMM

A Awareness rising - problems + solutions

Are the target groups aware of the problems their current travel behaviour creates?

Are the target groups familiar with the offered MM measures and travel alternatives?

Indicators Measurable target Method of data collection

Number/share of touristswho are aware of prob-lems their car journey

causes at the destination

Problem awareness at 50%

of all tourists until 2010survey

Number/share of employees who know thePT-ticket or carpool offer

50% awareness oneyear after setting up

a company mobility plansurvey

Number/share of citizenswho know the

Mobility Center.

25% awareness amongstcitizens 2 years after

openingsurvey


EvaMM

Timo Finke


EvaMM step by step

Monitoring

Evaluating

EvaluationPlan

Name and describe target groups

Specify indicators & measurable targets

Record input and output

Record framework conditions

Assess impacts

Evaluate success

Specify MM-measures

Formulate mission statementI

V

VI

VII

VIII

II

III

IV

Evaluation Report


EvaMM

Timo Finke


EvaluationPlan Specify indicators and measurable targetsIV

Fact sheetDescriptionof Indicator

Awareness for the daily congestion caused by the employees and the limited number of company's parking spaces.Knowledge of the MM measures offered to solve these problems

Assessment Level Awareness rising through MMA

Target group Employees

Description of Indicator and its relevance for the assessed MM-ProgrammeBasis for a behaviour change is the awareness of problems and knowledge of solutions offered. Company'sMM should make sure that employees are aware of the daily congestions in the proximity of the company andthe limited number of parking spaces that lead to illegal parking on public streets. At the same time, it shouldshow measures to solve these problems.

The higher the share of employees that are aware of these problems and solutions offered by the MMprogramme the more successful measures of awareness rising could be assessed and the more likely asuccess of the MM programme will be.

How is success measured?What is assessed?

Assessed is the current awareness of the addressed problems and offered solutionsamongst employees and its past development.

What data arerequired?

Number of employees, who developed an awareness for the addresses problems andoffered solutions.

How are datacollected?

Interview of employees:

„Do you know the company's Mobility Coordinator?

If YES, How did you learn about him/her?What is his/her task?

Do you know about the measures of the company' MM programme?

If YES, please name those measures you know.“

Target value andtime frame

X % awareness of problems and solutions amongst the employees after 1 year,Y % awareness of problems and solutions amongst the employees after 3 years.

What data areavailable?

-

Former development of indicatorA former survey of the staff council addressed problems of the company's accessibility for staff, customers,visitors and suppliers. Can results be used?

What else should be taken into account?Note Give employees the chance to report their own view of problems additionally to what is

addressed by the MM programme.

Backgroundinformation

Due to residents' protests paid parking is planned in the company's proximity. This willlead to an increased use of public transport.


EvaMM

Timo Finke




Use of MM-Services



Permanent alternative travel behaviour


Start of alternative travel behaviour

Intention to change behaviour

A

B

C

D

E

F

G

M1

M2

Traffic impacts to be achieved:reduced motorised trips: 11.000 p.a.= reduction of 50 parking lots

Set target:Reduction of CO

2

emissions: 40 tons p.a.

80% of employees knowproblems and solutions

80% of those who developed an awareness for the problems

80% of those who plan to changetheir travel behaviour

90% of users are satisfied

120 employees accept theoffered alternatives

55 employees change permanently

90% of those who changed theirtravel beaviour are satisfied

100 employees start to changetheir travel behaviour

50% of those who acceptedpersonal responsibility

EvaluationPlan Specify indicators and measurable targetsIV


EvaMM

Timo Finke


Monitoring Record input and outputV

Input

Record of all ressources used based on the principles of cost and activity accounting.

Output

Record of all measures and products provided.

Info

rmat

ion

Kind of service provided Start-time End-time

X PT info 08 : 15 08 : 17

X Bike rental 08 : 19 08 : 23

X Railway ticket 08 : 24 08 : 27

X Carsharing 08 : 31 08 : 46

Co

nsu

ltin

g

Sal

e

Res

erva

tio

n

Oth

er

X Lost properties 08 : 47 08 : 49

__ : __ __ : __


EvaMM

Timo Finke


Monitoring Record framework conditionsVI

1. Record initial situation:as basis for the development of MM programme

2. Distinguish between: Changes as result of MM... demonstrate MM's success.

Changes based on factors outside MM programme... can not be influenced by MM priogramme, but might have influence on the MM programme.

Identify causality between trigger and behaviour change in surveys.


EvaMM

Timo Finke


Evaluating Assess impactsVII



Use of MM-Services



Permanent alternative travel behaviour


Start of alternative travel behaviour

Intention to change behaviour

A

B

C

D

E

F

G

M1

M2

Impacts achieved by MM:- transport related- ecological- individual

Share of those who are aware ofproblems and offered solution.

Share of those who accepttheir own responsibility.

Share of those who useMM services.

Share of those who aresatisfied with MM services.

Share of those who acceptthe offered alternatives.

Share of those who practise newtravel behaviour permanently.

Share of those who changed their travelbehaviour and are satisfied with it.

Share of those who starta new travel behaviour.

Share of those who intend tochange their own travel bahaviour.


EvaMM

Timo Finke


Evaluating Evaluate successVIII

Effectiveness• Collection of achieved impacts• Comparison of measurable targets and achieved performance (target-performance comparison) for

Output Impacts

Efficiency• Collection of consumed ressources• Comparison of available ressources with measurable

targets• Evaluate achieved results vs. consumed ressources for

Output (costs per service unit) Changes in framework conditions Impacts (costs per impact unit)


EvaMM

Timo Finke


EvaMM step by step

Monitoring

Evaluating

EvaluationPlan

Name and describe target groups

Specify indicators & measurable targets

Record input and output

Record framework conditions

Assess impacts

Evaluate success

Specify MM-measures

Formulate mission statementI

V

VI

VII

VIII

II

III

IV

Evaluation Report


EvaMM

Timo Finke


Guidelines for the

Evaluation of Mobility Management Programmes

EvaMM

Thank you!

Timo Finke

Department of Traffic ManagementCity of Düsseldorf

Documents

Guidelines for the Evaluation von MM Programmes EvaMM Timo Finke RUTH Guidelines for the Evaluation of Mobility Management Programmes EvaMM Handlungsleitfaden