64
Train punctuality: the passenger perspective November 2015

Train punctuality: the passenger perspectived3cez36w5wymxj.cloudfront.net/migrated/Train... · towards punctuality targets. There was a strong view that passengers travelling on a

  • Upload
    others

  • View
    32

  • Download
    0

Embed Size (px)

Citation preview

Train punctuality: the passenger perspective

November 2015

1

ContentsForeword 1

Key findings 2

Transport Focus conclusions and recommendations3

2

3

6

8

Train punctuality: the passenger perspective1

Office of Rail and Road conclusions 4

Punctuality performance measurement 115

Background, objectives and methodology 12Passengers’ top of mind views on train performance 17Reaction to PPM and CaSL performance measures 22Speed, punctuality, frequency trade-offs 35Performance measurement trade-off exercises 41Summary 49

Punctuality and passenger satisfaction 536

2

Foreword

As part of this push to give more weight in the process to passengers’ perspectives, Transport Focus and

the Office of Rail and Road (ORR) have co-funded twostudies to understand more about passengers’ views on train punctuality. The first is new qualitative researchinto views about train performance – punctuality andcancellations – and how it should be measured. Thesecond is a quantitative analysis of the relationshipbetween a passenger’s actual punctuality and theirsatisfaction with the journey in question.

The research involved 10 focus groups acrossEngland, Scotland and Wales in March 2015 (takingplace in Cardiff, Glasgow, London and Manchester). Thepassengers taking part reflected a cross-section of age,gender and socio-demographics, as well as differentsegments of the rail market. Meanwhile the quantitativeanalysis looked at the relationship between actualpunctuality experienced and how satisfied 10,849 AbellioGreater Anglia passengers were when they took part in

the National Rail Passenger Survey (NRPS) between2012 and 2014. It is clear from both studies that greaterfocus on punctuality will be needed to deliver whatpassengers expect in the five years from 2019 (railwayControl Period 6, or CP6). The key findings of the twostudies are set out below, followed by the conclusionsand recommendations that Transport Focus and ORReach draw from them.

We hope that this report will help support the process of determining the Control Period 6 passengerperformance targets and ensuring that they focus onpassengers’ needs.

Anthony Smith Richard PriceChief Executive Chief ExecutiveTransport Focus Office of Rail and Road

The process to determine what Britain’s railways should deliver in the five yearsfrom 2019 is already underway. It is vital that passengers’ views are at the heartof the process – and with passengers paying over 60 per cent of the cost of therailway through fares, their views must count in decisions on how rail serviceimprovements and investments are prioritised.

Train punctuality: the passenger perspective1

3

Key findings from the passenger researchThe full research report by Illuminas is included in thisdocument as section 5. The key findings are:

• Passengers in the focus groups saw a punctual service as thekey success criterion for their journey. They saw performancemeasurement as an important part of ensuring that railcompanies focus sufficiently on punctuality. Punctuality is avital prerequisite for building trust between passengers and a train company.

• In general, passengers want a tougher Public PerformanceMeasure (PPM) target, but feel that the Cancellations andSignificant Lateness (CaSL) target is more reasonable. Oncemade aware of how PPM is calculated, passengers oftenregarded a very high target as not unreasonable – given thefive minutes ‘grace’ (10 minutes for long-distance trains) for a train to be considered ‘on time’ by the industry. Thepassengers also suspected that the current target level of 92.5 per cent is regarded as a ceiling rather than a minimum.Some argued that an industry focused on its customers should always aim to deliver 100 per cent, even if it is never achieved.

• Some passengers suggested that a ‘significantly late’ trainshould be 10 minutes for short-distance and 20 minutes forlong-distance, which is a tighter definition than the 30 minutescurrently used by the industry. For some, combining

cancellations and significant lateness was confusing.Passengers in the Glasgow groups could not understand why there is no CaSL target in Scotland.

• Passengers in the focus groups defined ‘on time’ as beingwithin one minute of scheduled time, although some wouldaccept leeway of one or two minutes. The passengers believedpunctuality should be measured at all stations, not just where a train terminates. There was low awareness of the currentperformance measures and lack of trust in how the rail industrymeasures punctuality. Once aware of how PPM is calculated,the passengers felt it offered the rail industry too muchflexibility in meeting targets they already regarded as too low; it also confirmed their suspicions about statistics generally, in that a train that is late can count as ‘on time’.

• The research explored if it would be better to measure theproportion of passengers who arrive on time, rather than the proportion of trains that are on time. Some commuters in the focus groups found this attractive, recognising that there would be greater incentive for train companies to runtheir trains punctually. On balance, however, passengers in the focus groups felt that all trains should count equallytowards punctuality targets. There was a strong view thatpassengers travelling on a lightly-loaded train should not be treated as less important when it comes to focus onpunctuality.

Train punctuality: the passenger perspective2

4

Trade-offsVarious ‘trade-offs’, described below, were explored in theresearch. Significantly, passengers in the focus groups felt that if the railway is properly-planned, properly-maintained and properly-run it should not be necessary to make trade-offs between thequality of different aspects of their journey. Many passengers felt that not striving to deliver on all fronts is an example of thecustomers interest being insufficiently to the fore of rail industrythinking. Three key points emerged:• Punctuality versus speed and frequency. Overall, the

preference expressed was for trains to be more punctualrather than faster or more frequent. There were exceptions:on very long-distance trips journey time reduction isimportant, as is frequency to some leisure passengers.

• Punctuality versus fewer cancellations and days ofwidespread disruption. Commuters regarded punctuality as the priority because it affects them twice a day every day, whereas leisure and business passengers felt that ashort delay has less impact on them than a cancellation.

• Punctuality versus running an extra train. Most sawpunctuality as more important than seeking to run an extratrain. This was particularly true of commuters, unless theyexperienced crowding that prevented them from getting on the train at all.

Other findings• Many passengers taking part in the research felt it is not

acceptable for train companies to add extra time into thetimetable on approach to the destination station. Those whothought managing expectations in this way was acceptableoften observed that it would be more honest if the extra time was distributed throughout the journey.

• On very high frequency routes, for example with 10 trains per hour or more, the idea of measuring the interval betweentrains (rather than measuring each train at its destination)found favour with most passengers. However some still feltthat trains should be measured against the timetable even in these circumstances.

• Passengers in the research favoured the current approach by some train companies of adjusting the timetable in theautumn leaf-fall season to deliver a predictable, reliableservice, even if journey times are slightly extended.

• There was strong opposition to the current practice that a train cancelled before 22:00 the day before does not count as a cancellation in official statistics.

Passengers were presented with what some regarded as a trickydilemma. Namely, whether – on a day of widespread disruption – the rail industry should seek to reinstate the normal timetableas quickly as possible, even if there is short-term disadvantageto some passengers as a result. The sort of things that might be done include: trains missing out stations so the next journeyruns on time; cancelling a train so the next one runs on time; and terminating trains before the normal destination so most ofthe next trip runs on time. While the effect of the focus groupenvironment may have influenced the responses given in front of peers, many participants felt it was fairer to ‘spread the pain’than cause disadvantage to some for the ‘greater good’.However, passengers in London felt that short-term disruption to restore the timetable was reasonable because alternatives are more likely to exist for those affected.

Train punctuality: the passenger perspective2

5

The executive summary of the report by consultantsGHD is included as section 6.

This analysis updated work Transport Focus published in 20101

examining the relationship between actual train performance andpassenger satisfaction. The 2015 work looked at the actualpunctuality experienced by 10,849 Abellio Greater Anglia passengerswho took part in the National Rail Passenger Survey (NRPS)between 2012 and 2014. We are grateful to Abellio Greater Angliafor their co-operation in providing detailed train performanceinformation for the three years in question.

The key findings are:• 82 per cent of passengers were satisfied with punctuality

when their train arrived early or within 59 seconds of the timegiven in the public timetable. This varies by journey purpose:75 per cent of commuters were satisfied with punctualitywhen on time or early, while 94 per cent of leisurepassengers and 91 per cent of business passengers weresatisfied with punctuality when on time. A possible reason forthe variation is that commuters’ assessment of punctuality‘today’ is affected by past experience – and, put simply,commuters have more ‘past experience’ than leisure andbusiness passengers. The effect of cancellations may alsohave a marginal effect. For example where a passenger’sintended train is cancelled and they catch the next one – thepassenger is late but the train they travelled on is on time.

• For every minute of lateness (that is, after scheduled arrivaltime), passenger satisfaction with punctuality declined by threepercentage points. This also varies by journey purpose: commutersatisfaction declined by five percentage points per minute oflateness, while among leisure passengers the decline was onepercentage point per minute. Therefore a significant degree of passenger satisfaction is ‘lost’ when trains are officially ‘ontime’ according to the industry measure of PPM, but late inpassengers’ eyes. For example, passengers travelling on a train

that arrives four minutes 59 seconds late – ‘on time’ accordingto PPM – will record satisfaction with punctuality over 12percentage points lower than had that train been truly on time.

• For every minute of lateness, overall satisfaction declines by oneand a half percentage points. Among commuters the decline in overall satisfaction is steeper at three percentage points perminute of lateness. Therefore overall satisfaction on a train thatis four minutes 59 seconds late – that is, on time according to PPM – will have fallen by over six percentage points.

• On trains leaving London (where the majority of passengersare likely to get off before the train’s terminating station), 56 per cent of passengers arrived at their station on time or early. This compares with 69 per cent of trains reachingtheir destination on time.

Key findings from analysis of the relationship between punctualityand passenger satisfaction

1What passengers want – Towards a ‘right time’ East Anglian railwayhttp://www.transportfocus.org.uk/research/publications/what-passengers-want-towards-a-right-time-east-anglian-railway

6

Train punctuality: the passenger perspective3

2Presenting ‘right-time’ performance information to rail passengers, May 2013http://www.transportfocus.org.uk/research/publications/presenting-righttime-performance-information-to-rail-passengers

Transport Focusconclusions and recommendationsThe overall conclusion Transport Focus draws from this researchand analysis is that a key strategic focus for Control Period 6must be on delivering a railway that is markedly more punctualthan at present. That is, markedly more punctual in the waypassengers understand punctuality – on time to within a minuteof the timetable (‘right time’, as the rail industry calls it). Unlessan incident is specifically disrupting the service, passengersshould arrive ‘right time’ significantly more often than nowwherever they get off. Trains which never run on time, or whichare late more often than not, must become a thing of the past.And we note that it can be done: Arriva Trains Wales, ChilternRailways and c2c regularly achieve a ‘right time’ arrival score of over 80 per cent.

The research shows that passengers want a robust,dependable timetable so they arrive on time at their destination.It appears that passengers – particularly commuters – are moreinterested in arriving punctually than in how long the journeytakes or in the industry striving to run extra trains. There areexceptions: there is appetite for reduced journey time on verylong-distance trips; for having more trains on routes with lowfrequencies; and for extra trains among commuters who strugglejust to get on the train – never mind getting a seat. It should bekept in mind that this is qualitative research, but it suggests thatpassengers do not want a ‘fudge’ where the timetable just aboutworks on paper, but rarely if ever in practice. This should beexplored further in quantitative research.

It is clear that punctuality measured by the PublicPerformance Measure (PPM) does not accurately reflectpassengers’ experience, mainly because of the five or 10 minute leeway and because trains are measured only at theirdestination. PPM also undermines trust: counting trains as ontime when they are late plays badly to passengers, many ofwhom are already suspicious of statistics from their traincompany. Transport Focus therefore advocates a move awayfrom PPM as the single regulatory measure of train punctuality.Continuing for another five years with a regime where late isconsidered ‘OK’ is simply not tenable. But Transport Focusrecognises that moving instead to a single pass/fail measure of‘arrival within 59 seconds’ could have unintended consequences.Might the answer be targets to encourage movement of thewhole ‘arrivals curve’ (example below) to the left on the graph,incentivising better ‘right time’ performance, but also givingincentives to achieve a three minute delay rather than a fourminute delay, or a nine minute delay rather than an 11 minutedelay and so on?

The industry needs to determine how punctuality should bemeasured at intermediate stations and then reflected in theregulatory targets. A new metric could try to combine punctualityat destination with that at some or all intermediate stations. Itwould be more difficult to explain, but it might focus attention onwhat really matters to passengers. If accompanied by completetransparency about performance, passengers would still be ableto see how their trains performed, but the metric would bedifficult to explain to passengers and staff – potentially limiting its effectiveness as a tool to drive improvement.

Example of an ‘arrivals curve’

Pro

po

rtio

n o

f tr

ain

s

Lateness in minutes

30%

25%

20%

15%

10%

5%

0%-5 -3 -1 1 3 5 7 9 11 13 15 17 19 21 23 25 27

7

Control Period 6 should seek to deliver better punctuality for commuters – but not at the expense of giving train companiesless incentive to run off-peak trains on time. The fact that poorpeak punctuality can currently be off-set by good off-peakperformance should be addressed, but not by creating theopposite problem. Would setting a target for peak trains, as wellas for the timetable as a whole, be a way to increase focus ontrains carrying a large numbers of commuters, without riskingperverse incentives elsewhere?

A single pass/fail measure does not paint a full picture. A trainwith a 'right time' record of zero might arrive within two minuteson every occasion - but equally it might always be nine minuteslate. It should therefore be made easy for a passenger to see agraduated picture of how often their train is ‘right time’, arriveswithin two minutes, three minutes, four minutes and so on. Thiswould give a richer, more rounded view of train punctuality to both passengers and commentators.

The definition of ‘significant lateness’ within the Cancellationsand Significant Lateness (CaSL) measure should be reviewed for Control Period 6. To passengers, particularly those makingshort journeys, a train becomes significantly late after less than30 minutes delay. Separately, the target for CaSL should bereduced further for long-distance operators. Passengers makinglong-distance leisure and business trips said cancellations causethem more trouble than late running, yet the target for VirginTrains (that is, Intercity West Coast) and Virgin Trains East Coast is more forgiving than for other operators. A CaSL target should also beconsidered for Scotland.

The industry shouldconsider how underlyingpunctuality can be measuredand better understood – thatis, on days when there havebeen no specific incidents.Perhaps this could beachieved by tracking ‘righttime’ performance on the ninebest days in every 10 (with theleast good removed)? Orperhaps by tracking ‘right time’punctuality on days when thereare very few cancellations orsignificantly late trains (as a proxy for the absence of disruption)?

Finally, in looking forward to 2019 the industry shouldconsider if the level of punctuality required by previous High LevelOutput Specifications has been insufficiently ambitious to driveradical thinking and innovation. If the governments and regulatorwere to seek substantially higher performance in Control Period 6and beyond, could it be the catalyst for fundamental change thatwould ultimately lead to exceptionally high levels of punctualityand highly efficient use of track, station and fleet capacity?

Summary• When it comes to performance, a main objective for 2019-

2024 should be to markedly improve true ‘on time’ punctualityacross the rail network, including at intermediate stations. That means robust timetables that are neither overly heroic nor excessively padded. It means accurate sectional runningtimes and accurate station dwell times.

• Transport Focus advocates a move away from PPM as thesole measure of success. It is not trusted by passengers anddoes not drive sufficient focus on punctuality as passengersdefine it.

• Whatever replaces PPM must strongly incentivise ‘right time’punctuality, but seek to avoid unintended consequences ofhaving a different, more demanding, sole measure of success.The industry should investigate if targets could be developedthat would incentivise better performance generally, including‘right time’. How can the industry be incentivised in ControlPeriod 6 to move the whole ‘arrivals curve’ to the left on thegraph?

• Whatever the chosen metric, there should be a separatepunctuality target for peak services to incentivise the industryto get commuters to and from work on time. Givenpassengers’ concerns about reducing the incentive to run off-peak trains on time, this is preferable to weighting trains by volume of passengers within punctuality statistics.

• To give a more meaningful picture of punctuality, the industryshould make it easy for passengers to see a graduated pictureof how often their train (or group of trains) is ‘right time’, within two minutes, three minutes, four minutes and so on.

• The industry must become properly transparent and granularwith all performance information – and through the ‘front door’via train company websites and apps. If a passenger uses onlythe ‘07:29’ and the ‘18:17’, data for those trains alone shouldbe readily available to them. The industry did not respondeffectively to recommendations following research in 20132

(funded jointly by Transport Focus, ORR and National RailEnquiries) and it should now do so.

• There should be a review of the Cancellations and SignificantLateness (CaSL) measure and targets with a view to: reducingthe definition of ‘significant lateness’, particularly for short-distance journeys; further tightening the target forlong-distance train companies; and Transport Scotland shouldconsider specifying a CaSL measure in Control Period 6.

• The industry should tackle causes of distrust in statistics by:eliminating differences between the public timetable and the working timetable; reforming the system wherebycancellations made before 22:00 the day before do not countas cancellations in statistics; and being transparent about the number of days on which a formal amended timetable (one involving fewer trains running than normal) operated and about the number of trains involved.

As the regulator for rail in Great Britain, we want to ensure thatpassengers are at the heart of Britain’s railways and we are keen to see improvements in the levels of punctuality and reliability forpassengers achieved by the industry to the greatest extent possiblewith the funding available. These studies are an important startingpoint as part of our preparations for Control Period 6 (CP6).

The qualitative study reflects the views of 80 passengers using therail network. Their views provide us and the industry with a valuableinsight into the priorities of different passenger groups, their level ofawareness of performance targets and how they understand andinterpret the existing performance measures. The quantitative analysisis useful in helping the industry better understand the real relationshipbetween actual train performance and passenger satisfaction, althoughit must be noted that the results for Abellio Greater Anglia passengersmay not be reflective of all train passengers, especially those usingdifferent types of services, e.g. long distance.

ORR is working to get the best deal for passenger and taxpayers.ORR’s role is to create incentives and set targets for passenger

punctuality and reliability that reflect the interests of both governmentand the passenger (and recognising also the role of freight operators).We must develop a framework that genuinely encourages NetworkRail and the industry to deliver improvements in punctuality, and which also aligns the objectives of train operators and Network Rail.

We are pleased that the industry National Task Force (NTF) isleading a review of the existing measures and generating alternativeoptions for CP6 and that it has found these studies useful in thatprocess. We would like the industry to deliver an outcome thatprovides the industry with measures which drive the right behaviours,which government would feel comfortable using for setting its highlevel targets for the industry and for its train operator franchises, and which we could then also use to set the regulatory targets forholding Network Rail to account.

We particularly welcome that the industry has taken on board the need to provide passengers with more accessible and transparentinformation about punctuality. The National Task Force has endorseda “My Journey” work stream to make additional information available

Office of Rail and Roadconclusions

8

Train punctuality: the passenger perspective4

to passengers about the reliability of their individual journeys. We willmonitor progress with this work.

Before introduction of any new industry punctuality and reliabilitymeasure, there are a range of options and features now underdiscussion, in part informed by these studies and also from industrydiscussion and debate. This includes measurement to ‘right time’(arrival within one minute of scheduled time), measurement at everystation, use of banding, and some sort of passenger weighting. We consider that it is likely that we will need to achieve a balance of these desirable features across a small number of measures,rather than seeking to achieve one single measure which reflects all the features identified.

The assessment by the industry, by government, and by us of anypotential new industry measures must be a carefully considered oneand so we do not propose to make recommendations as to particularmeasures at this stage. We particularly want to understand how anynew measure would translate into management behaviour in the dayto day operation of the railway, and also in how the railway is planned

and timetabled, so that any unwanted outcomes are avoided. Forexample a ‘right time’ measure has the potential to result in extendedjourney times as a result of longer station dwell times to enablegreater volumes and different types of passengers to get on and offthe train. We must take into account the impact of any changes topassenger punctuality measures on the freight market (and vice versa).

There is merit in continuing to measure PPM for comparison andcontinuity purposes, as this is a measure that has been in place for a number of years. New measures, which may help the industryaddress the issues raised by these studies, could require improvementsin technology (or the availability or distribution of technology on thenetwork). We believe we must not be limited by the currenttechnology but set the industry on a path that enables the importantnew technology on the horizon, such as GPS train fitment and smartticketing, to be utilized to further improve measures over time.

We are acutely aware that there is a very difficult balance to strike between a comprehensive measure that captures all elementsof punctuality and one that is transparent and easy for users tounderstand.

The NTF is leading an industry trial of a selection of newmeasures over the coming months, and we are eager to see theoutcome of this trial. We consider that there needs to be flexibility to develop a strong set of measures that would meet the criteria set out above. We do not consider it necessary to wait until the nextControl Period to implement a new measure or set of measures.

In terms of next steps, we will continue to engage with the NTF workstream, while developing our views on what the regulatedoutputs will be. This will inform our initial Periodic Review 2018(PR18) consultation early in 2016, and wider consultation which we intend to carry out in relation to outputs around that time.

We look forward to continuing to work with the industry todevelop proposals in this area.

9

10

11

Pre

pare

d in

com

plia

nce

with

the

Inte

rnat

iona

l qua

lity

stan

dard

cov

erin

g m

arke

t res

earc

h, IS

O 2

0252

(201

2), T

he M

RS

Cod

e of

Con

duct

, and

the

Dat

a P

rote

ctio

n A

ct 1

998

by Il

lum

inas

, 183

-203

Eve

rsho

lt S

treet

, Lon

don

NW

1 1B

U, U

K

T +4

4 (0

)20

7909

092

9 F

+44

(0)2

0 79

09 0

921

E in

fo@

illum

inas

-gl

obal

.com

w

ww

.illu

min

as-g

loba

l.com

PREP

AR

ED B

Y IL

LUM

INA

S a

glob

al te

am b

ased

in L

ondo

n, N

ew Y

ork

and

Aus

tin

Punc

tual

ity p

erfo

rman

ce m

easu

rem

ent

Res

earc

h D

ebrie

f

Prep

ared

for:

Tra

nspo

rt F

ocus

D

ate:

8th

Apr

il 20

15

12

Bac

kgro

und,

obj

ectiv

es a

nd

met

hodo

logy

13

Bac

kgro

und

Trai

n pe

rform

ance

in B

ritai

n is

sub

ject

to a

num

ber o

f qua

lity

serv

ice

targ

ets

cove

ring

a ra

nge

of a

spec

ts o

f the

ser

vice

whi

ch th

e ra

ilway

s pr

ovid

e

Thes

e ta

rget

s ar

e se

t by

a pr

oces

s in

volv

ing

the

Offi

ce o

f Rai

l and

Roa

d (O

RR

), th

e ra

il in

dust

ry it

self

and

the

Wes

tmin

ster

and

Edi

nbur

gh

gove

rnm

ents

. The

se b

odie

s ar

e ab

out t

o be

gin

a re

view

pro

cess

that

will

le

ad to

the

prod

uctio

n of

a s

et o

f Hig

h Le

vel O

utpu

t Spe

cific

atio

ns th

at w

ill

incl

ude

targ

ets

for t

rain

per

form

ance

from

201

9 to

202

4

To h

elp

info

rm th

e de

velo

pmen

t of t

hese

targ

ets,

Tra

nspo

rt Fo

cus

and

the

OR

R h

ave

com

mis

sion

ed re

sear

ch to

ens

ure

that

pas

seng

ers’

prio

ritie

s fo

r tra

in p

erfo

rman

ce a

re c

lear

ly u

nder

stoo

d an

d in

form

the

abov

e pr

oces

s

14

The

obje

ctiv

es o

f the

rese

arch

are

to e

stab

lish

wha

t pas

seng

ers

know

abo

ut ra

il pe

rform

ance

mea

sure

men

t an

d to

iden

tify

thei

r asp

iratio

ns fo

r how

(and

wha

t ele

men

ts o

f) pe

rform

ance

sho

uld

be m

easu

red

in th

e fu

ture

Key

obj

ectiv

es fo

r the

rese

arch

are

to u

nder

stan

d:

How

pas

seng

ers

judg

e tra

in c

ompa

nies

’ ‘pe

rform

ance

’ P

asse

nger

s’ e

xper

ienc

e of

dis

rupt

ion

incl

udin

g de

lays

, can

cella

tions

, div

ersi

ons,

sho

rt-fo

rmat

ions

, etc

H

ow th

ese

expe

rienc

es tr

ansl

ate

into

pas

seng

ers’

ass

essm

ent o

f the

railw

ay’s

‘per

form

ance

’ P

asse

nger

s’ k

now

ledg

e an

d un

ders

tand

ing

of h

ow p

erfo

rman

ce is

cur

rent

ly m

easu

red

offic

ially

P

asse

nger

s’ u

nder

stan

ding

of a

nd re

actio

ns to

the

Pub

lic P

erfo

rman

ce M

easu

re a

nd th

e ge

nera

l con

cept

of

‘lat

enes

s’

Pas

seng

ers’

und

erst

andi

ng o

f and

reac

tions

to th

e C

ance

llatio

ns a

nd S

igni

fican

t Lat

enes

s M

easu

re

The

exte

nt to

whi

ch p

asse

nger

s un

ders

tand

and

are

pre

pare

d to

mak

e al

low

ance

s fo

r the

inte

r-re

latio

nshi

p of

ser

vice

freq

uenc

y, jo

urne

y tim

e (s

peed

), ca

paci

ty (a

vaila

bilit

y of

sea

ts) a

nd p

erfo

rman

ce

Inte

rest

am

ongs

t pas

seng

ers

in h

avin

g of

ficia

l per

form

ance

mea

sure

s pu

blis

hed

and

avai

labl

e fo

r pub

lic

scru

tiny

Diff

eren

ces

in u

nder

stan

ding

and

exp

ecta

tions

by

pass

enge

r typ

e, jo

urne

y pu

rpos

e, jo

urne

y di

stan

ce,

serv

ice

frequ

ency

, etc

Th

e im

pact

of p

oor p

erfo

rman

ce o

n pa

ssen

gers

’ tru

st in

the

railw

ays

and/

or s

peci

fic T

rain

Ope

ratin

g C

ompa

nies

(TO

C)

Wha

t crit

eria

sho

uld

form

the

basi

s of

any

qua

ntita

tive

asse

ssm

ent o

f pas

seng

er p

erce

ptio

ns o

f TO

C

perfo

rman

ce.

Obj

ectiv

es

15

Met

hodo

logy

Ten

qual

itativ

e fo

cus

grou

ps w

ere

cond

ucte

d ac

ross

four

loca

tions

: Lo

ndon

D

erby

G

lasg

ow

Car

diff

Four

focu

s gr

oups

wer

e co

nduc

ted

in L

ondo

n an

d tw

o in

eac

h of

the

othe

r loc

atio

ns:

Two

of th

e gr

oups

in L

ondo

n sa

mpl

ed A

belli

o G

reat

er A

nglia

pas

seng

ers

only.

Thi

s w

as s

o th

at th

e fin

ding

s of

thes

e gr

oups

can

be

cons

ider

ed a

long

side

a s

epar

ate

stud

y th

at T

rans

port

Focu

s an

d O

RR

hav

e co

mm

issi

oned

look

ing

at th

e im

pact

of a

ctua

l del

ay e

xper

ienc

ed b

y pa

ssen

gers

on

how

th

ey a

nsw

er p

artic

ular

Nat

iona

l Rai

l Pas

seng

er S

urve

y qu

estio

ns. F

or th

at e

xerc

ise

Abe

llio

Gre

ater

A

nglia

has

bee

n us

ed a

s a

case

stu

dy.

Eac

h fo

cus

grou

p co

ntai

ned

eigh

t res

pond

ents

who

use

d th

e tra

in fo

r eith

er c

omm

utin

g or

bus

ines

s/le

isur

e pu

rpos

es

Res

pond

ents

wer

e al

so c

ateg

oris

ed b

y ag

e an

d so

cio-

dem

ogra

phic

s.

16

Gro

up d

iscu

ssio

n pr

ogra

mm

e

The

focu

s gr

oup

disc

ussi

on p

rogr

amm

e is

det

aile

d be

low

:

LOCA

TIO

N

DEM

OG

RAPH

ICS

& T

RAIN

USA

GE

TRA

IN U

SAG

E

Lond

on

Youn

ger,

C1C

2D

Com

mut

er

Old

er,

ABC1

Bu

sine

ss/L

eisu

re

Lond

on (

Abel

lio G

reat

er A

nglia

pass

enge

rs)

Youn

ger,

ABC

1 Bu

sine

ss/L

eisu

re

Old

er,

C1C2

D

Com

mut

er

Man

ches

ter

Youn

ger,

C1C

2D

Busi

ness

/Lei

sure

Old

er,

ABC1

Co

mm

uter

Card

iff

Youn

ger,

ABC

1 Co

mm

uter

Old

er,

C1C2

D

Busi

ness

/Lei

sure

Gla

sgow

Yo

unge

r, C

1C2D

Co

mm

uter

Old

er,

ABC1

Bu

sine

ss/L

eisu

re

Focu

s gr

oups

took

pla

ce w

eeks

com

men

cing

9 a

nd 1

6 M

arch

201

5.

Methodology

Ten qualitative focus groups were conducted across four locations: London Derby Glasgow Cardiff

Four focus groups were conducted in London and two in each of the other locations: Two of the groups in London sampled Abellio Greater Anglia passengers only. This was so that the findings of these groups can be considered alongside a separate study that Transport Focus and ORR have commissioned looking at the impact of actual delay experienced by passengers on how they answer particular National Rail Passenger Survey questions. For that exercise Abellio Greater Anglia has been used as a case study.

Each focus group contained eight respondents who used the train for either commuting or business/leisure purposes

Respondents were also categorised by age and socio-demographics.

6

17

Pas

seng

ers’

top

of m

ind

view

s on

trai

n pe

rform

ance

18

Wha

t mak

es fo

r a “s

ucce

ssfu

l” jo

urne

y?

Rel

iabi

lity

is p

asse

nger

s’ m

inim

um re

quire

men

t fro

m th

eir t

rain

ser

vice

P

asse

nger

s de

fine

relia

bilit

y pr

imar

ily in

term

s of

pun

ctua

lity

and

seco

ndar

ily in

term

s of

not

bei

ng

canc

elle

d or

dis

rupt

ed (r

efle

ctin

g th

e fre

quen

cy w

ith w

hich

thes

e is

sues

are

typi

cally

exp

erie

nced

)

Pun

ctua

l ser

vice

Sta

tion

envi

ronm

ent

Trai

n en

viro

nmen

t

Get

ting

a se

at

Oth

er th

an a

relia

ble

serv

ice,

a ra

nge

of

addi

tiona

l fac

tors

info

rm p

asse

nger

s’

asse

ssm

ent o

f wha

t mak

es fo

r a s

ucce

ssfu

l jo

urne

y Th

ese

fact

ors,

suc

h as

get

ting

a se

at a

s w

ell a

s a

clea

n an

d sa

fe e

nviro

nmen

t on

the

train

and

at

the

stat

ion,

can

enh

ance

the

exte

nt to

whi

ch th

e jo

urne

y is

rate

d po

sitiv

ely

But

thes

e fa

ctor

s al

one

(i.e.

in th

e ab

senc

e of

a

punc

tual

ser

vice

) will

not

resu

lt in

a s

ucce

ssfu

l jo

urne

y

The

impo

rtanc

e of

thes

e fa

ctor

s of

cou

rse

varie

s by

jour

ney

type

Fo

r exa

mpl

e on

a lo

nger

dis

tanc

e bu

sine

ss/le

isur

e jo

urne

y, g

ettin

g a

seat

is a

lmos

t exp

ecte

d an

d th

e la

ck o

f it c

an s

ever

ely

influ

ence

sat

isfa

ctio

n H

owev

er, o

n a

shor

ter c

omm

uter

trip

in p

eak

hour

s pa

ssen

gers

do

not n

eces

saril

y ex

pect

to g

et a

se

at, s

o ge

tting

one

can

cre

ate

cons

ider

able

del

ight

.

Hyg

iene

fa

ctor

s

Qua

lity

driv

ers

Sta

ff

19

Ove

rall,

pas

seng

ers’

sat

isfa

ctio

n w

ith th

e le

vel o

f del

ay, d

isru

ptio

n an

d ca

ncel

latio

ns is

not

esp

ecia

lly

poor

H

owev

er, e

xper

ienc

es d

o va

ry b

y pa

ssen

ger t

ype

CO

MM

UTE

R

Del

ays

tend

to b

e m

inor

but

freq

uent

Fo

r exa

mpl

e, 2

-3 m

inut

e de

lays

se

vera

l tim

es p

er w

eek

Few

can

cella

tions

, but

sho

rt fo

rmat

ions

no

t unc

omm

on

NB

: Due

to th

e gr

oup

envi

ronm

ent a

n el

emen

t of o

ver c

laim

may

exi

st

BU

SIN

ESS/

LEIS

UR

E D

elay

s, c

ance

llatio

ns a

nd d

isru

ptio

n ar

e ra

re

Mos

t can

reca

ll at

leas

t one

“hor

ror s

tory

” of

a jo

urne

y, th

ough

this

was

not

ne

cess

arily

rece

nt

RU

RA

L LI

NES

D

elay

s an

d ca

ncel

latio

ns o

ccur

mor

e of

ten

durin

g ‘b

ad’ w

eath

er

Inst

ance

s of

trai

ns n

ot s

topp

ing

at

sche

dule

d st

atio

ns

Wee

kend

ser

vice

ofte

n no

n-ex

iste

nt o

r re

duce

d in

freq

uenc

y

GLA

SGO

W

Pas

seng

ers

in G

lasg

ow fe

el th

e nu

mbe

r of

min

or d

elay

s an

d ca

ncel

latio

ns is

hig

h an

d th

at th

e se

rvic

e is

infe

rior c

ompa

red

with

oth

er p

arts

of B

ritai

n Lo

ng d

elay

s ar

e ra

re, w

ith tr

ains

eith

er

2-3

min

utes

late

or c

ance

lled

outri

ght

NB

: oth

er T

rans

port

Focu

s re

sear

ch in

S

cotla

nd s

how

ed a

bel

ief t

hat S

cotR

ail i

s to

o ca

utio

us a

nd in

clin

ed to

can

cel

serv

ices

at t

he ‘f

irst s

ign

of a

sno

wfla

ke’

“The

boa

rd w

ill s

ay th

at th

e tra

in is

del

ayed

by

thre

e m

inut

es, a

nd th

en it

will

just

cha

nge

to c

ance

lled,

ther

e is

not

hing

in b

etw

een.

” G

lasg

ow g

roup

, Com

mut

er, Y

oung

er.

Exp

erie

nce

of d

elay

s, d

isru

ptio

n an

d ca

ncel

latio

ns is

mix

ed

20

Pas

seng

ers

assu

me

that

per

form

ance

is m

easu

red

prim

arily

in te

rms

of p

unct

ualit

y, a

lthou

gh th

ey

have

no

defin

itive

kno

wle

dge

of th

is

Mos

t stru

ggle

to re

call

havi

ng h

eard

or s

een

anyt

hing

abo

ut p

erfo

rman

ce m

easu

rem

ent

Ref

er to

/mak

e co

mm

ent o

n m

edia

sto

ries

e.g.

: K

ings

Cro

ss C

hris

tmas

deb

acle

S

outh

ern

com

mut

er s

ervi

ce fr

om B

right

on

to V

icto

ria th

at w

as ‘l

ate

ever

y da

y’

Som

e m

entio

ns o

f pos

ters

in ra

il st

atio

ns s

how

ing

‘num

bers

of s

ome

sort’

ab

out p

unct

ualit

y P

artic

ular

ly in

Lon

don,

pas

seng

ers

quer

y th

e re

liabi

lity

of th

ese

num

bers

as

ofte

n se

em h

igh

Ther

e is

no

clea

r und

erst

andi

ng o

f who

set

s pe

rform

ance

targ

ets

It is

pre

sum

ed th

at th

is is

don

e by

the

train

com

pani

es th

emse

lves

, the

‘Gov

ernm

ent’

or ‘s

omet

hing

of

ficia

l’.

LITT

LE/N

O K

NO

WLE

DG

E SO

ME

KN

OW

LED

GE

Lim

ited

know

ledg

e of

how

per

form

ance

is a

ctua

lly m

easu

red

21

Pre

viou

s re

sear

ch*

has

high

light

ed th

e im

porta

nce

of re

liabi

lity

for t

rain

com

pani

es in

atta

inin

g an

d bu

ildin

g tru

st

Ther

e ar

e ot

her f

acto

rs in

add

ition

to re

liabi

lity

and

man

y of

thes

e ar

e la

ckin

g am

ongs

t tra

in c

ompa

nies

Th

eref

ore

pass

enge

rs a

re o

ften

cyni

cal w

hen

talk

ing

abou

t the

ext

ent t

o w

hich

they

trus

t the

ir tra

in

com

pany

C

onse

quen

tly, t

hey

are

also

pes

sim

istic

whe

n ta

lkin

g in

term

s of

rail

targ

ets;

how

they

are

set

, who

set

s th

em a

nd th

e ex

tent

to w

hich

they

are

ach

ieve

d

Rel

iabi

lity

is k

ey to

TO

Cs

build

ing

trust

Thos

e sa

tisfie

d w

ith th

e pu

nctu

ality

of t

heir

train

ser

vice

ar

e m

ore

likel

y to

trus

t the

TO

C

For c

omm

uter

s, p

unct

ualit

y is

m

ost i

mpo

rtant

to b

uild

ing

trust

, gi

ven

that

an

on-ti

me

serv

ice

is

mos

t des

ired

For b

usin

ess/

leis

ure

pass

enge

rs, e

mot

iona

l fac

tors

ar

e al

so c

ited

as b

eing

key

to

esta

blis

hing

trus

t, su

ch a

s st

aff

enga

gem

ent,

qual

ity o

f rol

ling

stoc

k an

d cu

stom

er s

ervi

ce.

“I tru

st th

e on

e th

at I

use

beca

use

they

get

me

to

wor

k on

tim

e, a

nd it

’s v

ery

impo

rtant

that

I ge

t to

wor

k on

tim

e ot

herw

ise

I’m la

te fo

r cou

rt.”

Der

by g

roup

, Com

mut

er, O

lder

.

“In te

rms

of q

ualit

y of

the

actu

al tr

ain

carr

iage

s I

thin

k V

irgin

are

way

ahe

ad a

nd th

at in

fluen

ces

my

trust

in th

em.”

Der

by g

roup

, Bus

ines

s/Le

isur

e, Y

oung

er.

* http

://w

ww

.tran

spor

tfocu

s.or

g.uk

/rese

arch

/pub

licat

ions

/pas

seng

ers-

rela

tions

hip-

with

-the-

rail-

indu

stry

22

Rea

ctio

n to

PP

M a

nd C

aSL

perfo

rman

ce m

easu

res

23

Ove

rvie

w: r

eact

ions

to tr

ain

perfo

rman

ce m

easu

res

Pas

seng

ers

know

littl

e ab

out h

ow tr

ain

perfo

rman

ce is

mea

sure

d - k

now

ledg

e of

PP

M a

nd C

aSL

non-

exis

tent

How

ever

, mea

surin

g pe

rform

ance

is s

een

as im

porta

nt a

nd th

ere

is a

n ap

petit

e fo

r lea

rnin

g ab

out h

ow it

is m

easu

red

That

sai

d, m

ost p

asse

nger

s ex

pect

that

targ

ets

will

not

be

parti

cula

rly d

eman

ding

and

tend

to g

ive

low

est

imat

es w

hen

aske

d w

hat t

hey

belie

ve ta

rget

s w

ill b

e

For C

aSL,

the

head

line

targ

et o

f 2.2

per

cen

t was

see

n as

reas

onab

le

98 p

er c

ent n

ot c

ance

lled

was

typi

cally

sug

gest

ed a

s an

asp

iratio

n A

ccep

ted

that

‘thi

ngs

happ

en’ m

eani

ng s

ome

canc

ella

tions

inev

itabl

e

PP

M le

ss w

ell r

ecei

ved

98 p

er c

ent

- 99

per c

ent p

unct

ualit

y of

ten

the

typi

cal t

arge

t sug

gest

ed

As

such

, 92.

5 pe

r cen

t tar

get f

alls

wel

l sho

rt of

idea

l (al

thou

gh n

ot a

ltoge

ther

une

xpec

ted)

O

n re

flect

ion,

aro

und

95 p

er c

ent s

een

as ‘r

ealis

tic’ t

arge

t

How

ever

, onc

e th

e de

tail

of ta

rget

s is

reve

aled

, man

y fe

el th

at th

eir ‘

wor

st s

uspi

cion

s’ h

ave

been

con

firm

ed

Do

not b

elie

ve th

at m

easu

res

accu

rate

ly re

flect

true

per

form

ance

Fi

gure

s ‘m

assa

ged’

by

gene

rous

targ

ets

and

‘loop

hole

s’

Furth

erm

ore,

man

y pa

ssen

gers

stru

ggle

to u

nder

stan

d ho

w ta

rget

s im

pact

on

thei

r jou

rney

W

heth

er a

chie

ved

or n

ot, w

hat a

re th

e co

nseq

uenc

es?

Som

e m

ake

an e

xplic

it lin

k be

twee

n co

mpe

nsat

ion

for d

elay

or c

ance

llatio

n w

ith p

erfo

rman

ce ta

rget

s or

with

fine

s an

d pe

rform

ance

targ

ets

Whi

le th

ere

are

calls

for m

ore

strin

gent

rule

s in

resp

ect o

f fin

es a

nd c

ompe

nsat

ion,

this

is a

lso

seen

as

a do

uble

-edg

ed

swor

d –

perc

eptio

n th

at u

ltim

atel

y ‘th

e pa

ssen

ger a

lway

s pa

ys’

“And

at t

he e

nd o

f the

day

if th

at w

as o

kay,

they

wou

ld te

ll yo

u w

ould

n’t t

hey?

It w

ould

be

“Her

e’s

how

we

are

m

easu

red.

..” b

ut th

ey o

bvio

usly

don

’t w

ant t

o te

ll yo

u th

at b

ecau

se e

very

body

is g

oing

to s

ay th

at’s

not

righ

t.”

Car

diff

grou

p, C

omm

uter

, You

nger

.

“It’s

a b

it of

a c

on, t

hey’

re

mea

surin

g th

ose

figur

es in

a

way

that

mak

es th

em s

how

w

hat t

hey

wan

t the

m to

sho

w,

rath

er th

an m

easu

ring

it to

id

entif

y an

d fix

pro

blem

s, to

m

ake

it ac

tual

ly a

goo

d se

rvic

e.”

Lond

on g

roup

, Com

mut

er,

You

nger

.

24

Per

form

ance

mea

sure

men

t: in

itial

exp

ecta

tions

Pas

seng

ers

expe

ct p

unct

ualit

y to

be

mea

sure

d in

det

ail a

nd b

elie

ve th

at th

e te

chno

logy

can

/sho

uld

faci

litat

e th

is

STAT

ION

TO

C

JOU

RN

EY

Eve

ry s

ervi

ce o

pera

ted

by

ever

y TO

C s

houl

d be

m

easu

red

and

publ

ishe

d

All

jour

neys

sho

uld

be

mon

itore

d an

d pu

blis

hed

Dep

artu

re/a

rriv

al ti

mes

sh

ould

be

mea

sure

d fo

r ev

ery

train

sto

ppin

g at

eve

ry

stat

ion

Som

e su

gges

t a s

ampl

ing

appr

oach

as

long

as

the

sam

ple

still

mea

sure

d th

e tra

in’s

ent

ire ro

ute

(not

ju

st e

nd d

estin

atio

n st

atio

n).

“Eve

ry s

tatio

n it

stop

s at

bec

ause

it’s

all

very

w

ell i

f it l

eave

s G

lasg

ow a

nd g

ets

to E

dinb

urgh

at

the

right

tim

e bu

t if s

omew

here

alo

ng th

e lin

e, s

ay it

’s d

elay

ed a

nd y

ou a

rriv

e la

te o

r mis

s yo

ur c

onne

ctin

g tra

in?”

G

lasg

ow g

roup

, Com

mut

er, Y

oung

er.

“I kn

ow w

e’ve

got

the

tech

nolo

gy to

do

it b

ut if

you

can

get

a b

ig e

noug

h sa

mpl

e, it

’s s

tatis

tical

ly v

alid

an

yway

.” C

ardi

ff gr

oup,

Com

mut

er, Y

oung

er.

25

Unv

eilin

g of

PP

M to

resp

onde

nts

Pas

seng

er

thou

ghts

on

whe

n pu

nctu

ality

sh

ould

be

mea

sure

d

Pas

seng

er

perc

eptio

ns o

f w

hat ‘

on-ti

me’

m

eans

Pas

seng

er

estim

atio

n of

%

of tr

ains

that

ar

rive

on ti

me

Brie

f de

scrip

tion

of

PP

M g

iven

Initi

al

awar

enes

s of

P

PM

test

ed

Edu

cate

d th

at a

le

eway

exi

sts

for

train

s ar

rivin

g at

de

stin

atio

n st

atio

n

Edu

cate

d th

at

curr

ent t

arge

t is

92.5

% o

f tra

ins

arriv

ing

on ti

me

Ask

ed to

re

valu

ate

estim

atio

n fo

r %

of ‘

on-ti

me’

tra

ins

Edu

cate

d th

at

train

s ar

e on

ly

mea

sure

d fo

r pu

nctu

ality

at

end

dest

inat

ion

stat

ion

Edu

cate

d th

at

long

dis

tanc

e tra

ins

have

a 1

0 m

inut

e le

eway

Edu

cate

d th

at

shor

t dis

tanc

e tra

ins

have

a 5

m

inut

e le

eway

Firs

t st

age

Seco

nd

stag

e

Third

st

age

Pas

seng

ers

wer

e ed

ucat

ed a

bout

Pub

lic P

erfo

rman

ce M

easu

re (P

PM

) in

the

follo

win

g w

ay

Thei

r rea

ctio

ns w

ere

soug

ht a

fter e

ach

piec

e of

info

rmat

ion

was

giv

en

26

Ove

rvie

w: r

eact

ions

to P

PM

The

Pub

lic P

erfo

rman

ce M

easu

re (P

PM

) sho

ws

the

perc

enta

ge o

f tra

ins

whi

ch a

rriv

e at

thei

r te

rmin

atin

g st

atio

n on

tim

e.

Initi

al re

actio

ns a

re th

at P

PM

sho

uld

mea

sure

pun

ctua

lity

firm

ly a

nd s

tring

ently

B

road

con

sens

us th

at >

95 p

er c

ent o

f tra

ins

shou

ld b

e ar

rivin

g ‘o

n tim

e’

‘On

time’

sho

uld

mea

n to

the

min

ute

Pun

ctua

lity

at e

very

sto

p sh

ould

be

mea

sure

d

Initial reaction

Initi

al s

tring

ency

sof

tens

as

educ

ated

mor

e ab

out w

hat P

PM

mea

sure

s U

nder

stan

ding

that

a v

ery

smal

l ele

men

t of ‘

leew

ay’ m

ay b

e ne

eded

ar

ound

‘on

time’

mea

sure

Considered reaction

Sce

ptic

ism

set

s in

and

pas

seng

ers

ques

tion

the

valu

e of

the

mea

sure

92

.5 p

er c

ent t

arge

t fee

ls fa

r too

low

(NB

- ta

rget

tend

s to

be

seen

as

a ce

iling

rath

er th

an a

bas

e le

vel)

Leew

ay c

onsi

dere

d ov

erly

gen

erou

s i.e

. 10

min

utes

‘lat

e’ c

onsi

dere

d to

o lo

ng to

stil

l be

coun

ted

as ‘o

n tim

e’

That

trai

ns a

re o

nly

mea

sure

d at

des

tinat

ion

stat

ion

furth

er c

ompo

unds

cy

nici

sm

Reaction after detailed

explanation

Awar

enes

s of

how

PP

M m

easu

re is

cal

cula

ted

furth

er u

nder

min

es tr

ust i

n tra

in

oper

ator

s.

27

Initi

al

awar

enes

s of

P

PM

test

ed

No

awar

enes

s of

PP

M

Pas

seng

er

estim

atio

n of

%

of t

rain

s th

at a

rriv

e on

tim

e

Est

imat

es ra

nge

from

70

per c

ent –

90

per c

ent

Thos

e w

ho s

ugge

st lo

wer

figu

res

argu

e th

is re

flect

s tru

e ex

perie

nces

Th

ose

that

pre

dict

hig

her f

igur

es b

elie

ve th

at s

ome

of th

e sh

orte

r, le

ss c

onge

sted

se

rvic

es a

re m

ore

relia

ble

and

boos

t the

ave

rage

S

ome

belie

ve th

at tr

ain

com

pani

es w

ould

not

wan

t to

repo

rt lo

w fi

gure

s, a

nd

“mas

sage

” the

figu

res

acco

rdin

gly

“I th

ink

peop

le h

ave

a pe

rcep

tion

that

it’s

a lo

t lo

wer

but

ther

e’s

load

s of

diff

eren

t com

pani

es a

nd

jour

neys

that

are

muc

h sh

orte

r and

pro

babl

y on

-tim

e m

ost o

f the

tim

e.”

Car

diff

grou

p, C

omm

uter

, You

nger

.

Pas

seng

er

perc

eptio

ns o

f w

hat ‘

on-ti

me’

m

eans

For t

he m

ajor

ity, ‘

on-ti

me’

mea

ns to

the

min

ute

Som

e ac

cept

ance

that

a s

mal

l lee

way

(one

/tw

o m

inut

es) m

ay b

e ju

stifi

ed

Som

e re

cogn

ition

that

it is

like

ly to

diff

er

depe

nden

t on

the

jour

ney

leng

th

“If it

arr

ives

at 7

.01a

m in

stea

d of

6.5

9am

to m

e th

at is

late

; it’

s no

t the

tim

e th

ey

adve

rtise

d it.

Not

that

late

I w

ill a

ccep

t, bu

t it’s

stil

l lat

e.”

Lond

on g

roup

, Com

mut

er,

You

nger

.

Edu

cate

d th

at

curr

ent t

arge

t is

92.

5% o

f tra

ins

arriv

ing

on ti

me

92.5

per

cen

t ini

tially

sou

nds

high

as

a re

flect

ion

of tr

ue tr

ain

punc

tual

ity (

alth

ough

no

t par

ticul

arly

hig

h as

a ta

rget

) S

ome

sugg

est t

hat t

arge

t sho

uld

be m

ore

aspi

ratio

nal

Sho

uld

striv

e to

be

the

best

i.e.

100

per

cen

t A

nd s

houl

d be

pro

gres

sive

e.g

. sho

w p

rogr

ess

year

on

year

.

Det

aile

d vi

ew: r

eact

ions

to P

PM

28

Edu

cate

d th

at

shor

t dis

tanc

e tra

ins

have

a 5

m

inut

e le

eway

Edu

cate

d th

at

long

dis

tanc

e tra

ins

have

a

10 m

inut

e le

eway

Edu

cate

d th

at

train

s ar

e on

ly

mea

sure

d fo

r pu

nctu

ality

at

end

dest

inat

ion

stat

ion

Ask

ed to

re

valu

ate

estim

atio

n fo

r %

of ‘

on-ti

me’

tra

ins

Pas

seng

ers

ofte

n ‘o

utra

ged’

at i

ndus

try’s

def

initi

on o

f ‘on

-tim

e’

Als

o di

sbel

ief t

hat t

his

is n

ot m

ore

wid

ely

com

mun

icat

ed

Som

e su

gges

t alte

rnat

ives

: Le

eway

cal

cula

ted

as a

per

cent

age

of tr

ain

jour

ney

Le

eway

bui

lt in

to th

e tim

etab

le, p

artic

ular

ly

fo

r lon

g di

stan

ce jo

urne

ys (a

s pe

r airl

ines

)

“If y

ou’re

giv

en a

tim

e an

d it

gets

pas

t tha

t tim

e, th

en in

my

opin

ion

that

’s la

te –

ho

w c

an y

ou s

ay it

’s o

n tim

e if

it ar

rived

10

min

utes

late

?”

Gla

sgow

gro

up,

Bus

ines

s/Le

isur

e,

Old

er

Pas

seng

ers

furth

er ir

ritat

ed b

y th

is

Add

s to

the

perc

eptio

n th

at tr

ain

com

pani

es ‘m

assa

ge’ t

he fi

gure

s

Con

sens

us th

at p

unct

ualit

y sh

ould

be

mea

sure

d at

eve

ry s

tatio

n

Oth

erw

ise

not a

ccur

ate

give

n m

any

peop

le w

ill d

isem

bark

bef

ore

final

de

stin

atio

n

A pe

rcep

tion

that

92.

5 pe

r cen

t is

not a

true

refle

ctio

n of

trai

n pu

nctu

ality

G

iven

all

of th

e ca

veat

s, a

sco

re o

f 99

per c

ent i

s no

t see

n as

unr

easo

nabl

e.

“We

all s

aid

that

we

care

abo

ut if

it g

ets

to o

ur

stat

ion

on ti

me,

so

this

isn'

t rea

lly te

lling

us

anyt

hing

abo

ut th

at, i

t’s ju

st te

lling

us

whe

ther

it

gets

to w

hich

ever

the

end

stat

ion

is.”

Car

diff

grou

p, C

omm

uter

, You

nger

.

Det

aile

d vi

ew: r

eact

ions

to P

PM

29

Unv

eilin

g of

CaS

L to

resp

onde

nts

Brie

f de

scrip

tion

of C

aSL

give

n

Ask

ed to

es

timat

e w

hat

‘sig

nific

antly

la

te’ m

eans

Initi

al

awar

enes

s of

CaS

L te

sted

Ext

ent t

o w

hich

ca

ncel

latio

ns

and

sign

ifica

nt

late

ness

sho

uld

be m

easu

red

toge

ther

Ask

ed to

re

valu

ate

estim

atio

n fo

r %

of c

ance

lled/

si

gnifi

cant

ly la

te

train

s

Edu

cate

d th

at

curr

ent t

arge

t is

2.2%

of t

rain

s ca

ncel

led

or

sign

ifica

ntly

late

Pas

seng

er

estim

atio

n of

%

of tr

ains

that

are

ca

ncel

led

or

sign

ifica

ntly

late

Edu

cate

d th

at 3

0 m

inut

es la

te is

co

nsid

ered

as

‘sig

nific

antly

’ lat

e

Edu

cate

d th

at

Sco

tRai

l is

not m

easu

red

agai

nst C

aSL

Firs

t st

age

Seco

nd

stag

e

Gla

sgow

on

ly

Pas

seng

ers

wer

e ed

ucat

ed a

bout

Can

cella

tions

and

Sig

nific

ant L

aten

ess

(CaS

L) in

the

follo

win

g w

ay

Thei

r rea

ctio

ns w

ere

soug

ht a

fter e

ach

piec

e of

info

rmat

ion

was

giv

en

30

CaS

L is

def

ined

as

the

num

ber a

nd p

erce

ntag

e of

pas

seng

er tr

ains

(fra

nchi

sed

and

open

ac

cess

ope

rato

rs) w

hich

are

can

celle

d in

par

t or f

ull,

or w

hich

arr

ive

at th

eir f

inal

des

tinat

ion

30 o

r mor

e m

inut

es la

ter t

han

the

time

show

n in

the

publ

ic ti

met

able

.

Pas

seng

er d

efin

ition

of ‘

sign

ifica

ntly

late

’ con

side

rabl

y m

ore

strin

gent

th

an th

e in

dust

ry m

easu

re

10 m

inut

e ‘c

ut-o

ff’ fo

r sho

rt di

stan

ce a

nd 2

0 m

inut

es fo

r lon

g di

stan

ce tr

ains

C

ance

llatio

ns s

een

as re

quiri

ng a

mor

e st

ringe

nt ta

rget

than

la

tene

ss –

98

per c

ent n

ot c

ance

lled

emer

ges

as c

onse

nsus

figu

re.

S

ome

indi

gnat

ion

at in

dust

ry d

efin

ition

of ‘

sign

ifica

ntly

late

’ - 3

0 m

inut

es

cons

ider

ed to

o ge

nero

us

How

ever

, 2.2

per

cen

t as

head

line

figur

e co

nsid

ered

a re

ason

able

targ

et fo

r ca

ncel

latio

ns a

lbei

t mor

e de

tail

rega

rdin

g re

ason

s fo

r can

cella

tion

ofte

n de

sire

d M

easu

ring

sign

ifica

nt la

tene

ss a

nd c

ance

latio

ns to

geth

er is

con

fusi

ng fo

r so

me.

Reaction after detailed explanation

Initial reaction

Ove

rvie

w: r

eact

ions

to C

aSL

31

Initi

al

awar

enes

s of

C

aSL

test

ed

Ask

ed to

es

timat

e w

hat

‘sig

nific

antly

la

te’ m

eans

No

awar

enes

s of

CaS

L

Pas

seng

ers

estim

ate

that

‘sig

nific

antly

late

’ wou

ld in

clud

e sh

ort d

ista

nce

train

s th

at a

re m

ore

than

10

min

utes

late

and

long

dis

tanc

e tra

ins

that

are

mor

e th

an

20 m

inut

es la

te

i.e. d

oubl

e th

e al

low

ance

s th

at P

PM

mak

es fo

r lat

e tra

ins

Edu

cate

d th

at

30 m

inut

es

late

is

cons

ider

ed a

s ‘s

igni

fican

tly’

late

Incl

udin

g si

gnifi

cant

late

ness

with

in c

ance

llatio

n fig

ures

cau

ses

som

e co

nfus

ion

Som

e ag

ree

that

30

min

s de

lay

is a

s ba

d as

a c

ance

llatio

n an

d so

sho

uld

be c

ount

ed a

s su

ch

Oth

ers

susp

ect i

t may

be

a w

ay o

f ‘hi

ding

’ lat

enes

s

Pas

seng

er

estim

atio

n of

%

of t

rain

s th

at a

re

canc

elle

d or

si

gnifi

cant

ly

late

Est

imat

es a

re 9

5-98

per

cen

t of t

rain

s ar

e no

t can

celle

d or

sig

nific

antly

late

P

asse

nger

s sp

eak

in te

rms

of th

e nu

mbe

rs o

f tra

ins

that

are

not

del

ayed

or

sig

nific

antly

late

R

athe

r tha

n th

e nu

mbe

r tha

t are

can

celle

d or

sig

nific

antly

late

.

“I ca

n't u

nder

stan

d w

hy it

is 3

0 m

inut

es a

nd I

wou

ld a

im to

redu

ce

that

. I th

ink

they

hav

e gi

ven

them

selv

es q

uite

a lo

t of l

eew

ay

actu

ally

with

30

min

utes

.” G

lasg

ow g

roup

, Bus

ines

s/Le

isur

e,

Old

er.

Det

aile

d vi

ew: r

eact

ions

to C

aSL

32

Edu

cate

d th

at

curr

ent t

arge

t is

2.2%

of t

rain

s ca

ncel

led

or

sign

ifica

ntly

late

2.2

per c

ent c

onsi

dere

d a

reas

onab

le ta

rget

by

mos

t O

nly

a m

inor

ity a

rgue

for s

omet

hing

mor

e st

ringe

nt

Ext

ent t

o w

hich

ca

ncel

latio

ns

and

sign

ifica

nt

late

ness

sho

uld

be m

easu

red

toge

ther

Ask

ed to

re

valu

ate

estim

atio

n fo

r %

of c

ance

lled/

si

gnifi

cant

ly la

te

train

s N

ot a

cle

ar c

onse

nsus

on

sign

ifica

nt la

tene

ss

Sug

gest

ed s

igni

fican

t lat

enes

s sh

ould

be

mea

sure

d al

ongs

ide

PP

M

(som

e as

sum

ed th

at in

clud

ing

a tra

in w

ithin

CaS

L bo

osts

PP

M s

core

s fu

rther

) A

lso

man

y ar

gue

that

cla

ssifi

catio

n fo

r ‘si

gnifi

cant

ly la

te’ s

houl

d be

diff

eren

t for

sh

ort a

nd lo

ng d

ista

nce

30 m

inut

e de

lay

on a

10

min

ute

jour

ney

mor

e si

gnifi

cant

than

on

a 3

hour

jo

urne

y C

ould

be

calc

ulat

ed a

s a

perc

enta

ge o

f jou

rney

tim

e

Edu

cate

d th

at

Sco

tRai

l is

not

mea

sure

d ag

ains

t CaS

L

Pas

seng

ers

in G

lasg

ow c

anno

t com

preh

end

why

Sco

tRai

l is

not m

easu

red

agai

nst

CaS

L S

pecu

late

that

this

is b

ecau

se o

f the

var

iabl

e an

d “s

ever

e” w

eath

er

But

not

con

side

red

a le

gitim

ate

reas

on fo

r exc

lusi

on

Sup

ports

pas

seng

er p

erce

ptio

n th

at d

elay

s ar

e ei

ther

min

or, o

r tra

ins

are

canc

elle

d ou

trigh

t.

“Wha

t do

you

expe

ct?

99 p

er c

ent?

I w

ould

se

ttle

for 9

9 pe

r cen

t for

eve

ryth

ing.

” G

lasg

ow g

roup

, Bus

ines

s/Le

isur

e, O

lder

.

“2.2

per

cen

t? I

thin

k th

at’s

qu

ite re

ason

able

. We

can

live

with

that

.” Lo

ndon

gro

up, B

usin

ess/

Leis

ure,

Old

er

Det

aile

d vi

ew: r

eact

ions

to u

nvei

ling

of C

aSL

33

Cur

rent

ly, a

ll tra

ins

coun

t equ

ally

tow

ards

pun

ctua

lity

targ

ets

– ea

ch in

divi

dual

trai

n ei

ther

do

es o

r doe

sn’t

arriv

e w

ithin

5 o

r 10

min

utes

of s

ched

uled

tim

e. T

here

is th

eref

ore

exac

tly

the

sam

e in

cent

ive,

from

a p

erfo

rman

ce ta

rget

per

spec

tive,

to ru

n a

train

on

time

that

has

1,

000

pass

enge

rs o

n it

as o

ne w

ith 2

0 pa

ssen

gers

.

On

bala

nce,

mos

t pas

seng

ers

belie

ve th

at a

ll tra

ins

shou

ld c

ount

equ

ally

tow

ards

pun

ctua

lity

targ

ets

They

arg

ue th

at e

very

one

has

mad

e th

e sa

me

cont

ract

with

the

TOC

and

eac

h jo

urne

y sh

ould

ha

ve th

e sa

me

wei

ght

Ther

e is

som

e ar

gum

ent (

parti

cula

rly b

y co

mm

uter

s) th

at jo

urne

ys s

houl

d be

wei

ghte

d by

pas

seng

er

num

bers

A

nd s

ome

susp

icio

n th

at ta

rget

s m

ight

be

mas

sage

d by

ope

rato

rs ru

nnin

g tra

ins

on ‘e

asy’

se

rvic

es to

‘up’

the

aver

age

How

ever

, als

o be

lieve

that

wei

ghtin

g by

pas

seng

er n

umbe

rs m

ight

intro

duce

per

vers

e in

cent

ives

If

targ

ets

are

skew

ed to

bus

y tra

ins,

it is

fear

ed th

at th

e tra

in c

ompa

nies

may

dro

p se

rvic

e st

anda

rds

on q

uiet

er s

ervi

ces

and

not s

trive

to e

nsur

e op

timum

pun

ctua

lity.

“I do

n't t

hink

they

sho

uld

or o

ther

wis

e th

ey

will

end

up

mak

ing

all t

he tr

ains

for l

eisu

re

four

hou

rs la

te, a

nd th

e re

st o

n tim

e!”

Lond

on g

roup

, Bus

ines

s/Le

isur

e, O

lder

.

“But

are

they

look

ing

at th

at s

ayin

g th

ere’

s on

ly 2

0 pe

ople

on

it so

let’s

can

cel i

t bec

ause

it’

s no

t eco

nom

ical

to ru

n it?

“ G

lasg

ow g

roup

, Com

mut

er, Y

oung

er.

Det

aile

d vi

ew: r

eact

ion

to c

alcu

latio

n of

pun

ctua

lity

targ

ets

34

Kno

wle

dge

of P

PM

/CaS

L an

d ho

w e

ach

mea

sure

is c

alcu

late

d fu

rther

und

erm

ines

pas

seng

ers’

trus

t in

the

railw

ay fo

r a n

umbe

r of r

easo

ns:

Bel

ief t

hat t

arge

ts a

re n

ot s

tretc

hing

eno

ugh

over

all

Targ

ets

seen

as

cont

aini

ng n

umer

ous

loop

hole

s an

d ca

veat

s th

at a

llow

the

indu

stry

to m

assa

ge

the

figur

es

Exp

ecta

tion

that

targ

ets

will

be

treat

ed a

s a

ceili

ng fo

r ser

vice

per

form

ance

and

that

ope

rato

rs

are

only

ince

ntiv

ised

to ‘g

et o

ver t

he li

ne’.

Effe

ct o

n tru

st

“You

trus

t the

m le

ss, k

now

ing

the

deta

il be

hind

the

mea

sure

now

, it’s

like

no

t wha

t we

wou

ld e

xpec

t, ou

r pe

rcep

tion

of 9

5 pe

r cen

t on

time

is

not a

ctua

lly a

ccur

ate.

” Lo

ndon

gro

up, B

usin

ess/

Leis

ure,

O

lder

.

“I sa

id b

efor

e th

at I

trust

if I

had

a co

mpl

aint

but

now

I th

ink

they

’d p

roba

bly

do th

e sa

me

with

thei

r com

plai

nt fi

gure

s an

d sa

y “o

h w

ell,

this

com

plai

nt d

oesn

't

coun

t for

this

reas

on”,

wha

teve

r.”

Gla

sgow

gro

up, B

usin

ess/

Leis

ure,

Old

er.

“A b

unch

of t

hiev

ing

rogu

es!”

Lond

on g

roup

, Bus

ines

s/Le

isur

e,

Old

er.

35

Spe

ed, p

unct

ualit

y,

frequ

ency

trad

e-of

fs

36

Pun

ctua

lity

mos

t des

ired

over

spe

ed, f

requ

ency

Mos

t pas

seng

ers

(and

com

mut

ers

in p

artic

ular

) des

ire m

ore

punc

tual

trai

ns

This

is b

ecau

se p

asse

nger

s’ p

rimar

y ai

m is

to a

rriv

e at

thei

r des

tinat

ion

‘on

time’

, reg

ardl

ess

of

how

long

that

jour

ney

take

s A

lso,

refle

cts

belie

f / e

xper

ienc

e th

at d

elay

s oc

cur m

ore

frequ

ently

than

can

cella

tions

Ther

e ar

e a

few

exc

eptio

ns:

Spee

d de

sire

d on

ver

y lo

ng d

ista

nce

jour

neys

(Lon

don

– G

lasg

ow),

to re

duce

jour

ney

time

Freq

uenc

y de

sire

d on

rura

l jou

rney

s, to

ens

ure

train

s ru

n m

ore

regu

larly

Fr

eque

ncy

desi

red

by s

ome

leis

ure

trave

llers

, as

this

sho

uld

resu

lt in

mor

e se

ats

and

ther

efor

e le

ss c

row

ding

A w

ides

prea

d be

lief f

rom

pas

seng

ers

that

ther

e is

no

reas

on w

hy th

e tra

in c

ompa

nies

can

’t de

liver

an

impr

ovem

ent i

n te

rms

of a

ll th

ree

fact

ors:

spe

ed, f

requ

ency

and

pun

ctua

lity

The

indu

stry

’s a

rgum

ent t

hat a

ll th

ree

can’

t be

achi

eved

furth

er c

ompo

unds

a v

iew

that

pa

ssen

gers

’ bes

t int

eres

ts a

re n

ot p

rom

inen

t eno

ugh

Pas

seng

ers

also

arg

ue th

at a

‘one

siz

e fit

s al

l’ ap

proa

ch is

inap

prop

riate

and

that

diff

eren

t jou

rney

s re

quire

diff

eren

t im

prov

emen

t prio

ritie

s.

“Tha

t is

a rid

icul

ous

argu

men

t. I t

hink

bec

ause

w

e gi

ve th

em s

o m

uch

leew

ay th

at is

why

they

ca

n th

en s

ay th

ese

thin

gs.“

Lond

on g

roup

, Com

mut

er, Y

oung

er.

“To

me

it’s

too

top

dow

n, it

’s a

gen

eral

que

stio

n in

gen

eral

term

s, w

hat w

ould

you

like

? B

ut th

e sp

ecifi

c is

sues

are

spe

cific

rout

es s

o w

hy c

an’t

they

add

ress

them

rath

er th

an ju

st s

ayin

g w

e ca

n ha

ve fr

eque

ncy,

spe

ed o

r ?“

G

lasg

ow g

roup

, Com

mut

er, Y

oung

er.

37

Task

1

60%

40%

Com

mut

ers

mor

e lik

ely

to d

esire

mor

e ‘o

n tim

e’ tr

ains

, ref

lect

ing

mor

e fre

quen

t exp

erie

nce

of d

elay

s an

d m

ore

limite

d im

pact

s of

can

cella

tions

giv

en s

ervi

ce fr

eque

ncy

Thos

e ch

oosi

ng fe

wer

can

cella

tions

(mor

e of

ten

busi

ness

/leis

ure

trave

llers

) arg

ue th

at a

10

min

ute

dela

y is

not

hug

ely

sign

ifica

nt fo

r a lo

nger

jour

ney,

but

a c

ance

llatio

n co

uld

be a

‘dis

aste

r’.

“If I

was

doi

ng a

jour

ney,

say

I w

as

goin

g G

lasg

ow to

Man

ches

ter f

or a

tri

p aw

ay, i

f you

r tra

in’s

can

celle

d,

that

’s y

our t

rip ru

ined

.” G

lasg

ow g

roup

, Com

mut

er,

You

nger

.

“I pu

t the

firs

t one

just

bec

ause

I th

ink

ther

e’s

not

as m

any

canc

ella

tions

as

ther

e ar

e la

te tr

ains

. B

ut a

can

cella

tion

at th

e w

rong

tim

e co

uld

be

terr

ible

but

they

rare

ly g

et c

ance

lled,

com

pare

d to

the

amou

nt th

at a

re la

te.“

Lond

on g

roup

, Com

mut

er, Y

oung

er.

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

38

30%

70

%

Com

mut

ers,

aga

in a

re m

ore

likel

y to

des

ire m

ore

‘on

time’

trai

ns

Acc

usto

med

to c

row

ding

and

not

get

ting

a se

at

Pun

ctua

lity

and

getti

ng to

wor

k/m

eetin

gs o

n tim

e is

mor

e im

porta

nt

Bus

ines

s/le

isur

e pa

ssen

gers

des

ire m

ore

com

fort

– cr

owdi

ng/la

ck o

f sea

ting

is a

mor

e si

gnifi

cant

issu

e

Som

e co

mm

uter

s ar

gue

in fa

vour

of a

dditi

onal

trai

ns o

n gr

ound

s th

at s

ervi

ces

ofte

n se

vere

ly

over

crow

ded N

ot a

que

stio

n of

not

get

ting

a se

at, b

ut o

f not

bei

ng a

ble

to g

et o

n th

e tra

in a

t all.

“But

then

you

don

’t re

ally

min

d st

andi

ng o

n th

e tra

in fo

r 15

min

utes

eve

ry m

orni

ng, y

ou w

ould

n't

wan

t to

be s

tand

ing

from

Gla

sgow

to L

ondo

n.“

Gla

sgow

gro

up, B

usin

ess/

Leis

ure,

Old

er.

“I'd

rath

er g

et s

quas

hed

for a

littl

e bi

t. B

ecau

se

we’

re u

sed

to g

ettin

g sq

uash

ed.“

Lond

on g

roup

, Com

mut

er, Y

oung

er.

Task

2

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

39

Littl

e de

sire

for a

fast

er s

ervi

ce in

exc

hang

e fo

r mor

e er

ratic

pun

ctua

lity

Pas

seng

ers

do n

ot m

ind

how

long

a s

ervi

ce ta

kes,

pro

vidi

ng it

arr

ives

at t

he s

ched

uled

tim

e A

llow

s th

em to

pla

n/sc

hedu

le

Bel

ief t

hat f

aste

r doe

sn’t

mea

n si

gnifi

cant

ly fa

ster

and

is li

kely

to b

e on

ly o

ne/tw

o m

inut

es

quic

ker.

“If th

ey te

ll m

e it’

s go

ing

to ta

ke 1

0 m

inut

es,

I'm h

appy

for i

t to

take

10

min

utes

, don

’t re

ally

ca

re if

it ta

kes

eigh

t.“

Lond

on g

roup

, Com

mut

er, Y

oung

er.

“Yea

h, if

you

r tra

in jo

urne

y ta

kes

norm

ally

20

min

utes

and

they

can

redu

ce it

to 1

0 m

inut

es

but t

hey

coul

d be

10

min

utes

late

, the

n yo

u're

st

ill g

ettin

g fro

m y

our h

ouse

to y

our u

ltim

ate

dest

inat

ion

at th

e sa

me

time.

I’d

rath

er th

ey

wer

e m

ore

accu

rate

.“ Lo

ndon

gro

up, B

usin

ess/

Leis

ure,

Old

er.

Task

3

10%

90%

B

ase:

80

CA

UTI

ON

: The

se fi

gure

s sh

ould

be

used

onl

y as

an

indi

catio

n, d

ue to

the

low

sam

ple

size

40

73%

17

%

10%

“I th

ink

gene

rally

mor

e tra

ins

are

dela

yed

than

th

ey a

re c

ance

lled

or d

isru

pted

so

if yo

u're

taki

ng

an a

vera

ge, I

wou

ld ra

ther

that

they

wer

e m

ore

on

time

and

a co

uple

of c

ance

llatio

ns.”

Lond

on g

roup

, Com

mut

er, Y

oung

er.

The

maj

ority

des

ire m

ore

train

s ar

rivin

g on

tim

e –

refle

cts

belie

f / e

xper

ienc

e th

at d

elay

s oc

cur m

ore

frequ

ently

than

can

cella

tions

Thos

e w

ho o

pt fo

r few

er d

ays

of m

ajor

dis

rupt

ion

argu

e th

at th

is w

ill re

duce

the

num

ber o

f peo

ple

stra

nded

/una

ble

to g

et s

omew

here

, par

ticul

arly

on

long

er jo

urne

ys

Whe

reas

can

cella

tions

/del

ays

may

stil

l allo

w a

rriv

al a

t des

tinat

ion,

just

late

.

“I pu

t num

ber t

hree

aga

in b

ecau

se if

you

can

't ge

t th

ere

at a

ll , i

f you

hav

e a

day

of m

ajor

dis

rupt

ion,

if

you

can'

t get

ther

e at

all

it co

uld

real

ly m

ess

up

a ho

liday

or w

hate

ver ,

whe

reas

bei

ng s

light

ly la

te

isn’

t the

end

of t

he w

orld

.” Lo

ndon

Gro

up, B

usin

ess/

Leis

ure,

Old

er.

Task

4

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

41

Per

form

ance

mea

sure

men

t tra

de-o

ff ex

erci

ses

42

Lear

ning

abo

ut s

ome

of th

e cr

iteria

aga

inst

whi

ch P

PM

and

CaS

L ar

e m

easu

red

furth

er e

rode

s pa

ssen

gers

’ per

cept

ions

of t

he c

redi

bilit

y of

thes

e m

easu

res

Pas

seng

ers

are,

aga

in, l

eft ‘

outra

ged’

at s

ome

of th

e ta

ctic

s th

at th

e tra

in c

ompa

nies

can

em

ploy

, sp

ecifi

cally

: A

ddin

g ex

tra ti

me

to th

e tim

etab

le b

etw

een

the

penu

ltim

ate

and

last

sto

p C

ance

l tra

ins

by 1

0pm

the

nigh

t bef

ore

they

are

due

to ru

n an

d th

ey d

on’t

coun

t as

canc

elle

d M

iss

out s

tatio

ns to

sav

e tim

e an

d ge

t sub

sequ

ent t

rain

s ru

nnin

g to

sch

edul

e

This

furth

er s

treng

then

s th

e pe

rcep

tion

that

PP

M/C

aSL

does

not

pro

vide

a re

pres

enta

tive

view

of t

he

train

ser

vice

as

too

man

y ‘lo

opho

les’

exi

st.

“I

thin

k th

e fig

ures

they

see

m to

pub

lish

are

certa

inly

pub

lishe

d to

pul

l the

woo

l ove

r our

eye

s. If

they

just

told

us

wha

t was

ha

ppen

ing,

we

coul

d sa

y “Y

eah,

that

’s o

kay,

we

unde

rsta

nd it

’s

a di

fficu

lt jo

b yo

u’ve

got

to d

o, w

e un

ders

tand

ther

e’s

goin

g to

be

del

ays

and

canc

ella

tions

”, w

e un

ders

tand

all

that

, if y

ou ju

st

told

us

the

truth

then

we’

d be

abl

e to

dea

l with

that

.” G

lasg

ow g

roup

, Bus

ines

s/Le

isur

e, O

lder

.

Furth

er le

arni

ng o

n P

PM

/CaS

L

43

28%

22

%

25%

15

%

10%

Not

a c

lear

con

sens

us

Som

e se

e th

is a

s ac

cept

able

pro

vidi

ng th

ey a

rriv

e at

thei

r des

tinat

ion

at th

e sc

hedu

led

time

– ex

pect

atio

ns a

re m

anag

ed

Man

y fe

el it

is u

nacc

epta

ble

Ano

ther

way

that

the

figur

es a

re m

anip

ulat

ed

Not

a fa

ir/ge

nuin

e re

flect

ion

of h

ow th

e se

rvic

e ha

s pe

rform

ed

View

ed a

s m

ore

acce

ptab

le if

add

ition

al ti

me

is a

dded

on

at e

very

sta

tion

the

train

sto

ps a

t E

.g. o

ne/tw

o m

inut

es

But

not

just

bet

wee

n pe

nulti

mat

e an

d en

d st

atio

n.

“It’s

not

fixi

ng th

e pr

oble

m. I

t’s ju

st ly

ing

and

sayi

ng

that

it is

on

time,

but

it’s

not

.” G

lasg

ow g

roup

, Bus

ines

s/Le

isur

e, O

lder

.

“If it

sai

d a

coup

le o

f min

utes

fro

m w

hen

it ac

tual

ly a

rriv

es a

t its

des

tinat

ion,

you

kno

w I

wou

ld

rath

er p

erso

nally

that

than

it

arriv

e tw

o m

inut

es la

te a

nd I

mis

s m

y co

nnec

tion.

” G

lasg

ow g

roup

, Com

mut

er,

You

nger

.

“If a

trai

n sa

id it

add

ed a

n ex

tra m

inut

e on

the

time

betw

een

each

sto

p an

d it

actu

ally

took

that

tim

e,

whe

ther

that

mea

nt it

was

goi

ng s

light

ly s

low

er o

r w

hate

ver,

that

I w

ould

n't h

ave

a pr

oble

m w

ith.”

Lond

on g

roup

, Com

mut

er, Y

oung

er.

Task

1

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

44

80%

20%

Larg

e m

ajor

ity a

gree

that

an

inte

rval

mea

sure

men

t sys

tem

wou

ld b

e m

ore

appr

opria

te

Per

cept

ion

that

this

wou

ld p

rovi

de a

mor

e ac

cura

te re

flect

ion

of p

unct

ualit

y ex

perie

nced

by

the

maj

ority

of p

asse

nger

s.

“It’s

stil

l goi

ng to

inco

nven

ienc

e th

e fir

st p

eopl

e at

the

plat

form

or s

ome

peop

le o

n on

e tra

in, b

ut fo

r the

maj

ority

it’

s pr

obab

ly g

oing

to im

prov

e th

eir e

xper

ienc

e.”

Lond

on g

roup

, Com

mut

er, Y

oung

er.

Task

2

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

45

10%

90%

Mix

ed fe

elin

gs e

xist

on

leaf

mul

ch

Som

e re

cogn

ise

that

it is

a g

enui

ne p

robl

em

Oth

ers

stru

ggle

with

the

conc

ept a

nd d

on’t

belie

ve o

ther

cou

ntrie

s ha

ve s

uch

prob

lem

s

Pas

seng

ers

desi

re a

pre

dict

able

ser

vice

rath

er th

an u

ncer

tain

ty a

nd d

o no

t opp

ose

an a

men

ded

timet

able

S

afet

y is

par

amou

nt

Any

am

ende

d tim

etab

le w

ould

nee

d to

be

in p

lace

for a

lim

ited

perio

d i.e

. tw

o/th

ree

mon

ths

With

adv

ance

not

ice

abou

t its

intro

duct

ion

Thos

e ag

ains

t the

idea

arg

ue th

at th

e TO

Cs

rece

ive

enou

gh le

eway

as

it is

W

hils

t a la

ck o

f tru

st re

sults

in p

asse

nger

s be

lievi

ng th

at T

OC

s w

ould

intro

duce

the

timet

able

s to

o ea

rly o

r whe

n le

af m

ulch

isn'

t a p

robl

em.

“Peo

ple

just

nee

d to

pla

n th

eir

jour

ney,

peo

ple

acce

pt

diffe

rent

tim

es o

f yea

r tha

t yo

u m

ight

not

get

the

sam

e le

vel o

f ser

vice

, it’s

kno

win

g in

adv

ance

so

you

can

take

ot

her a

ctio

n to

get

ther

e.“

Gla

sgow

gro

up, C

omm

uter

, Y

oung

er.

Task

3

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

46

40%

60

%

Pas

seng

ers

divi

ded

on th

e in

trodu

ctio

n of

an

amen

ded

timet

able

Saf

ety

is p

aram

ount

A

n am

ende

d tim

etab

le is

like

ly to

be

mor

e pu

nctu

al

But

, any

am

ende

d tim

etab

le

shou

ld b

e co

mm

unic

ated

wel

l in

adva

nce

TOC

s sh

ould

at l

east

atte

mpt

to d

eliv

er th

e fu

ll tim

etab

le

Rat

her t

han

adm

ittin

g de

feat

st

raig

htaw

ay

P

asse

nger

s’ p

erce

ptio

ns o

f ext

rem

e w

eath

er li

kely

to b

e si

gnifi

cant

ly d

iffer

ent

from

TO

Cs’

P

asse

nger

s st

rand

ed a

t non

-sto

ppin

g st

atio

ns

Supp

ort a

n am

ende

d tim

etab

le

Opp

ose

an a

men

ded

timet

able

Per

form

ance

sho

uld

be m

easu

red

agai

nst t

he a

men

ded

timet

able

, pro

vidi

ng p

asse

nger

s ar

e gi

ven

notic

e of

this

and

it is

not

intro

duce

d at

ver

y sh

ort n

otic

e.

“I th

ink

that

they

sho

uld

atte

mpt

to d

o it.

In m

y ex

perie

nce

ther

e’s

like

liter

ally

a c

oupl

e of

sn

owfla

kes

and

that

’s it

the

who

le n

etw

ork

goes

off

. To

be h

ones

t the

y w

ould

brin

g in

an

amen

ded

timet

able

too

soon

, the

y’d

say

right

that

’s

it.”

Gla

sgow

gro

up, C

omm

uter

, Y

oung

er.

Task

4

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

47

66%

30

%

4%

1%

0%

Alm

ost u

nani

mou

s ag

reem

ent t

hat t

his

shou

ld n

ot b

e al

low

ed to

hap

pen

Mor

e ac

cept

able

if th

e cu

t off

poin

t was

ear

lier t

han

10pm

and

pas

seng

ers

wer

e gi

ven

mor

e w

arni

ng e

.g. 2

4 ho

urs.

“I co

uld

unde

rsta

nd if

they

had

a

plat

form

whe

re th

ey c

ould

info

rm

ever

yone

“thi

s tra

in’s

can

celle

d” a

nd

you'

re g

iven

ple

nty

of n

otic

e bu

t if t

hey

didn

’t re

ally

pro

vide

not

ice,

I’d

stro

ngly

di

sagr

ee th

at th

is is

acc

epta

ble.

” Lo

ndon

gro

up, C

omm

uter

, You

nger

.

“It d

epen

ds w

hat t

ime

the

train

s ar

e th

e

next

day

ent

irely

bec

ause

you

can

get

a

six

o’ c

lock

trai

n an

d yo

u're

sle

epin

g at

10

pm, I

thin

k it

has

to b

e 12

hou

rs’

notic

e or

som

ethi

ng li

ke th

at.”

Gla

sgow

gro

up, C

omm

uter

, You

nger

.

Task

5

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

48

19%

81%

The

maj

ority

feel

that

all

pass

enge

rs s

houl

d be

trea

ted

equa

lly, r

egar

dles

s of

tim

e of

trav

el

Unf

air t

o le

ave

pass

enge

rs s

trand

ed

And

una

ble

to g

et h

ome

Mos

t pas

seng

ers

can

reca

ll a

time

whe

n th

ey h

ave

been

stra

nded

or a

trai

n ha

s no

t st

oppe

d at

thei

r sta

tion

The

only

exc

eptio

n is

Lon

don

Som

e pa

ssen

gers

feel

that

Lon

don

is b

ette

r equ

ippe

d to

cop

e if

they

can

celle

d tra

in

serv

ices

for a

sho

rt pe

riod

Alte

rnat

ive

rout

es/fo

rms

of tr

ansp

ort a

vaila

ble

‘Dis

aste

r day

s’ s

houl

d be

mea

sure

d se

para

tely

in p

unct

ualit

y st

atis

tics

And

mea

sure

d ag

ains

t how

wel

l the

‘dis

aste

r’ w

as d

ealt

with

.

“I th

ink

it’s

the

mos

t fai

r, ev

eryo

ne’s

goi

ng to

get

de

laye

d an

d th

at’s

just

the

way

it g

oes.

You

all

get

dela

yed

toge

ther

.” Lo

ndon

gro

up, B

usin

ess/

Leis

ure,

Old

er.

Task

6

Bas

e: 8

0 C

AU

TIO

N: T

hese

figu

res

shou

ld b

e us

ed o

nly

as a

n in

dica

tion,

due

to th

e lo

w s

ampl

e si

ze

49

Sum

mar

y

50

Per

form

ance

mea

sure

s an

d tru

st

Pas

seng

ers’

vie

ws

on p

erfo

rman

ce ta

rget

s an

d m

easu

rem

ent a

re in

form

ed b

y th

e w

ider

con

text

with

in

whi

ch th

ey a

sses

s th

e ra

ilway

s. T

here

are

thre

e ke

y is

sues

:

Lim

ited

trus

t - la

ck o

f tru

st is

a re

curr

ing

them

e in

pas

seng

ers’

ass

essm

ent o

f rai

lway

per

form

ance

Th

is s

tudy

, in

line

with

muc

h pr

evio

us re

sear

ch, h

ighl

ight

s a

larg

e de

gree

of c

ynic

ism

abo

ut th

e m

otiv

es a

nd

beha

viou

r of t

he ra

ilway

s W

hile

this

cyn

icis

m c

an o

ften

appe

ar il

l-inf

orm

ed, i

t ref

lect

s bo

th a

(not

unr

easo

nabl

e) la

ck o

f und

erst

andi

ng

abou

t how

the

railw

ay o

pera

tes

and

the

very

lim

ited

emot

iona

l eng

agem

ent t

hat c

onsu

mer

s ha

ve w

ith th

e ra

ilway

s

As

such

, the

re is

a te

nden

cy to

sus

pect

the

wor

st ra

ther

than

giv

e th

e be

nefit

of t

he d

oubt

– a

n im

pres

sion

that

is

rein

forc

ed w

hen

pass

enge

r lea

rn m

ore

abou

t the

det

ail t

hat s

its b

ehin

d P

PM

and

CaS

L

Lack

of c

ompe

titio

n - w

hile

con

sum

ers

are

ofte

n sc

eptic

al a

bout

the

clai

ms

mad

e by

‘big

bus

ines

s’,

this

is c

ompo

unde

d in

the

case

of t

he ra

ilway

s by

a b

elie

f (w

heth

er ri

ght o

r wro

ng) t

hat t

he in

dust

ry is

no

t sub

ject

to th

e sa

me

leve

l of c

ompe

titiv

e m

arke

t dis

cipl

ine

as o

ther

sec

tors

Th

is h

as th

e co

ntra

dict

ory

effe

ct o

f inc

reas

ing

the

perc

eive

d im

porta

nce

of th

e ra

ilway

s ha

ving

stri

ngen

t pe

rform

ance

targ

ets,

whi

le a

lso

rein

forc

ing

pass

enge

rs’ s

uspi

cion

s th

at th

e ra

ilway

s w

ill d

o no

thin

g m

ore

than

the

bare

min

imum

to re

ach

such

targ

ets

Lack

of t

rans

pare

ncy

- for

the

mos

t par

t, pa

ssen

gers

do

not k

now

wha

t tar

gets

are

set

, by

who

m th

ey

are

set o

r how

they

are

mon

itore

d. F

urth

erm

ore,

eve

n w

hen

they

are

info

rmed

abo

ut ta

rget

s, th

ey

stru

ggle

to s

ee a

link

bet

wee

n th

ese

mea

sure

s an

d th

eir o

wn

jour

ney

expe

rienc

e or

how

thes

e m

easu

res

cont

ribut

e to

ser

vice

impr

ovem

ent m

ore

gene

rally

Li

nkin

g pe

rform

ance

mor

e ex

plic

itly

to c

ompe

nsat

ion

and

/ or f

ines

is s

een

by s

ome

as a

bet

ter w

ay o

f ref

lect

ing

pass

enge

rs’ e

xper

ienc

es b

ut s

ome

feel

suc

h co

sts

will

ulti

mat

ely

be b

orne

by

the

pass

enge

r.

51

Pas

seng

ers

valu

e P

PM

/CaS

L in

prin

cipl

e, b

ut q

uest

ion

how

th

ese

mea

sure

s ar

e im

plem

ente

d in

pra

ctic

e P

asse

nger

s’ k

ey p

riorit

y is

for r

elia

bilit

y an

d a

such

ther

e is

bro

ad a

gree

men

t tha

t bot

h pu

nctu

ality

(esp

ecia

lly) b

ut a

lso

canc

ella

tions

sho

uld

be s

tring

ently

mea

sure

d

As

such

, bot

h P

PM

and

CaS

L ar

e se

en a

s re

leva

nt a

nd u

sefu

l in

prin

cipl

e H

owev

er, i

n pr

actic

e, th

e ov

eral

l tar

gets

are

see

n as

rela

tivel

y le

nien

t (pa

rticu

larly

PP

M)

The

curr

ent m

easu

res

are

also

con

side

red

to c

onta

in to

o m

any

‘loop

hole

s’ –

this

rein

forc

es p

erce

ptio

ns o

f len

ienc

y an

d un

derm

ines

trus

t in

the

who

le m

easu

rem

ent p

roce

ss

Pas

seng

ers’

resp

onse

to th

e ab

ove

is to

sug

gest

that

mor

e –

and

mor

e de

taile

d –

info

rmat

ion

shou

ld b

e pr

ovid

ed. S

peci

fical

ly:

Mor

e de

tail

Dep

artu

re/a

rriv

al ti

mes

sho

uld

be m

easu

red

for e

very

trai

n st

oppi

ng a

t eve

ry s

tatio

n E

very

ser

vice

and

jour

ney

mea

sure

d In

form

atio

n on

cau

se o

f del

ay/c

ance

llatio

n/di

srup

tion

Sep

arat

e de

finiti

ons

for ‘

sign

ifica

ntly

late

’ on

shor

t and

long

dis

tanc

e tra

ins

Som

e su

ppor

t wei

ghtin

g by

pas

seng

er n

umbe

rs (a

lthou

gh th

e ov

eral

l con

sens

us w

as fo

r m

easu

rem

ent p

er tr

ain)

Less

leni

ent

Am

ount

of ‘

leew

ay’ d

eter

min

ing

‘on-

time’

bas

ed o

n jo

urne

y le

ngth

of t

rain

TO

Cs

not a

llow

ed to

add

ext

ra ti

me

to th

e tim

etab

le b

etw

een

penu

ltim

ate

and

term

inat

ing

stat

ion

Sco

tRai

l to

be m

easu

red

agai

nst C

aSL

Can

cella

tions

and

‘dis

aste

r day

s’ a

lway

s re

cord

ed a

nd m

easu

red

Tran

spar

ency

M

ore

com

mun

icat

ion

that

thes

e m

easu

res

exis

t M

ore

com

mun

icat

ion

abou

t how

thes

e fig

ures

are

cal

cula

ted

and

mon

itore

d P

rovi

ding

som

e of

the

addi

tiona

l det

ail d

escr

ibed

abo

ve m

ight

hel

p to

reas

sure

pas

seng

ers

abou

t the

rele

vanc

e an

d in

tegr

ity o

f PP

M a

nd C

aSL

How

ever

, it h

as to

be

ackn

owle

dged

that

sug

gest

ions

suc

h as

thes

e ar

e, in

par

t, a

func

tion

of p

asse

nger

s ha

ving

bee

n as

ked

to lo

ok a

t per

form

ance

mea

sure

s in

a s

usta

ined

and

det

aile

d w

ay in

a re

sear

ch s

ettin

g. In

real

ity, c

onsu

mer

s ar

e se

ldom

will

ing

to e

ngag

e at

suc

h a

leve

l of d

etai

l, al

thou

gh th

ey b

elie

ve a

cces

s to

suc

h de

tail

shou

ld b

e av

aila

ble

if re

quire

d.

52

Issu

es to

con

side

r

Pass

enge

rs w

ant t

rain

pun

ctua

lity

and

canc

ella

tions

to b

e m

easu

red

Giv

en th

is, t

here

may

be

mer

it in

pro

vidi

ng a

dditi

onal

det

ail a

bout

targ

ets

and,

inde

ed, i

n m

akin

g ta

rget

s m

ore

strin

gent

But

in a

dditi

on, c

onsi

dera

tion

shou

ld a

lso

be g

iven

to c

omm

unic

atin

g ta

rget

s in

a w

ay th

at h

elps

add

ress

the

bigg

er,

cont

extu

al is

sues

– p

artic

ular

ly th

at o

f tru

st. T

he fo

llow

ing

mig

ht th

eref

ore

be c

onsi

dere

d:

Obj

ectiv

ity a

nd in

depe

nden

ce

Mor

e in

form

atio

n ab

out w

ho s

ets

and

mon

itors

the

targ

ets,

as

wel

l as

reas

sura

nces

that

they

are

man

aged

in

depe

nden

tly a

nd im

parti

ally

with

pas

seng

ers’

bes

t int

eres

ts ‘a

t hea

rt’

Con

sequ

ence

s an

d in

cent

ives

C

omm

unic

atio

n of

why

it is

nec

essa

ry a

nd im

porta

nt fo

r TO

Cs

and

Net

wor

k R

ail t

o m

eet (

or e

ven

exce

ed)

targ

ets

and

the

cons

eque

nces

of n

on-p

erfo

rman

ce

Asp

iratio

nal a

nd p

rogr

essi

ve

Pos

ition

ing

targ

ets

as th

e ‘m

inim

um a

ccep

tabl

e le

vel’

of p

erfo

rman

ce, g

ivin

g an

ass

uran

ce th

at th

e in

dust

ry

striv

es to

exc

eed

thes

e ta

rget

s an

d pr

ovid

ing

evid

ence

that

it d

oes

so o

n oc

casi

ons”

* C

omm

unic

atin

g im

prov

emen

t ove

r tim

e an

d sh

owin

g th

at ta

rget

s w

ork

in s

uppo

rting

con

tinua

l ser

vice

im

prov

emen

t S

impl

icity

C

onsi

dera

tion

mig

ht b

e gi

ven

to re

-fram

ing

targ

ets

away

from

pur

ely

stat

istic

al in

form

atio

n (a

lthou

gh s

till v

ery

muc

h un

derp

inne

d by

‘har

d’ d

ata)

tow

ards

mak

ing

a sm

all n

umbe

r of s

impl

e bu

t def

initi

ve p

rom

ises

, cas

t in

‘con

sum

er’ l

angu

age

and

with

a c

lear

indi

catio

n of

the

cons

eque

nces

of f

ailu

re.

In th

is c

onte

xt, t

arge

ts m

ight

be

bet

ter c

omm

unic

ated

thro

ugh

Cus

tom

er R

epor

ts, w

hich

app

ear t

o ha

ve s

igni

fican

t pot

entia

l for

bui

ldin

g di

alog

ue w

ith p

asse

nger

s*

For e

xam

ple,

‘We

will

onl

y ev

er c

ance

l a tr

ain

for t

he fo

llow

ing

reas

ons.

..’, ‘

If w

e m

ake

you

mor

e th

an X

m

inut

es la

te w

e w

ill re

fund

Y p

er c

ent o

f you

r far

e’ e

tc.

*http

://w

ww

.tran

spor

tfocu

s.or

g.uk

/new

s/ar

ticle

s/tr

ain-

com

pany

-tran

spar

ency

-wel

com

ed-b

y-pa

ssen

gers

-201

5

53

Transport Focus Links between train punctuality and passenger satisfaction: Journeys across the Greater Anglia franchise in 2012, 2013 & 2014 – Executive Summary

54

Executive summary Transport Focus is the independent transport user watchdog charged with representing the interests of: Britain’s rail passengers; bus, coach and tram passengers in England but outside London; and users of the strategic road network in England. Amongst other objectives, Transport Focus seeks to understand the needs and expectations of rail passengers and to secure tangible and measurable improvements for them. To support these objectives Transport Focus commissions and publishes the twice-yearly National Rail Passenger Survey (NRPS), which is the benchmark measure of changes in passengers’ attitudes towards all elements of rail travel in the country.

This report, commissioned by Transport Focus in a joint project with the Office of Rail and Road (ORR), provides the results of a study examining passenger satisfaction, as measured by NRPS, alongside rail industry train punctuality data from 2012 to 2014. The principal aim of the study is to further understand the relationships between passenger satisfaction with punctuality and actual train punctuality.

The analysis matched train punctuality data with individual respondents from the survey, establishing how late the train was at the location where the passenger alighted. This allows a direct comparison to be made between the lateness the passenger experienced and their resulting satisfaction with punctuality.

The report focusses on the Greater Anglia (GA) franchise in order to provide comparability with a 2009 report prepared by CDL (now part of GHD), as well as to inform Transport Focus ahead of the East Anglia franchise competition later in 2015.

The document has been prepared solely based on data from:

NRPS records and corresponding reports, supplied by Transport Focus; and

Train punctuality and timetable data, supplied by Abellio Greater Anglia (AGA).

In discussion with Transport Focus it was agreed that:

Due to potential complications resulting from weekend engineering works, NRPS respondents travelling at weekends would be excluded from the analysis;

Train punctuality data used would be that for weekdays during the NRPS survey periods only; and

Cancelled services would be excluded from the study.

Findings from the analysis Impact of lateness on satisfaction with punctuality

The analysis shows the relationship between passenger satisfaction with punctuality as measured by the NRPS and actual lateness experienced by the passenger concerned. Do passengers notice an increase in lateness? How significant is the impact on their satisfaction?

Across all passengers surveyed in the study period:

82 per cent express satisfaction with punctuality when their service arrives early or on time; and

For every minute of lateness, satisfaction with punctuality decreases by three percentage points.

The characteristics of a passenger’s journey can influence how they perceive lateness. Typically, those passengers who travel more frequently are less satisfied and are more sensitive to worsening punctuality. The following graphs illustrate this for different journey purposes and

55

travel frequency. Given that these characteristics are clearly linked – commuters travel most frequently – the graphs have similarities.

For journey purpose (as shown in the figure below):

Commuters are less tolerant of lateness than business and leisure travellers; only 74.9 per cent of commuters are satisfied with punctuality when their train is on time;

94 per cent of leisure travellers are satisfied when their train is on time;

For every minute of lateness, commuters’ satisfaction with punctuality declines by five percentage points; this suggests that those passengers who travel most frequently are influenced by previous punctuality experiences when responding to the survey;

Leisure travellers’ satisfaction with punctuality decreases by just one percentage point for every minute of lateness; and

The rate of decline for leisure travellers increases at the eight minute mark, indicating that leisure passengers have heightened awareness of lateness from this point.

For travel frequency (as shown in the figure below):

Passengers travelling more frequently express a lower satisfaction rate than those travelling less frequently even when their service arrives early or on time; their reaction to increased lateness is almost identical to that of commuters; and

Passengers travelling between one and eight times per month respond to lateness in the same way as passengers travelling less than once a month. This indicates that the satisfaction rate of less frequent travellers is defined by their journey purpose rather than their frequency of travel.

0%

20%

40%

60%

80%

100%

0 1 2 3 4 5 6 7 8 9 10-11 12-15

Prop

ortio

n of

pas

seng

ers

satis

fied

Lateness (minutes)

Changes in satisfaction with punctuality with an increase in minutes of lateness (by journey purpose)

Leisure Commuters Business

56

Extending this to ticket type, the trend continues. Respondents using weekly, monthly and annual season tickets are less satisfied with punctuality, even when on time. When experiencing delays, their satisfaction with punctuality also declines at a faster rate than those on full and reduced tickets (typically bought by less frequent travellers).

Changes to passenger lateness and satisfaction over time

When a comparison between satisfaction and lateness is considered year by year, conclusions may be drawn about whether passengers’ satisfaction with punctuality follows the trend of the punctuality actually experienced. Most notably (as shown in the figure below):

Of the passengers surveyed, the proportion of passengers arriving within five minutes of their scheduled time increased marginally from 89 per cent (2012) to 91 per cent (2014);

The proportion of passengers arriving on time or early decreased in 2013, but increased again in 2014; and

The response of passengers in terms of their satisfaction with punctuality follows a similar trend, with a dip seen in 2013, followed by a recovery in 2014.

Note that the graph below is only representative of the respondents who were successfully mapped to punctuality data.

Impact of lateness on overall satisfaction

Many years of NRPS results has enabled Transport Focus to determine that satisfaction with punctuality is the key driver for overall satisfaction. As a result, it is expected that the trend

0%

20%

40%

60%

80%

100%

0 1 2 3 4 5 6 7 8 9 10-11 12-15Prop

ortio

n of

pas

seng

ers

satis

fied

Lateness (minutes)

Changes in satisfaction with punctuality with an increase in minutes of lateness (by frequency of travel)

Three or more times a week One to eight times per month Less than once a month

89% 88% 91%

63%56% 60%

73% 72% 75%

0%

20%

40%

60%

80%

100%

2012 2013 2014

Prop

ortio

n of

pas

seng

ers

Year

NRPS matched passenger lateness vs passenger satisfaction with punctuality

Proportion of passengers arriving within five minutes of scheduled time (RT5)Proportion of passengers arriving early or on time (RT)Satisfaction with punctuality

57

between satisfaction and increased lateness to apply to overall satisfaction as well. While other factors clearly influence a passenger’s overall satisfaction, the graph below shows that lateness does play a key part. The key findings are (as shown in the figure below):

Only 83 per cent expressed overall satisfaction with their service when arriving early or on time; and

For each minute of lateness, the overall satisfaction reduces by 1.5 percentage points.

This does not prove a relationship, but indicates that passenger’s overall responses are influenced by punctuality.

This is supported when considering how passengers’ satisfaction with punctuality and overall satisfaction has changed over the three year study period. Both satisfaction with punctuality and overall satisfaction in 2014 improved in comparison with 2012, as shown in the figure below. Note that the data for this graph is taken from the respective NRPS reports and represents the full survey, not just the matched data.

Impact of satisfaction with punctuality on responses to other NRPS questions

The analysis carried out also considers the impact that passenger satisfaction with punctuality has on responses to other NRPS questions, e.g. satisfaction with train cleanliness and crowding. There are three categories of relationship:

Satisfaction drives satisfaction (satisfaction with punctuality drives positive responses to other questions);

Dissatisfaction drives dissatisfaction (dissatisfaction with punctuality drives negative responses to other questions); and

0%10%20%30%40%50%60%70%80%90%

100%

0 1 2 3 4 5 6 7 8 9 10-11 12-15

Prop

ortio

n of

pas

seng

ers

satis

fied

Lateness (minutes)

Changes in overall satisfaction with an increase in minutes of lateness

74% 78% 80%70%

75% 76%

0%

20%

40%

60%

80%

100%

2012 2013 2014

Prop

ortio

n of

pas

seng

ers

satis

fied

Year

NRPS respondents satisfaction with punctuality and overall satisfaction

Overall satisfaction Satisfaction with punctuality

58

No significant relationship.

The table below allocates NRPS questions to each category, with the strongest relationship at the top of each column. For example, satisfaction with punctuality drives satisfaction with scheduled journey time in a positive direction. Conversely, dissatisfaction with punctuality means passengers are more likely to be dissatisfied with the value for money of their ticket. Note that the relationship with overall satisfaction, discussed earlier, has also been included in this table. The analysis suggests that satisfaction with punctuality drives overall satisfaction, but dissatisfaction with punctuality does not have the same impact on overall dissatisfaction.

Satisfaction with punctuality drives satisfaction

Dissatisfaction with punctuality drives dissatisfaction

No significant relationship

Overall satisfaction

Scheduled journey time

Value for money of ticket

Sufficient space to sit and stand

Ease of getting on and off the train

Train cleanliness

Comparing train and passenger lateness

The analysis reported up to this point is based on the lateness the passenger experiences. It is important to understand that this can be significantly different from the train lateness that is widely reported by the rail industry in the form of the Public Performance Measure (PPM) and ’right-time’ arrivals. The graph below highlights this by considering only services travelling away from London. The reason these services have been chosen is because the destination of the passenger and of the train is likely to be different. The graph shows there is a one minute lag between the two lines (as shown in the figure below). This means:

If a train from London is reported as being on time, the average passenger will be one minute late; and

On services departing London, 69 per cent of trains arrive at their ultimate destinations on time or early, compared with 56 per cent of passengers arriving at their station on time or early.

0%

5%

10%

15%

20%

25%

30%

-5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 101112131415161718192021222324252627282930

Prop

ortio

n of

pas

seng

ers/

trai

n

Lateness (minutes)

Lateness of train at passenger destination vs train destination (departures from London)

Passenger Train

59

Passenger satisfaction insight

During the analysis, some useful insight was also gained into how passenger satisfaction varies by passenger characteristic.

Satisfaction by gender: In general female respondents show higher levels of satisfaction – both with punctuality and overall – than male respondents; the difference ranging from two to seven percentage points over the past three years.

Satisfaction by age: Older age groups are considerably more satisfied than younger age groups (as shown below).

Satisfaction by route: All routes have generally been improving with respect to satisfaction with punctuality. None more so than Stansted Express which has satisfaction levels 13 percentage points higher than any other route in 2014, although this may be related to changes in the composition of the Stansted Express building block within NRPS.

0%10%20%30%40%50%60%70%80%90%

100%

16-25 26-34 35-44 45-54 55-64 65+

Prop

ortio

n of

pas

seng

ers

satis

fied

Age groups

Satisfaction with punctuality by age

2012 2013 2014

.

.

Contact Transport Focus

Any enquiries regarding this research should be addressed to:

Mike HewitsonHead of Policy and IssuesTransport Focust 0300 123 0830e [email protected] www.transportfocus.org.uk

Fleetbank House 2-6 Salisbury Square London EC4Y 8JX

Transport Focus is the operatingname of the Passengers’ Council

Published in November 2015© 2015 Transport Focus