50
RES Easter School 2012 The Economics and Econometrics of Forecasting Jennifer L. Castle Birmingham University April 2012 Lecture 4: Nowcasting Castle (Oxford) Forecasting April 2012 1 / 50

RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

RES Easter School 2012The Economics and Econometrics of

Forecasting

Jennifer L. Castle

Birmingham University

April 2012

Lecture 4: Nowcasting

Castle (Oxford) Forecasting April 2012 1 / 50

Page 2: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Why nowcast?

24 July 2009 ONS official GDP growth data:0.8% decline in GDP for 09Q2

Much worse than anticipated – severe forecast failure.

Financial Times (25 July 2009):

‘the ONS said that its estimates were even less reliable thannormal because the economy’s unpredictability meant itsmodels had “broken down” .’

National Institute (Mitchell, 2009):

Performance of statistical nowcasting models deterioratedwith onset of recession.

Current nowcasting methods break down when structuralbreaks/turning points.Consider reasons for nowcasting and implications for how to producerobust nowcasts.

Castle (Oxford) Forecasting April 2012 2 / 50

Page 3: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Problems

Missing data – not all disaggregated contemporaneous dataavailable to construct aggregate.Statistical agencies views differ on optimal trade-off betweentimeliness and accuracy.

Measurement error – ‘flash’ estimates subject to potentiallysubstantial revisions.Not reliable and accurate guide to current conditions.

Changing database – different components unavailable indifferent periods and missing on non-systematic basis.

Breaks – Nowcasts act as ‘early warning signals’ when they differradically from the measured series.Rapid action to update/account for breaks, or warn ofmeasurement error.

Castle (Oxford) Forecasting April 2012 3 / 50

Page 4: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

GDP outturns: initial and latest estimates

Source: Bank of England Quarterly Bulletin, Autumn 2005, p.338

Castle (Oxford) Forecasting April 2012 4 / 50

Page 5: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Timing/sources of information

Why nowcasting differs from forecasting:Contemporaneous Observations

Sources of contemporaneous data:

Disaggregates available closer to nowcast origin (e.g. retail sales);

Covariates available at higher frequencies/more timely (e.g. newpassenger car registrations, construction output, industrial neworders, road traffic, air passenger numbers, energy consumption);

Surveys (business/consumer plans and expectations);

Google Trends data (Choi and Varian, 2009);

Prediction markets (Croxson and Reade, 2008).

Castle (Oxford) Forecasting April 2012 5 / 50

Page 6: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Variable of interest

Objective: nowcast of aggregate yT .where:

yt =

N∑i=1

wiyi,t, (1)

yi,t disaggregates;

wi weights.

Data released with varying time delays: at T some componentsobserved, some unavailable until T + δ.At T :

J known components;

N − J unknown components.

J not fixed, sets not uniquely defined.

Castle (Oxford) Forecasting April 2012 6 / 50

Page 7: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Aggregates versus disaggregates

Forecast aggregate using aggregate information:

yT |T−δ∗ = f(Y0T−1,Z

0T−δ∗

),

Forecast disaggregates unknown at T :

yi,T |T−δ∗ = f(y0i,T−δ,Z

0T−δ∗

), i = J + 1, . . . , N,

and aggregate with the known data:

yT |T =

J∑i=1

wiyi,T +

N∑i=J+1

wiyi,T |T−δ∗

Castle (Oxford) Forecasting April 2012 7 / 50

Page 8: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Aggregates versus disaggregates

Forecast aggregate, conditioning on aggregate and disaggregateinformation.

Balanced panel:

yT |T−δ = f(Y0T−δ,y

0i,T−δ,Z

0T−δ

), ∀i ∈ N,

Unbalanced panel:

yT |T = f(Y0T−1; y0

1,T , . . . ,y0J,T ,y

0J+1,T−δ, . . . ,y

0N,T−δ; Z

0T−δ∗

),

– results in ‘ragged edge’ problem.

Castle (Oxford) Forecasting April 2012 8 / 50

Page 9: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Aggregates versus disaggregates

Can be shown that when predicting the aggregate, nothing is lost bydirectly predicting from disaggregate information, without predictingdisaggregates.

yT = w1y1,T + (1− w1) y2,T (2)

Assume J = 0. DGP for the disaggregates is:

yi,t = γ′ixt−1 + ηi,t (3)

where xt−1 = (y1,t−1, . . . , yN,t−1; zt−1)′ so:

ET−1 [yi,T | xT−1] = γ′ixT−1 for i = 1, 2 (4)

Castle (Oxford) Forecasting April 2012 9 / 50

Page 10: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Aggregates versus disaggregates

Aggregating delivers:

ET−1 [yT | xT−1] =

(2∑i=1

wiγ′i

)xT−1 = ψ′xT−1 (5)

Predicting yT directly from xT−1 yields:

ET−1 [yT | xT−1] = π′xT−1 (6)

Since the left-hand sides of (5) and (6) are equal:

π′xT−1 = ψ′xT−1 (7)

so nothing is lost by predicting yT directly, instead of aggregatingcomponent predictions once the same information set xT−1 is used forboth.

Castle (Oxford) Forecasting April 2012 10 / 50

Page 11: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Aggregates versus disaggregates

Hendry and Hubrich (2009) generalize to non-constant weights,changing parameters.Does not mitigate breaks.

BUT contemporaneous information is available at T –unbalanced panel

helps distinguish between breaks and measurement errorespecially when breaks occur simultaneously across thedisaggregates (or a subset)

Need a combination of forecasting unknown disaggregates, augmentedwith structural break detection

Current methods – dynamic factor models/MIDAS.

Castle (Oxford) Forecasting April 2012 11 / 50

Page 12: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Selecting nowcasting models

Nowcasts required of N − J unknown disaggregates.GUM:

yi,t = β′xt−1 + α′ft−1 +

T−1∑j=1

ςj1tj=t + νt, i = J + 1, . . . , N (8)

xt−1: all available information (lagged disaggregates, survey data,leading indicators)

ft−1: set of q latent common factors (ft = Λ′yd,t);

1tj=t: set of T − 1 impulse-indicators.

Selection using Autometrics (Doornik, 2009a, Doornik, 2009b) formore variables than observations (and ∴ perfect collinearity)Forecasts:

yi,T |T−1 = γ′x∗T−1 + θ′f∗T−1 + ς ′dT−1 (9)

Castle (Oxford) Forecasting April 2012 12 / 50

Page 13: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Nowcasting strategy

If break occurs in J observed disaggregate series,use information to improve forecast yi,T |T−1, i = J + 1, . . . , N .

1 Detect whether break occurred at T

yi,T = β′xt−1 + ρ′ft−1 +

T∑j=1

ςj1tj=t + vt, i = 1, . . . , J ; t = 1, . . . , T.

(10)Test whether ςT significant

Conservative significance level: 0.5% ≤ α ≤ 0.1%(Conventional tests low or no power at end-point)Forecast error:

ei,T = yi,T − yi,T |T−1, i = 1, . . . , J,

Castle (Oxford) Forecasting April 2012 13 / 50

Page 14: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Nowcasting strategy

2 If evidence of break at T , adjust N − J unknown disaggregates(role of judgment).

Is break thought to be:

permanent or transitory?– measurement error or location shift;

idiosyncratic or common?– correlated with unknown disaggregates at T .

Forecasting rule:

yi,T |T = (1− Ik) yi,T |T−1 + Iky∗i,T |T , i = J + 1, . . . , N, (11)

where Ik = 1 when kαJ ≥ p for p =∑J

i=1 1T and y∗i,T |T interceptcorrected forecast

Castle (Oxford) Forecasting April 2012 14 / 50

Page 15: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Nowcasting strategy

IC forecast:

y∗i,T |T = yi,T |T−1 +1

p

p∑j=1

ςp,T (12)

Or weighted average based on correlations between the disaggregates.

IC analogous to setting forecast back on track but across disaggregateseries as opposed to through time.

Error variance equal to uncorrected error variance.

Contrast to standard intercept correction that sets forecast back ontrack and doubles the error variance.

Alternative: differencing – doesn’t impose break magnitude butdoubles error variance.

Castle (Oxford) Forecasting April 2012 15 / 50

Page 16: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Intercept correction

Let:yi,T = ψiyi,T−1 + vi,T (13)

when Ik = 0: yi,T |T−1 = ψiyi,T−1;

when Ik = 1: y∗i,T |T = yi,T |T−1 + µp,T ;

where µp,T =∑p

j=1 ςp,T

Forecast error:

v∗i,T = yi,T − y∗i,T |T= vi,T − µp,T (14)

vi,T = forecast error from uncorrected forecast

V[v∗i,T

]≈ V [vi,T ] as µp,T nearly a fixed constant for each i when J is

large.

Castle (Oxford) Forecasting April 2012 16 / 50

Page 17: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Refinements

Split disaggregates into blocks corresponding to groups of variables(e.g. industrial production, prices, financial variables, interest rates,labour variables, housing market variables, etc.)

Requirements:

close linkages: breaks likely to spread within block;

different release timings;

common trends or cycles for subsets of disaggregates

Apply intercept correction to each block separately.

Strategy is computationally feasible, allows for breaks in-sample and atnowcast origin, employs full information set but relies on someproportion of known disaggregates containing signal about unknowndisaggregates

Castle (Oxford) Forecasting April 2012 17 / 50

Page 18: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Measurement errors versus breaks

Signal extraction problem at T .

If yi,T |T−δ differs significantly from yi,T :

outlier due to measurement error?

more permanent location shift?

combination of both?

observationally equivalent with one data point

Measurement errors ⇒ autocorrelated residuals but only fewobservations to detect.

Residual analysis needed at end of sample

Castle (Oxford) Forecasting April 2012 18 / 50

Page 19: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Residual analysis under measurement error

No measurement error: t = 1, . . . , T e

Data measured with error: s = T e, . . . , TDGP for disaggregates:

yi,t = ψiyi,t−1 + vi,t for t = 1, . . . , T ; i = 1, . . . , J (15)

vi,t ∼ IN[0, σ2vi

]; |ψi| < 1.

For 1, . . . , T e: model coincides with (15)For s = T e, . . . , T we observe yi,s = y∗i,s + ηi,s.

Assume ηi,s ∼ IN[0, σ2ηi

]; E[y∗i,sηi,t

]= 0 for all s, t.

(Systematic measurement error: e.g. E [ηi,s] = µηi 6= 0)

Castle (Oxford) Forecasting April 2012 19 / 50

Page 20: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Residual analysis under measurement error

For T e, . . . , T :

yi,s = ψiyi,s−1 + (vi,s + ηi,s − ψiηi,s−1) = ψiyi,s−1 + ei,s

When ψi = 1, residuals over s:

E [ei,s] ' 0

V [ei,s] ' σ2vi +(1 + ψ2

i

)σ2ηi

E [ei,sei,s−1] = ρi '−ψiσ2ηi

σ2vi +(1 + ψ2

i

)σ2ηi

ρi denotes late-onset error autocorrelation (assuming σ2ηi constant ass→ T )If last few residuals exhibit increase in variance andautocorrelation, more weight placed on measurement errorhypothesis

Castle (Oxford) Forecasting April 2012 20 / 50

Page 21: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Residual analysis under location shifts

Alternatively, indicator-impulse saturation used to detect late onsetshiftsSome cases can be justified ex ante (e.g. VAT changes).

Problem:

Measurement error and location shifts at T require differentforecasting models.

Measurement error ⇒ EWMA schemes optimal

Location shift ⇒ intercept correction and differencingBut exacerbates impact of measurement errors

Location shift requires + IC for nowcast periodMeasurement error requires − one-off IC to offset error

Resolving conflict between opposite responses is central toaccurate nowcasting

Castle (Oxford) Forecasting April 2012 21 / 50

Page 22: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Measurement errors versus breaks

Can we distinguish between location shifts and measurementerrors?

measurement error at T does not ‘carry forward’, although effectswill in dynamic process;

data at T usually revised: revisions to errors at T + 1 informativeabout source of error from T to T + 1;

next nowcast error (from T + 1 to T + 2) large if source is locationshift, ∴ repeated mis-forecasting indicative of location shift;

extraneous contemporaneous data help to discriminate:discrepancy from existing models persist or disappear;

variance of measurement errors usually changes as the forecastorigin approaches.

Castle (Oxford) Forecasting April 2012 22 / 50

Page 23: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Measurement errors versus breaks

Simplest model:yt = y∗ + εt (16)

where εt ∼ IN[0, σ2ε

].

Three cases:

y∗ is constant – measurement error;

εt = 0 ∀t but y∗ alters – location shift;

both y∗ shifts and εt 6= 0

Nowcast at time T from estimation sample 1, . . . , T − δ for small δSequence of nowcasts as if in real time, at T + 1, T + 2 etc.

Castle (Oxford) Forecasting April 2012 23 / 50

Page 24: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

1. Measurement errors only

ET+1 [yT+1 | IT+1] = ET+1 [(y∗ + εT+1)] = y∗ (17)

Despite measurement error, 1-step minimum MSE forecasting device:

yT+1|T = y(T ) =1

T

T∑t=1

yt.

Thus:

ET+1

[yT+1|T | IT+1

]= y∗

VT+1

[yT+1|T

]= σ2ε

(1 +

1

T

)Full-sample estimate y(T ) of y∗ is unbiased predictor, with

smallest variance of any sample size choice, which is just 1T

larger than nowcast from the known location y∗.Castle (Oxford) Forecasting April 2012 24 / 50

Page 25: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

2. Location shifts only

Best predictor of yT+1 is yT+1|T = yT .

When no location shifts, yT+1|T = yT = y∗ is exact;When shift at T (∇(T )y

∗) a one-period mistake is made:

yT+1 − yT+1|T = yT+1 − yT = ∇(T )y∗

nowcast at T + 2 unbiased if process remains constant:

yT+2 − yT+2|T+1 = yT+2 − yT+1 = 0.

Best 1-step predictor is lagged value, uses smallest possiblesample size – final observation – ignoring all earlier observations.

Castle (Oxford) Forecasting April 2012 25 / 50

Page 26: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

3. Cross solutions

1 Use yT+1|T = yT but only measurement error:

ET+1

[yT+1|T

]= ET+1 [yT ] = y∗

VT+1

[yT+1|T

]= 2σ2ε

Predictor unbiased but variance increases by (T − 1) /T .

2 Use yT+1|T when εt = 0 ∀t but location shift (∇(τ)y∗):

ET+1

[yT+1 − yT+1|T

]=τ∗∇(τ∗)y

T

y(T ) is biased predictor – impact of in-sample breakunder-estimated when not modelled. Either model break oruse rolling sample spanning post-break period.

Castle (Oxford) Forecasting April 2012 26 / 50

Page 27: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Measurement errors and location shifts

DGP: yT+1 = y∗a + εT+1 and yT+2 = y∗a + εT+2 where nounmodelled in-sample shifts, but:

y∗a = y∗ +∇(T+1)y∗

and after data revision at T + 2:

yT+1 = y∗a + εT+1

y(T ) minimum MSE estimator of y∗, with variance σ2εT−1 on

average;

yT+1 − yT+1 estimates revision error;

yT+1 − yT and yT+1 − yT estimate ∇(T+1)y∗ imprecisely;

VT+1 [εT+1] and VT+2 [εT+2] larger than σ2ε

Castle (Oxford) Forecasting April 2012 27 / 50

Page 28: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Measurement errors and location shifts

(yT+1 + yT+2) /2 estimates y∗a with variance of 14

(σ2ε + VT+2 [εT+2]

),

combining with y estimated up to T , and the estimate of ∇(T+1)y∗

gained from yT+1 − yT yields:

y∗a =1

2

(y(T ) + (yT+1 − yT ) +

1

2(yT+1 + yT+2)

)(18)

with:

VT+2 [y∗a] =1

4

(σ2ε

(2 +

1

T

)+

1

4

(σ2ε + VT+2 [εT+2]

))

Weighted estimator (18) has lower variance under certain conditions,see Castle and Hendry (2010).Signal extraction suggests using both latest yT+1 and yT , whereweights vary with measurement error variance.

Castle (Oxford) Forecasting April 2012 28 / 50

Page 29: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Empirical application

Empirical application from Castle, Fawcett, and Hendry (2009).Compute nowcasts of Euro-area quarterly GDP growthQuarterly observations indexed by t;τ denotes the monthly index, with t = 3τ .Three releases:Flash estimate ≈43 days after reference quarter;Two revised releases in following consecutive months.Denote releases as vintages:

yv1t released at τ + 2

yv2t released at τ + 3

yv3t released at τ + 4

Survey data – 0 publication lagOther data (e.g. industrial production, financial variables) releasedwith intermediate lag of between 1 and 3 months.

Castle (Oxford) Forecasting April 2012 29 / 50

Page 30: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Data

Label Description Lag releaseYt real GDP, million, constant prices 2,3,4IPt industrial production index (NSA) 3IPCt industrial production index for construction (NSA) 3SCIt service sector confidence indicator (survey) 0RSt retail trade index, except motor vehicles, constant prices 2CARSt new passenger car registrations, total 2MCIt industry confidence indicator (survey) 0ESIt economic sentiment indicator (base=100) 0CCIt consumer confidence indicator (survey) 0RCIt retail trade confidence indicator (survey) 0EERt real effective exchange rate, CPI deflated, core group 1EUROXt Dow Jones Euro Stoxx Broad stock exchange index 1OECDLIt OECD composite leading indicator, Euro area, trend restored 0EUROCOINt Eurocoin indicator 0URt unemployment rate, total 2M1t Index of notional stock, money M1 2SPREADt =(3MTB-10YB)/100 1

Castle (Oxford) Forecasting April 2012 30 / 50

Page 31: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Nowcasts

Calculate nowcasts for period 2003Q2–2008Q1, (20 observations).

For each quarter, compute 3 nowcasts of quarterly GDP growth;

H1 for month at end of reference quarter;

H2 for month after end of reference quarter;

H3 for second month after end of reference quarter.

Castle (Oxford) Forecasting April 2012 31 / 50

Page 32: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Timing of nowcasts and data releases

M1 M2 M3 M4 M5 M6 M7 M8 M9 M10 M11 M12

H1 H2 H3Q1yv1t yv2

t yv3t

H1 H2 H3Q2yv1t yv2

t yv3t

H1 H2 H3Q3yv3t yv1

t yv2t

H2 H3 H1Q4yv1t yv2

t yv3t

Castle (Oxford) Forecasting April 2012 32 / 50

Page 33: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Empirical Specifications

[A] Benchmark quarterly univariate models:

H1 : ∆yt = f(∆yv1

t−1, . . . ,∆yv1t−4; ∆yv2

t−1, . . . ,∆yv2t−4; ∆yv3

t−2, . . . ,∆yv3t−4

)H2 : ∆yt = f

(∆yv1

t−1, . . . ,∆yv1t−4; ∆yv2

t−1, . . . ,∆yv2t−4; ∆yv3

t−1, . . . ,∆yv3t−4

)H3 : ∆yt = f

(∆yv1

t , . . . ,∆yv1t−4; ∆yv2

t−1, . . . ,∆yv2t−4; ∆yv3

t−1, . . . ,∆yv3t−4

)[B] Benchmark quarterly models with covariates:

Conditioning variables xt = (∆ipt , ∆ipct, ∆SCIt, ∆rst, ∆CARSt,∆MCIt, ∆ESIt, ∆CCIt, ∆RCIt, ∆eert, ∆euroxt, ∆oecdlit,∆EUROCOINt, ∆urt, ∆m1t, SPREADt), and (xr1

t , xr2t , xr3

t ).

[C] Disaggregate nowcasts

1-step ahead forecasts from recursively-selected models for each horizon.

Castle (Oxford) Forecasting April 2012 33 / 50

Page 34: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Methodology

1 Obtain forecasts for monthly variables released with lagAutomatic Gets with IIS at α = 1%Direct forecasts, depending on publication lagModels selected and estimated recursivelyRecord retained final observation impulsesAlso test for final observation impulses in contemporaneous data(surveys)

2 Compute nowcasts of GDP growthCreate quarterly time series for monthly variables:

xr1t = xτ−2, xτ−5, xτ−8, . . .

xr2t = xτ−1, xτ−4, xτ−7, . . .

xr3t = xτ , xτ−3, xτ−6, . . .

Castle (Oxford) Forecasting April 2012 34 / 50

Page 35: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Methodology

Form GUM with all three quarterly series– avoids aggregation issue and allows all monthly data to be includedin quarterly model

GUM includes all in-sample data for the conditioning variables andlatest available vintage of GDP growth.

Models selected recursively with IIS for each nowcast origin and eachnowcast horizon

Nowcasts computed by plugging in forecasts for variables selected butunknown at nowcast horizon.

Nowcasts compared to actuals given by final available vintage of data,(December 2008).

1 Adjustments made if significant impulses at T .

Castle (Oxford) Forecasting April 2012 35 / 50

Page 36: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Stage 1: GUM specification

Forecast GUM Variables ESE RMSE

∆ipτ ∆ipτ−3,...,τ−12; ∆ipcτ−3,...,τ−12; SCIτ,...,τ−12;C;S;I 1.02% 1.32%

∆ipcτ ∆ipτ−3,...,τ−12; ∆ipcτ−3,...,τ−12; SCIτ,...,τ−12;C;S;I 2.04% 3.83%

∆rsτ ∆rsτ−2,...,τ−12; ∆CARSτ−2,...,τ−12; ∆ipτ−3,...,τ−12;∆ipcτ−3,...,τ−12;C;I 0.59% 0.63%

∆CARSτ ∆rsτ−2,...,τ−12; ∆CARSτ−2,...,τ−12; ∆ipτ−3,...,τ−12;∆ipcτ−3,...,τ−12;C;I 2.81% 3.41%

∆eerτ ∆eerτ−1,...,τ−12; ∆euroxτ−1,...,τ−12; SPREADτ−1,...,τ−12;C;I 1.30% 1.08%

∆euroxτ ∆eerτ−1,...,τ−12; ∆euroxτ−1,...,τ−12; SPREADτ−1,...,τ−12;C;I 2.22% 3.33%SPREADτ ∆eerτ−1,...,τ−12; ∆euroxτ−1,...,τ−12; SPREADτ−1,...,τ−12;C;I 0.14% 0.16%

∆urτ ∆urτ−2,...,τ−12; ∆rsτ−2,...,τ−12; ∆ipτ−3,...,τ−12;∆ipcτ−3,...,τ−12; ESIτ,...,τ−12; C;I 0.35% 0.56%

∆m1τ ∆m1τ−2,...,τ−12; SPREADτ−1,...,τ−12; ∆ipτ−3,...,τ−12;∆ipcτ−3,...,τ−12; ∆rsτ−2,...,τ−12; C;I 0.47% 0.89%

Castle (Oxford) Forecasting April 2012 36 / 50

Page 37: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Stage 1: GUM specification

GUM includes: SCIrjt−i, MCI

rjt−i, ESI

rjt−i, CCI

rjt−i, RCI

rjt−i,

SPREADrjt−i, ∆ip

rjt−i, ∆ipc

rjt−i, ∆rs

rjt−i, ∆CARS

rjt−i, ∆eer

rjt−i,

∆euroxrjt−i, ∆oecdli

rjt−i, ∆ur

rjt−i, ∆EUROCOIN

rjt−i, ∆m1

rjt−i, for

i = 0, . . . , 2 and j = 1, 2, 3, an intercept and impulse indicatordummies.Also LDVs:

H1 : ∆yv1t−1,∆y

v1t−2; ∆yv2

t−1,∆yv2t−2; ∆yv3

t−2H2 : ∆yv1

t−1,∆yv1t−2; ∆yv2

t−1,∆yv2t−2; ∆yv3

t−1,∆yv3t−2

H3 : ∆yv1t ,∆y

v1t−1,∆y

v1t−2; ∆yv2

t−1,∆yv2t−2; ∆yv3

t−1,∆yv3t−2

150–152 variables + T indicator dummies.Models selected recursively at α = 1%

Castle (Oxford) Forecasting April 2012 37 / 50

Page 38: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Stage 2: computing nowcasts

Nowcasts computed as:

∆yHkt = β′xt + γ′xt + δ′ιt (19)

xt – retained variables known at t for horizon k;

xt – forecasts for retained variables unknown at t for horizon k;

ιt – retained impulse indicators.

[C1] Ex post nowcasts – all disaggregates known

[C2] Disaggregate nowcasts (19)

[C3] Double differenced device: xτ = xτ−l

Castle (Oxford) Forecasting April 2012 38 / 50

Page 39: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Results

A B C1 C2 C3

H1 0.2951 0.9823 0.4340 0.7994 0.7531H2 0.3056 1.2245 0.4808 0.6372 0.6222H3 0.1486 1.0372 0.8320 0.8320 0.8320

Table: Actual RMSE for [A] and ratio of RMSE to the univariate benchmarkmodel [A] for [B] and [C].

Castle (Oxford) Forecasting April 2012 39 / 50

Page 40: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

MAE and RMSE for nowcasting models

A B C1 C2 C3

0.025

0.050

0.075

Mean Absolute Error (%)

H1

H2 H3

A B C1 C2 C3

A B C1 C2 C3

0.1

0.2

0.3

RMSE (%)

H1

H2 H3

A B C1 C2 C3

Castle (Oxford) Forecasting April 2012 40 / 50

Page 41: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Nowcast errors

A B C1 C2 C3

2003 2004 2005 2006 2007 2008

-0.005

0.000

0.005

0.010 Nowcast errors for H1A B C1 C2 C3

A B C1 C2 C3

2003 2004 2005 2006 2007 2008

-0.005

0.000

0.005

0.010 Nowcast errors for H2A B C1 C2 C3

A B C

2003 2004 2005 2006 2007 2008

-0.005

0.000

0.005

0.010 Nowcast errors for H3

A B C

Castle (Oxford) Forecasting April 2012 41 / 50

Page 42: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Results

Higher-frequency monthly data yields smaller RMSE, particularly overshort horizons

Main benefits come from:

rapid incorporation of information available at the monthlyfrequency;

accounting for outliers using IIS;

use of recursive selection and estimation to update models rapidly.

Little benefit to well-specified econometric models to forecast themonthly indicators as opposed to robust forecasting device such asDDD.

Castle (Oxford) Forecasting April 2012 42 / 50

Page 43: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Revisions

∆yv1t −∆yv2

t ∆yv1t −∆yv3

t ∆yv1t −∆y

vft

ME (%) 0.0045 -0.0059 -0.0674SD (%) 0.0214 0.0391 0.1583

Table: Magnitude of revisions over nowcast horizon

Substantial measurement errors in the first few vintages of data

Little information content in the revisions initially.

In nowcasting context, detecting measurement errors close tonowcast origin is difficult.

Castle (Oxford) Forecasting April 2012 43 / 50

Page 44: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Revisions to GDP growth

∆ytvf

(∆ytv1−∆yt

v2) (∆yt

v1−∆ytv3)

(∆ytv1−∆yt

vf)

2003 2004 2005 2006 2007 2008

-0.0025

0.0000

0.0025

0.0050

0.0075

0.0100

Revisions to GDP growth

∆ytvf

(∆ytv1−∆yt

v2) (∆yt

v1−∆ytv3)

(∆ytv1−∆yt

vf)

Castle (Oxford) Forecasting April 2012 44 / 50

Page 45: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Breaks in monthly indicators

Significant impulses at α = 1%:

∆ipcτ = 2005(12); 2006(1)

∆CARSτ = 2005(5); 2005(6)

MCIτ = 2003(12)

ESIτ = 2003(12)

∆urτ = 2006(4); 2007(7); 2007(9); 2008(1)

∆m1τ = 2005(1); 2005(6); 2006(12)

SPREADτ = 2007(8)

No impulses for ∆ipτ , SCIτ , ∆rsτ , CCIτ , RCIτ , ∆eerτ , ∆euroxτ ,∆oecdliτ and ∆EUROCOINτ .

Castle (Oxford) Forecasting April 2012 45 / 50

Page 46: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Monthly impulses at α = 1%

∆ytvf

Dummies

2002 2003 2004 2005 2006 2007 2008

0.002

0.004

0.006

0.008

0.010

0.012

∆ytvf

Dummies

Castle (Oxford) Forecasting April 2012 46 / 50

Page 47: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Robust nowcasts

Recall rule:∆yt = (1− Ik) ∆yt + Ik∆y

∗t (20)

∆yt nowcasts obtained from [C2];

∆y∗t DDD given by:

∆y∗t =

∆yv2

t−1 for H1

∆yv3t−1 for H2

∆yv1t for H3

C2 C2-adjust

H1 0.2359 0.2327H2 0.1948 0.2146H3 0.1236 0.1603

Castle (Oxford) Forecasting April 2012 47 / 50

Page 48: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

Conclusion

Nowcasting differs significantly from forecasting: problems ofmissing data, measurement errors, changing database, andbreaks.

Location shifts induce nowcast failure, but interact with measurementerrors to make discrimination difficult in the available time horizon.

Methodology includes Gets recursive selection for many covariates,higher frequency data, in-sample and end-point break detection, robustdevices.

Application suggests substantial gains to flash estimates.

Apparent ‘break down’ of the ONS’s current models, reported by theFinancial Times, shows the difficulty of nowcasting in times ofeconomic uncertainty and structural change.

Castle (Oxford) Forecasting April 2012 48 / 50

Page 49: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

References I

Castle, J. L., N. W. P. Fawcett, and D. F. Hendry (2009).Nowcasting is not just contemporaneous forecasting.National Institute Economic Review 210, 71–89.

Castle, J. L. and D. F. Hendry (2010).Nowcasting from disaggregates in the face of location shifts.Journal of Forecasting 29, 200–214.

Choi, H. and H. Varian (2009).Predicting the present with Google Trends.Unpublished paper, Economics Research Group, Google.

Croxson, K. and J. J. Reade (2008).Information and efficiency: Goal arrival in soccer betting.Mimeo, Economics Department, Oxford University.

Doornik, J. A. (2009a).Autometrics.In J. L. Castle and N. Shephard (Eds.), The Methodology and Practice of Econometrics, pp. 88–121. Oxford: Oxford

University Press.

Doornik, J. A. (2009b).Econometric model selection with more variables than observations.Working paper, Economics Department, University of Oxford.

Hendry, D. F. and K. Hubrich (2009).Combining disaggregate forecasts versus disaggregate information to forecast an aggregate.Journal of Business and Economic Statistics, DOI:10.1198/jbes.2009.07112.

Castle (Oxford) Forecasting April 2012 49 / 50

Page 50: RES Easter School 2012 The Economics and Econometrics of ... · Performance of statistical nowcasting models deteriorated with onset of recession. Current nowcasting methods break

References II

Hendry, D. F., S. Johansen, and C. Santos (2008).Automatic selection of indicators in a fully saturated regression.Computational Statistics 33, 317–335.Erratum, 337–339.

Castle (Oxford) Forecasting April 2012 50 / 50