22
#AnalyticsX Copyright © 2016, SAS Institute Inc. All rights reserved. Holiday Demand Forecasting Yue Li Senior Research Statistician Developer SAS

Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

#AnalyticsXC o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Holiday Demand Forecasting

Yue LiSenior Research Statistician DeveloperSAS

Page 2: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Background

Holiday demand modeling techniques

Weekend day

Holiday dummy variable

Two-stage methods

Results

Discussions

Outline

Page 3: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Background: Motivation Importance of accurate electric demand forecasting

system operations and planning

energy trading

demand side management

Challenges of holiday electric demand forecasting

Limited historical data

Changing demand profile across holidays and/or across years for the same holiday

Page 4: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Background: Data Hourly load and temperature data of ISO (Independent

System Operator) New England

1

ˆ1| | 100%

N

t t

t t

y yMAPE

N y

Source: http://www.ferc.gov/market-oversight/mkt-electric/new-england.asp

Page 5: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Background: Data 10 US Federal Holidays

Page 6: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Background: Data Hourly demand on each holiday from 2004 to 2008

Page 7: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Background: Benchmark Model

0 1 2 3 4 5( ) ( )

t t t t t t t t i tiLoad Trend M W H W H f T f T

242 3 2 3

1 2 3 4 5 6 1

1 where ( ) and

24t i t i t t i t t i t t i t t i t t i t t t hh

f T T M T M T M T H T H T H T T

Load by month (M) Weekly load profile (W) Load by hour (H)

PROC GLM in SAS/STAT®

Page 8: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Modeling Holiday as WeekendsSunday Saturday

Alternate the weekday code to weekend (Saturday or Sunday)

Page 9: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Modeling Holidays using Dummy Variables

Thanksgiving Day Weekly load profile

Not similar to any weekday or weekend day

Page 10: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Modeling Holidays using Dummy Variables

0 1 2 3 4 5( ) ( ) +Holiday

t t t t t t t t i tiLoad Trend M W H W H f T f T

0 1 2 3 4 5( ) ( ) +Holiday*

t t t t t t t t i t tiLoad Trend M W H W H f T f T H

Page 11: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Two-stage Method - Naive

Final forecasts = Load forecasts + Residual forecasts

• Stage 1: load forecasted from benchmarkmodel with or without treating holiday asweekend day

• Stage 2: residual forecasted from the mean ofthe model fit residuals

Page 12: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Two-stage Method – Rule Based

Page 13: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Two-stage Method – Rule Based

Final forecasts = Load forecasts + Residual forecasts

• Stage 1: load forecasted from benchmarkmodel with or without weekday effect

• Stage 2: For holiday occurred on each day-of-week: compare the hourly residual profilewith non-holiday residual profile in each day-of-week and the holiday model fit residuals tocome up with the rule. Use the rule togenerate residual forecasts

Page 14: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Two-stage Method – Rule BasedExample Rules:

If New Year’s Day is on Monday then treat it as Sunday

If New Year’s Day is on Friday then treat it as Sunday

If July 4th is on Monday then treat it as Sunday

If July 4th is on Friday then treat it as Saturday

If Veteran’s Day is on Friday then treat it as Friday

If Christmas Day is on Monday then treat it as Sunday

Page 15: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Two-stage Method – Rule Based Data driven rule based model

For same-date holidays

Different residual patterns for different Day-of-Week

Can incorporate experts’ judgements

Page 16: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Results

Out-of-sample MAPEs of Holiday Demand Forecasts from Different Holiday Demand Modeling Techniques

July 4th Thanksgiving

Page 17: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Results

Page 18: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Discussion

Page 19: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Discussion

Page 20: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

DiscussionGradient Boosting Model (GBM)

A stage wise method to fit residuals

Popularity

SAS® Enterprise Miner

1%

3%

5%

7%

9%

11%

13%

15%

1 2 3 4 5 6 7 8 9 10

Holi

day M

AP

E

Holiday

Benchmark GBM Residual

Page 21: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#analyticsx

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

Conclusion Different holiday demand forecasting requires different

technique

Overall, the two-stage methods perform well

The availability of the historical data also impacts the selection of holiday demand modeling method

Page 22: Holiday Demand Forecasting - Sas Institute · Different holiday demand forecasting requires different technique Overall, the two-stage methods perform well The availability of the

C o p y r ig ht © 201 6, SAS In st i tute In c. A l l r ig hts r ese rve d.

#AnalyticsX