31
Sta$s$cal postprocessing using reforecasts to improve medium range renewable energy forecasts Tom Hamill and Jeff Whitaker NOAA Earth System Research Lab, Physical Sciences Division [email protected] NOAA Earth System Research Laboratory

Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Sta$s$cal  post-­‐processing  using  reforecasts  to  improve  medium-­‐range  renewable  energy  forecasts  

Tom  Hamill  and  Jeff  Whitaker  NOAA  Earth  System  Research  Lab,  

Physical  Sciences  Division  [email protected]  

NOAA  Earth  System  Research  Laboratory  

Page 2: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Wind  energy  decisions    based  on  weather  forecasts  

•  Most  consequen$al  decisions  are  “unit  commitments”  (~  1  day)  and  then  updates  using  very  short-­‐range  forecasts  to  adjust.  

•  Less  consequen$al  O&M  decisions  might  be  based  on  longer-­‐lead  forecasts.  

•  Ques$ons:      –  Can  we  improve  long-­‐lead  forecasts  to  support,  say,  maintenance  decisions?  

–  Can  we  make,  say,  2-­‐day  forecasts  as  well  as  we  make  current  1-­‐day  forecasts  so  that  unit  commitment  decisions  might  be  made  further  in  advance?  

– What  new  data  sets  and  approaches  might  be  tried  to  improve  these  longer-­‐lead  forecasts?  

Page 3: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Current  assimila$on/forecast  process  

12Z  Obs   Data  Assimila$on  

Forecast  valid  12Z  

Analysis  valid  12Z  

Forecast  Model  

13Z  Obs   Data  Assimila$on  

Forecast  valid  13Z  

Analysis  valid  12Z  

…  

Forecast  valid  14Z   Forecast  valid  15Z   …  

Page 4: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Current  assimila$on/forecast  process  

12Z  Obs   Data  Assimila$on  

Forecast  valid  12Z  

Analysis  valid  12Z  

Forecast  Model  

13Z  Obs   Data  Assimila$on  

Forecast  valid  13Z  

Analysis  valid  12Z  

…  

Forecast  valid  14Z   Forecast  valid  15Z   …  

These  forecasts  used  to  help  make  decisions  about  how  much  wind  energy  can  be  provided.    Some$mes  direct  forecasts  are  used,  some$mes  with  sta$s$cal  adjustment.  

Page 5: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

12Z   14Z  13Z   15Z   17Z  16Z   18Z  

Wind  po

wer  

Analyzed  

Forecast  

Page 6: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

12Z   14Z  13Z   15Z   17Z  16Z   18Z  

Wind  po

wer  

Analyzed  

Forecast  F  minus  A  

Page 7: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

12Z   14Z  13Z   15Z   17Z  16Z   18Z  

Wind  po

wer   F  minus  A  

Errors  are  some  mix  of  systema$c  errors  due  to  the  forecast  model  deficiencies    and  random  errors  due  to  the  chao$c  growth  from  small  analysis  errors.  

Page 8: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

F  minus  A  

Page 9: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

F  minus  A  

0  

Page 10: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

F  minus  A  

0  

an  overall  bias  correc$on  should  result  in  a  modest  improvement  in  the  forecasts  

F  -­‐  A  

Page 11: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

F  minus  A  

0  

What  if  we  had  addi$onal  informa$on  such  as  the  wind  direc$on?    Then    perhaps  a  more  sophis$cated  sta$s$cal  correc$on  could  be  ahempted.  

F  -­‐  A  

N   N  

W  

E  E   E  

Page 12: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

F  minus  A  

0  

What  if  we  had  addi$onal  informa$on  such  as  the  wind  direc$on?    Then    perhaps  a  more  sophis$cated  sta$s$cal  correc$on  could  be  ahempted.    What  if  we  had  further  addi$onal    informa$on  such  as  sta$c  stability  “S”  ?  

F  -­‐  A  

N   N  

W  

E  E   E  

S  S   S   S   S   S  

Page 13: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Challenges  in  directly    using  forecast  guidance  

F  minus  A  

0  

What  if  we  had  addi$onal  informa$on  such  as  the  wind  direc$on?    Then    perhaps  a  more  sophis$cated  sta$s$cal  correc$on  could  be  ahempted.    What  if  we  had  further  addi$onal    informa$on  such  as  sta$c  stability  “S”  ?  

F  -­‐  A  

N   N  

W  

E  E   E  

S  S   S   S   S   S  

The  more  addi$onal  predictors  you  may  wish  to  include  in  some  sta$s$cal  correc$on  model,  the  longer  the  $me  series  of  forecasts  and  observa$ons  you  are  going  to  need.  

Page 14: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Reforecasts  (hindcasts)  

•  Numerical  simula$ons  of  the  past  weather  (or  climate)  using  the  same  forecast  model  and  assimila$on  system  that  (ideally)  is  used  opera$onally.      – Very  common  with  climate,  s$ll  uncommon  with  weather  models.  

•  Reforecasts  may  be  ini$alized  from  reanalyses,  but  reforecasts  ≠  reanalyses  

14  

Page 15: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

GEFS  reforecast  v2  details  •  Seeks  to  mimic  GEFS  (NCEP  Global  Ensemble  Forecast  System)  opera$onal  

configura$on  as  of  February  2012.  

•  Each  00Z,  11-­‐member  forecast,  1  control  +  10  perturbed.  

•  Reforecasts  produced  every  day,  for  1984120100  to  current  (actually,  working  on  finishing  late  2012  now).  

•  CFSR  (NCEP’s  Climate  Forecast  System  Reanalysis)  ini$al  condi$ons  (3D-­‐Var)  +  ETR  perturba$ons  (cycled  with  10  perturbed  members).    Aoer  ~  22  May  2012,  ini$al  condi$ons  from  hybrid  EnKF/3D-­‐Var.  

•  Resolu$on:  T254L42  to  day  8,    T190L42  from  days  7.5  to  day  16.  

•  Fast  data  archive  at  ESRL  of  99  variables,  28  of  which  stored  at  original  ~1/2-­‐degree  resolu$on  during  week  1.    All  stored  at  1  degree.    Also:  mean  and  spread  to  be  stored.  

•  Full  archive  at  DOE/Lawrence  Berkeley  Lab,  where  data  set  was  created  under  DOE  grant.  

15  

Page 16: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Status  •  00Z  reforecasts  1985-­‐late  2012  completed  and  publicly  available.  

•  Within  a  month  or  two,  we  will  be  pulling  real-­‐$me  GEFS  data  over  from  NCEP  and  purng  it  in  our  archive.  

•  Web  sites  are  open  to  you  now:  – NOAA/ESRL  site:  fast  access,  limited  data  (99  fields).  – US  Department  of  Energy:  slow  access,  but  full  data  set  

•  Soon:  experimental  probabilis$c  precipita$on  forecast  graphics  in  real  $me.  

16  

Page 17: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Data  to  be  readily  available  from  ESRL  

Also:  hurricane  track  files   17  

Page 18: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Data  to  be  readily  available  from  ESRL  

Also:  hurricane  track  files   18  

useful  for  wind  energy?  

Page 19: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Data  to  be  readily  available  from  ESRL  at  na$ve  resolu$on  (~0.5  degree  in  week  1,  ~0.7  degree  in  week  2)  

19  

Page 20: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Data  to  be  readily  available  from  ESRL  at  na$ve  resolu$on  (~0.5  degree  in  week  1,  ~0.7  degree  in  week  2)  

20  of  par$cular  relevance  for  hydro,  wind,  and  solar  renewable-­‐energy  forecas$ng  

Page 21: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

esrl.noaa.gov/psd/forecasts/reforecast2/download.html  

21  

Your  point-­‐and-­‐  click  gateway  to  the  reforecast  archive.    Produces    netCDF  files.    Also:  direct  op  access  to  allow  you  to  read  the  raw  grib  files.  

Page 22: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

This  DOE  site  will  be  ready  for  access  to    tape  storage  of  full  data  (slower).    Use  this  to    access  full  model  state.      

22  

Page 23: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Skill  of  raw  reforecasts  (no  post-­‐processing)  

23  

Page 24: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

500  hPa  Z  anomaly  correla$on  (from  determinis$c  control)  

Lines  w/o  filled  colors  for  second–genera$on    reforecast  (2012,  T254)    Lines  with  filled  colors  for  first-­‐genera$on  reforecast  (1998,  T62).    Perhaps  a  1.5-­‐2.5  day  improvement.    Some  change  in  skill  over  period  of  reforecast.  

24  

Page 25: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Sta$s$cal  post-­‐processing  using  reforecasts  

25  

Page 26: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Sta$s$cal  post-­‐processing  of  precipita$on  forecasts  

Probabili$es  directly  es$mated  from  ensemble  predic$on  systems  are  ooen  unreliable.    This  is  data  from  Jul-­‐Oct  2010,  when  the  GEFS  was  T190.    Can  we  sta$s$cally  post-­‐process  the  current  GEFS  using  reforecasts  and  improve  reliability  and  skill?  

26  

Page 27: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Reliability,  >  10  mm  precipita$on  24  h-­‐1  Ve

rsion  2  (2012  GE

FS)  

Day  +0-­‐1   Day  +2-­‐3   Day  +4-­‐5  

27  

Almost  perfect  reliability,  greatly  improved  skill  with  a  very  simple  sta$s$cal  post-­‐processing  algorithm  leveraging  the  long  reforecast  data  set.  

Page 28: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Applica$on  to  wind  energy:    what  if  there’s  no  $me  series  of  observed  data?  

28  

Say  you  don’t  have  observa$onal  or  analysis  data  widely  available  for  sta$s$cal  post-­‐processing.  How  can  you  leverage  reforecasts  to  tell  you  whether  or  not  today’s    weather  is  unusual?    Here’s  an  example  quan$fying  how  unusual  the  forecast  wind  speed  is  rela$ve  to  past  model  forecasts  of  wind  speed  for  a    similar  $me  of  the  year.      This  might  be  useful  for  making  decisions  for  wind  energy,  for  example.  

Page 29: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Conclusions  

•  Reforecast  data  set  has  been  created  for  current  opera$onal  NCEP  GEFS.  

•  Reforecast  data  and  real-­‐$me  forecasts  available  now,  or  will  be  soon.  

•  May  be  useful  for  sta$s$cal  calibra$on  and  developing  improved  products  for  renewable-­‐energy  forecasts.  

29  

Page 30: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

30  

An  example  of  a  sta$s$cal  correc$on  technique  using  those  reforecasts  

For  each  pair  (e.g.  red  box),  on  the  leo  are  old  forecasts  that  are  somewhat  similar  to  this  day’s  ensemble-­‐mean  forecast.    The  boxed  data  on  the  right,  the  analyzed  precipita$on  for  the  same  dates  as  the  chosen  analog  forecasts,  can  be  used  to  sta$s$cally  adjust  and  downscale  the  forecast.  

Analog  approaches  like  this  may  be  par$cularly  useful  for  hydrologic  ensemble  applica$ons,  where  an  ensemble  of  weather  realiza$ons  is  needed  as  inputs  to  a  hydrologic  ensemble  streamflow  system.    

Today’s  forecast  (&  observed)  

Page 31: Reforecasts 4Renewables hamill AMS2013€¦ · GEFS(reforecastv2(details(• Seeks(to(mimic(GEFS((NCEP(Global(Ensemble(ForecastSystem)(operaonal(configuraon(as(of(February(2012.(•

Skill  of  calibrated  precipita$on  forecasts  (over  US,  1985-­‐2010,  “rank  analog”  calibra$on  method)  

31  

Verifica$on  here  against  32-­‐km  North  American  Regional  Reanalysis  (tougher).    Verifica$on  in  previous  plot  against  1-­‐degree  NCEP  precipita$on  analysis  (easier).