36
PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar , R Poirot Coordination Support by Inter-RPO WG Fast Aerosol Sensing Tools for Natural Event Tracking, FASTNET NSF Collaboration Support for Aerosol Event Analysis NASA REASON Coop EPA -OAQPS Event : Deviation > x*percentile

PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Embed Size (px)

Citation preview

Page 1: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

PM Event Detection from Time Series

Contributed by the FASNET Community, Sep. 2004Correspondence to R Husar , R Poirot

Coordination Support by

Inter-RPO WG Fast Aerosol Sensing Tools for Natural Event Tracking, FASTNET

NSF Collaboration Support for Aerosol Event Analysis

NASA REASON Coop

EPA -OAQPS

Event : Deviation > x*percentile

Page 2: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Temporal Analysis

• The time series for typical monitoring data are ‘messy’; the signal variation occurs at various scales and the time pattern at each scale is different

• Inherently, aerosol events are spikes in the time series of monitoring data but extracting the spikes from the noisy data is a challenging endeavor

The temporal signal can be meaningfully decomposed into a

1. Seasonal component with stable periodic pattern

2. Random variation with ‘white noise’ pattern

3. Spikes or events that are more random in frequency and magnitude

Each signal component is caused by different combination of the key processes: emission, transport, transformations and removal

Typical time series of daily AIRNOW PM25 over the Northeastern US

Page 3: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Temporal Signal Decomposition and

Event Detection

• First, the median and average is obtained over a region for each hour/day (thin blue line)

• Next, the data are temporally smoothed by a 30 day moving window (spatial median - red line; spatial mean – heavy blue line). These determine the seasonal pattern.

EUS Daily Average 50%-ile, 30 day 50%-ile smoothing

Deviation from %-ile

Event : Deviation > x*percentile

Median Seasonal Conc.

Mean Seasonal Conc.

Average

Median

• Finally, the hourly/daily deviation from the the smooth median is used to determine the noise (blue) and event (red) components

Page 4: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Seasonal PM25 by Region

The 30-day smoothing average shows the seasonality by region

The Feb/Mar PM25 peak is evident for the Northeast, Great Lakes and Great Plains

This secondary peak is absent in the South and West

Page 5: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Northeast – Southeast Comparison• Northeast and Southeast differ in the pattern of seasonal and event variation• Northeast has two seasonal peaks and more events–values well above the median• Southeast peaks in September and has few values much above the noise

Northeast

Southeast

Page 6: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Causes of Temporal Variation by Region

The temporal signal variation is decomposable into seasonal, meteorological noise and events

Assuming statistical independence, the three components are additive:

V2Total = V2

Season + V2MetNoise + V2

Event

The signal components have been determined for each region to assess the differences

Northeast exhibits the largest coeff. variation (56%); seasonal, noise and events each at 30%Southeast is the least variable region (35%), with virtually no contribution from eventsSouthwest, Northwest, S. Cal. and Great Lakes/Plains show 40-50% coeff. variation mostly, due to seasonal and meteorological noise.Interestingly, the noise is about 30% in all regions, while the events vary much more, 5-30%

Page 7: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

‘Composition’ of Eastern US Events• The bar-graph shows the various combinations of species-

events that produce Reconstructed Fine Mass (RCFM) events

• ‘Composition’ is defined in terms of co-occurrence of multi-species events (not by average mass composition)

• The largest EUS RCFM events are simultaneously ‘events’ (spikes) in sulfate, organics and soil!

• Some EUS RCFM events are events in single species, e.g. 7-Jul-97 (OC), 21-Jun-97 (Soil)

Based on VIEWS data

Page 8: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Northeast

Page 9: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Great Lakes

Page 10: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Great Lakes-Plains

Page 11: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Northeast

Page 12: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Great Plains

Page 13: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

NorthWest

Page 14: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

S. California

Page 15: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Southeast

Page 16: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Southwest

Page 17: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Event Definition:Time Series Approach

• Eastern US aggregate time series

Page 18: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Sulfate

EUS Daily Average

50%-ile, 30 day 50%-ile smoothing

Deviation from %-ile

Event – Deviation > percentile value

Median Seasonal Conc.

Mean Seasonal Conc.

Page 19: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Reconstructed Fine Mass RCFM

Page 20: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Organic Carbon

Page 21: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Eelemental Carbon

Page 22: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

SOIL

Page 23: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Nitrate

Page 24: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Temporal Pattern Regional Speciated Analysis - VIEWS

• Aerosol species time series:– ammSO4f– OCf– ECf– SOILf– ammNO3f– RCFM

Regions of Aggregation

Page 25: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Dust

Seasonal + spikes

East – west events are independent

East events occur several times a year, mostly in summer

West events are lest frequent, mostly in spring

US

West

East

Page 26: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Dust

asgasgasfg

Northeast

Southwest

Southeast

Page 27: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Dust

dfjdjdfjetyj

Northwest

S. California

Great Plaines

Page 28: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Amm. Sulfate

wdthehreherh

US

West

East

Page 29: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Amm. Sulfate

stheherheyju

Northeast

Southwest

Southeast

Page 30: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Amm. Sulfate

shheherh

Northwest

S. California

Great Plaines

Page 31: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Organic Carbon

sdhdfhefheryj

US

West

East

Page 32: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Organic Carbon

sdheherh

Northeast

Southwest

Southeast

Page 33: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Organic Carbon

erheryeyj

Northwest

S. California

Great Plaines

Page 34: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Reconstructed Fine Mass

estrhertheryu

US

West

East

Page 35: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Reconstructed Fine Mass

werty3rueru

Northeast

Southwest

Southeast

Page 36: PM Event Detection from Time Series Contributed by the FASNET Community, Sep. 2004 Correspondence to R Husar, R PoirotR Husar, R Poirot Coordination Support

Reconstructed Fine Mass

wthwrthwerhtr

Northwest

S. California

Great Plaines