Upload
diana-king
View
226
Download
6
Tags:
Embed Size (px)
Citation preview
1
Applied Hydrology
RSLAB-NTU
Lab for Remote Sensing Hydrology and Spatial Modeling
Detection of Hydrological Changes – Nonparametric Approaches
Professor Ke-Sheng ChengDept. of Bioenvironmental Systems Engineering
National Taiwan University
2Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Parametric vs nonparametric
Parametric statisticsBody of statistical methods based on an
assumed model for the underlying population from which the data was sampled.
Inference is about some parameter (mean, variance, correlation) of the population•
If model is incorrect the inference may be misleading.
Example: Classical t-test assumes normal populations.
3Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Nonparametric statisticsBody of statistical methods that relax the assum
ptions about the underlying population model.Typically statistics based on ranks or simple co
unts.Can be used for both ordinal and nominal data.
4Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
MWP test for change point detection
5Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
6Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Let us suppose the Xi are independent
Bernoulli random variables.
Tt
t
jjttTt
t
jj
T
jj
t
ii
T
tjj
t
ii
t
i
T
tjj
t
i
T
tjiTt
tSTS
XSSStStT
XXtXtT
XtXtT
XXU
1
111
11
1 11 1,
)()(
)(
)(
7Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
8Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
m
ZZF
j
ii
jm
1*
1 )(n
ZZF
j
ii
jn
1*
2
)1()(
9Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
10Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
11Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
12Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Assessment on the performance of MWP test
In general, the time of change occurrence is detected at a time that occurs later than the real time of change occurrence. [The problem of late detection.]
13Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Mann-Kendall test for trend detection
The Mann-Kendall trend test is derived from a rank correlation test for two groups of observations.
In the Mann-Kendall trend test, the correlation between the rank order of the observed values and their order in time is considered.
The null hypothesis for the Mann-Kendall test is that the data are independent and randomly ordered, i.e. there is no trend or serial correlation structure among the observations.
14Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
However, in many real situations the observed data are autocorrelated. The autocorrelation in observed data will result in misinterpretation of trend tests results.
Positive serial correlation among the observations would increase the chance of significant answer, even in the absence of a trend.
15Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
The original Mann-Kendall trend test
16Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Under the null hypothesis that X and Y are independent and randomly ordered, the statistic S tends to normality for large n, with mean and variance given by:
17Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
If the values in Y are replaced with the time order of the time series X, i.e. 1,2,...,n, the test can be used as a trend test. In this case, the statistic S reduces to that given in Eq. (5):
18Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Kendall (1955) gives a proof of the asymptotic normality of the statistic S. The significance of trends is tested by comparing the standardized test statistic Z = with the standard normal variate at the desired significance level.
)var(SS
19Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Autocorrelated data series
If X is normally distributed with mean and variance 2, then (xj – xi) will also be normally di
stributed with mean zero and variance 22.
20Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
It can be shown that for autocorrelated data series var(S) is the same as that of independent series, i.e.,
21Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
The assumption of normally distributed X was used to derive the above results, but in fact the test is nonparametric and does not depend on the distribution of X.
22Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
The effect of autocorrelation on the Mann-Kendall trend test
Fig. 1 shows two time series X and Y each of length n = 100 observations.
Visual inspection of the two time series would not indicate a large difference in the apparent trends for the two series.
In fact, series X is stationary white noise, while series Y is generated as an AR(1) series with = 0.4 using series X as the input noise.
Both series are stationary without trend.
23Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
24Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
25Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
26Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
27Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Autocorrelation between the ranks of the observations
28Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
29Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
Approximate formula for calculating V(S)
30Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
31Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
32Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
33Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU
34Lab for Remote Sensing Hydrology and Spatial ModelingRSLAB-NTU