17
www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification Lars Aurdal, Ragnar Bang Huseby, Dagrun Vikhamar, Line Eikvil, Anne Solberg, Rune Solberg MultiTemp 2005

Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

Embed Size (px)

Citation preview

Page 1: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

Lars Aurdal, Ragnar Bang Huseby, Dagrun Vikhamar, Line Eikvil, Anne Solberg, Rune Solberg

MultiTemp 2005

Page 2: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Aim of project

1. Our aim was to study satellite image classification based on class temporal evolution in multitemporal sequences .

2. Specifically we considered vegetation ground cover classification based on such sequences.

3. Classification based on 7 LANDSAT TM and ETM+ images.

4. Digital vegetation maps of the study area were provided by the Norwegian Institute of Land Inventory (NIJOS).

Page 3: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Previous work

1. The annual changes in the vegetation ground cover includes the phenological development of the different plant species that make up the ground cover.

2. Many works on ground cover classification have used the varying phenological cycles observed in the images to distinguish between different ground cover classes.

3. Few authors actually model the phenological evolution of different plant societies in order to use this in the classification process.

Page 4: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Phenological evolution of different plant species, NDVI

Birch

Pine

Page 5: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Model

1. We model the ground cover phenology using a Hidden Markov Model (HMM).

2. The basic assumption is that the vegetation will be in one of four states, dormancy, greenup, maturity or senescence.

3. These states are hidden for the observer, all that can be known about these states is the probability of transition between these states as a function of the time of the year and the probability of observables in a given state.

Page 6: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Model

1. While in one of these states the vegetation ground cover produces observables (satellite images in our case).

2. Each vegetation ground cover class will produce observables with an estimated mean and variance.

3. The classification problem becomes the problem of choosing the ground cover class that best explains the given sequence of observables.

Page 7: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Hidden Markov Models

Page 8: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Model

1. To specify the HMM for the phenological evolution of a ground cover vegetation class you need:a. The states of the system. We consider 6 states,

snowcover, dormancy1, greenup, maturity, senescence and dormancy2.

b. The state transition matrices, these are time varying, but can be assumed constant within for instance one week intervals.

c. The probabilities of the observables given a certain state and class.

Page 9: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Model example, birch, NDVI

Page 10: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Model example, pine, NDVI

Page 11: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Model example, state transitions

Page 12: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

High mountain vegetation classification

Left:

Norwegian national borders and a LANDSAT 199-17 scene.

Right:

Norwegian national borders and vegetation maps

(vegetation maps provided by NIJOS)

Venabygd

Sør-Fron

Page 13: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

High mountain vegetation classification

Venabygd vegetation map reduced to only 5 plant societies. The color coding is given in the legend. White areas are either outside the Vena region or areas not interesting for classification (water e.g.).

Page 14: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

High mountain vegetation classification, results

Venabygd test area, all seven LANDSAT images classified using the HMM approach. All 6 bands where used as input to the classifier. The overall classification accuracy was 63.1%.

Vegetation mapHMM

Page 15: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

High mountain vegetation classification, results

1. For comparison:a. A trained maximum likelihood classifier was applied to the

Venabygd test area in each of the 7 images separately. The best overall classification accuracy was 58.2%..

b. A trained maximum likelihood classifier was applied to the Venabygd test area in a stack of all 7 images. The overall classification accuracy was 63.4%.

c. Using the same training data both the HMM and the ML approach was applied to the Sør-Fron test area in a stack of all 7 images. The overall classification accuracy was 62.4% (HMM) and 56.3% (ML).

HMM ML single

ML stack

Venabygd 63.1% 58.2% 63.4%

Sør-Fron 62.4% - 56.3%

Page 16: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Conclusions

1. We have developed a HMM based classification algorithm.

2. Experiments using the HMM approach and the ML approach clearly shows the value of using multitemporal data.

3. When trained locally the ML approach is superior.

4. The ML approach generalizes very poorly (overadaptation)

5. The HMM approach generalizes well.

Page 17: Www.nr.no Use of Hidden Markov Models and Phenology for Multitemporal Satellite Image Classification Applications to Mountain Vegetation Classification

www.nr.no

Conclusions

1. The HMM based classification algorithm has many desirable features:a. The number of images in the multitemporal

sequence can change.

b. Snow and cloud cover can easily be modeled.

c. More detailed modeling of phenology is possible.