How to Detect Human Fall in Video

Embed Size (px)

Citation preview

  • 8/14/2019 How to Detect Human Fall in Video

    1/21

    www.company.com

    www.fallcam.be

    Howtodetecthu

    manfallin

    video?Anoverview

    Jonas Van den BerghToon Goedem

    Jared Willems

    Mieke DeschodtKoen Milisen

    Eddy Dejaeger

    Glen DebardBert BonroyBart Vanrumste

  • 8/14/2019 How to Detect Human Fall in Video

    2/21

    www.fallcam.be2

    Summary

    Master project

    System overview

    Background subtraction

    Fall detection

    Results

    Conclusion & Demo

  • 8/14/2019 How to Detect Human Fall in Video

    3/21

    www.fallcam.be3

    Project

    Master project

    Camera system for elderly fall detection

    Part of the TETRA-project: Fallcam www.fallcam.be

    Goal Developing a video-based algorithm for fall

    detection, using grayscale video sequences

    http://www.fallcam.be/http://www.fallcam.be/
  • 8/14/2019 How to Detect Human Fall in Video

    4/21

    www.fallcam.be4

    Basic fall detection system

  • 8/14/2019 How to Detect Human Fall in Video

    5/21

    www.fallcam.be5

    1. Background subtraction

  • 8/14/2019 How to Detect Human Fall in Video

    6/21

    www.fallcam.be6

    Background subtraction

  • 8/14/2019 How to Detect Human Fall in Video

    7/21www.fallcam.be7

    Background subtraction

    Non-recursive techniquesFrame differencing

    Median filtering

    Recursive techniquesRunning average

    Approximated median filtering

    Mixture of gaussians

  • 8/14/2019 How to Detect Human Fall in Video

    8/21www.fallcam.be8

    AMF & MF

    Approximated median filtering:

    Median filtering:

    B x , y=B x , y1 if Ix , y B x , y B x , y=B x , y1 if Ix , y B x , y

    Calculated

    BackgroundMedian

  • 8/14/2019 How to Detect Human Fall in Video

    9/21www.fallcam.be9

    Background subtraction

  • 8/14/2019 How to Detect Human Fall in Video

    10/21www.fallcam.be10

    Background subtraction

    In our project median filtering and approximatedmedian filtering comparative study

    Median filtering gives better results but is slower thanapproximated median filtering(0.097 vs 0.20 seconds per frame [intel core 2 duo, T9400])

    (MF: 0.35, AMF: 2.44 avg pixel difference)

    Buffer of 40 frames, one frame added each 5 frames

  • 8/14/2019 How to Detect Human Fall in Video

    11/21www.fallcam.be11

  • 8/14/2019 How to Detect Human Fall in Video

    12/21www.fallcam.be12

    2. Fall detection

    Three major subdivisions:Extracting parameters from video data

    Self learning algorithms (Hidden Markov Models)

    Detection of abnormal behavior

    We will focus on parameter-based methods

  • 8/14/2019 How to Detect Human Fall in Video

    13/21www.fallcam.be13

    Fall detection

    Aspect ratio

    Fall angle

    Vertical projection histograms

    Centroid of the falling person

    Horizontal and vertical gradient

  • 8/14/2019 How to Detect Human Fall in Video

    14/21www.fallcam.be14

    Fall detection

    Aspect ratio

  • 8/14/2019 How to Detect Human Fall in Video

    15/21www.fallcam.be15

    Fall detection

    Fall angle

  • 8/14/2019 How to Detect Human Fall in Video

    16/21www.fallcam.be16

    Fall detection

    Vertical projection histograms

  • 8/14/2019 How to Detect Human Fall in Video

    17/21www.fallcam.be17

    Further processing

    Further processing is needed to become a goodworking fall detection system, possibilities are:

    Noise suppression (filtering)

    Morphological operations (erosion / dilation)

    Shadow detection

    Ghost detection

    Occlusion handling

    Ellipse fitting

  • 8/14/2019 How to Detect Human Fall in Video

    18/21www.fallcam.be18

    Results

    Accuracy:

    Tested with 23 sequences

    processing speed [s/frame]:

    Intel Core 2 Duo, T9400, 2,53 Ghz dual core processor

    Correct FP FN

    Sideview 85% 0% 15%Frontview 78% 11% 11%

    AMF MF

    0,36 0,43

  • 8/14/2019 How to Detect Human Fall in Video

    19/21www.fallcam.be19

    Conclusion

    During this master project, we have developed aworking fall detection algorithm

    Note that all processing was done using grayscale

    video sequences

    Better results with additional processing steps

    Other programming language and more efficient codeto speed-up the algorithm

  • 8/14/2019 How to Detect Human Fall in Video

    20/21www.fallcam.be20

    Demo

  • 8/14/2019 How to Detect Human Fall in Video

    21/2121

    Questions?