Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca

V&L Net workshop on Vision and LanguageBrighton, September 15th, 2011

Exploiting Natural-Language Interaction in Video Surveillance Systems

2

UNDERSTAND videos with humans … (or actions in images) …to EXPLAIN them in their context (or classify, search…)

ISE Lab: Research Lab on Image Sequence Evaluation

3

• Detection• Segmentation• Agent/body/face tracking• Activity recognition• Scene understanding• Behavior recognition• Video annotation/ retrieval• Augmented reality• NL descriptions

human

horse

ISE Lab: some research we do...

An example: the MIPRCV project

156 : …

203 : Lo vianant surt per la part inferior dreta...

252 : ...

4

5

Control Terminal

3 Dedicated Servers

Giga Ethernet cam

Servolens with integrated Zoom

Pan & Tilt

Network Infrastructure

An example: the MIPRCV demonstrator

6

PTZ control

7

Terminal for Active Video Surveillance

8

Natural Language Understanding

What happened today?

9

Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca

http://iselab.cvc.uab.es/

Exploiting Natural-Language Interaction in Video Surveillance Systems