Ohne LIRe keine Bildsuche

Ohne LIRekeine Bildsuche

Dr. Mathias LuxAss. Prof. / AAU

http://www.uni-klu.ac.at

2

CV

● Techn. Mathematik (TU Graz)● Telematik (TU Graz)● Know-Center & KMI● Alpen Adria Universität Klagenfurt

Information Technology – ITEC

http://www.uni-klu.ac.at

3

Interessen

● Multimedia Search & Retrieval● User Intentions● Computer Games

http://www.uni-klu.ac.at

4ITEC, Klagenfurt University, Austria

Number of Digital Photos(global)

● Estimate 2006 > 150 billion photos from cameras > 100 billion photos from camera phones

● Forecast 2010 > 500 billion photos + increased resolution

Source: IDC Study “Expanding Digital Universe” http://www.emc.com/about/destination/digital_universe/

http://www.uni-klu.ac.at

5ITEC, Klagenfurt University, Austria

Digital Imaging Devices(Germany)

Still image cameras sold in Germany (thousands)

Source: Cewe Factbook, http://www.cewecolor.de

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

1997 1998 1999 2000 2001 2002 2003 2004 2005 2006

analogue

digital

http://www.uni-klu.ac.at

6

http://www.uni-klu.ac.at

7

Motivation

● Or even on the web?o Flickr …

http://www.uni-klu.ac.at

8

http://www.uni-klu.ac.at

9

http://www.uni-klu.ac.at

10

http://www.uni-klu.ac.at

11

http://www.uni-klu.ac.at

12

Semantic Gap

● Inability of computers to interpret the scene

What is so special about Mona Lisa’s smile?

http://www.uni-klu.ac.at

13

Semantic & Sensory Gap

http://www.uni-klu.ac.at

16

Bildsuche

● Vergleich von 2 MP Bilderno á 1.600 x 1.200 x 2 byte = 3,66 MB

● Annahme: 7000 Bildero ~ 25 GB Daten

(CC) JasonRogers: http://flickr.com/photos/restlessglobetrotter/2149696743/

http://www.uni-klu.ac.at

17

Was tun?

http://www.uni-klu.ac.at

18

Was tun?

http://www.uni-klu.ac.at

19

LIReLucene Image Retrieval

(CC) CayUsa: http://www.flickr.com/photos/cayusa/981372736/

● Softwarebibliothek – GPL‘d● Verwendet Java● Erlaubt Bildsuche

o Globale Features (> 10)o Lokale Features (SIFT, SURF, MSER)o Vereinfacht Indizierung & Sucheo Lineare & approximative Suche

● Zeigt Funktionalität via Demo

http://www.uni-klu.ac.at

20

LIReLucene Image Retrieval

Finde ähnliche

Finde Preise

Finde Läden

http://www.uni-klu.ac.at

21

Demo …

http://www.uni-klu.ac.at

22

Danke …

… für eure Zeit

Mathias Luxmlux@itec.uni-klu.ac.athttp://www.semanticmetadata.net