Semantic Desktop - History, Ideas, Details (2008)

  • Upload
    leobard

  • View
    221

  • Download
    0

Embed Size (px)

Citation preview

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    1/76

    [email protected] semantic desktop 11.12.2008

    In this galaxy,today

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    2/76

    The Semantic DesktopA new Hope for

    Personal Information

    Management

    Leo Sauermann

    [email protected]

    http://www.dfki.de/~sauermann/

    mailto:[email protected]://www.dfki.de/~sauermann/http://www.dfki.de/~sauermann/mailto:[email protected]
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    3/76

    [email protected] semantic desktop 31.12.2008

    Leo Sauermann

    Researcher on Semantic Desktop since 2002

    At DFKI since 2004

    Currently at the Nepomuk EU project

    Scientist: workshops, lectures, students, and diploma theses

    Open Source: developer, blogger, SWEO member at

    W3C.org, aperture.sf.net, Eclipse SMILA

    Training: workshops, consulting, keynotes

    [email protected]

    http://www.dfki.de/~sauermann/

    mailto:[email protected]://www.dfki.de/~sauermann/http://www.dfki.de/~sauermann/mailto:[email protected]
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    4/76

    [email protected] semantic desktop 41.12.2008

    Why do we need a

    Semantic Desktop

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    5/76

    [email protected] semantic desktop 61.12.2008

    Writing: 3200 BC (Sumerian cuneiform)

    History slides by Prof. Stefan Decker, DERI.IE

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    6/76

    [email protected] semantic desktop 71.12.2008

    Printing Press (Gutenberg 1450)

    History slides by Prof. Stefan Decker, DERI.IE

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    7/76 [email protected] semantic desktop 81.12.2008

    World Wide Web - Tim Berners-Lee 1989

    History slides by Prof. Stefan Decker, DERI.IE

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    8/76

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    9/76 [email protected] semantic desktop 101.12.2008

    How did Artificial Intelligence evolve?

    a short history on artificial intelligence

    by Jean Rohmer

    1967- 1980: Soft Engineering (Compilers, OS,

    databases, VLSI)

    1980 - 1993: Artificial Intelligence Research,

    Products, Services

    1993 2005: IDELIANCE Semantic Networks(personal and collective)

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    10/76 [email protected] semantic desktop 111.12.2008

    WHY AI SUCCEEDED IN THE 80 s / early 90s

    The situation was stable ( and boring)

    in Computer Science: OS, Databases, C, C++

    Hardware and systems were valuable professional and industrial assets

    which had to be profitable through ambitious applications

    Hardware was slow and expensive

    IT WAS TIME TO DO MORE EXCITING THINGS

    THAN SOFTWARE ENGINEERING

    WITH COMPUTERS

    Japanese Fifth Generation Computing Program was key

    Examples: SACHEM, RAMSES, METAPEDIA multi M in the80s

    Jean Rohmer, Thales SA

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    11/76 [email protected] semantic desktop 121.12.2008

    WHY AI vanished in the early 90 S

    Hardware was slow and expensive (bis)

    AI was an expensive way to save money

    AI kept fighting and losingagainst Software Engineering

    Economical crisis

    AI NEEDED HUMAN EFFORT, DISCIPLINE, CONTINUITY AND

    INTELLIGENCE

    RESEARCHERS NOT INTERESTED IN EVERYDAY LIFE APPLICATIONS

    Natural Language / Voice Processing did not deliver

    AI applications did not look different for the user !

    Jean Rohmer, Thales SA

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    12/76 [email protected] semantic desktop 131.12.2008

    Where is the Link between AI and Web?

    Oct 1980: Tim Berners-Lee Enquire

    ENQUIRE is a method of documenting a system. It

    concentrates on the way the system is composed of parts,

    and how these parts are interrelated.

    This information about a system is difficult to store, and

    particularly to update, using paper documents, so

    ENQUIRE stores its information on a computer. The

    ENQUIRE-WITHIN program allows a person to create and

    edit the data, so that others can later extract it as it is

    relevant to them.

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    13/76 [email protected] semantic desktop 141.12.2008

    Today: three tracks come together

    Written Language

    and Replication

    at ESTCLeo Sauermannpresents Semantic Desktop

    Language and Philosophy

    Artificial Intelligence

    PersonalInformation

    Management

    Semantic Desktop

    computable facts

    Language

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    14/76 [email protected] semantic desktop 151.12.2008

    In this galaxy,today

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    15/76 [email protected] semantic desktop 161.12.2008

    Where does all this text come from?

    from People

    using mostly desktop computers

    to enter information relevant to them

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    16/76

    [email protected] semantic desktop 171.12.2008

    Knowledge Workplace

    Workstation

    Archives

    News

    Services

    Data Bases

    email

    contacts

    partners

    products

    services

    projects

    colleagues

    role

    position

    nterests

    goals

    heterogenous data sources

    & complex knowledge work

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    17/76

    [email protected] semantic desktop 181.12.2008

    But information is chaotic

    Thousands of files,

    in hundreds of folders,in many applications and formats

    Hard-disk space cheap as air,

    no one will delete these files

    the CIDproject

    Documents

    Papers

    Projects

    CID

    Research

    files emails

    Inbox

    Todo

    SAP

    CID-proj

    Karlsruhe

    contacts

    Claudia Stern

    Dirk Hageman

    Klaus Nord

    No desktop

    standard torepresent ideas andalign to files

    Th h b th b d

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    18/76

    [email protected] semantic desktop 191.12.2008

    The human user bears the burdento hold everything together

    E-MailsTime Schedule

    Meeting Presentations Travel Websites

    Organising a meeting involved

    documents, contacts, time-schedule, organize Meeting

    in Belfast

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    19/76

    [email protected] semantic desktop 201.12.2008

    The approach:

    Enhance available information

    by formal semantic annotation

    to build explicit

    personal information models

    and facilitate automated services

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    20/76

    [email protected] semantic desktop 211.12.2008

    Personal Information Model PIMO

    represents personal mentalmodel

    formal: classes, concepts,relations in RDFS documents, e-mails,

    websitesare tagged with concepts

    extensible with organizational knowledge ontologies extracted data

    unifying model for solvingour problems

    PIMO - a Framework for Representing Personal Information ModelsSauermann, van Elst, Dengel (2007)

    http://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdf

    The CID

    Project

    Documents

    Papers

    Projects

    CID

    Research

    Files E-Mails

    Inbox

    Todo

    SAP

    CID-proj

    Karlsruhe

    Contacts

    Claudia Stern

    Dirk Hagemann

    Klaus Nord

    CID

    Topic

    Claudia

    Project

    Person

    Karlsruhe

    Management

    LocationDirk

    CID slides

    Document

    Ontologies

    Data

    Person

    is a AnnotationRelation

    http://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdfhttp://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdfhttp://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdfhttp://www.dfki.uni-kl.de/~sauermann/papers/sauermann+2007b.pdf
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    21/76

    [email protected] semantic desktop 221.12.2008

    PIMO Thingsmerge multiple KM systems

    Taxonomy

    hierarchy

    terms

    alternative terms

    Company

    Private

    Projects

    CID

    Research

    Topics

    Classes and Instances

    types

    properties of types

    CID

    Project

    CID slides

    Document

    Ontologies

    relations

    rules

    CIDClaudia

    Karlsruhe

    Management

    Dirk

    CID slides

    Tagging

    flat structure

    2008

    CIDContract

    Wikis

    description and hyperlinks

    CIDis a Project.Dirk and Claudia work on it.

    PIMO

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    22/76

    [email protected] semantic desktop 231.12.2008

    Example: PIMO about ESTC 2008

    outlook://contact/0019E1773D6A56

    occurrsin contact

    http://www.palais-niederoesterreich.at/

    has-location

    http://www.dfki.uni-kl.de/~sauermann/

    http://www.kth.se/Claudia

    http://www.sti2.org/index.php/team2/27-about-usstaff/104-alexander-wahler

    organized byhttp://www.estc2008.com/ESTC 2008

    Leo SauermannAlexander Wahler

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    23/76

    [email protected] semantic desktop 241.12.2008

    Personal Information Management PIM

    Personal Information PI different interpretations possible: owned, accessed, controlled by the Person directed at a Person

    about a Person, but kept by someone else

    relevant for Person Personal Space of Information PSI all information elements

    within the definition ofPI

    tools to interact with the information,Personal Knowledge Workspace

    borders unknown, fuzzy,overlaps with others PSI

    Background Information about PIM

    Book: Personal Information ManagementWilliam Jones and Jaime Teevan (2007)

    Book: Keeping Found Things FoundWilliam Jones (2008)

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    24/76

    [email protected] semantic desktop 251.12.2008

    Background Information about PIM

    PIM activities by Knowledge Workers filing information for retrieval and storage

    (re) finding information

    organizing information and meta-level activities

    Personal Information Collection PIC a list (category) of items, used to support activities

    Typical behaviours observed in field studies character of workers differ: pilers VS filers walking the same beaten paths to known information

    orienteering: looking where you are to know the next step,knowing how you get there

    fulltext search as last resort No education for workers provided!

    Finding and Reminding: File Organization from the DesktopDeborah Barreau and Bonnie A Nardi (1995)

    The perfect search engine is not enough: a study of orienteering behavior in directed searchTeevan, Alvarado, Ackerman, Karger (2004)

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    25/76

    [email protected] semantic desktop 261.12.2008

    Personal Information Model

    represents Personal Information Models of

    individuals.

    consists of RDF Vocabulary

    class:PIMO class:Thing identifiers relations information fusion

    Upper Ontology

    basic concepts inPIM

    Person, Location,Event, Organization,Topic, Document,Time

    The knowledge workers

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    26/76

    [email protected] semantic desktop 271.12.2008

    The knowledge workers

    world-view on information

    Mental Model

    Documents

    Papers

    Projects

    CID

    Research

    Files

    PersonalInformationModel

    Personal Spaceof Information

    file://C:/home/claudia_stern/documents/projects/CID/ProjectDescription6.doc

    < >

    DirkThe CIDProject

    claudia:CID

    claudia:Dirk

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    27/76

    [email protected] semantic desktop 281.12.2008

    RDF on theSemantic Desktop

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    28/76

    [email protected] semantic desktop 291.12.2008

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    29/76

    [email protected] semantic desktop 301.12.2008

    @prefix nco: .

    @prefix nie: .

    a nie:InformationElement, nco:Contact;

    nie:title "Claudia Stern";nco:fullname "Claudia Stern";

    nco:nameFamily "Stern";

    nco:nameGiven "Claudia";

    nco:hasEmailAddress ;

    nco:hasPostalAddress

    ;

    nie:dataSource

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    30/76

    [email protected] semantic desktop 311.12.2008

    @prefix nco: .

    @prefix nie: .

    a nie:InformationElement, nco:Contact;

    nie:title "Claudia Stern";nco:fullname "Claudia Stern";

    nco:nameFamily "Stern";

    nco:nameGiven "Claudia";

    nco:hasEmailAddress ;

    nco:hasPostalAddress

    ;

    nie:dataSource

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    31/76

    [email protected] semantic desktop 321.12.2008

    @prefix nco: .

    @prefix nie: .

    a nie:InformationElement, nco:Contact;

    nie:title "Claudia Stern";nco:fullname "Claudia Stern";

    nco:nameFamily "Stern";

    nco:nameGiven "Claudia";

    nco:hasEmailAddress .

    a nco:EmailAddress ;nco:emailAddress "[email protected]" .

    Statements nie:title to be able to show

    anything in a GUI (= the label)

    nameFamily, nameGiven

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    32/76

    [email protected] semantic desktop 331.12.2008

    Aligning a Thing to Information Elements

    Claudiaclaudia:Claudia a pimo:Person.

    Contact

    fullname Claudia Stern

    groundingOccurrence

    TextDocument

    title The CIDProjectcreator

    fullname Claudia Stern

    occurrence of Claudia

    PIMO

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    33/76

    [email protected] semantic desktop 341.12.2008

    Hands-on: Annotating a filePIMO

    Section 11.7

    a nie:TextDocument;nie:title "Belfast Bus Timetable".

    claudia:BelfastBusTimetable

    a pimo:Document;nao:personalIdentifier "Belfast Bus Timetable";

    pimo:isDefinedBy claudia:PIMO;pimo:groundingOccurrence

    ;

    pimo:groundingOccurrence

    claudia:Belfasta pimo:City;

    nao:personalIdentifier "Belfast";pimo:isDefinedBy claudia:PIMO.

    pimo:hasTopic

    pimo:hasTopic claudia:Belfast.

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    34/76

    [email protected] semantic desktop 351.12.2008

    Ontologiesaround PIMO

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    35/76

    All Concepts a Userof the Semantic Desktop deals with

    All Concepts anApplication Programmerof the Semantic Desktop deals wit

    RDF

    RDFS

    NRL

    NAO

    NIE PIMO

    Foundational

    Group-level

    Personal-Level

    Upper-Level Layer

    Lower-Level Layer

    Representational Layer

    NEPOMUK Ontologies

    Knowledge Worker

    Individual

    activities in PSIworkflows: filing finding

    thinking

    Ontologies are the formal basis for

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    36/76

    [email protected] semantic desktop 371.12.2008

    Ontologies are the formal basis forshared understanding

    Between humans:

    Several users explicate their specific views and

    interpretations by annotating information

    elements

    Relying on ontologies ensures consistent use of

    concepts

    For machines:

    Formal annotations allow the invocation of

    computer services

    Ontologies serve as reference for the developer

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    37/76

    [email protected] semantic desktop 381.12.2008

    NEPOMUK Ontologies

    Representation Language (NRL) built on top of RDF/S

    RDF triple, Named Graph and Graph Views

    Graph Roles Vocabulary

    Annotation Ontology (NAO) Tagging, semantic annotation,

    nao:hasTag, nao:hasTopic, nao:isRelated, ...

    Graph Metadata Vocabulary

    Information Elements (NIE) files (Word documents, images, PDFs),

    address book, entries, emails, etc.

    Personal Information Model(PIMO)

    available free at

    www.semanticesktop.org/ontologies

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    38/76

    [email protected] semantic desktop 391.12.2008

    NEPOMUK Information Elements NIE

    existing data

    needed for

    knowledge work

    domain independent

    Information Elements

    ttp://www.flickr.com/photos/uniqueo/2667162885/

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    39/76

    [email protected] semantic desktop 401.12.2008

    NEPOMUK Information Elements NIE

    NIE identifies both the NIE ontology and

    the NIE framework of ontologies

    builds on NRL NepomukRepresentational Language (= RDFS +

    extensions) Representing existing information, not

    replacing existing file formats

    Integration and reuse amongst ontologiesin the framework

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    40/76

    [email protected] semantic desktop 411.12.2008

    DataObjects representphysical entitiesthat contain data.

    files, mailboxes etc.

    Bitstreams which need

    to be interpreted asInformationElement.

    InformationElement is a

    piece of informationstored within a dataobject.

    Two Parts

    O l i b if d

    http://www.semanticdesktop.org/ontologies/nie/http://www.semanticdesktop.org/ontologies/nie/http://www.semanticdesktop.org/ontologies/nie/http://www.semanticdesktop.org/ontologies/nie/
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    41/76

    [email protected] semantic desktop 421.12.2008

    Ontologies get better if used

    NIE is used by Aperture, Beagle++

    (+10000 downloads) PIMO is used by

    Thai, V.; Handschuh, S. & Decker, S.

    IVEA: An Information Visualization Tool for Personalized

    Exploratory Document Collection Analysis, ESWC2008

    Fernandez-Garcia, N.; Sauermann, L.; Sanchez, L. &

    Bernardi, A.

    PIMO Population and Semantic Annotation for the

    Gnowsis Semantic Desktop, 2006 ISWC WS Woerndl, W. & Woehrl, M.

    SeMoDesk: Towards a Mobile Semantic Desktop

    CHI 2008 WS

    Data-flow between NEPOMUK services:

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    42/76

    [email protected] semantic desktop 431.12.2008

    Data flow between NEPOMUK services:from data to PIMO

    DataPersons files and

    e-mails

    RDF

    adaptingto RDF

    matchingto PIMO

    PIMO

    Aperture.sf.net

    crawling framework

    converts all data to

    RDF

    Alignment

    analyzes files and e-mails

    (and more)

    matching to existing things

    creating new things

    User Interfaces

    read/write PIMO

    Documents

    Papers

    Projects

    CID

    Research

    Files E-Mails

    Inbox

    Todo

    SAP

    CID-proj

    Karlsruhe

    Contacts

    Claudia Stern

    Dirk Hagemann

    Klaus Nord

    T d h k h

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    43/76

    [email protected] semantic desktop 441.12.2008

    Today: three tracks come together

    Written Language

    and Replication

    at ESTCLeo Sauermannpresents Semantic Desktop

    Language and Philosophy

    Artificial Intelligence

    Personal

    Information

    Management

    Semantic Desktop

    computable facts

    Language

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    44/76

    [email protected] semantic desktop 451.12.2008

    www.flickr.com/photos/wonderferret/1447024668

    How did the Semantic Desktop

    change knowledge work?

    R lt C t li k d t ti ll

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    45/76

    [email protected] semantic desktop 461.12.2008

    Leo

    Leo with

    Mobile_phone,

    Laptopnear

    Enschede,

    Netherlands.

    Result: Concepts are linked automatically

    Leo Sauermanndesktop://outlook/contact/ECD4B993

    a Person

    Enschedehttp://www.dbpedia.org/resource/Enschede

    a City

    Services on the personal desktop support

    http://www.kwark.org/x/person.pl?q=eaa363e2b75a11db14e62afb8995340a198e8b9e;name=Leohttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Mobile_phonehttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Laptophttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://www.dbpedia.org/resource/Enschedehttp://www.dbpedia.org/resource/Enschedehttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://swordfish.rdfweb.org/discovery/2001/08/codepict/aboutairport.jsp?url=http://www.daml.org/cgi-bin/airport?ENShttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Laptophttp://www.kwark.org/x/person.pl?q=http://xmlns.com/wordnet/1.6/Mobile_phonehttp://www.kwark.org/x/person.pl?q=eaa363e2b75a11db14e62afb8995340a198e8b9e;name=Leo
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    46/76

    [email protected] semantic desktop 471.12.2008

    Services on the personal desktop supportpersonal semantic information management

    Connect, structure, retrieve

    information

    Personal RDF store as universal

    fact repository

    Personal Task Management makes

    context explicit

    Personal Information Model (PIMO)

    explicates concepts used within the

    personal information space

    Result: Your personal information

    space at a glance!

    Search

    Current Task

    Information relevant

    in this context

    semantic relations / links

    categories

    persons

    projects

    Tasks, data,

    concepts

    Mi i i Sid b

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    47/76

    [email protected] semantic desktop 481.12.2008

    Miniquire Sidebar

    Search

    PIMO Ontology

    viewer and editor

    Filtering

    keeping orientation

    PIMO Edit

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    48/76

    [email protected] semantic desktop 491.12.2008

    PIMO Editor

    wiki name = short

    unique name for

    things

    semantic wiki text

    Text-Attributes:

    key/value pairs for

    datatype attributes

    Relations

    to other things

    Link to filesystem,

    email, outlook

    entry,

    anything

    integrated throughAperture.sf.net

    L i f th b h i

    PIM Basic

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    49/76

    [email protected] semantic desktop 501.12.2008

    Learning from the users behavior

    Plugins gather user actions

    Elicitation of task concepts

    Notification of GUI

    Applications

    shows documents, people, projects,

    topics relevant to current work

    search documents via context:

    I saw it after working with Dirk pro-active non-obtrusive assistance

    Bayesian Network

    UA UA

    Domain

    Wf Task

    NOP NOP NOP NOP

    Wf Task

    TaCo

    Domain

    UA

    NOP

    PIMMaus

    PIM MidDFKI KM

    PIM Upper

    A Context Model for Personal Knowledge Management ApplicationsSven Schwarz (2006)

    Application plugins, mini-applications,

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    50/76

    [email protected] semantic desktop 511.12.2008

    Application plugins, mini applications,mashups

    tagging e-mails drop-box

    Idea: Let people use their existing applications

    to get their knowledge work done

    Application: Drop Box

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    51/76

    [email protected] semantic desktop 521.12.2008

    Application: Drop Box

    Helps filing information

    uses PIMO structuresconcepts and folders

    Knows the users model and istrained by using it

    process flow files are stored into a Drop-Box folder

    files are text-analysed and possibletarget folders are suggested

    Drop-Box user interface shows

    user selects a folder, classify

    files are moved and classified

    Learns from the user

    doc:

    EPOS

    Project:Epos

    EPOS, DFKI,

    Maus,

    PIMO of Paul

    =

    Sauermann, L.; Grimnes, G.A.; Kiesel, M.; Fluit, C.; Maus, H.; Heim, D.;

    Nadeem, D.; Horak, B. & Dengel, A.

    Semantic Desktop 2.0: The Gnowsis Experience

    ISWC 2006

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    52/76

    [email protected] semantic desktop 531.12.2008

    search

    Siebert, M.; Smits, P.; Sauermann, L. & Dengel, A.Increasing Search Quality with the Semantic Desktop

    in Proposal Development

    PAKM 2006

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    53/76

    [email protected] semantic desktop 541.12.2008

    Human Access

    Search for Information: documents and facts

    Enable Free-text queries

    to keep knowledge overhead away from the user

    NLP problems, e.g. syntactic, structural ambiguity

    form the search engines point of view

    phone number of the KM-Group secretaryseminar topics

    +49 631 205 75 101

    Schuhmacher, K.; Sintek, M. & Sauermann, L.Combining Metadata and Document Search with Spreading Activation for Semantic Desktop Search

    ESWC 2008

    Fact Retrieval Example

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    54/76

    [email protected] semantic desktop 551.12.2008

    Fact Retrieval Example

    Property Class Instance

    (no result)(no result)

    0049 631 205 75 101

    [1] [2]

    [3]

    [4]

    instances:

    ,

    phone number of the KM-Group secretary

    [5]

    get instances

    Schuhmacher, K.; Sintek, M. & Sauermann, L.Combining Metadata and Document Search with Spreading Activation for Semantic Desktop Search

    ESWC 2008

    Personal Semantic Wiki for note taking

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    55/76

    [email protected] semantic desktop 561.12.2008

    NepomukNepomuk is an EU project .

    Its topic is the

    Social Semantic Desktop .

    DFKI coordinates .

    Personal Semantic Wiki for note-taking

    Terms

    Types

    Relation types

    Relations

    RDF

    We can use a personal semantic wikieverywhere: comments, notes, documents,

    websites, blogs, e-mails, Sauermann, L.

    The Gnowsis Using Semantic Web Technologies to build a Semantic Desktop

    Diploma Thesis, Technical University of Vienna, 2003

    Semantic Wiki User Interface

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    56/76

    [email protected] semantic desktop 571.12.2008

    Semantic Wiki User Interface

    Kaukoluwiki

    open source

    Assistance systemAutomatic annotation

    Malte Kiesel, Kaukolu: Hub of the Semantic Corporate Intranethttp://www.dfki.uni-kl.de/~kiesel/2006-06-12-Kaukolu-SemWikiESWC2006.pdf

    http://kaukoluwiki.opendfki.de/

    Express thoughts using free text

    Evaluations of these applications showed

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    57/76

    [email protected] semantic desktop 581.12.2008

    Evaluations of these applications showed

    We evaluated the approach in a two month case

    study in 2006 with eight participants, and 2 year-useuntil 2008

    Result

    For Personal Information Management, classes andtyped properties are not needed for browsing

    I dont model the world, only what is important

    Drop-Box enabled multi-tag annotations

    A little semantics goes a long way

    Sauermann, L. & Heim, D.Evaluating long-term use of the Gnowsis Semantic Desktop for PIM

    ISWC 2008

    CID CID slides

    Orienteering Behavior

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    58/76

    [email protected] semantic desktop 591.12.2008

    Orienteering Behavior

    Teevan, Alvarado, Ackerman, Karger

    users go somewhere, look around, know wherethey are, go on

    Teevan, J.; Alvarado, C.; Ackerman, M.S. & Karger, D.R.

    The perfect search engine is not enough: a study of orienteering behavior in directed search

    CHI2004, pp.415-422

    Filtering

    keeping orientation

    Long-term users stopped

    using web-search interface

    Besides being shown

    differently, hasPart and

    isRelated have no

    programmatic difference.

    For orienteering,

    click somewhere to the

    right is enough

    Interpretation

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    59/76

    [email protected] semantic desktop 601.12.2008

    Interpretation

    A little semantics goes a long way

    The Semantic Desktop helps in PIMs typicalactivities:filing, finding, thinking

    Limited RDF: No computation, no social exchange Classes were only needed when the pain was too big

    Typed relations were not needed: related would beenough for personal orienteering

    Personal Semantic Desktop Wiki was used as ageneral knowledge tool

    PIM research was confirmed: orienteering

    first navigating, then searching

    CID CID slides

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    60/76

    [email protected] semantic desktop 611.12.2008

    www.flickr.com/photos/wonderferret/1447024668

    How did the Semantic Desktop

    change the world?

    Well-established communities

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    61/76

    [email protected] semantic desktop 621.12.2008

    adopt and support NEPOMUK

    KDE 4.0 beta released contains basic NEPOMUK

    architecture components

    ECLIPSE community

    supports OSGI-basedNEPOMUK implementation

    PSEW alpha available

    Demonstrated at IBM

    Lotusphere 07

    Open Source development platform available

    dev.nepomuk.semanticdesktop.org

    Public mailing list: [email protected]

    NEPOMUK Architecture

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    62/76

    [email protected] semantic desktop 631.12.2008

    NEPOMUK Architecture

    The KDE Desktop provides NEPOMUK

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    63/76

    [email protected] semantic desktop 641.12.2008

    The KDE Desktop provides NEPOMUKmodels and annotations as an OS service

    manual tagging of files, folders,

    emails, etc. Representation of tags within

    PIMo

    nepomuk.kde.org~1mio potential users

    PIMo

    Java

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    64/76

    [email protected] semantic desktop 651.12.2008

    nepomuk.KDE.org1-4 million desktop users

    The NEPOMUK project

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    65/76

    [email protected] semantic desktop 661.12.2008

    The NEPOMUK project

    EU integrated project Duration 1.1.2006 31.12.2008

    Funding 11.5 M

    Overall 17.1 M

    Goals Standardization of Social

    Semantic Desktop Contribute to European Vision

    of a capable knowledge society

    Combines and integrates severalareas of research

    Contact Website http://nepomuk.semanticdesktop.org E-Mail [email protected]

    Coordinator Dr. Ansgar Bernardi

    SeMouse

    http://nepomuk.semanticdesktop.org/mailto:[email protected]:[email protected]://nepomuk.semanticdesktop.org/
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    66/76

    [email protected] semantic desktop 691.12.2008

    SeMouse

    Annotation of documents using the middle mouse

    button Works with Word, Browser, PDF,

    Can be integrated with other frameworks (gnowsis)

    Sergio F.Anzuola

    click!

    DBin

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    67/76

    [email protected] semantic desktop 701.12.2008

    DBin

    ein verteilter Semantic Desktop

    Suche nach Information

    Kollektiv arbeiten

    Open IRIS

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    68/76

    [email protected] semantic desktop 711.12.2008

    Open IRIS

    verwandte Daten

    Ideliance

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    69/76

    [email protected] semantic desktop 721.12.2008

    Ideliance

    What connects Jerome

    Euzenat with Ireland

    Multiple Data Entry

    Options

    Industry Cooperations

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    70/76

    [email protected] semantic desktop 741.12.2008

    Industry Cooperations

    Aperture.sourceforge.net

    a Java framework to extractdata and metadata

    In production, 6000 downloadsmany users

    DFKI and Aduna (Jeroen Wester) Converts your files (MSOffice, PDF,

    Multimedia) and more to RDF

    Compatible with ADUNA products

    also in dynaq.opendfki.de

    Industry Cooperations

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    71/76

    [email protected] semantic desktop 751.12.2008

    Industry Cooperations

    www.eclipse.org/smila/

    SMILA is an extensible framework forbuilding search solutions to accessunstructured information in theenterprise.

    uses Aperture

    Empolis (Arvato) Igor Novakovic

    Jasmin Franz

    Brox August Georg Schmidt

    DFKI Leo Sauermann

    DFKI Competence Center Semantic Web

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    72/76

    [email protected] semantic desktop 761.12.2008

    DFKI Competence Center Semantic Web

    Communicates between DFKI

    Experts and customers

    Ontology creation and

    maintenance

    Support for annotation anddata analysis

    Contract research

    Consulting, Training, Talks

    http://semanticweb.dfki.de

    Michael Sintek

    [email protected]

    Paul Buitelaar

    [email protected]

    Involved Scientific Community

    http://semanticweb.dfki.de/http://semanticweb.dfki.de/
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    73/76

    [email protected] semantic desktop 771.12.2008

    Involved Scientific Community

    Community resources

    www.semanticdesktop.org community websitewith wiki and many projects

    [email protected] mailinglist

    Scientific events ISWC workshop 2005

    ISWC workshop 2006

    i-Semantics Special Track 2007 ESWC workshop 2007

    Nepomuk Summer School 2008

    Future

    http://www.semanticdesktop.org/mailto:[email protected]:[email protected]://www.semanticdesktop.org/
  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    74/76

    [email protected] semantic desktop 781.12.2008

    Future

    follow-up project OrganiK

    Personalized Semantic Web for SMEs Planned commercialization of Semantic

    Desktop services in 2009 (contact me)

    Stefan Decker from DERI,our team from DFKI, and

    others are initiating

    a standardization foundation at least a million KDE users,

    do your own research

    Summary - The Semiotic Triangle

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    75/76

    [email protected] semantic desktop 791.12.2008

    Summary The Semiotic Triangle

    NEPOMUK gives tools to express knowledge

    in Semantics,beyond stones.

    try KDE4.0 Meetingin Belfast

    Informationin mind

    Artifactsstones + RDF

    triggers references

    represents

    Real World

    CID

    Meeting

    Belfast

    d

    d

    asdf

    Semantic Web

  • 7/31/2019 Semantic Desktop - History, Ideas, Details (2008)

    76/76

    asdf

    asfd

    sadf

    asfd

    asdf

    sadf

    asdf

    asdf

    asdf

    asdfasdf

    asdf

    asdf

    asdf

    sda

    fd

    dfs

    dfs

    sda

    df

    da

    sfd

    asdf

    f

    fad

    dsfsfd

    fds

    d

    sfd

    dfs

    fds

    questions?

    Leo Sauermann

    [email protected]://www.dfki.de/~sauermann/

    Thanks to Jesus, Ingrid Brunner-Sauermann, Heiko Maus, Sven Schwarz, Ansgar Bernardi,Andreas Dengel, Frank Osterfeld, Dominik Heim, Man Luo, Jeen Broekstra, GiovanniTummarello, Michael Zeltner, Stephan Baumann, Gunnar A Grimnes, Ludger Van Elst,Harald Holz, Stefan Decker, Malte Kiesel, timbl and the bunch from #swig

    Semantic Webin Application

    mailto:[email protected]://www.dfki.de/~sauermann/http://www.dfki.de/~sauermann/mailto:[email protected]