IT Consulting Alicja Gruzdz: Semantic Technologies for Social Media (Part I)

IT Consulting Alicja Gruzdz

Technologies Know How Expertise


http://www.huffingtonpost.com/2013/06/27/obama-fracking-support_n_3510651.htmlTOPICS• Oil and gas - upstream activities• Energy resources • Natural gas• Coal• Alternative energy• Renewable energy• Pollution• Waste management and pollution

control • Environmental pollution

PEOPLE• Barack Obama• Bob Casey, Jr.• Andrew Cuomo

GROUPS• Sierra Club• Democratic Party (United States)• Americans

Let’s take some text……for example, an article.

Our software can tell what this article is about and auto tag it.

http://www.huffingtonpost.com/2013/06/27/obama-fracking-support_n_3510651.html


TOPICS• Oil and gas - upstream activities

(economy, business and finance)• Energy resources (environmental issue)• Natural gas (economy, business and

finance)• Coal (economy, business and finance)• Alternative energy (economy, business

and finance)• Renewable energy (environmental issue)• Pollution (disaster and accident)• Waste management and pollution

control (economy, business and finance)• Environmental pollution

(environmental issue)

PEOPLE• Barack Obama• Bob Casey, Jr.• Andrew Cuomo

GROUPS• Sierra Club• Democratic Party (United States)• Americans


DISAMBIGUATION: Even if at the first glance it may seem that there are some redundancies, semantic technology reveals totally different contexts.




http://cogcomp.cs.illinois.edu/demo/ner/index.php

To prove the point we processed the same article using a state-of-the-art named entity recognition (NER) system.

Among the best available…

http://cogcomp.cs.illinois.edu/demo/ner/index.php


❶ NER cannot infere topics, events• Oil and gas - upstream activities• Energy resources • Alternative energy• Waste management and pollution control • Environmental pollution

These topics are not mentioned verbatim in the text, but are inferred based on the analysis of the entire text.

And this is what we found:




❷ Mere words – not concepts• President Obama• Barack Obama• Obama

These are not different people – they all refere to the same person.







❸ Too much information• Deb Nardone• Robert Howarth• Associated Press• PITTSBURGH• Oakland, Calif.

Completely irrelevant for the content of the article or for the generic topics discussed in it.







❸ Too much information• Deb Nardone• Robert Howarth• Associated Press• PITTSBURGH• Oakland, Calif.

Completely irrelevant for the content of the article or for the generic topics discussed in it.

❹ Often gibberish• Obama Fracking = PERSON

Plainly wrong.



Oil and gas - upstream activities

Energy and resources

Natural resources

Energy resources

Environmental issue

Pollution

Environmental pollution

Disaster and accident

Waste management and pollution control

Economy, business and finance

Unlike NER semantic technologies understand text. This is how our software sees the article:




Natural resources

Energy resources

Environmental issue

Pollution






Occurs verbatim in the article.




Natural resources

Energy resources

Environmental issue

Pollution






Occurs verbatim in the article.Inferred from the text.




Natural resources

Energy resources

Environmental issue

Pollution






Occurs verbatim in the article.Inferred from the text.Inferred from our knowledge base.


This is what NER cannot tell you about the article – but our software can:


What We Do


What We Do

Technology

IT Consulting Alicja Gruzdz: Semantic Technologies for Social Media (Part I)