Nextremer Inc.

Nextremer Inc.

NLP

Nextremer Inc.

NLP

Nextremer Inc.

NLP.

NLP

Nextremer Inc.

NLP he

Mike gave John a gift, so he was happy

gifthappy

(LDA, word2vec, LSTM)

policy is a deliberate system of principles to guide decisions and achieve rational outcomes

sports are all forms of usually competitive physical activity or games which

Nextremer Inc.

He left his wallet behind, so he could not buy it

(He, leave, wallet)

(money, be in, wallet)

buymoney

money

Nextremer Inc.

NLP

Nextremer Inc.

NLP

Nextremer Inc.

The man is walking on the

bridgecakewater

60%20%10%

(man, walk, street)

(man, meet, woman)

the man is walking on the street

Then, he met a woman

Nextremer Inc.

opencyc 1984

wordnet

Nextremer Inc.

Unsupervised Learning of Narrative Event Chains

Event Chain

John went to the park, then he drunk water.

go drink

(Nathanael Chambers and Dan Jurafsky 2008)

Nextremer Inc.

( 2014)

I get, I have, I walk

They soon know that they will grow up, and the way Wendy knew was this. One day when she was two years old she was playing in a garden

['they', 'know', 'soon', 'grow', know'] ['they', 'grow', 'will', up'] ['wendy', 'know', this']

['she', 'old', 'when', 'be', 'year']

They were eating only a loaf of bread without butter.

Nextremer Inc.

NLP

Nextremer Inc.

NLP

Nextremer Inc.

InScript Corpus Event chain

1.

After playing football with my friends , I was all sweaty and dirty , so I decide I should take a bath

10 x 100

2. 1()

I slice up a few strawberries 'I', 'slice', 'strawberry'

InScript: Narrative texts annotated with script information

(Ashutosh Modi, Tatjana Anikina, Simon Ostermann, Manfred Pinkal)

Nextremer Inc.

seq2seq

4 events=8 wordsdry hand put flour blend whip get bowl

sequence to

sequcence

3LSTM attention

1 events=2 words

mix chocolate

Nextremer Inc.

seq2seq

decide today preheat oven gather ingredient need eggevent

take ingredient take batter take pan

ride bike take minute ride bike miss experience

take wheel take tire remove tireshow agent walk detector gather belongings wait passenger

walk line walk ticket wait ticket wait seat take seat see ride

Nextremer Inc.

seq2seq

decide today preheat oven gather ingredient need eggevent

take ingredient take batter take pan

Andrew decided the today. He preheated his oven and gathered his ingredient. He needed his egg then took the ingredient. He took his batter. He took the pan.

Nextremer Inc.

decide today preheat oven gather ingredient need egg

take ingredient take batter take pan take pan take pan

event

seq2seq

event

Nextremer Inc.

seq2seq

100

dry hand put flour blend whip get bowl

want platform show ticket find seat take seat

leave counter go gate walk gate pull magazine

: CAKE

: TRAIN

: LIBRARY

Nextremer Inc.

event

Nextremer Inc.

Unsupervised Learning of Narrative Event Chains (Nathanael Chambers and Dan Jurafsky) InScript: Narrative texts annotated with script information (Ashutosh Modi, Tatjana Anikina, Simon Ostermann, Manfred Pinkal) Improving event prediction by representing script participants (Simon Ahrendt and Vera Demberg) Script Induction as Language Modeling

(Rachel Rudinger, Pushpendre Rastogi, Francis Ferraro, and Benjamin Van Durme )

( , , ) Phillip ( ) Reasoning With Neural Tensor Networks for Knowledge Base Completion (Richard Socher, Danqi Chen, Christopher D. Manning, Andrew Y. Ng) what is opencyc? http://agi-conf.org/2009/slides/friday/1_reed_opencyctutorial.ppt

http://agi-conf.org/2009/slides/friday/1_reed_opencyctutorial.ppt