Practical Sentiment Analysis

  • Published on
    11-Aug-2014

  • View
    1.988

  • Download
    1

Embed Size (px)

DESCRIPTION

An informative tutorial on practical sentiment analysis, natural language processing, and semi-supervised learning. Learn how your company can leverage the crowd for sentiment analysis of structured and un-structured content. Dr. Jason Baldridge is co-founder and Chief Scientist at People Pattern, and Associate Professor, Linguistics, at the University of Texas

Transcript

  • Practical Sentiment Analysis Tutorial Jason Baldridge @jasonbaldridge Sentiment Analysis Symposium 2014 Associate Professor Co-founder & Chief Scientist Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 About the presenter Associate Professor, Linguistics Department, The University of Texas at Austin (2005-present) Ph.D., Informatics, The University of Edinburgh, 2002 MA (Linguistics), MSE (Computer Science), The University of Pennsylvania, 1998 Co-founder & Chief Scientist, People Pattern (2013-present) Built Converseons Convey text analytics engine, with Philip Resnik and Converseon programmers. 2 Wednesday, March 5, 14
  • Why NLP is hard Sentiment analysis overview Document classication break Aspect-based sentiment analysis Visualization Semi-supervised learning break Stylistics & author modeling Beyond text Wrap up Wednesday, March 5, 14
  • Why NLP is hard Sentiment analysis overview Document classication Aspect-based sentiment analysis Visualization Semi-supervised learning Stylistics & author modeling Beyond text Wrap up Wednesday, March 5, 14
  • Text is pervasive = big opportunities Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 Texts as bags of words (with apologies) (http://www.wordle.net/) 6 Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 Texts as bags of words (with apologies) (http://www.wordle.net/) http://www.wired.com/magazine/2010/12/ff_ai_essay_airevolution/ 6 Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 That is of course not the full story... Texts are not just bags-of-words. Order and syntax affect interpretation of utterances. 7 leg on manthe dog bit Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 That is of course not the full story... Texts are not just bags-of-words. Order and syntax affect interpretation of utterances. 7 legonmanthe dogbit thethe Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 That is of course not the full story... Texts are not just bags-of-words. Order and syntax affect interpretation of utterances. 7 legonmanthe dogbit thethe mandog Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 That is of course not the full story... Texts are not just bags-of-words. Order and syntax affect interpretation of utterances. 7 legonmanthe dogbit thethe mandog Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 That is of course not the full story... Texts are not just bags-of-words. Order and syntax affect interpretation of utterances. 7 legonmanthe dogbit thethe mandog Subject Object Modifier Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 That is of course not the full story... Texts are not just bags-of-words. Order and syntax affect interpretation of utterances. 7 legonmanthe dogbit thethe mandog Subject Object Location Wednesday, March 5, 14
  • What does this sentence mean? I saw her duck with a telescope. Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l I saw her duck with a telescope. Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l I saw her duck with a telescope. verb Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l I saw her duck with a telescope. verb Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l I saw her duck with a telescope. verb Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l I saw her duck with a telescope. verb Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l I saw her duck with a telescope. verb Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun [http://www.clker.com/clipart-green-eyes-3.html] Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun [http://www.clker.com/clipart-3163.html] Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun [http://www.simonpalfrader.com/category/tournament-poker] Slide by Lillian Lee Wednesday, March 5, 14
  • What does this sentence mean? [http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/] I saw her duck with a telescope. verb noun [http://casablancapa.blogspot.com/2010/05/fore.htm]l Slide by Lillian Lee Wednesday, March 5, 14
  • Ambiguity is pervasive the a are of I [Steve Abney] Slide by Lillian Lee Wednesday, March 5, 14
  • Ambiguity is pervasive the a are of I [Steve Abney] an are (100 m2) another are Slide by Lillian Lee Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 And it goes further... Rhetorical structure affects the interpretation of the text as a whole. 10 Max fell. John pushed him. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 And it goes further... Rhetorical structure affects the interpretation of the text as a whole. 10 Max fell. John pushed him. Max fell. John pushed him. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 And it goes further... Rhetorical structure affects the interpretation of the text as a whole. 10 Max fell. John pushed him.(Because) Explanation Max fell. John pushed him. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 And it goes further... Rhetorical structure affects the interpretation of the text as a whole. 10 Max fell. John pushed him.(Because) Explanation Max fell. John pushed him.(Then) Continuation Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 And it goes further... Rhetorical structure affects the interpretation of the text as a whole. 10 Max fell. John pushed him.(Because) Explanation Max fell. John pushed him.(Then) Continuation pushing precedes falling Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 2014 And it goes further... Rhetorical structure affects the interpretation of the text as a whole. 10 Max fell. John pushed him.(Because) Explanation Max fell. John pushed him.(Then) Continuation pushing precedes falling falling precedes pushing Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] To get a spare tire (donut) for his car? John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] store where donuts shop? or is run by donuts? or looks like a big donut? or made of donut? or has an emptiness at its core? John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] I stopped smoking freshman year, but John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] Describes where the store is? Or when he stopped? John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] Well, actually, he stopped there from hunger and exhaustion, not just from work. John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] At that moment, or habitually? John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] Thats how often he thought it? John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] But actually, a coffee only stays good for about 10 minutes before it gets cold. John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March 201411 Whats hard about this story? [Slide from Jason Eisner] Similarly: In America a woman has a baby every 15 minutes. Our job is to nd that woman and stop her. John stopped at the donut store on his way home from work. He thought a coffee was good every few hours. But it turned out to be too expensive there. Wednesday, March 5, 14
  • 2014 Jason M Baldridge Sentiment Analysis Symposium, March...