View
509
Download
0
Category
Preview:
DESCRIPTION
Citation preview
NewsTweet Discover what’s
happening anywhere in the world right now.
Kevin Schaeffer Insight Data Science Fellow June 2013
Exciting News Broken on Twitter But… Very Noisy!
NewsTweet
The Algorithm News
(recognized news accounts) Other
(streaming API)
Multinomial Naïve Bayes Classifier
• Tokenize Tweets (anonymize @, #)
• Only English Tweets with >100 characters
• Bag of Words Model • n=6000 training set • 86% cross-validation accuracy
Tools
Kevin Schaeffer Ph.D. in Physics from Berkeley
(String Theory)
What makes a tweet newsworthy?
§ Most informative news words: § U.S.
§ Officials
§ Law
§ Most informative words for other types of tweets: § Lol
§ Ipad
§ U
Recommended