Embed Size (px)
Citation preview
by Matthew Huebert
Language models thatstimulate creativity
BrainTripping
Building BrainTripping+ Lessons Learned
+ Observations
makin’ brains
Dr. SeussJustin BieberJesus ChristParis Hilton
Queen Elizabeth IIKurt Cobain
RihannaMother Teresa
Steve JobsBeethoven
Donald TrumpStephen Hawking
Lil WayneCharles Darwin
Helen KellerSarah Palin
Pope Benedict XVITupac Shakur
Albert EinsteinMaya AngelouJane GoodallMitt RomneyGeorge BushPaul Graham
Condoleeza RiceDr. Phil
Chairman MaoFriedrich Nietzsche
Bill GatesEdgar Allan PoeStephen ColbertL. Ron Hubbard
Jane AustenBarack ObamaSigmund Freud
ShakespeareKim Jong Il
0 10000 20000 30000 40000
Vocabulary sizeAuthors are listed in order of corpus length
35 000
100 000
200 000
500 000
1 000 000
Corpus Length
Dr. SeussJustin BieberJesus ChristParis Hilton
Queen Elizabeth IIKurt Cobain
RihannaMother Teresa
Steve JobsBeethoven
Donald TrumpStephen Hawking
Lil WayneCharles Darwin
Helen KellerSarah Palin
Pope Benedict XVITupac Shakur
Albert EinsteinMaya AngelouJane GoodallMitt RomneyGeorge BushPaul Graham
Condoleeza RiceDr. Phil
Chairman MaoFriedrich Nietzsche
Bill GatesEdgar Allan PoeStephen ColbertL. Ron Hubbard
Jane AustenBarack ObamaSigmund Freud
ShakespeareKim Jong Il
0 10000 20000 30000 40000
Musicians35 000
100 000
200 000
500 000
1 000 000
Corpus Length
Dr. SeussJustin BieberJesus ChristParis Hilton
Queen Elizabeth IIKurt Cobain
RihannaMother Teresa
Steve JobsBeethoven
Donald TrumpStephen Hawking
Lil WayneCharles Darwin
Helen KellerSarah Palin
Pope Benedict XVITupac Shakur
Albert EinsteinMaya AngelouJane GoodallMitt RomneyGeorge BushPaul Graham
Condoleeza RiceDr. Phil
Chairman MaoFriedrich Nietzsche
Bill GatesEdgar Allan PoeStephen ColbertL. Ron Hubbard
Jane AustenBarack ObamaSigmund Freud
ShakespeareKim Jong Il
0 10000 20000 30000 40000
Politicians35 000
100 000
200 000
500 000
1 000 000
Corpus Length
portraits
Scott McLeod
Copyright 2010 Creators Syndicate
Devoir-de-Philosophie.com
Scott McLeod
BBC Photo Library
Keith Kasnot / National Geographic Image Collection [left]The Unit of Art in Medicine/The University of Manchester [right]
BBC Photo Library
Keith Kasnot / National Geographic Image Collection [left]The Unit of Art in Medicine/The University of Manchester [right]
suggestion algorithm
Zipf’s Law
Zipf’s Law
Zipf’s Law
High Frequency“glue” words
Low Frequencyunexpected, random
speed
Speed of Word Lookup
10 seconds
read;synthesize;
produce
Speed of Word Lookup
10 seconds
read;synthesize;
produce
Speed of Word Lookup
10 seconds 100 milliseconds
read;synthesize;
producereal-time
interaction
Speed of Word Lookup
10 seconds 100 milliseconds
Shared Authorship
user algorithm source author
Anonymity
Real Identity
yellow_frog_1982
Matthew Huebert
Anonymity
Real Identity
Mask
yellow_frog_1982
Matthew Huebert
Matt tripping on Freud
Mask
intuition for data
In a cave in Kartoom lives a beast called the Natch
In a cave in Kartoom lives a beast called the Natch
In a cave Kartoom lives beast called the Natchin a
In a cave in Kartoom lives a beast called the Natch
In a cave
Kartoom lives
1 2
3
4
5
6
beast called the Natch8 9 10
7
In a cave Kartoom lives beast called the Natchin a
One fish, two fish, red fish, blue fish.
One fish, two fish, red fish, blue fish.
One fish two fish red fish blue fish1 2 3 4 5 6 7
One fish, two fish, red fish, blue fish.
One fish two fish red fish blue fish1 2 3 4 5 6 7
One
fishtwo
red
blue
1
2
3
4 5
6 7
Implementation
speed (developer, response time)simplicity
Heroku (managed servers, simple to scale)Node.js (same language on client and server)In-memory language models
human process
Hacking BrainTrippingNode.js hackathon in Montréal
Hisako, Gina Cook, Brian Doherty, Mary Ellen Cathcart, Jon Volkmar, Martin Provencher, Jeff Marshall
Experiment Quickly
HACK
PITCH
PRESENT
Future
• Structured creative writing: “constrain and suggest”
• Foreign language “training wheels”
