View
68
Download
2
Category
Preview:
Citation preview
andrew@remesh.ai
Qualitative Research in the Age of Artificial Intelligence
Andrew Konya
andrew@remesh.ai
Fundamental Question Gather Data Analyze Data Report.ppt
How to scale for Qual?
andrew@remesh.ai
Fundamental Question Gather Data Analyze Data Report.ppt
Data
“I just can’t vote for a corrupt politician. Trump is at least blunt and honest, but how he talks about women makes me feel really
uncomfortable. I am still undecided.”
Natural Language
Audio Video
andrew@remesh.ai
I enjoy walks with my dog
I like to stroll with my k9
fresh pastry in the morning is the best
warm donuts when I wake up are awesome
Concept Space
my dog walks with me to get donuts
andrew@remesh.ai
I enjoy walks with my dog
Language Embedding
Language Embedding
ie. 1 billion google news articles
concept space
Train on corpus
andrew@remesh.ai
I enjoy walks with my dog
Language Embedding
Language Embedding
0.1, 0.50.8, 0.6
concept space
high dimensional vector
andrew@remesh.ai
Semantic Similarity
concept space
I enjoy walks with my dog
I like to stroll with my k9
Language Embedding
Language Embedding
andrew@remesh.ai
Semantic Similarity
concept space
I enjoy walks with my dog
I like to stroll with my k9
Language Embedding
Language Embedding
= Similarity (high)
andrew@remesh.ai
Semantic Similarity
concept space
I enjoy walks with my dog Language Embedding
Language Embedding
= Similarity (low)
warm donuts when I wake up are awesome
andrew@remesh.ai
Semantic Clustering
I enjoy walks with my dog
I like to stroll with my k9
fresh pastry in the morning is the best
warm donuts when I wake up are awesome
concept space
LanguageEmbedding
LanguageEmbedding
LanguageEmbedding
LanguageEmbedding
andrew@remesh.ai
Semantic Clustering
I enjoy walks with my dog
I like to stroll with my k9
fresh pastry in the morning is the best
warm donuts when I wake up are awesome
concept space
•k-means•DBSCAN•hierarchical clustering•spectral clustering•etc.
Relevant Algos
andrew@remesh.ai
Semantic Attribute Analysis
Trump is blunt and honest, and has some skills for success, but how he talks about
women makes me feel really uncomfortable.
Language Embedding
concept space
Neural Network
Semantic Attributes
ability
empathy
personality
authenticity
similarity
andrew@remesh.ai
Semantic Attribute Analysis
Says it like it is. Honest. Blunt.
concept space
Neural Network
Semantic Attributes
ability
empathy
personality
authenticity
similarity
Language Embedding
andrew@remesh.ai
Linguistic Reasoning
•Memory Networks (MN)•Neural Turring Machines (NTM)
When does Sally cook?
A.I.
Sally cooks on weekends and holidays
Sally cooks when she has free time
Sally has free time over the holidays
Sally has free time on the weekendsRelevant Algos
andrew@remesh.ai
Conversation Automation
Templated Conversation
A.I.
A.I. A.I.
•Preprogramed flow by a human•Assisted by NLP/ML algos•Limited scope of conversation•Templated responses
•Semantic Classification •Entity Extraction
andrew@remesh.ai
Conversation Automation
A.I.
the taste is weird
LSTM LSTM LSTM LSTM
Thought Vector (in concept space)
LSTM LSTM LSTM
explain the taste
Seq2seq RNN•Trained on real conversation data•Can cover wide scope of dialogue•Does not use context
andrew@remesh.ai
Conversation Automation
A.I.
Seq2seq RNN with context•Trained on real conversation data•Can cover wide scope of dialogue•Does use context via context vector
Previous Context Vector
the taste is weird
LSTM LSTM LSTM LSTM
Thought Vector (in concept space)
LSTM LSTM LSTM
explain the taste bob
Current Context Vector
LSTM
andrew@remesh.ai
Conversation Automation
A.I.
Memory Networks•Trained on real conversation data•Can cover wide scope of dialogue•Context via NN addressable memory
Addressable Memory
the taste is weird
LSTM LSTM LSTM LSTM
Thought Vector (in concept space)
LSTM LSTM LSTM
explain the taste bob
Memory Vector
LSTM
NN
andrew@remesh.ai
Fundamental Question Gather Data Analyze Data Report.ppt
Automated conversation with participants
Automated analysisof conversations
Qualitative Research in the Age of Artificial Intelligence
andrew@remesh.ai
A.I.
Researcher Employees,Consumers,
Experts
Thanks
Recommended