Upload
nobuk
View
11.080
Download
1
Embed Size (px)
Citation preview
Preferred Networks, Inc.
2016/01/07
l (@nobu_k)
CTO@Preferred Networks, Inc. (PFN)
u US (Preferred Networks America, Inc. San Mateo)
l
()
l
beatmania IIDX SP/DP
2
l
l OK
3
Elasticsearch
Elasticsearch
+(1)
4
l
5+
l
+
l
l
l (
+(2)
l
l
l
l
l +
5
+(3)
l VOC
l
l
l
6
l
l
7
l
l
l ""(w)
8
9
l ()
(AI)
10
l
l
l
u ""
11
l
l
u
u
u
u
(1999Suica)
()
12
""
13
5
l /
1. ()
2.
3. ()
4.
5.
14
1. ()
l 1
"-19", "20-29", "30-39", "40-49", "50-", ""
l
MECE: Mutually Exclusive and Collectively Exhaustiveu
u
15
2.
l
16
-19 20-29 50-
Point 1:
2.
l
17
-19 20-29 50-
Point 1:
Point 2:
"50-"9:1""9
2.
l
18
-19 20-29 50-
Point 1:
Point 2:
Point 3: ()(tf-idf)
2.
l
19
-19 20-29 50-
Point 1:
Point 2:
Point 3: ()
Point 4: Point 13
3.
l (1)
11
u
l ()
OK
u
20
JSON:{ "label": "20-29", "tweet": {}}
CSV 1:20-29,"{CSVtweetJSON}"
CSV 2:20-29,,,
3. (1)
l
:19xx, xx, x
u
: "17", ""
u
l Elasticsearch
21
3. (2)
l
u
22
Preferred InfrastructureSedue Predictor
4.
l
(feature vector)
23
FV
: libsvm : : : : 11
4.
l
()()
bag-of-words
: n-grametc
: (tf)tf-idflog tf0/1(11)etc
l Jubatus
24
{ "1": 1, "2": 2, }
{ "": 2, "": 9, }
: libsvm# =>1=>2labelHoge 1:2 2:9
5.
l
11
25
FV
Elasticsearch
26
1: Elasticsearch
l RPython
l Elasticsearch
27
2Jubatus
l fluentdexec filterJubatus
l
11(RPC)
1128
out_exec_filter Elasticsearch
fluentd
JSON"age""gender"
3PFN
l OSS
l
SQL(CQL)
u /UDF+UDS(User Defined State)
fluentd
Go
l Chainer
Deep Learning
ChainerNLP
29
30
l
l
l
u
31
32
Copyright 2014-
Preferred Networks All Right Reserved.