33
機械学習をした ちょっとリッチな検 Preferred Networks, Inc. 2016/01/07

機械学習を利用したちょっとリッチな検索

  • Upload
    nobuk

  • View
    11.080

  • Download
    1

Embed Size (px)

Citation preview

  • Preferred Networks, Inc.

    2016/01/07

  • l (@nobu_k)

    CTO@Preferred Networks, Inc. (PFN)

    u US (Preferred Networks America, Inc. San Mateo)

    l

    ()

    l

    beatmania IIDX SP/DP

    2

  • l

    l OK

    3

    Elasticsearch

    Elasticsearch

  • +(1)

    4

    l

    5+

    l

    +

    l

    l

    l (

  • +(2)

    l

    l

    l

    l

    l +

    5

  • +(3)

    l VOC

    l

    l

    l

    6

  • l

    l

    7

  • l

    l

    l ""(w)

    8

  • 9

  • l ()

    (AI)

    10

  • l

    l

    l

    u ""

    11

  • l

    l

    u

    u

    u

    u

    (1999Suica)

    ()

    12

  • ""

    13

  • 5

    l /

    1. ()

    2.

    3. ()

    4.

    5.

    14

  • 1. ()

    l 1

    "-19", "20-29", "30-39", "40-49", "50-", ""

    l

    MECE: Mutually Exclusive and Collectively Exhaustiveu

    u

    15

  • 2.

    l

    16

    -19 20-29 50-

    Point 1:

  • 2.

    l

    17

    -19 20-29 50-

    Point 1:

    Point 2:

    "50-"9:1""9

  • 2.

    l

    18

    -19 20-29 50-

    Point 1:

    Point 2:

    Point 3: ()(tf-idf)

  • 2.

    l

    19

    -19 20-29 50-

    Point 1:

    Point 2:

    Point 3: ()

    Point 4: Point 13

  • 3.

    l (1)

    11

    u

    l ()

    OK

    u

    20

    JSON:{ "label": "20-29", "tweet": {}}

    CSV 1:20-29,"{CSVtweetJSON}"

    CSV 2:20-29,,,

  • 3. (1)

    l

    :19xx, xx, x

    u

    : "17", ""

    u

    l Elasticsearch

    21

  • 3. (2)

    l

    u

    22

    Preferred InfrastructureSedue Predictor

  • 4.

    l

    (feature vector)

    23

    FV

    : libsvm : : : : 11

  • 4.

    l

    ()()

    bag-of-words

    : n-grametc

    : (tf)tf-idflog tf0/1(11)etc

    l Jubatus

    24

    { "1": 1, "2": 2, }

    { "": 2, "": 9, }

    : libsvm# =>1=>2labelHoge 1:2 2:9

  • 5.

    l

    11

    25

    FV

  • Elasticsearch

    26

  • 1: Elasticsearch

    l RPython

    l Elasticsearch

    27

  • 2Jubatus

    l fluentdexec filterJubatus

    l

    11(RPC)

    1128

    out_exec_filter Elasticsearch

    fluentd

    JSON"age""gender"

  • 3PFN

    l OSS

    l

    SQL(CQL)

    u /UDF+UDS(User Defined State)

    fluentd

    Go

    l Chainer

    Deep Learning

    ChainerNLP

    29

  • 30

  • l

    l

    l

    u

    31

  • 32

  • Copyright 2014-

    Preferred Networks All Right Reserved.