Dealing with pain points of recommenders in the real world fileTaylor Swift Pulp The Smiths Joy...

Dealing with pain points of recommenders in the real world

Sophie Watson @sophwats sophie@redhat.com

Dealing with pain points of recommenders in the real world

Sophie Watson @sophwats sophie@redhat.com

Alternating Least Squares

1 5 3

1

5

3

3

· · ·

?

· · ·

1

1

3 3

3

· · ·

· · ·

· · ·

· · ·

· · ·· · ·

· · ·· · ·

· · ·· · ·· · ·

4

4

45 5

5? ?

?2

?

?

?

? ?

1

?

≈ · · ·

≈ · · ·

?

1

≈ · · ·

1

A

B

C

1 play

10 plays

100 plays

1

1 play

10 plays

100 plays

A

B

C

Plays

Confidence

1

A

B

C

1 play

10 plays

100 plays

· · ·

1 5 3

Pain Points of ALS

???

?

???

?

time

Solutions

· · ·

· · ·

≈ · · ·

Recommendations returned to users

· ·

≈ · Data

· ·

≈ · DataRecommendations returned to users

Post-processing

· ·

≈ · DataRecommendations returned to users

Post-processing

· ·

≈ · DataRecommendations returned to users

Post-processing

NEW!

· ·

≈ · DataRecommendations returned to users

Post-processing

NEW!

time

Composable signatures for Recommendation

1 2 3

Taylor Swift Pulp

The Smiths Joy Division Billy Bragg

Taylor Swift Pulp

The Smiths Joy Division New Order

Taylor Swift Miley Cyrus

Little Mix Billie Eillish Spice Girls

1 2 3

Taylor Swift Pulp

The Smiths Joy Division Billy Bragg

Taylor Swift Pulp

The Smiths Joy Division New Order

Taylor Swift Miley Cyrus

Little Mix Billie Eillish Spice Girls

Jaccard 1 2,( (= Artist listened to Artist listened to

Artist listened to Artist listened to

1

1

2

2

∩∩

1

Taylor Swift Pulp

The Smiths Joy Division Billy Bragg

Jaccard 1 2,( (= Artist listened to Artist listened to

Artist listened to Artist listened to

1

1

2

2

=4

6

2 3

Taylor Swift Pulp

The Smiths Joy Division New Order

Taylor Swift Miley Cyrus

Little Mix Billie Eillish Spice Girls

∩∩

1

Taylor Swift Pulp

The Smiths Joy Division Billy Bragg

Jaccard 1 2,( (

=Artist listened to Artist listened to

Artist listened to Artist listened to

1

1

3

3

=1

9

2 3

Taylor Swift Pulp

The Smiths Joy Division New Order

Taylor Swift Miley Cyrus

Little Mix Billie Eillish Spice Girls

=4

6

Jaccard 1 3,( ( ∩∩

Jaccard 1 5,( (=

Jaccard 1 3,( (= 0.5

Jaccard 1 4,( (= 0.1

0.1

Jaccard 1 6,( (= 0.6

Jaccard 1 ,( (= 0.32

Jaccard 1 5,( (=

Jaccard 1 3,( (= 0.5

Jaccard 1 4,( (= 0.1

0.1

Jaccard 1 6,( (= 0.6

Jaccard 1 ,( (= 0.32

Artist id Date-timeTaylor Swift

Pulp The Smiths Joy Division Billy Bragg

1

2

1

2

Jaccard 1 2,( (=∩∩

1

2

Jaccard 1 2,( (=∩∩

1

2

Jaccard 1 2,( (= =3

10

∩∩

1

1

1

1

1

+

=

Artist id Date-time

Summer

Winter

1

2

1

2

Jaccard 1 2,( (=∩∩

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

1 ,( (.

MinHash for recommendation

1

1

Min-hash signature

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists.

∞∞∞∞∞

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists.

∞∞∞∞∞

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists.

∞∞∞∞∞

1

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists.

∞∞∞∞∞

1

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists. 11111

∞∞∞∞∞

1

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists. 11111

612,048

9856471

∞∞∞∞

1

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists. 11111

612,048

9856471

1

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists. 11111

612,048

9856471

1

4

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists. 4 612,048

9856471

4

4

44

1711,09743,861

93111,123

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from # artists to # artists. 4 6

98

71

4

4

44

11,097

93

4

1

Min-hash signature

6

91

43

1,987

93

1

Min-hash signature

6

91

43

1,987

93

2

9,872

486

43

1,987

32,821

1

Min-hash signature

6

91

43

1,987

93

2

9,872

486

43

1,987

32,821

1

2

1

2

1

Min-hash signature

6

91

43

1,987

93

1

9,872

486

43

12

84

1

Min-hash signature

6

91

43

1,987

93

1

+ =

6

91

43

12

84

9,872

486

43

12

84

1

h1( (h2( (h3( (h4( (h5( (Min-hash signature

Map from ARTIST NAMES to # artists.

Artist Date

Locality sensitive MinHash

1 2 3 4

1 2 3 4

}Band 1

}Band 2

}Band 3

}Band 4

}Band 5

1 2 3 4

}Band 1

}Band 2

}Band 3

}Band 4

}Band 5

h ( (Map from vecs of band size to large numbers.

1 2 3 4

}Band 1

}Band 2

}Band 3

}Band 4

}Band 5

h ( (Map from vecs of band size to large numbers.

Things we didn’t have time for

1

A

B

C

1 play

10 plays

100 plays

1 5 3

Things we have talked about

sophie@redhat.com @sophwats

sophie@redhat.com @sophwats

sophie@redhat.com @sophwats

sophie@redhat.com @sophwats