musicdiscoberry: the bittersweet high-hanging fruit

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma

MUSICDISCOBERRYthe bittersweet high-hanging fruit

Òscar Celma

“The Paradox of Choice: Why More Is Less” (Barry Schwartz, 2004)

The limited reach of music recommendationHelp! I’m stuck in the head

Sales Rank83 Artists 6,659 Artists 239,798 Artists

0% ofrecommendations

48% of recommendations

52% of recommendations

Last.fm similar artists

WHAT WHO WHY WHEN WHERE

Music Similarity

● Content-based● Usage-based● Social-based● Hybrid (combination)

Music Similarity

Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen

Audio Content-Based Analysis

Timbre (MFCC)

Harmony (Chromagram)

Rhythm: beat detection, BPMs

Song: “Call Me Maybe” Carly Rae Jepsen

Timbre (MFCC)

Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen

Timbre (MFCC)

Rhythm: beat detection, BPMs...as well as

loudnessdanceability

studio vs. livestructure (ABABCA)

genre (pop)mood (euphoric, energetic)

Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen

Timbre (MFCC)

Rhythm (beat detection, BPMs)

Song 2

Timbre (MFCC)

Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen

Timbre (MFCC)

Song 2

Timbre (MFCC)

Rhythm (beat detection, BPMs)sim(Song1, Song2) = ???

EMD & k-meansKL & GMML2 & PCA

Adhoc...

Audio Content-Based Similarity

Music Similarity

Usage-Based

● Collaborative filtering● “people who listen to X also listen to Y”

● Matrix Factorization● SVD, NMF, ...

Usage-Based The Beatles Example

Long Tail in Music

● From Hits to Niches

how many clicks?

Long Tail in Music

● From Hits to Niches● Audio Content-Based similarity

– 2 clicks● Usage-Based (last.fm)

– 5 clicks (!)

(yet, perceived quality is higher for usage-based)

Music Similarity

Social-Based

Content Reviews Blogs Social Tags Bios Playlists

thrash

gothic

heavy metal

concert

Social-Based The Beatles Example

Social-Based Black Metal Tag

http://www.last.fm/bestof/10years/artists/tag/black+metal

Music Similarity

Hybrid

● Weighted (linear combination)● E.g Usage * 0.4 + Social * 0.4 + Content * 0.2

● Cascade● E.g 1st apply Social, then reorder by Content-Based

● (...)

Hybrid Music Similarity

● Consider all music including new, and not-so popular

Radiohead similar artists

“If you like Radiohead you might like this article” (Celma & Lamere). AI Magazine, 2011

Using Last.fm-360K dataset (google: oscar celma datasets)

Social-Based: Using Artist TagsContent-Based: Audio Similarity (artist top tracks)

Usage-Based: CF

Recommendation

“People who like Radiohead also like X”vs.

“Paul likes Radiohead, so he might also like Y”

Recommendation

● To whom are we recommending? Phoenix-2. UK (2006)

lamere @ last.fm

● Clustering lamere top-20 artists (using tags)

lamere @ last.fm

● Clustering lamere top-20 artists (using tags)

@lamere - Radiohead

vs. Radiohead similar artists...

@lamere - Radiohead

Novel & Relevant music for Paul

Novelty & Relevance

Emitt Rhodes

Novelty & Relevance

WHY as important as WHAT

Novelty & Relevance

SIMILAR ARTISTS:

The RoulettesThe Fourmost

SIMILAR ARTISTS:

The Idle RaceThe Flower Pot Men

SIMILAR ARTISTS:

Emitt RhodesHotlegs

Emitt Rhodes

● Listener’s context

● Listener’s context● Working● Driving● Workout● Studying● Relaxing

● How to get user's attention?

The Whole Picture

@ocelmahttp://ocelma.net

MUSICDISCOBERRYthe bittersweet high-hanging fruit

musicdiscoberry: the bittersweet high-hanging fruit

ocelma hybrid

ocelmahybrid music similarity

carly rae jepsenrhythm

g usage

carly rae jepsen song

energeticharmony chromagram

beatles example

black metal taghttp

Documents

ai pharma the low hanging fruit - 27 july 2017

pdf - seo - low hanging fruit

agriculture is low hanging fruit for eac

multi-inclusion, universal client electronic health record...

health: low hanging fruit? - mit opencourseware · health:...

beyond the low hanging fruit: applying affinity clues for ...

the meantime - step three - low hanging fruit · table of...

canadian unconventionals: the low(er) hanging fruit ·...

harvesting the not-so-low hanging fruit into noyce

b2b marketing: low-hanging fruit to support the sales team

more low-hanging fruit than you think

using competitive gap analyses to discover low-hanging fruit

op naar hoger hangend fruit - home - sirm · the...

technical marketing and growth hacking low hanging fruit

salterbaxter - directions supplement - avoid the low hanging...

seo keyword research - find the "low hanging fruit" keywords

canadian unconventionals: the low(er) hanging fruit

the ex-im bank: can congress tackle cronyism's...

reaching for high-hanging fruit: cost effective

low hanging fruit always rots first - carbon trade watch ·...