musicdiscoberry: the bittersweet high-hanging fruit

recsys meetup 2012 @ berlin | musicdiscoberry | @ocelma

MUSICDISCOBERRYthe bittersweet high-hanging fruit

Òscar Celma

“The Paradox of Choice: Why More Is Less” (Barry Schwartz, 2004)

The limited reach of music recommendationHelp! I’m stuck in the head

Pop

ula

rity

Sales Rank83 Artists 6,659 Artists 239,798 Artists

0% ofrecommendations

48% of recommendations

52% of recommendations

Last.fm similar artists



WHAT WHO WHY WHEN WHERE


Music Similarity

● Content-based● Usage-based● Social-based● Hybrid (combination)


Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen


Audio Content-Based Analysis

Timbre (MFCC)

Harmony (Chromagram)

Rhythm: beat detection, BPMs

Song: “Call Me Maybe” Carly Rae Jepsen


Audio Content-Based AnalysisSong: “Call Me Maybe” Carly Rae Jepsen

Timbre (MFCC)


Rhythm: beat detection, BPMs...as well as

loudnessdanceability

studio vs. livestructure (ABABCA)

genre (pop)mood (euphoric, energetic)


Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen

Timbre (MFCC)


Rhythm (beat detection, BPMs)

Song 2

Timbre (MFCC)




Audio Content-Based SimilaritySong 1: “Call Me Maybe” Carly Rae Jepsen

Timbre (MFCC)



Song 2

Timbre (MFCC)


Rhythm (beat detection, BPMs)sim(Song1, Song2) = ???

EMD & k-meansKL & GMML2 & PCA

Adhoc...


Audio Content-Based Similarity


Music Similarity



Usage-Based

● Collaborative filtering● “people who listen to X also listen to Y”

● Matrix Factorization● SVD, NMF, ...


Usage-Based The Beatles Example


Long Tail in Music

● From Hits to Niches

how many clicks?


Long Tail in Music

● From Hits to Niches● Audio Content-Based similarity

– 2 clicks● Usage-Based (last.fm)

– 5 clicks (!)

(yet, perceived quality is higher for usage-based)


Music Similarity



Social-Based

Content Reviews Blogs Social Tags Bios Playlists

thrash

rock

Edgy

gothic

heavy metal

90s

Weird

concert

Loud


Social-Based The Beatles Example


Social-Based Black Metal Tag



???



http://www.last.fm/bestof/10years/artists/tag/black+metal


Music Similarity



Hybrid

● Weighted (linear combination)● E.g Usage * 0.4 + Social * 0.4 + Content * 0.2

● Cascade● E.g 1st apply Social, then reorder by Content-Based

● (...)


Hybrid Music Similarity



● Consider all music including new, and not-so popular


Radiohead similar artists

“If you like Radiohead you might like this article” (Celma & Lamere). AI Magazine, 2011



? ? ?

Using Last.fm-360K dataset (google: oscar celma datasets)

Social-Based: Using Artist TagsContent-Based: Audio Similarity (artist top tracks)

Usage-Based: CF


Recommendation

“People who like Radiohead also like X”vs.

“Paul likes Radiohead, so he might also like Y”


Recommendation

● To whom are we recommending? Phoenix-2. UK (2006)


lamere @ last.fm


lamere @ last.fm

● Clustering lamere top-20 artists (using tags)


@lamere - Radiohead

9


@lamere - Radiohead

vs. Radiohead similar artists...

9


@lamere - Radiohead

vs. Radiohead similar artists...

9

Novel & Relevant music for Paul


Novelty & Relevance


Novelty & Relevance

Emitt Rhodes


Novelty & Relevance

WHY as important as WHAT


Novelty & Relevance

SIMILAR ARTISTS:

The RoulettesThe Fourmost

SIMILAR ARTISTS:

The Idle RaceThe Flower Pot Men

SIMILAR ARTISTS:

Emitt RhodesHotlegs



Emitt Rhodes

?



● Listener’s context



● Listener’s context● Working● Driving● Workout● Studying● Relaxing

● How to get user's attention?


The Whole Picture


@ocelmahttp://ocelma.net

MUSICDISCOBERRYthe bittersweet high-hanging fruit

http://ocelma.net/

musicdiscoberry: the bittersweet high-hanging fruit

Documents

ocelma hybrid

ocelmahybrid music similarity

carly rae jepsenrhythm

g usage

carly rae jepsen song

energeticharmony chromagram

beatles example

black metal taghttp