Transcript
Page 1: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe

Advisor: Prof. Nick Webb

Page 2: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

RESEARCH QUESTIONS

Can we predict the year in which a song was released?

Can we predict the genre of a song?

Can we identify which attributes are the strongest in answering these questions?

Page 3: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

BACKGROUND

Hit Song Science Genre Classification Year Prediction

Page 4: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

APPROACH

Use WEKA Use the Million Song Dataset

Page 5: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

WEKA

Machine Learning Software Contains Visualization tools and

algorithms for data analysis and modeling

Page 6: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

DATA

Million Song Data Set: commercial tracks from 1922-2011,collected by LabROSA

Page 7: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb
Page 8: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

EARLY CHALLENGES

Data in the wrong Format: HDF5 vs CSV Lots of missing Data! Almost half of the songs are missing

year, a very important attribute Many attributes are being ignored

because a majority of the songs are missing data.

ArtistID -> Year?

Page 9: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb
Page 10: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

ATTRIBUTES

The MSD contains 53 descriptive attributes for each song, along with 90 timbre attributes. Attributes were removed if they were not good indicators of release year or genre, or if they were too closely tied to what was being classified.

Page 11: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

ATTRIBUTE MOTIVATION

Ranked Descriptive Attributes• Loudness (measured in decibels)• Duration (in seconds)• Tempo (estimated tempo in BPM)• Time Signature (estimated beats per bar)• Key • Mode (major or minor)

Timbre is the quality of a musical note or sound that distinguishes different types of musical instruments, or voices. It is a complex notion also referred to as sound color, texture, or tone quality, and is derived from the shape of a segment’s spectro-temporal surface, independently of pitch and loudness.

Page 12: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

EARLY RESULTS – DESCRIPTIVE ATTRIBUTES Discretized into 6 decades; 1960-1970, 1970-1980, etc. Baseline (Chance selection): 16.67% First Tests: 6-9% correctly classified More recent Tests: 25-30% Why Random Forest and BayesNet?

Page 13: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

EARLY RESULTS

Page 14: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

TIMBRE RESULTS

Page 15: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

GENRE PREDICTION

Genres: Classic pop and rock Classical Dance and Electronica Folk Hip-Hop Jazz Metal Pop Rock and Indie Soul and Reggae

Page 16: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

GENRE PREDICTION RESULTS

Page 17: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

CONCLUSIONS & FUTURE WORK

Timbre Attributes are better than Descriptive Attributes – Why?

Taste Profile Lyrical/Emotional Content Tag Dataset

Page 18: MACHINE LEARNING TECHNIQUES FOR MUSIC PREDICTION S. Grant Lowe Advisor: Prof. Nick Webb

QUESTIONS?


Top Related