SlideShare a Scribd company logo
Understanding Music Playlists
10 July 2015
ICML 2015 Workshop - Machine Learning and Music Discovery
Keunwoo Choi
George Fazekas
Mark Sandler
@c4dm @Queen Mary University of London
Content
• Music Playlist
• Finding 1
• Finding 2
• Finding 3
• Conclusion
Playlist and Recommendation
• Music recommendation == playlist generation 

in many cases; especially for common music listener.
• Because recommending a song doesn’t make sense.
• Because simply picking top-N songs might fail.
Music Playlist
• What is playlist?
• “Sequence of music items”

for ( ), by ( ), …
• Ill-posed definition,

inductively defined

by how people use
• Many people use it
• 1.5B playlists on Spotify
Different Assumptions
• What is a good playlist?
Sequence of similar songs
Smooth transitions
Fixed start/end song
Given duration
?
Datasets
Deezer-2015
144,726 songs
50,000 playlists
during 2007-2015
EchoNest track
features (high-level
features such as
speechness,
dancability, …)
AoTM-2011
97,411 songs
86,310 playlists
during 1998-2011
EchoNest Timbre
Features, energy/
key/loudness/
mode…
+ playlist category
Datasets
• Hierarchy of playlist categories
Genre
Rock Jazz Hiphop R&B Electronic Folk
Rock/
Pop
Mixed
Genre
Blues Raggae Country
Punk Hardcore
Dance/
House
Activity
Sleep
Road
trip
Emotion
Break
up
Depression
Others
Indie
Alternating
DJ
Theme
Single
artist
Cover Narrative
Three Findings
F1. User clusters in 

audio-based feature domain
Jennings, 2007
Understanding Music Playlists
Understanding Music Playlists
Understanding Music Playlists
• No structural difference
• Playlist itself doesn’t represent the user that much.

(Or is not easily observed.)
• Usage data may be required
• Usage hours, number of songs/artists, diversity of
preferences, price tier, social activities, …
F2. Similarity vs. Diversity
“Songs in a playlist should be similar”
“Songs in a playlist shouldn’t be too similar”
Similar
Familiar
Unified
vs.
Interesting
Not boring
Diverse
• Audio feature similarity between songs
• within-playlist



vs.



arbitrary pairs
Mean 25% 75%
0.080 0.061 0.094
0.095 0.041 0.126
3. Different similarity given category
• Compute the similarity of songs in the playlists for each
category (for each feature)
• Get rankings of categories (for each feature)
• Get average of the rankings
• Plot it (with nice colours)
3. Different similarity given category
Summary
• User (behaviour) information is required to build user
model based on clustering
• Should find an appropriate range of similarity for better
playlist generation
• which varies given dataset, features, and similarity
measure.
• Desired song similarity may be different for each
category
• Different parameters/prior should be set.
Future work
, or just curious about…
• How much do people care about playlist? 

How much do people put efforts on it?
• Mix Tape/CD was important for us (music researchers),

so as (modern) playlist for people?
• Looks like they are just containers for a set of songs
rather than a sequence songs.

More Related Content

PDF
"All you need is AI and music" by Keunwoo Choi
PDF
20211026 taicca 1 intro to mir
PDF
20190625 Research at Taiwan AI Labs: Music and Speech AI
PDF
Machine learning for creative AI applications in music (2018 nov)
PDF
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
PDF
20211026 taicca 2 music generation
PDF
楊奕軒/音樂資料檢索
PDF
Alpan Aytekin-Game Audio Essentials
"All you need is AI and music" by Keunwoo Choi
20211026 taicca 1 intro to mir
20190625 Research at Taiwan AI Labs: Music and Speech AI
Machine learning for creative AI applications in music (2018 nov)
인공지능의 음악 인지 모델 - 65차 한국음악지각인지학회 기조강연 (최근우 박사)
20211026 taicca 2 music generation
楊奕軒/音樂資料檢索
Alpan Aytekin-Game Audio Essentials

What's hot (20)

PDF
machine learning x music
PDF
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
PPT
Video Game Music Overview
PDF
The echo nest-music_discovery(1)
PDF
Machine Learning for Creative AI Applications in Music (2018 May)
PDF
Deep Learning with Audio Signals: Prepare, Process, Design, Expect
PDF
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
PDF
Artificial intelligence and Music
PPTX
Conditional generative model for audio
PDF
Research at MAC Lab, Academia Sincia, in 2017
ODP
Social Tags and Music Information Retrieval (Part I)
PPT
Game Audio Post-Production
PPT
Problems and Solutions in Game Audio
PDF
Automatic Music Composition with Transformers, Jan 2021
PDF
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
PPT
Nothing Odd about Audio
PDF
北原研究室の研究事例紹介:ベーシストの旋律分析とイコライザーの印象分析(Music×Analytics Meetup vol.5 ロングトーク)
PDF
Adaptive Music in Games
ODP
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
PDF
Sound Events and Emotions: Investigating the Relation of Rhythmic Characteri...
machine learning x music
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
Video Game Music Overview
The echo nest-music_discovery(1)
Machine Learning for Creative AI Applications in Music (2018 May)
Deep Learning with Audio Signals: Prepare, Process, Design, Expect
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Artificial intelligence and Music
Conditional generative model for audio
Research at MAC Lab, Academia Sincia, in 2017
Social Tags and Music Information Retrieval (Part I)
Game Audio Post-Production
Problems and Solutions in Game Audio
Automatic Music Composition with Transformers, Jan 2021
ISMIR 2019 tutorial: Generating music with generative adverairal networks (GANs)
Nothing Odd about Audio
北原研究室の研究事例紹介:ベーシストの旋律分析とイコライザーの印象分析(Music×Analytics Meetup vol.5 ロングトーク)
Adaptive Music in Games
Annotating Music Collections: How Content-Based Similarity Helps to Propagate...
Sound Events and Emotions: Investigating the Relation of Rhythmic Characteri...
Ad

Viewers also liked (9)

PDF
Automatic Tagging using Deep Convolutional Neural Networks - ISMIR 2016
PDF
Deep learning for music classification, 2016-05-24
PDF
딥러닝 개요 (2015-05-09 KISTEP)
PDF
[261] 실시간 추천엔진 머신한대에 구겨넣기
PDF
Deep Learning Meetup #5
PDF
Deep Convolutional Neural Networks - Overview
PPTX
Talwar_Rakshak_2016URD
PDF
Deep Learning for Speech Recognition - Vikrant Singh Tomar
PDF
MusicMood - Machine Learning in Automatic Music Mood Prediction Based on Song...
Automatic Tagging using Deep Convolutional Neural Networks - ISMIR 2016
Deep learning for music classification, 2016-05-24
딥러닝 개요 (2015-05-09 KISTEP)
[261] 실시간 추천엔진 머신한대에 구겨넣기
Deep Learning Meetup #5
Deep Convolutional Neural Networks - Overview
Talwar_Rakshak_2016URD
Deep Learning for Speech Recognition - Vikrant Singh Tomar
MusicMood - Machine Learning in Automatic Music Mood Prediction Based on Song...
Ad

Similar to Understanding Music Playlists (20)

PDF
Btp 1st
PDF
Hsjs.pdf
PDF
auto_playlist
PDF
Spotify Machine Learning Solution for Music Discovery
PDF
Machine Learning and Big Data for Music Discovery at Spotify
PDF
Lorenzo Porcaro PhD Defense
PDF
Hypergraph Models of Playlist Dialects
PDF
AI&BigData Lab 2016. Игорь Костюк: Как приручить музыкальную рекомендательную...
PDF
IRJET- A Personalized Music Recommendation System
PDF
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”
PDF
PDF
Music 4.5 The New Digital Tech with Alan Hannaway, Product Owner Data, 7digital
PDF
Music Personalization At Spotify
PDF
Big data and machine learning @ Spotify
PDF
Music Recommendation 2018
PDF
Trends in Music Recommendations 2018
PPTX
General assembly ux_project_051113_avc
PDF
Personalizing the listening experience
KEY
Finding a Path Through the Juke Box: The Playlist Tutorial
PDF
Improvise
Btp 1st
Hsjs.pdf
auto_playlist
Spotify Machine Learning Solution for Music Discovery
Machine Learning and Big Data for Music Discovery at Spotify
Lorenzo Porcaro PhD Defense
Hypergraph Models of Playlist Dialects
AI&BigData Lab 2016. Игорь Костюк: Как приручить музыкальную рекомендательную...
IRJET- A Personalized Music Recommendation System
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”
Music 4.5 The New Digital Tech with Alan Hannaway, Product Owner Data, 7digital
Music Personalization At Spotify
Big data and machine learning @ Spotify
Music Recommendation 2018
Trends in Music Recommendations 2018
General assembly ux_project_051113_avc
Personalizing the listening experience
Finding a Path Through the Juke Box: The Playlist Tutorial
Improvise

Recently uploaded (20)

PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PPTX
Geodesy 1.pptx...............................................
PDF
Well-logging-methods_new................
PPTX
Internet of Things (IOT) - A guide to understanding
PDF
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
PPT
Mechanical Engineering MATERIALS Selection
PPTX
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
PDF
Model Code of Practice - Construction Work - 21102022 .pdf
PDF
composite construction of structures.pdf
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PPTX
UNIT 4 Total Quality Management .pptx
PPTX
Sustainable Sites - Green Building Construction
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
DOCX
573137875-Attendance-Management-System-original
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PPTX
Construction Project Organization Group 2.pptx
PPTX
Welding lecture in detail for understanding
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
Geodesy 1.pptx...............................................
Well-logging-methods_new................
Internet of Things (IOT) - A guide to understanding
Mitigating Risks through Effective Management for Enhancing Organizational Pe...
Mechanical Engineering MATERIALS Selection
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
Model Code of Practice - Construction Work - 21102022 .pdf
composite construction of structures.pdf
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
UNIT 4 Total Quality Management .pptx
Sustainable Sites - Green Building Construction
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
573137875-Attendance-Management-System-original
UNIT-1 - COAL BASED THERMAL POWER PLANTS
Construction Project Organization Group 2.pptx
Welding lecture in detail for understanding
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx

Understanding Music Playlists

  • 1. Understanding Music Playlists 10 July 2015 ICML 2015 Workshop - Machine Learning and Music Discovery Keunwoo Choi George Fazekas Mark Sandler @c4dm @Queen Mary University of London
  • 2. Content • Music Playlist • Finding 1 • Finding 2 • Finding 3 • Conclusion
  • 3. Playlist and Recommendation • Music recommendation == playlist generation 
 in many cases; especially for common music listener. • Because recommending a song doesn’t make sense. • Because simply picking top-N songs might fail.
  • 4. Music Playlist • What is playlist? • “Sequence of music items”
 for ( ), by ( ), … • Ill-posed definition,
 inductively defined
 by how people use • Many people use it • 1.5B playlists on Spotify
  • 5. Different Assumptions • What is a good playlist? Sequence of similar songs Smooth transitions Fixed start/end song Given duration ?
  • 6. Datasets Deezer-2015 144,726 songs 50,000 playlists during 2007-2015 EchoNest track features (high-level features such as speechness, dancability, …) AoTM-2011 97,411 songs 86,310 playlists during 1998-2011 EchoNest Timbre Features, energy/ key/loudness/ mode… + playlist category
  • 7. Datasets • Hierarchy of playlist categories Genre Rock Jazz Hiphop R&B Electronic Folk Rock/ Pop Mixed Genre Blues Raggae Country Punk Hardcore Dance/ House Activity Sleep Road trip Emotion Break up Depression Others Indie Alternating DJ Theme Single artist Cover Narrative
  • 9. F1. User clusters in 
 audio-based feature domain Jennings, 2007
  • 13. • No structural difference • Playlist itself doesn’t represent the user that much.
 (Or is not easily observed.) • Usage data may be required • Usage hours, number of songs/artists, diversity of preferences, price tier, social activities, …
  • 14. F2. Similarity vs. Diversity “Songs in a playlist should be similar” “Songs in a playlist shouldn’t be too similar” Similar Familiar Unified vs. Interesting Not boring Diverse
  • 15. • Audio feature similarity between songs • within-playlist
 
 vs.
 
 arbitrary pairs
  • 16. Mean 25% 75% 0.080 0.061 0.094 0.095 0.041 0.126
  • 17. 3. Different similarity given category • Compute the similarity of songs in the playlists for each category (for each feature) • Get rankings of categories (for each feature) • Get average of the rankings • Plot it (with nice colours)
  • 18. 3. Different similarity given category
  • 19. Summary • User (behaviour) information is required to build user model based on clustering • Should find an appropriate range of similarity for better playlist generation • which varies given dataset, features, and similarity measure. • Desired song similarity may be different for each category • Different parameters/prior should be set.
  • 20. Future work , or just curious about… • How much do people care about playlist? 
 How much do people put efforts on it? • Mix Tape/CD was important for us (music researchers),
 so as (modern) playlist for people? • Looks like they are just containers for a set of songs rather than a sequence songs.