SlideShare a Scribd company logo
Towards a musical Semantic Web Yves Raimond Centre for Digital Music, Queen Mary, University of London May 6th, 2007
Overview Introduction Web Web of data The Semantic Web RDF Making sense of the data Content negotiation The Music Ontology The Timeline ontology The Event ontology FRBR + FOAF Music  production  specific concepts Workflow information Levels of expressiveness Extensions And now?? Linking open data on the Semantic Web Two applications
Introduction – Web  1. I ask my favourite search engine for “ Lonah creative commons song”   Looking for Creative Commons-licensed song from the French band  Lonah
Introduction – Web  Looking for Creative Commons-licensed song from the French band  Lonah 2. I read the  context  of each of the first results 3. The second one seems ok... 4. I reach this  last.fm  page: 5. According to the tags, it looks like the band I am looking for... 6. I read “Music available on ...” and decide to visit the linked page 7. I reach the Jamendo website 8. I launch a search for  Lonah , and, finally:
Introduction – Web  Now:  Ask your computer to do the same thing! Some requirements emerging from this scenario: - I need an entry point: the  search engine - I need to understand the  context  of the links - I need to find my way into the  web maze
Introduction – Web of data Turning the Web into a huge, “semantic”, democratic database in order to make machines able to look by themselves for particular informations KB1 KB2 KB3 KB4 Application1 Application 2
The Semantic Web Resources on the Web can be far more than just web pages! http://moustaki.org/foaf.rdf#moustaki  is a resource representing  me http://dbtune.org/jamendo/band/lonah  is a resource representing the band  Lonah When  HTTP-GET ting, Let's leave fancy HTML pages for humans, and let's  provide some useful descriptions for the machine! Resource Description Framework http://dbtune.org/jamendo/band/both http://dbtune.org/jamendo/artist/5 Both http://xmlns.com/foaf/0.1/Group
Ontologies - Making sense of the data Ontologies , to map these  resources and properties (links)  to  real-world objects and  relationships Providing a COMMON UNDERSTANDING An  Album  has several  Tracks , a  name , a  release date ... A  Performance  has one  location , one  time , some  performers , ... Ontologies are also described in  RDF Instance data  refers  to ontologies through  RDF triples such as: < http://dbtune.org/jamendo/artist/5 > rdf:type < http://purl.org/ontology/mo/Musicartist > < http://dbtune.org/jamendo/artist/5 >  foaf:name  “Both”
Content negotiation http://dbtune.org/jamendo/artist/5 <mo:MusicArtist rdf:about=&quot;http://dbtune.org/jamendo/artist/5&quot;> <foaf:based_near rdf:resource=&quot;http://dbpedia.org/France&quot;/> <foaf:homepage rdf:resource=&quot;http://www.both-world.com&quot;/> <foaf:img rdf:resource=&quot;http://img.jamendo.com/artists/b/both.jpg&quot;/> <foaf:name rdf:datatype=&quot;&xsd;string&quot;>Both</foaf:name> </mo:MusicArtist> HTML for “human consumption” RDF for “machine consumption” And now, let's make both the  human   and the  machine  happy!
The Music Ontology Problem:  no agreed ways of dealing with music-related information on the Semantic Web Solution:  Let's launch a community project, based on previous ontology engineering efforts! http://musicontology.com/ Several facets [Pachet]: Complex  editorial  information Acoustic  information ( cultural  information)
The Timeline ontology First thing to address: representing  temporal information “This performance happened the 9 th  of March, 1984” “ This beat is occurring around sample 32480” “ The second verse is just before the second chorus” ... Only four concepts:  Instant ,  Interval ,  TimeLine  (and  TimeLineMap )
The Event ontology We need a way to classify space/time regions : Performances, recordings, beats, verses, composition, ...
FRBR + FOAF FRBR: Functional Requirements for Bibliographic Records We use three FRBR concepts:   Work Manifestation Item The  Expression  concept seemed to fuzzy for being used: whole  workflow  between a work and its manifestation FOAF: Friend-of-a-friend Person Group Organization ... and the relationship vocabulary (married, brother of, etc.)
Music  production  specific concepts On top of FRBR: MusicalWork ,  MusicalManifestation  ( Album ,  Track ,  Playlist,  etc.) MusicalItem  ( Stream , a particular  Vynil , etc.)   On top of FOAF: MusicArtist  and  MusicGroup  (defined classes) Arranger ,  Engineer ,  Performer ,  Composer , etc. (same thing) On top of the Event ontology: Composition ,  Arrangement ,  Performance ,  Sound ,  Recording Others: Signal ,  Score ,  Genre ,  Instrument , etc.
Workflow  information
Levels of expressiveness Flexibility of the ontolog y - Level 1:  purely editorial “ This track is on that particular album and that compilation and was created by that artist” - Level 2:  introducing events “ This is a recording of this particular musician playing that jazz-rock arrangement of that particular piece” - Level 3:  introducing event decomposition “ In this performance, this key was played at this particular time by this person,  who was playing the piano”
Extensions Lots of  anchor points  (instrument, genre, signal, timeline, etc.) Already several extensions available: -  Musical feature ontology : uses  Event  as a way to classify  features on a signal' timeline -  Instrument taxonomy : thanks to Musicbrainz! -  Genre taxonomy : thanks to Wikipedia/DBPedia -  The Key ontology Other possible extensions: - Audio recording devices under the  Recording  concept? -  Mixing  events dealing with  Signal  objects? - Sound cognition under the  Sound / Listener  concepts? - Symbolic music notation under  Score ? - Chord ontology?
Linking open data on the Semantic Web W3C' Semantic Web Education and Outreach community project Lots of  open data  available: Wikipedia, Geonames, Musicbrainz, creative commons  repositories, etc. Let's interlink them using Semantic Web technologies: DATA MASHUPS So far: - Jamendo - Magnatune - Musicbrainz - DBPedia - GeoNames - RDF book mashup - ...
And now?? - Your audio files are just other  items  of a particular  manifestation , which has an URI  - Store the corresponding statements in your SW-enabled application - And your collection gets access to the whole web of knowledge (well, in its current  state:-) ) Give me all musical works composed in a city with more than 500 000 inhabitants Is there someone nearby really liking this band and the same beer as me, so that we can have a drink tomorrow? Place my collection on a timeline and make me listen something composed  in the UK in 1560, followed by a rock song recorded in the 60s Give me all Jimmy Hendrix songs played by Brass Bands with at least 5 members Are there any other performances of this work? Give me one with a small part at 120 bpm
Thank you!!

More Related Content

ODP
Publishing and interlinking music-related data on the Web
PDF
Combining Social Music and Semantic Web for music-related recommender systems
PPT
Ontology Engineering: Ontology Use
PDF
Semantics-aware Content-based Recommender Systems
PPTX
Conception et Réalisation d’une application de Gestion SCOLAIRE
PDF
Mining the social web for music-related data: a hands-on tutorial
PDF
Recommending for the World
PDF
(Some) pitfalls of distributed learning
Publishing and interlinking music-related data on the Web
Combining Social Music and Semantic Web for music-related recommender systems
Ontology Engineering: Ontology Use
Semantics-aware Content-based Recommender Systems
Conception et Réalisation d’une application de Gestion SCOLAIRE
Mining the social web for music-related data: a hands-on tutorial
Recommending for the World
(Some) pitfalls of distributed learning

Similar to Towards a musical Semantic Web (20)

PPTX
Jewish Music Online: Digital Fieldwork
PPT
Music mobile
PPTX
The Streams of Our Lives - Visualizing Listening Histories in Context
PDF
Enhancing a Digital Sheet Music Collection A report for LIS-435 ...
DOCX
PDF
J-P. Fauconnier, J. Roumier. Musonto - A Semantic Search Engine Dedicated to ...
PPT
Aplicații Web Semantice - Descriere Proiect
PDF
Introduction to Music Information Retrieval
PDF
Introduction to Music Information Retrieval
PPT
Ism2011
PPT
Denktank 2010
PDF
MongoDB at ex.fm
PDF
Sonia Pascua IFLA 2018
PDF
Music Personalization At Spotify
ODP
Linked Open Europeana: Semantics for the Citizen
PDF
Stop Looking and Start Listening
PDF
Linked Data Publication of Live Music Archives and Analyses
PDF
楊奕軒/音樂資料檢索
PDF
Understanding The Art Of Sound Organization Landy Leigh
PDF
Knowledge-based Music Recommendation
Jewish Music Online: Digital Fieldwork
Music mobile
The Streams of Our Lives - Visualizing Listening Histories in Context
Enhancing a Digital Sheet Music Collection A report for LIS-435 ...
J-P. Fauconnier, J. Roumier. Musonto - A Semantic Search Engine Dedicated to ...
Aplicații Web Semantice - Descriere Proiect
Introduction to Music Information Retrieval
Introduction to Music Information Retrieval
Ism2011
Denktank 2010
MongoDB at ex.fm
Sonia Pascua IFLA 2018
Music Personalization At Spotify
Linked Open Europeana: Semantics for the Citizen
Stop Looking and Start Listening
Linked Data Publication of Live Music Archives and Analyses
楊奕軒/音樂資料檢索
Understanding The Art Of Sound Organization Landy Leigh
Knowledge-based Music Recommendation
Ad

More from Yves Raimond (8)

PDF
Time, Context and Causality in Recommender Systems
PDF
Deep Learning for Recommender Systems
PDF
Paris ML meetup
PDF
Spark Meetup @ Netflix, 05/19/2015
PDF
Utilisation du Web Semantique pour les sites de la BBC
PDF
Linked Data on the BBC
ODP
Linked data and applications
ODP
Web of data
Time, Context and Causality in Recommender Systems
Deep Learning for Recommender Systems
Paris ML meetup
Spark Meetup @ Netflix, 05/19/2015
Utilisation du Web Semantique pour les sites de la BBC
Linked Data on the BBC
Linked data and applications
Web of data
Ad

Recently uploaded (20)

PDF
KodekX | Application Modernization Development
PDF
NewMind AI Monthly Chronicles - July 2025
PDF
Electronic commerce courselecture one. Pdf
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PPTX
Cloud computing and distributed systems.
PDF
Machine learning based COVID-19 study performance prediction
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Approach and Philosophy of On baking technology
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Spectral efficient network and resource selection model in 5G networks
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
PPT
Teaching material agriculture food technology
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
PPTX
MYSQL Presentation for SQL database connectivity
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
KodekX | Application Modernization Development
NewMind AI Monthly Chronicles - July 2025
Electronic commerce courselecture one. Pdf
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Cloud computing and distributed systems.
Machine learning based COVID-19 study performance prediction
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Approach and Philosophy of On baking technology
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Spectral efficient network and resource selection model in 5G networks
Building Integrated photovoltaic BIPV_UPV.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Digital-Transformation-Roadmap-for-Companies.pptx
Teaching material agriculture food technology
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
MYSQL Presentation for SQL database connectivity
Encapsulation_ Review paper, used for researhc scholars
Advanced methodologies resolving dimensionality complications for autism neur...
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows

Towards a musical Semantic Web

  • 1. Towards a musical Semantic Web Yves Raimond Centre for Digital Music, Queen Mary, University of London May 6th, 2007
  • 2. Overview Introduction Web Web of data The Semantic Web RDF Making sense of the data Content negotiation The Music Ontology The Timeline ontology The Event ontology FRBR + FOAF Music production specific concepts Workflow information Levels of expressiveness Extensions And now?? Linking open data on the Semantic Web Two applications
  • 3. Introduction – Web 1. I ask my favourite search engine for “ Lonah creative commons song” Looking for Creative Commons-licensed song from the French band Lonah
  • 4. Introduction – Web Looking for Creative Commons-licensed song from the French band Lonah 2. I read the context  of each of the first results 3. The second one seems ok... 4. I reach this last.fm page: 5. According to the tags, it looks like the band I am looking for... 6. I read “Music available on ...” and decide to visit the linked page 7. I reach the Jamendo website 8. I launch a search for Lonah , and, finally:
  • 5. Introduction – Web Now: Ask your computer to do the same thing! Some requirements emerging from this scenario: - I need an entry point: the search engine - I need to understand the context of the links - I need to find my way into the web maze
  • 6. Introduction – Web of data Turning the Web into a huge, “semantic”, democratic database in order to make machines able to look by themselves for particular informations KB1 KB2 KB3 KB4 Application1 Application 2
  • 7. The Semantic Web Resources on the Web can be far more than just web pages! http://moustaki.org/foaf.rdf#moustaki is a resource representing me http://dbtune.org/jamendo/band/lonah is a resource representing the band Lonah When HTTP-GET ting, Let's leave fancy HTML pages for humans, and let's provide some useful descriptions for the machine! Resource Description Framework http://dbtune.org/jamendo/band/both http://dbtune.org/jamendo/artist/5 Both http://xmlns.com/foaf/0.1/Group
  • 8. Ontologies - Making sense of the data Ontologies , to map these resources and properties (links)  to real-world objects and relationships Providing a COMMON UNDERSTANDING An Album  has several Tracks , a name , a release date ... A Performance  has one location , one time , some performers , ... Ontologies are also described in RDF Instance data refers to ontologies through RDF triples such as: < http://dbtune.org/jamendo/artist/5 > rdf:type < http://purl.org/ontology/mo/Musicartist > < http://dbtune.org/jamendo/artist/5 > foaf:name “Both”
  • 9. Content negotiation http://dbtune.org/jamendo/artist/5 <mo:MusicArtist rdf:about=&quot;http://dbtune.org/jamendo/artist/5&quot;> <foaf:based_near rdf:resource=&quot;http://dbpedia.org/France&quot;/> <foaf:homepage rdf:resource=&quot;http://www.both-world.com&quot;/> <foaf:img rdf:resource=&quot;http://img.jamendo.com/artists/b/both.jpg&quot;/> <foaf:name rdf:datatype=&quot;&xsd;string&quot;>Both</foaf:name> </mo:MusicArtist> HTML for “human consumption” RDF for “machine consumption” And now, let's make both the human  and the machine happy!
  • 10. The Music Ontology Problem: no agreed ways of dealing with music-related information on the Semantic Web Solution: Let's launch a community project, based on previous ontology engineering efforts! http://musicontology.com/ Several facets [Pachet]: Complex editorial information Acoustic information ( cultural information)
  • 11. The Timeline ontology First thing to address: representing temporal information “This performance happened the 9 th of March, 1984” “ This beat is occurring around sample 32480” “ The second verse is just before the second chorus” ... Only four concepts: Instant , Interval , TimeLine (and TimeLineMap )
  • 12. The Event ontology We need a way to classify space/time regions : Performances, recordings, beats, verses, composition, ...
  • 13. FRBR + FOAF FRBR: Functional Requirements for Bibliographic Records We use three FRBR concepts: Work Manifestation Item The Expression concept seemed to fuzzy for being used: whole workflow between a work and its manifestation FOAF: Friend-of-a-friend Person Group Organization ... and the relationship vocabulary (married, brother of, etc.)
  • 14. Music production specific concepts On top of FRBR: MusicalWork , MusicalManifestation ( Album , Track , Playlist, etc.) MusicalItem ( Stream , a particular Vynil , etc.) On top of FOAF: MusicArtist and MusicGroup (defined classes) Arranger , Engineer , Performer , Composer , etc. (same thing) On top of the Event ontology: Composition , Arrangement , Performance , Sound , Recording Others: Signal , Score , Genre , Instrument , etc.
  • 16. Levels of expressiveness Flexibility of the ontolog y - Level 1: purely editorial “ This track is on that particular album and that compilation and was created by that artist” - Level 2: introducing events “ This is a recording of this particular musician playing that jazz-rock arrangement of that particular piece” - Level 3: introducing event decomposition “ In this performance, this key was played at this particular time by this person, who was playing the piano”
  • 17. Extensions Lots of anchor points (instrument, genre, signal, timeline, etc.) Already several extensions available: - Musical feature ontology : uses Event as a way to classify features on a signal' timeline - Instrument taxonomy : thanks to Musicbrainz! - Genre taxonomy : thanks to Wikipedia/DBPedia - The Key ontology Other possible extensions: - Audio recording devices under the Recording concept? - Mixing events dealing with Signal objects? - Sound cognition under the Sound / Listener concepts? - Symbolic music notation under Score ? - Chord ontology?
  • 18. Linking open data on the Semantic Web W3C' Semantic Web Education and Outreach community project Lots of open data available: Wikipedia, Geonames, Musicbrainz, creative commons repositories, etc. Let's interlink them using Semantic Web technologies: DATA MASHUPS So far: - Jamendo - Magnatune - Musicbrainz - DBPedia - GeoNames - RDF book mashup - ...
  • 19. And now?? - Your audio files are just other items of a particular manifestation , which has an URI - Store the corresponding statements in your SW-enabled application - And your collection gets access to the whole web of knowledge (well, in its current state:-) ) Give me all musical works composed in a city with more than 500 000 inhabitants Is there someone nearby really liking this band and the same beer as me, so that we can have a drink tomorrow? Place my collection on a timeline and make me listen something composed in the UK in 1560, followed by a rock song recorded in the 60s Give me all Jimmy Hendrix songs played by Brass Bands with at least 5 members Are there any other performances of this work? Give me one with a small part at 120 bpm