Become a rockstar using FOSS!
- 1. Become a rockstar using FOSS! (Or at least use FOSS to write and share music for fun!) Lorenzo Miniero @lminiero@fosstodon.org FOSDEM 2023, Open Media devroom 4th February 2023, Brussels
- 2. Clickbait title alert: not a rockstar!
- 3. But that doesn’t mean you can just have fun
- 4. A few words about me Lorenzo Miniero • WebRTC developer (Janus) • Hobbyist musician • Love metal & orchestral! Let’s keep in touch! • lminiero@gmail.com • https://fosstodon.org/@lminiero • https://lminiero.bandcamp.com • https://soundcloud.com/lminiero
- 5. A barebones TOC • We’ll talk about (not necessarily in this order...) • The FOSS music ecosystem • How you can write some music (composition and orchestration) • Different ways of rendering virtual instruments • Recording and/or processing real instruments • Putting it all together in a DAW (mixing and mastering) • How you can distribute the result (on demand vs. live) • Please notice we will only scratch the surface, though • There’s so much to talk about and so little time! • Besides, I’m no expert: there’s good chances I’ll say something wrong...
- 6. A barebones TOC • We’ll talk about (not necessarily in this order...) • The FOSS music ecosystem • How you can write some music (composition and orchestration) • Different ways of rendering virtual instruments • Recording and/or processing real instruments • Putting it all together in a DAW (mixing and mastering) • How you can distribute the result (on demand vs. live) • Please notice we will only scratch the surface, though • There’s so much to talk about and so little time! • Besides, I’m no expert: there’s good chances I’ll say something wrong...
- 7. FOSS music ecosystem is amazing! • Audio backends getting easier to use at low latencies • e.g., ALSA, JACK, Pipewire, etc. • Port-based approach helps avoiding monolithic applications • Different applications to deal with different requirements • They can then all connect to each other • Many existing alternatives for different requirements • Easy to find what works best for your needs • Different genres may require a different approach
- 8. FOSS music ecosystem is amazing! • Audio backends getting easier to use at low latencies • e.g., ALSA, JACK, Pipewire, etc. • Port-based approach helps avoiding monolithic applications • Different applications to deal with different requirements • They can then all connect to each other • Many existing alternatives for different requirements • Easy to find what works best for your needs • Different genres may require a different approach
- 9. FOSS music ecosystem is amazing! • Audio backends getting easier to use at low latencies • e.g., ALSA, JACK, Pipewire, etc. • Port-based approach helps avoiding monolithic applications • Different applications to deal with different requirements • They can then all connect to each other • Many existing alternatives for different requirements • Easy to find what works best for your needs • Different genres may require a different approach
- 10. An important distinction before we start • Applications will work with audio and/or MIDI signals • Results may be similar, but they’re not the same “thing”! • Audio signals • Basically a waveform, an actual sound being captured/reproduced • What may come from a microphone, or what’s sent to your speakers • MIDI signals • Information about specific notes being played (e.g., on a keyboard) • Will often be translated to an audio signal itself (e.g., with virtual instruments) • Some applications will only work with one, others with both
- 11. An important distinction before we start • Applications will work with audio and/or MIDI signals • Results may be similar, but they’re not the same “thing”! • Audio signals • Basically a waveform, an actual sound being captured/reproduced • What may come from a microphone, or what’s sent to your speakers • MIDI signals • Information about specific notes being played (e.g., on a keyboard) • Will often be translated to an audio signal itself (e.g., with virtual instruments) • Some applications will only work with one, others with both
- 12. An important distinction before we start • Applications will work with audio and/or MIDI signals • Results may be similar, but they’re not the same “thing”! • Audio signals • Basically a waveform, an actual sound being captured/reproduced • What may come from a microphone, or what’s sent to your speakers • MIDI signals • Information about specific notes being played (e.g., on a keyboard) • Will often be translated to an audio signal itself (e.g., with virtual instruments) • Some applications will only work with one, others with both
- 13. An important distinction before we start • Applications will work with audio and/or MIDI signals • Results may be similar, but they’re not the same “thing”! • Audio signals • Basically a waveform, an actual sound being captured/reproduced • What may come from a microphone, or what’s sent to your speakers • MIDI signals • Information about specific notes being played (e.g., on a keyboard) • Will often be translated to an audio signal itself (e.g., with virtual instruments) • Some applications will only work with one, others with both
- 14. JACK Audio Connection Kit (JACK) https://jackaudio.org/
- 15. One Pipewire to rule them all! https://pipewire.org/
- 16. Capturing an instrument to make some noise • You have your guitar/bass and your laptop, what do you do now? • You can’t just plug the jack in the mic slot! • You’ll need an audio interface of some sort • e.g., USB audio interface with XLR/3.5mm inputs • Interface ports then available as a system “capture” • What to capture depends on what you need • e.g., straight from the cable vs. already processed for electric guitar • Acoustic guitars sometimes recorded from multiple sources at the same time
- 17. Capturing an instrument to make some noise • You have your guitar/bass and your laptop, what do you do now? • You can’t just plug the jack in the mic slot! • You’ll need an audio interface of some sort • e.g., USB audio interface with XLR/3.5mm inputs • Interface ports then available as a system “capture” • What to capture depends on what you need • e.g., straight from the cable vs. already processed for electric guitar • Acoustic guitars sometimes recorded from multiple sources at the same time
- 18. Capturing an instrument to make some noise • You have your guitar/bass and your laptop, what do you do now? • You can’t just plug the jack in the mic slot! • You’ll need an audio interface of some sort • e.g., USB audio interface with XLR/3.5mm inputs • Interface ports then available as a system “capture” • What to capture depends on what you need • e.g., straight from the cable vs. already processed for electric guitar • Acoustic guitars sometimes recorded from multiple sources at the same time
- 19. The one I personally use (note: cat not included)
- 20. Audio interface + instrument + JACK
- 21. Audio interface + instrument + JACK
- 22. Audio interface + instrument + JACK
- 23. Audio interface + instrument + JACK
- 24. Audio interface + instrument + JACK
- 29. Why not both at the same time?
- 30. What if we want to record it, now? • Any recording application that can act as a JACK sink will do • e.g., Audacity, GStreamer, etc. • Good chances are you want to work within a “project”, though • Multiple tracks for different instruments • Ability to add filters to work on tracks dynamically • That’s where a DAW can help! • Digital Audio Workstation • Conceived to record, edit and produce audio files of different kinds • Modular nature adds support for filters, EQ, compression, etc.
- 31. What if we want to record it, now? • Any recording application that can act as a JACK sink will do • e.g., Audacity, GStreamer, etc. • Good chances are you want to work within a “project”, though • Multiple tracks for different instruments • Ability to add filters to work on tracks dynamically • That’s where a DAW can help! • Digital Audio Workstation • Conceived to record, edit and produce audio files of different kinds • Modular nature adds support for filters, EQ, compression, etc.
- 32. What if we want to record it, now? • Any recording application that can act as a JACK sink will do • e.g., Audacity, GStreamer, etc. • Good chances are you want to work within a “project”, though • Multiple tracks for different instruments • Ability to add filters to work on tracks dynamically • That’s where a DAW can help! • Digital Audio Workstation • Conceived to record, edit and produce audio files of different kinds • Modular nature adds support for filters, EQ, compression, etc.
- 33. The one I personally use: Ardour https://ardour.org/
- 34. That’s a lot of connections!
- 35. Adding drums (without a drummer!) • Let’s assume we have bass and guitars, now: what about drums? • Unless you have a “real” one, that is! • First good example of “virtual instrument” • We’ll need to “write” the drum parts • Something will then need to “sequence” them (drum sounds) • While you can write MIDI manually, patterns are easier to work with • Rhythmic parts can be repeated, with some variations • Percussive nature of instrument helps too
- 36. Adding drums (without a drummer!) • Let’s assume we have bass and guitars, now: what about drums? • Unless you have a “real” one, that is! • First good example of “virtual instrument” • We’ll need to “write” the drum parts • Something will then need to “sequence” them (drum sounds) • While you can write MIDI manually, patterns are easier to work with • Rhythmic parts can be repeated, with some variations • Percussive nature of instrument helps too
- 37. Adding drums (without a drummer!) • Let’s assume we have bass and guitars, now: what about drums? • Unless you have a “real” one, that is! • First good example of “virtual instrument” • We’ll need to “write” the drum parts • Something will then need to “sequence” them (drum sounds) • While you can write MIDI manually, patterns are easier to work with • Rhythmic parts can be repeated, with some variations • Percussive nature of instrument helps too
- 38. An excellent pattern based drum machine: Hydrogen http://hydrogen-music.org/
- 39. Multichannel drums composition: DrumGizmo https://drumgizmo.org/
- 41. What about other virtual instruments? • We added guitars, bass, even drums, but we may want more • Maybe a keyboard background... • ... or a piano/synth solo ... • ... or even a full orchestra! • Just as with drums, this is where MIDI helps • We’ll have information on which notes to play, and how • Something will then turn that to “sounds” (e.g., a trumpet) • Notes can come from different places • Hardware keyboards often have USB MIDI support (a source in JACK) • Or we might simply want to write the parts ourselves instead
- 42. What about other virtual instruments? • We added guitars, bass, even drums, but we may want more • Maybe a keyboard background... • ... or a piano/synth solo ... • ... or even a full orchestra! • Just as with drums, this is where MIDI helps • We’ll have information on which notes to play, and how • Something will then turn that to “sounds” (e.g., a trumpet) • Notes can come from different places • Hardware keyboards often have USB MIDI support (a source in JACK) • Or we might simply want to write the parts ourselves instead
- 43. What about other virtual instruments? • We added guitars, bass, even drums, but we may want more • Maybe a keyboard background... • ... or a piano/synth solo ... • ... or even a full orchestra! • Just as with drums, this is where MIDI helps • We’ll have information on which notes to play, and how • Something will then turn that to “sounds” (e.g., a trumpet) • Notes can come from different places • Hardware keyboards often have USB MIDI support (a source in JACK) • Or we might simply want to write the parts ourselves instead
- 44. You don’t need that many keys to have fun!
- 45. Using soundfonts (SF2): Fluidsynth/Qsynth https://qsynth.sourceforge.io/
- 46. Using soundfonts (SF2): Fluidsynth/Qsynth
- 47. Using a more complex synth: Yoshimi https://yoshimi.sourceforge.io/
- 48. Using a more complex synth: Yoshimi
- 49. Using Sforzando format (SFZ): sfizz https://sfz.tools/sfizz/
- 50. Using Sforzando format (SFZ): sfizz
- 51. Using Windows VSTs: LinVST (e.g., via Carla) https://github.com/osxmidi/LinVst
- 52. Using Windows VSTs: LinVST (e.g., via Carla)
- 53. Writing music as if you were programming: Lilypond https://lilypond.org/
- 54. A simpler WYSIWYG approach: MuseScore https://musescore.org/
- 55. Don’t know music notation? Piano rolls to the rescue!
- 56. Your song’s ready: what now? • Many places where you could upload it to • e.g., Soundcloud, Jamendo, Youtube/Peertube, etc. • Bandcamp good option to try and monetize your music • Spotify, Apple Music, etc. need intermediary (e.g., Distrokid) • ... but they’re only worth it if you want to “be there” • Royalties per play are beyond ridicolous • Make sure you engage the community for feedback and learning! • https://linuxmusicians.com/viewforum.php?f=9 • https://discourse.ardour.org/c/community/made-with-ardour/13
- 57. Your song’s ready: what now? • Many places where you could upload it to • e.g., Soundcloud, Jamendo, Youtube/Peertube, etc. • Bandcamp good option to try and monetize your music • Spotify, Apple Music, etc. need intermediary (e.g., Distrokid) • ... but they’re only worth it if you want to “be there” • Royalties per play are beyond ridicolous • Make sure you engage the community for feedback and learning! • https://linuxmusicians.com/viewforum.php?f=9 • https://discourse.ardour.org/c/community/made-with-ardour/13
- 58. Your song’s ready: what now? • Many places where you could upload it to • e.g., Soundcloud, Jamendo, Youtube/Peertube, etc. • Bandcamp good option to try and monetize your music • Spotify, Apple Music, etc. need intermediary (e.g., Distrokid) • ... but they’re only worth it if you want to “be there” • Royalties per play are beyond ridicolous • Make sure you engage the community for feedback and learning! • https://linuxmusicians.com/viewforum.php?f=9 • https://discourse.ardour.org/c/community/made-with-ardour/13
- 59. “All I want for Christmas is Odin” https://www.youtube.com/watch?v=hxjwb8mzDQQ https://peertube.tv/w/jGRAueDQFvhhNC2y1CYdKE
- 60. “Can WebRTC help musicians?” https://fosdem.org/2021/schedule/event/webrtc_musicians/
- 61. Thanks! Questions? Comments? Contacts • https://lminiero.bandcamp.com • https://soundcloud.com/lminiero • https://fosstodon.org/@lminiero • https://twitter.com/elminiero