awesome-musicdsp

Originally created by Cockos, iPlug is an awesome plug-in framework. For a long time, I was maintaining a , but over the last few years and I have reworked it into something new, with the imaginitive name: iPlug2. It's a massive improvement on the original version, adding support for GPU accelerated vector graphics, resizable high DPI UIs, iOS, WebViews, AUv3 and compiling to WebAudio/WASM, amongst many other things. iPlug2's syntax is super simple, for example, creating a parameter or a control in the UI is only a single line of C++ code

JUCE

JUCE is an undeniably awesome C++ application/plug-in framework with audio roots. It boasts a vast amount of functionality for the development of music software, including support for almost all plug-in formats and platforms. JUCE is used widely in the music technology industry and it has excellent documentation, code standards, features and support. The JUCE team organise the which is one of the best conferences to attend if you like audio programming. What's more all the videos from all the ADCs so far are available

AudioKit uses the Swift programming language. It's a high level DSP and UI toolkit for audio things. If you want to make apps for Apple's devices this is a great option, although if you want to do more low level, custom DSP, you will still have to do some C/C++

This is a framework from , used in his books, which is based on the VST3 SDK and it's AU/AAX wrappers, along with VST GUI and its runtime UI editor. It includes a project creator and a lot of extra "nuts and bolts" code for plug-in development

DPF

Distrho Plug-in Framework is a nice C++ plug-in framework by falkTX, supporting lots of Linux formats

A new framework built on top of the VST3SDK & VSTGUI, with some useful extra widgets and good CMake support

A plug-in framework using the D programming language, that has had a huge amount of work over many years. I haven't tried it, but I've decided to include it here in solidarity with the authors. As a fellow open-source framework developer, it's nice if people know about your work

Steinberg VST3 SDK

The Steinberg VST3 SDK has been around for a long time, but recent versions start to add a lot of great features such as really good CMake support, Lots of documentation, and . Since Steinberg include wrappers for VST2, AUv2, AUv3 and AAX it is somewhat like a plug-in framework

CPLUG

A smart new plug-in abstraction in C that targets VST3, AUv2, CLAP and Standalone formats on desktop. It's very new but a nice clean and minimal way to target multiple formats producing tiny binaries. Also includes hot reloading capabilities for the standalone targets

iPlug2OOS

Continuing the theme of self-promotion, here is the latest and greatest iPlug2 template project, set up with CI/CD, installer scripts, github workspaces etc

pamplejuce

An excellent template for JUCE projects

wolfsound - audio-plugin-template

Jan Wilczek has made another excellent JUCE template

JUCECmakeRepoPrototype

Eyal Amir also has one which looks good!

Brad Howes AUv3 Template

A template for iOS/macOS AUv3 projects

VSTGUI

VSTGUI is Steinberg's cross-platform UI framework for audio plug-ins. It is released under a BSD licence, it's an impressive piece of work and many plug-in developers use it for their products

Elements

A very promising UI framework for audio software using modern C++

PUGL

A cross platform GLFW-like solution that lets plug-in developers use OpenGL for their UIs

Gamma

Gamma is a very awesome C++ DSP library by Lance Putnam. The beauty of Gamma is the conciseness of the implementation of certain techniques. How about for a concise STFT example

Q

A very nice looking modern C++ DSP library with concise examples

HIIR is a seriously cool oversampling library by Laurent de Soras. Oversampling is something we often need in audio DSP, and this library handles it elegantly - providing a variety of classes for low latency IIR half band filtering (including SIMD optimizations). Originally this had a LGPL licence but now it's available under the - my favourite licence

HOALibrary

A flexible DSP library for high order ambisonics (HOA) - a spatial audio platform that is becoming more and more relevant thanks to VR (GPL Licence)

HISSTools Library

a nice BSD licensed library by Alex Harker, including FFT abstractions and multi-channel convolution, amongst other things

Mach1 Spatial SDK

Vector based multichannel & spatial audio APIs for customizing multichannel or spatial audio pipelines & tools and agnostically playback any spatial, surround soundfields

Spatial Audio Framework

Another excellent library for ambisonics and other spatial audio related processing

MadronaLib

Randy Jones' DSP library, which is awesome because it is all designed for SIMD processing

WDL

WDL is Cockos' library of reusable C++ code, that is used to make the DAW Reaper, amongst other things. It includes open source implementations of many useful things such as resampling and convolution, although there is next to no documentation and the code is difficult to understand. For more info about the various parts of WDL (which can be used independently), check

A MIT licensed DSP library written for the Daisy platform, but also useable elsewhere. I like it because it includes some nice ports of Emilie Gillet's mutable instruments code

A really nice looking DSP library, along with a really nice with a collection of nice articles, e.g. , see also

essentia

Essentia is a huge collection of MIR algorithms that you can use to extract high and low level features from audio. AGPL3 license. Somewhat painful to build cross-platform

audioflux

AudioFlux is a new-kid-on the block and some what similar but looks designed for deep learning, it looks very promising and has a liberal (MIT) license

FAUST

FAUST is a powerful functional DSL for audio DSP with many options for quickly compiling to different “architectures” including audio plug-ins and embedded devices. FAUST is not interpreted like programming languages such as Puredata/Max/Supercollider/javascript, it is to C++ and various other programming languages or bytecode formats such as Web Assembly (WASM). This functionality is suited to rapid prototyping but can also produce robust and performant binaries. Whilst the rapid prototyping possibilities of FAUST are appealing to me, what I like most about it is the extensive library of high quality DSP, particularly for physical modelling synthesis and the way in which you can compose algorithms using the concise syntax. FAUST includes a JIT compiler "libfaust" based on LLVM, which I . I've used it to make a

Is an exciting new DSL created by Jules Storer and Cesare Ferrari, which also uses the LLVM compiler technology. It has a JIT compiler for a fast workflow and can spit out C++ and WASM and ready-to-go JUCE projects. Cmajor is an imperative language much more similar to C/C++/Javascript than FAUST. It has several advantages, for example multi-rate processing and in my opinion it is more suited for code that mixes event-handling with DSP, where as FAUST is good for discreet blocks of DSP processing. Since FAUST can output Cmajor code via faust2cmajor, you can use them together

A nice blog post and demonstrating IIR filters

An excellent web based filter design tool

DSPFilters

Vinno Falco made this excellent MIT licensed IIR filter library. is a fork to work with the latest JUCE. See also , which seems a further developed and improved version

HTML version of Robert Bristow-Johnson's EQ cookbook

Andy Simper's technical papers, which include code examples and theory for modern approaches to filter design

Very math-heavy text on those modern approachs

Will Pirkle has written two books that will be invaluable the aspiring audio plug-in developer - "Designing Audio Effect Plug-Ins in C++" and "Designing Software Synthesizer Plug-Ins in C++". The books contain detailed information about important audio DSP, including modern virtual analogue techniques, and sample code for complete sythesizers that sound good. My only criticism is that a large part of the books relates to a bespoke plugin framework and providing information for multiple formats, AU, VST3 can be a bit overwhelming, and clutters the content. Nevertheless I highly recommend these books. For more info

This is my absolute favourite book to recommend to students studying computer music/audio synthesis. I find the book does not date like some other computer music texts. The block diagrams are charming and the techniques are discussed very well

This is a great book on audio DSP, written by a variety of domain experts, and it includes Matlab code examples

Julius Smith's site and his four books are an amazing resource. Matlab/Octave and FAUST code examples included

All the papers from the DAFX conference are available online. Another great resource

Nigel Redmond's DSP blog contains some very nicely written explanations of a variety of topics

In depth article about Four common mistakes in audio development

A developer who writes a lot of interesting software and articles about lock free programming

A nice series on synthesis techniques

This blog, along with is full of fascinating, cutting-edge stuff

Some nice pdfs with clear explanations of audio DSP topics

Sudara is writing some really excellent articles on some of the painful tasks involved in audio plug-in development and also publishing lots of useful open source recipes on

a very cool site with writings about various DSP topics and examples in pd/c

ChatGPT has become invaluable to me, allowing me to experiment and be creative with things that would have taken much more work before

VSCode is a brilliant text editor that has lots of interesting extensions and functionality. Lately I am using VSCode remote containers and Github Codespaces which I think is a game-changing technology

Max is a great environment to use for prototyping audio plug-ins. There are just so many options for integrating different technologies, I highly recommend it - even if nowadays most of the max patches I make only include a few objects

This is an awesome online graphing calculator. Check out some interactive Casio CZ waveforms that I made

This is an online interactive C++ compiler, which can be a very nice and quick way to test out a particular feature of the language, without having to build a binary

Compiler explorer is a great tool for checking the assembly code that different compilers will produce

This is an online FAUST IDE and compiler, that lets you test FAUST code with webaudio. You can then tell it to output a zip file with a binary for your preferred platform. This saves you all the trouble of installing FAUST and its dependencies on your local machine

Matplotlib-cpp

A C++ interface to the matplotlib python plotting tool. Allows you to visualize algorithms using the same code that you can use in production

This is a really cool project allowing you to use JIT compiled C++ in jupyter notebooks - which, like Matplotlib-cpp above is great for visualizing algorithms using the same code that you can use in production, inside the popular jupyter notebook format. is an example of how you can use those things together, easily via a ready made docker image

Open-source audio plugin manager tool and Github plugin templates to automatically build cross-platform audio plugins

dspplot

A python script that I find useful for plotting filter responses

Docker is incredibly useful for creating reproducible environments, e.g. with specific python libraries installed

An audio plug-in that embeds a C++ JIT compiler which you can use to test your C++ DSP without leaving the DAW

Make macOS terminal/iTerm2 nice and colorful

surge

Surge was an excellent product which has been open sourced and is now being maintained and continually improved by the surge-synth team, with a new JUCE UI

valentine

An awesome compressor and great, complete project example for a cross platform audio plug-in in 2023

vital

Vital is a very succesful wavetable synth with a slick interface done using the GPU. Amazing that a project like this can be open source!

ni-media

A very nice audio file loading library from Native Instruments

choc

From the creator of JUCE comes CHOC, an ISC licensed library of Classy Header-Only Classes. Including some useful audio related utilities

BespokeSynth

A pretty amazing modular synth/composition environment with nice real-time visualisation, loads of modules, and lots of flexibility

destroyfx

A brilliant collection of open source plug-ins that are very original have been around since the dawn of VST

Pd is a really nice cross platform dataflow programming environment. Also check out , which you can use as an embeddable DSP runtime in your C++ audio plug-in etc. combines libpd with JUCE to let you make plug-ins based on Pd patches. is an excellent new effort to make PD run as a plug-in with a fresh new UI built with JUCE

supercollider

Likewise, but make sure you look at the scsynth part for DSP stuff

csound

CSound is still going strong after many years. It can also be used as an embeddable DSP library. There is a , which is a great way to play with interesting scores/orchestras/UDOs that you find on the web and lets you make plug-ins based on CSound orchestras

vcvrack

Whilst the other items in this list have been around a while and have somewhat arcane code-bases, this is pretty new and the API is very clean and simple. I think making a VCVRack module it is a great way to get into audio programming

tracktion engine

Source code for an entire DAW engine, using modern C++. An amazing resource for learning all sorts of things including how to structure and architect large audio projects. GPL/Commercial license

"A collection of algorithms, thoughts and snippets, gathered for the music dsp community". A long serving site that has recently been revamped. Beware: most of the code there was written a very long time ago, and optimization tricks etc, may not be relevant on modern machines. Also there are lots of code snippets programming languages other than C++ (delphi, java, C# etc). Could do with some curation

obxd

OBxd is a great sounding oberheim emulation plug-in, written with JUCE. , and it has also been

dexed

Dexed is a JUCE frontend to , which is an excellent DX7 emulation. Also

AudioKit SynthOne

SynthOne is a great open source project built using Audiokit, that will be very interesting to anyone looking to build an iOS synthesiser

AirWindows Plugins

A large collection of GUI-less plug-ins open source but supported via patreon

Fons Adriaensen's linux audio projects offer a lot of great tools for acoustic measurements, spatial audio etc - mostly as jack apps

Webkit's Web Audio API

This is the C++ code for WebKit's implementation of the Web Audio API, as used in Safari

The same thing in Blink (Google chromium)

And for Mozilla Firefox

Very cool project building open source guitar fx/amp simulations using machine learning techniques

NeuralAmpModeler

A similar project, which is also very cool - plug-in built with iPlug2!

ONNXRuntime

Microsoft's ONNX Runtime is a ML inference engine that is well documented, performant, and customizable. is an iPlug2 example that I prepared that integrates onnxruntime into an audio plugin, using - another project that I made in order to build custom, slimmed down static libraries for the onnxruntime

RTNeural

A library designed for realtime inference of Neural Network models with audio in mind. Very small when compared to linking a library like OnnxRuntime or libtensorflow

Torsion Audio's Neural Network Inference Template for Real-Time Cricital Audio Environments

A great JUCE template for a machine learning based plug-in, set up for libTorch, TFLite, or OnnxRuntime, including code to help you offload inference onto a separate thread

"Safe for work" knob pics and an online tool to generate them

This is a programmable stomp box and eurorack module that I've been working with since the kick starter campaign to launch it. It's a really nice little unit, which you can program in C++, FAUST, Pd or with Max gen~. I find the limited interface with 4 controls makes me think quite carefully about what's important about my DSP algorithm. You can find some patches I made for it (using a mixture of c++ and FAUST) in the , and the original code

Bela is a wonderful little SoC + Audio Interface which is pretty revolutionary, allowing super low latency audio and sensor I/O all clocked together, in a tiny package. I wrote the FAUST support class for bela. You can also program it with C++ or libpd, and even supercollider

An embedded linux OS & dev kit that runs VST2 & VST3 plugins with super low latency

mutable instruments

Emilie Gillet's work is inspirational. The code has been and to some nice

pedalvite

An open source pedal board project from a developer who did a lot of the DSP in the best plugins of the last ~20 years

Daisy is a brilliant programmable embedded music platform. A few different host devices are available into which you plug the Of course you can also build your own device around the Daisy seed board if you don't suck at electronics, like me. It has a more powerful MCU than the OWL and I really like how the same board can be plugged into different hardware depending on your needs

Jan is an extremely driven, friendly and talented guy who has put a lot of work into making a great set of resources for people who want to learn audio programming. His content is a mixture of very good technical overviews of important topics and great interviews with people across the industry and involved in academia. I was honoured to be interviewed by Jan for episode 15 of the wolfsound podcast, which you can listen to

includes a lot of tutorials about JUCE with guest slots on things like web audio

although this channel is focused on game development, the is excellent. Highly recommended

Valerio has made a very impressive channel and dedicated to AI and ML topics in Audio

My friend and Ableton colleague Jose is recording his work developing plug-ins in Juce/C++ and DSP code using CMajor

an inspiring interview with a great developer about a killer synth

great talk by another great plugin developer

a very clearly presented course

a great interview full of insight

The music DSP mailing list is pretty quiet these days, but it still worth signing up, despite the web 0-1 front page. Every now and again a music DSP legend posts something interesting

This is probably the most active forum for audio DSP that is not aligned with a particular plug-in framework. There are some very smart people, some mavericks and some plain weirdos who hang out here

This is a collection of forums centred around the variety of things that JUCE does. Since there are such a huge amount of people using JUCE to make audio software, there is a lot of good info here

Another collection of forums centred around Cockos' tools including one for WDL/iPlug and one for Reaper JS

Whilst the other places mentioned here are all virtual, this is a real conference where you can go and meet real people face-to-face who do audio programming - highly recommended!

A popular community for discussing audio programming

forum for iPlug2 discussions

A forum for the VST3 SDK/format