10 AI Music Tools You Should Have Played With
The recent release of Google’s stunning “MusicLM” model is just the tip of the iceberg. Everything points to the fact that AI music generators could experience a similar surge in popularity this year as AI image generators like Midjourney or DALL-E did in 2022.
But before we see Twitter explode and AI Music Creation become the new talk of the town, here are some of the most exciting AI music tools to play with in the meantime:
Riffusion
This web app uses Stable Diffusion under the hood and lets you enter a text prompt that gets rendered into a spectrogram that gets rendered into sound. And you get the acoustic equivalent of img-2-img: let your music prompts blend into each other! I wrote about it in more detail here. Also available as Colab and Gradio Web Demo.
AI Crate Digging
Robert Dargavel Smith made something that not only crate diggers will appreciate: a notebook that lets you create royalty free lo-fi hiphop samples! Read more from Robert about this approach here.
Link to Google Colab: https://colab.research.google.com/github/teticio/audio-diffusion/blob/master/notebooks/test_model.ipynb#scrollTo=b294a94a
#MadeWithMagenta
From AI powered Sequencers to Music Jump’n’Run Games, you’ll find a ton of AI music projects at https://magenta.tensorflow.org/demos/community/
Magenta Notebooks & Apps
More Magenta notebooks & apps to play with: https://magenta.tensorflow.org/demos/colab/
ToneTransfer
Neural Synthesis lets you transfer your singing into instruments or create new sounds: https://sites.research.google/tonetransfer
Drawing Music
Using Google’s #MusicVAE, this tool lets you sketch melodies visually and sequence them into longer compositions.
https://teampieshop.github.io/latent-loops/
Text-To-Music by Mubert
This Text-To-Music Model by @mubertapp lets you create music and accurately synced loops with a single text prompt.
Image-To-Music by Mubert + CLIP Interrogator
This one combines the aforementioned @mubertapp & CLIP Interrogator to create music from images.
OpenAI’s Jukebox
Use the Jukebox Explorer to browse through music made with OpenAi’s Jukebox or get creative with the Google Colab: https://colab.research.google.com/github/openai/jukebox/blob/master/jukebox/Interacting_with_Jukebox.ipynb
Blog: https://openai.com/blog/jukebox/
Thanks for reading! 🙏
