Google’s new AI system MusicLM can generate highly accurate music in any genre given a text description. Google isn’t the first who introduced AI for songs, as there have been others, including Riffusion, an AI that composes music by visualizing it, as well as Dance Diffusion, Google’s own AudioML, and OpenAI’s Jukebox.
But due to technical constraints and limited training data, none of them has been able to produce songs that are particularly complex in composition or highly accurate, whereas MusicLM is the first that can. MusicLM was trained on a dataset of 2,80,000 hours of music to learn to generate coherent songs for descriptions of significant complexity as described in an academic paper by US-based Cornell University.