Adobe Research has announced its latest venture, Project Music GenAI Control, an experimental tool to generate AI music and edit it as required.
The project is a collaborative effort involving researchers from the University of California, San Diego, and the School of Computer Science, Carnegie Mellon University.
This technology allows creators to generate music from text prompts and provides fine-grained control for precise editing, addressing the specific needs of musicians, broadcasters, podcasters, and other audio professionals.
Project Music GenAI Control builds upon the text prompt methodology already employed in Firefly. Users can input prompts such as ‘powerful rock,’ ‘happy dance,’ or ‘sad jazz’ to initiate the music generation process.
Moreover, the user-friendly interface empowers creators to transform the generated audio based on a reference melody, adjust tempo and structure, modify repeating patterns, control audio intensity, extend clip length, remix sections, and generate seamlessly repeatable loops.
“With Project Music GenAI Control, generative AI becomes your co-creator. It helps people craft music for their projects, whether they’re broadcasters, or podcasters, or anyone else who needs audio that’s just the right mood, tone, and length,” said Nicholas Bryan, Senior Research Scientist at Adobe Research.
Adobe claims that the material for AI training was available in the public domain. The company is still not clear whether we can upload any audio on the tool and the length of the music clips.
Bryan also parallels Project Music GenAI Control and Adobe Photoshop, claiming that the former is “taking it to the level of Photoshop by giving creatives the same kind of deep control to shape, tweak, and edit their audio.”
Other companies such as Google and Meta have also offered similar tools where users can input texts and generate AI music. However, these tools do not allow editing options as of now. Project Music GenAI Control takes the lead here. YouTube has also unveiled the Dream Track tool for YouTube Short creators.
Currently, the project is at an early experiment stage, and Adobe may include this tool in its pre-existing arsenal. However, the company has not divulged any information regarding this.
In the News: MWC 2024 Day 2: Foldable phones, flip phones and AI Glass
