AI Startup Stability AI has collaborated with Chipmaker Arm to bring Stability’s Stable Audio Open to mobile devices running arm chips with an AI model that can generate audio with sound effects.
Many AI-powered apps can generate audio such as Suno and Udio, but most of the time they rely on cloud processing and cannot be used offline. Additionally, some audio generation models were trained with copyrighted content, poses IP risk. Stability, stable audio open training set consists entirely of royalty-free audio and songs.
The stable audio opening running on the arm chip, which will be demonstrated at the Mobile World Congress conference held in Barcelona this week, can generate sounds from textual descriptions such as “Calm sea waves at sunset.” According to stability, it works with ARM to optimize and “distill” stable audio, increasing production time by 30 times faster. It takes about 8 seconds to generate one 11-second audio sample on an ARMV9 CPU.
To be clear, the optimized stable audio open model cannot be downloaded – at least not yet. However, in a statement, Stability CEO Prem Akkaraju suggested that stability will work to bring models with stable audio to consumer apps and devices in the future.
“As more specialized creatives and businesses adopt generative AI to enhance their production pipelines, it is important that our models and workflows are available to builders and create creators,” says Akkaraju. “We are excited to partner with ARM for this exact reason.”
The company says it is working with ARM to further optimize and fine-tune stable audio for mobile use.
Stability, a plagued company behind the stable spread of popular image-generating models, raised new cash last year as investors, including Eric Schmidt and Napster founder Sean Parker, tried to turn the business around. Stability co-founder and EX-CEO Emad Mostaque has mismanaged stability to financial ruin, causing staff to step down, leading a partnership with Canva, and investors are reportedly concerned about the company’s outlook.
Over the past few months, Stability has hired a new CEO, appointed Titanic Director James Cameron to the board, and released several new image generation models.