“I felt like there was a huge opportunity for things that were not just showing off the power of AI, but using the power of AI and giving it to actual musicians to make new and interesting music,” says Mann. By putting the musician first, and the tool second, NBHS is aiming to re-think how we interact with AI in the studio and on stage.
Holly Herndon has released a new artificial intelligence tool made by Never Before Heard Sounds — which the composer is also referring to as her “digital twin” — called “Holly+” that allows users to upload any polyphonic audio and receive a new version of that music sung in Herndon’s own voice.
Musical production techniques have become so sophisticated that listeners only perceive musical textures nowadays. But behind the scenes, the methods of making those textures are changing dramatically. Watch Yotam demonstrate some wild stuff in there.
The challenge with machine learning algorithms is that they’re slow. We designed our models to be as close to real-time as possible, and put them of dedicated hardware to open up new forms of expression.
The result is unlike any other instrument.
Never Before Heard Sounds has developed a first of its kind musical style-transfer that lets you resynthesize audio from YouTube using a neural net trained on vocal and instrumental recordings.
The result is an A.I. interpretation of the audio which retains the pitches and rhythms of the original but adds the texture and timbre learned from the training set.
Sign up for early beta access: