Skip to content

Shelly Palmer - AudioCraft: Meta AI's Text-to-Sound Model

SASKTODAY's newest columnist, Shelly Palmer has been named LinkedIn’s “Top Voice in Technology,” and writes a popular daily business blog.
aimusic
When it comes to music, your opinion is the only one that matters.

Greetings from Candlewood Lake. In a stunning display of AI prowess, Meta AI has introduced AudioCraft, a single-stop code base that does an impressive job of composing, arranging, orchestrating, producing and playing music. AudioCraft is not just an AI that can mimic a melody. It's a sophisticated system that can create music, sound effects, and even handle audio compression.

The system operates on a single autoregressive Language Model (LM) that works with compressed discrete music representation, or tokens. It's a simple yet elegant approach that efficiently models audio sequences, capturing the long-term dependencies in the audio and generating high-quality sound.

People are going to instantly ask questions about subjective quality, emotional integrity, the magic of music, etc. I will explore these subjects in detail in my upcoming Sunday essay, "AI Can Hum a Tune. But Is It Music or Just Notes?" For today, just visit the AudioCraft site and listen. Remember, you're the world's foremost expert on the music you like. And, when it comes to music, your opinion is the only one that matters.

If you want to learn more about how AI models create music, sign up for our free online course Generative AI for Execs. It will give you a good baseline understanding of the topic. As always your thoughts and comments are both welcome and encouraged. Just reply to this email. -s

[email protected]

P.S. ICYMI: Yesterday, on an all new Shelly Palmer LIVE, I demo'd SDXL 1.0, Stable Diffusion's Midjourney Killer, talked about AI copilots like Shopify's Sidekick and Microsoft's Copilot and why copilots are the most obvious goal of every AI company. We also looked at ways researchers have found to circumvent AI safety measures, the role of subject matter expertise in generative AI, China's idea of a well-aligned AI model, and much, much more. Watch here.

ABOUT SHELLY PALMER

Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse University’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named LinkedIn’s “Top Voice in Technology,” he covers tech and business for Good Day New York, is a regular commentator on CNN and writes a popular daily business blog. He's a bestselling author, and the creator of the popular, free online course, Generative AI for Execs. Follow @shellypalmer or visit shellypalmer.com

push icon
Be the first to read breaking stories. Enable push notifications on your device. Disable anytime.
No thanks