Sound Effects are now available in Studio

ElevenLabs · Intermediate ·📰 AI News & Updates ·1y ago

Key Takeaways

ElevenLabs' Studio now features Sound Effects with a Text to SFX model, allowing users to generate sound effects by describing them, and customize their volume and blocking settings.

Full Transcript

Today we are launching sound effects in studio which allows you to add ambient sounds to your audio books or your scripts to make them a lot more immersive. I have three demos to show you. So here's my first demo which is something that you might hear in an audio book. Sarah lit a match, threw it into the fireplace, and poured herself a glass of wine as the fire began to crackle. Now, all of these sounds make this script way more immersive than simply hearing a voice describe the sound. And these sounds were all generated using our text to sound effects model. So, I can describe exactly the sound that I want, like lighting a match or pouring wine into a glass or the crackling of fire, and our AI model will actually generate a brand new sound effect specifically based on my prompt. Um, I can also change the volume of these sound effects to match the volume of my speech. And I can decide whether I want them to be blocking or not. So, here's an example of a blocking sound effect where the meditation bell sounds and the voice doesn't start until that sound has finished playing. Welcome to this guided meditation. Close your eyes and focus on your breath. Notice any ambient sounds around you. Rather than engaging with the sound, let it gently wash over you like water. So in this example, I had the low meditation bell. I had relaxing birds in a forest without the word relaxing. Those birds were slightly too aggressive and excitable and I had gentle ocean waves. My final example here is um a question that seems to have been on everyone's lips over the last few days. And you can imagine this voice over in some sort of Instagram or Tik Tok video. So we have sound effects like a riser and we have a gorilla grunting. Both of which were generated entirely from scratch using the 11 Labs text to sound effects model. Who would win in a fight? 100 men or one gorilla? So, this is an incredible new feature. It allows you to add a whole new dimension to your AI voiceovers. And we cannot wait to hear what you create with these new sound effects in Studio.

Original Description

Try out Studio at https://elevenlabs.io?utm_source=youtube&utm_medium=organic&utm_campaign=not_set&utm_content=sound_effects_are_now_available_in_studio We’re launching Sound Effects in Studio today. Our Text to SFX model is built into our longform editor; just describe a sound, and that sound is generated instantly. It’s now easier than ever to bring depth, realism and immersive ambience to your audiobooks and scripts. When you enter an SFX prompt in Studio, you’ll be given four generations to choose from. Sound effects can either be: Blocking: voices will stop speaking until the SFX has finished, or Non-blocking: SFX will play in parallel to your voices You can also adjust the volume for each individual SFX for a seamless blend with your voiceover. We're excited to hear the immersive soundscapes you create with this. Try it out at https://elevenlabs.io?utm_source=youtube&utm_medium=organic&utm_campaign=not_set&utm_content=sound_effects_are_now_available_in_studio
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from ElevenLabs · ElevenLabs · 56 of 60

1 AI Multilingual TTS Demo | ElevenLabs
AI Multilingual TTS Demo | ElevenLabs
ElevenLabs
2 Professional Voice Cloning Demo | ElevenLabs
Professional Voice Cloning Demo | ElevenLabs
ElevenLabs
3 Introducing: Projects
Introducing: Projects
ElevenLabs
4 ElevenLabs Dubbing Studio
ElevenLabs Dubbing Studio
ElevenLabs
5 ElevenLabs Speech to Speech
ElevenLabs Speech to Speech
ElevenLabs
6 Sound Effects are Coming Soon to ElevenLabs
Sound Effects are Coming Soon to ElevenLabs
ElevenLabs
7 It Started to Sing
It Started to Sing
ElevenLabs
8 It Started to Sing (Jazz)
It Started to Sing (Jazz)
ElevenLabs
9 Broke my Heart
Broke my Heart
ElevenLabs
10 My Love
My Love
ElevenLabs
11 ElevenLabs Dubbing API
ElevenLabs Dubbing API
ElevenLabs
12 ElevenLabs Audio Native
ElevenLabs Audio Native
ElevenLabs
13 Increasing reader engagement with Audio Native [June 2024 Webinar]
Increasing reader engagement with Audio Native [June 2024 Webinar]
ElevenLabs
14 ElevenLabs Text to Sound Effects API Demo
ElevenLabs Text to Sound Effects API Demo
ElevenLabs
15 ElevenLabs Voiceover Studio
ElevenLabs Voiceover Studio
ElevenLabs
16 ElevenLabs Speech to Speech Tutorial
ElevenLabs Speech to Speech Tutorial
ElevenLabs
17 ElevenLabs Voice Isolator API Demo
ElevenLabs Voice Isolator API Demo
ElevenLabs
18 ElevenLabs Turbo v2.5
ElevenLabs Turbo v2.5
ElevenLabs
19 ElevenLabs Reader App - Android
ElevenLabs Reader App - Android
ElevenLabs
20 ElevenLabs Impact Program
ElevenLabs Impact Program
ElevenLabs
21 We’ve reduced our pricing.
We’ve reduced our pricing.
ElevenLabs
22 Sound Effects Explore
Sound Effects Explore
ElevenLabs
23 Behind the Voice - Michael Marshall
Behind the Voice - Michael Marshall
ElevenLabs
24 X to Voice
X to Voice
ElevenLabs
25 Huberman Labs now Dubbing with ElevenLabs
Huberman Labs now Dubbing with ElevenLabs
ElevenLabs
26 GenFM, Now Playing on ElevenReader: Smart Podcasts Produced by Generative AI
GenFM, Now Playing on ElevenReader: Smart Podcasts Produced by Generative AI
ElevenLabs
27 Introducing ElevenLabs Conversational Agents
Introducing ElevenLabs Conversational Agents
ElevenLabs
28 Meet Flash
Meet Flash
ElevenLabs
29 Transforming media production with AI sound effects & dubbing
Transforming media production with AI sound effects & dubbing
ElevenLabs
30 ElevenLabs Conversational AI Webinar
ElevenLabs Conversational AI Webinar
ElevenLabs
31 ElevenLabs - Text to Speech, Dubbing, Sound Effects and more
ElevenLabs - Text to Speech, Dubbing, Sound Effects and more
ElevenLabs
32 Talk to Santa
Talk to Santa
ElevenLabs
33 Year in Review with special guest TIME's CTO Burhan Hamid
Year in Review with special guest TIME's CTO Burhan Hamid
ElevenLabs
34 Conversational AI Voice Agents that can issue refunds
Conversational AI Voice Agents that can issue refunds
ElevenLabs
35 Prenez une longueur d'avance avec ElevenLabs
Prenez une longueur d'avance avec ElevenLabs
ElevenLabs
36 Studio is now available to everyone, with new features (walkthrough)
Studio is now available to everyone, with new features (walkthrough)
ElevenLabs
37 Build Conversational AI agents with Gemini 2.0 Flash
Build Conversational AI agents with Gemini 2.0 Flash
ElevenLabs
38 Meet Alexis & El – Support Agents Handling 4,000 Calls a Day
Meet Alexis & El – Support Agents Handling 4,000 Calls a Day
ElevenLabs
39 Transform your Speech with ElevenLabs Voice Changer
Transform your Speech with ElevenLabs Voice Changer
ElevenLabs
40 Personalize conversational AI phone calls with Twilio
Personalize conversational AI phone calls with Twilio
ElevenLabs
41 Spotify is now accepting Audiobooks Narrated by ElevenLabs
Spotify is now accepting Audiobooks Narrated by ElevenLabs
ElevenLabs
42 Build Outbound AI Sales Agents
Build Outbound AI Sales Agents
ElevenLabs
43 Meet Scribe
Meet Scribe
ElevenLabs
44 Build a multilingual speech transcription bot with the ElevenLabs transcriber API
Build a multilingual speech transcription bot with the ElevenLabs transcriber API
ElevenLabs
45 Streaming and Caching Speech with Supabase
Streaming and Caching Speech with Supabase
ElevenLabs
46 Meet GibberLink, Conversational AI's secret language
Meet GibberLink, Conversational AI's secret language
ElevenLabs
47 Building a Personal AI Receptionist
Building a Personal AI Receptionist
ElevenLabs
48 Cross-platform AI Voice Agents with Expo React Native
Cross-platform AI Voice Agents with Expo React Native
ElevenLabs
49 Automatic Language Detection for Conversational AI
Automatic Language Detection for Conversational AI
ElevenLabs
50 Native Retrieval-Augmented Generation (RAG) in Conversational AI
Native Retrieval-Augmented Generation (RAG) in Conversational AI
ElevenLabs
51 Text to Bark from ElevenLabs
Text to Bark from ElevenLabs
ElevenLabs
52 Meet KUBI the Conversational Robot Barista
Meet KUBI the Conversational Robot Barista
ElevenLabs
53 Introducing the ElevenLabs MCP server
Introducing the ElevenLabs MCP server
ElevenLabs
54 Collect and analyze data with Conversational AI
Collect and analyze data with Conversational AI
ElevenLabs
55 Agent Transfer - Conversational AI
Agent Transfer - Conversational AI
ElevenLabs
Sound Effects are now available in Studio
Sound Effects are now available in Studio
ElevenLabs
57 How to Make your Professional Voice Clone.
How to Make your Professional Voice Clone.
ElevenLabs
58 Get unique AI Voiceovers in CapCut
Get unique AI Voiceovers in CapCut
ElevenLabs
59 Transfer to human - Conversational AI
Transfer to human - Conversational AI
ElevenLabs
60 Use HeyGen Avatar IV to Make AI Movie Characters
Use HeyGen Avatar IV to Make AI Movie Characters
ElevenLabs

ElevenLabs' Studio now offers Sound Effects, enabling users to generate and customize sound effects using a Text to SFX model, and create immersive audio experiences for audiobooks and scripts.

Key Takeaways
  1. Try out Studio at elevenlabs.io
  2. Enter an SFX prompt in the longform editor
  3. Choose from four sound effect generations
  4. Adjust the volume for each SFX
  5. Customize blocking settings for SFX
💡 The Text to SFX model in ElevenLabs' Studio allows for instant generation of sound effects, making it easier to create immersive audio experiences.

Related Reads

📰
The Rule of the Few: When the People Who Own the World’s Wealth Also Own the Intelligence That Will…
Learn how a small group of billionaires and companies dominate global wealth and AI, and why this matters for the future of technology and society
Medium · AI
📰
The Great AI Price Crash: What a 1,000x Cost Drop Actually Means for the Rest of Us
A 1,000x cost drop in AI means previously unaffordable projects are now feasible, opening up new opportunities for innovation
Medium · Startup
📰
Two variables that will decide if AI skips Africa
Learn how two key variables will determine the impact of AI on Africa's economy, based on a new IMF model
Medium · Startup
📰
The AI spending debate seems to have changed this week.
Google's increased AI infrastructure spending sparks debate on ROI, shifting focus from investment to profitability
Reddit r/artificial
Up next
Opus 5 is FINALLY here! (WOAH)
Matthew Berman
Watch →