Adobe is introducing a revolutionary tool that turns simple sounds into realistic sound effects. The new Generate Sound Effects in the Firefly app lets users record themselves imitating sounds – like “clip-clop” for horse hooves or “whooosh” for a rocket launch – and artificial intelligence generates four professional sound effect options.
Timeline Interface and Video Sync
The tool’s interface resembles a video editing timeline and allows users to synchronize the effects they create with uploaded footage. For example, you can play a video of a horse walking and simultaneously record “clop-clop” sounds in sync with its hooves, along with a text description of “hooves on concrete.” The AI generates four different sound effects to choose from.
The tool builds on Project Super Sonic that Adobe unveiled at its Max event in October, supporting impact sounds like breaking branches, footsteps, and zippers, as well as atmospheric sounds like natural sounds and city ambience. It doesn't work for speech, but it covers a wide range of sound effects.
Text-to-Video Controls
Firefly introduces new advanced controls for the Text-to-Video generator:
Composition Reference: Upload a video along with your text prompt to copy the composition of the footage into the generated video. This makes it easier to achieve specific results, compared to repeating text descriptions.
Keyframe Cropping: Cut and upload images of the first and last frames that Firefly can use to create videos between them.
Style Presets: A new collection of visual styles that users can quickly select, including anime, vector art, claymation, and more. The presets are only available with its own Firefly video AI model, but Adobe is looking into adding similar controls for third-party AI models in the future.
Strategic Integration of AI Models
Generate Sound Effects is in beta and available for both recorded and generated footage, providing greater control over audio creation compared to competing tools like Google Veo 3. The feature is part of Adobe's broader strategy to integrate generative AI into all filmmaking workflows.
Discover the new features of Adobe Firefly and give voice to your ideas! Learn more at firefly.adobe.com.
Comart is an Adobe Gold Reseller in the Commercial, Education & Government categories
