Here’s How Adobe Plans to Use Its Firefly Generative AI

On the heels of announcing that its Premiere Pro and After Effects video-editing applications will get new generative AI capabilities, Adobe is fleshing out some details, and the upcoming Firefly technology plays a key role.

Firefly, unveiled last month, is a collection of generative AI models, à la ChatGPT, that creates images, text effects, audio, vectors, videos, and 3D for you. It will also be able to apply color treatments, animated text, and themed music. Here’s what users can expect from Adobe’s Firefly:

Firefly-generated text effects
(Credit: Adobe)

• Text to Color Enhancements: Creators will be able to change the color schemes, time of day, or even the seasons in already-recorded videos, altering the mood and setting to evoke a specific tone and feel. Text-to-video prompts will enable a simple prompt such as “make this scene feel warm and exciting” to bring a creator’s visions to life.

Change color mood with text prompts using Firefly in Adobe video software
(Credit: Adobe)

• Advanced Music and Sound Effects: Using only text prompts, users will be able to generate custom sounds and music to fit a specific mood and scene, either as temporary or final tracks.

• Stunning Animated Fonts, Graphics and Logos: In a matter of minutes, subtitles, logos and title cards can be generated with custom animations based on the creator’s preferences, expressed with simple words.

• Powerful Script and B-roll Capabilities: Firefly will dramatically accelerate pre-production, production and post-production workflows, using AI analysis of script text to automatically create storyboards and previsualizations, as well as recommending b-roll clips for rough or final cuts.

• Creative Guide Capabilities: Assisted by generative AI-powered personalized “how-to” guides, users will be able to master new skills and accelerate processes from initial vision to creation and editing.

Company representatives said the new capabilities will be available starting later this year.