Last year Adobe launched Firefly, its latest generative AI model that builds on its predecessor SenseiAI, and now the company is showing how to use its video editing software, Premiere Pro. In the preview, it introduced several key features coming later this year, including Object Addition and Removal, Generative Expansion, and Text to Video.
The new features are likely to be popular because video cleanup is a common (and painful) task. The first feature, Generative Extend, solves a problem that editors face in almost every edit: clips that are too short. “Add seamless frames to make clips longer, so it’s easier to time edits perfectly and add smooth transitions,” says Adobe. It does this by using AI to help with additional media creation, editing or transition coverage.
Another common problem is things you don’t want or add to a shot that can be difficult to remove. do I want. Premiere Pro’s Object Addition and Removal takes care of that, using Firefly’s generative AI. “Simply select and track objects, then transform them. Remove unwanted objects, change an actor’s wardrobe, or quickly add props to the table, such as paintings or photorealistic flowers,” Adobe writes.
Adobe shows several examples by adding a stack of diamonds to a portfolio via a text prompt (created by Firefly). It also removes the ugly utility box, changes the clock face, and adds a tie to the character’s suit.
The company also demonstrated that it can import custom AI models. One called Pika powers Generative Extend, while another (Sora from OpenAI) can automatically generate B-Roll (video footage). Adobe said in the video that the latter will be controversial because it could potentially destroy thousands of jobs, but is still “currently in the early research phase.” The company notes that it will add “content credentials” to such shots, so you can see what was created by the AI, including the company behind the model.
A similar feature is available in “Text to Video”, which allows you to create completely new images directly within the program. “Simply type the text in the prompt or upload reference images. These clips can be used to generate ideas and create storyboards or create B-roll to enhance live action footage,” Adobe said. Considering that generative AI video was first introduced, the company is commercializing this feature quite quickly just a few months ago.
These features will arrive later this year, but Adobe is rolling out updates to all users in May. These include interactive dimmer handles to make transitions easier, an Essential Sound tab with audio category labels (“AI automatically labels audio clips as dialogue, music, sound effects or atmosphere, and adds a new icon for one-click, instant access for editors”). proper control for”), effect icons and redesigned waveforms on the graph.
