Runway introduces image-to-video generation for Gen-3 Alpha and teases Gen-3 Alpha Turbo
Days after facing scrutiny for its data collection practices, Runway has announced significant updates to its Gen-3 Alpha video generation model, including image-to-video capabilities and a faster "Turbo" version which accelerates generations while driving down costs.
It seems Runway has been quite active on X lately, announcing updates to its video generation offerings. The company recently shared that it would update Gen-3 Alpha to support image-to-video generation. With this update, users can upload an image for the model to use as the first frame of video clips up to 11 seconds long. Optionally, the images can be accompanied by a text-based prompt to provide the model with additional guidance. According to Runway, the Image-to-Video update brings increased artistic control and improves the consistency of the generated clips. As a demonstration of Gen-3 Alpha's image-processing capabilities, the company followed the announcement with a thread including 10 generations.
Today we are releasing Gen-3 Alpha Image to Video. This update allows you to use any image as the first frame of your video generation, either on its own or with a text prompt for additional guidance.
— Runway (@runwayml) July 29, 2024
Image to Video is major update that greatly improves the artistic control and… pic.twitter.com/OieDwMIspz
Less than 48 hours later, Runway announced it had been training an enhanced version of Gen-3 Alpha, introduced as Turbo, which delivers the same groundbreaking performance but generates videos several times faster. The sample video demonstrates Gen-3 Alpha Turbo generating a 10-second video in 11 seconds. The full video, which demonstrates the speed of both models side by side, has Gen-3 Alpha Turbo generating and playing an astonishing five different 10-second videos in the time it takes for Gen-3 Alpha to create and play a single 10-second video. Runway plans to roll out Gen-3 Alpha Turbo over the next few days to free and paid users, who will benefit from the lower pricing.
We trained a new version of Gen-3 Alpha, Turbo, that can generate videos 7x faster than the original Gen-3 Alpha, while matching its performance on many use cases. We’ll be rolling out Turbo for Image to Video with significantly lower pricing over the coming days while also… pic.twitter.com/4qbmD15pvY
— Runway (@runwayml) July 31, 2024
Runway is one of the AI companies to come under fire for their unethical data collection practices after 404 Media reported it obtained a training data spreadsheet comprising links to popular YouTube channels, spanning media and entertainment companies, news outlets, influencers, and other individual creators. The media company tested the model using keywords and prompts based on the document. 404 Media posted some of the resulting outputs, which bear an uncanny resemblance to the original videos referenced by the prompts.
