Runway, the New York City-based generative AI video startup, has released an update to its signature text/image/video-to-video model Gen-2, causing excitement among its users. Many AI filmmakers have described the update as “game-changing” and a “pivotal moment in generative AI.” Gen-2 has undergone significant improvements in the fidelity and consistency of video results, according to Runway’s official account on the social network X. Jamie Umpherson, Runway’s head of creative, praised the update for its advancements in fidelity and consistency, saying it is a significant step forward for anyone with a story to tell.
Gen-2, which was unveiled in March of this year, allows users to generate new four-second-long videos from scratch by typing text prompts or by uploading images for the AI model to add motion to. Previous models required users to upload existing video clips. In August, Runway added the option to extend AI-generated videos in Gen-2 up to 18 seconds. In September, they introduced “Director Mode,” which allows users to choose the direction and intensity of camera movement in their AI-generated videos.
The latest update to Gen-2 adds even smoother, sharper, higher-definition, and more realistic motion to AI-generated and still image subjects. AI artists have praised the update for its improved resolution, which allows them to create high-quality scenes based on still images. Users can now stitch together short AI-generated clips to create longer works, and some have already created compelling music videos using this method.
Runway’s founder and CEO, Cristóbal Valenzuela, expressed his enthusiasm for the update, stating that previous software allowed human users to manually create by “pushing pixels,” whereas AI-powered models like Gen-2 now do that work for us. Valenzuela declared that “Creative software is dead,” explaining that AI tools now take care of the manual work, leaving users to direct the machines at a higher level with natural language or parameter adjustments.
The Gen-2 update has sparked inspiration among Runway’s employees and users. AI filmmaking is emerging as a major creative force in this century, potentially comparable to the rise of physical filmmaking in the 1920s. The update’s release coinciding with a major Hollywood actors union strike and negotiations with studios over the use of AI in creating digital twins or replacing actors entirely adds a certain irony to the situation.
VentureBeat aims to provide a platform for technical decision-makers to gain knowledge about transformative enterprise technology and transact.
