Gen-2 by Runway
Runway Gen-2: Real-time, ML-powered creative video tools and research
Last updated Mar 28, 2026
What is Gen-2 by Runway?
Gen-2 by Runway's Top Features
Key capabilities that make Gen-2 by Runway stand out.
Real-time, web-based video masking and rotoscoping
Green Screen with interactive include/exclude clicks for precise object selection
Refinement Network: UNet-based interactive segmentation for arbitrary objects
Propagation Network: temporal mask tracking across frames
Performance reported up to 63 FPS at 720p in-browser
Chroma key export for downstream editing pipelines
Streaming technology integration for low-latency processing
Research into video diffusion with 3D convolutions (e.g., RaMViD)
Multimodal, text-guided media editing via CLIP
Generative ensemble methods such as eDiff‑I for text-to-image synthesis
Mission-driven focus on next-generation creative ML tools
Acceleration Program providing curriculum, mentorship, and access to GPU clusters
Use Cases
Who benefits most from this tool.
Video editors
Quickly isolate subjects and replace backgrounds using real-time masks for faster turnarounds.
Filmmakers and VFX artists
Accelerate rotoscoping and apply effects selectively with temporally consistent masks.
Social media creators
Create chroma key overlays and stylized cutouts directly in the browser without heavy desktop suites.
Advertisers and marketers
Swap backgrounds and produce clean product cutouts for campaign assets at speed.
Journalists and newsrooms
Anonymize subjects by masking faces or objects quickly and consistently across frames.
Motion designers
Track objects to apply color grading, glows, or composited elements that follow movement.
Educators and instructors
Demonstrate ML-driven segmentation and video editing techniques live in class.
Research scientists
Prototype and evaluate video diffusion approaches (e.g., with 3D convolutions) for generation and editing.
Aspiring ML engineers
Leverage the Acceleration Program’s mentorship and GPU clusters to transition into ML roles.
Remote creative teams
Use web-based, streaming workflows for real-time reviews and collaborative edits.
Tags
User Reviews
Share your thoughts
If you've used this product, share your thoughts with other builders