Using 3D Assets in Gen-4 References | Runway Academy

Runway · Beginner ·🏗️ Systems Design & Architecture ·1y ago

Key Takeaways

Using 3D assets with Gen-4 References in Runway Academy for controlled and production-ready generative workflows

Full Transcript

Welcome to Rimway Academy. Today we're exploring using 3D assets with Gen 4 [Music] references. Using 3D assets as part of your generative workflow is a very powerful tool. It allows you to control the specific scene elements contained in your reference image. And while you can't use 3D models directly in Runway, you can still create pre-MP images that can be brought in and used with references. Start by opening your 3D application of choice and build out a very basic 3D scene. Use the 3D camera to get the angle that you're looking for and then export the camera POV as a single still image. Now import that still image into references and combine it with a style reference image and a prompt. Your prompt structure should be something like render image one in the style of image 2, but feel free to experiment with different prompt [Music] structures. You can even try swapping out image 2 with other style reference images to get different stylistic results. But once you have some outputs that you like, try asking references for different angles of the scene or close-ups on specific elements. Now, choose your favorite images and turn them into videos with Gen 4. Then, edit them together for your final [Music] result. Using references with other traditional content creation workflows and existing assets is a powerful way to create with even more control, consistency, and production ready fidelity. Perfect for film, advertising, or other creative use cases. If you're looking for some additional tips, head over to the Gen 4 help articles or join our community on Discord to see how other creators are using references. If you need to ask us a question directly, you can always use this button on your dashboard at any time. [Music]

Original Description

Learn how to use 3D asset pre-comps with Gen-4 References for even more control, consistency and production-ready fidelity in today's Runway Academy. — runwayml.com academy.runwayml.com
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Runway · Runway · 27 of 60

1 David Ha - Creative AI Conversations
David Ha - Creative AI Conversations
Runway
2 Devi Parikh - Creative AI Conversations
Devi Parikh - Creative AI Conversations
Runway
3 Rebecca Fiebrink - Creative AI Conversations
Rebecca Fiebrink - Creative AI Conversations
Runway
4 Soumyadip Sengupta - Creative AI Conversations
Soumyadip Sengupta - Creative AI Conversations
Runway
5 Jia-Bin Huang - Creative AI Conversations
Jia-Bin Huang - Creative AI Conversations
Runway
6 Something is coming... | Runway
Something is coming... | Runway
Runway
7 Introducing Gen-2: Text to Video | Runway
Introducing Gen-2: Text to Video | Runway
Runway
8 Gen-2 Now Available | Runway
Gen-2 Now Available | Runway
Runway
9 "Smile" by Ta-ku: Behind The Scenes | Runway Studios
"Smile" by Ta-ku: Behind The Scenes | Runway Studios
Runway
10 A New Era of Creativity | Runway
A New Era of Creativity | Runway
Runway
11 In Conversation With: Julien Vallée | Runway Creative Partners Program
In Conversation With: Julien Vallée | Runway Creative Partners Program
Runway
12 Introducing General World Models | Runway
Introducing General World Models | Runway
Runway
13 Bias in AI and How to Fix It | Runway
Bias in AI and How to Fix It | Runway
Runway
14 Gen-3 Alpha: Available Now | Runway
Gen-3 Alpha: Available Now | Runway
Runway
15 Introducing Act-One | Runway
Introducing Act-One | Runway
Runway
16 Getting Started with Act-One | Runway Academy
Getting Started with Act-One | Runway Academy
Runway
17 Behind the Scenes: Migration — Jeremy Higgins | Runway Studios
Behind the Scenes: Migration — Jeremy Higgins | Runway Studios
Runway
18 Using a Restyled First Frame with Video to Video | Runway Academy
Using a Restyled First Frame with Video to Video | Runway Academy
Runway
19 Introducing Runway Gen-4 | Runway
Introducing Runway Gen-4 | Runway
Runway
20 The Herd | Gen-4 | Runway
The Herd | Gen-4 | Runway
Runway
21 Scimmia Vede | Gen-4 | Runway
Scimmia Vede | Gen-4 | Runway
Runway
22 The Retrieval | Gen-4 | Runway
The Retrieval | Gen-4 | Runway
Runway
23 The Lonely Little Flame | Gen-4 | Runway
The Lonely Little Flame | Gen-4 | Runway
Runway
24 NYC is a Zoo | Gen-4 | Runway
NYC is a Zoo | Gen-4 | Runway
Runway
25 Gen-4 Image to Video | Runway Academy
Gen-4 Image to Video | Runway Academy
Runway
26 Using 3D Assets with Gen-4 + References | Runway
Using 3D Assets with Gen-4 + References | Runway
Runway
Using 3D Assets in Gen-4 References | Runway Academy
Using 3D Assets in Gen-4 References | Runway Academy
Runway
28 Generating Environments with Gen-4 References | Runway
Generating Environments with Gen-4 References | Runway
Runway
29 Runway This Week | July 7
Runway This Week | July 7
Runway
30 Introducing Act-Two | Runway
Introducing Act-Two | Runway
Runway
31 Runway This Week | July 14
Runway This Week | July 14
Runway
32 Expressive Character Performances | Runway Academy
Expressive Character Performances | Runway Academy
Runway
33 Introducing Runway Aleph | A new way to edit, transform and generate video.
Introducing Runway Aleph | A new way to edit, transform and generate video.
Runway
34 Runway This Week | August 2
Runway This Week | August 2
Runway
35 How to Transform Videos with Runway Aleph | Runway Academy
How to Transform Videos with Runway Aleph | Runway Academy
Runway
36 Runway This Week | August 10
Runway This Week | August 10
Runway
37 Runway This Week | August 17
Runway This Week | August 17
Runway
38 Runway This Week | August 29
Runway This Week | August 29
Runway
39 Runway This Week | September 6
Runway This Week | September 6
Runway
40 Runway This Week | September 13
Runway This Week | September 13
Runway
41 Using Workflows | Runway Academy
Using Workflows | Runway Academy
Runway
42 How to Build Custom Workflows | Runway Academy
How to Build Custom Workflows | Runway Academy
Runway
43 Runway This Week | November 22
Runway This Week | November 22
Runway
44 Introducing Gen-4.5 | Runway
Introducing Gen-4.5 | Runway
Runway
45 Research Demo Day 2025 | Runway
Research Demo Day 2025 | Runway
Runway
46 Gen-4.5 Updates — Research Demo Day 2025 | Runway
Gen-4.5 Updates — Research Demo Day 2025 | Runway
Runway
47 GWM Real-time Worlds — Research Demo Day 2025 | Runway
GWM Real-time Worlds — Research Demo Day 2025 | Runway
Runway
48 GWM Avatars — Research Demo Day 2025 | Runway
GWM Avatars — Research Demo Day 2025 | Runway
Runway
49 GWM Robotics — Research Demo Day 2025 | Runway
GWM Robotics — Research Demo Day 2025 | Runway
Runway
50 Character Creator Workflow | Runway Academy
Character Creator Workflow | Runway Academy
Runway
51 Move with Gen-4.5 | Runway
Move with Gen-4.5 | Runway
Runway
52 How to Use Motion Sketch | Runway
How to Use Motion Sketch | Runway
Runway
53 How to Turn an Image into an Entire Story with Story Panels Workflow | Runway
How to Turn an Image into an Entire Story with Story Panels Workflow | Runway
Runway
54 Previs your shoot with Storyboard Creator Workflow | Runway
Previs your shoot with Storyboard Creator Workflow | Runway
Runway
55 All the best models. All inside Runway. | Runway
All the best models. All inside Runway. | Runway
Runway ML
56 Morningstar: An AI short film | Runway
Morningstar: An AI short film | Runway
Runway ML
57 Introducing Runway Characters | Runway
Introducing Runway Characters | Runway
Runway ML
58 Create Your Own Character in 5 Minutes | Runway
Create Your Own Character in 5 Minutes | Runway
Runway
59 Build a Characters React App | Runway
Build a Characters React App | Runway
Runway
60 Screen Sharing and Camera Feed with Runway Characters | Runway
Screen Sharing and Camera Feed with Runway Characters | Runway
Runway

Learn how to use 3D assets with Gen-4 References in Runway Academy to create controlled and production-ready generative workflows. This allows for more control, consistency, and fidelity in film, advertising, and other creative use cases. By following the steps outlined in this video, you can create stunning videos with ease.

Key Takeaways
  1. Open a 3D application and build a basic 3D scene
  2. Export the camera POV as a single still image
  3. Import the still image into references and combine it with a style reference image and a prompt
  4. Experiment with different prompt structures and style reference images
  5. Ask references for different angles of the scene or close-ups on specific elements
  6. Turn favorite images into videos with Gen 4 and edit them together for the final result
💡 Using 3D assets with Gen-4 References allows for more control, consistency, and production-ready fidelity in generative workflows

Related Reads

📰
A Lei de Gall: Por que todo sistema complexo que funciona evoluiu de um sistema simples que funcionava ⚙️
Learn about Gall's Law, which states that complex systems evolve from simple ones, and apply it to software engineering and system design
Dev.to · Vitor Mateus
📰
Web Development in Vancouver: Why We Chose Next.js Over WordPress for Client Sites
Learn why Next.js is preferred over WordPress for client sites in web development, and how to apply this knowledge to your own projects
Dev.to · Dhiraj Chatpar
📰
Designing Enterprise Automation Architectures with GBase Database — From Java Services to Distributed Data Intelligence
Learn to design enterprise automation architectures using GBase Database, from Java services to distributed data intelligence, and transform organizational operations
Dev.to · Scale
📰
The SRE Interview: Questions I Actually Ask
Learn the actual questions asked in a Site Reliability Engineering (SRE) interview to improve your chances of acing it
Dev.to · Samson Tanimawo
Up next
How To Install iOS 27 Beta on iPhone for FREE! (Step-by-Step)
Ksk Royal
Watch →