Expressive Character Performances | Runway Academy

Runway · Beginner ·🎨 Image & Video AI ·1y ago

Key Takeaways

Create expressive character performances with Act-Two, a motion capture tool that supports hand and upper body tracking, and learn how to use it for best results in image AI applications.

Full Transcript

Welcome to Runway Academy. Today we're going to create expressive character performances using Act 2. From a generative session, you can access Act 2 from the video tab. Then load in or record your driving performance video in the top slot and add a character image or video in the bottom slot. You'll get the best results out of Act 2 if your driving performance video and your character are facing the same general direction and taking up similar screen space. If you're standing too far away or facing the wrong direction, your results may vary. As a pro tip, you can easily correct your character's pose and eyline by quickly running it through references. Before we generate our first video, let's open up the settings. First, we have our facial expressiveness slider, which lets you dial up or down the expressiveness of your character performance output. Lower values will tame the expressiveness, while higher values will amplify it. The gestures toggle, which is on by default, will capture your body gestures, including your hands, for your character performance. If your character input has visible hands, make sure that your hands are also visible in the driving video to achieve the best results. [Laughter] With Act Two, you now have the power of performance on your side, including more support for animated characters and non-human characters, all with a much higher level of consistency and a much more diverse range of styles than was possible in Act One. We can't wait to see what you make with Act 2. If you need some additional support, make sure to check out the help articles or head over to Discord to see how our creative community is using Act 2. If you need to ask us a question directly, you can always use this button on your dashboard at any time. [Music]

Original Description

Create expressive character performances with Act-Two, our most advanced motion capture yet. Now supporting hand and upper body tracking as well as an even wider variety of characters and styles. Learn how in today's Runway Academy. 0:00 Intro 0:18 How to use Act-Two 0:30 Tips for best results 0:55 Settings 1:32 Outro — runwayml.com academy.runwayml.com
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Runway · Runway · 32 of 60

1 David Ha - Creative AI Conversations
David Ha - Creative AI Conversations
Runway
2 Devi Parikh - Creative AI Conversations
Devi Parikh - Creative AI Conversations
Runway
3 Rebecca Fiebrink - Creative AI Conversations
Rebecca Fiebrink - Creative AI Conversations
Runway
4 Soumyadip Sengupta - Creative AI Conversations
Soumyadip Sengupta - Creative AI Conversations
Runway
5 Jia-Bin Huang - Creative AI Conversations
Jia-Bin Huang - Creative AI Conversations
Runway
6 Something is coming... | Runway
Something is coming... | Runway
Runway
7 Introducing Gen-2: Text to Video | Runway
Introducing Gen-2: Text to Video | Runway
Runway
8 Gen-2 Now Available | Runway
Gen-2 Now Available | Runway
Runway
9 "Smile" by Ta-ku: Behind The Scenes | Runway Studios
"Smile" by Ta-ku: Behind The Scenes | Runway Studios
Runway
10 A New Era of Creativity | Runway
A New Era of Creativity | Runway
Runway
11 In Conversation With: Julien Vallée | Runway Creative Partners Program
In Conversation With: Julien Vallée | Runway Creative Partners Program
Runway
12 Introducing General World Models | Runway
Introducing General World Models | Runway
Runway
13 Bias in AI and How to Fix It | Runway
Bias in AI and How to Fix It | Runway
Runway
14 Gen-3 Alpha: Available Now | Runway
Gen-3 Alpha: Available Now | Runway
Runway
15 Introducing Act-One | Runway
Introducing Act-One | Runway
Runway
16 Getting Started with Act-One | Runway Academy
Getting Started with Act-One | Runway Academy
Runway
17 Behind the Scenes: Migration — Jeremy Higgins | Runway Studios
Behind the Scenes: Migration — Jeremy Higgins | Runway Studios
Runway
18 Using a Restyled First Frame with Video to Video | Runway Academy
Using a Restyled First Frame with Video to Video | Runway Academy
Runway
19 Introducing Runway Gen-4 | Runway
Introducing Runway Gen-4 | Runway
Runway
20 The Herd | Gen-4 | Runway
The Herd | Gen-4 | Runway
Runway
21 Scimmia Vede | Gen-4 | Runway
Scimmia Vede | Gen-4 | Runway
Runway
22 The Retrieval | Gen-4 | Runway
The Retrieval | Gen-4 | Runway
Runway
23 The Lonely Little Flame | Gen-4 | Runway
The Lonely Little Flame | Gen-4 | Runway
Runway
24 NYC is a Zoo | Gen-4 | Runway
NYC is a Zoo | Gen-4 | Runway
Runway
25 Gen-4 Image to Video | Runway Academy
Gen-4 Image to Video | Runway Academy
Runway
26 Using 3D Assets with Gen-4 + References | Runway
Using 3D Assets with Gen-4 + References | Runway
Runway
27 Using 3D Assets in Gen-4 References | Runway Academy
Using 3D Assets in Gen-4 References | Runway Academy
Runway
28 Generating Environments with Gen-4 References | Runway
Generating Environments with Gen-4 References | Runway
Runway
29 Runway This Week | July 7
Runway This Week | July 7
Runway
30 Introducing Act-Two | Runway
Introducing Act-Two | Runway
Runway
31 Runway This Week | July 14
Runway This Week | July 14
Runway
Expressive Character Performances | Runway Academy
Expressive Character Performances | Runway Academy
Runway
33 Introducing Runway Aleph | A new way to edit, transform and generate video.
Introducing Runway Aleph | A new way to edit, transform and generate video.
Runway
34 Runway This Week | August 2
Runway This Week | August 2
Runway
35 How to Transform Videos with Runway Aleph | Runway Academy
How to Transform Videos with Runway Aleph | Runway Academy
Runway
36 Runway This Week | August 10
Runway This Week | August 10
Runway
37 Runway This Week | August 17
Runway This Week | August 17
Runway
38 Runway This Week | August 29
Runway This Week | August 29
Runway
39 Runway This Week | September 6
Runway This Week | September 6
Runway
40 Runway This Week | September 13
Runway This Week | September 13
Runway
41 Using Workflows | Runway Academy
Using Workflows | Runway Academy
Runway
42 How to Build Custom Workflows | Runway Academy
How to Build Custom Workflows | Runway Academy
Runway
43 Runway This Week | November 22
Runway This Week | November 22
Runway
44 Introducing Gen-4.5 | Runway
Introducing Gen-4.5 | Runway
Runway
45 Research Demo Day 2025 | Runway
Research Demo Day 2025 | Runway
Runway
46 Gen-4.5 Updates — Research Demo Day 2025 | Runway
Gen-4.5 Updates — Research Demo Day 2025 | Runway
Runway
47 GWM Real-time Worlds — Research Demo Day 2025 | Runway
GWM Real-time Worlds — Research Demo Day 2025 | Runway
Runway
48 GWM Avatars — Research Demo Day 2025 | Runway
GWM Avatars — Research Demo Day 2025 | Runway
Runway
49 GWM Robotics — Research Demo Day 2025 | Runway
GWM Robotics — Research Demo Day 2025 | Runway
Runway
50 Character Creator Workflow | Runway Academy
Character Creator Workflow | Runway Academy
Runway
51 Move with Gen-4.5 | Runway
Move with Gen-4.5 | Runway
Runway
52 How to Use Motion Sketch | Runway
How to Use Motion Sketch | Runway
Runway
53 How to Turn an Image into an Entire Story with Story Panels Workflow | Runway
How to Turn an Image into an Entire Story with Story Panels Workflow | Runway
Runway
54 Previs your shoot with Storyboard Creator Workflow | Runway
Previs your shoot with Storyboard Creator Workflow | Runway
Runway
55 All the best models. All inside Runway. | Runway
All the best models. All inside Runway. | Runway
Runway ML
56 Morningstar: An AI short film | Runway
Morningstar: An AI short film | Runway
Runway ML
57 Introducing Runway Characters | Runway
Introducing Runway Characters | Runway
Runway ML
58 Create Your Own Character in 5 Minutes | Runway
Create Your Own Character in 5 Minutes | Runway
Runway
59 Build a Characters React App | Runway
Build a Characters React App | Runway
Runway
60 Screen Sharing and Camera Feed with Runway Characters | Runway
Screen Sharing and Camera Feed with Runway Characters | Runway
Runway

Learn how to create expressive character performances using Act-Two, a motion capture tool that supports hand and upper body tracking, and discover how to achieve the best results in image AI applications. This lesson covers the basics of using Act-Two, including loading driving performance videos and character images, adjusting settings, and generating character videos. By following these steps, you can create high-quality character performances with Act-Two.

Key Takeaways
  1. Access Act-Two from the video tab
  2. Load in or record a driving performance video
  3. Add a character image or video
  4. Adjust the facial expressiveness slider and gestures toggle
  5. Generate a character video
  6. Refine the character's pose and eyeline using references
  7. Experiment with different character styles and settings
💡 To achieve the best results with Act-Two, ensure that the driving performance video and character are facing the same general direction and taking up similar screen space.

Related Reads

📰
I Tried to Replace My Image Workflow with an AI Photo Generator. Three Times It Failed. Once It Didn't.
Learn from an experiment replacing an image workflow with an AI photo generator, and discover the challenges and one success story
Dev.to AI
📰
The Best Free AI Image Generators Better Than ChatGPT and Gemini
Discover free AI image generators that outperform ChatGPT and Gemini for specific workflows, offering superior photorealism and graphic design capabilities
Dev.to AI
📰
50+ Sequential Images, One Prompt in Codex
Learn to generate sequential images with Codex using a single prompt and understand the limitations of this approach
Medium · ChatGPT
📰
How can I batch-generate 3D assets from prompts or images using an API, and which 3D generation APIs support batch generation?
Learn to batch-generate 3D assets from prompts or images using APIs for efficient pipeline creation
Reddit r/artificial

Chapters (5)

Intro
0:18 How to use Act-Two
0:30 Tips for best results
0:55 Settings
1:32 Outro
Up next
Logo Animations with AI 🤩 your Brand / Shop Promotions with AI 🚀 AI Videos Free #ai #aivideo
Raj Photo Editing and Much More
Watch →