How to Transform Videos with Runway Aleph | Runway Academy

Runway · Beginner ·✍️ Prompt Engineering ·11mo ago

Key Takeaways

The video demonstrates how to use Runway Aleph, a powerful general-purpose video model, to transform videos by applying various effects such as relighting, style transfer, and reanimation. It covers the basics of accessing Aleph, prompting with Aleph, and using image references to achieve desired transformations.

Full Transcript

Welcome to Runway Academy. Today we're transforming videos with a left. ALF is a powerful generalpurpose video model that can accomplish a wide variety of transformation tasks like viewpoint changes, inpainting, outpainting, relighting, reanimation, style transfer, and many, many more. To access LF, simply drag a video clip into the prompt box within a session or into chat mode. For the best results, make sure your video clip is 1280 x 720 and no more than 5 seconds long. Let's start off with something simple like a relighting task. Now we have nice warm light on the side of the man's face while everything else in the scene remains intact. Stepping up in complexity, let's ask LF for a nightto-day transformation. When prompting ALF, it's helpful to try and include as much detail as possible so the model knows exactly what you're trying to achieve. For example, if we just prompt for make it cinematic, we get a result that looks like this. It's definitely cool, but it's not specific. Changing the prompt to how we want to make it cinematic will pull your results even closer to the vision that you have in mind. So, be direct and specific about the request. You can also instruct LF to keep certain parameters the same, like camera motion or lighting, while changing the main subject action entirely. In addition to the text prompt and the video clip, you can also provide LF with image references, giving you even more control over your video transformations. You can even apply rough animations over a still image as your video input to have ALF bring it to life. With ALF, you can now focus on new camera angles, next shot generations, adding to a scene, removing from a scene, completely changing a scene entirely, or anything in between. ALF, much like references, is a general purpose model that allows for practically endless workflows and use cases. Make sure you check out the ALF help articles for additional tips and tricks or the Runway Discord to see how other community members are using ALF and other runway tools. If you need to ask us a question directly, you can always use this button on your dashboard at any time. [Music]

Original Description

Learn how to edit and transform videos with Aleph. 0:00 Intro 0:15 About Aleph 0:33 Accessing Aleph 0:46 Prompting with Aleph 1:39 Using image references 1:55 Outro — runwayml.com academy.runwayml.com
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Runway · Runway · 35 of 60

1 David Ha - Creative AI Conversations
David Ha - Creative AI Conversations
Runway
2 Devi Parikh - Creative AI Conversations
Devi Parikh - Creative AI Conversations
Runway
3 Rebecca Fiebrink - Creative AI Conversations
Rebecca Fiebrink - Creative AI Conversations
Runway
4 Soumyadip Sengupta - Creative AI Conversations
Soumyadip Sengupta - Creative AI Conversations
Runway
5 Jia-Bin Huang - Creative AI Conversations
Jia-Bin Huang - Creative AI Conversations
Runway
6 Something is coming... | Runway
Something is coming... | Runway
Runway
7 Introducing Gen-2: Text to Video | Runway
Introducing Gen-2: Text to Video | Runway
Runway
8 Gen-2 Now Available | Runway
Gen-2 Now Available | Runway
Runway
9 "Smile" by Ta-ku: Behind The Scenes | Runway Studios
"Smile" by Ta-ku: Behind The Scenes | Runway Studios
Runway
10 A New Era of Creativity | Runway
A New Era of Creativity | Runway
Runway
11 In Conversation With: Julien Vallée | Runway Creative Partners Program
In Conversation With: Julien Vallée | Runway Creative Partners Program
Runway
12 Introducing General World Models | Runway
Introducing General World Models | Runway
Runway
13 Bias in AI and How to Fix It | Runway
Bias in AI and How to Fix It | Runway
Runway
14 Gen-3 Alpha: Available Now | Runway
Gen-3 Alpha: Available Now | Runway
Runway
15 Introducing Act-One | Runway
Introducing Act-One | Runway
Runway
16 Getting Started with Act-One | Runway Academy
Getting Started with Act-One | Runway Academy
Runway
17 Behind the Scenes: Migration — Jeremy Higgins | Runway Studios
Behind the Scenes: Migration — Jeremy Higgins | Runway Studios
Runway
18 Using a Restyled First Frame with Video to Video | Runway Academy
Using a Restyled First Frame with Video to Video | Runway Academy
Runway
19 Introducing Runway Gen-4 | Runway
Introducing Runway Gen-4 | Runway
Runway
20 The Herd | Gen-4 | Runway
The Herd | Gen-4 | Runway
Runway
21 Scimmia Vede | Gen-4 | Runway
Scimmia Vede | Gen-4 | Runway
Runway
22 The Retrieval | Gen-4 | Runway
The Retrieval | Gen-4 | Runway
Runway
23 The Lonely Little Flame | Gen-4 | Runway
The Lonely Little Flame | Gen-4 | Runway
Runway
24 NYC is a Zoo | Gen-4 | Runway
NYC is a Zoo | Gen-4 | Runway
Runway
25 Gen-4 Image to Video | Runway Academy
Gen-4 Image to Video | Runway Academy
Runway
26 Using 3D Assets with Gen-4 + References | Runway
Using 3D Assets with Gen-4 + References | Runway
Runway
27 Using 3D Assets in Gen-4 References | Runway Academy
Using 3D Assets in Gen-4 References | Runway Academy
Runway
28 Generating Environments with Gen-4 References | Runway
Generating Environments with Gen-4 References | Runway
Runway
29 Runway This Week | July 7
Runway This Week | July 7
Runway
30 Introducing Act-Two | Runway
Introducing Act-Two | Runway
Runway
31 Runway This Week | July 14
Runway This Week | July 14
Runway
32 Expressive Character Performances | Runway Academy
Expressive Character Performances | Runway Academy
Runway
33 Introducing Runway Aleph | A new way to edit, transform and generate video.
Introducing Runway Aleph | A new way to edit, transform and generate video.
Runway
34 Runway This Week | August 2
Runway This Week | August 2
Runway
How to Transform Videos with Runway Aleph | Runway Academy
How to Transform Videos with Runway Aleph | Runway Academy
Runway
36 Runway This Week | August 10
Runway This Week | August 10
Runway
37 Runway This Week | August 17
Runway This Week | August 17
Runway
38 Runway This Week | August 29
Runway This Week | August 29
Runway
39 Runway This Week | September 6
Runway This Week | September 6
Runway
40 Runway This Week | September 13
Runway This Week | September 13
Runway
41 Using Workflows | Runway Academy
Using Workflows | Runway Academy
Runway
42 How to Build Custom Workflows | Runway Academy
How to Build Custom Workflows | Runway Academy
Runway
43 Runway This Week | November 22
Runway This Week | November 22
Runway
44 Introducing Gen-4.5 | Runway
Introducing Gen-4.5 | Runway
Runway
45 Research Demo Day 2025 | Runway
Research Demo Day 2025 | Runway
Runway
46 Gen-4.5 Updates — Research Demo Day 2025 | Runway
Gen-4.5 Updates — Research Demo Day 2025 | Runway
Runway
47 GWM Real-time Worlds — Research Demo Day 2025 | Runway
GWM Real-time Worlds — Research Demo Day 2025 | Runway
Runway
48 GWM Avatars — Research Demo Day 2025 | Runway
GWM Avatars — Research Demo Day 2025 | Runway
Runway
49 GWM Robotics — Research Demo Day 2025 | Runway
GWM Robotics — Research Demo Day 2025 | Runway
Runway
50 Character Creator Workflow | Runway Academy
Character Creator Workflow | Runway Academy
Runway
51 Move with Gen-4.5 | Runway
Move with Gen-4.5 | Runway
Runway
52 How to Use Motion Sketch | Runway
How to Use Motion Sketch | Runway
Runway
53 How to Turn an Image into an Entire Story with Story Panels Workflow | Runway
How to Turn an Image into an Entire Story with Story Panels Workflow | Runway
Runway
54 Previs your shoot with Storyboard Creator Workflow | Runway
Previs your shoot with Storyboard Creator Workflow | Runway
Runway
55 All the best models. All inside Runway. | Runway
All the best models. All inside Runway. | Runway
Runway ML
56 Morningstar: An AI short film | Runway
Morningstar: An AI short film | Runway
Runway ML
57 Introducing Runway Characters | Runway
Introducing Runway Characters | Runway
Runway ML
58 Create Your Own Character in 5 Minutes | Runway
Create Your Own Character in 5 Minutes | Runway
Runway
59 Build a Characters React App | Runway
Build a Characters React App | Runway
Runway
60 Screen Sharing and Camera Feed with Runway Characters | Runway
Screen Sharing and Camera Feed with Runway Characters | Runway
Runway

This video teaches how to use Runway Aleph to transform videos by applying various effects and using prompts and image references. It covers the basics of accessing Aleph and prompting with Aleph to achieve desired transformations. By following this lesson, viewers can learn how to use Aleph to edit and transform videos.

Key Takeaways
  1. Access Aleph by dragging a video clip into the prompt box
  2. Prompt Aleph with specific details to achieve desired transformations
  3. Use image references to provide more control over video transformations
  4. Apply effects such as relighting, style transfer, and reanimation to videos
  5. Experiment with different prompts and image references to achieve desired outcomes
💡 Providing specific and detailed prompts to Aleph is crucial to achieving desired video transformations

Related Reads

Chapters (6)

Intro
0:15 About Aleph
0:33 Accessing Aleph
0:46 Prompting with Aleph
1:39 Using image references
1:55 Outro
Up next
Why do some good prompt produce amazing results while others fail?The secret is Prompt Engineering.
Kartikeya
Watch →