Dreamix - Applying Video Diffusion Models as General Video Editors (AI-fused Video Editing)

650 AI Lab · Beginner ·🧠 Large Language Models ·3y ago
Dreamix: Video Diffusion Models are General Video Editors Dreamix can create videos based on image and text inputs. In this example it is able to instill complex motion in a static image, adding a moving shark and making the turtle swim. In this case, visual fidelity to object location and background was preserved but the turtle direction was flipped. Given a small collection of images showing the same subject, Dreamix can generate new videos with the subject in motion. In this example, given a small number of images of the toy fireman, Dreamix is able to extract the visual features and then animate it to lift weights while maintaining fidelity and temporal consistency. Resources and Source Code GitHub : - https://dreamix-video-editing.github.io/ - https://github.com/prodramp/DeepWorks/blob/main/llm/README.md - https://github.com/prodramp/DeepWorks/blob/main/DiffusionModels/Dreamix-DiffusionMixVideoEditing.md ▬▬▬▬▬▬ ⏰ TUTORIAL TIME STAMPS ⏰ ▬▬▬▬▬▬ - (00:00) Quick Introduction - (00:12) Dreamix Output Videos - (01:35) Dreamix Intro - (05:05) How it works? - (07:03) Conclusion Connect ------------------ - Prodramp LLC (@prodramp) - Website - https://prodramp.com - LinkedIn - https://www.linkedin.com/company/prodramp - GitHub- https://github.com/prodramp/ - AngelList - https://angel.co/company/prodramp - Facebook - https://www.facebook.com/Prodramp Content Creator: Avkash Chauhan (@avkashchauhan) - https://www.linkedin.com/in/avkashchauhan - https://twitter.com/avkashchauhan Tags: #python #stablediffusion #diffusion
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related AI Lessons

Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →