Control Light in AI Images

Sebastian Kamph · Beginner ·🛠️ AI Tools & Apps ·3y ago

Key Takeaways

This video teaches how to control light in AI images using ControlNet in Stable diffusion

Full Transcript

you've been able to control characters faces poses compositions and now you can control lighting as well with a preset character or scene I'm going to show you how and if you learn anything feel free to subscribe I research this so you don't have to and YouTube ads help me keep going by the way where do bad rainbows go prism but it's a light sentence alright so I've prepared it here and we're gonna go into PNG info I have this image that we're gonna use for this tutorial I'm going to send that to image to image this is the problem in the settings to get this image and we will be using controllment as well now we need to change some things we're going to up the denoting strength to about 0.9 you can go between 0.9 and and up to one I found that the best settings and we actually remove this here I'm not going to go into control net we're going to upload the image here we're going to enable and you're going to use the depth map in my experience the depth hilarious is a little better for this lighting trick but you can use the depth map as well and the regular depth model you don't need to bother with the rest of the control net settings just remember to enable and also remember to keep the seed fixed but if you have an image that you sent in through PNG info like I did it will be set here now I have a prepared a light pack and I'm gonna upload this for you to use as well I'm just going to show you some of them so here are some of the files that I'm going to be using and these are presets that we will use so let me just slap on in there I'll show you I'll take um let's take this one now what you can do is you can just generate this and you're getting it everything is going on here so you get uh basically three light sources we have something up here we have the right one there we have something up top that we can't see but there's light on the face and there's lots of lighting here but it's not really the control that we're looking for but what I want to do here is let's go into the edit here and now if you hold you can either hold shift to just keep the aspect ratio or you can drag however you want so let's say we want to light the right side of her so take it like this so this will be the right side of the image and the left side of the image will be black so generate again so as you can see we have a huge light coming from here and it's much darker here and it's not just a light blob the the image understands and corrects as well so the lighting on the character stays the same and this works both for people and and scenes it doesn't really matter it works for anything and let's just say okay we want the light on the light side so either we can do like this or I prefer doing that because then you get the right Edge in there and now we have the light coming from the left and it's basically black on the right side you can play around with this you can use other settings I have this one for example where I might want the light to come from see I want it to come mostly from the top right but I don't want it to be fully black in the rest of the scene so here we have a big light come up here and we have less light which is not as black as it used to be let's try and move it up a little bit more I'm just going to get a huge blob of light up the top right and this is more of a daylight setting but still as you can see here there's just a small parts of black here and some gray so we have good lighting down here but it's not as blown out as it is up here you can play around with this as much as you want I made some presets that you can use and you can use them as is or with the edit and crop this is more of a straight on basically a classic ring light if you wish you can see they have the strong lights coming on here you still have some diffused light up here so the the gray Parts here will be more diffused than these will be harder these lights and again you can just swap these around let's try and get some another light pack I'm going to leave in the video description below so you can download that and play with it now you don't have to use a specific input image that uh like this that you have here you can use a crude sketch or basically anything you wanted I just wanted to show you that if you have an image that you can control it a little bit more now it's not the exact same image because we're not keeping the color here but that can also be controlled if you put colors inside of the light here now let me show you how you can be this consistent with video when I have an example here I'm going to play for you and this is basically what we did but you can see that it's the exact same face and pose and everything is the same but the light is moving so you can animate with 100 control without any of the glitches or artifacts that all the other video tutorials out there are getting now this is a little time consuming but I bet I bet there a lot of you that can find ways around that if you find a clever workflow you know let me let me know and uh I'll look it over and basically what you need to do today is let's say you have those lights and you take okay I want that image there then you generate one image and then you need to manually move that a little bit to keep the light is removing one frame at a time now this isn't very effective at all and it's very time consuming but it's the first step of making animations that are fully controllable and just looking at this example here you can see especially the light you can see the light on the the nose and everything this is revolutionary mine this is this has a great potential we've been able to control first with dream Booth control over the faces with control net we have had control over any pose or composition and within control net we now have control of the light as well so uh this is super cool and I hope you enjoyed this if you learned anything remember subscribing and liking helps me you don't have to if you don't want to as always have a good one see ya

Original Description

I'm the king of lights now with ControlNet in Stable diffusion. Support me on Patreon to say thank you for the free light pack https://www.patreon.com/sebastiankamph FREE Light pack: https://drive.google.com/file/d/1am7z4CquPJrvz97DGAqMcP35WxEI-Pio/view Chat with me in our community discord: https://discord.com/invite/dFB7zuXyFY ControlNet tutorial and install guide https://youtu.be/vFZgPyCJflE LIVE Pose in Stable Diffusion https://youtu.be/uAI_FBK6UPc My workflow to Perfect Images https://youtu.be/4u-Ytioi3DM Ultimate Stable diffusion guide https://youtu.be/DHaL56P6f5M The Rise of AI Art: A Creative Revolution https://youtu.be/Ujpr62w7qcU 7 Secrets to writing with ChatGPT (Don't tell your boss!) https://youtu.be/G5pld_ELBI0 Ultimate Animation guide in Stable diffusion https://youtu.be/lztn6qLc9UE Dreambooth tutorial for Stable diffusion https://youtu.be/Z-hyKADmHmE 5 tricks you're not using https://youtu.be/-5TaeHvnVxE Avoid these 7 mistakes https://youtu.be/b8xWjrzTAPY How to ChatGPT. ChatGPT explained: https://youtu.be/APvEaj19Io4 How to fix live render preview: https://youtu.be/_4rY0oPbUYA
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Sebastian Kamph · Sebastian Kamph · 51 of 60

1 How to install stable diffusion tutorial (automatic1111)
How to install stable diffusion tutorial (automatic1111)
Sebastian Kamph
2 Inpainting in Stable diffusion for beginners.
Inpainting in Stable diffusion for beginners.
Sebastian Kamph
3 OpenAI NEW Whisper is AMAZING!
OpenAI NEW Whisper is AMAZING!
Sebastian Kamph
4 Tutorial - Free AI Game assets in Stable diffusion. Episode 1: Sword
Tutorial - Free AI Game assets in Stable diffusion. Episode 1: Sword
Sebastian Kamph
5 Game assets in Stable diffusion. Ep 2: Jewelry
Game assets in Stable diffusion. Ep 2: Jewelry
Sebastian Kamph
6 Stable diffusion Animation tutorial with AUTOMATIC AUDIO SYNC. Make your own AI music video!
Stable diffusion Animation tutorial with AUTOMATIC AUDIO SYNC. Make your own AI music video!
Sebastian Kamph
7 Stable diffusion img2img tutorial.
Stable diffusion img2img tutorial.
Sebastian Kamph
8 Stable diffusion tutorial - AI Game assets. Episode 3: Treasure chest
Stable diffusion tutorial - AI Game assets. Episode 3: Treasure chest
Sebastian Kamph
9 Stable diffusion animation tutorial. Deforum ALL settings explained. Make your own AI video!
Stable diffusion animation tutorial. Deforum ALL settings explained. Make your own AI video!
Sebastian Kamph
10 Dreambooth tutorial for stable diffusion. Quick, free and easy!
Dreambooth tutorial for stable diffusion. Quick, free and easy!
Sebastian Kamph
11 Dreambooth to CKPT. NEW VERSION! Dreambooth locally on potato pc.
Dreambooth to CKPT. NEW VERSION! Dreambooth locally on potato pc.
Sebastian Kamph
12 Stable diffusion tutorial. ULTIMATE guide - everything you need to know!
Stable diffusion tutorial. ULTIMATE guide - everything you need to know!
Sebastian Kamph
13 AI music video. Neffex - Winning
AI music video. Neffex - Winning
Sebastian Kamph
14 Stable diffusion video input tutorial. How I made this music video singing animation.
Stable diffusion video input tutorial. How I made this music video singing animation.
Sebastian Kamph
15 Stable diffusion color grading tutorial. Quick trick!
Stable diffusion color grading tutorial. Quick trick!
Sebastian Kamph
16 Prompt Editing and Alternating Words in Stable Diffusion.
Prompt Editing and Alternating Words in Stable Diffusion.
Sebastian Kamph
17 Stable diffusion gui most important setting. Live render preview.
Stable diffusion gui most important setting. Live render preview.
Sebastian Kamph
18 NEW Voice2img prototype! This AI assistant is using Stable diffusion!
NEW Voice2img prototype! This AI assistant is using Stable diffusion!
Sebastian Kamph
19 Prompts and FREE ONLINE stable diffusion. OpenArt AI tutorial
Prompts and FREE ONLINE stable diffusion. OpenArt AI tutorial
Sebastian Kamph
20 Stable diffusion Halloween concept art tutorial.
Stable diffusion Halloween concept art tutorial.
Sebastian Kamph
21 Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Sebastian Kamph
22 Stable diffusion prompt tutorial. NEW PROMPT BOOK released!
Stable diffusion prompt tutorial. NEW PROMPT BOOK released!
Sebastian Kamph
23 Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Stable diffusion GTA 6 style image tutorial. Quick and EASY!
Sebastian Kamph
24 How to install Deforum locally. Stable diffusion animation.
How to install Deforum locally. Stable diffusion animation.
Sebastian Kamph
25 Dreambooth in Automatic1111. Cpu only & gpu option.
Dreambooth in Automatic1111. Cpu only & gpu option.
Sebastian Kamph
26 Nvidia's NEW text to image AI eDiff-I. Will it dethrone Stable diffusion?
Nvidia's NEW text to image AI eDiff-I. Will it dethrone Stable diffusion?
Sebastian Kamph
27 NEW VR in Stable diffusion? The future is now!
NEW VR in Stable diffusion? The future is now!
Sebastian Kamph
28 Motion capture workflow implementation with Stable diffusion
Motion capture workflow implementation with Stable diffusion
Sebastian Kamph
29 Don't make these 7 mistakes in Stable diffusion.
Don't make these 7 mistakes in Stable diffusion.
Sebastian Kamph
30 Stable diffusion up to 50% faster? I'll show you.
Stable diffusion up to 50% faster? I'll show you.
Sebastian Kamph
31 Stable diffusion 2.0 Released
Stable diffusion 2.0 Released
Sebastian Kamph
32 Top 5 Stable diffusion tips for newcomers.
Top 5 Stable diffusion tips for newcomers.
Sebastian Kamph
33 3 AMAZING Stable diffusion models that will change your life!
3 AMAZING Stable diffusion models that will change your life!
Sebastian Kamph
34 Best NEW AI tool? InvokeAI tutorial for Stable diffusion.
Best NEW AI tool? InvokeAI tutorial for Stable diffusion.
Sebastian Kamph
35 Monetize your AI art on Creative Fabrica with CF Spark.
Monetize your AI art on Creative Fabrica with CF Spark.
Sebastian Kamph
36 NEW Stable diffusion 2.1 RELEASED!
NEW Stable diffusion 2.1 RELEASED!
Sebastian Kamph
37 Stable diffusion 2.1 is GREAT. At this one thing. 2.1 install tutorial.
Stable diffusion 2.1 is GREAT. At this one thing. 2.1 install tutorial.
Sebastian Kamph
38 Your face in AI images? The EASY way.
Your face in AI images? The EASY way.
Sebastian Kamph
39 3 FANTASTIC Stable diffusion models you don't know about!
3 FANTASTIC Stable diffusion models you don't know about!
Sebastian Kamph
40 Unstable diffusion JUST GOT BANNED! 😲
Unstable diffusion JUST GOT BANNED! 😲
Sebastian Kamph
41 The end of AI Art? Lawsuit against Stable diffusion
The end of AI Art? Lawsuit against Stable diffusion
Sebastian Kamph
42 Stable diffusion TIER LIST. Best GUI ranked.
Stable diffusion TIER LIST. Best GUI ranked.
Sebastian Kamph
43 Google's ChatGPT rival Bard. Is it better?
Google's ChatGPT rival Bard. Is it better?
Sebastian Kamph
44 7 Secrets in ChatGPT (Don't tell your boss!)
7 Secrets in ChatGPT (Don't tell your boss!)
Sebastian Kamph
45 How to ChatGPT? Chat GPT explained!
How to ChatGPT? Chat GPT explained!
Sebastian Kamph
46 How to ChatGPT in 20 seconds!
How to ChatGPT in 20 seconds!
Sebastian Kamph
47 Midjourney 4C Features
Midjourney 4C Features
Sebastian Kamph
48 NEW ControlNet for Stable diffusion RELEASED! THIS IS MIND BLOWING!
NEW ControlNet for Stable diffusion RELEASED! THIS IS MIND BLOWING!
Sebastian Kamph
49 Revealing my Workflow to Perfect AI Images.
Revealing my Workflow to Perfect AI Images.
Sebastian Kamph
50 LIVE Pose in Stable Diffusion's ControlNet.
LIVE Pose in Stable Diffusion's ControlNet.
Sebastian Kamph
Control Light in AI Images
Control Light in AI Images
Sebastian Kamph
52 Multi-ControlNet tutorial.
Multi-ControlNet tutorial.
Sebastian Kamph
53 Control Text in AI Images
Control Text in AI Images
Sebastian Kamph
54 Full AI Art Workflow. ControlNet & Stable diffusion.
Full AI Art Workflow. ControlNet & Stable diffusion.
Sebastian Kamph
55 ControlNet Guidance tutorial. Fixing hands?
ControlNet Guidance tutorial. Fixing hands?
Sebastian Kamph
56 Illuminati Model with Noise Offset & Weekly AI Art Challenge
Illuminati Model with Noise Offset & Weekly AI Art Challenge
Sebastian Kamph
57 Paint&Text2Image - MultiDiffusion Region Control.
Paint&Text2Image - MultiDiffusion Region Control.
Sebastian Kamph
58 Style2Image in ControlNet (T2I)
Style2Image in ControlNet (T2I)
Sebastian Kamph
59 Gen-1 AI Animation is WILD
Gen-1 AI Animation is WILD
Sebastian Kamph
60 Famous Scenes Remade by ControlNet AI
Famous Scenes Remade by ControlNet AI
Sebastian Kamph

Related Reads

📰
AI For Time Management: How Artificial Intelligence Can Help You Get More Done Every Day
Learn how AI can optimize your daily schedule and boost productivity
Medium · ChatGPT
📰
I Built a Tool With AI That I Actually Use Every Week — Here’s What “Built With AI” Actually Looks…
Learn how to build a practical AI-powered tool for automating tasks, such as keeping OS images current, and apply it to real-world scenarios
Medium · DevOps
📰
AI-Ready Infrastructure: A Checklist Before You Scale
Ensure your infrastructure is AI-ready by checking key components before scaling
Dev.to AI
📰
How I Cut My OpenAI Bill by 97% — The Full Migration Guide
Learn how to cut your OpenAI bill by 97% with a full migration guide, optimizing costs and improving efficiency
Dev.to · rarenode
Up next
💑 Best Budgeting App for Couples - 🤢Avoid the Couple Money Fights!
Modest Money - Reviews & Coupons
Watch →