Wait, ChatGPT Can Make Animations?!

Key Takeaways

thanks to do free we can now create entire animations just by using Chad GPT and most people have no idea that this is possible if you're a game developer this will save you countless hours if you want to make some extra money you can create custom animations and sell them on Fiverr or maybe you just want a new profile picture on Discord either way you have to learn how to do this before everybody else does it's crazy that all of this can be done straight from chat GPT we're going to use just two plugins both from open AI one to create the images and sprad and the other to create the animation itself now I have to give major credit to Nick Doos from Twitter he's the one who discovered that CAD GPD can create animations so make sure to check out the original thread first link in the description because we're using D free you'll have to get CAD GPD plus which I highly recommend you do but if you're broke I found a way to do this completely for free I'll show you how to do that later in the video the first step is to start a new chat select DOL free and decide what you want to create here are some ideas for inspiration pixel art anime storyboard dancing evolving origami time-lapse fighting Kaleidoscope but of course you can create anything you want just make sure to specify some sort of a movement or change in your prom otherwise you're going to have a pretty boring animation believe it or not this is actually the most important step because it's infinitely easier to create a great animation if you have a great spreadsheet you can get started with a very simple prompt such as create a spreadsheet of X doing y so maybe create a Sprite sheet of a cat dancing or create a Sprite sheet of a Viking screaming these are already yielding some pretty cool images but if you want more consistent and reliable results I recommend going with the following prom create a Sprite sheet of 9 to 12 different Sprites in a consistent grid we will use these Sprites to make a gif animation now comes the customizable line the Sprites should be showing X doing Y in Z style each Sprite has to to be different from the one before him and make sure the Sprite sheet is consistent and reliable you have to generate four different images each one depicting a totally unique Sprite sheet and now comes the fun part unleashing your creativity it's amazing how fulfilling and engaging this process is and the best part is that we're only getting started my name is David Andre and I make AI videos like this one so if you want to be on The Cutting Edge of AI make sure to subscribe this is where great animations are made you have to master the art of iteration don't settle for mediocre images tell CAD GPT what you don't like about the image explain what could be better and tell it to generate four more Sprite sheet keep polishing your prompt until the results you're getting are just amazing it really is a game of trial and error if there's one style or image you particularly like you can say hey I like the third image you made give me four new variations in that style once you have a sprad sheet that looks great and has consistent rows and columns download it if you're not overcome with excitement to to create the animation then you should keep creating more images until you suddenly jump out of your chair that's how you know you got something special now let's move on to step two create a new chat but this time select Advanced Data analysis this is basically the code interpreter plug-in just with a new name and here upload the Sprite sheet you want to animate but before you do so make sure your image doesn't contain any weird Sprites on the side if Del gives you some Sprites that are cut off like it did with my Viking scream just take a screenshot of the good part and use that file the next step is quite important because we have to make sure that c GPT knows how many Sprites there are and more importantly where they are and the following prompt does just that put this image onto a graph with labeled axis once you see the grid lines you can easily eyeball the dimensions of each Sprite step three splice and animate finally this is the step where we get to create the animation and we need to clearly communicate to CH GPT the layout of the sprad sheet so how many rows and columns there are it would be amazing if open AI combined these plugins that way you can do everything from a single chat and we wouldn't have to do all this prompt engineering you just say create the animation and it would use its Vision capabilities to see exactly where the Sprites are and how to align them perfectly but right now we don't have that so we have to use the following prom the Sprite sheet has 12 different Sprites in three rows and four columns splice the Sprite sheet accordingly and output a gif animation now you could already get solid results with this prom however if your Sprite sheet isn't super consistent or if C gbd is messing up the Sprite order then use this Advanced prompt the Sprite sheet has six different Sprites the dimensions of each Sprite are height 500 width 333 obviously you have to change these numbers based on the graph we created earlier the Sprites are placed in two rows and three columns here is the correct order of the Sprites one 2 3 enter 4 5 6 splice the Sprite sheet accordingly and output a gif animation if you don't specify the order of the frames your animation might get messed up which is exactly what happened to my dancing cat here we finally get to look at our animation our Masterpiece our work of art at least if you get lucky the more likely option is that your animation isn't aligned properly but don't worry I'll show you how to fix that step four fixing the alignment the fastest and easiest fix to this problem is just typing the Sprites are not aligned properly can you fix it sometimes a simple prompt like this can fix the issue which is quite surprising or you can try this prom which is a little more professional the Sprites are misaligned can you run some type of image recognition to line them up better there is a good chance that one of these two proms will work but I found an even better way if you go to this hugging face space Linked In the description and upload your Sprite sheet here you will get much more reliable results that's because it uses an extra 2D convolution to align the images and what's crazy is that most of the code was written by by C GPD shout out to Doc sardo for creating this space now it's crucial that in the columns per row box you enter the number of columns for each row so for this sprad sheet I would do 777 but for this one I have to do 4444 because it has one more row here you can also easily adjust the duration of each frame technically you can do that in ch gpd2 but having a slider is much nicer using 150 Ms to 200 Ms seems to be the sweet spot now you've probably noticed that the hugging face splicer is completely free so if we find a free way to generate the Sprites we don't even need chbd plus luckily there is such a way and that's the image Creator this site uses Del free to create all of the images however you only get a limited amount of credits and not only is it free it's also a lot faster than the DI plugin in chbd but that's probably because they are using a smaller version of the AI model which means the images won't be as detailed the last thing you have to know is what mistakes to avoid this is the last missing piece because if you're making beginner mistakes you're going to get beginner results and we don't want that we're looking to create mind-blowing animations that could be used in a game or sold online for a nice profit the first mistake is not having enough movement in the Sprites there has to be some noticeable visual change otherwise your animation will be static another thing that beginners do is not generating enough variations and believe me I've made this mistake myself sometimes you have to ask Del more multiple times before you get a Sprite sheet worth animating when you settle for a mediocre Sprite sheet you're going to get a mediocre animation so if you're not hitting the gp4 limit then you're not generating enough also make sure to experiment try different styles and subjects Sprites aren't the only thing you can animate this guy created three different story boards and all of them look pretty damn good a big mistake I see people make is trying to force chaotic and inconsistent Sprite sheets through the next steps you need you need to develop an eye for nice grids don't bother animating sprad sheets that are all over the place this method is not good for that keep in mind that all of this is still very early days I'm not a professional animator and I'm not claiming that I have the best proms make sure to experiment with your own PRS and styles and maybe you'll discover an even better way to do this hopefully you learn something new in this video and if you did please subscribe it takes just two seconds oh and make sure to check out Nick Doos on Twitter he's the one who discovered all this