How to use Stable Diffusion on Cloud Run

Key Takeaways

now that I can use gpus serverless in Cloud run what can I do with it good question you can run different op Source models on it like stable diffusion XL for image generation and let me show you [Music] how welcome to the show Lisa what do you do here at Google Cloud I'm a product manager at Google coud focusing on C run and gke and my years of experience in the C industry have given me a deep understanding of the challenges Enterprises face I am passionate about using this knowledge to drive product development and ensure a simless user experience for our customers seamless user experience I love it uh so what are we building today Lisa we're building a simple AI inference application that generates image it uses the stable diffusion Excel model with torch serf running similarly on carun once deployed the application will allow you to generate images simply by providing a text prompt describing the image you want and here's an example of what it can do but you could also use Google's hosted image and model for image generation uh why are we using stable diffusion Google's imj model is really good good it's hosted by Google and generates photo realistic images it's easy to call from your code so you can get your application to Market quickly if you use that on the other hand if you host your own model or open models on carun you get more control you get more transparency and customization and that's what we're doing today ah I see so you said before that we're going to set up stable diffusion excel in Cloud run uh can viewers try for themselves yeah of course you can follow along in the collab Martin can you please make sure to include the link in the show notes okay we'll do all right the first step is to enable the right apis in your Google call project and I have done that in my project but the collab list all the commands for this got it next I will create a torch serve app torch serve is an open source model serving library that makes my life easier to work with the stable diffusion Excel model and the stable diffusion Excel model will run in the GPU enabled cand service then I will create a requirements file that list all the libraries the application will use I will add a file called config do properties that gives torch serve is configuration now it's time to add the main code of the application I'll create a new file called stable diffusion Handler and paste the code from the cab in there whoa that's a lot of code uh where does the image generation happen here in the inference method and that's where the real action happens this inference method takes a list of input promps and generate images using the loaded models it first used the pipeline to generate a initial image from the pump and then it used the refiner to refine the image and remove the artifacts ah got it next I will create a shell script file that starts the torch serve application I'll will ask cun to call this show script Cloud run runs and scales containers for us in the cloud so I need a Docker file to build that container here at the end of the docker file I'm asking Cloud run to execute the show script that starts the torch serve application ah understood and now it's time to deploy the app yeah that is right it takes some time to download a stable diffusion Excel model from the internet so to speed things up let's run this two commands to set up a Callet and that will increase the bandwidth to huging face website where the model is stored sounds useful uh deployment time yeah it is first I will run gcal builds Summit to build a container and this command will build a container in the cloud on a Google host dat to build server it will take a while so let's take a te break and we're back the build was completed successfully now I will run Gard run deploy to deploy the build container and give it a public https edges and it looks like you're setting up cloudron to use gpus here Lisa yeah GPU equals one means that the service will use one GPU and then GPU type flag specified the service will Ed Nvidia L4 GPU let's run that command it will take a minute to complete looks like the deployment finished it did let's try it out first let's put the service URL in an environment variable next let's set up environment variable for the prompt and I'll ask for a image of a dog running in the park since the dog is my favorite pet and then I will run this Cur command to send a request to my app with the prom and this will take a minute also due to the cloud run service code start and it's done here's the image very nice um could the dog wear a pink shirt and sunglasses sure let's do it I'll send another request to the app with a new prompt and here you are this is the image how do you like it Martin it looks great Lisa uh well thank you for showing us this Lisa yes thanks for having me Martin and thank you everyone for watching if you have any questions for Lisa or me please add them in the comments also please let me know what you thought of this episode I read every single comment I can't wait to see what you build [Music]