{"id":327,"date":"2022-09-26T20:47:36","date_gmt":"2022-09-27T00:47:36","guid":{"rendered":"https:\/\/kryptech.name\/site\/?p=327"},"modified":"2022-09-26T20:54:57","modified_gmt":"2022-09-27T00:54:57","slug":"ai-image-generation-with-stable-diffusion","status":"publish","type":"post","link":"https:\/\/kryptech.name\/site\/index.php\/ai-image-generation-with-stable-diffusion\/","title":{"rendered":"AI Image Generation with Stable Diffusion"},"content":{"rendered":"\n

<\/p>\n\n\n\n

Lately I’ve been enthralled with AI image generation, specifically Stable Diffusion. The idea is that you have a model that relates text to images. The tool generates noise and refines it over steps into an image that relates to the prompt. I’d previously signed up for the beta access to DALL\u00b7E 2<\/a> and got to try it out. You get a certain amount of free credits per month, which is nice, but AI image generation is a lot about trial-and-error and thus it’s easy to chew through credits while trying to tweak the prompt to get the target image result. I also played around with Stability.Ai’s DreamStudio<\/a> Lite, which has a similar credit model.<\/p>\n\n\n\n

On August 22, 2022 Stability.Ai publicly released their text-to-image model<\/a> – a big move that opened up lots of options for developers. After trying a few different projects I landed on AUTOMATIC111 \/ stable-diffusion-webui<\/a>, which was pretty easy to set up and has optimizations that make it very usable on my NVIDIA video card with 4GB of VRAM. At 512 x 512 pixels, it usually takes between 1-3 seconds per iteration but I’m a patient person and the tools allows for great batching so that you can set up a bunch variations and then check back when done.<\/p>\n\n\n\n

Below are some of the images I’ve generated. These are typically the result of a number of “img2img” iterations – taking the result from the initial text prompt, noising it up a certain percentage and using that plus a a text prompt to nudge the result toward what I had in mind. Sure, it’s fun to just type in something and get results but that’s not satisfying for me.<\/p>\n\n\n\n

\"\"<\/a>
Stable Diffusion does detailed textures very well<\/figcaption><\/figure>\n\n\n\n
\"\"<\/a><\/figure><\/div>\n\n\n\n
\"\"<\/a>
It’s fun watching how mechanical things are generated, how parts meld together<\/figcaption><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n
\"\"<\/a>
In some variations, the rock on the right was textured like a tree instead<\/figcaption><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n
\"\"<\/a>
I edited an initial version to add blobs for face and hands and then ran it through further img2img to build the detail<\/figcaption><\/figure>\n\n\n\n
\"\"<\/a>
Stable Diffusion struggles with positional prompts, like “parrot on shoulder”, so I edited in the parrot on a good version of the man and then Stable Diffusion was able to stitch the two together<\/figcaption><\/figure>\n\n\n\n
\"\"<\/a>
A edited in the fire on the right and the vertical lines of the structure at the top left and then ran it through again to bring out the detail<\/figcaption><\/figure>\n\n\n\n
\"\"<\/a><\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Lately I’ve been enthralled with AI image generation, specifically Stable Diffusion. The idea is that you have a model that relates text to images. The tool generates noise and refines it over steps into an image that relates to the prompt. I’d previously signed up for the beta access to DALL\u00b7E 2 and got to …read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":330,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[2],"tags":[27,24,28,26],"_links":{"self":[{"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/posts\/327"}],"collection":[{"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/comments?post=327"}],"version-history":[{"count":4,"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/posts\/327\/revisions"}],"predecessor-version":[{"id":342,"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/posts\/327\/revisions\/342"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/media\/330"}],"wp:attachment":[{"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/media?parent=327"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/categories?post=327"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kryptech.name\/site\/index.php\/wp-json\/wp\/v2\/tags?post=327"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}