Stability AI’s Stable Doodle
Introducing Stable Doodle: Turn Sketches Into Images
Sketch-2-Image Powered By Stable Diffusion XL and Tencent’s T2I Adapter
Stability AI, known for its Stable Diffusion image generation model, has launched a new service called Stable Doodle that converts sketches into images.
Stable Doodle is free and available through ClipDrop, a platform acquired by Stability AI that offers a range of image generation and editing tools.
Here’s how the new feature works.
What’s Under The Hood?
If you’ve used Stable Diffusion locally or via Rundiffusion.com (I wrote a blog post about how to do that), you’ve probably come across ControlNet, a set of control functions that help create images based on depth maps, Canny edges, or: sketches.
Stable Doodle works similarly, albeit with a different toolset: it uses the latest Stable Diffusion XL model and a “conditional control solution” developed by Tencent called T2I adapter. The latter allows Stable Diffusion XL to use sketches as a guide for fine-tuning the final image output.
Stable Doodle combines the advanced image-generating technology of Stability AI’s Stable Diffusion XL with the powerful T2I-Adapter. T2I-Adapter is a condition control solution developed by Tencent ARC (license). It allows for precise control over AI image generation.
How To Use Stable Doodle
Step 1
Log in to ClipDrop and choose “STABLE DOODLE” from the feature lilst.
Step 2
Use the drawing tool to create your doodle…
… and add a combination of text prompt and style option (currently there are 14 art styles):
Step 3
From the pre-rendered image options choose the one you want to upscale to HD…
Output Quality
Once you start experimenting with Stable Doodle, you’ll find that the quality of the output depends on the level of detail of the sketch, the vividness of the prompt, and the complexity of the scene.
It also seems that certain style presets work better than others for certain subjects.
Have fun exploring! 🚀
Links
Stability AI’s blog post announcing Stable Doodle
➡️ Follow me to stay up to date on “AI &Creativity”. If you want to support my work, become a Medium member using my referral link and get full access to all my articles (140+ and growing) and those of thousands of other writers. 🙏
➡️ If you like my content, why not leave a “clap” at the end of this article, so more people can see it?