Controlnet Canny Stable Diffusion

ControlNet is a neural network structure to control diffusion models by adding extra conditions. ControlNet equips us with the ability to control SD and generate images in the way we desire by passing a control image and prompt. In this app, we will give a pattern image and a prompt. Model will detect the canny edges of the image and based on prompt will create a new image that matches the shape of control input image.
J

Check the code : Github

J

View youtube video demo : Youtube Demo Video (0:41 secs)