Image Implantation/Manipulation

ReatKay
Sun, 10 Sep 2023 18:17:12 +0000

Ahhh, now it’s clear…
well, thats a use-case which can be solved through Inpainting or - even more automatic - by using ControlNet (usable with img2img , text2img etc.) on Stable Diffusion - completely, if i’m not absolutely wrong. I’m using Inpainting very limited atm, only to remove watermarks, text, logos to build datasets for image generation, but im using ControlNet daily on generation.

ControlNet allows you for example to mask objects on input file, replacing that object by sihlouette, depth data, pose (through a mechanism called OpenPose) etc. with another object, pretty much exactly matching the sihlouette or the pos.

I woudl suggest installing Automatic11111 - a great web gui for Stable Difussion and then installing the extension “ControlNet” on it. Pretty straight forward thing. And the good: About everything that can be done in the web frontend, is also available als API - allowing you, to write some client application or an automation mechanism to send the data to the API and getting the output back. Im using ControlNet for example to create character drafts, always in the same pose - then using control net to transfer the face (so it’s always the same), so i get the same character posing in the same way just with different hair, color, background etc. - reducing the randomness factor.

Try it out and if you run into issues, feel free to send me a direct message, will try to help with pleasure