Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

inpaint_global_harmonious preprocessor #75

Open
axelblaze88 opened this issue Aug 14, 2024 · 3 comments
Open

inpaint_global_harmonious preprocessor #75

axelblaze88 opened this issue Aug 14, 2024 · 3 comments

Comments

@axelblaze88
Copy link

axelblaze88 commented Aug 14, 2024

Do these nodes include any preprocessor like inpaint_global_harmonious from automatic1111?

inpaint-global-harmonious-wmd

That feature works wonders for image restoration and I need to switch to ComfyUI for more flexibility

@valery016
Copy link

It is indeed a very special preprocessor that can be used for a number of purposes beyond image restoration (where SILVI2 is the most brilliant example). I use it for my current artistic project as the only suitable method of the kind, will try to demonstrate that with examples on the main discussion page. According to my brief research, there is no node for, or any other code implementation of inpaint_global_harmonious preprocessor in Comfy, and SwarmUI doesn't support it either (the developer doesn't even know what it is). Still, I would love to have support for inpaint_global_harmonious in Krita Ai plugin too, if possible.

@axelblaze88
Copy link
Author

Yes, that's exactly what I was trying to do, implement SILVI in Comfy. Wanna add some intermediate processes to the workflow that'd be impossible with AUTO1111's rigidity. A real shame they don’t implement it in Comfy, honestly :(

@valery016
Copy link

valery016 commented Sep 2, 2024

I am getting very good results with Hyper-SDXL-8steps-CFG-lora in Forge / SDXL, equivalent or actually better than those with SILIVI. So hang on, I intend to publish results here and on reddit SD sub, also on CivitAI (obviously).

In the meantime, here is what I designed for Krita in this regard. Feel free to play with it, see if you can reproduce it and/or perhaps improve it even further.

{
"name": "HyperScale (XL)",
"version": 1,
"sd_version": "auto",
"sd_checkpoint": "RealVisXL_V4.0.safetensors",
"loras": [
{
"name": "Hyper-SDXL-8steps-CFG-lora.safetensors",
"strength": 0.85
}
],
"style_prompt": "best quality, highres",
"negative_prompt": "bad quality, low resolution, blurry",
"vae": "Checkpoint Default",
"clip_skip": 1,
"v_prediction_zsnr": false,
"self_attention_guidance": false,
"preferred_resolution": 0,
"sampler": "Alternative - Euler A",
"sampler_steps": 8,
"cfg_scale": 2.0,
"live_sampler": "Realtime - Hyper",
"live_sampler_steps": 8,
"live_cfg_scale": 3.5
}

Before generating (Strength 100% (!)), create Unblur control layer with the settings as in the screenshot below.
Also, since the method adds significant red color cast to the output, use the Luminosity blending mode for the generated layer to get rid of it.

Krita screenshot

Here's my best result with Krita for the SILVI test image:

UPSCALED Krita RealVisXLv4 HyperScale CNet tile 0 76-10 1x 4xFFHQDAT 2x 16s colorfixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants