Flux Tools For Low VRAM GPU's | Introduction to Inpainting & Outpainting

Flux Tools For Low VRAM GPU's | Introduction to Inpainting & Outpainting

Monzon Media

54 года назад

1,769 Просмотров

Flux Tools For Low VRAM GPU's Introduction to Inpainting & Outpainting in ComfyUI. There is also support for SwarmUI and SDNext. In my opinion this is a better inpaint and outpaint model than the Alimama one released not too long ago but a bigger file size but even at 11GB FP8 I can run it fine on my 3060Ti 8GB VRAM GPU. This is an intro to inpainting & Outpainting with Flux but I'll be covering more in future videos in regards to the new controlnet and IP Adapter (Redux).

Black Forest Labs Announcement https://blackforestlabs.ai/flux-1-tools/
Flux Fill FP8 Model https://civitai.com/models/969431/flux-fill-fp8
All Flux Tools models can be found here https://huggingface.co/black-forest-labs
ComfyUI Workflows https://comfyanonymous.github.io/ComfyUI_examples/flux
Workflows used in the video
Inpaint: https://drive.google.com/file/d/1Qr-PkUHxOCUI6CD4nBB2c615I2O2D6OQ/view?usp=sharing
Outpaint: https://drive.google.com/file/d/1p40sP_oSrnaWxGTYPnmL196SQ7n1ZxTv/view?usp=sharing

⏲Time Stamps
0:00 Flux tools overview
0:30 Where to get the Flux Tools models?
1:18 ComfyUI example workflows
2:05 Inpaint workflow overview
5:10 Inpaint examples
5:49 Outpaint workflow overview
7:09 Outpaint examples
8:32 What do you want to see next?

**Disclaimer Affiliate Links Below**

📸 Gear I use
Sony A7C CAN https://amzn.to/3spWX8C
Sony 35mm 1.8 CAN https://amzn.to/36Apekr
Meld Studio (FREE) https://www.meldstudio.co/
Editor Davinci Resolve https://www.blackmagicdesign.com/ca/products/davinciresolve/
Audio: Rode Podmic https://amzn.to/35sSnxv

🔦 Find us on:
Discord: https://discord.gg/Z6GEsyxd4V
Instagram: https://www.instagram.com/monzonmedia/
Facebook: https://www.facebook.com/MonzonMedia

Тэги:

#flux_tools #flux #flux_inpainting #flux_outpainting #black_forest_labs #flux_dev #comfyui #comfyui_inpainting #comfyui_outpainting #flux_ai #low_vram #flux_local #ai_news #comfyui_setup
Ссылки и html тэги не поддерживаются


Комментарии:

@bause6182
@bause6182 - 22.11.2024 10:49

Thanks for the guide , it is possible to run redux with low vram ?

Ответить
@havemoney
@havemoney - 22.11.2024 10:56

We are waiting for lllyasviel to attach it to Forge

Ответить
@contrarian8870
@contrarian8870 - 22.11.2024 10:57

Thanks. Do the Redux next, then Depth, then Canny

Ответить
@havemoney
@havemoney - 22.11.2024 11:22

I'll go play Project Zomboid, I recommend it

Ответить
@ProvenFlawless
@ProvenFlawless - 22.11.2024 12:18

Huh. What is the difference between xlabs and Shakker-Labs controlnets of canny/depth. Why is this special? We already have two of them. Someone please explain.

Ответить
@vVinchi
@vVinchi - 22.11.2024 13:42

This will be a good series of videos

Ответить
@RikkTheGaijin
@RikkTheGaijin - 22.11.2024 14:24

SwarmUI tutorial please

Ответить
@FranktheSquirell
@FranktheSquirell - 22.11.2024 15:44

ya did it again , great job as usual 😊😊
only trouble is i've been using foocus for in/out painting and now you've made me want to try it in comfyui grrrrr lol
I gave up on comfy cause the update broke the LLM generator i was using in it , come to mention it i cant even remember the name of the generator now .. damn🤣🤣🤣🤣

Ответить
@onurerdagli
@onurerdagli - 22.11.2024 15:46

Thank you, I just tried outpaint and inpaint truly amazing quality

Ответить
@AimanFatani
@AimanFatani - 22.11.2024 16:37

Been waiting for such things .. thanks for sharing ❤❤

Ответить
@Maylin-ze6qx
@Maylin-ze6qx - 22.11.2024 18:26

❤❤❤❤

Ответить
@RiftWarth
@RiftWarth - 22.11.2024 19:29

Could you please do a video on crop and stitch with Flux tool inpainting?

Ответить
@cekuhnen
@cekuhnen - 22.11.2024 19:37

Redux will be fun for MJ to deal with.

Ответить
@LucaSerafiniLukeZerfini
@LucaSerafiniLukeZerfini - 22.11.2024 20:08

Great to follow. Updated Comfy but returning this:
RuntimeError: Error(s) in loading state_dict for Flux:
size mismatch for img_in.weight: copying a param with shape torch.Size([3072, 384]) from checkpoint, the shape in current model is torch.Size([3072, 64]).

by the way, depth and canny would be the best to see

Ответить
@Maylin-ze6qx
@Maylin-ze6qx - 22.11.2024 20:20

Hello, my dear friend, please introduce my page so that it can be seen, thank you.❤❤❤

Ответить
@Elwaves2925
@Elwaves2925 - 22.11.2024 20:25

I finally got to do the inpainting I needed from Flux. On 12Gb VRAM with the full 'fill' model it was a lot quicker than I expected. That's the only one I've tried so far but with how well it worked I'm looking forward to the others.

Ответить
@LucaSerafiniLukeZerfini
@LucaSerafiniLukeZerfini - 22.11.2024 22:09

Can't wait. I found flux less effective in design rather than SDXL.

Ответить
@ApexArtistX
@ApexArtistX - 22.11.2024 22:27

You have 8vram ? I have 8vram and it crash on all non gguf models . How are you able to load 11 gb model on 8 vram 😮

Ответить
@baheth3elmy16
@baheth3elmy16 - 22.11.2024 23:01

Thank you for sharing, always good to see your videos! I was let down earlier this morning when ComfyUI announced zero day support for Flux tools and saw the models were 23GB in size. I'll give it a test now and see how they go.. Thanks again, and looking forward to your next fun video on Redux with ContolNet.

Ответить
@rogersnelson7483
@rogersnelson7483 - 22.11.2024 23:38

Good video. Anyone else getting really bad quality outputs for Outpainting.
Even the original non Outpaint area looks bad.
I am using FluxFillPP8_v10 safetensor model from the description.
Also should it take 6 minutes for 1 image(768x1344) using 8Gig V Ram.

Ответить
@SouthbayJay_com
@SouthbayJay_com - 23.11.2024 01:16

These are so cool! Can't wait to dive into these! Thanks for sharing the info! 🙌🙌

Ответить
@baheth3elmy16
@baheth3elmy16 - 23.11.2024 02:02

With inpainting, it disturbs the composition of the image, the results are not that good, so are the results for the outpainting, the final images are distorted at the edges and lost details, using the fp8 model.

Ответить
- 23.11.2024 10:20

Thanks for the vid! And do you know if the flux.1-fill-dev (23Gb) version is an extended version of the original flux.1-dev? or a whole new thing, and you have to install both?

Ответить
@MonzonMedia
@MonzonMedia - 22.11.2024 10:15

By the way, there is Flux Tools support for SwamUI and SDNext. Fingers crossed that Forge adds this when the updates get done soon!

Ответить