OOM on 96GB H20 with FLUX.2-dev (BF16) - Is 96GB not enough?

#31
by jasonhuang21 - opened

First off, congrats on the FLUX.2 release. The performance and prompt adherence are truly next-level—it's a huge step forward for the community.

I'm currently trying to run the BF16 version on a single NVIDIA H20 (96GB VRAM) but met CUDA Out of Memory. Is 96GB VRAM officially insufficient for FLUX.2, or is there a specific peak memory spike during loading that I should optimize for? Any recommended settings to force it into a single 96GB card without OOM?
Here's how i load the FLUX.2-dev (BF16)

Thanks again for the incredible work.

Sign up or log in to comment