How to convert DF11 files into a single file for use within ComfyUI?

[jaxiez]

Hi,

I have used a script to convert these files (i.e. Wan2.2-T2V-A14B-DF11) into a single safetensors file in an attempt to use with the DFloat11 node in ComfyUI. However, there is an error "DFloat11ModelLoader'NoneType' object has no attribute 'set_inference_dtype'! when runningComfyUI.

Pleas help. How do I go about using these DF11 files in ComfyUI?

Thanks.
Jack.

My Script for shell command:

E:\ComfyUI_windows_portable\python_embeded\python.exe -c "import os,glob,json; from safetensors import safe_open; from safetensors.torch import save_file; p=r'D:\dfloat11-files\Wan2.2-T2V-A14B-DF11'; out='Wan2.2-T2V-A14B-DF11.safetensors'; os.chdir(p); idx=glob.glob('.safetensors.index.json'); files=sorted({s for s in (json.load(open(idx[0],'r',encoding='utf-8'))['weight_map'].values())}) if idx else sorted(glob.glob('.safetensors')); t={}; [ (lambda sf: [t.setdefault(k, sf.get_tensor(k)) for k in sf.keys()]) (safe_open(f, framework='pt', device='cpu')) for f in files if f!=out ]; save_file(t,out); print('Wrote:', os.path.join(p,out))"

[mingyi456]

It says on the README page that only Flux models are supported. And technically, only Flux.1-dev based models work out of the box, because schnell-based models are recognized differently by ComfyUI (although the patching required is rather trivial).
Also, DF11 models must be compressed separately to work with both diffusers and ComfyUI, which is why the original developer uploaded 2 separate DF11 versions of Flux.1-Krea-dev, one for diffusers and one for ComfyUI. For some technical details regarding this incompatibility, check out this discussion here.

Basically, you cannot simply merge all the safetensors shards that were made for diffusers and expect them to work in ComfyUI, and also, the code in the DF11 custom node must provide explicit support for the specific model type.

Pleas help. How do I go about using these DF11 files in ComfyUI?

I initially tried supporting Wan on my fork of the DF11 custom node, but I decided to temporarily shelve them. If you are interested, I can give it another go, but it will take some time.

[jaxiez]

Thank you. I'd love to, as I am trying to get more fellows use the dfloat11 node in comfyui. Love to have all heavy models being compressed, esp Flux2, wan2.2. If you can, kindly help.
Thanks for the great work.

Looking forward with excitement./Jack.

[mingyi456]

Ok, I can try to get Wan working on my custom node, but it will take some time. Regarding Flux.2, it is too large for me to work with using my current hardware setup, so it will not be planned for the foreseeable future due to the insane hardware prices recently.

[jaxiez]

Thank you very much. Wan2.1 is OK. If you get Wan2.2, would be best. Thank you once again. Also, I am using your extended node pack (forked) as well. I love hem.