My entire Comfy UI is broken since I updated to 0.17. Nothing works

[IntellectzProductions]

Custom Node Testing

• I have tried disabling custom nodes and the issue persists (see how to disable custom nodes if you need help)

Your question

This is very frustrating. I have a ton of work to get done and now gguff is broken so I can't even use LTX 2.3. I try to use other workflows that don't use gguff like Z-image.. doesn't work because nodes have been made incompatible. I want to get back to 16.4 until you guys fix all these issues.

Logs

Other

No response

[IntellectzProductions]

Ok, I found the issue with what is going on. There are a couple things that I needed to do.
First: I deleted Comfy-gguf node set (it does not like gemma right now)
and kept the gguf node set. I altered pig.py:

Here’s the change list in order.

Added meta-tensor detection helpers:

def _module_has_meta_tensors(self, module): ...
def _model_has_meta_tensors(self): ...

Patched unpatch_model() so it skips the parent device move when the model still has meta tensors.

Patched load() so it scans modules before super().load(...) and moves meta-backed modules with to_empty(device=device_to).

Added a retry path in load() so if the same meta-tensor error happens once, it does another to_empty() sweep and retries.

Patched the mmap release section in load() so it skips:

m.to(self.load_device).to(self.offload_device)

for modules that still contain meta tensors.

Then I uninstalled Sageattention
Then I uninstalled Triton(and all folders left behind)

Restarted Comfy and now LTX 2.3 is working with gguf models and nodes and my sound issue is fixed. I am also sure everything else will work now as well.

[rattus128]

I recently added meta-tensors for the sake of GGUF logic introspecting geometry before SD load without needing to allocate an overridden empty but it sounds like there are corners.

Can I confirm you are on the latest git master?

Can I get the crash backtrace and a model link that reproduces?

Thanks for the detailed debug, we can fix this in the core before the next release rather than downstream. We can just promote the meta-tensors to empties straight up on the state dict load if they don't exist but usually these weights are giants.

[IntellectzProductions]

I recently added meta-tensors for the sake of GGUF logic introspecting geometry before SD load without needing to allocate an overridden empty but it sounds like there are corners.

Can I confirm you are on the latest git master?

Can I get the crash backtrace and a model link that reproduces?

Thanks for the detailed debug, we can fix this in the core before the next release rather than downstream. We can just promote the meta-tensors to empties straight up on the state dict load if they don't exist but usually these weights are giants.

Yes I am on the master currently

I traced it through here

NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.

It was affecting the pig.py inside gguf node folder. At the same time the comfy-gguf nodes wasn't working. So, I asked ChatGPT if it agreed with me that something was going on with gguf and this error and then the sage attention was realized. So, it was two things going on and I though it was one.

At first, I thought it was just a LTX 2.3 issue but then I tried a z-image WF which I don't use gguf at all and still was getting the error so that is where I confirmed it was sage attention. Below is the error I got after I thought I had fixed my issue with pig.py:

oad device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16 Requested to load LTXAVTEModel_ GGUF: skipping unpatch_model device move because model still contains meta tensors GGUF: moved 1 meta-backed modules to_empty on cuda:0 before load loaded completely; 12420.00 MB usable, 11168.21 MB loaded, full load: True FETCH ComfyRegistry Data: 125/130 FETCH ComfyRegistry Data: 130/130 FETCH ComfyRegistry Data [DONE] [ComfyUI-Manager] default cache updated: https://api.comfy.org/nodes FETCH DATA from: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json [DONE] [ComfyUI-Manager] All startup tasks have been completed. gguf qtypes: F32 (2672), BF16 (28), Q4_K (1544), Q5_K (200) model weight dtype torch.bfloat16, manual cast: None model_type FLUX lora key not loaded: diffusion_model.audio_caption_projection.linear_1.alpha lora key not loaded: diffusion_model.audio_caption_projection.linear_1.lora_A.weight lora key not loaded: diffusion_model.audio_caption_projection.linear_1.lora_B.weight lora key not loaded: diffusion_model.audio_caption_projection.linear_2.alpha lora key not loaded: diffusion_model.audio_caption_projection.linear_2.lora_A.weight lora key not loaded: diffusion_model.audio_caption_projection.linear_2.lora_B.weight lora key not loaded: diffusion_model.caption_projection.linear_1.alpha lora key not loaded: diffusion_model.caption_projection.linear_1.lora_A.weight lora key not loaded: diffusion_model.caption_projection.linear_1.lora_B.weight lora key not loaded: diffusion_model.caption_projection.linear_2.alpha lora key not loaded: diffusion_model.caption_projection.linear_2.lora_A.weight lora key not loaded: diffusion_model.caption_projection.linear_2.lora_B.weight VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16 Requested to load VideoVAE Model VideoVAE prepared for dynamic VRAM loading. 1384MB Staged. 0 patches attached. Warning: TAESD previews enabled, but could not find models/vae_approx/None Requested to load LTXAV loaded partially; 12226.19 MB usable, 12214.91 MB loaded, 565.09 MB offloaded, 11.27 MB buffer reserved, lowvram patches: 0 Attempting to release mmap (1151) Fatal Python error: Aborted Thread 0x00003cf8 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x000009c8 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00004840 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x000012f4 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x0000200c (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00003768 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x000066c4 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x0000230c (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00002120 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00000be4 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00004d68 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x000018d8 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00004448 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00001900 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x0000269c (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00005564 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00001758 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00000a44 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00004fbc (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00004888 (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\concurrent\futures\thread.py", line 89 in _worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Current thread 0x0000579c (most recent call first): File "D:\ComfyUI\venv\Lib\site-packages\sageattention\core.py", line 149 in sageattn File "D:\ComfyUI\comfy\ldm\modules\attention.py", line 553 in attention_sage File "D:\ComfyUI\comfy\ldm\modules\attention.py", line 137 in wrapper File "D:\ComfyUI\comfy\ldm\lightricks\model.py", line 414 in forward File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787 in _call_impl File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776 in _wrapped_call_impl File "D:\ComfyUI\comfy\ldm\lightricks\embeddings_connector.py", line 93 in forward File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787 in _call_impl File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776 in _wrapped_call_impl File "D:\ComfyUI\comfy\ldm\lightricks\embeddings_connector.py", line 297 in forward File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787 in _call_impl File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776 in wrapped_call_impl File "D:\ComfyUI\comfy\ldm\lightricks\av_model.py", line 578 in preprocess_text_embeds File "D:\ComfyUI\comfy\model_base.py", line 1024 in extra_conds File "D:\ComfyUI\comfy\samplers.py", line 704 in encode_model_conds File "D:\ComfyUI\comfy\samplers.py", line 794 in process_conds File "D:\ComfyUI\comfy\samplers.py", line 970 in inner_sample File "D:\ComfyUI\comfy\samplers.py", line 995 in outer_sample File "D:\ComfyUI\comfy\patcher_extension.py", line 112 in execute File "D:\ComfyUI\comfy\samplers.py", line 1051 in sample File "D:\ComfyUI\comfy_extras\nodes_custom_sampler.py", line 963 in execute File "D:\ComfyUI\comfy_api\latest_io.py", line 1764 in EXECUTE_NORMALIZED File "D:\ComfyUI\comfy_api\internal_init.py", line 149 in wrapped_func File "D:\ComfyUI\execution.py", line 296 in process_inputs File "D:\ComfyUI\execution.py", line 308 in _async_map_node_over_list File "D:\ComfyUI\execution.py", line 334 in get_output_data File "D:\ComfyUI\execution.py", line 525 in execute File "D:\ComfyUI\execution.py", line 758 in execute_async File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\events.py", line 84 in _run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 1951 in run_once File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 618 in run_forever File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\windows_events.py", line 321 in run_forever File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 651 in run_until_complete File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\runners.py", line 118 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\runners.py", line 194 in run File "D:\ComfyUI\execution.py", line 702 in execute File "D:\ComfyUI\custom_nodes\comfyui_image_metadata_extension\modules_init.py", line 12 in run File "D:\ComfyUI\main.py", line 276 in prompt_worker File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x00001f3c (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\windows_events.py", line 769 in _poll File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\windows_events.py", line 444 in select File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 1913 in _run_once File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 618 in run_forever File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\windows_events.py", line 321 in run_forever File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 651 in run_until_complete File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\runners.py", line 118 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\runners.py", line 194 in run File "D:\ComfyUI\custom_nodes\ComfyUI-Crystools\general\monitor.py", line 31 in startMonitorLoop File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 989 in run File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1052 in _bootstrap_inner File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\threading.py", line 1009 in _bootstrap Thread 0x0000418c (most recent call first): File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\windows_events.py", line 769 in _poll File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\windows_events.py", line 444 in select File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 1913 in _run_once File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 618 in run_forever File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\windows_events.py", line 321 in run_forever File "C:\Users\GGINTELLECTZ\AppData\Local\Programs\Python\Python312\Lib\asyncio\base_events.py", line 651 in run_until_complete File "D:\ComfyUI\main.py", line 478 in Extension modules: yaml._yaml, PIL._imaging, sqlalchemy.cyextension.collections, sqlalchemy.cyextension.immutabledict, sqlalchemy.cyextension.processors, sqlalchemy.cyextension.resultproxy, _wmi, sqlalchemy.cyextension.util, greenlet._greenlet, markupsafe._speedups, multidict._multidict, yarl._quoting_c, propcache._helpers_c, _brotli, aiohttp._http_writer, aiohttp._http_parser, aiohttp._websocket.mask, aiohttp._websocket.reader_c, frozenlist._frozenlist, charset_normalizer.md, tomli._types, tomli._re, tomli._parser, tomli, numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._dynamo.autograd_compiler, torch._C._dynamo.eval_frame, torch._C._dynamo.guards, torch._C._dynamo.utils, torch._C._fft, torch._C._linalg, torch._C._nested, torch._C._nn, torch._C._sparse, torch._C._special, psutil._psutil_windows, cython.cimports.libc.math, scipy._lib._ccallback_c, scipy.linalg._fblas, scipy.linalg._flapack, scipy.linalg.cython_lapack, scipy.linalg._cythonized_array_utils, scipy.linalg._solve_toeplitz, scipy.linalg._decomp_lu_cython, scipy.linalg._matfuncs_sqrtm_triu, scipy.linalg._matfuncs_expm, scipy.linalg._linalg_pythran, scipy.linalg.cython_blas, scipy.linalg._decomp_update, scipy.sparse._sparsetools, _csparsetools, scipy.sparse._csparsetools, scipy.sparse.linalg._dsolve._superlu, scipy.sparse.linalg._eigen.arpack._arpack, scipy.sparse.linalg._propack._spropack, scipy.sparse.linalg._propack._dpropack, scipy.sparse.linalg._propack._cpropack, scipy.sparse.linalg._propack._zpropack, scipy.sparse.csgraph._tools, scipy.sparse.csgraph._shortest_path, scipy.sparse.csgraph._traversal, scipy.sparse.csgraph._min_spanning_tree, scipy.sparse.csgraph._flow, scipy.sparse.csgraph._matching, scipy.sparse.csgraph._reordering, scipy.optimize._group_columns, scipy._lib.messagestream, scipy.optimize._trlib._trlib, scipy.optimize._lbfgsb, _moduleTNC, scipy.optimize._moduleTNC, scipy.optimize._cobyla, scipy.optimize._slsqp, scipy.optimize._minpack, scipy.optimize._lsq.givens_elimination, scipy.optimize._zeros, scipy.optimize._cython_nnls, scipy._lib._uarray._uarray, scipy.special._ufuncs_cxx, scipy.special._ufuncs, scipy.special._specfun, scipy.special._comb, scipy.special._ellip_harm_2, scipy.linalg._decomp_interpolative, scipy.optimize._bglu_dense, scipy.optimize._lsap, scipy.spatial._ckdtree, scipy.spatial._qhull, scipy.spatial._voronoi, scipy.spatial._distance_wrap, scipy.spatial._hausdorff, scipy.spatial.transform._rotation, scipy.optimize._direct, PIL._imagingft, av._core, av.logging, av.bytesource, av.buffer, av.audio.format, av.error, av.dictionary, av.container.pyio, av.utils, av.option, av.descriptor, av.format, av.stream, av.container.streams, av.sidedata.motionvectors, av.sidedata.sidedata, av.opaque, av.packet, av.container.input, av.container.output, av.container.core, av.codec.context, av.video.format, av.video.reformatter, av.plane, av.video.plane, av.video.frame, av.video.stream, av.codec.hwaccel, av.codec.codec, av.frame, av.audio.layout, av.audio.plane, av.audio.frame, av.audio.stream, av.filter.link, av.filter.context, av.filter.graph, av.filter.filter, av.filter.loudnorm, av.audio.resampler, av.audio.codeccontext, av.audio.fifo, av.bitstream, av.video.codeccontext, scipy.ndimage._nd_image, scipy.ndimage._rank_filter_1d, _ni_label, scipy.ndimage._ni_label, regex._regex, scipy.integrate._odepack, scipy.integrate._quadpack, scipy.integrate._vode, scipy.integrate._dop, scipy.integrate._lsoda, scipy.interpolate._fitpack, scipy.interpolate._dfitpack, scipy.interpolate._dierckx, scipy.interpolate._ppoly, scipy.interpolate._interpnd, scipy.interpolate._rbfinterp_pythran, scipy.interpolate._rgi_cython, scipy.interpolate._bspl, scipy.special.cython_special, scipy.stats._stats, scipy.stats._sobol, scipy.stats._qmc_cy, scipy.stats._biasedurn, scipy.stats._stats_pythran, scipy.stats._levy_stable.levyst, scipy.stats._ansari_swilk_statistics, scipy.stats._mvn, scipy.stats._rcont.rcont, av.subtitles.stream, _cffi_backend, google._upb._message, skimage._shared.geometry, xxhash._xxhash, skimage.measure._ccomp, insightface.thirdparty.face3d.mesh.cython.mesh_core_cython, kiwisolver._cext, scipy.io.matlab._mio_utils, scipy.io.matlab._streams, scipy.io.matlab._mio5_utils, sklearn.__check_build._check_build, pyarrow.lib, pandas._libs.tslibs.ccalendar, pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.dtypes, pandas._libs.tslibs.base, pandas._libs.tslibs.nattype, pandas._libs.tslibs.timezones, pandas._libs.tslibs.fields, pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.tzconversion, pandas._libs.tslibs.timestamps, pandas._libs.properties, pandas._libs.tslibs.offsets, pandas._libs.tslibs.strptime, pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion, pandas._libs.tslibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos, pandas._libs.interval, pandas._libs.lib, pyarrow._compute, pandas._libs.ops, numexpr.interpreter, pandas._libs.hashing, pandas._libs.arrays, pandas._libs.tslib, pandas._libs.sparse, pandas._libs.internals, pandas._libs.indexing, pandas._libs.index, pandas._libs.writers, pandas._libs.join, pandas._libs.window.aggregations, pandas._libs.window.indexers, pandas._libs.reshape, pandas._libs.groupby, pandas._libs.json, pandas._libs.parsers, pandas._libs.testing, sklearn.utils._isfinite, sklearn.utils.sparsefuncs_fast, sklearn.utils.murmurhash, sklearn.utils._openmp_helpers, sklearn.metrics.cluster._expected_mutual_info_fast, sklearn.preprocessing._csr_polynomial_expansion, sklearn.preprocessing._target_encoder_fast, sklearn.metrics._dist_metrics, sklearn.metrics._pairwise_distances_reduction._datasets_pair, sklearn.utils._cython_blas, sklearn.metrics._pairwise_distances_reduction._base, sklearn.metrics._pairwise_distances_reduction._middle_term_computer, sklearn.utils._heap, sklearn.utils._sorting, sklearn.metrics._pairwise_distances_reduction._argkmin, sklearn.metrics._pairwise_distances_reduction._argkmin_classmode, sklearn.utils._vector_sentinel, sklearn.metrics._pairwise_distances_reduction._radius_neighbors, sklearn.metrics._pairwise_distances_reduction._radius_neighbors_classmode, sklearn.metrics._pairwise_fast, sklearn.utils._fast_dict, sklearn.cluster._hierarchical_fast, sklearn.cluster._k_means_common, sklearn.cluster._k_means_elkan, sklearn.cluster._k_means_lloyd, sklearn.cluster._k_means_minibatch, sklearn.neighbors._partition_nodes, sklearn.neighbors._ball_tree, sklearn.neighbors._kd_tree, sklearn.utils.arrayfuncs, sklearn.utils._random, sklearn.utils._seq_dataset, sklearn.linear_model._cd_fast, _loss, sklearn._loss._loss, sklearn.svm._liblinear, sklearn.svm._libsvm, sklearn.svm._libsvm_sparse, sklearn.linear_model._sag_fast, sklearn.utils._weight_vector, sklearn.linear_model._sgd_fast, sklearn.decomposition._online_lda_fast, sklearn.decomposition._cdnmf_fast, sklearn.cluster._dbscan_inner, sklearn.cluster._hdbscan._tree, sklearn.cluster._hdbscan._linkage, sklearn.cluster._hdbscan._reachability, sklearn._isotonic, sklearn.tree._utils, sklearn.tree._tree, sklearn.tree._partitioner, sklearn.tree._splitter, sklearn.tree._criterion, sklearn.neighbors._quad_tree, sklearn.manifold._barnes_hut_tsne, sklearn.manifold._utils, h5py._errors, h5py.defs, h5py._objects, h5py.h5, h5py.utils, h5py.h5t, h5py.h5s, h5py.h5ac, h5py.h5p, h5py.h5r, h5py._proxy, h5py._conv, h5py.h5z, h5py.h5a, h5py.h5d, h5py.h5ds, h5py.h5g, h5py.h5i, h5py.h5o, h5py.h5f, h5py.h5fd, h5py.h5pl, h5py.h5l, h5py._selector, jaxlib.cpu_feature_guard, cv2_enumerate_cameras._windows_backend, sentencepiece._sentencepiece, pyzstd._c._zstd, cuda_utils, PIL._imagingcms, tornado.speedups, websockets.speedups, _win32sysloader, win32api, Cython.Utils, Cython.Plex.Actions, Cython.Plex.Transitions, Cython.Plex.Machines, Cython.Plex.DFA, Cython.Plex.Scanners, Cython.Compiler.Scanning, Cython.StringIOTree, Cython.Compiler.Code, scipy.signal._sigtools, scipy.signal._max_len_seq_inner, scipy.signal._upfirdn_apply, scipy.signal._spline, scipy.signal._sosfilt, scipy.signal._peak_finding_utils, skimage.measure._moments_cy, skimage.measure._find_contours_cy, skimage.measure._marching_cubes_lewiner_cy, lxml._elementpath, lxml.etree, grpc._cython.cygrpc, pymupdf._extra, pymupdf._mupdf, skimage.transform._warps_cy, numba.core.typeconv._typeconv, numba._helperlib, numba._dynfunc, numba._dispatcher, numba.core.runtime._nrt_python, numba.np.ufunc._internal, numba.experimental.jitclass._box, win32file, pycocotools._mask, PIL._imagingmath, msgpack._cmsgpack, __triton_launcher (total: 361)

[m8rr]

city96/ComfyUI-GGUF#427 (comment)

@rattus128 I’m not sure if you’ve had a chance to see this yet, but I’d appreciate it if you could take a look.

[rattus128]

city96/ComfyUI-GGUF#427 (comment)

@rattus128 I’m not sure if you’ve had a chance to see this yet, but I’d appreciate it if you could take a look.

No that's quite different. I'll hopefully get back around to dynamic GGUF soon!

[Jbla0712]

Me too, downgrade .

17.1 & 17.2 are full bugued.
Take 17..0 on Uptodown website
Isn't Nodes, Isn't craped Python

Tomorrow 17.3 for sur..
Juste waiting some week when it's like this before upgrade.
GL Guys

[vedam]

I have to admit, even though I really appreciate the fantastic work that ComfyUI has done, the 17.x update was the worst experience I’ve had so far. I’m neither a programmer nor a Comfy expert, and I painstakingly built up a few workflows that simply worked. After the update, for whatever reason, they no longer do. Subgraphs, whose properties could previously adjusted via “Shown on node” and “Hidden / nested parameters,” no longer respond to these settings. Group node boxes are suddenly placed completely out of position without their content. I don't even know where to start or stop listing problems like these.

I really hope, switching back to 16.4. will bring back the workflows I'm used to. And for future updates my only learning can be to wait until things have settled BEFORE installing. Unfortunately this prevent giving early feedbacks or reports.

Update: Downgrading to 16.4 still with broken Subgraph Properties (Show/Hide), showing up "Disconnected" in every single workflow on Subgraphs ... so no solution on that end 😭.

[GlamoramaAttack]

No that's quite different. I'll hopefully get back around to dynamic GGUF soon!

This error is similar, happens since Comfy version 0.17.1 when using a GGUF file for CLIP encoding, first the clip seems to be loaded, but then: "Cannot copy out of meta tensor; no data!"

gguf qtypes: F32 (289), Q6_K (49), Q4_K (288)
Attempting to recreate sentencepiece tokenizer from GGUF file metadata...
Created tokenizer with vocab size of 262208
(...)
CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
Requested to load LTXAVTEModel_
!!! Exception during processing !!! Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.
Traceback (most recent call last):
File "D:\ComfyUI\execution.py", line 525, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)

File "D:\ComfyUI\execution.py", line 334, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)

File "D:\ComfyUI\execution.py", line 308, in _async_map_node_over_list
await process_inputs(input_dict, i)
File "D:\ComfyUI\execution.py", line 296, in process_inputs
result = f(**inputs)
File "D:\ComfyUI\nodes.py", line 80, in encode
return (clip.encode_from_tokens_scheduled(tokens), )
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
File "D:\ComfyUI\comfy\sd.py", line 313, in encode_from_tokens_scheduled
pooled_dict = self.encode_from_tokens(tokens, return_pooled=return_pooled, return_dict=True)
File "D:\ComfyUI\comfy\sd.py", line 375, in encode_from_tokens
self.load_model(tokens)
~~~~~~~~~~~~~~~^^^^^^^^
File "D:\ComfyUI\comfy\sd.py", line 422, in load_model
model_management.load_models_gpu([self.patcher], memory_required=memory_used)
^
File "D:\ComfyUI\comfy\model_management.py", line 817, in load_models_gpu
loaded_model.model_load(lowvram_model_memory, force_patch_weights=force_patch_weights)
~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\comfy\model_management.py", line 580, in model_load
self.model_use_more_vram(use_more_vram, force_patch_weights=force_patch_weights)

File "D:\ComfyUI\comfy\model_management.py", line 610, in model_use_more_vram
return self.model.partially_load(self.device, extra_memory, force_patch_weights=force_patch_weights)

File "D:\ComfyUI\comfy\model_patcher.py", line 1064, in partially_load
self.detach()
~~~~~~~~~~~^^
File "D:\ComfyUI\comfy\model_patcher.py", line 1080, in detach
self.unpatch_model(self.offload_device, unpatch_weights=unpatch_all)
~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\custom_nodes\ComfyUI-GGUF\nodes.py", line 78, in unpatch_model
return super().unpatch_model(device_to=device_to, unpatch_weights=unpatch_weights)
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\comfy\model_patcher.py", line 941, in unpatch_model
self.model.to(device_to)
~~~~~~~~~~~~~^^^^^^^^^^^
(...)
[Previous line repeated 2 more times]
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 964, in _apply
param_applied = fn(param)
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1374, in convert
raise NotImplementedError(
...<2 lines>...
) from None
NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.

But I don't have the pig.py file as the other user, IntellectzProductions, who seems to use calcluis's gguf-nodes while I'm using city96's GGUF- nodes.

[rattus128]

No that's quite different. I'll hopefully get back around to dynamic GGUF soon!

This error is similar, happens since Comfy version 0.17.1 when using a GGUF file for CLIP encoding, first the clip seems to be loaded, but then: "Cannot copy out of meta tensor; no data!"

gguf qtypes: F32 (289), Q6_K (49), Q4_K (288)
Attempting to recreate sentencepiece tokenizer from GGUF file metadata...
Created tokenizer with vocab size of 262208
(...)
CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
Requested to load LTXAVTEModel_
!!! Exception during processing !!! Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.
Traceback (most recent call last):
File "D:\ComfyUI\execution.py", line 525, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
File "D:\ComfyUI\execution.py", line 334, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)
File "D:\ComfyUI\execution.py", line 308, in _async_map_node_over_list
await process_inputs(input_dict, i)
File "D:\ComfyUI\execution.py", line 296, in process_inputs
result = f(**inputs)
File "D:\ComfyUI\nodes.py", line 80, in encode
return (clip.encode_from_tokens_scheduled(tokens), )

File "D:\ComfyUI\comfy\sd.py", line 313, in encode_from_tokens_scheduled
pooled_dict = self.encode_from_tokens(tokens, return_pooled=return_pooled, return_dict=True)
File "D:\ComfyUI\comfy\sd.py", line 375, in encode_from_tokens
self.load_model(tokens)
~~~~~~~~~~~~~~~^^^^^^^^
File "D:\ComfyUI\comfy\sd.py", line 422, in load_model
model_management.load_models_gpu([self.patcher], memory_required=memory_used)
^
File "D:\ComfyUI\comfy\model_management.py", line 817, in load_models_gpu
loaded_model.model_load(lowvram_model_memory, force_patch_weights=force_patch_weights)
~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\comfy\model_management.py", line 580, in model_load
self.model_use_more_vram(use_more_vram, force_patch_weights=force_patch_weights)
File "D:\ComfyUI\comfy\model_management.py", line 610, in model_use_more_vram
return self.model.partially_load(self.device, extra_memory, force_patch_weights=force_patch_weights)
File "D:\ComfyUI\comfy\model_patcher.py", line 1064, in partially_load
self.detach()
~~~~~~~~~~~^^
File "D:\ComfyUI\comfy\model_patcher.py", line 1080, in detach
self.unpatch_model(self.offload_device, unpatch_weights=unpatch_all)
~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\custom_nodes\ComfyUI-GGUF\nodes.py", line 78, in unpatch_model
return super().unpatch_model(device_to=device_to, unpatch_weights=unpatch_weights)
~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\comfy\model_patcher.py", line 941, in unpatch_model
self.model.to(device_to)
~~~~~~~~~~~~~^^^^^^^^^^^
(...)
[Previous line repeated 2 more times]
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 964, in _apply
param_applied = fn(param)
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1374, in convert
raise NotImplementedError(
...<2 lines>...
) from None
NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.

But I don't have the pig.py file as the other user, IntellectzProductions, who seems to use calcluis's gguf-nodes while I'm using city96's GGUF- nod

Ive been trying to reproduce this for a while and a lot of GGUFs are working for me. I think its the GGUF that runs before that that matters. Can I get a HF link to the GGUF models you are using as I am crash free on LTX GGUF I tried myself. Need to isolate variables.

Theres a reasonable theory on how to fix this crash but I just need any complete reproducer and this bug will be gone.

[rattus128]

@IntellectzProductions @GlamoramaAttack please try:

#12967

For the "meta" crash.

[GlamoramaAttack]

For the "meta" crash.

The error message with that change is now called "AttributeError: 'NoneType' object has no attribute 'device'". The main difference to the log from 0.17.1 (but I'm now on 0.17.2) is that it doesn't cite any of the memory patches as a source for messages. And before that it reads "Requested to load SDXLClipModel" instead of "Requested to load LTXAVTEModel_" (as in 0.17.1).

!!! Exception during processing !!! 'NoneType' object has no attribute 'device'
Traceback (most recent call last):
File "D:\ComfyUI\execution.py", line 524, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)

File "D:\ComfyUI\execution.py", line 333, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)

File "D:\ComfyUI\execution.py", line 307, in _async_map_node_over_list
await process_inputs(input_dict, i)
File "D:\ComfyUI\execution.py", line 295, in process_inputs
result = f(**inputs)
File "D:\ComfyUI\nodes.py", line 80, in encode
return (clip.encode_from_tokens_scheduled(tokens), )
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^
File "D:\ComfyUI\comfy\sd.py", line 313, in encode_from_tokens_scheduled
pooled_dict = self.encode_from_tokens(tokens, return_pooled=return_pooled, return_dict=True)
File "D:\ComfyUI\comfy\sd.py", line 377, in encode_from_tokens
o = self.cond_stage_model.encode_token_weights(tokens)
File "D:\ComfyUI\comfy\sdxl_clip.py", line 59, in encode_token_weights
g_out, g_pooled = self.clip_g.encode_token_weights(token_weight_pairs_g)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\comfy\sd1_clip.py", line 45, in encode_token_weights
o = self.encode(to_encode)
File "D:\ComfyUI\comfy\sd1_clip.py", line 306, in encode
return self(tokens)
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\comfy\sd1_clip.py", line 279, in forward
outputs = self.transformer(None, attention_mask_model, embeds=embeds, num_tokens=num_tokens, intermediate_output=intermediate_output, final_layer_norm_intermediate=self.layer_norm_hidden_state, dtype=torch.float32, embeds_info=embeds_info)
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\comfy\clip_model.py", line 208, in forward
x = self.text_model(*args, **kwargs)
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\comfy\clip_model.py", line 181, in forward
x, i = self.encoder(x, mask=mask, intermediate_output=intermediate_output)
~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\comfy\clip_model.py", line 127, in forward
x = l(x, mask, optimized_attention)
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\comfy\clip_model.py", line 104, in forward
x += self.self_attn(self.layer_norm1(x), mask, optimized_attention)
~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\comfy\clip_model.py", line 70, in forward
q = self.q_proj(x)
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1776, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\venv\Lib\site-packages\torch\nn\modules\module.py", line 1787, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\comfy\ops.py", line 373, in forward
return self.forward_comfy_cast_weights(*args, **kwargs)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\custom_nodes\ComfyUI-GGUF\ops.py", line 217, in forward_comfy_cast_weights
out = super().forward_comfy_cast_weights(input, *args, **kwargs)
File "D:\ComfyUI\comfy\ops.py", line 365, in forward_comfy_cast_weights
weight, bias, offload_stream = cast_bias_weight(self, input, offloadable=True)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\comfy\ops.py", line 230, in cast_bias_weight
if offloadable and (device != s.weight.device or
^^^^^^^^^^^^^^^

[GlamoramaAttack]

I made a mistake: I forgot to switch the "type" in the CLIP loader and because of that - it still doesn't work - the error messages are different:

gguf qtypes: F32 (289), Q6_K (49), Q4_K (288)
Attempting to recreate sentencepiece tokenizer from GGUF file metadata...
Created tokenizer with vocab size of 262208
Dequantizing token_embd.weight to prevent runtime OOM.
clip missing: ['(...)']
CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
Requested to load LTXAVTEModel_
loaded partially; 4651.00 MB usable, 0.00 MB loaded, 12403.80 MB offloaded, 7252.06 MB buffer reserved, lowvram patches: 0
Attempting to release mmap (290)
loaded partially; 4625.88 MB usable, 0.00 MB loaded, 12403.80 MB offloaded, 7252.06 MB buffer reserved, lowvram patches: 0
VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
Found quantization metadata version 1
Detected mixed precision quantization
!!! Exception during processing !!! module 'comfy.model_management' has no attribute 'supports_mxfp8_compute'
Traceback (most recent call last):
File "D:\ComfyUI\execution.py", line 524, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)

File "D:\ComfyUI\execution.py", line 333, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, v3_data=v3_data)

File "D:\ComfyUI\execution.py", line 307, in _async_map_node_over_list
await process_inputs(input_dict, i)
File "D:\ComfyUI\execution.py", line 295, in process_inputs
result = f(**inputs)
File "D:\ComfyUI\custom_nodes\ComfyUI-KJNodes\nodes\model_optimization_nodes.py", line 297, in patch_and_load
model = comfy.sd.load_diffusion_model_state_dict(sd, model_options=model_options, metadata=metadata)
File "D:\ComfyUI\comfy\sd.py", line 1760, in load_diffusion_model_state_dict
model = model_config.get_model(new_sd, "")
File "D:\ComfyUI\comfy\supported_models.py", line 878, in get_model
out = model_base.LTXAV(self, device=device)
File "D:\ComfyUI\comfy\model_base.py", line 1012, in init
super().init(model_config, model_type, device=device, unet_model=comfy.ldm.lightricks.av_model.LTXAVModel) #TODO

File "D:\ComfyUI\comfy\model_base.py", line 144, in init
operations = comfy.ops.pick_operations(unet_config.get("dtype", None), self.manual_cast_dtype, fp8_optimizations=fp8, model_config=model_config)
File "D:\ComfyUI\comfy\ops.py", line 1035, in pick_operations
mxfp8_compute = comfy.model_management.supports_mxfp8_compute(load_device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: module 'comfy.model_management' has no attribute 'supports_mxfp8_compute'. Did you mean: 'supports_fp8_compute'?