Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
chengzeyi committed Jan 12, 2025
1 parent 62c1f5d commit 9e65f7b
Show file tree
Hide file tree
Showing 3 changed files with 12 additions and 2 deletions.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,9 +79,12 @@ One of the advantages of this node over the original `TorchCompileModel` node is
It is suggested to pass `--gpu-only` when launching your `ComfyUI` if you are using this node, for example, if you are using `comfy-cli`:

```bash
comfy launch -- --gpu-only --force-channels-last
comfy launch -- --gpu-only
```

If you encounter any problems with frequent compilation after changing the resolution or text prompt, you could try enabling the `dynamic` option of the `Compile Model+` node.
Or you could launch your `ComfyUI` with environment variable `TORCH_LOGS=recompiles_verbose` to debug the reason for recompilation.

**NOTE**: `torch.compile` might not be able to work with model offloading well, you could try passing `--gpu-only` when launching your `ComfyUI` to disable model offloading.

**NOTE**: `torch.compile` does not work on Windows offcially, you should not use this node if you are facing this problem, or search on Google to find out how to make it work.
Expand Down
7 changes: 7 additions & 0 deletions misc_nodes.py
Original file line number Diff line number Diff line change
Expand Up @@ -118,6 +118,13 @@ def patch(
mode = mode if mode else None
options = json.loads(options) if options else None

if compiler == "torch.compile" and backend == "inductor" and dynamic:
# TODO: Fix this
# File "pytorch/torch/_inductor/fx_passes/post_grad.py", line 643, in same_meta
# and statically_known_true(sym_eq(val1.size(), val2.size()))
# AttributeError: 'SymInt' object has no attribute 'size'
pass

if is_patcher:
patcher = model.clone()
else:
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
[project]
name = "wavespeed"
description = "The all in one inference optimization solution for ComfyUI, universal, flexible, and fast."
version = "1.0.23"
version = "1.0.24"
license = {file = "LICENSE"}

[project.urls]
Expand Down

0 comments on commit 9e65f7b

Please sign in to comment.