Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error running SamplerCustomAdvanced #74

Open
hellosky23 opened this issue Jan 14, 2025 · 6 comments
Open

Error running SamplerCustomAdvanced #74

hellosky23 opened this issue Jan 14, 2025 · 6 comments

Comments

@hellosky23
Copy link

torch._dynamo.exc.BackendCompilerFailed: backend='inductor' raised:
FileNotFoundError: [Errno 2] No such file or directory: 'C:\Users\sky\AppData\Local\Temp\torchinductor_sky\triton\0\3288a2b4da40f5f3c752f9095518ae8bdb19646496f5a71d8caa0ac25c85daa8\__grp__triton_red_fused__scaled_mm__to_copy_add_clamp_mul_native_layer_norm_ones_16.json.tmp.pid_9796_7d68d846-f74b-4e5a-a739-43ce1dc143c8'

Set TORCH_LOGS="+dynamo" and TORCHDYNAMO_VERBOSE=1 for more information

You can suppress this exception and fall back to eager by setting:
import torch._dynamo
torch._dynamo.config.suppress_errors = True

@tuneravent123
Copy link

same here ,

backend='inductor' raised:
RuntimeError: Cannot find a working triton installation. Either the package is not installed or it is too old. More information on installing Triton can be found at https://github.com/openai/triton

Set TORCH_LOGS="+dynamo" and TORCHDYNAMO_VERBOSE=1 for more information

You can suppress this exception and fall back to eager by setting:
import torch._dynamo
torch._dynamo.config.suppress_errors = True

@Pancat009
Copy link

same issue

@Pancat009
Copy link

if you're using Windows, delete the "Compile Model+" node also enable the acceleration, just need to remain the "Add first block cache" node

@dernuiJK
Copy link

But I only use Add first block cache and it doesn't have any effect

@alenknight
Copy link

But I only use Add first block cache and it doesn't have any effect

how many steps you running? make sure you hitting over 20 steps

@skystoler
Copy link

  1. For windows system, triton is not officially supported, you can refer to https://github.com/woct0rdho/triton-windows to install, make sure all the requirements are met, or it will be hard to handle environment issues.
  2. You may get 'cannot create a file when that file already exists' , it might be torch's issue, tmp_path.rename in inductor code cache on Windows pytorch/pytorch#138211 and torch.inductor error: Cannot create a file when that file already exists woct0rdho/triton-windows#10 might be helpful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants