Assertion failed

[catalwaysright]

I met this ../aten/src/ATen/native/cuda/Indexing.cu:1292: indexSelectLargeIndex: block: [10,0,0], thread: [31,0,0] Assertion srcIndex < srcSelectDimSize failed when trying out other 13b llama models. Any clue?

[BillYao-6]

I have the same problems,didyou solve it ?

[SeanLee97]

Could you provide more details? It is hard to locate the problem without enough context.

Which backbone do you use? If the backbone is not LLaMA, it is better to specify the target_modules for Lora config explicitly.