You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Sometimes, especially when generating or decoding long high resolution videos on CUDA or HIP backends, it crashes with this assert in ggml_cuda_cpy() kernel.
Out of frustration, I just commented out the asserts and somehow, it seems to run just fine.
Looking at the code, I don't immediately see what's the purpose of these asserts. So I'd say it might be safe to remove them if they're in your way.
Am I missing something? Should I just propose the change upstream?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Sometimes, especially when generating or decoding long high resolution videos on CUDA or HIP backends, it crashes with this assert in ggml_cuda_cpy() kernel.
Out of frustration, I just commented out the asserts and somehow, it seems to run just fine.
Looking at the code, I don't immediately see what's the purpose of these asserts. So I'd say it might be safe to remove them if they're in your way.
Am I missing something? Should I just propose the change upstream?
Beta Was this translation helpful? Give feedback.
All reactions