You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We've encountered a problem with the sum-transformers module when processing inputs that exceed the maximum token limit. Currently, the module is expected to throw an error and continue functioning normally for subsequent requests when faced with large inputs. However, we're observing that the entire module shuts down under these circumstances. This issue seems to be specific to GPU environments.
The text was updated successfully, but these errors were encountered:
sum-transformers
module when processing inputs that exceed the maximum token limit. Currently, the module is expected to throw an error and continue functioning normally for subsequent requests when faced with large inputs. However, we're observing that the entire module shuts down under these circumstances. This issue seems to be specific to GPU environments.The text was updated successfully, but these errors were encountered: