You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
class InferenceAPI(Generator):
...
self.uri = self.URI + name
If I change name to config_root.plugins.model_name it works like before, but maybe not the correct fix? I'm having a hard time figuring out the call chain (_plugins.py through klass() without name being passed, apparently). 0.9.0.13 inherited from HFCompatible, which seems to do some magic in this area.
The text was updated successfully, but these errors were encountered:
python3 -m garak --model_type huggingface.InferenceAPI --model_name microsoft/Phi-3-mini-4k-instruct --probes malwaregen.Evasion
stopped working after 0.9.0.13 (it just gets stuck). Logging https requests and digging into the code:
send: b'POST /models/ HTTP/1.1\r\nHost: api-inference.huggingface.co\r\nUser-A
gent: python-requests/2.32.3\r\nAccept-Encoding: gzip, deflate, zstd\r\nAccept
: /\r\nConnection: keep-alive\r\nAuthorization: Bearer ...
when it had the model name in the URI before.
class InferenceAPI(Generator):
...
self.uri = self.URI + name
If I change name to config_root.plugins.model_name it works like before, but maybe not the correct fix? I'm having a hard time figuring out the call chain (_plugins.py through klass() without name being passed, apparently). 0.9.0.13 inherited from HFCompatible, which seems to do some magic in this area.
The text was updated successfully, but these errors were encountered: