Can we use PyRIT on local HF models?

[EricXQiu]

Hi PyRIT team,

I'm pretty new here. Can we use PyRIT on local models? We have downloaded a few Hugging Face model on the local storage.

Thanks for any suggestions or help.

[rdheekonda]

Thanks for reaching out to us. At the moment, we don't have that option available. However, one approach is to deploy the same Hugging Face model to Azure ML using PyRIT's deployment functionality and then utilize PyRIT's Azure ML chat target for probing. We will reply to the issue that you've created if we have any plans to support Hugging Face model as a target.