compatible with oobabooga text-generation-web-ui

[cycloarcane]

This change adds a modified rest.py that is compatible with oobabooga text generation webui as oobabooga uses nested JSON in its API responses. I added the _get_nested_value method to the rest.py template file.

An example of the nested JSON response from oobabooga:

curl -X POST http://127.0.0.1:5000/v1/completions -H "Content-Type: application/json" -d '{"prompt": "Hello"}'

{"id":"conv-1732215852476260864","object":"text_completion","created":1732215852,"model":"WhiteRabbitNeo_Llama-3.1-WhiteRabbitNeo-2-8B","choices":[{"index":0,"finish_reason":"length","text":" and Happy New Year to all who cruised past this channel during the year gone","logprobs":{"top_logprobs":[{}]}}],"usage":{"prompt_tokens":2,"completion_tokens":17,"total_tokens":19}}%   

Verification

• Supporting configuration such as generator configuration file

  "rest": {
    "RestGenerator": {
      "name": "oobabooga Local Model",
      "uri": "http://127.0.0.1:5000/v1/completions",
      "method": "post",
      "headers": {
        "Content-Type": "application/json"
      },
      "req_template_json_object": {
        "prompt": "$INPUT",
        "max_tokens": 1000,
        "temperature": 0.7
      },
      "response_json": true,
      "response_json_field": "choices[0].text"
    }
  }
}

I have signed off the commit. Here is the method that was added:

def _get_nested_value(self, obj, path):
       """Helper method to get nested dictionary values using a path string."""
       try:
           current = obj
           parts = path.replace("][", "].").replace("[", ".").replace("]", "").split(".")
           for part in parts:
               if part.isdigit():
                   current = current[int(part)]
               else:
                   current = current[part]
           return current
       except (KeyError, IndexError, TypeError) as e:
           logging.error(f"Failed to access path '{path}' in object: {e}")
           return None

I have tested and run garak successfully with oobabooga text generation webui after making these changes.

[github-actions]

DCO Assistant Lite bot All contributors have signed the DCO ✍️ ✅

[cycloarcane]

I have read the DCO Document and I hereby sign the DCO

[cycloarcane]

recheck

[jmartin-tech]

The existing restGenerator supports extracting the response via JSONPath provided in the response_json_field as of #651, what new functionality is added here?

Please test using a JSONPath as response_json_field in your example with the existing generator, something like:

      "response_json_field": "$.choices[0].text"

Also please note that unless there is significant change need a new module is not needed. The proposed change here introduces significant code duplication that can easily be avoided.