AI Testing Tool

Demo

The test case is

When you add a google account in Passwords & accounts, username is [email protected], password is 123456. Then you should see an error "Couldn't find your Google Account".

Architecture

How to use it?

Run the following command to run the tool

OPENAI_API_KEY=<openai api key> python ai-testing-tool.py <system prompt file> <task file> --appium=<appium server address>

Run the following command to run the tool in debug mode

python ai-testing-tool.py <system prompt file> <task file> --appium=<appium server address> --debug

Acknowledgements

1. https://github.com/Nikhil-Kulkarni/qa-gpt
2. https://github.com/quinny1187/GridGPT
3. https://github.com/nickandbro/chatGPT_Vision_To_Coords
4. https://arxiv.org/abs/2304.07061