Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Examples as E2E Tests #32

Open
chr-hertel opened this issue Sep 23, 2024 · 3 comments
Open

Examples as E2E Tests #32

chr-hertel opened this issue Sep 23, 2024 · 3 comments

Comments

@chr-hertel
Copy link
Member

Would be interesting to run the examples as E2E tests. Would require tokens (not that problematic with secrets i guess) but also a clever way to execute and run assertions.

Maybe it's enough to have a proper exit code? 🤔
@OskarStark
Copy link
Contributor

What about prompting "Answer just with: OK" or a structured output?

@chr-hertel
Copy link
Member Author

Answer just with: OK

Huh, easy one - i Like 👍

@chr-hertel
Copy link
Member Author

after integrating the example runner, this is not that urgent anymore, but basically that thing could be converted to a functional phpunit test - only important to execute those example parallel not sequentially

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@OskarStark @chr-hertel