Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

explore property-based testing #1545

Open
maelle opened this issue Oct 3, 2024 · 2 comments
Open

explore property-based testing #1545

maelle opened this issue Oct 3, 2024 · 2 comments
Labels
upkeep maintenance, infrastructure, and similar

Comments

@maelle
Copy link
Contributor

maelle commented Oct 3, 2024

https://www.etiennebacher.com/posts/2024-10-01-using-property-testing-in-r/

@maelle maelle added the upkeep maintenance, infrastructure, and similar label Oct 3, 2024
@maelle
Copy link
Contributor Author

maelle commented Oct 3, 2024

related to igraph/igraph#2459

@szhorvat
Copy link
Member

szhorvat commented Oct 3, 2024

Google FuzzTest is a framework for doing this for C++ projects. Tamás and I have been looking at it for a while, but realistically, we won't have the time to implement it anytime soon.

The interesting thing about Google FuzzTest is that it doesn't just produce random input. It mutates the input in a random, but also targeted way to try to maximize code coverage (like in coverage-guided fuzzing). Are there similar tools for R that can go beyond dumb random input generation?

BTW many of the tests we have are already like this in spirit, except that they run for a fixed seed. If we allow a variable seed, then we need: (1) an easy way to run the test for the same seed (2) a way to report the seed upon failure. That would have needed a bit more work for the custom testing framework we had in C.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
upkeep maintenance, infrastructure, and similar
Projects
None yet
Development

No branches or pull requests

2 participants