Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for custom domains #36

Open
dvoits opened this issue May 3, 2017 · 1 comment
Open

Support for custom domains #36

dvoits opened this issue May 3, 2017 · 1 comment
Assignees

Comments

@dvoits
Copy link
Owner

dvoits commented May 3, 2017

Domain describes structure and semantics of input and output program data.
For each experiment there is one domain.

Input:

  • Command line argument with special token to be replaced with an input benchmark file name when run.
  • Benchmark files extensions (one or several).

Output:
It describes named values contained in a program output and extracted by two alternative ways:

  • "Value" can depend on exit code (specific code corresponds to specific value)
  • "Value" is a result of a given regular expression applied to a standard output

Values are represented as a JSON object, one object for each of the benchmarks.

@wintersteiger
Copy link

More examples:
F* (custom I/O requirements)
SAT solvers (the "canonical" example is MiniSAT, which follow the SAT competition requirements (there are also many that use parallelism)
Other SMT solvers (very similar to Z3), e.g. those taking part in the SMT Competition

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants