Feature test suite

[bignose-debian]

What is a good feature test suite for Xyppy, to ensure that changing the code doesn't introduce bugs?

[theinternetftw]

I've entertained the idea of building a regression checker that plays games and checks its output against pre-recorded output (full transcripts for local checks, or a hash for anyone who pulls the repo).

That'd at least be a start, and it helps that it actually sounds interesting to me.

If I've misread you and you're wondering about decent pre-existing z-machine test suites to test against, I've already been using (though not in an automated fashion) etude.z5, praxix.z5, czech.z5, and strictz.z5. You can find them in the z-machine spec itself under testing compliance. Note that they're insufficient and you'd better run through a million games as well. Certainly helps though, and being able to auto-test against them (as well as others) as you code would pretty much be the idea of the above checker.

[deckaddict]

Sounds like something that Texttest can be used for.