Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add django-oscar for mapping and benchmarking #93

Open
wants to merge 17 commits into
base: main
Choose a base branch
from

Conversation

apotterri
Copy link
Contributor

@apotterri apotterri commented Jun 24, 2024

Also, made some minor fixes/changes along the way, including restoring the timeout when running test commands.

Add --start-page to print_pulls.py to make it easier to restart the
process if you previously aborted it.
Add --id-filter, --version-filter, and --keep to engine_validation.py.
Using these makes it easier to debug validation of a small subset of
instances.
Call out tests that ERRORed before and after patch application for an
instance. These may indicate a problem with the way the environment has
been configured.
refactor: fix a typo

fix: don't assume particular dataset splits

Don't assume that a dataset has "test" and "dev" splits. Iterate over
all splits when looking for an instance.

feat: add django-oscar dataset

fix: run custom hook during install

Give a repo configuration the chance to run a hook between environment
creation and installing dependencies. Use it to set up django-oscar so
uWSGI installs correctly.
The "created_at" attribute of a prediction is a Timestamp, make sure it
serializes correctly.
When loading data for solving, check to see if the given dataset name
exists on disk and load it if it does. This allows the same path to be
passed to solve.py and run_evaluation.py.
The django-oscar dataset has PASS_TO_PASS and FAIL_TO_PASS that are
lists, rather than strings.
Update the scripts that take --verbose as a switch, changing the action
from "store_true" to "count". Change a couple of checks to take
advantage of the change, printing more output when --verbose is
specified multiple times.

In particular, only tee test command output if --verbose has been given
more than once. This also restores test timeout if --verbose is only
given once, or not at all.
Fix the way pytest is invoked so that --test-group-count and
--test-group only get specified once.
Add a config for django-oscar with some exclusions, so mapping will run
a little faster.

Tell the solver about some django-oscar runs.
Update the GH action to allow the set of instances to be specified when
the workflow is run.
@apotterri apotterri force-pushed the django-oscar_20240611 branch 5 times, most recently from 20a96fe to 5f743a4 Compare June 24, 2024 11:25
Add --id_filter, --version_filter, and --show_only to make it easier to
create AppMaps for a subset of instances.
Remove appmap/__init__.py so python doesn't see it as a module that can
be imported. It's not ever imported, and making it a module breaks the
python agent (which also has an "appmap" module).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant