Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

filterblock: add default_value for use with convert_dtype #143

Merged
merged 2 commits into from
Jul 16, 2024

Conversation

markmc
Copy link
Contributor

@markmc markmc commented Jul 15, 2024

Fixes #133

We have been using None as a default value when dtype conversion fails. This works fine with the eq operator, but not others e.g. ge

In many cases a default like zero or False works fine, but there are cases where the pipeline author will need to specify a different default, for example when using something like le(1) you would want a default greater than 1.

With this change, we're acknowledging that this is default value handling is very normal, and we can drop from error logging to debug logging.

markmc added 2 commits July 15, 2024 23:13
Fixes instructlab#133

We have been using None as a default value when dtype conversion fails.
This works fine with the eq operator, but not others e.g. ge

In many cases a default like zero or False works fine, but there are
cases where the pipeline author will need to specify a different default,
for example when using something like `le(1)` you would want a default
greater than 1.

With this change, we're acknowledging that this is default value
handling is very normal, and we can drop from error logging to debug
logging.

Signed-off-by: Mark McLoughlin <[email protected]>
@mergify mergify bot added the testing Relates to testing label Jul 15, 2024
@markmc
Copy link
Contributor Author

markmc commented Jul 15, 2024

Also fixes #123

@markmc markmc requested a review from russellb July 16, 2024 15:57
Copy link
Member

@russellb russellb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This lgtm.

I'd like to run full sdg CI on this, but since we have several PRs ready, I suggest we merge them all and run the CI job against main so they're all tested together at once.

@russellb russellb merged commit c083f98 into instructlab:main Jul 16, 2024
11 checks passed
jwm4 pushed a commit to jwm4/sdg that referenced this pull request Dec 13, 2024
…_actions/actions/checkout-4.2.1

Bump actions/checkout from 4.2.0 to 4.2.1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
testing Relates to testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve FilterByValueBlock invalid value error handling
2 participants