-
Notifications
You must be signed in to change notification settings - Fork 100
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
e2e groupby conditional scenarios #1807
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Also, just a general question, why were minIf and anyIf kept in a separate scenario? Why not keep them in the first scenario itself?
Then Validate output file generated by file sink plugin "fileSinkTargetBucket" is equal to expected output file "groupByTest5OutputFile" | ||
|
||
@GROUP_BY_TEST @FILE_SINK_TEST | ||
Scenario: To verify complete flow of data extract and transfer from File source to File sink with GroupBy plugin using set of aggregates |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: update scenario description to mention which aggregates are being tested (count, sum, max)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated scenario description.
eeb3c8b
to
f05cb94
Compare
Added minif and anyif aggregators in first scenario. |
f3e218e
to
3502087
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Seems like the build failure might be flaky behaviour, please validate that once. LGTM otherwise. Ensure e2e test build works before merging
8fbb96b
to
32db009
Compare
32db009
to
05afe37
Compare
e2e test failure seems to be due to "Verify Distinct plugin validation errors for incorrect data in Fields" (src/e2e-test/features/distinctplugin/DistinctErrorScenarios.feature:5) scenario. Merging since it is unrelated. |
Design document available in PR review folder.