-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add gather support for parallel dir structure #1044
Conversation
This reverts commit 6ae5d1d.
…er_support_parallel_dir_structure
🚨 API breaking changes detected! 🚨 |
🚨 API breaking changes detected! 🚨 |
🚨 API breaking changes detected! 🚨 |
🚨 API breaking changes detected! 🚨 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Couple comments on the protocol side of things, not read the rest yet.
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #1044 +/- ##
==========================================
- Coverage 94.57% 92.73% -1.84%
==========================================
Files 135 135
Lines 10061 10077 +16
==========================================
- Hits 9515 9345 -170
- Misses 546 732 +186
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
🚨 API breaking changes detected! 🚨 |
🚨 API breaking changes detected! 🚨 |
🚨 API breaking changes detected! 🚨 |
🚨 API breaking changes detected! 🚨 |
🚨 API breaking changes detected! 🚨 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @atravitz , this looks great. Only thing I'm not so sure about yet is the input file path for gather.
I wanted to test this on one of my old result files, however they were in a structure such as this:
all_results
with following subfolders:
results_0
, results_1
, results_2
, results_other_setting_0
, results_other_setting_1
, results_other_setting_2
.
If I only want to analyze the results from the first three folders, I'd have to move the other folders in a different directory.
This could be fine, but alternatively, gather could also take a list of Paths. I'm not sure yet what is better, but just wanted to raise this use case.
Just wanted to chime in here that having gather take in a list of results JSON and/or directories would be great (the former more than the latter)! That being said I do think this is maybe something to be dealt with elsewhere. |
Co-authored-by: Hannah Baumann <[email protected]>
I agree with both of you @IAlibay @hannahbaumann - how do you feel about me addressing this in a follow-up PR? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @atravitz , lgtm!
No API break detected ✅ |
Checklist
news
entryDevelopers certificate of origin