Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(hydroflow): add repeat_n(n) windowing operator, modify scheduler #1596

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

MingweiSamuel
Copy link
Member

@MingweiSamuel MingweiSamuel commented Dec 6, 2024

Needed a way for repeat_n to repeat itself, so I've added a context api reschedule_current_subgraph, which works by tracking a single bit/bool after each subgraph run. The repeat_n just calls that method until it no longer needs to loop. This method differs from schedule_subgraph in that schedule_subgraph only schedules for the next tick.

@MingweiSamuel MingweiSamuel marked this pull request as ready for review December 6, 2024 00:34
@MingweiSamuel MingweiSamuel changed the title feat(hydroflow): add repeat_n() windowing operator, modify scheduler feat(hydroflow): add repeat_n(n) windowing operator, modify scheduler Dec 6, 2024
@shadaj
Copy link
Member

shadaj commented Dec 10, 2024

Just checking: if we reschedule the current subgraph, that will reset all internal operator state, right?

@MingweiSamuel
Copy link
Member Author

Just checking: if we reschedule the current subgraph, that will reset all internal operator state, right?

Yeah, everything local will be reset, which is why we put stuff in conext.state_ref

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants