Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add flags for QPS and Burst to *-poollet and *-broker #1157

Merged

Conversation

balpert89
Copy link
Contributor

@balpert89 balpert89 commented Nov 18, 2024

Proposed Changes

  • define a common default for client QPS and Burst for broker and poollet components
  • make QPS and Burst client configuration configurable
  • make concurrent max reconciles configurable

Fixes #1154

@balpert89 balpert89 requested a review from a team as a code owner November 18, 2024 16:22
@github-actions github-actions bot added size/L bug Something isn't working labels Nov 18, 2024
@balpert89
Copy link
Contributor Author

removed the no-op rate limiting configuration.

broker/bucketbroker/cmd/bucketbroker/app/app.go Outdated Show resolved Hide resolved
broker/volumebroker/cmd/volumebroker/app/app.go Outdated Show resolved Hide resolved
broker/machinebroker/cmd/machinebroker/app/app.go Outdated Show resolved Hide resolved
poollet/bucketpoollet/cmd/bucketpoollet/app/app.go Outdated Show resolved Hide resolved
poollet/machinepoollet/cmd/machinepoollet/app/app.go Outdated Show resolved Hide resolved
poollet/volumepoollet/cmd/volumepoollet/app/app.go Outdated Show resolved Hide resolved
@afritzler afritzler added enhancement New feature or request and removed bug Something isn't working labels Nov 25, 2024
@github-actions github-actions bot added the bug Something isn't working label Nov 25, 2024
@afritzler afritzler changed the title feat: expose multiple client configuration to finetune performance Add flags for QPS and Burst to *-poollet and *-broker Nov 25, 2024
@afritzler afritzler removed the bug Something isn't working label Nov 25, 2024
@github-actions github-actions bot added the bug Something isn't working label Nov 25, 2024
@balpert89 balpert89 removed the bug Something isn't working label Nov 26, 2024
poollet/volumepoollet/cmd/volumepoollet/app/app.go Outdated Show resolved Hide resolved
poollet/common/defaults/defaults.go Outdated Show resolved Hide resolved
@github-actions github-actions bot added the bug Something isn't working label Nov 26, 2024
…ptionsUpdated `Options` struct with `QPS` and `Burst` fields, added corresponding flags in `AddFlags` method, and set these values in the `Run` function for ippoollet, machinepoollet, and volumepoollet controllers. This allows configurable rate limits for Kubernetes client requests and logs the settings on startup.Suggestion: Review the changes to ensure consistency and test the new configuration options.

Signed-off-by: Benjamin Alpert <[email protected]>

change poollet client specific qps and burst opts implementation to common options pattern

change to client config defaults for qps and burst
Bumps [github.com/onsi/gomega](https://github.com/onsi/gomega) from 1.35.1 to 1.36.0.
- [Release notes](https://github.com/onsi/gomega/releases)
- [Changelog](https://github.com/onsi/gomega/blob/master/CHANGELOG.md)
- [Commits](onsi/gomega@v1.35.1...v1.36.0)

---
updated-dependencies:
- dependency-name: github.com/onsi/gomega
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…e-dev#1174)

Bumps [github.com/bits-and-blooms/bitset](https://github.com/bits-and-blooms/bitset) from 1.15.0 to 1.17.0.
- [Release notes](https://github.com/bits-and-blooms/bitset/releases)
- [Commits](bits-and-blooms/bitset@v1.15.0...v1.17.0)

---
updated-dependencies:
- dependency-name: github.com/bits-and-blooms/bitset
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Copy link
Member

@lukasfrank lukasfrank left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lukasfrank lukasfrank merged commit dc782b5 into ironcore-dev:main Nov 27, 2024
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request size/L
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add QPS and Burst configuration for poollet and broker
3 participants