Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added kafka features config map to kafka broker docs #5622

Merged
merged 12 commits into from
Oct 5, 2023

Conversation

Cali0707
Copy link
Member

Fixes #5607

Proposed Changes

  • Add info about the kafka features config map

@netlify
Copy link

netlify bot commented Jul 10, 2023

Deploy Preview for knative ready!

Built without sensitive environment variables

Name Link
🔨 Latest commit 9dac7ea
🔍 Latest deploy log https://app.netlify.com/sites/knative/deploys/651ecf18f4a6fb0008ef01ab
😎 Deploy Preview https://deploy-preview-5622--knative.netlify.app/docs/eventing/brokers/broker-types/kafka-broker/configuring-kafka-features
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@knative-prow knative-prow bot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label Jul 10, 2023
@Cali0707
Copy link
Member Author

/cc @pierDipi

@Cali0707
Copy link
Member Author

/cc @Leo6Leo

@knative-prow knative-prow bot requested a review from Leo6Leo July 11, 2023 18:14
## Configure Kafka features

There are various kafka features/default values the Knative Kafka Broker uses when interacting with Kafka. You can configure these as follows:

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you can add a line to say what is this sample config file will achieve. (What does it do if I choose to follow this configuration in general)

docs/eventing/brokers/broker-types/kafka-broker/README.md Outdated Show resolved Hide resolved
@@ -257,6 +257,46 @@ spec:
!!! note
When using an external topic, the Knative Kafka Broker does not own the topic and is not responsible for managing the topic. This includes the topic lifecycle or its general validity. Other restrictions for general access to the topic may apply. See the documentation about using [Access Control Lists (ACLs)](https://kafka.apache.org/documentation/#security_authz).

## Configure Kafka features

There are various kafka features/default values the Knative Kafka Broker uses when interacting with Kafka. You can configure these as follows:
Copy link
Member

@pierDipi pierDipi Jul 12, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We probably need to link to https://knative.dev/docs/eventing/experimental-features/ and clarify what each feature is about and how each feature works, etc.

This seems overly generic for a user to grasp.

It might be worth considering a separate page that is linked to this one

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pierDipi would all of the features in this config map be considered experimental features then?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The term experimental is used wrongly in that doc, they are really just features, each at different maturity level (alpha, beta, or stable)

@knative-prow knative-prow bot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Jul 14, 2023
@Cali0707
Copy link
Member Author

@pierDipi I've made a new page to group the kafka config options together. WDYT?

@knative-prow knative-prow bot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Sep 20, 2023
@Cali0707
Copy link
Member Author

/test

@knative-prow
Copy link

knative-prow bot commented Sep 22, 2023

@Cali0707: No presubmit jobs available for knative/docs@main

In response to this:

/test

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Cali0707
Copy link
Member Author

/retest

@pierDipi
Copy link
Member

@Cali0707 the deploy preview failed

Comment on lines +193 to +195
- Apache Kafka:
- About Apache Kafka Broker: eventing/brokers/broker-types/kafka-broker/README.md
- Configuring Kafka features: eventing/brokers/broker-types/kafka-broker/configuring-kafka-features.md
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When I build these changes locally, it seemed to still work fine

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for double checking

@Cali0707
Copy link
Member Author

@Cali0707 the deploy preview failed

The error seems to be:

2:49:21 PM: ERROR: Could not install packages due to an EnvironmentError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Max retries exceeded with url: /packages/89/58/aa3301b23966a71d7f8e55233f467b3cec94a651434e9cd9053811342539/mkdocs-1.5.3-py3-none-any.whl (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f40fc558c10>: Failed to establish a new connection: [Errno 101] Network is unreachable'))

I don't think my changes caused this, but I don't have the ability to re-run the deploy preview. Any ideas @pierDipi ?

@pierDipi
Copy link
Member

@Cali0707 the deploy preview failed

The error seems to be:

2:49:21 PM: ERROR: Could not install packages due to an EnvironmentError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Max retries exceeded with url: /packages/89/58/aa3301b23966a71d7f8e55233f467b3cec94a651434e9cd9053811342539/mkdocs-1.5.3-py3-none-any.whl (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7f40fc558c10>: Failed to establish a new connection: [Errno 101] Network is unreachable'))

I don't think my changes caused this, but I don't have the ability to re-run the deploy preview. Any ideas @pierDipi ?

me neither 🤔 can you just rebase/force push as a workaround?

@knative-prow knative-prow bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 26, 2023
@Cali0707
Copy link
Member Author

@pierDipi the deploy preview worked this time :)

@Cali0707 Cali0707 requested a review from pierDipi October 5, 2023 14:34
@pierDipi
Copy link
Member

pierDipi commented Oct 5, 2023

image

Signed-off-by: Calum Murray <[email protected]>
@Cali0707
Copy link
Member Author

Cali0707 commented Oct 5, 2023

@pierDipi whoops - a bracket issue 🤦

Copy link
Member

@pierDipi pierDipi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@knative-prow knative-prow bot added the lgtm Indicates that a PR is ready to be merged. label Oct 5, 2023
@knative-prow
Copy link

knative-prow bot commented Oct 5, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: Cali0707, pierDipi

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@pierDipi
Copy link
Member

pierDipi commented Oct 5, 2023

Thank @Cali0707

@knative-prow knative-prow bot merged commit 76afdd5 into knative:main Oct 5, 2023
16 checks passed
@pierDipi
Copy link
Member

pierDipi commented Oct 6, 2023

/cherry-pick release-1.11

@knative-prow-robot
Copy link
Contributor

@pierDipi: new pull request created: #5705

In response to this:

/cherry-pick release-1.11

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Document Custom Kafka Topics
4 participants