Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MINOR: Convert DynamicBrokerReconfigurationTest to KRaft #17905

Conversation

cmccabe
Copy link
Contributor

@cmccabe cmccabe commented Nov 22, 2024

Convert testUncleanLeaderElectionEnable and testMetricsReporterUpdate to KRaft.

Remove testAdvertisedListenerUpdate, testAddRemoveSslListener, testAddRemoveSaslListeners since we no longer support dynamically adding or removing network listeners when in KRaft mode.

Make TestUtils.ensureConsistentKRaftMetadata robust against brokers that don't have sharedServer.loader initialized yet (or have shut down).

@github-actions github-actions bot added core Kafka Broker tests Test fixes (including flaky tests) labels Nov 22, 2024
@chia7712
Copy link
Member

@cmccabe Could you please check the failed tests? DynamicBrokerReconfigurationTest#testUncleanLeaderElectionEnable

@chia7712
Copy link
Member

or the test can be disabled temporarily and I will file a jira to trace it

@cmccabe cmccabe force-pushed the cmccabe_remove_zk_only_tests_in_dynamic_broker_reconfiguration_test branch 3 times, most recently from 355dfd3 to 4a5d199 Compare November 28, 2024 17:54
@cmccabe cmccabe force-pushed the cmccabe_remove_zk_only_tests_in_dynamic_broker_reconfiguration_test branch from 4a5d199 to c6eac28 Compare November 28, 2024 17:58
@@ -852,7 +840,8 @@ class DynamicBrokerReconfigurationTest extends QuorumTestHarness with SaslSetup
"", mayReceiveDuplicates = false)
verifyThreadPoolResize(SocketServerConfigs.NUM_NETWORK_THREADS_CONFIG, config.numNetworkThreads,
networkThreadPrefix, mayReceiveDuplicates = true)
verifyThreads("data-plane-kafka-socket-acceptor-", config.listeners.size)
System.out.println("config.listeners = " + config.listeners)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please remove this line?

@cmccabe cmccabe merged commit b8c8e0c into apache:trunk Nov 28, 2024
3 checks passed
@cmccabe cmccabe deleted the cmccabe_remove_zk_only_tests_in_dynamic_broker_reconfiguration_test branch November 28, 2024 19:59
@cmccabe
Copy link
Contributor Author

cmccabe commented Nov 28, 2024

or the test can be disabled temporarily and I will file a jira to trace it

I fixed it by reducing ReplicationConfigs.UNCLEAN_LEADER_ELECTION_INTERVAL_MS_CONFIG in the test

def testThreadPoolResize(groupProtocol: String): Unit = {
@ParameterizedTest(name = TestInfoUtils.TestWithParameterizedQuorumAndGroupProtocolNames)
@MethodSource(Array("getTestQuorumAndGroupProtocolParametersAll"))
def testThreadPoolResize(quorum: String, groupProtocol: String): Unit = {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This gets flaky and I open https://issues.apache.org/jira/browse/KAFKA-18123 to fix it.

chiacyu pushed a commit to chiacyu/kafka that referenced this pull request Nov 30, 2024
Convert testUncleanLeaderElectionEnable and testMetricsReporterUpdate to KRaft.

Remove testAdvertisedListenerUpdate, testAddRemoveSslListener, testAddRemoveSaslListeners since we no longer support dynamically adding or removing network listeners when in KRaft mode.

Make TestUtils.ensureConsistentKRaftMetadata robust against brokers that don't have sharedServer.loader initialized yet (or have shut down).

Reviewers: Chia-Ping Tsai <[email protected]>
tedyu pushed a commit to tedyu/kafka that referenced this pull request Jan 6, 2025
Convert testUncleanLeaderElectionEnable and testMetricsReporterUpdate to KRaft.

Remove testAdvertisedListenerUpdate, testAddRemoveSslListener, testAddRemoveSaslListeners since we no longer support dynamically adding or removing network listeners when in KRaft mode.

Make TestUtils.ensureConsistentKRaftMetadata robust against brokers that don't have sharedServer.loader initialized yet (or have shut down).

Reviewers: Chia-Ping Tsai <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Kafka Broker tests Test fixes (including flaky tests)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants