Skip to content
This repository has been archived by the owner on Oct 23, 2023. It is now read-only.

Consumer Shutdown Testing: Shard Reallocation #5

Open
markglh opened this issue May 30, 2017 · 0 comments
Open

Consumer Shutdown Testing: Shard Reallocation #5

markglh opened this issue May 30, 2017 · 0 comments

Comments

@markglh
Copy link
Contributor

markglh commented May 30, 2017

When processing from multiple shards (1 consumer), we need to assert the following.

  • Reducing the shard count from 2 to 1 (in Kinesis) should result in the consumer continuing to consume from the remaining shard. Kinesis will reallocate messages to the remaining shard automatically. We need to ensure the consumer continues seamlessly.
  • It's possible that the ConsumerManager within the client will shutdown the whole consumer when a shard is removed as it calls shutdown on the KCLWorker, which isn't shard specific.
  • Note also that there are two shutdown scenarios in the manager, one when shutting down a shard gracefully and one due to an exception - this is testing the former.
@markglh markglh closed this as completed May 30, 2017
@markglh markglh reopened this May 30, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Development

No branches or pull requests

1 participant