forked from twitchscience/kinsumer
-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Description
Currently we rebalance shards any time we notice kinesis shard counts change. We have noticed that at high shard counts (100+), kinesis' scaling can take a very long time - up to a couple of hours - before the shard count is stable again.
This will cause kinsumer to constantly stop-start itself, which can be an issue for apps using it.
One solution to work around this is to check the stream status at the same time that we check the shard count, and only rebalance once it's done scaling.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels