Skip to content

Add check for kinesis scaling action #15

@colmsnowplow

Description

@colmsnowplow

Currently we rebalance shards any time we notice kinesis shard counts change. We have noticed that at high shard counts (100+), kinesis' scaling can take a very long time - up to a couple of hours - before the shard count is stable again.

This will cause kinsumer to constantly stop-start itself, which can be an issue for apps using it.

One solution to work around this is to check the stream status at the same time that we check the shard count, and only rebalance once it's done scaling.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions