Skip to content

Data Sharding #286

@Max-Meldrum

Description

@Max-Meldrum

The following are some aspects we need to address/implement to enable data parallelism:

  • KeyHasher (e.g., Murmur3)
  • Range vs. Hash Sharding
  • KeyExtractor
  • Keyed Streams (KeyedStream, KeyedArrowStream)
  • Region & Shards

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions