Skip to content

Refactor script to run on distributed clusters #56

@jathavaan

Description

@jathavaan

Task description

Refactor the script to run each partition computation on a distributed cluster. Keep DuckDB in the script, but rewrite it to pass runtime arguments that include the partition ID. The partition ID should be a H3 hash (see #55 for more information). Test the script on a local Kubernetes cluster using kind.

Developer tasks

No response

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions