Skip to content

Split into modules for data registry, management, and retrieval#22

Merged
karimbahgat merged 2 commits intomainfrom
data-registry-manage-retrieve
Mar 10, 2026
Merged

Split into modules for data registry, management, and retrieval#22
karimbahgat merged 2 commits intomainfrom
data-registry-manage-retrieve

Conversation

@karimbahgat
Copy link
Collaborator

Split into several basic modules with very limited areas of responsibility:

  • Data registry: Getting overview and returning basic info about registered datasets from yaml files. Other modules can also reuse its components to get dataset information.
  • Data manager: Managing the available data for a registered data, by downloading and optionally building zarr archives for datasets. This might be something we want triggered in other ways, but providing API endpoints for now so that we can easily populate data from the FastAPI interface.
  • Data accessor/retrieval: Accessing available data for a given dataset, with optional time and space filters. All other modules that access data should reuse components from here. For now includes an endpoint to retrieve filtered data and download as netcdf file. Serves same purpose and should be easy to reuse and expand for OGC EDR endpoints.
image

@karimbahgat karimbahgat marked this pull request as ready for review March 10, 2026 15:49
@karimbahgat karimbahgat requested a review from turban March 10, 2026 15:49
@karimbahgat karimbahgat merged commit b724d9e into main Mar 10, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant