Skip to content

Feat/update tables#76

Merged
dylanlee merged 9 commits intomainfrom
feat/update-tables
Apr 3, 2026
Merged

Feat/update tables#76
dylanlee merged 9 commits intomainfrom
feat/update-tables

Conversation

@dylanlee
Copy link
Copy Markdown

@dylanlee dylanlee commented Apr 3, 2026

This PR updates the API and icefabric hydrofabric schemas to be able to handle the oCONUS domains. It also modifies the script that builds the NHF so that when tables are written to a given environment you can overwrite the existing tables and update the table schema instead of having to purge the tables. Finally this PR modifies the NHF subsetting so that the gpkg returned by the subsetter always returns all the NHF layers even if some of the layers are empty.

dylanlee added 8 commits April 2, 2026 14:47
This commit modifies build_nhf.py so that it overwrites instead of
purges existing tables. This allows rollbacks/keeps previous versions in
the catalog
Previously build_nhf.py always assumed it would add NHF tables to the
test environment. This makes it possible to use build_nhf.py to update
OE nhf tables
Copy link
Copy Markdown

@quercoak quercoak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good

.pyiceberg.yaml Outdated
s3.endpoint: s3.us-east-1.amazonaws.com
warehouse: s3://52fcde3e7-5582-477d-7686ou4ij1ptxj8equ83a5xc51fsuse1b--table-s3
# warehouse: s3://52fcde3e7-5582-477d-7686ou4ij1ptxj8equ83a5xc51fsuse1b--table-s3 # Test
warehouse: 154735606025 # OE
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we'd rather leave this commited to test

@danielcumpton
Copy link
Copy Markdown

Ran the updated subsetter for gage 12175500 which was previously missing the waterbodies layer. The geopackage now contains the waterbodies layer. Code changes for the subsetter and other items look good.

@dylanlee dylanlee merged commit 4594ec2 into main Apr 3, 2026
9 checks passed
@dylanlee dylanlee deleted the feat/update-tables branch April 3, 2026 20:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants