Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
83 commits
Select commit Hold shift + click to select a range
44b4473
Begin examining how to best add structured array support to Zarr v3 d…
BrianMichell Nov 24, 2025
e6df164
Merge branch 'google:master' into v3_structs
BrianMichell Nov 24, 2025
187f424
Updates to have proper reads
BrianMichell Nov 24, 2025
c2e73cd
Local testing and examples
BrianMichell Nov 24, 2025
9e8ed94
Begin adding support for opening struct arrays as void and add suppor…
BrianMichell Nov 25, 2025
44c765e
Fix failing tests
BrianMichell Nov 25, 2025
547642d
Resolve issues with opening struct as void
BrianMichell Nov 25, 2025
2a4c3d8
Remove debug print
BrianMichell Nov 26, 2025
b0abb94
Add field for open as void
BrianMichell Dec 2, 2025
fff0a5b
Add a shim for new open_as_void flag open option
BrianMichell Dec 3, 2025
b6c24f9
Revert some formatting changes
BrianMichell Dec 3, 2025
488b160
revert gitignore changes
BrianMichell Dec 3, 2025
537d309
Merge pull request #1 from BrianMichell/v3_structs_compatibility
BrianMichell Dec 3, 2025
54941a0
V3 structs remove shim (#2)
BrianMichell Dec 3, 2025
c9f58f9
Fix structured fill value population
BrianMichell Dec 3, 2025
7655cfd
V3 examples merge (#3)
BrianMichell Dec 4, 2025
8c4c4ca
Remove vestigial example build
BrianMichell Dec 4, 2025
4b590f8
V3 structs fix fills (#4)
BrianMichell Dec 4, 2025
7691c83
Merge branch 'google:master' into v3_structs
BrianMichell Dec 4, 2025
c0082a0
Add new options to schema
BrianMichell Dec 4, 2025
9a46c82
Fix copyright header date
BrianMichell Dec 4, 2025
b9b5e41
Cleanup (#5)
BrianMichell Dec 4, 2025
d5f6201
Merge zarr3 structured dtype support
BrianMichell Jan 5, 2026
31e55ec
Remove default values
BrianMichell Jan 5, 2026
aad0ee0
Merge branch 'google:master' into v3_structs_and_void
BrianMichell Jan 23, 2026
89098f8
zarr3: Add mutual exclusivity validation for field and open_as_void
BrianMichell Jan 26, 2026
471aa1b
zarr3: Reject URL syntax when selected_field or open_as_void specified
BrianMichell Jan 26, 2026
34e52fe
zarr3: Preserve open_as_void flag in GetBoundSpecData for spec round-…
BrianMichell Jan 26, 2026
0db22e4
zarr3: Add open_as_void tests and fix BUILD dependency
BrianMichell Jan 26, 2026
5fadaf0
zarr3: Fix DecodeChunk and EncodeChunk for void access
BrianMichell Jan 26, 2026
a25dd7d
zarr3: Add read/write tests for open_as_void
BrianMichell Jan 26, 2026
7065b42
zarr3: Add compression test for open_as_void
BrianMichell Jan 26, 2026
b8daec0
zarr3: Add original_is_structured flag for void access
BrianMichell Jan 26, 2026
5dab237
zarr3: Mark structured type void access test as TODO
BrianMichell Jan 26, 2026
6a05640
zarr3: Fix GetDomain rank handling for void access
BrianMichell Jan 26, 2026
76b3002
zarr3: Mark structured type void access test as TODO
BrianMichell Jan 26, 2026
9794450
zarr3: Improve comments for void access rank handling
BrianMichell Jan 26, 2026
a027195
zarr3: Fix void access EncodeChunk to use original dtype
BrianMichell Jan 26, 2026
83a5199
zarr3: Add OpenAsVoidWriteWithCompression test
BrianMichell Jan 26, 2026
0d307c8
zarr3: Add GetSpecInfo rank tests for void access
BrianMichell Jan 26, 2026
5819c8a
zarr3: Add fill_value handling for void access
BrianMichell Jan 26, 2026
53ced58
zarr3: Add structured type support for void access
BrianMichell Jan 26, 2026
13cae40
zarr3: Enhance structured type tests and add GetSpecInfo test
BrianMichell Jan 26, 2026
cfea1dd
zarr3: Add OpenAsVoidIncompatibleMetadata test
BrianMichell Jan 26, 2026
dda05a8
zarr3: Add OpenAsVoidWithSharding test
BrianMichell Jan 26, 2026
d609dd8
zarr3: Fix schema.yml field/open_as_void documentation for consistenc…
BrianMichell Jan 26, 2026
5d849f6
zarr3: Add explicit implicit_lower_bounds in GetExternalToInternalTra…
BrianMichell Jan 26, 2026
1298bcb
zarr3: Add assertion in DecodeChunk for void access field count
BrianMichell Jan 26, 2026
e197bc6
Merge pull request #7 from BrianMichell/v3_open_as_void_validation
BrianMichell Jan 26, 2026
72968e8
zarr3: Add contiguity assertions for encode/decode chunk operations
BrianMichell Jan 26, 2026
14546a1
zarr3: Use CopyArray for safe structured type encode/decode
BrianMichell Jan 26, 2026
faf4d4f
zarr3: Use ComputeStrides utility for stride computation
BrianMichell Jan 26, 2026
f0a5dbc
zarr3: Use DimensionSet::UpTo and std::fill_n/std::copy_n utilities
BrianMichell Jan 26, 2026
ac98313
zarr3: Fix open_as_void with sharding for non-structured types
BrianMichell Jan 26, 2026
2d7f34c
zarr3: Remove redundant member variables in ZarrShardSubChunkCache
BrianMichell Jan 26, 2026
d139d87
Merge pull request #8 from BrianMichell/v3_review
BrianMichell Jan 26, 2026
a20a686
Fix includes.
BrianMichell Feb 3, 2026
e9ac828
Fix indentation
BrianMichell Feb 3, 2026
858e40d
Fix imports.
BrianMichell Feb 3, 2026
be1ab7c
friend inline the equality and inequality operator overloads.
BrianMichell Feb 3, 2026
24e16c2
Prefer absl::StrFormat over tensorstore::StrCat
BrianMichell Feb 3, 2026
f9c6750
Add return type annotation to lambdas.
BrianMichell Feb 3, 2026
6a773e2
Update key generation to handle grid indices safely by ensuring the s…
BrianMichell Feb 3, 2026
6028b5b
Prefer `empty()` over `size()`
BrianMichell Feb 4, 2026
0cb0637
Refactor `tensorstore::StrCat` to `absl::StrFormat`. Resolves https:/…
BrianMichell Feb 6, 2026
45d02ba
Merge branch 'master' into v3_structs_and_void
BrianMichell Feb 6, 2026
6ba070f
Use stringify for spans as well.
BrianMichell Feb 6, 2026
caa6610
Merge branch 'master' into v3_structs_and_void
BrianMichell Feb 26, 2026
6917f31
Merge branch 'master' into v3_structs_and_void
BrianMichell Mar 16, 2026
7a89ad9
Update to support final state of `struct` and `structured` zarr-exten…
BrianMichell Mar 16, 2026
90c0b72
Add documentation for open_as_void
BrianMichell Mar 16, 2026
2d9b893
Revert "Add documentation for open_as_void"
BrianMichell Mar 16, 2026
83f9982
Fix to use appropriate lambda
BrianMichell Mar 16, 2026
1b71e73
Resolve https://github.com/google/tensorstore/pull/271#discussion_r29…
BrianMichell Mar 18, 2026
4f79bc9
Deslop
BrianMichell Mar 18, 2026
3c8590a
Resolve https://github.com/google/tensorstore/pull/271#discussion_r29…
BrianMichell Mar 18, 2026
5314706
Expand sharding tests for struct dtype and fix errors
BrianMichell Mar 19, 2026
d5f9913
Consolidate redundent code
BrianMichell Mar 19, 2026
f7a0d72
Add TODO for open as void validation
BrianMichell Mar 19, 2026
c649713
Update fixture names
BrianMichell Mar 19, 2026
c01106f
Remove accidental commit to zarr driver test
BrianMichell Mar 20, 2026
ada7d09
Remove improper shape parameter support
BrianMichell Mar 20, 2026
2e861e1
Merge branch 'master' into v3_structs_and_void
BrianMichell Mar 20, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 22 additions & 2 deletions tensorstore/driver/zarr3/BUILD
Original file line number Diff line number Diff line change
Expand Up @@ -96,8 +96,8 @@ tensorstore_cc_library(

tensorstore_cc_library(
name = "metadata",
srcs = ["metadata.cc"],
hdrs = ["metadata.h"],
srcs = ["metadata.cc", "dtype.cc"],
hdrs = ["metadata.h", "dtype.h"],
deps = [
":default_nan",
":name_configuration_json_binder",
Expand Down Expand Up @@ -146,6 +146,23 @@ tensorstore_cc_library(
],
)

tensorstore_cc_test(
name = "dtype_test",
size = "small",
srcs = ["dtype_test.cc"],
deps = [
":metadata",
"//tensorstore:data_type",
"//tensorstore:index",
"//tensorstore/internal/testing:json_gtest",
"//tensorstore/util:status_testutil",
"@abseil-cpp//absl/status",
"@abseil-cpp//absl/strings",
"@googletest//:gtest_main",
"@nlohmann_json//:json",
],
)

tensorstore_cc_test(
name = "driver_test",
size = "small",
Expand Down Expand Up @@ -203,10 +220,12 @@ tensorstore_cc_library(
srcs = ["chunk_cache.cc"],
hdrs = ["chunk_cache.h"],
deps = [
":metadata",
"//tensorstore:array",
"//tensorstore:array_storage_statistics",
"//tensorstore:batch",
"//tensorstore:box",
"//tensorstore:contiguous_layout",
"//tensorstore:index",
"//tensorstore:index_interval",
"//tensorstore:rank",
Expand All @@ -223,6 +242,7 @@ tensorstore_cc_library(
"//tensorstore/internal:intrusive_ptr",
"//tensorstore/internal:lexicographical_grid_index_key",
"//tensorstore/internal:regular_grid",
"//tensorstore:strided_layout",
"//tensorstore/internal:storage_statistics",
"//tensorstore/internal/cache",
"//tensorstore/internal/cache:chunk_cache",
Expand Down
Loading