feat: Iceberg V2 delete file support in druid-iceberg-extensions#19266

Open

Shekharrajak wants to merge 26 commits intoapache:masterfrom

Shekharrajak:feature/iceberg-v2-delete-support

Commits on Apr 6, 2026

add V2DeleteHandling enum for iceberg v2 delete file support
Shekharrajak
committed
add iceberg-data dependency and promote iceberg-parquet to compile scope
Shekharrajak
committed
implement IcebergRecordConverter for iceberg Record to Druid map conversion
Shekharrajak
committed
implement streaming IcebergNativeRecordReader with v2 delete support
Shekharrajak
committed
add FileScanResult and extractFileScanTasks to IcebergCatalog for v2 delete detection
Shekharrajak
committed
wire v2DeleteHandling into IcebergInputSource with native reader routing
Shekharrajak
committed
add unit tests for IcebergRecordConverter and V2DeleteHandling
Shekharrajak
committed
fix compilation: use public Iceberg APIs and correct Druid method signatures
Shekharrajak
committed
fix test compilation and all test failures for v2 delete handling
Shekharrajak
committed
cleanup temporary settings file
Shekharrajak
committed
remove V2DeleteHandling config and add auto-detect routing in IcebergInputSource
Shekharrajak
committed
add DeleteFileInfo POJO for serializable delete file metadata
Shekharrajak
committed
add IcebergFileTaskInputSource for per-task serializable v2 input source
Shekharrajak
committed
rewrite IcebergNativeRecordReader with manual positional and equality delete application
Shekharrajak
committed
add CompositeInputSourceReader for multi-task v2 reading in IcebergInputSource
Shekharrajak
committed
register IcebergFileTaskInputSource in IcebergDruidModule
Shekharrajak
committed
update all tests for auto-detect v2 architecture without V2DeleteHandling config
Shekharrajak
committed
fix missing Iterator import in IcebergInputSource
Shekharrajak
committed
docs: add iceberg v2 delete file support documentation
Shekharrajak
committed
fix checkstyle, strict compilation, and double-brace initialization errors
Shekharrajak
committed
add v2 table creation overload to IcebergRestCatalogResource
Shekharrajak
committed
add IcebergV2DeleteIngestionTest with equality, positional, mixed, and no-delete scenarios
Shekharrajak
committed
fix IT compilation: correct GenericParquetWriter method reference and verifySqlQuery signature
Shekharrajak
committed
fix dependency:analyze by scoping iceberg-data as runtime and adding to ignored list
Shekharrajak
committed
remove stray processing/.factorypath IDE artifact
Shekharrajak
committed
remove all stray .factorypath IDE artifacts from tracking
Shekharrajak
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: Iceberg V2 delete file support in druid-iceberg-extensions#19266

feat: Iceberg V2 delete file support in druid-iceberg-extensions#19266
Shekharrajak wants to merge 26 commits intoapache:masterfrom
Shekharrajak:feature/iceberg-v2-delete-support

Commits on Apr 6, 2026

add V2DeleteHandling enum for iceberg v2 delete file support

add iceberg-data dependency and promote iceberg-parquet to compile scope

implement IcebergRecordConverter for iceberg Record to Druid map conversion

implement streaming IcebergNativeRecordReader with v2 delete support

add FileScanResult and extractFileScanTasks to IcebergCatalog for v2 delete detection

wire v2DeleteHandling into IcebergInputSource with native reader routing

add unit tests for IcebergRecordConverter and V2DeleteHandling

fix compilation: use public Iceberg APIs and correct Druid method signatures

fix test compilation and all test failures for v2 delete handling

cleanup temporary settings file

remove V2DeleteHandling config and add auto-detect routing in IcebergInputSource

add DeleteFileInfo POJO for serializable delete file metadata

add IcebergFileTaskInputSource for per-task serializable v2 input source

rewrite IcebergNativeRecordReader with manual positional and equality delete application

add CompositeInputSourceReader for multi-task v2 reading in IcebergInputSource

register IcebergFileTaskInputSource in IcebergDruidModule

update all tests for auto-detect v2 architecture without V2DeleteHandling config

fix missing Iterator import in IcebergInputSource

docs: add iceberg v2 delete file support documentation

fix checkstyle, strict compilation, and double-brace initialization errors

add v2 table creation overload to IcebergRestCatalogResource

add IcebergV2DeleteIngestionTest with equality, positional, mixed, and no-delete scenarios

fix IT compilation: correct GenericParquetWriter method reference and verifySqlQuery signature

fix dependency:analyze by scoping iceberg-data as runtime and adding to ignored list

remove stray processing/.factorypath IDE artifact

remove all stray .factorypath IDE artifacts from tracking