wip: [AURON #1676] Enable native BatchScanExec for Iceberg COW tables #1677
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| @@ -0,0 +1,68 @@ | |||
| # | |||
| # Licensed to the Apache Software Foundation (ASF) under one or more | |||
Contributor
Author
There was a problem hiding this comment.
Borrowed from #1541 as its not merged in yet.
added 2 commits
November 29, 2025 23:50
This comment was marked as duplicate.
This comment was marked as duplicate.
Sorry, something went wrong.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Which issue does this PR close?
Note: This is a WIP PR, I'm still working on testing the support and also only allowing reads from COW tables.
Closes #1676
Rationale for this change
Auron currently does not support native execution for Iceberg DSv2 reads backed by BatchScanExec, so all Iceberg scans fall back to Spark execution. This change enables native execution for Iceberg COW table scans to unlock native file scan performance for Parquet/ORC Iceberg workloads.
What changes are included in this PR?
Are there any user-facing changes?
Yes. When enabled via configuration, Iceberg COW table scans can now run through native execution. No behavior change when the feature flag is disabled.
How was this patch tested?