Skip to content

Track Iceberg v3 Feature Support (Roadmap for 0.4.0) #637

Description

@zhjwpku

We already have partial support for Iceberg v3 in the codebase (e.g., Row Lineage and partition statistics). However, a number of key v3 features are still missing.

This issue serves as a parent tracking issue for the remaining v3 work we plan to (partially) include in the 0.3.0 release.

If you are interested in working on any of the items below, please open a dedicated sub-issue and link it back to this one.

V3 related

1. Schema-Level Support for New v3 Types

Add support for all newly introduced v3 types at the schema level, including:

2. Column Default Values (Schema Evolution)

Enable schema evolution with default values:

3. Multi-Argument Transforms (Not planned, as they are not supported by the Java implementation)

4. Binary Deletion Vectors

Add support for deletion vectors (DV):

5. Table-Level Encryption Metadata (Not planned for 0.4.0) @shangxinli

Support encryption-related metadata defined in v3:

  • Parse and preserve encryption metadata

6. Puffin-Based Statistics (Not planned for 0.4.0)

Support table and partition statistics stored in Puffin files:

  • Metadata parsing
  • Optional integration into scan planning

Table update and maintenance: #364

Miscellaneous

If anything is missing or you have suggestions, feel free to comment or open additional sub-issues.

Activity

  1. changed the title [-]Track Iceberg v3 Feature Support (Target: 0.3.0)[/-] [+]Track Iceberg v3 Feature Support (Target: 0.4.0)[/+] on May 5, 2026
  2. manuzhang commented on May 21, 2026

    @manuzhang
    Member

    @zhjwpku Can you help to link #665 here as sub-issue? I don't think I have the permission to do so.

  3. manuzhang commented on May 21, 2026

    @manuzhang
    Member

    @zhjwpku Meanwhile, it might be valuable to create a milestone 0.4.0 to track all issues?

  4. zhjwpku commented on May 21, 2026

    @zhjwpku
    CollaboratorAuthor

    @zhjwpku Meanwhile, it might be valuable to create a milestone 0.4.0 to track all issues?

    Good suggestion. We haven't used milestones for previous releases, but I think we should start doing that for future releases. Let me try that.

  5. zhjwpku commented on May 21, 2026

    @zhjwpku
    CollaboratorAuthor

    @zhjwpku Meanwhile, it might be valuable to create a milestone 0.4.0 to track all issues?

    Good suggestion. We haven't used milestones for previous releases, but I think we should start doing that for future releases. Let me try that.

    Oh, I don't have permission to create milestones. Let's wait for @wgtmac to handle this. I'm not sure if we should do this after the 0.3.0 release.

  6. wgtmac commented on May 21, 2026

    @wgtmac
    Member
  7. wgtmac commented on May 21, 2026

    @wgtmac
    Member

    I think we don't need to support 5. Table-Level Encryption Metadata and 6. Puffin-Based Statistics at the moment.

  8. zhjwpku commented on May 21, 2026

    @zhjwpku
    CollaboratorAuthor

    I think we don't need to support 5. Table-Level Encryption Metadata and 6. Puffin-Based Statistics at the moment.

    Added a comment noting that this is not planned for 0.4.0.

  9. pinned this issue on May 22, 2026
  10. zhjwpku commented on Jun 6, 2026

    @zhjwpku
    CollaboratorAuthor

    I've moved the unfinished items from Roadmap for 0.3.0 (#523) into this issue. Feel free to ping me if I missed anything.

    I've also linked the iceberg-go V3 tracking issue [1] here so we can keep track of any V3-related work we might otherwise miss.

    [1] apache/iceberg-go#589

  11. changed the title [-]Track Iceberg v3 Feature Support (Target: 0.4.0)[/-] [+]Track Iceberg v3 Feature Support (Roadmap for 0.4.0)[/+] on Jun 6, 2026
  12. 33 remaining items

  13. manuzhang commented on Jul 21, 2026

    @manuzhang
    Member

    @zhjwpku @wgtmac I've labeled all open PRs planned here with 0.4.0 milestone. Let's prioritize reviewing them and getting them in.

  14. modified the milestones: 0.4.0, 0.5.0 on Sep 22, 2026
  15. manuzhang commented on Sep 23, 2026

    @manuzhang
    Member

    Remaining items not landing in 0.4.0 (variant, applying column defaults, RewriteManifests, CherryPickOperation, plus the unplanned encryption metadata and Puffin statistics work) are now tracked in #959 for the 0.5.0 milestone.

  16. manuzhang commented on Sep 23, 2026

    @manuzhang
    Member

    @zhjwpku I've moved remaining items to #959 for 0.5.0 and will close this as completed for 0.4.0. Thanks!

  17. shangxinli commented on Oct 9, 2026

    @shangxinli
    Contributor

    #988 is created for table encryption

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions