Skip to content

Create Or Replace with Iceberg V3 Row lineage #14968

@Rizxcviii

Description

@Rizxcviii

Query engine

Spark running AWS Glue

Question

For a create or replace operation, does Iceberg V3 maintain row lineage.

Sometimes, we may have iceberg tables that are refreshed from a source table, and using an operation similar to create or replace might be beneficial to use for efficiency.

But of course, row lineage will need to be taken into account.

If create or replace does not maintain row lineage, would insert overwrite work instead?

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions