Skip to content

kernel <> datafusion expression conversion #3999

@roeap

Description

@roeap

Is your feature request related to a problem?

To properly leverage predicates for data skipping with delta kernel, we need to convert datafusion predicates to kernel ones.

To properly support arbitrary predicates, we need to also provide opaque expressions to cover expressions not within the kernel expression system.

Describe the solution you'd like

conversion functions between kernel and datafusion predicates.

Describe alternatives you've considered

No response

Priority

High - Important for my use case

Additional context

No response

Contribution

  • I'm willing to submit a pull request for this feature
  • I can help with testing this feature
  • I can help with documentation for this feature

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    Status

    No status

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions