Skip to content

feat(cubestore): Enable ZSTD compression for Parquet file#10584

Open
kunalpatange wants to merge 1 commit intocube-js:masterfrom
kunalpatange:feat/zstd-parquet-compression
Open

feat(cubestore): Enable ZSTD compression for Parquet file#10584
kunalpatange wants to merge 1 commit intocube-js:masterfrom
kunalpatange:feat/zstd-parquet-compression

Conversation

@kunalpatange
Copy link
Copy Markdown

Problem

Cube Store writes Parquet files without explicit compression, relying on datafusion's default behavior. This results in
larger file sizes, which impacts performance when:

  • Transferring pre-aggregation results from remote storage (S3, GCS, etc.)
  • Storing intermediate computation results locally

Changes Made

  • Add .set_compression(datafusion::parquet::basic::Compression::ZSTD) to Parquet writer properties
  • Single-line change in ParquetTableStore::writer_props() method
  • No breaking changes or API modifications

@kunalpatange kunalpatange requested a review from a team as a code owner March 30, 2026 16:32
@github-actions github-actions bot added cube store Issues relating to Cube Store rust Pull requests that update Rust code pr:community Contribution from Cube.js community members. labels Mar 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cube store Issues relating to Cube Store pr:community Contribution from Cube.js community members. rust Pull requests that update Rust code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant