Skip to content

Release 0.28.0: Add support for Pyspark 4

Choose a tag to compare

View all tags
@cosmicbboy cosmicbboy released this 06 Jan 20:37
· 235 commits to main since this release
v0.28.0
82096dd
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

⭐️ Highlight

Pandera now supports Pyspark 4 🚀

What's Changed

  • refactor(pyspark): restructure pyspark components by @ELC in #2007
  • add support for pyspark 4 by @cosmicbboy in #2193
  • Decouple import dependencies for io serialization formats by @cosmicbboy in #2195
  • Use get_annotations instead of direct __annotations__ access by @amerberg in #2196
  • Re-implement improvements to str_length check by @cosmicbboy in #2198
  • Support the Decimal data type in the Ibis engine by @deepyaman in #2194
  • Update .git-blame-ignore-revs to add Ruff refactor by @deepyaman in #2199
  • Avoid full materialization of levels in failing MultiIndex validations by @amerberg in #2187
  • schema descriptor should raise AttributeError if build_schema_ is not implemented by @amerberg in #2197

New Contributors

  • @ELC made their first contribution in #2007

Full Changelog: v0.27.1...v0.28.0

Contributors

amerberg, cosmicbboy, and 2 other contributors
Assets 2
Loading