Add str_length built-in check for PySpark backend#1709
Conversation
Signed-off-by: Marc Rovira <marc.rovira@electrolux.com>
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #1709 +/- ##
==========================================
- Coverage 94.28% 93.46% -0.82%
==========================================
Files 91 117 +26
Lines 7013 8856 +1843
==========================================
+ Hits 6612 8277 +1665
- Misses 401 579 +178 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
|
thanks @marrov ! please run pre-commit to fix linter errors: https://pandera.readthedocs.io/en/stable/CONTRIBUTING.html#set-up-pre-commit |
Signed-off-by: Marc Rovira <54272586+marrov@users.noreply.github.com>
Yes, sorry for that I added it too hastily. Should be fixed now @cosmicBboy. |
|
thanks @marrov ! sorry to extend this a little longer, but this check needs unit tests, which can live here: https://github.com/unionai-oss/pandera/blob/main/tests/pyspark/test_pyspark_check.py |
|
Opened a new PR: #2288 as this PR fails CI tests, and seems to be abandoned since last 2 years. |
Adds a builtin-check for
str_lengthfor the pyspark.sql backend, solving these issues: