SparkException: Python worker exited unexpectedly (crashed)

[nikimonjazeb]

Error for profiling: /data/Niki/k-divided/kaggle-short32
err-short32.txt

[8879700760]

@nikimonjazeb, how you resolve this issue? pls share the solution for this.