Skip to content

feat(dependencies): add databricks-runtime extra#1211

Draft
chifu1234 wants to merge 1 commit into
datacontract:mainfrom
chifu1234:main
Draft

feat(dependencies): add databricks-runtime extra#1211
chifu1234 wants to merge 1 commit into
datacontract:mainfrom
chifu1234:main

Conversation

@chifu1234
Copy link
Copy Markdown
Contributor

This new optional dependency group includes all the soda-core-spark, databricks-sql-connector, and databricks-sdk dependencies from the databricks extra, but excludes pyspark (provided by the Databricks Runtime environment).

Use pip install "datacontract-cli[databricks-runtime]" when running inside Databricks to avoid dependency conflicts.

Updated CHANGELOG.md and README.md with the new extra.

  • Tests pass (uv run pytest)
  • Code formatted (uv run ruff check --fix && uv run ruff format)
  • README.md updated (if relevant)
  • CHANGELOG.md entry added

This new optional dependency group includes all the soda-core-spark,
databricks-sql-connector, and databricks-sdk dependencies from the
databricks extra, but excludes pyspark (provided by the Databricks
Runtime environment).

Use `pip install "datacontract-cli[databricks-runtime]"` when running
inside Databricks to avoid dependency conflicts.

Updated CHANGELOG.md and README.md with the new extra.
@jschoedl
Copy link
Copy Markdown
Collaborator

jschoedl commented May 6, 2026

This should resolve a conflict with pyspark, right? But soda-core-spark-df==3.5.6 (which you included) pulls in pyspark==3.5.8 anyways...

Can you name the exact conflict you are experiencing?

@jschoedl jschoedl marked this pull request as draft May 6, 2026 07:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants