refactor!: compositional pipeline API, path-free engine, and pipeline unification#452

Open

sjawhar wants to merge 46 commits intomainfrom

pipeline-unification-v2

Commits on Feb 25, 2026

docs: compositional pipeline API design — @stage + handle-based DAG composition
sjawhar
committed
docs: stage decorator return type analysis design
sjawhar
committed
feat(compose): bridge Pipeline.build() to RegistryStageInfo
sjawhar
committed
refactor!: remove annotation-parsing registration path
sjawhar
committed
fix(compose): infer input format from type, reject StageParams in unions, auto-format metrics/plots
sjawhar
committed
refactor!: path-free engine core — ArtifactIdentity in DAG/worker/lock/state/skip
sjawhar
committed
refactor!: complete ArtifactIdentity migration across all modules
sjawhar
committed
feat(cli): add identity-based target resolution for CLI commands
sjawhar
committed
refactor: simplify DAG graph construction and registry stage info
sjawhar
committed
fix(show): resolve data identity paths

sjawhar
and
sisyphus-dev-ai
committed
fix(cli): resolve diff identity targets

sjawhar
and
sisyphus-dev-ai
committed
fix(cli): resolve checkout identity targets via workspace store

sjawhar
and
sisyphus-dev-ai
committed
fix(cli): resolve verify and sync targets via identity keys
sjawhar
committed
fix(cli): resolve restore, completion, and display via identity keys
sjawhar
committed
test: expand identity resolution coverage (edge cases, None store, metrics filtering)
sjawhar
committed
fix(cli): re-raise identity validation errors in diff instead of falling through to path
sjawhar
committed
fix(cli): remove duplicate pathlib import in verify, defer pipeline discovery in completion
sjawhar
committed
Fix console explain crash: use 'identity' key for DepChange
sjawhar
committed
fix: propagate external input bindings from compose to store
sjawhar
committed
feat: add presentation layer for CAS ref symlinks
sjawhar
committed
docs: add path-free engine completion plan
sjawhar
committed
fix(compose): preserve key for single-field TypedDict outputs
sjawhar
committed
fix: namespace loader fingerprint keys per output, show code changes with missing deps
sjawhar
committed
refactor: always prefix stage names with pipeline_name/ at build time
sjawhar
committed
feat(compose): allow cross-pipeline artifact handles

sjawhar
and
sisyphus-dev-ai
committed
feat(compose): add cross-pipeline artifact handle support
sjawhar
committed
refactor(compose): make build() non-mutating — compute qualified names locally

sjawhar
and
sisyphus-dev-ai
committed
fix(compose): qualify stage producer names unconditionally in _handle_to_artifact_ref

sjawhar
and
sisyphus-dev-ai
committed
feat(compose): collect upstream closure and emit foreign stages in build()
sjawhar
committed
feat(compose): merge foreign input bindings with conflict detection
sjawhar
committed
test(compose): add transitive, list, state_dir, and pipeline-cycle edge case tests
sjawhar
committed
fix: sort imports and remove unused variable in test_compose.py
sjawhar
committed
fix(compose): filter self-handles in DFS walk, deduplicate closure traversal, extract helpers
sjawhar
committed
fix(pipeline): skip duplicate stages in include() for cross-pipeline --all discovery
sjawhar
committed
refactor!: complete pipeline unification — remove imperative API, DVC import, matrix

sjawhar
and
sisyphus-dev-ai
committed
feat(compose): scope variant call counts per variant context

sjawhar
and
sisyphus-dev-ai
committed
fix(explain): resolve deps through store instead of treating identity keys as paths

sjawhar
and
sisyphus-dev-ai
committed
test: update tests for pipeline unification, add variant and orphan coverage

sjawhar
and
sisyphus-dev-ai
committed
fix(cli): return non-zero exit on repro/run stage failure
sjawhar
committed
fix(skip): check output existence in explain path to match engine behavior
sjawhar
committed
fix(verify): check output file existence for producing stage
sjawhar
committed
fix(checkout): accept stage identity keys as targets
sjawhar
committed
fix(dag): collect all dependency errors and isolate per-pipeline with --keep-going
sjawhar
committed
feat(cli): add --all support to run, diff, metrics, params
sjawhar
committed
fix(cli): unify show and history run record lookup
sjawhar
committed
fix(watch): handle missing paths gracefully in watch coordinator
sjawhar
committed