Skip to content

A6 — Equity & Research pack fixtures - #7

Merged
jonathanbbechtel merged 1 commit into
mainfrom
feature/a6-equity-research-pack
Jun 2, 2026
Merged

A6 — Equity & Research pack fixtures#7
jonathanbbechtel merged 1 commit into
mainfrom
feature/a6-equity-research-pack

Conversation

@jonathanbbechtel

Copy link
Copy Markdown
Contributor

Summary

  • Expands spec.RESEARCH_REFS from 3 to 10 real, citable published tutoring/intervention studies (R1–R10), with 3 entries carrying non-null contradicts_claim to support Track 5 mixed-evidence tasks.
  • Generates fixtures/pack_equity_research/ via generator.py --seed 42 --pack equity_research: subgroup attendance + outcomes CSVs, research_refs.json (10 entries), program_context.json, and manifest.json. Deletes .gitkeep.
  • Authors docs/dataset_cards/pack_equity_research.md documenting subgroup variance, intentional low-N suppression, IEP disparity, and research reference structure.

Implements platform-ai#574.

Signals embedded

  • AIAN low-N suppression (Track 4): AIAN n=3 per month (< threshold of 10); suppressed in all 3 months. Also suppressed: NHPI (n=4), TwoOrMore (n=7), Unknown (n=1), NB (n=6), U (n=6).
  • IEP attendance disparity (Track 4): IEP=true avg attendance 68.5% vs IEP=false 82.5% — realized gap ~14 pp (spec penalty is 11 pp; seed-42 stochastic variation adds ~3 pp).
  • Research refs (Track 5): 10 references; R2 (Robinson et al.), R4 (Fryer), R10 (Vaughn et al.) carry contradicts_claim.

Test plan

  • All 81 existing unit tests pass (pytest)
  • ruff check . — no issues
  • ruff format --check . — all formatted
  • pre-commit run --all-files — all hooks pass (including mypy)
  • research_refs.json validated: 10 entries, all with required fields, 3 with non-null contradicts_claim
  • pack_operations and pack_outcomes NOT regenerated — only pack_equity_research committed
  • Numeric signal constants in spec.py unchanged (AIAN_TARGET_N, IEP_ATTENDANCE_PENALTY, etc.)

🤖 Generated with Claude Code

…s + dataset card (A6)

Expands spec.RESEARCH_REFS from 3 to 10 real, citable tutoring/intervention studies
(Nickow et al. 2020, Robinson et al. 2021, Morgan et al. 2008, Fryer 2014, Cook et al.
2015, Kraft & Falken 2021, Guryan et al. 2023, Pellegrini et al. 2018, Dietrichson et
al. 2017, Vaughn et al. 2012).  Generates fixtures/pack_equity_research/ with subgroup
attendance and outcomes tables embedding the AIAN low-N suppression signal and IEP
attendance disparity signal.  Authors docs/dataset_cards/pack_equity_research.md.
All 81 unit tests pass; ruff, mypy, and pre-commit clean; pack_operations and
pack_outcomes not regenerated.
@pearleng-atlantis

Copy link
Copy Markdown
Error: This repo is not allowlisted for Atlantis.

@jonathanbbechtel
jonathanbbechtel merged commit fb36469 into main Jun 2, 2026
2 checks passed
@jonathanbbechtel
jonathanbbechtel deleted the feature/a6-equity-research-pack branch June 2, 2026 17:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants