All issues

[banking_knowledge] Evaluator crashes on tasks 026/028: time-dependent tool result breaks replay-based grading

#387

· scott-memco opened

on Jul 8, 2026

No-op and missing reward checks in airline/retail tasks allow false-positive rewards

#384

· anirudhvenu opened

on Jul 4, 2026

`@api_retry` on `transcribe_audio` is dead code — inner try/except swallows all exceptions

#383

· chirag127 opened

on Jul 4, 2026

Banking task 82 / T082: gold secures only one of two debit cards carrying confirmed fraud

#372

· mohitunplugged opened

on Jun 28, 2026

Fix Mei Kovacs known_info to use name instead of user_id in retail tasks

#337

· junuMoon opened

on May 28, 2026

Several retail tasks reward success even when the listed calculate(...) action is absent

#327

· gss10282023 opened

on May 19, 2026

Several retail tasks may have an unclear contract around helper read actions and rewarded success

#326

· gss10282023 opened

on May 19, 2026

Retail task 100 / modify_pending_order_items may be order-sensitive in evaluation

#325

· gss10282023 opened

on May 19, 2026

Retail task 105 / T105: infeasible gold exchange is still rewarded as success

#321

· gss10282023 opened

on May 17, 2026

Retail task 50 / T50: missing required human handoff is still rewarded as success

#320

· gss10282023 opened

on May 17, 2026

Retail task 41 / T41: DB oracle hardcodes PayPal even though the user selected credit_card_9503061

#319

· gss10282023 opened

on May 17, 2026

Retail task 36 / T36: `modify_pending_order_items` appears to reuse the last replacement variant for all modified items

#318

· gss10282023 opened

on May 17, 2026