Issue resolution, held-out checks, and patch inspection.
The broad historical reference runs, not the later one-case diagnostics. These use modeled/mock generation and are not empirical evidence of current agent performance. Each track retains its own date, model labels and scoring history.
The retained full modeled matrix covers six issues. The captured collection separately covers eleven issues.
| Issue | Harness | Composite | Strict | Hidden | Held-out | Regression | Minimality | Backend |
|---|
Inspect the evidence
mathlib.calc.sum_evens(nums) should return the sum of the EVEN numbers in nums, but it currently returns the sum of the odd numbers. Fix it so even numbers are summed (and an empty list sums to 0).Open scored results ↓
ds.stack.Stack is meant to be a last-in-first-out stack, but Stack.pop() removes the OLDEST item instead of the most recently pushed one. Fix pop() so the stack is LIFO; popping an empty stack should raise IndexError.Open scored results ↓
textutil.slug.slugify(s) should produce a URL slug: lowercase, words separated by single hyphens, with all non-alphanumeric characters removed and no leading/trailing hyphens. It currently only replaces spaces with hyphens. Fix it to fully normalize the string.Open scored results ↓
pagelib.page.page_count(total, per_page) should return the number of pages needed to show `total` items at `per_page` per page, rounding up for a partial last page. It currently uses integer division, dropping the final partial page. Fix it (0 items is 0 pages).Open scored results ↓
countlib.words.word_count(text) should count word frequencies case-insensitively, returning a dict of lowercase word -> count. It currently counts case-sensitively, so 'The' and 'the' are separate keys. Fix it to fold case.Open scored results ↓
numlib.clamp.clamp(x, lo, hi) should constrain x to the inclusive range [lo, hi]. It currently applies only the upper bound, so values below lo pass through unchanged. Fix it to apply both.Open scored results ↓
Inspect the evidence