AI Scientist Bench
All configurations / K-Dense package

K-Dense literature-review

1/9 dimensions tested
Sonnet 5
Configuration
Upstream SKILL.md and references, pinned at 330c8e7, explicitly supplied.
Source
campaign/skill_snapshots/kdense-330c8e7/skills/literature-review
Recorded runs
7 scored outputs · $0.22 measured model spend · runs on 2026-09-15
Access
open prompt · standard tools
FIG. 01

By dimension

Scores /10 · Paired p-values are exploratory and unadjusted
Verify

Not yet tested.

Ground

Not yet tested.

4.38Find
Compared with baselinen=4 · recall@5 · Δ ±0.00 vs BM25 top-20 + rerank · 0W 0L 4T on 4 paired · p=1.000 (unadjusted) · $0.0336/task · 3.6s/task · 2026-09-15

headline; 4 tasks, 4 source clusters; 0 failed attempts kept in the denominator; free BM25 0.354; candidate oracle 0.500; 2 of 4 pools reachable Test: exact sign test on discordant pairs; n too small for a winner.

Run provenance

Report path: outputs/campaign/20260915/summary.json
Task pack: campaign-dev-20260915
Run: campaign-v3

  • targeted recoverable misses10.00 · n=2 · Δ ±0.00 · p=1.000 (unadjusted) · $0.0322 · 2026-09-15 · targeted recoverable misses; 2 tasks, 2 source clusters; 0 failed attempts kept in the denominator; free BM25 0.000; candidate oracle 1.000; 2 of 2 pools reachable
  • retrieval-ceiling control10.00 · n=1 · Δ ±0.00 · p=1.000 (unadjusted) · $0.0257 · 2026-09-15 · retrieval-ceiling control; 1 tasks, 1 source clusters; 0 failed attempts kept in the denominator; free BM25 1.000; candidate oracle 1.000; 1 of 1 pools reachable
Extract

Not yet tested.

Analyze

Not yet tested.

Compute

Not yet tested.

Synthesize

Not yet tested.

Review

Not yet tested.

Hypothesize

Not yet tested.