releases.shpreview

Research Index beats arXivQA benchmark by 18%

1 featureThis release1 featureNew capabilitiesAI-tallied from the release notes

Firecrawl Research Index is a specialized index for agents pushing the frontier of AI/ML research with state-of-the-art recall on arXivQA, outperforming the next best provider by 18% at comparable cost.

Key features:

  • Benchmark-leading performance — 53.3% recall on arXivQA versus 45.4% for the next best provider. 0.750 MRR puts the right paper in the top one or two results.
  • Search millions of papers alongside their code — 3M+ arXiv papers plus GitHub artifacts from top research repos (issues, merged PRs, READMEs), refreshed daily.
  • Complete toolset for research loops — Agents can retrieve papers, verify claims against full text, and pull code, going from literature to implementation with no manual review.
  • Plugs into any agent harness — Works with Codex, Claude Code, Grok Build, and more.
Research Index

Fetched June 25, 2026