$ cat models/claude-sonnet-5
Claude Sonnet 5
Anthropic
Check that an endpoint selling Claude Sonnet 5 really serves it. A test compares the endpoint's answers with answers collected from Anthropic, through OpenRouter pinned to Anthropic.
- Official Provider
- Anthropic, through OpenRouter pinned to Anthropic
- Reference Answers
- 1,000
- Declared Precision
- closed model
- Checks
- Identity
- Reference Data Updated
- 2026-10-16
How Well a Test Works
Size
Requests
Genuine Confirmed
Wrongly Flagged
Substitutes Caught
Standard
80
99.5%
0.5%
100.0%
Thorough
160
99.5%
0.5%
100.0%
Simulated from the reference answers. A substitute that isn't caught ends inconclusive: it is never confirmed as this model.
- No refusal check: Claude Sonnet 5's weights aren't published, so nobody can abliterate it.
- No competence check yet: the competence check needs hard tasks collected from the official provider, which this model doesn't have.