$ cat models/gpt-6-astra
GPT-6 Astra
OpenAI
Check that an endpoint selling GPT-6 Astra really serves it. A test compares the endpoint's answers with answers collected from OpenAI, through OpenRouter pinned to OpenAI.
- Official Provider
- OpenAI, through OpenRouter pinned to OpenAI
- Reference Answers
- 1,000
- Declared Precision
- closed model
- Checks
- Identity
- Reference Data Updated
- 2026-10-16
How Well a Test Works
Size
Requests
Genuine Confirmed
Wrongly Flagged
Substitutes Caught
Standard
80
28.7%
0.5%
59.2% · hardest GPT-6.1 Sol
Thorough
160
84.7%
0.5%
93.8% · hardest GPT-6.1 Sol
Simulated from the reference answers. A substitute that isn't caught ends inconclusive: it is never confirmed as this model.
- GPT-6 Astra and GPT-6.1 Sol answer almost alike: at Standard a genuine endpoint is confirmed in only 28.7% of tests, at Thorough in 84.7%. The rest end inconclusive; neither model is ever confirmed in the other's place. Test it at Thorough.
- No refusal check: GPT-6 Astra's weights aren't published, so nobody can abliterate it.
- No competence check yet: the competence check needs hard tasks collected from the official provider, which this model doesn't have.