$ cat models/deepseek-v4.1-flash-1017
DeepSeek V4.1 Flash 1017
DeepSeek
Check that an endpoint selling DeepSeek V4.1 Flash 1017 really serves it. A test compares the endpoint's answers with answers collected from DeepSeek, through OpenRouter pinned to DeepSeek.
- Official Provider
- DeepSeek, through OpenRouter pinned to DeepSeek
- Reference Answers
- 600
- Declared Precision
- not disclosed
- Official Release
- fp8, 32x32 blocks, experts fp4
- Checks
- Identity · Refusals (2 probes)
- Reference Data Updated
- 2026-10-22
How Well a Test Works
Size
Requests
Genuine Confirmed
Wrongly Flagged
Substitutes Caught
Standard
80
99.5%
0.5%
99.8% · hardest DeepSeek V4.1 Flash
Thorough
160
99.5%
0.5%
100.0%
Simulated from the reference answers. A substitute that isn't caught ends inconclusive: it is never confirmed as this model.
- No competence check yet: the competence check needs hard tasks collected from the official provider, which this model doesn't have.