Endpoint verification for LLM APIs
Is Your Endpoint Serving the Model It Claims?
Resellers and relays sell access to GPT, Claude, GLM, Kimi and more, sometimes far below the official price. llm-id.sh sends an endpoint a short set of questions, compares its answers with the ones the official provider gives, and tells you whether you get the real model, a cheaper substitute, a weakened copy or a mix.
Your API key is used for the test only and never stored.
What a Test Checks
IdentityWhich model answers. Each model has its own preferences on open questions, such as naming a random country; 80 or 160 short requests identify it.How it works CompetenceWhether it is served as well as by its official provider: a heavily quantized copy can get measurably more hard tasks wrong.How it works RefusalsWhether an open-weight model had its refusals removed, with benign requests the official model declines.How it works RoutingWhether requests go to more than one model, and whether the endpoint adds a system prompt of its own.How it works
How It Works
- 01Paste the endpoint's base URL, the model name and your key, and pick the model it claims to be.
- 02The test sends 80 short requests at Standard, or 160 at Thorough, and compares the answers with reference answers collected from the official provider.
- 03The report gives a verdict, how confident it is, and the evidence behind it. A genuine endpoint can get a public certificate with a badge for its site.
Verdicts
- GenuineThe answers match the claimed model, and the checks that ran found nothing wrong.
- InconclusiveNot enough evidence either way; a larger test settles it.
- DegradedThe claimed model, measurably weaker than at its official provider.
- SubstitutedThe answers match a different model, which the report names.
- Mixed RoutingRequests go to more than one model or backend.
- Unknown ModelNo model in the reference data fits the answers.
- AbliteratedThe claimed model with its refusals removed.
What each verdict means, and the evidence a report shows: Reading a Report.
26 Models from 10 Providers
All modelsReference answers come from each model's own provider, never from a reseller.
DeepSeek
Moonshot AI
Tencent
MiniMax
Alibaba
Google AI Studio
For Hosts
A genuine endpoint can get a public certificate, signed by llm-id.sh, and a badge for its site that anyone can check. Certificates and Badges.
Questions
- Is my API key stored?
- No. It's held in memory for the test and never written to disk or to the report.
- What does a test cost?
- The requests go to the endpoint on your key: 80 short questions at Standard, 160 at Thorough, plus the competence and refusal checks if you turn them on. Most answers are a few words.
- How sure is a verdict?
- Every verdict comes with its confidence. For most models a genuine endpoint is confirmed in 99.5% of simulated tests and wrongly flagged in 0.5%; the test form shows the rates for the model and size you pick.
- Can it tell the precision a model runs at?
- Not from the identity questions: quantization barely changes which answers a model prefers. The competence check measures what it does change.
- What if a model isn't listed?
- A model outside the list can't be named, only caught when its answers don't fit the model the endpoint claims.