Checks written once, run every time.
teleon.dev/docs/evaluators registers checks for schemas, text, service levels and metrics as code, pins them by content ID and runs them on every result at code speed and cost.
teleon.dev/docs/evaluatorsDeterministic evaluatorshttpsjsonmcp
Checks on one build
| Evaluator | Kind | Result |
|---|---|---|
| unit_tests_pass | metric | Pass |
| bundle_size_within_budget | metric | Pass |
| api_schema_valid | schema | Pass |
| p95_latency_slo | SLO | Watch |
Every check is code with a fixed ID, so the same build always gets the same verdict.
What it does
Written as code
JSON, CSV, text and service-level checks run the same way every time.
Pinned by content ID
An evaluator's ID changes only when its code changes.
Signed results
Each run returns an attestation for the evidence record.
The contract
An evaluator spec names its inputs, its rule and its pass condition.
KindsSchema, text, SLO, metric
IdentitySWHID per evaluator
ResultsSigned attestations
AccessRING-3 to read; RING-2 to register
Identifiers
det_evaluator_spec/v1
Execution contracts
Endpoints
| Method | Path | Access | What it does | Status |
|---|---|---|---|---|
GET | /v1/evaluators | RING-3 | Browse registered evaluators | |
POST | /v1/evaluators | RING-2 | Register an evaluator | |
POST | /v1/evaluators/{name}/run | RING-2 | Run an evaluator on a result |
Listed paths appear in the service’s published files today. In the one-host plan every path here is served under api.teleon.dev/v1/evaluators.
Words on this page
- Deterministic check
- A check written as code that gives the same answer every time for the same input, at code speed and cost.
- SWHID
- Software Heritage identifier: a permanent ID made from a file's hash, such as swh:1:cnt: followed by 40 hex digits.