TypeSafe / Jev score -- position on a rubric

TypeSafe (Jev) tool typesafe-score on looot: input fields, $0.00033 per call, output shape, and code to run it with curl, JavaScript or Python.

Judges state against one score question (Jev’s “score” type) and returns a probability-weighted position along an ordered rubric (can land between levels, e.g. 1.6), with the legend and a confidence – no generated text. Exactly one question per call, 2-10 rubric levels written as concrete situations (not adjectives). Score is for thresholds and ranking, not an exact interpolated number – do not treat it as ground truth to two decimal places. Pin model to jev-1.13.0 unless told otherwise.

Tool id: typesafe-score
Provider: TypeSafe (Jev)
Job: Evaluate judge (judge.evaluate)
Price: $0.00033 per call. A call that fails at the provider costs $0.

Inputs

Name	Type	Required	Description
`model`	string	no	Pinned TypeSafe System One model id.
`questions`	object	yes	Exactly one score question. The object’s single key is your own name for it; the answer comes back under the same key.
`state`	string	yes	The text being judged (the announcement’s `text`).

Output

Shape of the run’s result, checked against 2 real answers:

{ model, usage: { input_tokens, output_tokens }, answers: { frustration: { type, score, legend: { ... }, confidence, probabilities: { ... } } } }

Run it

Every call needs your API token in LOOOT_TOKEN; Sign in shows how to get one. Each run also needs a new idempotency key, so a retry never pays twice. With wait: 30 the answer comes back inline when the run ends within 30 seconds. Otherwise you get the running run back: poll GET /v1/runs/<runId>.

Example input with placeholder values:

curl -X POST "https://api.looot.ai/v1/runs" \
  -H "Authorization: Bearer $LOOOT_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{"endpointId":"typesafe-score","input":{"state":"<state>","questions":{}},"wait":30}'

const response = await fetch("https://api.looot.ai/v1/runs", {
  method: "POST",
  headers: {
    Authorization: `Bearer ${process.env.LOOOT_TOKEN}`,
    "Content-Type": "application/json",
    "Idempotency-Key": crypto.randomUUID(),
  },
  body: JSON.stringify({
    endpointId: "typesafe-score",
    input: {
      state: "<state>",
      questions: {},
    },
    wait: 30,
  }),
});
const run = await response.json();
console.log(run.status, run.result);

import os
import uuid

import requests

response = requests.post(
    "https://api.looot.ai/v1/runs",
    headers={
        "Authorization": f"Bearer {os.environ['LOOOT_TOKEN']}",
        "Idempotency-Key": str(uuid.uuid4()),
    },
    json={
        "endpointId": "typesafe-score",
        "input": {
            "state": "<state>",
            "questions": {},
        },
        "wait": 30,
    },
    timeout=90,
)
run = response.json()
print(run["status"], run.get("result"))

To let looot pick among every provider of this job instead, send job:judge.evaluate as endpointId; see the job page.