TypeSafe / Jev noul -- yes/no probability
TypeSafe (Jev) tool typesafe-noul on looot: input fields, $0.00029 per call, output shape, and code to run it with curl, JavaScript or Python.
Judges state against one yes/no question (Jev’s “noul” type) and returns a 0-1 probability – no generated text. Exactly one question per call (a single key under questions, typed noul); pass criteria.true/criteria.false as concrete situations to improve calibration, not adjectives. Reads state literally: spell out edge cases in instructions, do not rely on the model inferring them. Pin model to jev-1.13.0 unless told otherwise.
- Tool id:
typesafe-noul - Provider: TypeSafe (Jev)
- Job: Evaluate judge (
judge.evaluate) - Price: $0.00029 per call. A call that fails at the provider costs $0.
Inputs
| Name | Type | Required | Description |
|---|---|---|---|
model |
string | no | Pinned TypeSafe System One model id. |
questions |
object | yes | Exactly one noul question. The object’s single key is your own name for it (the announcement’s name); the answer comes back under the same key. |
state |
string | yes | The text being judged (the announcement’s text). |
Output
Shape of the run’s result, checked against 2 real answers:
{ model, usage: { input_tokens, output_tokens }, answers: { spam: { noul, type } } }
Run it
Every call needs your API token in LOOOT_TOKEN; Sign in shows how to get one. Each run also needs a new idempotency key, so a retry never pays twice. With wait: 30 the answer comes back inline when the run ends within 30 seconds. Otherwise you get the running run back: poll GET /v1/runs/<runId>.
Example input with placeholder values:
curl -X POST "https://api.looot.ai/v1/runs" \
-H "Authorization: Bearer $LOOOT_TOKEN" \
-H "Content-Type: application/json" \
-H "Idempotency-Key: $(uuidgen)" \
-d '{"endpointId":"typesafe-noul","input":{"state":"<state>","questions":{}},"wait":30}'const response = await fetch("https://api.looot.ai/v1/runs", {
method: "POST",
headers: {
Authorization: `Bearer ${process.env.LOOOT_TOKEN}`,
"Content-Type": "application/json",
"Idempotency-Key": crypto.randomUUID(),
},
body: JSON.stringify({
endpointId: "typesafe-noul",
input: {
state: "<state>",
questions: {},
},
wait: 30,
}),
});
const run = await response.json();
console.log(run.status, run.result);import os
import uuid
import requests
response = requests.post(
"https://api.looot.ai/v1/runs",
headers={
"Authorization": f"Bearer {os.environ['LOOOT_TOKEN']}",
"Idempotency-Key": str(uuid.uuid4()),
},
json={
"endpointId": "typesafe-noul",
"input": {
"state": "<state>",
"questions": {},
},
"wait": 30,
},
timeout=90,
)
run = response.json()
print(run["status"], run.get("result"))To let looot pick among every provider of this job instead, send job:judge.evaluate as endpointId; see the job page.