Skip to content
looot docs
Esc
↑↓navigate↵open⌘Jpreview
On this page

TypeSafe / Jev noul -- yes/no probability

TypeSafe (Jev) tool typesafe-noul on looot: input fields, $0.00029 per call, output shape, and code to run it with curl, JavaScript or Python.

Judges state against one yes/no question (Jev’s “noul” type) and returns a 0-1 probability – no generated text. Exactly one question per call (a single key under questions, typed noul); pass criteria.true/criteria.false as concrete situations to improve calibration, not adjectives. Reads state literally: spell out edge cases in instructions, do not rely on the model inferring them. Pin model to jev-1.13.0 unless told otherwise.

  • Tool id: typesafe-noul
  • Provider: TypeSafe (Jev)
  • Job: Evaluate judge (judge.evaluate)
  • Price: $0.00029 per call. A call that fails at the provider costs $0.

Inputs

Name Type Required Description
model string no Pinned TypeSafe System One model id.
questions object yes Exactly one noul question. The object’s single key is your own name for it (the announcement’s name); the answer comes back under the same key.
state string yes The text being judged (the announcement’s text).

Output

Shape of the run’s result, checked against 2 real answers:

{ model, usage: { input_tokens, output_tokens }, answers: { spam: { noul, type } } }

Run it

Every call needs your API token in LOOOT_TOKEN; Sign in shows how to get one. Each run also needs a new idempotency key, so a retry never pays twice. With wait: 30 the answer comes back inline when the run ends within 30 seconds. Otherwise you get the running run back: poll GET /v1/runs/<runId>.

Example input with placeholder values:

curl -X POST "https://api.looot.ai/v1/runs" \
  -H "Authorization: Bearer $LOOOT_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{"endpointId":"typesafe-noul","input":{"state":"<state>","questions":{}},"wait":30}'
const response = await fetch("https://api.looot.ai/v1/runs", {
  method: "POST",
  headers: {
    Authorization: `Bearer ${process.env.LOOOT_TOKEN}`,
    "Content-Type": "application/json",
    "Idempotency-Key": crypto.randomUUID(),
  },
  body: JSON.stringify({
    endpointId: "typesafe-noul",
    input: {
      state: "<state>",
      questions: {},
    },
    wait: 30,
  }),
});
const run = await response.json();
console.log(run.status, run.result);
import os
import uuid

import requests

response = requests.post(
    "https://api.looot.ai/v1/runs",
    headers={
        "Authorization": f"Bearer {os.environ['LOOOT_TOKEN']}",
        "Idempotency-Key": str(uuid.uuid4()),
    },
    json={
        "endpointId": "typesafe-noul",
        "input": {
            "state": "<state>",
            "questions": {},
        },
        "wait": 30,
    },
    timeout=90,
)
run = response.json()
print(run["status"], run.get("result"))

To let looot pick among every provider of this job instead, send job:judge.evaluate as endpointId; see the job page.

Was this page helpful?