Diffbot / Auto-detect and extract a page (with options)

Diffbot tool diffbot-extract-analyze on looot: input fields, $0.0012 per call, output shape, and code to run it with curl, JavaScript or Python.

Detects a page’s type (article, product, discussion, image, video, list or event) and extracts it. Send url; mode, fields and timeout refine it.

Tool id: diffbot-extract-analyze
Provider: Diffbot
Job: Scrape a URL into structured JSON (web.scrape.structured)
Price: $0.0012 per call. A call that fails at the provider costs $0.

Inputs

Name	Type	Required	Description
`fields`	string	no	comma-delimited optional fields
`mode`	string	no	restrict to one page type
`timeout`	integer	no	ms to wait. Example: 30000
`url`	string	yes	target URL. Example: “https://www.diffbot.com/products/extract/”

Output

The run’s result holds the provider’s answer. Signed in, looot inspect diffbot-extract-analyze prints its fields.

Every call needs your API token in LOOOT_TOKEN; Sign in shows how to get one. Each run also needs a new idempotency key, so a retry never pays twice. With wait: 30 the answer comes back inline when the run ends within 30 seconds. Otherwise you get the running run back: poll GET /v1/runs/<runId>.

Example input with placeholder values:

curl -X POST "https://api.looot.ai/v1/runs" \
  -H "Authorization: Bearer $LOOOT_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{"endpointId":"diffbot-extract-analyze","input":{"url":"https://www.diffbot.com/products/extract/","timeout":30000},"wait":30}'

const response = await fetch("https://api.looot.ai/v1/runs", {
  method: "POST",
  headers: {
    Authorization: `Bearer ${process.env.LOOOT_TOKEN}`,
    "Content-Type": "application/json",
    "Idempotency-Key": crypto.randomUUID(),
  },
  body: JSON.stringify({
    endpointId: "diffbot-extract-analyze",
    input: {
      url: "https://www.diffbot.com/products/extract/",
      timeout: 30000,
    },
    wait: 30,
  }),
});
const run = await response.json();
console.log(run.status, run.result);

import os
import uuid

import requests

response = requests.post(
    "https://api.looot.ai/v1/runs",
    headers={
        "Authorization": f"Bearer {os.environ['LOOOT_TOKEN']}",
        "Idempotency-Key": str(uuid.uuid4()),
    },
    json={
        "endpointId": "diffbot-extract-analyze",
        "input": {
            "url": "https://www.diffbot.com/products/extract/",
            "timeout": 30000,
        },
        "wait": 30,
    },
    timeout=90,
)
run = response.json()
print(run["status"], run.get("result"))

To let looot pick among every provider of this job instead, send job:web.scrape.structured as endpointId; see the job page.

Diffbot / Auto-detect and extract a page (with options)

Inputs

Output

Run it