Skip to content
looot docs
Esc
↑↓navigate↵open⌘Jpreview
On this page

Olostep / Batch scrape (start)

Olostep tool olostep-batch-start on looot: input fields, $0.0018 per result, output shape, and code to run it with curl, JavaScript or Python.

Initiates a new batch process with the specified parameters.

  • Tool id: olostep-batch-start
  • Provider: Olostep
  • Job: Batch web scrape (web.scrape.batch)
  • Price: $0.0018 per result. A call that fails at the provider costs $0.

Inputs

Name Type Required Description
country string no Country for the batch execution. Provide in ISO 3166-1 alpha-2 codes like US(USA), IN(India), etc
items array yes Array of items to be processed in the batch.
links_on_page object no Get all the links present on each page in the batch. Links are always returned as absolute URLs.
metadata object no Set of key-value pairs for storing additional information about an object. Follows Stripe’s approach with validation rules: max 50 keys, key max 40 characters (no square brackets), value max 500 characters, all values stored as strings.
parser object no You can use this parameter to specify the parser to use. Parsers are useful to extract structured content from web pages. Olostep has a few parsers built in for most common web pages, and you can also create your own parsers.
webhook string no HTTPS URL to receive a POST request when the batch completes. Must be a publicly accessible URL using http:// or https:// protocol. Cannot point to localhost or private IP addresses. See Webhooks for payload format and retry behavior.

Output

The run’s result holds the provider’s answer. Signed in, looot inspect olostep-batch-start prints its fields.

Run it

Every call needs your API token in LOOOT_TOKEN; Sign in shows how to get one. Each run also needs a new idempotency key, so a retry never pays twice. With wait: 30 the answer comes back inline when the run ends within 30 seconds. Otherwise you get the running run back: poll GET /v1/runs/<runId>.

Example input with placeholder values:

curl -X POST "https://api.looot.ai/v1/runs" \
  -H "Authorization: Bearer $LOOOT_TOKEN" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{"endpointId":"olostep-batch-start","input":{"items":[]},"wait":30}'
const response = await fetch("https://api.looot.ai/v1/runs", {
  method: "POST",
  headers: {
    Authorization: `Bearer ${process.env.LOOOT_TOKEN}`,
    "Content-Type": "application/json",
    "Idempotency-Key": crypto.randomUUID(),
  },
  body: JSON.stringify({
    endpointId: "olostep-batch-start",
    input: {
      items: [],
    },
    wait: 30,
  }),
});
const run = await response.json();
console.log(run.status, run.result);
import os
import uuid

import requests

response = requests.post(
    "https://api.looot.ai/v1/runs",
    headers={
        "Authorization": f"Bearer {os.environ['LOOOT_TOKEN']}",
        "Idempotency-Key": str(uuid.uuid4()),
    },
    json={
        "endpointId": "olostep-batch-start",
        "input": {
            "items": [],
        },
        "wait": 30,
    },
    timeout=90,
)
run = response.json()
print(run["status"], run.get("result"))

To let looot pick among every provider of this job instead, send job:web.scrape.batch as endpointId; see the job page.

Was this page helpful?