Skip to main content
Skip to content
ScrapingBuddyDevelopers
On this page Overview

Scraping API/API reference

List classification batches

Read paginated batch summaries and current classification availability.

01 / Request

Make a request

GET/api/v1/scraping/classifications

Returns up to 10 batches, newest first, without items. Use offset=0, then 10, then 20 while hasMore is true. Concurrent new batches can shift pages; deduplicate by batch ID.

availability.enabled indicates whether new classification work is enabled and the starting balance/access requirements are met. Also check activeBatchId and the daily allowance. It does not promise that every source or model call will succeed.

Required headers
AuthorizationstringRequired
Bearer followed by your ScrapingBuddy customer API key.

Query parameters

offsetintegerOptional
Default 0. Integer from 0 to 100000. No configurable limit parameter.

02 / Response

Understand the response

Success returns HTTP 200 with JSON. Inspect item outcomes even when the batch is completed.

batchesarray
Up to 10 batch summaries, newest first, without items.
hasMoreboolean
If true, request the next page with offset increased by 10.
availabilityobject
enabled, dailyLimit, usedToday, activeBatchId, maxUrls, and billing (enabled, canStart, balanceUsd). Counters cover a rolling 24-hour window; balanceUsd is available credit after holds.
Batch and item fields

Errors & next steps

Request errors return an HTTP error status and a top-level error string. Processing failures appear in batch.items[].error even when fetching the result succeeds.

New tasks and batches require $1 available balance; insufficient starting credit returns 402. All customer keys share 60 requests per minute per account. For 429, honor Retry-After; active-task and daily limits may require a longer wait.

Scraping API v1
Scraping referenceCreate a taskGet a task & resultList task historyCreate a classification batchGet classification resultsList classification batchesStop queued classification URLs

Explore the documentation

Scraping APIIntroduction

Public pages, HTML, Markdown, deep research, bulk classification, wallet billing and first integration.

GuidesBulk classification

One question, your own answer labels, and a separate machine-readable result for each website.

GuidesYour first scrape

Go from a public URL to saved page content in four steps.

GuidesAuthentication & access

Connect your server with your customer API key and understand public-page access.

GuidesAI analysis & company context

Extract information, summarize a page or assess relevance with optional OpenAI analysis.

GuidesFormats & page readiness

Choose the content format and when the page is ready to collect.

GuidesTask lifecycle & retention

Know when to poll, when to save content and when to stop.

GuidesSafe retries

Recover a lost response without accidentally creating another task.

GuidesErrors, limits & billing

Understand request failures, task failures and usage-based billing.

POST /scraping/tasksCreate a task

Collect a public page, with optional single-page or deep analysis. During the current testing stage, a valid customer API key is enough to create a public-page task; separate accou

GET /scraping/tasks/{id}Get a task & result

Read task progress and retrieve content when it is ready. Fetch the saved task ID with the same account that created it. Wait at least 6 seconds between progress checks. This reque

GET /scraping/tasksList task history

Find your recent tasks, newest first, without downloading page content. Returns up to 10 tasks per page, ordered by creation time and ID, plus hasMore. Request offset=0, then 10, t

POST /scraping/classificationsCreate a classification batch

Ask one question across up to 100 URLs and constrain answers to your own labels. Send a saved UUID v4 Idempotency-Key and JSON body of at most 256 KiB. The key becomes batch.id. An

GET /scraping/classifications/{id}Get classification results

Retrieve batch progress and all per-URL decisions. Use the batch ID and a key belonging to the same account. Poll at least 10 seconds apart. Returns 202 while queued or running, an

GET /scraping/classificationsList classification batches

Read paginated batch summaries and current classification availability. Returns up to 10 batches, newest first, without items. Use offset=0, then 10, then 20 while hasMore is true.

POST /scraping/classifications/{id}/cancelStop queued classification URLs

Stop batch items that have not started; let in-flight work finish. Send Authorization only; no request body or new Idempotency-Key is required. Repeating cancellation is safe. Only