Re-extract historical results with the current schema

POST

/api/v1/extraction/backfill

curl --request POST \
  --url https://dashboard.justcrawl.io/api/v1/extraction/backfill \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{ "domain": "example", "pageType": "example", "resultIds": [ "2489E9AD-2EE2-8E00-8EC9-32D5F69181C0" ], "limit": 20 }'

• Production

Replays the current merged schema (platform-discovered + this org’s custom attributes) against historical raw HTML blobs and updates the extraction_results rows in place. Useful after editing custom attributes — old rows pick up the new fields without a re-scrape.

Sync path, hard capped at 20 rows per call. Either pass resultIds to target an exact set, or omit it to process the most recent N (defaults to 20, max 50) results for the (domain, pageType) pair. Each row is processed sequentially; per-row failures show up as skipped / failed in the summary rather than aborting the run. Requires workflows:write.

Authorizations

• bearerAuth

Request Body ^required

Media type application/json

object

domain

required

string

pageType

required

string

resultIds

Array<string>

limit

integer

default: 20 <= 50

Responses

200

Per-row backfill summary with status (updated / skipped_no_blob / skipped_too_large / error).

Media type application/json

object

processed

integer

skipped

integer

failed

integer

results

Array<object>

object

id

string

status

string

newFields

integer

Example ^generated

{
  "processed": 1,
  "skipped": 1,
  "failed": 1,
  "results": [
    {
      "id": "example",
      "status": "example",
      "newFields": 1
    }
  ]
}

400

Validation failed — request body or query is missing/invalid

Media type application/json

object

error

string

Example

{
  "error": "Missing or invalid \"url\" field"
}

401

Missing or invalid authentication token

Media type application/json

object

error

string

Example

{
  "error": "Missing or invalid authentication token"
}

403

Insufficient permissions for this operation

Media type application/json

object

error

string

Example

{
  "error": "No organization. Complete onboarding first."
}

404

Resource not found

Media type application/json

object

error

string

Example

{
  "error": "Workflow not found"
}

500

Unexpected server error. Logs and PostHog $exception capture

Media type application/json

object

error

string

Example

{
  "error": "Something went wrong"
}