Get latest schema for a domain + page type

GET

/api/v1/extraction/schemas/{domain}/{pageType}

curl --request GET \
  --url https://api.justcrawl.io/api/v1/extraction/schemas/example/product \
  --header 'Authorization: Bearer <token>'

• Production

Returns the highest-version platform-discovered schema for the (domain, pageType) pair, or 404 if the platform has not yet discovered one. New schemas land asynchronously when the extraction worker runs an LLM-driven XPath discovery on a fresh page — there’s no synchronous “create schema” endpoint, by design.

Authorizations

• bearerAuth

Parameters

Path Parameters

domain

required

string

pageType

required

string

Allowed values: product product_list serp article job_posting bestseller

Responses

200

Latest extraction schema for the requested pair.

Media typeapplication/json

object

id

string

domain

string

pageType

string

Allowed values: product product_list serp article job_posting

version

integer

attributes

Array<object>

object

name

required

string

xpaths

required

Array<string>

type

required

string

Allowed values: text number url boolean text[] url[]

description

string

nullable

antiPatterns

Array<string>

nullable

semanticType

string

nullable

Allowed values: brand_name review_count product_id product_image star_rating availability_status

validation

object

minLength

integer

maxLength

integer

min

number

max

number

pattern

string

confidence

number

discoveredBy

string

Allowed values: llm llm_multi_sample manual reverse_engineered

sampleCount

integer

lastValidatedAt

string format: date-time

expiresAt

string format: date-time

createdAt

string format: date-time

Example

{
  "pageType": "product",
  "attributes": [
    {
      "type": "text",
      "semanticType": "brand_name"
    }
  ],
  "discoveredBy": "llm"
}

401

Missing or invalid authentication token

Media typeapplication/json

object

error

string

Example

{
  "error": "Missing or invalid authentication token"
}

403

Insufficient permissions for this operation

Media typeapplication/json

object

error

string

Example

{
  "error": "No organization. Complete onboarding first."
}

404

Resource not found

Media typeapplication/json

object

error

string

Example

{
  "error": "Workflow not found"
}

500

Unexpected server error. Logs and PostHog $exception capture

Media typeapplication/json

object

error

string

Example

{
  "error": "Something went wrong"
}