Skip to content
justcrawl.io

List URLs

GET
/api/v1/urls
 
curl -X GET 'https://dashboard.justcrawl.io/api/v1/urls?page=1&pageSize=25&domain=amazon.com' \
  -H 'Authorization: Bearer $JUSTCRAWL_API_KEY'

Returns a paginated slice of the org’s URL list. Use domain, tag, and search to narrow; sort + order to control ordering. pageSize is capped at 100 — for bulk export use repeated page requests rather than a single oversized query. This is the endpoint the MCP server’s jc_urls_list tool wraps, so anything you can pass here an LLM agent can also pass via Claude / Cursor / Codex.

Authorizations

Section titled “Authorizations ”

Parameters

Section titled “ Parameters ”

Query Parameters

Section titled “Query Parameters ”
page
integer
default: 1 >= 1

1-indexed page number.

pageSize
integer
default: 25 <= 100

Items per page; capped at 100.

domain
string

Filter to URLs on this host (e.g. amazon.com).

tag
string

Filter to URLs carrying this tag.

search
string

Free-text substring match against URL.

sort
string
Allowed values: url domain priority created updated lastRun

Column to sort by. Invalid values return 400.

order
string
Allowed values: asc desc

Sort direction.

Responses

Section titled “ Responses ”

200

Section titled “200 ”

Paginated URL list.

Media type application/json
object
items
Array<object>
object
id
string format: uuid
url
string
domain
string
priority
integer
tags
Array<string>
createdAt
string format: date-time
total
integer
Example generated
{
  "items": [
    {
      "id": "2489E9AD-2EE2-8E00-8EC9-32D5F69181C0",
      "url": "example",
      "domain": "example",
      "priority": 1,
      "tags": [
        "example"
      ],
      "createdAt": "2026-04-15T12:00:00Z"
    }
  ],
  "total": 1
}

400

Section titled “400 ”

Validation failed — request body or query is missing/invalid

Media type application/json
object
error
string
Example 
{
  "error": "Missing or invalid \"url\" field"
}

401

Section titled “401 ”

Missing or invalid authentication token

Media type application/json
object
error
string
Example 
{
  "error": "Missing or invalid authentication token"
}

403

Section titled “403 ”

Insufficient permissions for this operation

Media type application/json
object
error
string
Example 
{
  "error": "No organization. Complete onboarding first."
}

500

Section titled “500 ”

Unexpected server error. Logs and PostHog $exception capture

Media type application/json
object
error
string
Example 
{
  "error": "Something went wrong"
}