Skip to content
justcrawl.io
Search
Ctrl
K
Cancel
Select theme
Dark
Light
Auto
Getting Started
What is justcrawl.io?
Quickstart
API Quickstart
Core Concepts
Workflows
Providers
Service node settings
URLs
Schedules
Jobs
Smart Workflows
Smart Workflows
Strategies
Optimization Suggestions
Integrations & More
Integrations
Analytics
Billing & Plans
API Reference
Overview
Authentication
Overview
Register a new account
Log in with email and password
Refresh access token using a refresh token
Request a password reset link
Reset password using a reset token
Verify email address using a verification token
Resend email verification token (requires authentication)
Preview the user behind an impersonation nonce (no consume)
Atomically consume an impersonation nonce and return a 15-min access token
Jobs
Overview
List jobs
Submit a scrape job
Batch poll job statuses
Dashboard-widget aggregated counters with prior-window deltas
Get job detail
Get scrape result HTML
Workflows
Overview
List workflows
Create workflow
Create default smart workflow (no benchmark)
Get workflow
Update workflow
Delete workflow
Clone as custom
Publish workflow
Smart Workflows
Overview
Get smart workflow config
Update auto/suggest mode
List suggestions
Apply suggestion
Dismiss suggestion
List all pending suggestions for org
URLs
Overview
List URLs
Create single URL
Batch create URLs
Get URL detail
Delete URL
List extraction history for a URL
Schedules
Overview
List schedules
Create schedule
Get schedule
Update schedule
Delete schedule
Enable/disable schedule
Trigger schedule now
Integrations
Overview
List input queue configs
Create input queue config
Update input config
Delete input config
Toggle input config
List output configs
Create output config
Delete output config
Webhooks
Overview
Ingest URLs via webhook
Analytics
Overview
Get overview metrics
Get timeseries data
Provider comparison
Domain breakdown
Domain x provider matrix
Plans
Overview
Get plan status
Credit transaction history
Submit recharge request
Benchmarks
Overview
Start benchmark
Get latest benchmark
Get benchmark status
Cancel benchmark
Get benchmark results
Extraction
Overview
List extraction results
Get extraction result for a job
List extraction schemas
Get latest schema for a domain + page type
List org custom attributes for a domain
Create or update org custom attributes
Remove org custom attributes
Test XPath attributes against stored HTML
Re-extract historical results with the current schema
List extraction history for one URL item
Account
Delete your account (GDPR right to erasure)
Export all personal data (GDPR right to data portability)
Audit
List audit logs for the organization
Select theme
Dark
Light
Auto
Overview
Schedules
Section titled “Schedules”
Automated recurring scraping
Operations
Section titled “ Operations ”
GET
/api/v1/schedules
POST
/api/v1/schedules
GET
/api/v1/schedules/{id}
PUT
/api/v1/schedules/{id}
DELETE
/api/v1/schedules/{id}
PATCH
/api/v1/schedules/{id}/toggle
POST
/api/v1/schedules/{id}/trigger