Sign in

Create a Crawl

documented

Create and start a crawl job for a site.

POST /v3/crawlCrawlno implementation yet0 runs

Input

crawl_name*
Crawl Name
e.g. my-diffbot-crawl
seed_url*
Seed URL
https://example.com/
api_url*
API URL for processing seeds
https://api.diffbot.com/v3/analyze?mode=article
Calls Diffbot as you (your API key is your account); keychains.dev holds the credentials.