Re-crawl a single page
POST/api/v2/projects/:slug/recrawl/
Re-crawl one page and replace it in the project's search index, without touching the rest of the index. Returns immediately with 202; the crawl runs in the background.
Use this when one page changed. To re-crawl every source in the project, use POST /api/v2/projects/{slug}/sync/ instead.
Requirements
- The URL must be on a host Biel.ai already crawls for this project: one of its embed domains, or the host of one of its URL or sitemap sources. Host matching is exact. A URL on any other host returns
400, which keeps the endpoint from being used as a fetch-anything proxy. - The project must have been indexed at least once. Run a full sync first, until then this endpoint returns
409.
A page the index doesn't hold yet is added rather than replaced, and counts against your plan's page limit.
Result reporting
The 202 means the page was accepted and queued, not that it was indexed. The background job is fire-and-forget: if the page can't be fetched, is excluded by the project's URL filters, or produces no indexable content, the run is dropped and no status is reported back. The next call, or the next full sync, is the retry. Use GET /api/v2/projects/{slug}/search/ to confirm the new content is in the index.
Required permission: sync_create
Request
Responses
- 202
- 400
- 403
- 404
- 409
- 429
Page accepted and queued for crawling.
The url field is missing or malformed, or the URL is on a host this project does not crawl.
The API key is missing, belongs to another team, lacks sync_create, or the team's trial has expired.
Resource not found.
The project has no index to replace the page in. Run POST /api/v2/projects/{slug}/sync/ first.
Rate limit exceeded for this API key. Retry after the interval named in detail.