One API for web data

Start with the lightest request that works. Move to rendering, crawling, or extraction when the job needs it.

Start simple. Upgrade only when the page demands it.

SpiderFly gives products a single path from fast fetches to browser-backed pages and multi-page jobs.

Fetch

Start with the fast path for pages that can be read without a browser.

Browser Scrape

Use managed browser rendering when a page needs JavaScript before content is usable.

Crawl

Run multi-page jobs when an agent needs more than one URL.

Extract

Turn page content into structured fields your product can use.

Code becomes the product language as users go deeper

The homepage proves the API quickly. Platform and docs pages can carry denser examples for developers.

$ curl -X POST "$SPIDERFLY_BASE_URL/v1/browser/scrape" \
  -H "Authorization: Bearer $SPIDERFLY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://www.wikipedia.org/","browser":{"wait_for_selector":"body"}}'

Docs that agents and developers can follow

Route users from the website into copyable examples, public API reference, and the product console.

Read the docs API Reference

$ curl -X POST "$SPIDERFLY_BASE_URL/v1/browser/scrape" \
  -H "Authorization: Bearer $SPIDERFLY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://www.wikipedia.org/","browser":{"wait_for_selector":"body"}}'