Web Search Research x402 offerings

Pay-per-request access to FullEnrich, CompanyEnrich, LeadMagic, Exa, Firecrawl, Google Maps, Serper, and Whitepages APIs. No auth, no subscriptions.

Crawl a website from a starting URL and return each page as clean markdown: breadth-first over internal links, bounded by page count and depth, honouring robots.txt, with per-page title, status, depth and outbound links. Use it when an agent needs a whole section of a site rather than one known page.

Render a whole section of a site - up to 25 pages - in one call and get every page back as clean text. Each page runs in a real headless Chrome with JavaScript executed, so documentation sites and single-page apps come back complete rather than empty. Same host only. robots.txt is obeyed: any path disallowed for * is skipped and named in the result. $1.00 per call, because it is up to 25 full browser renders rather than a lookup. Free without payment: the exact crawl plan - w

Fetch a site's favicon/logo: reads the page's declared <link rel=icon…> tags (all variants with their sizes and types), deterministically picks the largest declared icon (falling back to /favicon.ico), fetches it, and returns the bytes as a base64 data URI plus the resolved icon URL and content type. Icons over 256KB return the URL and metadata without the inline data URI. SSRF-guarded - private-network hosts are rejected. Sites with no reachable icon return {found:false}.

Discover a website's URLs in one call: reads robots.txt, its declared sitemap(s) (sitemap indexes and gzipped sitemaps included, /sitemap.xml as the fallback) and the start page's internal links, then returns a same-host, normalized, deduplicated list (up to 500) with an optional substring filter. Hard budgets: at most 6 fetches, 15 seconds, 5 MB. Use it to pick which pages to crawl or extract next.

Does https://<domain>/ads.txt exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of ads.txt tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/api-docs exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of api-docs tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/CHANGELOG.md exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of CHANGELOG.md tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/feed exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of feed tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/feed.xml exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of feed.xml tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/humans.txt exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of humans.txt tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/license.txt exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of license.txt tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/llms-full.txt exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of llms-full.txt tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/llms.txt exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of llms.txt tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/readme.html exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of readme.html tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/sellers.json exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of sellers.json tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/site.webmanifest exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of site.webmanifest tells you about the site's tooling and policies. $0.01 per check.

Does https://<domain>/sitemap_index.xml exist? Requests the path and returns the HTTP status, content type, size and the first 300 characters when it is text. Presence of sitemap_index.xml tells you about the site's tooling and policies. $0.01 per check.

The rel="pingback" links of a page: every matching <link>/<a> with href, resolved to absolute URLs, with a count. Link-relationship discovery. $0.01 per page.

Bulk does site use google analytics 4: up to 20 domains in one call, processed concurrently, results in input order with a per-item error field and a failure count. Same answer per item as the single endpoint. Batch enrichment for agents that hold a list. $0.10 per batch.

A Wikipedia page summary by title or search words, in any language: title, short description, summary, page URL, thumbnail and Wikidata ID. For organisations, people and places, Wikidata facts: official website, inception, country, headquarters, date of birth and coordinates. Text is CC BY-SA 4.0 with attribution. Not found returns search suggestions.

Wayback Machine snapshots of a public URL: the capture closest to a date, the list of captures in a date range (one per day, max 500), first and last capture, and mode=diff, which compares the latest snapshot's text with the live page (added and removed lines, max 200 each). Diff is line-based and does not parse JavaScript-rendered pages.

For eleven AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended and others): allowed or blocked for the page's path under robots.txt, plus the noai and noimageai opt-outs in meta and X-Robots-Tag, and whether llms.txt exists. Reads the page as static HTML; no JavaScript runs.

Every HTML table of a web page as JSON: caption, headers and rows, up to 10 tables with 200 rows each. Tables that a script draws are not included. robots.txt is respected; a page it disallows answers 403, not charged.