Web Search Research x402 offerings

Scrapes any webpage and pulls title, description, canonical URL, OpenGraph + Twitter card metadata, headings, and outbound links from a single URL. Server-side rendering; body content rendered as text, raw HTML, or clean markdown, with optional link extraction. Cheerio-based with no headless browser, so it is fast and cheap, ideal for static pages and SSR sites. For JS-heavy SPAs that need a real browser, see website-screenshot. Use it as a web scraping API or webpage metadata extractor.

Search the live web for current information. Returns fresh structured organic search results with titles, URLs, snippets, domains, and ranks for agent research and retrieval.

Search the live web for current information. Returns fresh structured organic search results with titles, URLs, snippets, domains, and ranks for agent research and retrieval.

Website change monitoring / webpage change detection — text_sha256 or previous_text diff for documentation, pricing-page, changelog and policy monitoring. Batch up to 10 URLs in one call (items[]); optional CSS selector scoping and a one-line diff summary. $0.005 per URL Base ($0.01 Algorand); batch of 2-10 $0.003/URL ($0.006). Caller stores baseline; no server watch list. HTML/text only; no JS render. Failed checks not settled.

Webpage text extraction: extract clean text from any webpage. Extract the clean readable text from a public webpage with title, headings, links and SHA-256; add format=markdown for Markdown or render=true to render JavaScript pages. Web read / fetch URL / scrape URL to markdown — public webpage to clean text or Markdown with headings, links and SHA-256, for RAG and research. Batch up to 10 URLs; optional JavaScript rendering (headless Chromium). $0.003 per URL Base ($0.006 Algorand).

Webpage text extraction: extract clean text from any webpage. Extract the clean readable text from a public webpage with title, headings, links and SHA-256; add format=markdown for Markdown or render=true to render JavaScript pages. Web read / fetch URL / scrape URL to markdown / web scraping to markdown — public webpage to clean text or Markdown for RAG and research. Batch up to 10 URLs. GET form: one URL via ?url=; use POST for batches or render.

Website change monitoring: detect webpage changes. Website change monitoring / webpage change detection — text_sha256 or previous_text diff for documentation, pricing-page, changelog and policy monitoring. Batch up to 10 URLs in one call (items[]); optional CSS selector scoping and a one-line diff summary. $0.005 per URL Base ($0.01 Algorand); batch of 2-10 $0.003/URL ($0.006). Caller stores baseline; no server watch list. GET form: one URL via ?url=; use POST for batches or render.

Fetch one URL from a residential IP and get the raw response as JSON: status, final URL, headers and body (text or base64), up to 10 MB. GET, HEAD or POST, your own headers, an optional country. No JavaScript rendering. You pay for the megabytes delivered; a fetch that fails is not charged. Pay per call in stablecoins.

Fetch one URL from a residential IP and get the raw response as JSON: status, final URL, headers and body (text or base64), up to 10 MB. GET, HEAD or POST, your own headers, an optional country. No J…

Given a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot and more, each allowed or blocked, plus Googlebot, listed sitemaps, whether /llms.txt is published and page-level noindex/nosnippet, with fixes. Static check, no browser. Not charged if robots.txt cannot be read (no response, or a bot block).

Hand off a whole research or lookup task in one call: a Claude Haiku 5.5 agent plans the steps, calls up to 38 agentsvc.io tools in parallel (web and news search, page reading, papers, GitHub and npm, company registers and sanctions, crypto prices, token checks, DeFi TVL and yields, wallets, FX and macro data, weather, DNS, WHOIS, SSL, CVEs) and returns a Markdown answer with sources and the list of tool calls it made. Up to 12 steps and about 90 seconds.

AI web search optimized for agents. Returns ranked results with the relevant extracted content of each page (not just a link + blurb), plus a relevance score. topic=news for recent reporting. Distinct from search.web (raw SERP) — this returns clean, LLM-ready page content per result.

AI Web Extractor — turn ANY url into clean, LLM-ready markdown. POST {url}; get the main content as markdown (boilerplate/nav/ads stripped) with title, description, and links. The scrape / read / url-to-markdown primitive for RAG and research agents. Fast, cheap, x402-native.

Capture point-in-time URL facts, response headers, a text excerpt, and a SHA-256 content hash for research and verification.

Setting Google Shopping Product Info Tasks

Filters and customizable thresholds at DataForSEO OnPage API

List of Categories for Content Analysis API

Get Google Finance Markets HTML Results by id

DataForSEO Labs Google Available History

List of Google Events Locations for SERP API

List of Locations and Languages for DataForSEO Clickstream Data API

Get Google Shopping Product Info Results by id

Get Google Finance Quote HTML Results by id

Setting Live ‘Bulk Clickstream Search Volume’ Tasks