Api Endpoint

reader-testnet.scrapemole.workers.dev

Use when you need the list of pages a site publishes (to crawl it, find recent posts, or audit SEO): give a site URL (the sitemap is discovered from robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml) or a sitemap URL directly. Returns the page URLs with lastmod, changefreq and priority; for a sitemap index, returns its child sitemaps and (expand=true, default) the URLs of the first child sitemaps up to the limit. Gzipped sitemaps supported.

Open interactive test console

Offering

Provider
reader-testnet.scrapemole.workers.dev
Method
GET
Offering type
Api Endpoint
Transport type
http
Category
Web Search Research
Delivery
Not provided
Pricing model
Not provided
x402 version
2

Endpoint context

URL
https://reader-testnet.scrapemole.workers.dev/v1/sitemap
MIME type
application/json
First seen
2026-10-16T02:01:55.574Z
Last seen
Tags
None supplied

Payment pricing

x402 payment terms are the authoritative price for calling this endpoint.

Payment option 1
0.002 USDC
Atomic price: 2000 · Network: eip155:84532 · Asset: USDC · Scheme: exact
Raw x402 terms
[
  {
    "scheme": "exact",
    "network": "eip155:84532",
    "asset": "0x036CbD53842c5426634e7929541eC2318f3dCF7e",
    "amount": "2000",
    "payTo": "0x45f709d6cA15Cb101Aa1989A70C0534A604a9383"
  }
]

Observed health

Status
Degraded
Latest latency
38 ms
Average latency
136 ms
HTTP status
404
Last checked
Reachability
92.9% over 14 checks

Latency is measured to the first response headers. A reachable result does not verify response accuracy or merchant identity.

Input schema

{
  "type": "http",
  "method": "GET",
  "queryParams": {
    "url": "https://www.sitemaps.org"
  }
}

Output schema

{
  "type": "object",
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "required": [
    "input"
  ],
  "properties": {
    "input": {
      "type": "object",
      "required": [
        "type",
        "method"
      ],
      "properties": {
        "type": {
          "type": "string",
          "const": "http"
        },
        "method": {
          "enum": [
            "GET"
          ],
          "type": "string"
        },
        "queryParams": {
          "type": "object",
          "required": [
            "url"
          ],
          "properties": {
            "url": {
              "type": "string",
              "examples": [
                "https://www.sitemaps.org"
              ],
              "description": "Site URL (e.g. https://example.com) or a sitemap .xml/.xml.gz URL."
            },
            "limit": {
              "type": "string",
              "default": "1000",
              "description": "Max page URLs returned (1-5000)."
            },
            "expand": {
              "type": "string",
              "default": "true",
              "description": "For a sitemap index, also read the first child sitemaps (true/false)."
            }
          },
          "additionalProperties": false
        }
      },
      "additionalProperties": false
    },
    "output": {
      "type": "object",
      "required": [
        "type"
      ],
      "properties": {
        "type": {
          "type": "string"
        },
        "example": {
          "type": "object"
        }
      }
    }
  }
}