Index onlineMerchant portal
Api Endpoint

robots.txt Linter (RFC 9309)

Lints and validates a caller-supplied robots.txt against RFC 9309 and reports every check, not only the failures: group structure, product token charset, path patterns, special characters, other records, size limit. Given a user agent and URLs it recomputes the allow/disallow decision per URL, naming the winning rule, its octet length and the tiebreak that applied. Where the RFC is silent or contradicts itself, the reading used is stated. Makes no outbound request.

Open interactive test console

Offering

Provider
api.ozdreamtools.de
Method
POST
Offering type
Api Endpoint
Transport type
http
Category
Development
Delivery
Not provided
Pricing model
Not provided
x402 version
2

Endpoint context

URL
https://api.ozdreamtools.de/api/robots/lint
MIME type
Not provided
First seen
2026-10-16T01:50:14.534Z
Last seen
Tags
robots-txt, rfc-9309, crawlers, seo, linter

Website

Payment pricing

x402 payment terms are the authoritative price for calling this endpoint.

Payment option 1
0.05 USDC
Atomic price: 50000 · Network: eip155:8453 · Asset: USDC · Scheme: exact
Raw x402 terms
[
  {
    "scheme": "exact",
    "network": "eip155:8453",
    "asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
    "amount": "50000",
    "payTo": "0x4Dd5E59475A55f1C2c0816469600663cb74cC1Dc"
  }
]

Observed health

Status
Reachable
Latest latency
298 ms
Average latency
445 ms
HTTP status
405
Last checked
Reachability
100% over 14 checks

Latency is measured to the first response headers. A reachable result does not verify response accuracy or merchant identity.

Input schema

{
  "additionalProperties": false,
  "properties": {
    "body": {
      "properties": {
        "robots_txt": {
          "description": "Contents of the robots.txt to check",
          "type": "string"
        },
        "urls": {
          "description": "URLs or paths whose access decision should be recomputed, at most 50",
          "items": {
            "type": "string"
          },
          "type": "array"
        },
        "user_agent": {
          "description": "Product token to evaluate for, e.g. 'GPTBot'. A full User-Agent header is resolved to the token it contains. Required when 'urls' is given.",
          "type": "string"
        }
      },
      "required": [
        "robots_txt"
      ]
    },
    "bodyType": {
      "enum": [
        "json",
        "form-data",
        "text"
      ],
      "type": "string"
    },
    "method": {
      "enum": [
        "POST"
      ],
      "type": "string"
    },
    "type": {
      "const": "http",
      "type": "string"
    }
  },
  "required": [
    "type",
    "method",
    "bodyType",
    "body"
  ],
  "type": "object"
}

Output schema

{
  "properties": {
    "example": {
      "properties": {
        "applies_to": {},
        "checks": {
          "type": "array"
        },
        "decisions": {},
        "findings": {
          "type": "array"
        },
        "groups": {
          "type": "array"
        },
        "input": {
          "type": "object"
        },
        "interpretations": {
          "type": "array"
        },
        "limits": {
          "type": "object"
        },
        "linted_at": {
          "type": "string"
        },
        "note": {
          "type": "string"
        },
        "other_records": {
          "type": "array"
        },
        "summary": {
          "type": "object"
        }
      },
      "required": [
        "applies_to",
        "checks",
        "decisions",
        "findings",
        "groups",
        "input",
        "interpretations",
        "limits",
        "linted_at",
        "note",
        "other_records",
        "summary"
      ],
      "type": "object"
    },
    "type": {
      "type": "string"
    }
  },
  "required": [
    "type"
  ],
  "type": "object"
}