Introduction
What the Sitebulb Crawler Test Site is and how to use it.
The Sitebulb Crawler Test Site serves deterministic fixture routes for exercising web crawlers. Every fixture’s machine-readable expectations — status, headers, markers, directives, links — live in a typed registry, and every machine-readable output of this site (manifests, sitemaps, robots.txt, llms.txt) is generated from that registry.
Start with the canonical manifest: it lists every fixture with its full expectation set. The safe manifest lists only routes suitable for broad crawling, and the risky manifest lists direct-entry-only fixtures such as loops and traps. External tooling can validate manifests against /manifest.schema.json.
These pages explain fixtures for humans. They never define expectations — if a page and the manifest ever appear to disagree, the manifest is right.