Spider traps
Bounded spider-trap and honeytrap fixtures covering path depth, incrementing parameters, calendar walks, session-id URLs, faceted explosion, unique-token chains, hidden links, and a 10 MB body.
Fixtures that look like unbounded crawl spaces but are not: every trap family is a parameterised route with a hard server-enforced cap, a deterministic structure, and a visible stop page. A crawler that ignores the bound always reaches a terminal 200 page carrying a stop marker — there is no genuinely infinite generation anywhere in this group.
Families:
- Path depth: a 25-level chain where each level links only to the next; level 25 ends the chain.
- Query increment: an incrementing
pageparameter series capped at 50. - Calendar: prev/next month walking over a fixed 2025-01 to 2028-12 range (48 months, never today-relative).
- Session id: a
sidparameter that looks session-generated but is a deterministic hash of each target path; depth capped at 3 (40 URLs). - Faceted navigation: a 5x5 hub of 25 near-duplicate combinations, and a four-dimension hub capped at exactly 500 of 625 possible combinations.
- Unique-token URLs: a chain of unique-looking token segments, each the deterministic hash of its parent path, capped at 5 hops.
- Hidden and noscript links:
display:none,visibility:hidden, white-on-white, and noscript-only anchors, each pointing at a target page reachable only through the concealed link. - Oversized response: a streamed HTML body of exactly 10,485,760 bytes with start and end markers and a four-request concurrency cap.
The high-volume 10,000-link page belongs to the links group as
links-10000-unique and is deliberately not duplicated here; deeply nested
and adversarially malformed HTML are parser-stress fixtures owned by the
exotic advanced group.
Every trap entry point is risky, direct-entry only, and appears in no sitemap; trap waypoints, stop pages, and hidden-link targets are never emitted anywhere except the canonical manifest. The four hidden-link entry pages are moderate and safe to crawl broadly.
Fixtures in this category
- Hidden link — display:none —
hidden-display-none-link(moderate) - Hidden link — visibility:hidden —
hidden-visibility-hidden-link(moderate) - Hidden link — white on white —
hidden-white-on-white-link(moderate) - Hidden link — noscript only —
noscript-only-link(moderate)