# agentsitemaps.com — Sitemap and crawl surface > The family's real crawl surface: the sanctioned cross-host sitemap.xml on subagentsubdomains.com plus the per-site robots.txt/llms.txt conventions, fetched and rendered live. ## API - (no API of its own — aggregator over https://subagentsubdomains.com/sitemap.xml and /api/dns-zones) ## Upstream The homepage fetches https://subagentsubdomains.com/sitemap.xml server-side at request time (edge-cached ~5 minutes), counts and lists its entries, and cross-checks that count against status='routed' rows in https://subagentsubdomains.com/api/dns-zones — the same D1 table the sitemap is generated from. It also explains the sitemaps.org cross-submit mechanism (every family site's robots.txt declares that shared Sitemap: URL) and renders this site's own /robots.txt inline as the worked example. If an upstream is unreachable the page says so honestly instead of serving a stale copy. ## Family This site is one of the Cloudflare Workers in the subagent*.com family. For the live, machine-readable directory of every sibling domain, Cloudflare zone ID, and worker binding, fetch: https://subagentsubdomains.com/api/dns-zones For a unified catalog of every API route across every primitive in the family: https://subagentapi.com/api/catalog