Service Limitations & Operational Constraints
Transparent boundaries designed to ensure platform stability, fair resource allocation, and compliance with search engine guidelines.
API & Usage Limits
All API interactions and automated sitemap generation are subject to tier-based rate limits to maintain optimal performance across the infrastructure.
- •Rate Limiting: Standard API endpoints are capped at 1,000 requests per minute (RPM) on free tiers, scaling to 10,000 RPM on Professional plans. Enterprise customers receive dedicated rate limit pools.
- •Concurrent Jobs: Maximum 5 simultaneous sitemap generation/crawling jobs per account. Exceeding this triggers a 429 Too Many Requests response.
- •URL Caps: Free accounts support up to 500 indexed URLs per sitemap. Professional plans support up to 50,000 URLs. Enterprise plans are unlimited.
- •Data Retention: Historical sitemap versions and crawl logs are retained for 90 days on Standard plans and 1 year on Professional/Enterprise.
Technical & Format Constraints
Our engine adheres to W3C and IETF standards, but certain technical boundaries apply to ensure compatibility with major search engine crawlers.
| Parameter | Limit/Constraint | Status |
|---|---|---|
| Max Sitemap File Size | 50 MB (compressed) / 100 MB (uncompressed) | Standard |
| Max URLs Per Sitemap | 50,000 (per W3C specification) | Compliant |
| Supported Schemas | d>sitemap-index, urlset, video, image, news, hreflangSupported | |
| Dynamic/JS-Rendered Pages | Requires headless rendering toggle; may experience 2-5s crawl delay | Conditional |
| Custom Headers & Authentication | Basic, Bearer, and API Key supported. mTLS requires Enterprise tier. | Tiers |
External Dependencies & Third-Party Factors
While Sitemap.xml guarantees high availability for our own infrastructure, certain outcomes depend on external services beyond our control.
- •Search Engine Indexing: We handle sitemap generation and submission, but final indexing decisions, crawl prioritization, and ranking are solely controlled by Google, Bing, and other engines.
- •DNS & CDN Propagation: Sitemap URLs must be publicly resolvable. We cannot bypass firewall restrictions, Cloudflare challenges, or private VPC routing without proper configuration.
- •Hosting Environment: Servers returning 403/429/503 errors, missing `robots.txt` directives, or aggressive rate limits may result in partial crawls.
Regional, Legal & Compliance Boundaries
Our service operates in compliance with global data protection regulations and content policies.
- •Data Residency: EU and UK customer data is processed within AWS Frankfurt and London regions. Cross-border transfer requires explicit consent.
- •Restricted Jurisdictions: Service access may be limited or unavailable in regions subject to OFAC sanctions or local regulatory prohibitions.
- •Content Policy: We do not support indexing of malicious, infringing, or legally prohibited content. Automated scans may flag and pause suspicious sitemap submissions.
⚠️ Important Operational Notice
These limitations are subject to change with 30 days' advance notice via email and platform announcements. Critical changes affecting API compatibility will be versioned and documented in the Changelog. Continued use of the service constitutes acceptance of current constraints.
Need to Exceed These Limits?
Our infrastructure team can provision custom rate limits, dedicated crawl pods, or bespoke data retention policies for enterprise clients.
Contact Enterprise Support →