Community Channels
General
Introductions, announcements & casual chat
Developers
API, SDKs, plugins & code snippets
Support
Troubleshooting & questions
SEO Strategies
Crawl budget, indexing & optimization
Showcase
Share your projects & case studies
Bug Reports
Report issues & feature requests
Recent Discussions
View All →Best practices for handling Googlebot-Image vs Googlebot?
I'm seeing different crawl rates between the two user agents and wondering if there are specific directives I should use to optimize image indexing without impacting my main crawl budget...
💬 24 replies
👍 18 likes
👁️ 342 views
New Python SDK released - v1.2.0 with async support!
Excited to announce the new Python SDK release with full async/await support, improved sitemap generation, and better error handling. Check out the docs for migration guide...
💬 42 replies
👍 156 likes
🎉 Announcement
How to efficiently manage robots.txt for 500+ subdomains?
Our enterprise setup has hundreds of regional subdomains. Managing individual robots.txt files is becoming a nightmare. Has anyone implemented a dynamic generation strategy successfully?
💬 15 replies
👍 23 likes
✅ Solved
Case Study: Reduced crawl waste by 40% in 30 days
Share our journey of optimizing crawl budget for our e-commerce site with 100k+ SKUs. We implemented smart disallow rules and saw immediate improvements in indexing speed...
💬 38 replies
👍 210 likes
📝 Case Study