AnswerDockBot crawler
AnswerDockBot indexes websites at their owners' request so their AI support chatbots can answer from that content. If you're seeing our crawler, someone asked AnswerDock to index that site.
User agent
user-agent
AnswerDockBot/1.0 (+https://answerdock.ai/bot)How it behaves
- Respects
robots.txt, including Disallow rules and Crawl-delay. - Uses sitemaps when available instead of deep link-following.
- Rate-limits itself and pauses between requests.
- Never bypasses logins, paywalls, CAPTCHAs, or anti-bot systems.
- Only fetches HTML pages; skips media and binary files.
Blocking the crawler
Add this to your robots.txt to opt out entirely:
robots.txt
User-agent: AnswerDockBot
Disallow: /Contact
Questions or takedown requests: crawler@answerdock.ai. Include the affected domain and we'll remove indexed content promptly.