MoatlightBot
MoatlightBot is the crawler behind the free scan at moatlight.tech. Someone typed your domain into the scan and asked how ready it is for AI coding agents. This bot fetched a few of your public pages to answer.
How to recognise it
- User agent:
MoatlightBot/1.0 (+https://moatlight.tech/bot) - Some requests are signed with Web Bot Auth (RFC 9421). Our public key is at /.well-known/http-message-signatures-directory. The scan also fetches the same pages unsigned, to see whether signing changes the answer.
- We never send another vendor's user agent (GPTBot, ClaudeBot and so on).
What it fetches
- Your homepage and a handful of inner and documentation pages, plus robots.txt, sitemap, llms.txt, OpenAPI documents and MCP or OAuth discovery files.
- Read-only requests: GET, HEAD and OPTIONS, and the read-only calls of the MCP protocol (listing tools, not calling them). It never submits forms, signs up, logs in or calls an API that changes anything.
- It obeys robots.txt. It stays under a budget of 300 requests per scan, with at most 4 in flight at once, and caches results for several hours.
Opt out or report a problem
Disallow MoatlightBot in robots.txt and the bot stops fetching beyond your homepage. If it misbehaves, write to ceo@moatlight.tech and we will look into it.