AgentReadyBot

AgentReadyBot is the bot of the AgentReady service. It checks how usable a website is for AI agents — programs that look for information, choose products and fill in forms on a person's behalf. A check is started by a person who enters a site address on the home page.

How the bot identifies itself

Every request carries the same User-Agent:

AgentReadyBot/0.1 (+http://localhost:3000/bot)

What the bot does

• Requests the home page, robots.txt, llms.txt, sitemap.xml and the standard addresses of API descriptions.
• Opens the site in a browser and walks typical scenarios: find contacts, find a product and its price, add a product to the cart and reach checkout, find a request form.

What the bot does not do

• It does not submit forms, place or pay for orders, sign up or log in.
• It types nothing but test data: the name “Test Agent”, the e-mail agent-test@example.invalid, the phone +10000000000, the text “Automated accessibility check, please ignore”.
• It does not solve captchas or bypass bot protection — if the site does not let it in, the report simply says so.
• It does not go to other websites and does not download files.
• It never consents to tracking: it closes a cookie banner only with a neutral option such as “reject” or “only necessary”.

Load

At most 60 requests per check and no more than one request per second; a whole check takes no longer than 5 minutes. The same site is checked at most once a day — repeat requests get the existing report.

How to opt out

Add this to your site's robots.txt:

User-agent: AgentReadyBot
Disallow: /

The bot reads robots.txt before every check. If checks are disallowed, the site is not scanned and the user sees a message that the site owner has opted out. Rules for User-agent: * count towards the score but do not stop the check: the bot acts on a person's request, not as a search crawler.

How the score is calculated is described in the methodology.