NewThe tragent CLI is on npm: npx @tragent/cli scan your-store.com
tragent
Scan your site

Issue reference

No robots.txt served

Issue code
ROBOTS_MISSING
Stage
Find products
Protocol
—
Severity
Low

What it means

tragent reports this at the “Find products” stage. The question there is “Can an agent find your products at all?” An agent has to reach your site and locate products by searching or browsing before anything else can happen.

What it does to an agent

Agents get through, but your store reads less clearly to them than it could. It is worth fixing once the higher-severity issues are gone.

How to fix it

Serve a robots.txt that states explicitly which agents may read product and catalogue paths.

Check the fix

Run the check that reported ROBOTS_MISSING again after the change. The scan needs no account; an issue found during an AI shopping test needs that test run again.

Terminal
npx @tragent/cli scan https://your-store.com