Beyond the page, there's the technical layer that crawlers and agents read. Here's the priority order — and what doesn't yet keep its promises.
1. Markup first
schema.org/Product in JSON-LD is the base engines already read. It's the highest-return lever; start there.
2. A structured, up-to-date feed
Expose a clean feed, kept up to date from your catalog, with price and stock consistent with your pages.
3. robots.txt: control access
robots.txt tells bots — including AI crawlers — what they may crawl. You stay in control of who accesses what.
4. llms.txt: useful, but no guarantee
llms.txt is a community proposal, not a standard adopted by major engines. Do it if it's quick — but after the essentials, not instead of them.