Data Study · AI Search

    Among the Top 5,000 Sites, Those With an llms.txt File Are Cited in AI Answers Twice as Often (21% vs 11%)

    Among the 5,000 biggest sites, 20.5% of 307 with an llms.txt file were cited in AI answers, against 10.7% of 307 rank-matched sites without one.

    • 772,411 top-1M homepages; 307 rank-matched pairs
    • HTTP Archive + Google US mobile, Nov 2026
    20.5%
    Top-5,000 sites cited at least once in AI answers, with vs without llms.txt
    Any AI answer: with file20.5%
    Any AI answer: without10.7%
    AI Overviews: with file18.9%
    AI Overviews: without10.4%
    ChatGPT/Perplexity: with6.5%
    ChatGPT/Perplexity: without2%

    Source: PageSpeed Matters. Google US mobile results, 3 Nov 2026, and ChatGPT and Perplexity answers; 307 sites per group.

    Correlation on rank-matched groups; sites with the file skew to big English-language brands.

    In this study

    Top-1M homepages with a valid llms.txt file, by traffic rank band (October 2026)

    Rank bandHomepagesWith llms.txtShare
    Top 1k738577.7%
    1k to 5k2,9202508.6%
    5k to 10k3,5863098.6%
    10k to 50k28,8312,2707.9%
    50k to 100k36,9372,5727.0%
    100k to 500k306,04821,4767.0%
    500k to 1M393,35130,5037.8%
    All top 1M772,41157,4377.4%

    Source: PageSpeed Matters, Nov 2026. HTTP Archive mobile crawl, Oct 2026; rank bands by Chrome traffic.

    Summary

    An llms.txt file is a plain-text guide that tells AI tools what a site is and which pages matter. Plenty of guides now recommend one to get cited in AI answers. We checked how many big sites have one, and whether the ones that do turn up in AI answers more often.

    Few have one: 7.4% of the top 1 million sites (57,437 of 772,411). But among the 5,000 biggest sites, the ones with a file are cited about twice as often. 20.5% of 307 sites with llms.txt were cited in Google's AI Overviews or in ChatGPT and Perplexity answers, against 10.7% of 307 similar-sized sites without one. That is a link, not proof the file causes it.

    What we measured

    We used the HTTP Archive October 2026 mobile crawl of the top 1 million sites by Chrome traffic (772,411 homepages). A site counts as having llms.txt when the file exists at /llms.txt and passes the crawl's format check.

    For citations we took every one of the 307 sites in the top 5,000 with a valid file and matched them, rank band by rank band, with 307 sites without one. We then checked whether each site was cited at least once in 155,810 AI Overview citations from Google US mobile results collected on 3 November 2026, or in about 57,000 citations from ChatGPT and Perplexity answers to the same kind of US English questions.

    Limits: this is a correlation on small groups. Sites with llms.txt lean toward big English-language brands and retailers that AI answers cite anyway, while the comparison group holds more non-English and adult sites.

    Only 7.4% of the top 1 million sites have an llms.txt file

    57,437 of 772,411 top-1M homepages (7.4%) serve a valid llms.txt file. Size barely changes it: 7.7% of the top 1k sites, 8.6% of those ranked 1k to 10k and 7.0% to 7.9% further down.

    So llms.txt is still a minority practice even among sites with large audiences, and the biggest brands have not adopted it faster than everyone else.

    7.4%

    Share of 772,411 top-1M homepages serving a valid llms.txt file (HTTP Archive, October 2026).

    Top sites with llms.txt are cited about twice as often

    Among the 5,000 biggest sites, 63 of 307 with an llms.txt file (20.5%) were cited at least once in an AI Overview or a ChatGPT or Perplexity answer. Of 307 rank-matched sites without one, 33 were (10.7%).

    That is about 1.9 times the rate. The likely reason is partly who adopts the file: big English-language brands and retailers that AI answers cite anyway.

    The gap is wider in ChatGPT and Perplexity answers

    Split by source, 58 of the 307 sites with llms.txt were cited in AI Overviews, against 32 without, or 18.9% vs 10.4%. In ChatGPT and Perplexity answers it was 20 sites against 6, or 6.5% vs 2.0%.

    The chat tools cite far fewer sites overall, so those counts are small. Treat the direction as the finding, not the exact ratio.

    What this means for your site

    An llms.txt file is cheap to add and is found more often on sites that AI answers cite. It is not a shortcut: this data cannot separate the file from the kind of brand that adopts it, and the file is at most one part of being cited.

    • Add the file if your platform does not. Point it at your most useful, up-to-date pages, not every URL.
    • Fix the pages it points to first. A clear answer near the top of a page is more likely to be quoted.
    • Keep AI crawlers able to reach those pages. Check robots.txt and any firewall rules before adding a guide to pages they cannot fetch.
    • Track citations, not just the file. Check which of your pages AI answers cite before and after any change.

    On the technical side, our technical SEO services set up an llms.txt file that points to your best pages, check that robots.txt and firewall rules let AI crawlers reach them and fix rendering gaps, so the pages you list are pages they can read. Because the file alone does not make a page worth citing, our on-page SEO services rewrite page openings to answer the question directly, tighten headings around what people ask and refresh outdated facts, so each listed page is worth quoting.

    Sources

    • PageSpeed Matters analysis of the HTTP Archive October 2026 mobile crawl, top 1 million sites by Chrome traffic (772,411 homepages)
    • PageSpeed Matters analysis of AI Overview citations in Google US mobile results (3 November 2026) and of ChatGPT and Perplexity answer citations
    • The llms.txt proposal: https://llmstxt.org

    Embed this research

    Paste this on your site to embed the chart. It links back to the source automatically.

    <iframe id="psm-llms-txt-ai-citations" src="https://www.pagespeedmatters.com/embed/data-studies/llms-txt-ai-citations" width="100%" height="600" style="width:100%;border:1px solid #E2E3E1;border-radius:12px" loading="lazy" title="Among the Top 5,000 Sites, Those With an llms.txt File Are Cited in AI Answers Twice as Often (21% vs 11%) - PageSpeed Matters"></iframe>
    <script>window.addEventListener("message",function(e){if(e&&e.data&&e.data.psmEmbed==="llms-txt-ai-citations"&&e.data.height){var f=document.getElementById("psm-llms-txt-ai-citations");if(f){f.style.height=e.data.height+"px";}}});</script>
    <p style="font:14px/1.5 system-ui,sans-serif">Source: <a href="https://www.pagespeedmatters.com/resources/data-studies/llms-txt-ai-citations">Among the Top 5,000 Sites, Those With an llms.txt File Are Cited in AI Answers Twice as Often (21% vs 11%) - PageSpeed Matters</a></p>

    Frequently asked questions

    Does an llms.txt file help you get cited in AI answers?

    Sites with one are cited more often. Among the 5,000 biggest sites, 20.5% of 307 with an llms.txt file were cited in AI answers vs 10.7% of 307 without. This is a correlation: sites with the file skew to big brands that AI answers cite anyway.

    How many websites have an llms.txt file?

    7.4% of the top 1 million sites (57,437 of 772,411) served a valid llms.txt file in the October 2026 HTTP Archive crawl. The share is between 7.0% and 8.6% in every traffic band.

    Is the effect different in Google AI Overviews and ChatGPT?

    Both lean the same way. In AI Overviews 18.9% of top sites with the file were cited vs 10.4% without; in ChatGPT and Perplexity answers 6.5% vs 2.0%, from small counts.

    Share

    How we measured

    Methodology & Source

    Data source
    HTTP Archive mobile crawl, October 2026 (top 1M homepages); AI Overview citations in Google US mobile results (3 November 2026) and ChatGPT and Perplexity answer citations
    Collection date
    November 2026
    Sample
    772,411 top-1M homepages; 307 rank-matched pairs
    Release
    HTTP Archive + Google US mobile, Nov 2026

    772,411 top-1M homepages by Chrome traffic; a site has llms.txt when /llms.txt exists and passes the crawl's format check. Citation test: all 307 top-5,000 sites with a valid file, against 307 sites without one matched by rank band. A site is cited when it appears at least once among 155,810 AI Overview citations (US mobile, 3 Nov 2026) or about 57,000 ChatGPT and Perplexity citations to US English questions. Correlation only: sites with the file skew to big English-language brands, and the comparison group holds more non-English and adult sites.

    Using this data?

    Cite this study

    Link back to the study when you cite it.

    APA

    Matt Suffoletto. (2026). Among the Top 5,000 Sites, Those With an llms.txt File Are Cited in AI Answers Twice as Often (21% vs 11%). PageSpeed Matters. https://www.pagespeedmatters.com/resources/data-studies/llms-txt-ai-citations

    Plain link

    Among the Top 5,000 Sites, Those With an llms.txt File Are Cited in AI Answers Twice as Often (21% vs 11%) - PageSpeed Matters - https://www.pagespeedmatters.com/resources/data-studies/llms-txt-ai-citations

    Ready to Get Started?

    Get your site optimized in as little as 3 days. From $500.