Can AI assistants read thebiglead.com?

Measured on 2026-09-19 by asking the site 7 times — once as a browser, once as each of the 6 crawlers that feed ChatGPT, Claude, Perplexity, Gemini, Meta AI, Apple Intelligence and Doubao — and comparing what came back. The AI-training opt-out tokens that never crawl are read from robots.txt instead.

What each crawler got back

Cloudflare answers for this domain. Where a crawler above is refused while robots.txt allows it, the rule is applied by that edge, not written by the site — see how often each edge does this.

What to change, in order

1. Let in the 6 crawlers your own robots.txt already allows+6 crawlers
   ClaudeBot, GPTBot, OAI-SearchBot, PerplexityBot, Meta-ExternalAgent, Amazonbot are turned away before reading the page (served a bot challenge instead of the page), while robots.txt permits them — so this block is not written in your site. Cloudflare answers for this domain. Cloudflare applies AI-crawler blocking at the edge, independently of robots.txt (Security → Bots, plus the managed robots.txt feature). https://developers.cloudflare.com/bots/concepts/bot/ Fixing it takes this domain from 0 to 6 of 6 crawlers.
2. Declare the facts in JSON-LD
   There is no JSON-LD on the page, so every fact — who you are, what you sell, the price — has to be guessed out of the prose and the layout. A schema.org block is the difference between being quoted correctly and being paraphrased.

The checks

• Answers AI agents like it answers people0%
• Readable without JavaScript2%
• robots.txt lets the crawlers in100%
• Facts in JSON-LD0%
• Content reachable, not buried60%
• Publishes a map of itself75%
• Plain structure70%

Browse the whole index →

Embed this score

Put the badge on thebiglead.com — it links back here, and re-measures every time this index re-crawls.

<a href="https://shop.lumnika.com/ai-readiness/thebiglead.com"><img src="https://shop.lumnika.com/ai-readiness/thebiglead.com/badge.svg" alt="AI readability"></a>