Your website is not showing up in ChatGPT, and nothing tells you why. ChatGPT can only use pages that OpenAI's search robot, a program that reads web pages for ChatGPT, is allowed to visit, so start there. Run these six checks in order, beginning with the one that hides your whole site, and fix the first one that fails.
Check 1: your robots.txt blocks OpenAI's search crawler
A crawler is a program that visits web pages and reads them. OpenAI uses one called OAI-SearchBot to find pages for ChatGPT search. If your robots.txt file tells it to stay away, ChatGPT search won't use your pages in its answers. OpenAI says they may still show up as a plain link.
Robots.txt is a public text file at yourdomain.com/robots.txt that tells crawlers which pages they may visit. Open yours in a browser and look for either of these:
- a group of rules that starts with
User-agent: OAI-SearchBot(the line naming the crawler) and containsDisallow: /; - a
User-agent: *group withDisallow: /, which blocks every crawler that has no group of its own.
A website builder or security plugin may have added these lines without you noticing. If you find one, remove it or add an Allow rule for OAI-SearchBot. Our guide to robots.txt errors shows how to edit the file safely.
Check 2: bot protection turns the crawler away
Your host, firewall or CDN (a network that serves your site from many locations) may block automated visitors before robots.txt even matters. A blocked crawler usually gets an error page, such as 403 Forbidden, instead of your content.
Look in your hosting or CDN dashboard for settings called bot protection, bot fight mode or AI crawler blocking. Then check your server logs (the record your host keeps of every visit) for visits from OAI-SearchBot. Each visit has a status code, the three-digit answer your server gave: 200 means OK, 403 means blocked. Requests answered with 403 mean something is turning it away.
Check 3: your pages return errors
A crawler can't read a page that fails to load. Pages that answer with 404 Not Found, a 500 server error or a redirect that loops never get read, whoever is crawling.
Open your most important pages in a private browser window and confirm each one loads. Then fix any pages returning errors across the rest of the site.
Check 4: a noindex or nosnippet tag hides the page
This check matters for Google's AI answers, which many people mean when they say "AI search". Google says a page can appear in AI Overviews (the AI summary at the top of some Google results) and AI Mode (Google's chat-style search) only if two things are true. It must be indexed, which means stored in Google's list of pages it can show. And it must be allowed to show a snippet (the text preview under a search result).
A noindex tag keeps a page out of Google's index. A nosnippet tag keeps its text out of previews. OpenAI's crawler documentation doesn't say how it treats these tags. So remove them from every page you want found, as our guide to the noindex tag explains.
Check 5: Google hasn't indexed the page
Google states there are no extra requirements for its AI features: an indexed page that can show a snippet is eligible. So the simplest test for Google's AI answers is whether Google has the page at all.
Open Google Search Console, Google's free tool that shows how Google sees your site. Paste the page address into URL Inspection at the top of the screen. If it says the page is not on Google, read what "Crawled, currently not indexed" means and make sure the page is listed in your XML sitemap, a file that lists the pages you want search engines to find.
Check 6: you changed things less than a day ago
OpenAI says it can take about 24 hours after a robots.txt update for its search systems to adjust. Google says recrawling a page can take from a few days to a few weeks.
If you fixed something this morning, wait a full day before you test ChatGPT again. Google's AI answers can take longer, because Google may need days or weeks to read the page again. Note the date of each change so you can tell which fix made the difference.
What doesn't hide you from ChatGPT
OpenAI runs three crawlers with separate jobs, and its crawler documentation says each setting is independent of the others. Blocking the training crawler is a common worry, but it doesn't remove you from ChatGPT search.
| Crawler | What it does | What blocking it changes |
|---|---|---|
OAI-SearchBot | finds pages for ChatGPT search | your pages can't appear in ChatGPT search answers |
GPTBot | collects content for training OpenAI's models | your content isn't used for training; search is unaffected |
ChatGPT-User | opens a page when a person asks ChatGPT to | little: OpenAI says robots.txt rules may not apply to these visits |
So you can keep your content out of AI training and still be found. This robots.txt example does exactly that:
User-agent: OAI-SearchBot
Allow: /
User-agent: GPTBot
Disallow: /
Google works the same way. Its Google-Extended setting controls use of your content for some Google AI products, and Google says it doesn't affect Google Search, which still follows your Googlebot rules.
You may also read that ChatGPT search relies on Bing. OpenAI's crawler documentation doesn't say so, so we don't build advice on it.
How to test whether it worked
Ask ChatGPT the questions your customers would ask, without naming your business, for example "best bike repair shop in Brno". Try three or four phrasings, because answers change from one run to the next.
Look at the sources listed under each answer. If your site appears for some questions, the technical side works and the rest is about having the clearest answer. If it never appears after a day, go back to check 1.
Passing every check makes your site eligible, not guaranteed. Neither OpenAI nor Google promises to show any page.
Want a quick technical check of your homepage? Run a free audit and see the results in about a minute. For your whole site on a schedule, the crawler overview shows what gets checked.
Share it with whoever runs your site’s SEO.

