← HomeHow to Get Cited in AI
Answer

How often does ChatGPT re-crawl my site?

By Jason Burns, Founder of HurcuLeads · Stuff Doer at Adolicious · Updated

ChatGPT's crawl frequency depends on which of OpenAI's three user agents is fetching — GPTBot crawls on OpenAI's own schedule for training, OAI-SearchBot crawls to keep the ChatGPT Search index fresh (accelerated by IndexNow via Bing), and ChatGPT-User only fetches when a specific user prompt triggers a live retrieval.

OpenAI has not published a public schedule for GPTBot; frequency varies by site, popularity, and change signals. Server logs typically show GPTBot returning every few days on active sites and much less often on stable pages.

OAI-SearchBot is the more actionable one for AEO. Because ChatGPT Search is Bing-backed, an IndexNow ping on publish surfaces the URL to Bing within minutes and, transitively, to ChatGPT Search's freshness layer. Publishers routinely see new URLs available for citation the same day.

ChatGPT-User is on-demand — no schedule at all. It fires when a user asks ChatGPT to open or read a specific URL.

Practical measurement: filter your access logs for each of the three user-agent strings. That gives real crawl frequency for your site rather than a general estimate.

Related terms

Sources

Related questions people ask next

  • How do I get cited by ChatGPT?

    Get cited by ChatGPT by allowing OAI-SearchBot and ChatGPT-User in robots.txt, ranking on Bing (ChatGPT Search's primary index), pushing new URLs via IndexNow, and shipping pages with a direct-answer first sentence plus QAPage or FAQPage JSON-LD.

  • What is IndexNow and why does it matter for ChatGPT?

    IndexNow is an open protocol jointly announced by Microsoft Bing and Yandex that lets a site push new or changed URLs to participating search engines in near real time — and it matters for ChatGPT because ChatGPT Search's live web results are anchored on Bing's index.

  • How should robots.txt handle AI crawlers?

    Handle AI crawlers in robots.txt by explicitly listing each user agent — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Perplexity-User, Google-Extended — and setting Allow or Disallow per bot to match your policy on training, search citation, and live-fetch use.

  • Why doesn't my business appear in ChatGPT?

    Your business doesn't appear in ChatGPT because ChatGPT's answer layer only cites pages its crawlers can fetch, parse, and confidently attribute — and most sites fail on at least one of those three.