← HomeHow to Get Cited in AI
Answer

Does server-side rendering matter for AI crawlers?

By Jason Burns, Founder of HurcuLeads · Stuff Doer at Adolicious · Updated

Server-side rendering matters for AI crawlers because most of them fetch a page's raw HTML once and do not execute JavaScript — a client-rendered page returns an empty shell on that fetch, so the answer text is invisible to the crawler even when the site works perfectly for a browser.

Googlebot is the outlier: Google's JavaScript SEO documentation describes a two-pass render pipeline that eventually executes JavaScript. Even there, Google recommends server-side rendering, static rendering, or hydration for pages whose primary content depends on JavaScript, and warns that rendering can be delayed.

The other major AI crawlers — OpenAI's GPTBot and OAI-SearchBot, Anthropic's ClaudeBot, and Perplexity's PerplexityBot — are documented as HTML fetchers. None of the current public docs describe a full JavaScript-rendering pipeline like Googlebot's.

Practical translation: for any page you want cited, ensure the answer text, headings, and JSON-LD are present in the HTML returned by curl. Frameworks like Next.js, Astro, TanStack Start, and Nuxt make this the default when configured for SSR or static generation. Client-only React or Vue apps must add SSR/SSG for the pages that carry AEO content.

Test cheaply: curl -A "GPTBot" https://your-page and confirm the answer sentence appears in the returned HTML. If it does not, no amount of schema will help.

Related terms

Sources

Related questions people ask next

  • Why doesn't my business appear in ChatGPT?

    Your business doesn't appear in ChatGPT because ChatGPT's answer layer only cites pages its crawlers can fetch, parse, and confidently attribute — and most sites fail on at least one of those three.

  • How should robots.txt handle AI crawlers?

    Handle AI crawlers in robots.txt by explicitly listing each user agent — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Perplexity-User, Google-Extended — and setting Allow or Disallow per bot to match your policy on training, search citation, and live-fetch use.

  • How do AI assistants choose which sources to cite?

    Grounded AI assistants choose sources by running a retrieval query against a search index, ranking the returned pages using traditional relevance and authority signals, and then having the model select the passages it can quote with the highest attribution confidence.

  • How do I get cited by Perplexity?

    Get cited by Perplexity by allowing its crawler (PerplexityBot) in robots.txt, publishing server-rendered pages with a clear direct answer as the first sentence under each heading, and making the underlying URL rank on Bing — because Perplexity retrieves against public web indexes and its own crawl.