free seo audit

Free SEO Audit: Can Google and ChatGPT Find Your Site?

November 15, 2026 · 7 min read · Autana Solutions, Vancouver
Free SEO Audit: Can Google and ChatGPT Find Your Site? | Autana Solutions

A free SEO audit for a local business website should answer two questions. Can Google crawl, index and show your pages properly? And can AI search tools like ChatGPT, Perplexity, Claude and Gemini reach your pages so they can cite you? You can check both at no cost with Klimb Site Audit, which needs no account or card. It crawls your site for technical SEO problems, tests whether those four AI assistants can reach and cite your pages, and gives you a list of what to fix first. The rest of this post covers what a good audit looks at, what the official documentation says, and where an audit won't help.

Why AI search changes what an audit has to check

Until recently a technical audit mostly meant checking how Googlebot sees your site. Now several companies run their own crawlers, and each one has its own robots.txt name. If your robots.txt or firewall blocks the wrong one, you can disappear from an AI answer without ever knowing.

The vendors' documentation is clear about this. As of November 2026:

  • OpenAI separates its bots. Its crawler documentation says OAI-SearchBot is for search, and that sites opted out of it "will not be shown in ChatGPT search answers", though they can still show up as navigational links. GPTBot is a separate crawler for training models. Blocking GPTBot tells OpenAI not to use your content for training. According to OpenAI, that's a separate setting from search visibility.
  • Anthropic lists three bots in its help article Does Anthropic crawl data from the web, and how can site owners block the crawler?. ClaudeBot collects training data, Claude-User fetches pages when someone asks Claude a question, and Claude-SearchBot indexes content for search. Anthropic warns that blocking Claude-User may reduce your visibility for user-directed web search.
  • Perplexity says in its bot documentation that PerplexityBot exists to surface and link websites in its search results, and it recommends allowing it in robots.txt if you want to appear there.
  • Google uses a token called Google-Extended to control whether content can be used to train Gemini models and for grounding. Google's crawler overview states that Google-Extended "does not impact a site's inclusion in Google Search nor is it used as a ranking signal."

The practical point is that blocking training and blocking search are separate decisions. Plenty of business owners have pasted a block-all-AI-bots snippet into robots.txt and switched off their search visibility along with training. A good audit flags that.

What a free SEO audit should check on a local site

For a typical Metro Vancouver service business, like a clinic in Burnaby or a contractor in New Westminster, the technical basics still do most of the work.

Start with indexability. Google's guidance on AI features and your website says there are no additional requirements to appear in AI Overviews or AI Mode. A page just has to be indexed and eligible to be shown in Google Search with a snippet. Google also says you don't need to create new machine readable files, AI text files or special markup. So a stray noindex tag, a broken canonical or a page blocked in robots.txt hurts you in normal search and in AI answers at the same time.

Next comes content that machines can actually read. Google recommends keeping important content in text form. If your hours, service area and prices are only in an image or a PDF flyer, crawlers will have a hard time reading them.

Then check page experience. According to web.dev's Core Web Vitals guide, a good experience means Largest Contentful Paint within 2.5 seconds, Interaction to Next Paint of 200 milliseconds or less, and Cumulative Layout Shift of 0.1 or less. These are measured at the 75th percentile of page loads, on mobile and desktop separately. Slow, heavy page builder sites often miss these targets on phones.

Finally, look at internal links and structured data. Google recommends internal links so its crawler can find your pages, and structured data that matches what's visible on the page. Markup that claims things the page doesn't show is a problem, not a shortcut.

How to read the results

Don't try to fix everything at once. Work in this order:

  1. Anything that blocks a crawler completely. That means robots.txt rules, firewall or bot protection settings that return errors to legitimate crawlers, and noindex tags on pages you want found.
  2. Pages that should rank but can't be indexed. Your services pages and location page come first.
  3. Speed and mobile problems on your top pages.
  4. Thin or missing text. A services page with two sentences gives neither Google nor an AI assistant anything to quote.

Klimb puts its findings in a priority list for this reason. A small business owner has maybe an afternoon a month for this, so the first fix has to count.

Where this doesn't apply

An audit is a diagnosis. It doesn't fix anything by itself, and it has some real limits.

Being crawlable doesn't guarantee you'll be cited. Google's AI features page says outright that "indexing and serving isn't guaranteed." No vendor promises that an AI assistant will name your business, and no audit tool can promise it either.

Local rankings depend mostly on things outside your website. Google's help page Tips to improve your local ranking on Google says local results mainly come down to relevance, distance and how well known a business is, including reviews and how many websites link to you. If you've never filled out your Google Business Profile, start there before you worry about Core Web Vitals.

robots.txt isn't a complete control panel. OpenAI says ChatGPT-User handles user-initiated visits and robots.txt rules may not apply to it. Perplexity says Perplexity-User generally ignores robots.txt because a person requested the fetch. If you want to keep content private, put it behind a login. robots.txt won't do that.

Sometimes the right move is to wait. If nearly all your work comes from referrals and repeat clients and your calendar is full, a technical cleanup may not be worth much yet. Run the free check so you know where you stand, then decide.

A crawl is a snapshot. Changes take time to show up. OpenAI says robots.txt updates take about 24 hours to affect its search. Other systems update on their own schedules.

Frequently asked questions

Do I need an llms.txt file or special markup to show up in AI Overviews?

No. Google says you don't need new machine readable files, AI text files or special markup to appear in AI Overviews or AI Mode. Your page needs to be indexed and eligible to show in Google Search with a snippet, so standard technical SEO is what matters.

Will blocking GPTBot remove my site from ChatGPT search?

Not according to OpenAI. GPTBot is the crawler for training, while OAI-SearchBot controls whether your site appears in ChatGPT search answers. Sites that opt out of OAI-SearchBot won't show in those answers, so check which bot your robots.txt actually blocks.

Does blocking Google-Extended hurt my Google rankings?

No. Google states that Google-Extended does not affect a site's inclusion in Google Search and is not used as a ranking signal. It controls whether crawled content can be used to train Gemini models and for grounding, which is a separate decision from search visibility.

What should a local business fix first after an SEO audit?

Fix anything that blocks crawlers entirely first, like robots.txt rules or noindex tags on pages you want found. Then make sure your key services pages can be indexed. After that, work on speed and mobile problems, and add real text to thin pages.

Sources

If the audit turns up things you'd rather not fix yourself, or you want to talk through what's worth doing for your business, book a free call with Autana Solutions. We're based in Burnaby and New Westminster, and we'll give you a straight answer, even if that answer is that it isn't worth doing yet.

SEOAI searchlocal businessrobots.txtCore Web VitalsMetro Vancouver

Want an AI employee for your business?

We install a 24/7 AI worker for businesses in Vancouver, Burnaby, and beyond. Book a free Discovery Call.

Book a call →

Keep reading