WebEngine

0%
SEO & Analytics

Why Google Will Not Index Your Pages — and How to Fix It

The Search Console statuses decoded: Crawled — currently not indexed, Discovered, Duplicate. What each really means and which actions actually get a page indexed.

Pavlo8 min read

The page exists, it opens, robots.txt allows it, the sitemap lists it — and search shows nothing, not for its title and not for an exact quote from its text. This is the single most common problem owners bring to us, and the cause is almost never "the algorithm". It is one of seven quite specific states. Below: how to read Search Console statuses correctly and what to do about each, ordered from most to least common.

7

causes cover nearly everything

#1

cause is thin or duplicate content

2–4w

typical time to reindexation

0

value in checking daily

The first thing to do

Before drawing conclusions, inspect the specific URL in Search Console’s URL inspection tool. It shows the state of that exact page: discovered, crawled, indexed — and if not, why. The site: search operator is useless for diagnosis: it returns a sample rather than the full index, and an empty result proves nothing.

What the statuses actually mean

StatusWhat happenedWhat it really means
Crawled — currently not indexedThe crawler read the page and passedA quality judgment: thin, duplicated, or adding nothing new
Discovered — currently not indexedURL known, content never fetchedCrawl budget or server availability problem
Duplicate without user-selected canonicalGoogle picked a different pageSeveral similar pages competing with each other
Alternate page with canonical tagThe canonical points elsewhereUsually correct behaviour, not an error
Blocked by robots.txtCrawling is disallowedA robots.txt rule, often inherited from staging
Excluded by noindex tagThe page carries an explicit noindexA forgotten tag or a CMS setting
Not found (404) / soft 404The page is missing or emptyBroken template, empty category, deleted product

Cause number one: the page is not worth indexing

"Crawled — currently not indexed" means the crawler read the page and chose not to store it. That is not a technical fault; it is an assessment. The pages that most often land here are auto-generated ones: catalogue filters, product cards with two sentences of description, categories holding a single item, near-identical city pages with a swapped place name.

The fix is editorial, not technical: either the page gains unique value, or it should not be in the index at all. The second option is normal and often correct — a hundred deliberately excluded utility pages beat a hundred indexed empty ones.

Does this page deserve to be indexed?

  • It answers a query none of your other pages answer
  • It has at least several paragraphs of unique text, not just a template
  • It differs from neighbouring pages by more than a city or product name
  • At least one internal link points to it from navigation or body copy
  • Its title and description were written for it, not generated by a template
  • You would send this URL to a customer as an answer to their question

When the crawler simply never gets there

"Discovered — currently not indexed" appears mostly on large sites and means the crawler knows the URL but is not spending resources fetching it. The causes are almost always two: the server responds slowly, or the site burns its crawl allowance on junk — thousands of URLs generated by filter and sort parameters.

  1. 1Cut the number of useless URLs. Block filter and sort parameters from crawling, or stop linking to them altogether.
  2. 2Speed up server response. A time to first byte above one second directly reduces how many pages a crawler gets through.
  3. 3Provide internal links. A page six clicks from the homepage is crawled last. How to organise this is covered in our internal linking guide.
  4. 4Keep the sitemap clean. Only pages returning 200 that you genuinely want indexed.

Duplicates: when Google picked the wrong page

If you have several similar pages, search picks one and shows only that. The chosen one may not be the one you want: a blog article instead of the commercial service page on the same topic. This is not a penalty — it is the consequence of giving two answers to one query without indicating a priority.

What to do after fixing it

After making changes, request re-inspection in Search Console and close the tab for two to four weeks. Reindexation does not happen within an hour, and daily checking speeds up nothing. If the status has not changed after a month, you fixed the wrong cause — go back to the URL inspection tool. The full list of technical checks is collected in our technical SEO audit guide.

Frequently asked questions about indexing

What does "Crawled — currently not indexed" mean?

The search crawler fetched the page, assessed it, and decided not to add it to the index. This is not a technical error but a quality judgment: most often the page has too little unique content, duplicates another page on the site, or adds nothing to what already ranks. It is fixed through the page content, not through technical settings.

How long does indexation take after a fix?

Usually two to four weeks. Resubmitting the page through the URL inspection tool in Search Console shortens the time to the next crawl but does not guarantee fast inclusion in the index. If the status has not changed after a month, the cause you fixed was most likely not the real one.

Why does the site: operator not show my page?

The site: operator returns only a sample of the index rather than its full contents, so a page missing from its results proves nothing. For diagnosis you need the URL inspection tool in Google Search Console, which shows the real state of a specific address and the reason it has not been indexed.

Should every page on a site be indexed?

No. Utility pages, filter results, print versions, thank-you pages and internal search results are better excluded from indexing. A hundred deliberately excluded utility pages are more useful than a hundred indexed empty ones, because the latter dilute the site’s signals and consume crawl budget.

What if Google chose the wrong canonical page?

It means the site has two pages with very similar content and search picked one of them on its own. You either need to separate them substantially by content and purpose, or explicitly declare the canonical URL and strengthen the preferred page with internal links. Simply setting a canonical tag is often not enough while the pages remain nearly identical.

In short

  • Diagnosis starts with the URL inspection tool, not the site: operator — the latter only returns a sample.
  • Indexation is three separate stages: discovery, crawling, storage. A page stalls at one specific stage.
  • "Crawled — not indexed" nearly always means thin or duplicated content, not a technical fault.
  • "Discovered — not indexed" is a crawl budget issue: a slow server or thousands of junk URLs.
  • City pages differing only by place name get collapsed into one — they need genuinely local content.
  • After a fix, wait two to four weeks; daily checking accelerates nothing.
Share
  • SEO
  • indexing
  • Search Console

Related reading