Crawled - Currently Not Indexed - Google Index Coverage Issue

What Is Crawled – Currently Not Indexed? Ways To Fix Them

Ashkar Gomez
11min read
Table of Contents

Imagine you are working on your website or a client’s website, and you notice a technical error in Google Search Console as Page Crawled – currently not indexed, what would you do to fix it? 

Crawled – currently not indexed is an important Google index coverage issue that must be fixed depending on the priority. Various factors contribute to this issue, with different priority levels for improvement.

Many webmasters take this coverage issue on the higher side, but the impacts are high regarding crawl budget, indexing, and ranking.

The goal of every SEO professional will be to index the web pages rapidly and rank them on the search engine results page (SERP).

But what if your web pages are not indexed?

Your quality content, research, and many more efforts will go in vain.

This index coverage issue is one of the vital checklists we usually audit in our technical SEO process.

At the end of the blog, you will come to know what causes the “Crawled – currently not indexed” error and how to fix it smoothly, It is not as complicated as you think,

Let’s dive in.

What Is Crawled - Currently not Indexed?

Crawled-Currently-not-Indexed

This Google index coverage issue states that Googlebot could

  • Discover your web pages,
  • Crawl the complete web pages (up to 15 MB),
  • Render the contents of the web pages.

However, Google may fail to index the web pages for many reasons. We will be looking at both the reason and solution part later in this content.

As per Google or other search engine ethics, indexing is their choice. It is not mandated for Google to index your web pages post request indexing through URL inspection in the Google search console.

Post rendering, Google undergoes multiple checklists as per their algorithm and ranking factors to set a canonical URL.

If a web page doesn’t meet Webmaster quality guidelines, there is a high chance of Google not indexing or de-indexing the page.

How to Find the Pages That Are Crawled - Currently Not Indexed?

Page Indexing Dashboard

Google Search Console, a free technical SEO tool by Google, helps us identify these errors. To check what web pages come under crawled – currently not indexed, follow these steps:

Step 1 – Login to Google Search Console and choose your property.

Step 2 – On the left side, you will be provided with multiple options, click on pages that comes under index.

Step 3 – On page Indexing dashboard, Click Not Indexed, you will see list of  index coverage issues on your website.

Step 4 – If your  website has “crawled – currently not indexed” ,  error then it will appear with the number of web pages affected.

Crawled-Currently Not Indexed Issue - Dashboard

Step 5 – Just click on the option crawled – currently not indexed. You will be provided with the web pages that are excluded for this reason.

Crawled Not Indexed Error

What are the Reasons for Crawled - Currently Not Indexed?

Just like the other Google index coverage issue discovered – currently not indexed, this coverage issue is backed by multiple reasons.

Sometimes, Google might take action on the web pages that are indexed earlier.

Here are some reasons that can stop your web pages from indexing after discovering, crawling, and rendering.

  1. Excluded by Robots tag
  2. Keyword cannibalization
  3. Crawl errors
  4. Duplicate content
  5. Thin and low-quality content
  6. Improper internal linking and orphaned page
  7. Backlinks from spammy websites
  8. Google Penalty

Usually, when a web page is marked noindex under the robots tag, your web page can get this Google index issues.

“Noindex” robots tag command informs search engines to exclude from indexing.

Generally, details or pages with internal confidential content, tags, terms and conditions, privacy policy, etc., will come under noindex.

If you find any other pages that are important to be indexed in search engines, then you have to change noindex to index.

When two or more web pages have the same search intent, it is termed as keyword cannibalization. Google will get confused about which page to rank, so it excludes all the pages with the same intent from indexing.

Keyword cannibalization is an act of competition between internal web pages, which holds a high chance of web pages being excluded under crawled – currently not indexed.

Sometimes, your web pages won’t be indexed due to the crawl budget. To manage the crawl budget, you should check the crawl errors in the Google Search Console.

Crawl Status in Google Search Console

As per the above image, go to settings in Google Search Console to find Crawl Stats.

Click on Open Report, you will be getting all the details of the status of HTTP response.

Crawl Stats by HTTP response

Here, status codes like 200 and 304 are good URLs. Sometimes, you can be fine with redirects like 301 and 302.

The error part comes when you have webpages with HTTP status code 404 (not found), other internal issues 4xx, and server issues 5xx.

These issues consume a lot of crawl budget, and it takes a lot of time to crawl a new valuable web page, as the crawl budget would have vanished.

Duplicate Content:

When you have the same content across different web pages of your website without a proper canonical tag, it becomes duplicate content.

In this case, Google will tag all the duplicate web pages as crawled – currently not indexed.

Our best advice would be to avoid using the same content for any other web pages and show the uniqueness and relevancy of the web page.

Still, if you require to copy the same content (franchise, multiple-location businesses), use proper canonical tags to avoid exclusion from indexation.

Thin or Low Quality Content:

Often, pages with thin or low-quality content are mapped under crawled – currently not indexed.

Thin content is when you have very low content (less than 600 words) on a web page.

Low-quality content is when your web pages are built by AI, auto-generated, cloaking, keyword stuffing, irrelevant intent in the web page, etc.

Improper Internal Link Planning and Orphan Pages

Your web pages would have been discovered and crawled by search engines through sitemap. But, if the web page is not referred from internal web pages, then the chance of indexing goes to zero.

You often see orphan pages in the coverage issue crawled-currently not indexed.

To avoid this, plan your site architecture and internal link each relevant page.

How to Fix Crawled Currently Not Indexed Issue?

There are multiple ways to fix this issue, and we provide some priority levels with different types of URLs.

Looking at the recovery, you should do this to check when Googlebot crawled this web page the last time.

Validate Crawled Currently Not Indexed Web Page

As shown in the above image, please place the URLs (that are excluded from indexing post crawling) in the URL inspection of Google Search Console.

You will get these details, as the URL is not on Google with the exact status on coverage crawled currently not indexed, with the last crawl date.

Once you have done that, then you should follow the upcoming ways to fix this coverage issue,

False Positives

Low priority

This case is when your Google search console says that the web page is crawled-currently not indexed. But, your web pages are visible on the search engine result page.

How that is possible, and how to check a web page is a false positives of not indexed?

Take, for example, you need to check the indexation station of the webpage https://the7eagles. com/discovered-currently-not-indexed/

Take this URL and place it in the search engine bar with “site:” placed before the URL.

False Positives - Fixing crawled currently not indexed

If you see your web page visible in SERP (search engine results page), then do nothing. This is known as false positives.

Give the Google search console some more time to solve this by itself. The good news here is your web page is already indexed.

You can request manual indexing in Google Search Console to speed up the process. Still, Google takes the decision.

How to fix URLs with /feed/?

Rss Feed URL under Crawled currently not indexed

Neither do URL inspection and manual requests for indexing nor remove the URL.

These webpages will be navigated to XML documents that are important for the RSS feed and not for the Google index.

How to fix URLs with Pagination?

Low Priority

This is quite a common issue of crawled – currently not indexed. Frequently seen in e-commerce or websites with a high number of pages. Search engines crawl large pages of websites with the help of pagination.

URL with pagination

To resolve a number of pagination URLs from the excluded section, you should build with proper architecture and internal links so crawling becomes feasible for search engines.

Besides this make sure, your paginations are free from noindex tag (when you have e-commerce or news website), and contains self-referring canonical tag.

So, when you see these types of URLs under crawled – currently not indexed, then do nothing. Go to bed, just relax.

If you still think on saving crawl budgets from pagination, then block the pagination URLs from Robots.txt

How to fix URLs with Redirects?

High Priority

This is an important issue that should be given high focus. SEO professionals usually do a redirect when creating a destination page instead of an existing page.

This helps transfer both traffic and authority to the destination page. Still, the redirected web page rents in the Google Index.

Redirect URLs consume more crawl budget. That, too, when a page has multiple redirects, the consumption of crawling increases.

We advise you not to change the URL of any web pages. If you are changing the URL for SEO optimization, then you should use the 410 command to redirect the URL and start indexing the destination URL.

Yes, you will lose authority that has been built into the existing page. Yet, that’s the best way of resolving this use, as the redirecting URL will still be in the index database for crawling with no content.

So, it will keep the redirecting URL or destination URL in crawled – currently not indexed.

Just use 410 command to the redirecting URL and move on, this issue will resolve soon.

How to fix Pages with Thin or Low Quality Content?

High Priority

We find this error quite often when we do SEO audits. This error can even de-index the web pages that are indexed in earlier episodes of crawling.

This issue can be fixed and is a high priority for indexing them. 

Just update the content of the web page. If you find this a tedious process, you can get our content writers to work on that.

We will work on a 10x content strategy and make relevant, fresh, and content matching to your competitor on the 1st page of SERP.

Always focus on quality content. Your content should be a solution to your audience query. So, never engage in building content with

  • AI tools
  • Auto Generating Programs
  • Bot contents
  • Copy Content
  • Cloaking Contents

Looking to Fix Crawled – Currently Not Indexed? You’re just away from a mail!!!

Conclusion:

  • Crawled – currently not indexed is one of the Google Index coverage issues that affects the indexing of any web page.
  • This can harm your potential page from indexing.
  • This issue can be caused by various factors like thin content, duplicate content, improper internal links, excluded by robots tag, etc.
  • Focus on providing valuable content, and don’t duplicate, these are the best way to fix this google coverage issue.
  • If you find this process tedious, you can hire us for technical SEO services.
Ashkar Gomez

Ashkar Gomez

Ashkar Gomez is the Founder of 7 Eagles (a Growth Marketing & SEO Company). Ashkar started his career as a Sales Rep in 2013 and later shifted his career to SEO in 2014. He is one of the leading SEO experts in the industry with 8+ years of experience. He has worked on 200+ projects across 20+ industries in the United States, Canada, the United Kingdom, UAE, Australia, South Africa, and India. Besides SEO and Digital Marketing, he is passionate about Data Analytics, Personal Financial Planning, and Content Writing.

Table of Contents

Related Articles

Your Business
Growth
Starts Here

Let’s Have a Cup of Digital Tea

Request Your Free Quote