BugWP logo BugWP
Back to Community
Home / Community / Plugin → All in one seo

Why Google Won't Index Your Site: Fixing Common 'noindex' and Crawling Issues

37 threads Sep 16, 2025 Plugin → All in one seo

Content

Discovering that Google is refusing to index your website or specific pages is a common and frustrating issue for WordPress users. Often, the culprit is an unintended noindex tag or a misconfigured setting that blocks search engines. This guide will walk you through the most frequent causes and their solutions, based on community troubleshooting.

What Does "Excluded by 'noindex' Tag" Mean?

This error means that Google's crawler found a meta tag or HTTP header instructing it not to index the page. While this is sometimes intentional (e.g., for paginated pages or feeds), it's often an accidental setting that needs to be corrected.

Common Causes and How to Fix Them

1. Accidental Global Noindex Setting

The most common cause is a global setting within the All in One SEO plugin that has been enabled by mistake.

  • How to Check: In your WordPress dashboard, navigate to All in One SEO > Search Appearance > Advanced.
  • How to Fix: Find the Global Robots Meta setting. Ensure the Use Default Settings toggle is on, or if it's off, manually verify that No Index is not selected.

2. Individual Page/Post Settings

Sometimes, the noindex directive can be applied to individual pieces of content.

  • How to Check: Edit the specific page or post that isn't being indexed. Scroll down to the All in One SEO settings section and click on the Advanced tab.
  • How to Fix: Ensure the Robots Setting is set to Use Default or manually confirm that No Index is unchecked.

3. Conflicting SEO Plugins

Running multiple SEO plugins simultaneously can cause conflicts where one plugin outputs a noindex tag even if another is configured correctly.

  • How to Fix: Deactivate and completely uninstall any other SEO plugins you are not using. Use only one SEO plugin to manage your meta tags.

4. WordPress Reading Settings

A core WordPress setting can override your SEO plugin.

  • How to Check: Go to Settings > Reading in your WordPress admin.
  • How to Fix: Absolutely ensure that the checkbox next to "Discourage search engines from indexing this site" is NOT checked. If it is, your entire site will be set to noindex.

5. Feed URLs Being Indexed

It's normal for feed URLs (e.g., /feed/, /comments/feed/) to have a noindex tag, as seen in Thread #16. This is not an error; it's intended to prevent duplicate content. You typically do not want these pages indexed.

6. Paginated Pages

By default, All in One SEO adds noindex tags to paginated pages (e.g., page 2, 3, etc., of your blog archive). This is a best practice to prevent thin content from being indexed and is usually not something you need to change.

What to Do After Making Changes

  1. Clear Your Cache: If you use a caching plugin or server-level cache, clear it entirely after changing any settings.
  2. Request Re-crawling in Google Search Console: For the specific URLs affected, use the URL Inspection tool in Google Search Console. After verifying the live page no longer has the noindex tag, request a re-index.
  3. Be Patient: It can take from a few days to several weeks for Google to process the changes and re-index your pages.

When It's Not a "noindex" Problem

If your pages are discoverable but "Not Indexed," the issue may not be technical. As highlighted in Thread #6, Google may have discovered your pages but chosen not to index them because it doesn't deem them valuable, unique, or helpful enough. In these cases, focus on auditing and improving your content quality.

By methodically checking these common areas, you can usually identify and resolve the issue preventing Google from indexing your valuable content.

Related Support Threads Support