Why Are Pages Missing From Your XML Sitemap? A Troubleshooting Guide
Content
If you've discovered that your XML sitemap is missing pages, you're not alone. This is a common issue reported by users of the 'XML Sitemap Generator for Google' plugin. A sitemap that doesn't list all your published content can negatively impact how search engines crawl and index your site, often leading to a drop in search visibility.
Based on community reports, here are the most frequent causes and their solutions.
1. The "Links Per Page" Setting
The Problem: Your sitemap shows exactly 100 or 1000 URLs, but you have many more published pages or posts. Search console might report a decreasing number of indexed pages.
The Cause: This is often due to a configuration setting within the plugin. The "Links per page" value dictates the maximum number of URLs listed in a single sitemap file before the plugin should create additional sitemap files. A bug related to a new minimum size implementation has also been known to cause this.
The Solution:
- Navigate to the plugin's settings in your WordPress dashboard (usually under Settings > XML Sitemap).
- Locate the "Links per page" or similarly named field.
- Change the value to a higher number, such as 1000 (which is the new recommended minimum based on search engine guidance).
- Save your changes and regenerate your sitemap.
2. Conflicting Sitemap Generators
The Problem: You have multiple sitemap files (e.g., sitemap.xml, sitemap-index.xml) or your sitemap includes strange, unexpected URLs from other plugins (like ACF field groups).
The Cause: Another plugin or your theme might also be generating a sitemap, creating a conflict. The 'XML Sitemap Generator for Google' plugin might be trying to include content types from other plugins that you don't intend to be in your main sitemap.
The Solution: Deactivate other SEO or sitemap plugins to ensure only one sitemap generator is active. Check the plugin's settings to review and deselect any post types or taxonomies you do not want included (e.g., ACF Field Groups, feed post types).
3. Caching Issues
The Problem: New or updated content does not appear in the sitemap, even though it is published. Old, incorrect URLs (like those with dated permalinks) might still be listed.
The Cause: Caching plugins or server-level caching can serve an old, stale version of your sitemap.xml file.
The Solution: Clear all your caching. This includes your caching plugin (e.g., Autoptimize, W3 Total Cache), your server's cache (if applicable), and your CDN's cache (e.g., Cloudflare). After clearing the cache, regenerate the sitemap from the plugin's settings.
4. Incorrect Settings
The Problem: Specific types of content, such as static pages or custom post types, are absent from the sitemap.
The Cause: The corresponding option to include that content type may not be selected in the plugin's configuration.
The Solution: Carefully review the plugin's settings page. Ensure that all relevant checkboxes are selected for the content you want to include, such as "Include static pages", posts, categories, tags, and custom post types.
5. Permalink Structure Changes
The Problem: After changing your site's permalink structure, the sitemap still contains the old URLs.
The Solution: WordPress and the plugin typically handle this automatically, but a manual refresh can help. Go to Settings > Permalinks in your WordPress admin and simply click "Save Changes" without making any modifications. This flushes the rewrite rules and can force the sitemap to regenerate with the new correct URLs.
If you continue to experience issues after trying these steps, it is recommended to check for any error logs in your WordPress dashboard and ensure your plugin is updated to the latest version, as the 'XML Sitemap Generator for Google' team frequently releases updates to address known bugs.
Related Support Threads Support
-
Blog & Custom Canonical Links not indexedhttps://wordpress.org/support/topic/blog-custom-canonical-links-not-indexed/
-
XML Sitemap and Gravity viewhttps://wordpress.org/support/topic/xml-sitemap-and-gravity-view/
-
Sitemap showing lesser postshttps://wordpress.org/support/topic/sitemap-showing-lesser-posts/
-
Dupliacte entries in sitemap xmlhttps://wordpress.org/support/topic/dupliacte-entries-in-sitemap-xml/
-
no urls shownhttps://wordpress.org/support/topic/no-urls-shown/
-
XMl sitemap dont show currectly Persian languge in urlshttps://wordpress.org/support/topic/xml-sitemap-dont-show-currectly-persian-languge-in-urls/
-
updated blog linkshttps://wordpress.org/support/topic/updated-blog-links/
-
why sitemap doesn’t include pages?https://wordpress.org/support/topic/why-sitemap-doesnt-include-pages/
-
ALL LINKS BROKEN IN SETTINGS/XML-Sitemap areahttps://wordpress.org/support/topic/all-links-broken-in-settings-xml-sitemap-area/
-
via “Nextend Social login” is not displayed in the sitemaphttps://wordpress.org/support/topic/via-nextend-social-login-is-not-displayed-in-the-sitemap/
-
Generated HTML page shows blog content?https://wordpress.org/support/topic/generated-html-page-shows-blog-content/
-
Sitemap dosen’t include subpageshttps://wordpress.org/support/topic/sitemap-dosent-include-subpages/
-
Same Sitemap content in 2 sub sitemap fileshttps://wordpress.org/support/topic/same-sitemap-content-in-2-sub-sitemap-files/
-
I have 6 “homepages”https://wordpress.org/support/topic/i-have-6-homepages/
-
Sitemap not adding new Authors to XMLhttps://wordpress.org/support/topic/sitemap-not-adding-new-authors-to-xml/
-
/sitemap-externals.xml to /externals.xml (empty)https://wordpress.org/support/topic/sitemap-externals-xml-to-externals-xml-empty/
-
multisite sitemapshttps://wordpress.org/support/topic/multisite-sitemaps/
-
Bug: Bing Webmaster Only Reading Part of Sitemap.xmlhttps://wordpress.org/support/topic/bug-bing-webmaster-only-reading-part-of-sitemap-xml/
-
Sitemap links are emptyhttps://wordpress.org/support/topic/sitemap-like-are-empty/
-
Most links in a weird file!https://wordpress.org/support/topic/most-links-in-a-weird-file/
-
Most pages omitted from page-sitemap.xmlhttps://wordpress.org/support/topic/most-pages-omitted-from-page-sitemap-xml/
-
Where to place sitemap link?https://wordpress.org/support/topic/where-to-place-sitemap-link/
-
Why is the post-sitemap.xml list in reverse orderhttps://wordpress.org/support/topic/why-is-the-post-sitemap-xml-list-in-reverse-order/
-
error in my sitemaphttps://wordpress.org/support/topic/error-in-my-sitemap/
-
Indexed URL, not submitted in Sitemaphttps://wordpress.org/support/topic/indexed-url-not-submitted-in-sitemap/
-
Multiple problems in sitemaphttps://wordpress.org/support/topic/multiple-problems-in-sitemap/
-
Pagination is brokenhttps://wordpress.org/support/topic/pagination-is-broken-3/
-
A large number of site map URLs during URL inspection in Search Consolehttps://wordpress.org/support/topic/a-large-number-of-site-map-urls-during-url-inspection-in-search-console/
-
Why are there 4 versions of the sitemaphttps://wordpress.org/support/topic/why-are-there-4-versions-of-the-sitemap/
-
sitemap goes to buy dedicated servers pagehttps://wordpress.org/support/topic/sitemap-goes-to-buy-dedicated-servers-page/
-
Plugin UI with AWS Links – NOT FOUNDhttps://wordpress.org/support/topic/plugin-ui-with-aws-links-not-found/
-
how to include HTML sitemapshttps://wordpress.org/support/topic/how-to-include-html-sitemaps/
-
How can show all link in root sitemap link?https://wordpress.org/support/topic/how-can-show-all-link-in-root-sitemap-link/
-
Number of Urls per sitemap do not changehttps://wordpress.org/support/topic/number-of-urls-per-sitemap-do-not-change/
-
sitemap.xml not foundhttps://wordpress.org/support/topic/sitemap-xml-not-found-2/
-
*-sitemap.html show sitemap.html in 4.1.16https://wordpress.org/support/topic/sitemap-html-show-sitemap-html-in-4-1-16/