Crawled but not indexed

MORE NEWS

DIGITAL MARKETING

SEO

SEM

Invisible watermarking in AI content with Google SynthID

Invisible watermarking is a key innovation in authenticating and protecting content created by generative AI. Google SynthID is a state-of-the-art watermarking system designed to embed imperceptible digital signatures directly into AI-generated images, videos, text,...

Google Search API – A technical deep dive into ranking logic

📑 Key Takeaways from the API Leak If you don't have time to analyze 2,500 pages of documentation, here are the 3 most important facts that reshape our understanding of SEO: 1. Clicks are a ranking factor (End of Debate): The leak confirmed the existence of the...

Information gain in the age of AI

The digital information ecosystem stands at a precipice of transformation that is arguably more significant than the introduction of the hyperlink. For the past twenty-five years, the fundamental contract of the web was navigational. Users queried a search engine, and...

Google Discover optimization – technical guide

We have moved from a query-based retrieval model to a predictive push architecture. In this new environment, Google Discover is no longer a secondary traffic source. It is a primary engine for organic growth. The rise of zero-click searches, which now account for...

Parasite SEO strategy for weak domains

The barrier to entry for new digital entities has reached unprecedented heights in this year. For professionals entering competitive verticals, such as SaaS or finance, the mathematical reality of ranking algorithms presents a formidable challenge....

The resurrection protocol of toxic expired domains

The digital economy is littered with the remnants of abandoned web properties, often referred to in the cybersecurity sector as zombie domains. These are domain names that have expired, been dropped by their original registrants, and subsequently re-registered or...

Beyond the walled garden silo – true ROAS across platforms

Google says your campaign generated 150 sales. Amazon claims 200. Meta swears it drove 180. Add them up and you get 530 conversions. Check your actual revenue and you'll find you sold 250 units total.​ This is the walled garden nightmare every e-commerce marketer...

Data-driven CRO for PPC landing pages

In paid search campaigns, exceptional Quality Scores and high conversion rates don’t happen by accident—they’re the result of rigorous, data-driven optimization that blends user behavior insights with systematic testing. By combining visual tools like heatmaps and...

New YouTube Shorts campaign features in Google Ads

YouTube Shorts advertising has undergone significant transformation in 2025, introducing groundbreaking features that revolutionize how advertisers can target, optimize, and monetize short-form video content. The most notable advancement is the introduction...

The latest changes to Google Ads in 2025

Google Ads has undergone its most significant transformation in 2025, with artificial intelligence taking center stage in nearly every aspect of campaign management and optimization. The platform has evolved from a traditional keyword-based advertising system into a...

Jacek Białas

Holds a Master’s degree in Public Finance Administration and is an experienced SEO and SEM specialist with over eight years of professional practice. His expertise includes creating comprehensive digital marketing strategies, conducting SEO audits, managing Google Ads campaigns, content marketing, and technical website optimization. He has successfully supported businesses in Poland and international markets across diverse industries such as finance, technology, medicine, and iGaming.

How to fix “Crawled but not indexed” errors on medium-authority websites

Sep 18, 2025 | SEO

You’ve spent time perfecting product and category pages, but many still show as “crawled but not indexed” in Google Search Console. This means lost traffic and stalled SEO growth. Google’s recent quality updates emphasize strong content and internal linking. To fix this, audit crawl rules, enrich content, update your sitemap via a WordPress SEO plugin, and strengthen internal linking by adding recommended products blocks strategically inside your blog articles.

Problem

What you’re facing

Around 30% of your important pages aren’t getting indexed despite being crawled. These include product and category pages essential for your sales.

Why it matters now

Since Google’s August 2025 update, pages that are thin, duplicated, or poorly linked internally fall out of the index. Missing these pages means losing customers to competitors.

What’s the impact

Losing indexing on these pages equals missed organic visits and lost revenue daily. Unaddressed, this issue can grow and harm your site’s authority.

Solution

Four clear steps will recover your pages and boost traffic:

  1. Add internal linking blocks inside blog articles to boost link equity.
  2. Audit crawl rules.
  3. Enrich and differentiate your content.
  4. Update your main XML sitemap through your SEO plugin.

Audit crawl rules

Use a crawler tool like Screaming Frog to find

  • Pages with <meta name="robots" content="noindex"> tags
  • URLs blocked by your robots.txt file

Fix these by:

  • removing noindex tags on pages you want indexed (check your SEO plugin settings on product/category templates)
  • editing robots.txt to allow crawling of product and category directories (remove any Disallow: /products/ lines)
  • verifying fixed pages in Google’s URL Inspection tool to ensure “Allowed” status for crawling and indexing

Enrich and differentiate your content

Identify pages with:

  • less than 200 words of unique content,
  • duplicate or very similar page titles.

Improve each by:

  • writing 50–100 new words highlighting product benefits and features,
  • optimizing images for web, converting them to WebP format with descriptive alt text to improve loading speeds,
  • adding a short FAQ addressing common customer questions with schema.org,
  • including two genuine customer testimonials by first name only,
  • merging nearly identical pages and redirecting the weaker URL with a 301 redirect.

Update your XML sitemap for example via your WordPress SEO plugin

Manage your sitemap effectively:

  • using Yoast SEO or Rank Math, ensure all enriched product and category pages are included in your sitemap settings,
  • save changes to let the plugin automatically regenerate the sitemap (e.g., sitemap_index.xml),
  • submit or resubmit this sitemap in Google Search Console to prompt Google to re-crawl these updated pages promptly.

Add internal linking blocks inside blog articles

Use your high-traffic blog posts to support under-indexed product pages by embedding recommended products blocks naturally within the text:

Placement based on blog length

  • For posts up to 800 words, insert one block around the middle
  • For posts 800–1,600 words, insert two blocks — after about one-third and two-thirds of the text
  • For posts over 1,600 words, place three blocks evenly spaced

Block structure

  • Heading: Recommended products
  • Short intro sentence (e.g., “Check out these products related to [topic]”)
  • Bullet or simple list of 4–6 product links with descriptive anchor text
  • Avoid images inside these blocks to keep page speed optimal

Embedding these blocks this way improves user experience and distributes internal link equity, encouraging Google to prioritize indexing the linked product pages.

Real-world example

TechGizmo Shop lost 450 product URLs after Google’s update. Their recovery steps included:

  • Removing obsolete noindex tags and fixing robots.txt
  • Rewriting 380 thin pages with clear benefits, FAQs, optimized WebP images, and testimonials
  • Regenerating their sitemap with Yoast SEO to include all prioritized URLs
  • Adding two recommended products blocks inside ten of their most popular blog posts

After six weeks, 380 pages moved from “crawled but not indexed” to fully indexed, recovering 15% organic traffic and boosting monthly revenue by $12,000.

Step-by-step checklist

  1. Audit and fix robots.txt and noindex tags.
  2. Enrich thin and duplicate pages; merge and redirect duplicates.
  3. Regenerate and submit your XML sitemap via your SEO plugin.
  4. Identify relevant blog posts and add multiple recommended product blocks thoughtfully spaced.
  5. Track index coverage and organic traffic weekly; make adjustments as needed.

Key takeaways

  • Fix crawl blocks and remove noindex directives to re-enable indexing
  • Enrich content with unique descriptions, FAQs, optimized WebP images, and user testimonials
  • Keep your sitemap updated using WordPress SEO plugins to ensure Google sees your fixes
  • Add internal linking blocks inside blog articles at natural points to strengthen the link profile of important product pages

Start this structured approach today and watch your unindexed pages return to search results within 4 to 6 weeks.

Share News on