Whether you're managing a Webflow client site, running a private portfolio, or maintaining multiple versions of your Webflow site, you'll inevitably need control over which pages appear in search engine results.
Search engines are designed to index everything they can find, but not every page on your site should be publicly discoverable. From confirmation screens to staging environments, having unwanted pages in search results can dilute your SEO efforts and expose content that should remain private. Fortunately, Webflow provides several built-in methods to control which pages search engines can and cannot index.
In this guide, you'll learn the 5 main approaches to unindex content in Webflow, when to use each method, and how to implement them correctly without affecting your site's overall search performance.
Having control over what search engines index is crucial for maintaining a clean, professional online presence. Here are the key scenarios where unindexing becomes essential:
This method works best for specific static pages like thank you pages, confirmation screens, or internal documentation that you want to keep out of search results.
Individual page unindexing is the most straightforward approach when you need specific control over which static pages appear in search engines. You'll use this for pages that serve a functional purpose on your site but don't add value to search results.
When you disable sitemap indexing, Webflow automatically adds meta content="noindex" name="robots" to the page head and removes the page from your auto-generated sitemap. This tells search engines to stop crawling and indexing that specific page while leaving the rest of your site unaffected.
Use this method when you want to prevent all individual item pages within a CMS collection from being indexed. This is ideal for collections that serve functional purposes or when you only want the collection overview page to appear in search results, not the individual items.
This approach works well for various scenarios: team member profiles where individual bio pages aren't valuable for search, product catalogs where you prefer category-level visibility, portfolio collections used primarily for visual display, or any collection where the individual pages don't provide unique value to search users. It's more efficient than unindexing items individually when your entire collection follows the same indexing strategy.
This custom code affects every page generated from the collection template, meaning all individual CMS item pages will include the noindex meta tag and be excluded from search engine indexing. The collection listing page itself remains indexed unless you separately configure it.
When to use collection template unindexing vs individual item unindexing: Choose collection template unindexing when you want to exclude the entire collection, and individual item unindexing (Method 3, described below) when you only want to exclude specific items within a collection.
Use this approach when you need granular control over specific CMS items while keeping the rest of your collection visible in search results.
It requires a paid Site plan and works within the CMS panel, making it perfect for scenarios like incomplete portfolio pieces, draft content for stakeholder review, or items that were published prematurely but need to remain accessible via direct links.
This method overrides the global site indexing setting for that specific item, adding a noindex meta tag to just that page while keeping other collection items indexed normally. It works seamlessly with Webflow's draft publishing features, allowing you to control visibility at the individual item level.
Prevent your site.webflow.io staging domain from appearing in search results while keeping your custom domain fully indexed and visible.
This is essential for maintaining clean search results when you have both a custom domain and a Webflow subdomain active. Without this setting, search engines might index both versions, creating duplicate content issues and diluting your SEO efforts.
This creates a unique robots.txt file specifically for your webflow.io subdomain that prevents search engine indexing. Your custom domain remains completely unaffected, allowing you to maintain separate staging and production environments without SEO conflicts.
Important note: This setting only prevents new indexing. If your staging site was already indexed before enabling this setting, you'll need to use Google Search Console's URL Removal Tool or wait for Google to naturally remove the outdated results during its next crawl cycle.
This is not a common use case, but if you need to completely remove your entire Webflow custom domain from search engines while keeping the site functional, you have 2 options available.
You have two main options for completely unindexing your entire custom domain: password protection (which both unindexes and gates access) or custom code implementation (which unindexes while keeping content publicly accessible).
Steps to password protect your entire Webflow site:
When password protection is enabled, every page on your custom domain requires authentication before visitors can access any content. This automatically excludes all content from search engine indexing and sitemaps, making it the most effective method for complete privacy.
If you want to unindex your entire site while keeping it publicly accessible, you can add a site-wide noindex meta tag through Webflow's custom code section:
This approach tells search engines not to index any pages on your domain while allowing users to access content directly through URLs. It's useful for staging sites or internal tools that need to remain accessible but shouldn't appear in search results.
You can also apply password protection to specific folders or CMS collection templates instead of the entire site, giving you granular control over which sections require authentication while keeping other areas publicly accessible.
Unindexing tells search engines not to include specific pages in search results, but the pages remain publicly accessible to anyone with the direct URL. Password protection completely blocks access to pages, requiring authentication before anyone can view the content. Use unindexing for pages you want hidden from search but accessible to users, and password protection for truly private content.
Google typically processes noindex tags within 1-4 weeks, but this varies based on your site's crawl frequency and the specific pages involved. High-traffic pages may be removed faster, while rarely-visited pages might take longer. You can speed up the process by submitting a removal request through Google Search Console for immediate action on specific URLs.
Yes, you can unindex individual blog posts using the CMS item method, or unindex your entire blog collection using the collection template method while keeping static pages indexed. This gives you complete control over which content appears in search results without affecting your homepage, about page, or other static content.
Use the Disable Webflow subdomain indexing setting in Project Settings > SEO tab. This specifically targets your yoursite.webflow.io staging domain while leaving your custom domain fully indexed. This method is designed exactly for staging site scenarios and won't affect your production site's search visibility.
No, robots.txt is not recommended for unindexing in Webflow or any modern website. Google deprecated noindex support in robots.txt in 2019, and robots.txt only controls crawling, not indexing. Pages blocked in robots.txt can still appear in search results if linked from external sites. Always use Webflow's native noindex settings or password protection instead.
Use the individual static page unindexing method for thank you pages. Go to Page Settings > SEO section > toggle OFF "Sitemap indexing" for each confirmation page. This prevents these functional pages from cluttering search results while keeping them accessible to users who complete forms or purchases on your site.
Yes, you can partially unindex a Webflow CMS collection by selectively hiding specific items. Go to your CMS panel in the Webflow Designer, select the collection containing items you want to unindex, click on individual CMS items, and toggle OFF the "Search engine indexing" option for each item you want to hide.
Webflow automatically removes unindexed pages from your auto-generated sitemap.xml file. This happens immediately when you publish changes, ensuring search engines receive consistent signals about which pages should and shouldn't be indexed. You don't need to manually update your sitemap—Webflow handles this automatically.
Unindexing irrelevant pages actually improves your SEO by helping search engines focus on your most valuable content. Removing thank you pages, duplicate content, and staging sites from search results increases the authority and relevance of your remaining indexed pages, potentially boosting rankings for your important content.
Simply reverse the unindexing process by toggling ON the relevant indexing settings and publishing your site. For static Webflow pages, enable "Sitemap indexing" in Page Settings. For Webflow CMS items, enable "Search engine indexing" in the item settings. Google will typically re-index the pages within 1-2 weeks, or you can request immediate re-indexing through Google Search Console.
Proper unindexing control is essential for maintaining a professional, SEO-friendly Webflow site. Whether you need to hide staging sites, protect private content, or clean up search results, Webflow's built-in unindexing methods provide the flexibility and control you need without compromising your site's performance.
If you need help optimizing your Webflow site's search engine visibility or implementing advanced SEO strategies, our agency can assist with custom solutions tailored to your specific requirements.
Learn to display content exclusively on mobile devices in Webflow. Step-by-step guide for hiding desktop elements and optimizing mobile.
Control element visibility across the Webflow mobile view to optimize user experience. Step-by-step tutorial to do it in 5 minutes or less.
Choosing Webflow or Framer for 2025? Compare design, CMS, speed, learning curve & cost in our clear guide.