![]() The purpose of a robots.txt file is to tell search engines crawlers which pages they can access on a site.Īccording to Google, you can use a robots meta tag if you want to control how a specific page should be indexed. If you also want search engines to not follow the links on the de-indexed page, you should use the “noindex,nofollow” metatag instead: It’s important to note that you need to do this for every page that you want to de-index. Once you’ve added the tag, the search engine won’t index the page and it won’t appear in any search results. To do so, go to the beginning of your header by opening the source code of the page you want to de-index and paste the tag into a new line within the header. Add it to the section of your page’s HTML.The good news is that it’s quite easy to use metatag to prevent a specific page on your website from appearing in SERPs. In other words, if you add a noindex metatag to any page on your website, it won’t be shown in the search engine results. Add a “noindex” metatagĪdding a “noindex” metatag to a page sends a signal to search engines that it cannot add it to the search index, even though it can still crawl it. Here’s a quick overview of the most common methods. The easiest of them is to include the noindex tag, but if you can’t do that for some reason, there are other ways to de-index a page. There are multiple ways to discourage search engines from indexing a page. How to stop search engines from indexing a page? Google’s Quality Guidelines specify that you should prevent crawling to search result pages using robots.txt because they don’t add any value for users who come to your website from a search engine. You shouldn’t have any of your internal search results pages indexed by search engines because they are likely to harm your user’s experience and your website in general. Internal search results pagesĪn internal search results page is a page that results when a user performs a search on your site using the search function. You can either disable the author archive to prevent that from happening, but if for any reason you decide to keep it, you should noindex your author archives. Google and other search engines may consider author pages duplicate content if there’s only one author on the entire website. Author archives if you’re the only author on your blog ![]() They are considered thin content pages, and since they are of no value for search engines, you shouldn’t have them indexed. These are those pages you use to thank your newsletter subscribers or new customers/commenters. The only exceptions should be those login pages that serve a community. To prevent the pages from being indexed, you can simply add a noindex tag to them. You shouldn’t have your admin and login pages appearing in Google search results. Some of the pages that you should de-index include the following: Admin and login pages Many blog owners don’t know this, but not all pages on a website need to be indexed by search engines. What web pages don’t need to be indexed?īesides the reasons listed above, you may also want to stop search engines from indexing various pages on a live, public website. Or perhaps you’re creating a private blog that you don’t want to be accessible to the general public.įinally, many people use WordPress sites for intranet or project management and want to avoid making any internal documents accessible to users outside your organization. Maybe you’re still developing your website on a domain name that’s publicly accessible, and you don’t want search engines to index your maintenance mode page. However, there are multiple situations when preventing search engines from indexing a page makes sense. ![]() After all, the whole point of building a website is to rank in search engine searches, not be ignored by them. The first question that may pop into your mind when reading the title of this article may very well be, “why would I want to prevent search engines from indexing my site?”Īnd you’d be totally right to be puzzled by the idea of blocking search engines. Why would you want to stop search engines from indexing a page? Password protect your WordPress site with a plugin.Password protect your entire site via cPanel. ![]() Use a plugin to noindex one or more pages in Google.Remove the URL from Google Search Console.How to stop search engines from indexing a page?.What web pages don’t need to be indexed?.Why would you want to stop search engines from indexing a page?.
0 Comments
Leave a Reply. |