I have two questions regarding noindex/nofollow for search engines.
- What is the correct code snippet to stop search engines from crawling a page? I have seen 3 different variations on the forums that were marked as the correct answer. Here are two different examples I have seen:
<meta name="robots" content="noindex, follow" />
<meta name=”robots” content=”noindex, nofollow”>
One includes a “/” at the end and the names are wrapped in different types of quotes ( " versus ”).
I don’t actually know how to verify that the nofollow/noindex is being recognized, so I can’t test each one. Can someone please let me know which is correct?
- My second questions is whether I am using noindex/nofollow correctly. I have several empty collection pages. I was planning on adding the noindex/nofollow code inside the head tag of these pages as I don’t want Google to think I have pages with no content. Should I be adding this code to these pages? Should I also include this code on my 404 page (I saw this briefly mentioned on a different forum).
Thanks for any help you all can offer. I truly appreciate it!