Streaming live at 10am (PST)

Is there a way to disable/avoid searchbots on a weblow page within my site?


#1

Hi webflowers.

here's my share:
https://preview.webflow.com/preview/scottbarbey70956011502405-0cd0e7d07ed35?preview=0f56a325a84c45c5fd20d145375281af

I'm a designer and I want to build a page for more private viewing.
As some of the work has not launched yet, I would prefer it not be searchable thru google, etc.

page is already "hidden" from navigation... scottbarbey.com/pharma
Any advice - outside of "don't put any text on the page" ...?

:)


#2

Go to your site's site wide SEO settings. Then put this in your robots.txt file:

User-agent: *
Disallow: /url-of-page-here

Change "url-of-page-here" with the page you want search engines not to pick up


#3

Firstly, as always, thanks!

as I'm almost sure I'll do this wrong... I've attached a screenshot.
( I am a massive luddite and web flow is my enabler. )

so, did I get the url right and is there any easy way to check...?

I guess I could go the google and insert one of my copy blocks and search for it, correct?


#4

remove "/scottbarbey.com"


#5

so the line should just read

Disallow: /pharma

?


#6

Just to be clear, that robots.txt change will disable search bots from seeing anything in /pharma if you end up setting up subfolders. Another way to block a single page without touching robots.txt is to go into the settings for that page and pop this in the header:

<meta name="robots" content="noindex">

Read more: https://support.google.com/webmasters/answer/937…

Edit: Misread the robots.txt advice given; clarified above.


#7

so sorry, I'm just not following.

you said to "go into the settings for that page and pop this in the header:"
where is "the header" you are referring to?

do you mean into the Meta Discription?

see attached.


#8

scroll down in that panel to the custom code area


#9

ok, see it. terrified to alter it. :slightly_smiling:
so I stick:

where exactly in here? (attached)


#10

right above the style tag.


#11

so I replace the } on line 9?


#12

no. add a new line break on line 1, then add in

<meta name="robots" content="noindex">


#13

OK.
really hoping I can stop bothering you. Your patience is truly impressive.

Like this:


#14

swap line 1 with line 2


#15

for both our sakes,
hoping you give me the thumbs up on this one...


#16

Yup! You're good to go :)


#17

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.