<meta name="robots" content="noindex, follow"> in default layout

[jglauche]

Hello,

I recently set up a small website with sculpin and wondered why it wouldn't be found in search engines until a friend of mine pointed out to me that the sites include this meta tag:

<meta name="robots" content="noindex, follow">

Aargh! I noticed the default robots.txt but that? Why would that be put in a bootstrap layout file?

[WyriHaximus]

That was initially introduced with #23 now the theory is that only the content matters and not the pages linking to it. Now your posts should have this tag instead:

<meta name="robots" content="index, follow">

My blog has those tags in place and when searching for it the posts do show up on google: https://www.google.nl/?q=site:blog.wyrihaximus.net

Out of interest are your pages blog posts or static pages?

[jglauche]

Static pages for now, I disabled the blog (as this still needs to be converted). The static pages all had nofollow, so I deleted the meta tag.

[WyriHaximus]

so I deleted the meta tag

I'll make a PR soon with an example static page to mitigate this in the future.

[opdavies]

@beryllium Should be moved to https://github.com/sculpin/sculpin-blog-skeleton?

[beryllium]

Yep, seems more appropriate there. The content generated by the sculpin init command doesn't have this meta tag.