Skip to main content

Meta Name="robots"

I believe I am correct in thinking that the Siteglide system doesn’t include a meta name=”robots’ tag if in the page editor the page is set to ‘visible to search engines=Y’. If this value is set to N, the tag is inserted within the <head> section as <meta name=”robots” content=”noindex,nofollow”> but that is not always what is wanted (see 2 below).

1. I believe all web pages should include the meta robots tag regardless; and
2. there are occasions when an SEO company might want to stop SEs indexing a page, but not stop the spider crawling and following the links within. In this scenario, the only way to edit this is to make the page visible to SEs and then use liquid in the template to say:- if the page URL = “xxxxx” rewrite the tag to “noindex,follow”.
It would be a massive improvement to be able to edit the meta robots tag from within Site Admin/ page editor.
Please!

Status: Completed3 comments

Log in to comment and vote

Comments3

  • Matt Walter

    Team•

    Apr 23, 2025

    This has been released now. You can edit your meta robots value in SEO Settings on a Page.

    System Files update →

    https://docs.siteglide.com/en/developer-tools/release-notes/module-system-files-changelog#id-2.8.5.0-23rd-april-2025

  • Matt Walter

    Team•

    Apr 2, 2025

    We’ll add a new text field under ‘SEO Settings’ for you to write custom robots content.

  • Jon Macmorland

    •

    Mar 13, 2025

    And also to have the ability to add this to individual web app / module items as a standard field as per web pages. Essentially the detail view of items are web pages from a crawler point of view.