For each site that you set to “live” (but not "private"), you have the option to prevent the output from being used by search engines. You might consider doing this if you have multiple versions of product documentation, but you only want the most recent version to show up in search results.
When you enable this option, the server adds the site URL to a robots.txt file, which is generated by the server. This robots.txt file specifies that searches for content in that URL should be disallowed.
[Menu Proxy — Headings — Online — Depth3 ]
For this activity, you must have the following permission setting:
For more information about permissions, see Setting User Permissions.
How to Exclude a Site From Search Engines
- On the left side of the interface, click Sites.
- With the Sites tab selected at the top, click the name of the site you want to edit.
- If the site is not already set to Live select that option.
- Click Include in search engines to remove the check mark.
- Click Save.