Metadata robots and HTTP-settings for the site in Google of your site

This manual discusses in detail the settings that allow you to control how your site in Google is displayed in the issuance. You will learn how to use the Robots methag, the Data-Nosnippet attribute and the X-Robots-Tag title to adjust indexing and snippets, as well as what rules to be considered when combining them.

Using Robots Metateg for Google Site

Metateg <meta name="robots"> is responsible for indicating search robots, indexing the page or not, and how to process links. Place it in the section <head> :

<>
 <head>
 <meta name="robots" content="noindex">
 </head>
 <body>…</body>
</>

If you use CMS and cannot rule the source code, find tag control settings in the administration panel of your engine. The name and value of the tag are insensitive to the register.

To address individual agents, you can replace the name Robots with googlebot (for web lifes) or on googlebot-news (for news issuance). An example of disconnecting snippets only in the news feed:

<meta name="googlebot-news" content="nosnippet">

Use HTTP X-Robots-Tag heading for Google Site

If you need to set the indexation rules not in, but at the server level, use the headline:

X-Robots-Tag: noindex, nofollow

You can combine several headings or list the rules through a comma. An example of a prohibition of indexing images and obsolescence of the page after a given date:

X-Robots-Tag: noimageindex
X-Robots-Tag: unavailable_after: 25 Jun 2025 00:00:00 PST

List of acceptable rules for the site in Google

The main directives supported by the Robots methag and the X-Robots-Tag heading are listed below:

all - without restrictions (default value).
Noindex - Do not show the page in the issuance.
nofollow - Do not transfer weight to links on the page.
None - Noindex equivalent, nofollow.
Nosnippet -Do not show a text or video-spell.
Indexified - Indexate the page if it is built through iframe.
Max-Snippet: [number] - restriction of the length of text snippet.
Max-Image-PreView: [setting] - Image size: None, Standard or Large.
Max-Video-Preview: [seconds] -The length of the video breed in seconds.
notranslate - Do not offer a transfer in the issuance.
Noimageindex - Do not index the images.
unavailable_AFter: [date] - Do not show the page after the specified date.

Combining directives for the site in Google

Several rules can be combined through a comma or indicated in different tags. For example:

<meta name="robots" content="noindex, nofollow">

Or so:

<meta name="robots" content="noindex">
<meta name="robots" content="nofollow">

Working with the Data-Nosnippet attribute for the site in Google

To exclude part of the text on the page from Snippet, wrap it in the element <span>, <div> or <section> with an attribute data-nosnippet:

<p>Этот текст попадёт в сниппет, 
 <span data-nosnippet>а эта часть будет скрыта</span>.
</p>

The attribute is bouncer, the value is ignored. Elements should be correctly closed.

Interaction Robots.txt and metathegs for the site in Google

If the URL is prohibited in the file robots.txt, X-Robots-Tag metathets and headlines will not be available to Googlebot and ignore. For directives to be used, pages must be open for scanning.

For all issues of setting up metadata of your site, you can contact the SEO.compter SEO company by email info@seo.computer Or through WhatsApp +79202044461.

ID 134