Leave a request
Note
To close pages with parameters, the Disallow directive is sometimes used. However, it is recommended to use the Clean-Param directive, since it allows you to transmit Yandex to the Yandex to the Site indicators.
Watch the video to find out how to properly use the Clean-Param directive for your site and improve the results of indexation in Yandex.
For the successful use of the Clean-Param directive, it is important to regularly update the information and indicate it as fully as possible. If the new parameter does not affect the contents of the page, this can lead to the appearance of duplicate pages that should not fall into the search results of Yandex. Duplication slows down the site bypass, and changes on the site may not fall into the Yandex indexation for a long time.
When you use the Clean-Param directive correctly, the Yandex robot will ignore parameters that do not affect content, and this will help accelerate the bypass of the site and reduce the load on the server.
Example: The site has several identical pages with different Get parameters that do not change the contents, for example:
www.example.com/some_dir/get_book.pl?ref=site_1&book_id=123 www.example.com/some_dir/get_book.pl?ref=site_2&book_id=123 www.example.com/some_dir/get_book.pl?ref=site_3&book_id=123
In this case, if you apply the directive as follows:
User-agent: Yandex Clean-param: ref /some_dir/get_book.pl
Yandex adds all these addresses in one:
www.example.com/some_dir/get_book.pl?book_id=123
Now the page with such a URL will participate in the search results of Yandex.
Syntax directives is as follows:
Clean-param: p0[&p1&p2&..&pn] [path]
The first field contains a list of parameters that do not affect the content of the page, and they can be excluded from Yandex indexation. The second field indicates the path to which this rule is applied. This field may contain a regular expression that will act only for pages starting with the specified path.
Example:
Clean-param: s /forum/showthread.php
This rule means that the "S" parameter will be ignored on all pages starting C /forum/showthread.php.
The prefix of the path can be omitted if the rule should be applied to all pages of the site.
The register of characters in the way matters. The maximum line length of the rule is 500 characters.
Yandex automatically removes certain parameters that do not affect the content of the page, such as parameters for analytics and tracking. They are excluded from the search, and you do not need to indicate them manually in Robots.txt.
Examples of such parameters:
Example for addresses:
www.example1.com/forum/showthread.php?s=681498b9648949605&t=8243 www.example1.com/forum/showthread.php?s=1e71c4427317a117a&t=8243
Your Robots.txt should contain the following:
User-agent: Yandex Clean-param: s /forum/showthread.php
An example for addresses with parameters:
www.example2.com/index.php?page=1&sid=2564126ebdec301c607e5df www.example2.com/index.php?page=1&sid=974017dcd170d6c4a5d76ae
For such pages in Robots.txt, you need to indicate:
User-agent: Yandex Clean-param: sid /index.php
The Clean-Param directive can be used without Disallow directives. However, if pages with parameters are prohibited from indexing, this will have priority before using Clean-Param.
User-agent: Yandex Disallow:/forum Clean-param: s&ref /forum*/showthread.php
In this case, the ReF page will be prohibited from indexing Yandex, and the Clean-Param directive will not change this behavior.
To obtain additional information or resolving issues with SEO setting up for your site, you can contact the company's specialists for email info@seo.computer or through WhatsApp by number +79202044461.
ID 100
