Google bypass infrastructure uses complex algorithms to determine the optimal cost of bypass of your site. Our goal is to go around as many pages as possible on every visit without overloading the server. However, in some cases, the detour frequency can create a load on your infrastructure or lead to undesirable expenses in the event of an accident. To reduce the load, you can decide to reduce the number of requests from the Google Crauler.
A sharp increase in bypass frequency may be associated with an ineffective structure of your site or other problems. Based on the reports that we received, the most common reasons are as follows:
We strongly recommend that you check the available access logs of your server to find out the traffic source and check whether it is suitable for the reasons for a sharp increase in bypass frequency. Then get acquainted with our guidelines for managing the bypass of facet URLs and optimizing bypass efficiency.
Warning: If you decide to reduce the detour frequency, keep in mind that this will have a wide impact. For search, Google will detect fewer new pages, and updates of existing pages will occur less often (for example, prices and accessibility of goods will be displayed longer in search results), and the remote pages will remain in the index longer. For Google advertising, your campaigns can be canceled or suspended, but ads will not be shown.
If you need to urgently reduce the frequency of bypass by a short time (for example, by several hours or 1-2 days), you can send a response with the HTTP 500, 503 or 429 state codes for 200 requests. Google infrastructure will automatically reduce the frequency of site bypass if it collides with a significant number of URL with errors 500, 503 or 429 (for example, if you turn off the site). The reduced detour frequency will touch the entire domain of your site (for example, subdomain.example.com), both the URL with errors and those that return the content. When the number of these errors decreases, the detour frequency will automatically begin to increase.
Warning: We do not recommend using this method for a long period of time (more than 1-2 days), as this can negatively affect how your site is displayed in Google products. For example, if Google Bot observes these errors on the same URL for several days in a row, this URL can be removed from the Google index.
If for some reason you cannot send an error to the queries of Google Crauler, submit a special request to report the problem with an excessively high detour frequency, indicating the optimal frequency for your site. It is impossible to request an increase in bypass frequency, and it may take several days to process and fulfill your request.
If you have additional questions or needs, you can contact the SEO.compter SEO company for any issue on email info@seo.computer, WhatsApp +79202044461.
ID 63