Answer by unor for How to assign specific sitemaps for specific crawler-bots...
This is not possible in robots.txt. The Sitemap: value will be used by all supporting consumers.Sitemaps.org protocol:This directive is independent of the user-agent line, so it doesn't matter where...
View ArticleHow to assign specific sitemaps for specific crawler-bots in robots.txt?
Since some crawlers don't like the sitemap versions made for Google, I made different sitemaps.And there is an option to putSitemap: http://example.com/sitemap.xmlto robots.txt. But is it possible to...
View Article
More Pages to Explore .....
