robots

User-agent: Googlebot
Disallow: /?*

User-agent: Baiduspider
Disallow: /?*

User-agent: YandexBot
Disallow: /?*

User-agent: ichiro
Disallow: /?*

User-agent: sogou spider
Disallow: /?*

User-agent: Sosospider
Disallow: /?*

User-agent: YoudaoBot
Disallow: /?*

User-agent: YetiBot
Disallow: /?*

User-agent: bingbot
Crawl-delay: 2
Disallow: /?*

User-Agent: Yahoo! Slurp
Crawl-delay: 2
Disallow: /?*

User-agent: rdfbot
Disallow: /?*

User-agent: Seznambot
Request-rate: 1/2s
Disallow: /?*

User-agent: ia_archiver
Disallow:

User-agent: Mediapartners-Google
Disallow:

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top