User-Agent: *
Crawl-Delay: 2

User-Agent: Yandex
Crawl-Delay: 2
Disallow: /links-cat*
Disallow: /links.html
Host: www.allcables.ru