Файл robots.txt найден, но главная страница запрещена для индексации следующим ботам: grub-client, grub, looksmart, webzip, larbin, b2w/0.1, psbot, python-urllib, netmechanic, url_spider_pro, cherrypicker, emailcollector, emailsiphon, webbandit, emailwolf, extractorpro, copyrightcheck, crescent, sitesnagger, prowebwalker, cheesebot, lnspiderguy, ia_archiver, ia_archiver/1.6, teleport, teleportpro, miixpc, telesoft, moget/2.1, webzip/4.0, webstripper, websauger, webcopier, netants, webauto, thenomad, www-collector-e, rma, libweb/clshttp, asterias, httplib, turingos, spanner, infonavirobot, harvest/1.5, bullseye/1.0, cherrypickerse/1.0, cherrypickerelite/1.0, webbandit/3.50, nicerspro, dittospyder, foobot, webmasterworldforumbot, spankbot, botalot, lwp-trivial/1.34, lwp-trivial, bunnyslippers, wget/1.6, wget/1.5.3, wget, linkwalker, cosmos, moget, hloader, humanlinks, linkextractorpro, lexibot, true_robot/1.0, true_robot, blowfish/1.0, jennybot, miixpc/4.2, builtbottough, propowerbot/2.14, backdoorbot/1.0, tocrawl/urldispatcher, webenhancer, suzuran, vci, szukacz/1.4, openfind, xenu's, zeus, repomonkey, openbot, erocrawler, iron33/1.0.2, getright/4.2, gaisbot, aqua_products, msiecrawler, perman, searchpreview.
Распределение трафика из социальных сетей.