Файл robots.txt найден, но главная страница запрещена для индексации следующим ботам: ahrefsbot, mj12bot, rogerbot, semrushbot, ia_archiver, scoutjet, sistrix, searchmetricsbot, seokicks-robot, exabot, ncbot, backlinkcrawler, archive.org_bot, meanpathbot, pagesinventory, aboundexbot, spbot, linkdexbot, gigabot, dotbot, nutch, blexbot, ezooms, majestic-12, majestic-seo, dsearch, mj12, blekkobot, nerdybot, jamesbot, tineye, baiduspider, serpstat, spyfu, generic, snake, siphon, emailsiphon, pavuk, emailcollector, irlbot, nexuscache, wells, justview, reget, obot, netants, go-ahead-got-it, wget, y!tunnelpro, vacuum, gulliver, webhook, grafula, xara, xenu, hmview, szukacz, ping, perl, pump, dittospyder, copyrightcheck, webmole, httpfetcher, grabber, grabnet, recorder, dloader, spanner, orangebot, psycheclone, eyenetie, httrack, webauto, collector, openfind, lwp-trivial, httplib, httpapp, asterias, superhttp, anarchie, mercator, vagabondo, www-collector-e, yahooysmcm, winhttprequest, mirror, iria, freefind.com, webviewer, cherrypicker, vintage, flashget, slysearch, httpscraper, snoopy, antibot, nearsite, chinaclaw, copier, metacarta, stripper, sqworm, jonzilla, website, webster, w3c_validator, clshttp, alexibot, realdownload, bumblebee, blackwidow, getright, ecatch, flickbot, pockey, spacebison, bullseye, scooter, cherrypickerelite, jobo, java, eirgrabber, lachesis, python-urllib, zeus, zbot, zade, vayala, navroad, rico, miixpc, surveybot, cosmos, turingos, mag-net, pcbrowser, thenomad, cheesebot, takeout, webenhancer, jetcar, cherrypickerse, hloader, nicerspro, onestop, netzip, curl, backweb, abachobot, webmirror, webfetch, reaper, backdoorbot, propowerbot, filehound, easydl, leechftp, go!zilla, vci, php, rma, joc, b2w, hitboxdoctor, emailwolf, interget, mfc_tear_sample, bandit, repomonkey, queryn, linkwalker, lftp, link, spankbot, drip, clariabot, websauger, httptrack, magnet, octopus, disco, lexibot, webreaper, extractorpro, downloader, gotit, netspider, getweb!, sitecheck.internetseer.com, pagegrabber, stealer, linkscan, diamond, linkextractorpro, infonavirobot, npbot, smartdownload, libwww-perl, tocrawl, memo, microsofturl, semalt, jennybot, heretrix, scoutabout, batchftp, ninja, nikto, webcopier, likse, winhttp, frontpage, webdownloader, moget, msfrontpage, robozilla, libby_, libweb, autoemailspider, larbin, netresearchserver, blowfish, webstripper, aspseek, whacker, httpviewer, bunnyslippers, sitesnagger, appie, tighttwatbot, xaldon, builtbottough, harvest, wwwoffle, getsmart, attach, custo, buddy, msiecrawler, coldfusion, webzip, webleacher, phpot, superbot, titan, widow, voideye, libwwwperl, erocrawler, websucker, webminer, humanlinks, botalot, turnitinbot, websites, missigua, internetseer.com, spinne, netmechanic, webwhacker, psbot, urldispatcher, surfbot, crescent, snapbot, true_robot, suzuran, telesoft, pompos, semalt.com, bdcbot, checker, konqueror, istellabot, 360spider, ubersuggest, surdotlybot, cfnetwork, dalvik, domaincrawler, garlikcrawler, spider, robot, megaindex.ru, ccbot, nbot, duckduckgo-favicons-bot, duckduckgo, domainstatsbot, crawl, fetcher, cliqzbot, tweetmemebot, rsiteauditor.