robots.txt

paso obligado a ver una web cuando alguien te cae mal "robots.txt" :P, 2010-02-09T05:16:42Z
Borre (Eduardo Hernández)

Get the status of your domain,including AlexaRank,Age,indexation in DMOZ & Archive.org,robots.txt&WHOIS records. http://bit.ly/4iDqHf #seo, 2010-02-09T04:00:11Z
webseoanalytics (Web SEO Analytics)

google's own meta tag to disable google crawling. <meta name="robots" content="noindex"> also robots.txt works well., 2010-02-09T03:30:07Z
realcheesypizza (jim bob hatfield)

Create Robots.txt file: syntax, example, generator tools http://bit.ly/bRg4hE, 2010-02-09T03:12:50Z
tothepc (Davinder)

Is Robots.txt the key your Search Engine Rankings? http://bit.ly/dnkeu2, 2010-02-09T00:47:03Z
seo_semservices (Heather Plink)

@BrandonSheley @betatime They handle 1k+ active users but it went insane. They slowed the SE down via robots.txt to bring it back., 2010-02-08T23:28:25Z
mattmecham (mattmecham)

#FB allow pas grand chose en fait : http://www.facebook.com/robots.txt on se croirait presque protégé #e-reputation, 2010-02-08T23:13:47Z
Nico_Laustriat (Nicolas Laustriat)

The effect of Robots.txt on your Search Engine Future? http://bit.ly/dnkeu2, 2010-02-08T22:48:02Z
seo_semservices (Heather Plink)

Corolário: disallow no robots.txt + meta noindex no html = seu site ainda pode aparecer no índice do Google! (via @ArielL), 2010-02-08T21:45:45Z
marceloluft (marceloluft)

Will Robots.txt Prevent your Search Engine Future? http://bit.ly/dnkeu2, 2010-02-08T21:42:04Z
seo_semservices (Heather Plink)

@DianeBourque ...y compris les moteurs de recherche.." WP écrit dans le fichier robots.txt et ton blog est de nouveau accessible (je pense)., 2010-02-08T20:54:17Z
emmanuelcup (Emmanuel Cup)

@DianeBourque N'oublie pas le S au robots.txt comme un de mes clients qui a eu une mauvaise surprise, 2010-02-08T20:48:30Z
ericbaillargeon (Eric Baillargeon SEO)

@DianeBourque J'utilise un robot.txt pour ça : http://fr.wikipedia.org/wiki/Robots.txt, 2010-02-08T20:39:30Z
emmanuelcup (Emmanuel Cup)

@DianeBourque Oui dans fichier robots.txt ou page par page avec la commande meta noindex www.robotstxt.org & www.robotstxt.org/meta.html, 2010-02-08T20:39:17Z
orenoque (Louis Durocher)

Evil Demo - Robots.txt User Agent Generator Googlebot: http://bit.ly/8f4E0f via @addthis, 2010-02-08T20:38:54Z
evildemo (Ramon Sanchez)