robots.txt

this is funny. robots disallow: http://www.last.fm/robots.txt, 2010-07-30T00:58:59Z
villav74 (villav74)
villav74 (villav74)
El robots.txt de Last.fm http://hptx.es/97GDAv, 2010-07-30T00:37:54Z
juanjo__perez (juan jose)
juanjo__perez (juan jose)
/ Disallow: /harming/humans Disallow: /ignoring/human/orders Disallow: /harm/to/self RT @codinghorror http://www.last.fm/robots.txt, 2010-07-30T00:15:29Z
milel (fff)
milel (fff)
Quite possibly the best Robots.txt file ever http://bit.ly/bUfpiD, 2010-07-30T00:00:43Z
StBarg (Steve Bargain)
StBarg (Steve Bargain)
Last.fm pridalo tri zakony robotiky od Asimova do suboru robots.txt http://bit.ly/dbO8Sl Skyphire tam ma ASCII (cont) http://tl.gd/2qlaja, 2010-07-29T23:46:34Z
itsgoingd (Miroslav Rigler)
itsgoingd (Miroslav Rigler)
@johnallsopp @cssquirrel na, that's easy - apply the 3 laws of robotics http://www.last.fm/robots.txt - Asimov FTW, 2010-07-29T23:32:48Z
johnfoliot (John Foliot)
johnfoliot (John Foliot)
Last.fm pridalo tri zakony robotiky od Asimova do suboru robots.txt http://bit.ly/dbO8Sl Skyphire tam ma ASCII art http://bit.ly/dyzSuk, 2010-07-29T23:32:04Z
synopsi (synopsi)
synopsi (synopsi)
RT @wombleton: haha, they're right, THIS is how you write a robots.txt: http://j.mp/bVgUuL, 2010-07-29T23:24:08Z
brycenz (Bryce Ewing)
brycenz (Bryce Ewing)
RT @mricon RT @quaid A little 'robots.txt' humor from @LastFM : http://www.last.fm/robots.txt, 2010-07-29T23:01:30Z
lisandropm (Lisandro Pérez Meyer)
lisandropm (Lisandro Pérez Meyer)
RT @aysoon L'un des robots.txt les plus originaux au monde http://ays.li/18g, 2010-07-29T22:57:29Z
pkseb_inside (pkseb)
pkseb_inside (pkseb)
haha, they're right, THIS is how you write a robots.txt: http://j.mp/bVgUuL, 2010-07-29T22:21:48Z
wombleton (Rowan Crawford)
wombleton (Rowan Crawford)
@denharsh theres no robots.txt on the new install yet, naa no stress, if it doesnt pick up in a couple days ill need a hand though, 2010-07-29T22:10:50Z
askkim (Kimberly Castleberry)
askkim (Kimberly Castleberry)
@AskKim check robots.txt...Should I come on Skype... ?, 2010-07-29T22:07:05Z
denharsh (Harsh Agrawal)
denharsh (Harsh Agrawal)
RT @OwlofDoom: Ahahahaha last.fm's robots.txt (via BoingBoing): http://www.last.fm/robots.txt, 2010-07-29T21:57:28Z
socketwench (socketwench)
socketwench (socketwench)
RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?, 2010-07-29T21:45:11Z
zwitscherelfe (zwitscherelfe)
zwitscherelfe (zwitscherelfe)