Does anyone know a lot about how Robots.txt / how search engines crawl? I was hoping this would make it the digg's homepage to read more comments, but I'll put it to my fellow powncers: Does the newspapaer business have *any* legit claims here, or they (foolishly) just acting old economy or like the record, media, companies, etc? What do you think. I'd love to hear from anyone who knows about this as far as SEO, etc? Does Robots.txt need to be replaced?

Forward

5 months, 1 week ago by Chris D.

1 Reply

  • Dayton N. Dayton N. replied Mar 17th
    No reason why robots.txt isn't sufficient.

Join Now to Reply!

To add your own reply, sign in or join Pownce today!

157 Recipients

View all

This note is viewable by everyone.