Does anyone know a lot about how Robots.txt / how search engines crawl? I was hoping this would make it the digg's homepage to read more comments, but I'll put it to my fellow powncers: Does the newspapaer business have *any* legit claims here, or they (foolishly) just acting old economy or like the record, media, companies, etc? What do you think. I'd love to hear from anyone who knows about this as far as SEO, etc? Does Robots.txt need to be replaced?
Join Now to Reply!
To add your own reply, sign in or join Pownce today!