Random Stuff Forums
  

Go Back   Random Stuff Forums > Community > Feedback & Suggestions
Reload this Page Spiders on a forum

Feedback & Suggestions Discuss any ideas, issues, or suggestions regarding the forum.

Reply
Page 2 of 2 1 2
 
LinkBack Thread Tools Display Modes
  #11  
Old 07-07-2009, 07:00 PM
World Domination's Avatar
(Offline)
Super Sexy Admin
  
Join Date: Jan 2007
Location: Illinois, USA
Posts: 7,448
World Domination is an unknown quantity at this point
Default
Originally Posted by Matt View Post
Actually you can use robots.txt to control the benign ones Robert... But there's nothing wrong with search engines crawling your site, it's essentially how the internet thrives.
I know, and I was actually going to do this, but I got side tracked with other things.
__________________
RSForums.org - We Don't give a fuck.
RSForums.org - Worse than Crack.
RSForums.org - Where the criminals hang.
RSForums.org - Will never die.


To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.

"It's not yelling, it's projecting; and by the way, my voice is soothing."
-Billy Mays


To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
Why does have to MSN? Too secreto for the forums? If you don't want people to find out about something, post it at RSF.
Reply With Quote
  #12  
Old 07-07-2009, 07:53 PM
Matt's Avatar
(Offline)
Administrator
  
Join Date: Jan 2007
Location: United States - Ohio
Posts: 3,830
Matt is an unknown quantity at this point
Default
Don't. vBseo deals with all that shit... Plus spiders are our friends!!!
__________________
"Facts do not cease to exist because they are ignored."
Reply With Quote
  #13  
Old 07-07-2009, 08:02 PM
World Domination's Avatar
(Offline)
Super Sexy Admin
  
Join Date: Jan 2007
Location: Illinois, USA
Posts: 7,448
World Domination is an unknown quantity at this point
Default
Originally Posted by Matt View Post
Don't. vBseo deals with all that shit... Plus spiders are our friends!!!
Not the ones that come here and leech info then add us to more spammer's databases.
__________________
RSForums.org - We Don't give a fuck.
RSForums.org - Worse than Crack.
RSForums.org - Where the criminals hang.
RSForums.org - Will never die.


To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.

"It's not yelling, it's projecting; and by the way, my voice is soothing."
-Billy Mays


To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
Why does have to MSN? Too secreto for the forums? If you don't want people to find out about something, post it at RSF.
Reply With Quote
Reply
Page 2 of 2 1 2

« Previous Thread | Next Thread »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


All times are GMT -5. The time now is 02:34 AM.

Powered by vBulletin® Version 3.8.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.3.0
Copyright © 2006 - 2012, Rsforums.org

Contact Us - RSF - Archive - Top