Sub Menu
Links Menu
Online Users

In total there are 679 users online :: 2 registered, 0 hidden and 677 guests

Most users ever online was 1091 on Wed Aug 16, 2023 5:27 pm

Registered users: Bing [Bot], Google [Bot] based on users active over the past 60 minutes

Bots [Solved]

General discussion of anything. Discuss a topic in and out of IntegraMOD

Moderator: Integra Moderator

Bots [Solved]

PostAuthor: MWE_001 » Wed Jan 03, 2007 3:24 pm

Ok I have searched not this site BUT the other one too and turned up no results. HOW do I stop bots from visitng my page? Is there a way to do this? Ive been watching one sit on my site now for 4 days! I dont need bots. Dont want them have nouse for my page being indexed by anyone.

Is it just as wise to ban google, yahoo, jeeves , etc, etc? I run a website with VERY limited users and personally dont give a rats fat Arse about rankings at all. All that amounts to is status and Im not concerened with my websites status on the net.

And bots adding, ignoring and all that is just getting old. I got lists of bots that i have to ignore 1 at a time. YUCK!

Help!!! Please???? <img>
Last edited by MWE_001 on Thu Jan 04, 2007 4:56 am, edited 1 time in total.
"Don't gain the world and lose your soul, wisdom is better than silver and gold" -Bob Marley

If you build it, I can break it! ~ Whispered in the tone of the movie Field of Dreams.
User avatar
MWE_001
Sr Integra Member
Sr Integra Member
 
Posts: 1265
Likes: 0 post
Liked in: 0 post
Images: 12
Joined: Fri Apr 21, 2006 6:59 pm
Cash on hand: 0.00
Location: Illinois

Re: Bots

PostAuthor: Teelk » Thu Jan 04, 2007 12:57 am

If you have no need for bots you can ban them using ACP>Security>Special and entering their User Agent name in the "Block User Agents" section. You'll have to google a list of User Agent names for search engines, I don't know what they are specifically.
Last edited by Teelk on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.
User avatar
Teelk
Dev Team
Dev Team
 
Posts: 1309
Likes: 0 post
Liked in: 0 post
Joined: Tue Mar 14, 2006 5:25 pm
Cash on hand: 0.00
Location: Canada

Re: Bots

PostAuthor: MWE_001 » Thu Jan 04, 2007 4:55 am

Ok I can do that Thx Teelk.

Search Engine: User-Agent
AltaVista: Scooter
Infoseek: Infoseek
Hotbot: Slurp
AOL: Slurp
Google: Googlebot
Overture: Slurp:
Lycos: Lycos
MSN: Slurp
Netscape: Googlebot
NorthernLight: Gulliver
WebCrawler: ArchitextSpider
Iwon: Slurp
Fast: Fast
DirectHit: Grabber
Yahoo Web Pages: Googlebot
Looksmart Web Pages: Slurp
Last edited by MWE_001 on Tue Jan 09, 2007 1:50 pm, edited 1 time in total.
"Don't gain the world and lose your soul, wisdom is better than silver and gold" -Bob Marley

If you build it, I can break it! ~ Whispered in the tone of the movie Field of Dreams.
User avatar
MWE_001
Sr Integra Member
Sr Integra Member
 
Posts: 1265
Likes: 0 post
Liked in: 0 post
Images: 12
Joined: Fri Apr 21, 2006 6:59 pm
Cash on hand: 0.00
Location: Illinois

Re: Bots [Solved]

PostAuthor: MWE_001 » Tue Jan 09, 2007 1:42 pm

Just an FYI I found a great link that anyone wanting to exclude certain bots or all of them from your site. ALSO It has tutorials for making bot.txt files. What these do is allow you to create a text file for bots. What it essentially does is tell the bots which pages they can not index. By this I mean if you have certain pages you do not want them to index you can now take care of it through a bot.txt file much in the same manner as using a redirect in a .hta file. It's quite simple and bots have stopped visitng my site alltogether now. Which is what i was after to begin with.

Here is the link. [url=http]Robots.txt[/url]
Last edited by MWE_001 on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.
"Don't gain the world and lose your soul, wisdom is better than silver and gold" -Bob Marley

If you build it, I can break it! ~ Whispered in the tone of the movie Field of Dreams.
User avatar
MWE_001
Sr Integra Member
Sr Integra Member
 
Posts: 1265
Likes: 0 post
Liked in: 0 post
Images: 12
Joined: Fri Apr 21, 2006 6:59 pm
Cash on hand: 0.00
Location: Illinois


Return to General Discussion

Who is online

Registered users: Bing [Bot], Google [Bot]

cron