Page 1 of 2

Adding CrawlTrack

PostPosted: Sun Oct 07, 2007 9:19 am
Author: CaNNon
Your phpBB Version: 2.0.
phpBB Type: Standard phpBB
MODs: No
Your knowledge: Beginner
Board URL: [url]http://[/url]

PHP Version:
MySQL Version:


What was done before the problem appeared?



What was done to try to solve the problem?




De.scription and Message

This package is really something for working with robots. It's pretty much stand alone except for linking it to your install.

The edits are necessary in two files, due to the way the portal works. The site can be accessed from either file. So both should have your code inserted. The install info usually only mentions one though. The code to add is supplied in the install and except for the second location it's what i used.

Please note this needs to be the first code to run so you must place the edits at the start.

Portal.php

Code: Select all
//-- adding CrawlTracker ( location 1 ) ----------------------------------------------------$crawltsite=1;require_once("/your-site-path/your-crawltrack-folder/crawltrack.php");// end add




common.php

Code: Select all
//-- adding CrawlTracker ( location 2 ) ----------------------------------------------------$crawltsite=1;require_once("/your-site-path/your-crawltrack-folder/crawltrack.php");// end add


Link to site at the demo page [url=http]http]

I also have the security functions enabled, I thought there would be some conflicts with the 2 included packages in integramod but have found no problems.

From the way this is working I'm pretty sure it could be run with all integra versions as long as you meet the posted requirements

To use CrawlTrack you need a web hosting with:

-php version 4.3 minimum

-graphique library GD2 to be able to see the graphs

-one MySQL database, it needs its own it won't mess with others so you must be able to make and link to another.

* Edited with a better choice of second include

Re: Adding CrawlTrack

PostPosted: Mon Oct 08, 2007 8:04 am
Author: CaNNon
I have submitted the edits, so now you can view the Integramod edits at:
[url=http]http://www.crawltrack.fr/doccms.php[/url]

If anyone tests this on other Integramod versions Please make sure your edits are submitted.

PostPosted: Fri Oct 26, 2007 8:14 am
Author: richiebgood
sorry, what does it do?

Re: Adding CrawlTrack

PostPosted: Fri Oct 26, 2007 8:51 am
Author: CaNNon
It allows you to do things like optimize the the way your found by search words.
It will keep track and allow you to pick the ones you get the most hits from.

Complete graphing of all the bot activity, our bot mod tracks like a dozen types of bots? other than allow or block them you can't work with it much. This tracks 100's and gives 5x more info. you need to know if a bot is moving tru a private area or has bad manners (not obeying your robots.txt) this will tell you. It also allows you to create test robots for your site to help you see what happening.

It also adds a small extra security package, if you would like PM me and I will give you a url/pass/user to look at a working one. you'll see everything except the tool page.

PostPosted: Fri Oct 26, 2007 9:00 am
Author: richiebgood
pretty cool, i saw the demo there alright.

And are all the bots added automatically i.e. ip ranges etc? or is there some maintenance with it?

Re: Adding CrawlTrack

PostPosted: Fri Oct 26, 2007 9:22 am
Author: CaNNon
No, you get updates from the mod site it's trough 2 buttons one does the bot updates and the other is security updates. That stuff is on the tool page and for security you won't get that access (if it's a working demo).

The demo is the same as you can allow for your users and pretty close to what you can show if you use the public viewing pages. this area could be added to your site and as it's using css I'm sure a little work and it could fit right in with any style sheet your using.

PostPosted: Fri Oct 26, 2007 9:27 am
Author: richiebgood
cool, i will add it to my 'to do' list of things i am doing to improve my site

PostPosted: Thu Nov 15, 2007 7:50 pm
Author: richiebgood
Installed it there now, the crawl tracker works but i got an error when adding tags to portal and index. Perhaps i have it done wrong.

Code: Select all
<?php//-- adding CrawlTracker ( location 2 ) ----------------------------------------------------$crawltsite=1;require_once("/crawltrack/crawltrack.php");// end add



Is it the full url to the crawl tracker folder needed?


*edit, i did not need the first '/', solved

Re: Adding CrawlTrack

PostPosted: Thu Nov 15, 2007 7:59 pm
Author: CaNNon
your site path is missing in front ---> /your-site-path/

yea the "/" would make it look off root instead off the working folder.

PostPosted: Thu Nov 15, 2007 8:04 pm
Author: richiebgood
do you mean the paintballer.ie bit?

all i have at the moment is 'crawltrack/crawltrack.php'

the url is http://www.paintballer.ie/crawltrack/crawltrack.php.

So is what i have correct?

Re: Adding CrawlTrack

PostPosted: Thu Nov 15, 2007 8:10 pm
Author: CaNNon
create a test robot, and see you may not need that?

PostPosted: Thu Nov 15, 2007 8:24 pm
Author: richiebgood
ok test robot is working.

In the admin index, is shows a google bot on the forum but that is not showing up on the crawltrack. Does the bot have to hit the portal or index in order to get registered?

Re: Adding CrawlTrack

PostPosted: Thu Nov 15, 2007 8:27 pm
Author: CaNNon
If the bot was on the site before the install it won't see it.
The bot would not have passed tru your additional code.

PostPosted: Thu Nov 15, 2007 8:31 pm
Author: richiebgood
i see. nice one, cheers for the help. I will report back in a few days.

PostPosted: Sat Nov 17, 2007 6:11 am
Author: richiebgood
Well i have had crawl track for a few days now and i think it is great. It showing up more bots and differienciating more bots that the acp/bots managment.

Here is my public stats: http://www.paintballer.ie/crawltrack