If you want to do page counting and analysis there are several MySql tables that you can use. The MySql schema for these tables is in the mysql.schema file in the repository.
The tables are:
Here are the schemas of the tables:
CREATE TABLE `bots` (
`ip` varchar(40) NOT NULL DEFAULT '',
`agent` varchar(255) NOT NULL DEFAULT '',
`count` int(11) DEFAULT NULL,
`robots` int(5) DEFAULT '0',
`who` varchar(255) DEFAULT NULL,
`creation_time` datetime DEFAULT NULL,
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`ip`,`agent`),
KEY `ip` (`ip`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
CREATE TABLE `bots2` (
`ip` varchar(40) NOT NULL DEFAULT '',
`agent` varchar(255) NOT NULL DEFAULT '',
`date` date NOT NULL DEFAULT '0000-00-00',
`site` varchar(50) NOT NULL DEFAULT '',
`which` int(5) NOT NULL DEFAULT '0',
`count` int(11) DEFAULT NULL,
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`ip`,`agent`,`date`,`site`,`which`),
KEY `ip` (`ip`),
KEY `agent` (`agent`),
KEY `site` (`site`),
KEY `ip_2` (`ip`),
KEY `date` (`date`),
KEY `site_2` (`site`)
) ENGINE=InnoDB DEFAULT CHARSET=utf8;
CREATE TABLE `logagent` (
`site` varchar(25) NOT NULL DEFAULT '',
`ip` varchar(40) NOT NULL DEFAULT '',
`agent` varchar(255) NOT NULL,
`count` int(11) DEFAULT NULL,
`id` int(11) DEFAULT NULL,
`created` datetime DEFAULT '0000-00-00 00:00:00',
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`site`,`ip`,`agent`),
KEY `ip` (`ip`),
KEY `site` (`site`),
KEY `agent` (`agent`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
CREATE TABLE `logagent2` (
`site` varchar(25) NOT NULL DEFAULT '',
`ip` varchar(40) NOT NULL DEFAULT '',
`agent` varchar(255) NOT NULL,
`count` int(11) DEFAULT NULL,
`id` int(11) DEFAULT NULL,
`created` datetime DEFAULT '0000-00-00 00:00:00',
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`site`,`ip`,`agent`),
KEY `agent` (`agent`),
KEY `site` (`site`),
KEY `ip` (`ip`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
CREATE TABLE `daycounts` (
`site` varchar(50) NOT NULL DEFAULT '',
`date` date NOT NULL,
`real` int(11) DEFAULT '0',
`bots` int(11) DEFAULT '0',
`members` int(11) DEFAULT '0',
`visits` int(11) DEFAULT NULL,
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`site`,`date`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
CREATE TABLE `counter` (
`filename` varchar(255) NOT NULL,
`site` varchar(50) NOT NULL DEFAULT '',
`ip` varchar(20) DEFAULT NULL,
`agent` varchar(255) DEFAULT NULL,
`count` int(11) DEFAULT NULL,
`realcnt` int(11) DEFAULT '0',
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`filename`,`site`),
KEY `site` (`site`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
CREATE TABLE `counter2` (
`site` varchar(50) NOT NULL DEFAULT '',
`date` date NOT NULL DEFAULT '0000-00-00',
`filename` varchar(255) NOT NULL DEFAULT '',
`count` int(11) DEFAULT '0',
`members` int(11) DEFAULT '0',
`bots` int(11) DEFAULT '0',
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`site`,`date`,`filename`),
KEY `site` (`site`),
KEY `date` (`date`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;
CREATE TABLE `tracker` (
`id` int(11) NOT NULL AUTO_INCREMENT,
`site` varchar(25) DEFAULT NULL,
`page` varchar(255) NOT NULL DEFAULT '',
`ip` varchar(40) DEFAULT NULL,
`agent` varchar(255) DEFAULT NULL,
`starttime` datetime DEFAULT NULL,
`endtime` datetime DEFAULT NULL,
`difftime` time DEFAULT NULL,
`refid` int(11) DEFAULT '0',
`isJavaScript` int(5) DEFAULT '0',
`lasttime` datetime DEFAULT NULL,
PRIMARY KEY (`id`),
KEY `site` (`site`),
KEY `ip` (`ip`),
KEY `agent` (`agent`)
) ENGINE=MyISAM DEFAULT CHARSET=utf8;If you look at dbAbstract you will see several methods in the constructor:
If you look at these methods you will see that they are protected by a check of the database to see if the tables exists in the database. If the table does not exist an 'error_log' message is output. You can prevent the error message by setting "noErrorLog": "true" in the 'mysitemap.json' file.
I have five additional PHP files to check robots.txt (robots.php) and Sitemap.xml (sitemap.php). I also have a 'tracker.php', 'beacon.php' and 'tracker.js' to do session logging. These file are here in the 'docs/' directory.
If you want to track reads of robots.txt and Sitemap.xml you can add 'RewriteRule' clauses to your '.htaccess' file:
# Direct robots.txt to robots.php and Sitemap.xml to sitemap.php
# Also csstest-nnnnn.css redirects to our tracker.php
RewriteRule ^robots\.txt$ robots.php [L,NC]
RewriteRule ^Sitemap\.xml$ sitemap.php [L,NC]
RewriteRule ^csstest-(.*)\.css$ https://bartonlp.com/otherpages/tracker.php?id=$1&page=csstest [L,QSA]!!!!NEEDS UPDATING!!!!
Examples
dbTables
SiteClass Methods
Additional Files
Analysis and Tracking
Index
Barton Phillips : bartonphillips@gmail.com
Copyright © 2024 Barton Phillips
Project maintained by bartonlp
Last Modified January 5, 2024