Very Computer

Our Web site log is about 100 megabytes daily, zipped up, it's 10
megabytes. We are looking for a Web server log analyzer that contains
the following features:

1) can analyze Netscape server log files
2) must be Unix-based
3) can analyze files of up to 5 gigs monthly, rotating files daily while
keeping running tabulations for up to 1 month (our Web server right now
is short on disk space and can't handle for that half a gig of log files
at any one time).
4) can produce attractive graphics as well as numbers
5) Can analyze portions of the logs only (such as a subdirectory)
6) Ability to analyze remote server logs that are compressed.

I would much appreciate it if you could message me if you are using,
know of or have written software that meets this feature list. I've been
reviewing many log analyzers off the Net, and some are really good, but
none seems to meet all these features. Please email reply as well. Any
help much appreciated.

Gary Nielson
C*te NC

  http://www.statslab.cam.ac.uk/~sret1/analog/

--

  Statistical Laboratory,  16 Mill Lane, Cambridge, CB2 1SB, England
  "The Bishop of Huntingdon and Postman Pat each opened new school extensions"
                                            (Cambridge Weekly News, 28-May-97)

I would encourage you to take a look at the new SurfReport 3.0, available
for a free 30 day evaluation at http://www.veryComputer.com/

SurfReport is cross platform, very fast, easy to use, and is the most
configurable of all the statistics programs on the market. A live demo is
available on the site as well. It should meet your needs quite nicely.
--
John Logan
NETRICS.COM

**To respond, please remove .nospam from email address.**

Quote:> Our Web site log is about 100 megabytes daily, zipped up, it's 10
> megabytes. We are looking for a Web server log analyzer that contains
> the following features:

> 1) can analyze Netscape server log files
> 2) must be Unix-based
> 3) can analyze files of up to 5 gigs monthly, rotating files daily while
> keeping running tabulations for up to 1 month (our Web server right now
> is short on disk space and can't handle for that half a gig of log files
> at any one time).
> 4) can produce attractive graphics as well as numbers
> 5) Can analyze portions of the logs only (such as a subdirectory)
> 6) Ability to analyze remote server logs that are compressed.

> I would much appreciate it if you could message me if you are using,
> know of or have written software that meets this feature list. I've been
> reviewing many log analyzers off the Net, and some are really good, but
> none seems to meet all these features. Please email reply as well. Any
> help much appreciated.

> Gary Nielson
> C*te NC

I'm still waiting for someone to build a product that's an apache
module that logs to a "loghost" and does daily reports.  I'd pay
for that product...

Charles

: I would encourage you to take a look at the new SurfReport 3.0, available
: for a free 30 day evaluation at http://www.veryComputer.com/

: SurfReport is cross platform, very fast, easy to use, and is the most
: configurable of all the statistics programs on the market. A live demo is
: available on the site as well. It should meet your needs quite nicely.
: --
: John Logan
: NETRICS.COM

: **To respond, please remove .nospam from email address.**

: > Our Web site log is about 100 megabytes daily, zipped up, it's 10
: > megabytes. We are looking for a Web server log analyzer that contains
: > the following features:
: >
: > 1) can analyze Netscape server log files
: > 2) must be Unix-based
: > 3) can analyze files of up to 5 gigs monthly, rotating files daily while
: > keeping running tabulations for up to 1 month (our Web server right now
: > is short on disk space and can't handle for that half a gig of log files
: > at any one time).
: > 4) can produce attractive graphics as well as numbers
: > 5) Can analyze portions of the logs only (such as a subdirectory)
: > 6) Ability to analyze remote server logs that are compressed.
: >
: > I would much appreciate it if you could message me if you are using,
: > know of or have written software that meets this feature list. I've been
: > reviewing many log analyzers off the Net, and some are really good, but
: > none seems to meet all these features. Please email reply as well. Any
: > help much appreciated.
: >
: > Gary Nielson
: > C*te NC
: >
: >

--

~~~~~~~~~                                       ~~~~~~~~~~~
Charles S*man                               Internet Channel
INCH System Administration Team                 (212)243-5200

Unless you are doing other things, it is often wiser to just log
to a local file and then do batch processing; otherwise, if your loghost
ever goes down then you lose logs for that period.  It doesn't take
much effort to simply automatically copy the logs over to a loghost
for daily processing.

Even if you wanted to log to a remote host in real time, that is easy
using piped logs without needing a module..

The only advantage to the loghost is you can have the loghost do dns lookups which leaves
the webserver free from having to waste the resources on it.
We are doing something like this already.   We have apache send log entries to the
loghost which puts them in the right file for what ever virtual domain got the hit and do
the DNS lookup.
Solving the problem of the loghost going down is a bear, but it can be done with minimal
loss of data