Logfiles larger than 2 GB on solaris 7 ?

Logfiles larger than 2 GB on solaris 7 ?

Post by Marcus Türne » Fri, 14 Jan 2000 04:00:00



Apache is not able to write logfiles larger than 2 GB isn't it ?
How can I get Apache to do so.
Is it possible to filter the logging from Apache during running from
Apache so that Logentries with *xyz* will not be logged. How.
The documentation on this is too small. I cannot test to much, because I
need this Feature on a highly used machine. (Now about 2 GB Logfile in
16 hours)

Thanks in advance!

Regards Marcus

 
 
 

Logfiles larger than 2 GB on solaris 7 ?

Post by Marc Slem » Fri, 14 Jan 2000 04:00:00



>Apache is not able to write logfiles larger than 2 GB isn't it ?

That isn't an Apache issue, but a Solaris one.  If you compile Apache
with the right magic flags for large file support it likely would work.

Quote:>How can I get Apache to do so.
>Is it possible to filter the logging from Apache during running from
>Apache so that Logentries with *xyz* will not be logged. How.
>The documentation on this is too small. I cannot test to much, because I
>need this Feature on a highly used machine. (Now about 2 GB Logfile in
>16 hours)

Erm... why can't you setup a separate copy of the server running
in a dev environment, or even a different port on the same server?

Anyway, look at http://www.apache.org/docs/mod/mod_log_config.html

 
 
 

Logfiles larger than 2 GB on solaris 7 ?

Post by Rainer Scher » Fri, 14 Jan 2000 04:00:00


That's not possible for apache.
Because this is a Solaris OS problem.

The IMO only and fastest way is to rotate your log e.g. each
hour and avoid the 2GB boundary.

Perhaps someone can tell if this problem is fixed in Solaris 2.7...

- rainer


> Apache is not able to write logfiles larger than 2 GB isn't it ?
> How can I get Apache to do so.
> Is it possible to filter the logging from Apache during running from
> Apache so that Logentries with *xyz* will not be logged. How.
> The documentation on this is too small. I cannot test to much, because I
> need this Feature on a highly used machine. (Now about 2 GB Logfile in
> 16 hours)

> Thanks in advance!

> Regards Marcus

 
 
 

Logfiles larger than 2 GB on solaris 7 ?

Post by Marcus Türne » Sat, 15 Jan 2000 04:00:00


Thank you for your ideas, but:

Here you see the documentation about solaris from sun.

Copyright (c) 1997 Sun Microsystems, Inc.

DOCUMENT ID: 2480-02

SYNOPSIS:    Maximum single file and file system size

OS:          Solaris/SunOS

PLATFORM:    Generic

OS VERSION:  2.6

TECH AREA:   OS

PRODUCT:     Kernel

KEYWORDS:    large, size, single, fs

DESCRIPTION:

What's the maximum single file and file system size supported in Solaris
2.5.1, 2.6 ?

SOLUTION:

This lists the maximum single file and file system size of 4.1.x and Solaris
2.x up to 2.6.

OS RELEASE              SINGLE FILE             FILE SYSTEM
===============         ===========             ===========
4.1.x                      2 GB                     2 GB
4.1.x + ODS                2 GB                     1 TB
Solaris 2.0-2.5.1          2 GB                     1 TB
Solaris 2 + SDS            2 GB                     1 TB
Solaris 2.6                ~800 GB                  1 TB

A single file of Solaris 2.6 is limited to "about" 800 GB because the file
MUST fit inside a file system. The file system is nominally 1 TB, but in fact
one must create enough overhead in such a large file system that the largest
single file ends up being "about" 800 GB. (part of this is a bug, but even if
bug-free a single file can't be 1 TB)

Note that in Solaris 2.6, the swap and tmpfs file system are still limited to
2 GB.  Also note that the root file system is limited to ~2 GB on all but
Ultras due to an OBP limitation (~1 GB on systems with OBP versions 1.0->2.6).

---------------------------------------------------------------

So I think that this should be no problem of solaris

The rotating of the log is of course possible but in our case more komplex for
further actions.

Marcus

Rainer Scherg schrieb:

> That's not possible for apache.
> Because this is a Solaris OS problem.

> The IMO only and fastest way is to rotate your log e.g. each
> hour and avoid the 2GB boundary.

> Perhaps someone can tell if this problem is fixed in Solaris 2.7...

> - rainer


> > Apache is not able to write logfiles larger than 2 GB isn't it ?
> > How can I get Apache to do so.
> > Is it possible to filter the logging from Apache during running from
> > Apache so that Logentries with *xyz* will not be logged. How.
> > The documentation on this is too small. I cannot test to much, because I
> > need this Feature on a highly used machine. (Now about 2 GB Logfile in
> > 16 hours)

> > Thanks in advance!

> > Regards Marcus

 
 
 

Logfiles larger than 2 GB on solaris 7 ?

Post by Rainer Scher » Sat, 15 Jan 2000 04:00:00


Mhh, I read it, but in fact I had the same problems
creation tarballs > 2GB.  (SunOS tar cmd)

- rainer


> Thank you for your ideas, but:

> Here you see the documentation about solaris from sun.

> Copyright (c) 1997 Sun Microsystems, Inc.

> DOCUMENT ID: 2480-02

> SYNOPSIS:    Maximum single file and file system size

> OS:          Solaris/SunOS

> PLATFORM:    Generic

> OS VERSION:  2.6

> TECH AREA:   OS

> PRODUCT:     Kernel

> KEYWORDS:    large, size, single, fs

> DESCRIPTION:

> What's the maximum single file and file system size supported in Solaris
> 2.5.1, 2.6 ?

> SOLUTION:

> This lists the maximum single file and file system size of 4.1.x and Solaris
> 2.x up to 2.6.

> OS RELEASE              SINGLE FILE             FILE SYSTEM
> ===============         ===========             ===========
> 4.1.x                      2 GB                     2 GB
> 4.1.x + ODS                2 GB                     1 TB
> Solaris 2.0-2.5.1          2 GB                     1 TB
> Solaris 2 + SDS            2 GB                     1 TB
> Solaris 2.6                ~800 GB                  1 TB

> A single file of Solaris 2.6 is limited to "about" 800 GB because the file
> MUST fit inside a file system. The file system is nominally 1 TB, but in fact
> one must create enough overhead in such a large file system that the largest
> single file ends up being "about" 800 GB. (part of this is a bug, but even if
> bug-free a single file can't be 1 TB)

> Note that in Solaris 2.6, the swap and tmpfs file system are still limited to
> 2 GB.  Also note that the root file system is limited to ~2 GB on all but
> Ultras due to an OBP limitation (~1 GB on systems with OBP versions 1.0->2.6).

> ---------------------------------------------------------------

> So I think that this should be no problem of solaris

> The rotating of the log is of course possible but in our case more komplex for
> further actions.

> Marcus

> Rainer Scherg schrieb:

> > That's not possible for apache.
> > Because this is a Solaris OS problem.

> > The IMO only and fastest way is to rotate your log e.g. each
> > hour and avoid the 2GB boundary.

> > Perhaps someone can tell if this problem is fixed in Solaris 2.7...

> > - rainer


> > > Apache is not able to write logfiles larger than 2 GB isn't it ?
> > > How can I get Apache to do so.
> > > Is it possible to filter the logging from Apache during running from
> > > Apache so that Logentries with *xyz* will not be logged. How.
> > > The documentation on this is too small. I cannot test to much, because I
> > > need this Feature on a highly used machine. (Now about 2 GB Logfile in
> > > 16 hours)

> > > Thanks in advance!

> > > Regards Marcus

 
 
 

Logfiles larger than 2 GB on solaris 7 ?

Post by Alan Coopersmi » Tue, 18 Jan 2000 04:00:00





>>Apache is not able to write logfiles larger than 2 GB isn't it ?

>That isn't an Apache issue, but a Solaris one.  If you compile Apache
>with the right magic flags for large file support it likely would work.

And those "magic flags" are documented in "man lfcompile" on Solaris 2.6
and later.

--
________________________________________________________________________

Univ. of California at Berkeley         http://soar.Berkeley.EDU/~alanc/

 
 
 

Logfiles larger than 2 GB on solaris 7 ?

Post by William Ya » Fri, 28 Jan 2000 04:00:00




Quote:> That's not possible for apache.
> Because this is a Solaris OS problem.

> The IMO only and fastest way is to rotate your log e.g. each
> hour and avoid the 2GB boundary.

> Perhaps someone can tell if this problem is fixed in Solaris 2.7...

Actually, one can state that this really is a problem with Apache, not
with Solaris (2.6 and higher). You need to use different I/O calls to
manage files larger than 2 GB in Solaris, and you need to mount the
filesystem with the largefiles option on (which is on by default, as I
recall, in 2.6 and higher).  Prior to Solaris 2.6, it wouldn't work at
all.

Even so, rotation is probably the easier solution.

        -Bill
--
The Greater Columbus Free-Net
System Administration

 
 
 

1. Writing files larger than 2 GB in Solaris 2.6

I need to write a program to make a file larger than 2 GB using Solaris
2.6.
I can create a large file by "cat"ing two 2 GB files together.  Solaris
has no
problem with this.

When I try to write a C program, using gcc or sun native compilers, the
program
generates errors when trying to write records out past the 2 GB
barrier.  I think this
is because my libraries are still using a signed long (32 bit) to
maintain position in the file.

Does anybody know of a compiler that doesn't have this restriction? (or
has updated
libraries)
            ---  OR ----

Is it just a configuration error with my compiler?

Chris Busick

2. A job in Italy?

3. Files larger than 2 GB on Intel/Linux

4. Duron, LILO, RedHat 6.2 probs?

5. Can't fdisk /dev/hdd problem

6. Filesystem larger than 33 GB

7. Bluechip card for lombard

8. Linux on hard disk larger than 8.4 gb?

9. Mounting volumes larger than 2 GB on SunOS

10. Filesize larger than 2 GB on Intel machines an Linux 2.0.36

11. FIPS on a HD larger than 8 GB

12. files larger than 2 GB