Files larger than 2 GB on Intel/Linux

Files larger than 2 GB on Intel/Linux

Post by Eildert Groeneve » Thu, 06 May 1999 04:00:00



Someone started a thread with this very appropriate subject. But I
did not see any relevant answers to the topic. So let me raise
it again. We are about the by a really big Alpha server with some 3GB
of RAM  and 40 or so GB of disk space. What are our chances of
being able to handle files larger than 2GB?

This will certainly be a requirement if Linux is to make inroads in
high end computing.

greetings

Eildert Groeneveld
=========================================
Institute for
Animal Science and Animal Behaviour
Mariensee 31535 Neustadt Germany
Tel   : (49)(0)5034 871155
Fax   : (49)(0)5034 92579
www   : http://www.tzv.fal.de/~eg/

=========================================

 
 
 

Files larger than 2 GB on Intel/Linux

Post by Igor Zlatkovi » Thu, 06 May 1999 04:00:00


Hello there.


> Someone started a thread with this very appropriate subject. But I
> did not see any relevant answers to the topic. So let me raise
> it again. We are about the by a really big Alpha server with some 3GB
> of RAM  and 40 or so GB of disk space. What are our chances of
> being able to handle files larger than 2GB?

Linux cannot handle files larger than that at the present time, as of my
knowledge.

Quote:> This will certainly be a requirement if Linux is to make inroads in
> high end computing.

Linux made it a long time ago.

> greetings

> Eildert Groeneveld
> =========================================
> Institute for
> Animal Science and Animal Behaviour
> Mariensee 31535 Neustadt Germany
> Tel   : (49)(0)5034 871155
> Fax   : (49)(0)5034 92579
> www   : http://www.tzv.fal.de/~eg/

> =========================================

--
      o
     O       Cheers,
  ______O___
  \________/   Igor Zlatkovic

    \ O  /
     \  /
      \/
      ||       University of Applied Sciences
   ___||___    Frankfurt, Germany, EU.

 
 
 

Files larger than 2 GB on Intel/Linux

Post by Eugene V. Moroz » Thu, 06 May 1999 04:00:00



> Hello there.


> > Someone started a thread with this very appropriate subject. But I
> > did not see any relevant answers to the topic. So let me raise
> > it again. We are about the by a really big Alpha server with some 3GB
> > of RAM  and 40 or so GB of disk space. What are our chances of
> > being able to handle files larger than 2GB?

> Linux cannot handle files larger than that at the present time, as of my
> knowledge.

I've heard that Linux can handle files larger than 2Gb on 64 bit
machines, such as Alpha.
Eugene

--



Homepage: http://lucifer.dorms.spbu.ru     conversations with God)."
                                           (By Matt Welsh)

 
 
 

Files larger than 2 GB on Intel/Linux

Post by jxfau.. » Thu, 06 May 1999 04:00:00



> it again. We are about the by a really big Alpha server with some 3GB
> of RAM  and 40 or so GB of disk space. What are our chances of
> being able to handle files larger than 2GB?

You mention Intel in the Subject, then Alpha in the body.
Linux is 64 bit on 64 bit architectures (Alpha, UltraSparc) so you
will have no problems having files >2GB on an AlphaServer.
 
 
 

Files larger than 2 GB on Intel/Linux

Post by Stefan Monnie » Thu, 06 May 1999 04:00:00



> it again. We are about the by a really big Alpha server with some 3GB

There are several issues.  First is the filesystems themselves:

- ext2fs in linux-2.2 supports files bigger than 2GB (up to 1TB for
  filesystems with sufficiently big blocks (the limit comes from the
  triple-indirect blocks)).
- NFS only supports 32bits.
- NFSv3 supports 64bits (NFSv3 is available as a patch to the standard
  distribution).
- ...

Then, there is the interface between the user-code and the filesystem code:
On Linux-2.0, there is no support for more than 2GB files.
On Linux-2.2, files bigger than 2GB are supported but only on 64bit
architectures (alpha, Sparc64, ...).  So on Intel, you're out of luck.
But there is a patch (in alpha or beta quality, I don't know) for linux-2.2
that adds support for 64bit filesize on 32bit architectures (such as x86).
The catch is that any program that wants to access such a large file needs
recompilation.

        Stefan

 
 
 

Files larger than 2 GB on Intel/Linux

Post by Jürgen Exne » Thu, 06 May 1999 04:00:00



Quote:> Someone started a thread with this very appropriate subject. But I
> did not see any relevant answers to the topic. So let me raise
> it again. We are about the by a really big Alpha server with some 3GB
> of RAM  and 40 or so GB of disk space. What are our chances of
> being able to handle files larger than 2GB?

This has been discussed to death numerous times already. Please check
dejanews.

The short answer:
- for 64 bit architectures files larger than 2GB are supported already
- for 32 bit architectures there is no way to add support unless you do
major modifications to the kernel as well as to core libraries as well as
(in consequence to the library changes) to most applications.

jue
--
Jrgen Exner

 
 
 

1. Files larger than 2 GB on Intel/Linux

Hello,

is it possible to enable Linux/386 to deal with files >2 GB?

From what I read in the man pages for ftell()/fseek(), I guess I
run in trouble since both use long as file size arguments, which
is 32 bit on Intel. Is there a way to circumvent this limitation?
I mean, without changing "long" to "long long" and rebuilding the
entire system?

Cheers, patrick
--

University of Karlsruhe (TH), Germany
Faculty for Physics, EKP, Ka'CDF Tracking Group

2. problem mounting hard drives

3. Filesize larger than 2 GB on Intel machines an Linux 2.0.36

4. Q: Duplicating a bootable hardrive.

5. Writing files larger than 2 GB in Solaris 2.6

6. Writing a driver for a communications device

7. files larger than 2 GB

8. Some machines can't rarp

9. Linux on hard disk larger than 8.4 gb?

10. Filesystem larger than 33 GB

11. Mounting volumes larger than 2 GB on SunOS

12. Logfiles larger than 2 GB on solaris 7 ?

13. FIPS on a HD larger than 8 GB