Awful NFS client perf. w/AIX NFS server

Awful NFS client perf. w/AIX NFS server

Post by Brad Mill » Sat, 23 Mar 1996 04:00:00



Hi,
        I am having severe performance problems using linux as a nfs
client with an AIX nfs server.  The configuration is briefly described,
then the performance stats, and then a couple of questions.

Configuration:
--------------

Machine  OS     Version    NFS    
-------  ---    -------    ------
A1       AIX    3.2.51     Server    
A2       AIX    3.2.51     Client
L1       Linux  1.3.64     Client

Mount output for nfs partition for each machine
------------------------------------------------
A1: /dev/fslv01 /home      jfs    Feb 06 01:28 rw,log=/dev/loglv02
A2: A1 /home    /home      nfs    Mar 19 13:50 rw,hard,bg,intr
L1: A1:/home on /home type nfs    (rw,hard,intr,addr=XX.XX.XX.XX)
    where xx.xx.xx.xx is the correct local address of the server.

        It is not a network bandwidth problem, as ftp and other
networking apps on the linux box are at full speed - only nfs is
bottle-necked.  And A2 and L1 machines are both on the same ethernet
subnet as A1, so the network cabling/routing to the server is not a
problem.

Performance:
------------
The following gives the performance of creating a 1MB
file (using dd) on the /home file partition from the A2 and L1 nfs
clients (using a much larger file as the input file to dd).  As you
can see, it does much worse for the Linux client L1!  I would be happy
if the linux nfs client could do as well as the AIX nfs client A2...

Command: time dd if=/home/LargeFile of=/home/tstMM count=2k
         where MM is the machine name
Results:
A1:   1.33 seconds   (local file system, so no nfs overhead)
A2:  11.98 seconds   (nfs client of A1)
L1: 157.94 seconds   (nfs client of A1)

Questions:
---------

1. Any idea of nfs client parameters we can tweak on the linux box L1
to get acceptable performance?

2. When the L1 is nfs writing to A1:/home, you can actually hear the
hard disk sort of thrashing on A1 - maybe L1 is writing one byte at a
time?  How can I check?

3. If it is the AIX version of nfs that is screwy (optimized to work well only for other nfs machines), can we tweak the linux nfs version to act like an aix nfs client? (the linux box is only nfs mounting the aix box).

4. Maybe this can be fixed by manipulating the datagram wsize and
rsize parameters of mount (pg. 172, NAG) - if so, does anyone know
what size they should be for working with AIX NFS servers?

thank you,
Brad L. Miller

 
 
 

Awful NFS client perf. w/AIX NFS server

Post by Sean Ed » Sun, 24 Mar 1996 04:00:00


Hi Brad,

   >I am having severe performance problems using linux as a nfs
   >client with an AIX nfs server.  The configuration is briefly described,
   >then the performance stats, and then a couple of questions.

I had the same trouble with an IRIX NFS server and Linux client. For
me, the key variable was rsize,wsize. I've got rsize=8192,wsize=8192
in my Linux box's /etc/fstab now.  Linux defaults to a 1024 byte
read/write size. This change boosted my NFS performance in simple cp's
and dd's by 8-fold.  It got me to within 1.5-2x the performance of my
commercial (IRIX and Solaris) UNIX NFS clients, which I can live with.

I still take a fairly severe (4-fold) hit in jobs that do a lot of
small read/writes (such as an 'ld' of a lot of object code files,
during a 'make').  I'm running 1.2.13. I was told that 1.3.x kernels
did/would have additional NFS client improvements but haven't the time
to play with the experimental kernels.

Yours,
Sean Eddy
--
- Sean Eddy
- Dept. of Genetics, Washington University School of Medicine


 
 
 

1. Wierd AIX/NFS client, Sun/NFS server problem

AIX 3.1.6 and 3.1.5 on 320s, SunOS 4.1.1 on SS2s, thinnet on the IBMs,
both on the suns.

Suddenly (why do things always happen suddenly?), NFS client speed
from IBM -> Sun is *amazingly* slow.   As in 8 minutes to copy a
400K file from the remote filesystem to /tmp.  AIX<->AIX speed
is per usual, and Sun<->Sun speed is usual.

The only thing I've changed recently is to move the gateway for our
subnet to a new IP address.  I changed my rc files to reflect the change.
I don't remember the AIX machines slowing down then, either, as I was
using them to build software on the remote file systems immediately after the
change.

I've applied nfsextfix, and that didn't help.  etherfind(1) on the sun
shows that the 320s are asking and getting nfs requests w/ no exraneous
packets inbetween requests.  It's just that there's a 5-10 second lag
between each nfs request (which are 8K in size, like they've always been.)

There are no routers or bridges between the clients and the server.  The
arp table information on the AIX clients is correct.  The routing tables
as reported by netstat -rn seem to be just fine.  The percentage of bad
packets reported by nfsstat, etc, are all well below tolerances (and
are below the rates for the sun clients!).

Any clues/hints?

--

vox: (713) 749-2126  '91 CB750, DoD# 0378

2. Does Linux (2.0.30) work with AGP graphic cards?

3. Need info on PC/NFS and Unix NFS servers, server/client ratio

4. Fix for installing Solaris on Pentium 4, but how can you use it standalone?

5. NFS backup auto mount on client when NFS server fail...!

6. Pre-Compile libc with NIS

7. Tracing NFS Clients on the NFS Server ?

8. Can anyone help?

9. Poor NFS write performance from Linux clients to NFS Ver 3 servers.

10. SCO NFS client with HP/Apollo NFS server?

11. NFS server on HP-UX 10.20 & NFS client on RH-5.2 : write permission ???

12. problem with LINUX (NFS server) and Solaris 2.7 (intel ) NFS client.

13. NFS bug in the new kernels (was Re: NFS with Redhat 6 server and clients)