Cached file system -- summary

Cached file system -- summary

Post by John Caywo » Sat, 22 Jan 1994 02:44:51



About a month ago I posted a question to this group, asking about experiences
with the cache file system (cachefs) under Solaris 2.3.  I apologize for
not posting this summary sooner, but I installed Solaris 2.3 on my server
and 20 clients, but I had severe printing problems and I'm now in the
process of backing it out.  cachefs was *not* the reason for removing
Solaris 2.3.

As a result of these comments, I am using cached file systems on the few
systems still running Solaris 2.3.  As the first message reply shows, you
must also add the "cachedir=" mount option to entries in /etc/vfstab.
Cachefs is a blessing for workstations with a SUN0207 or smaller disk.
200M is not quite big enough for /, swap, and a full /usr, so you can
put a truncated /usr (say, the essential 60Mbytes of /usr, without openwin
or share/man) on the local disk and use the rest for cache directories.

Here are the replies.  Many thanks to all who replied.

>From David.Mi...@East.Sun.COM Thu Dec 16 17:03:16 1993

I've been using it for a few months now, and it works quite well.  All you have
to do to set it up is to create a cache area in a directory with cfsadmin, and
then mount things with the right parameters onto the cache directory (which I
presume is what answerbook tells you; haven't looked at that since it wasn't
there when I started using it).  I'm actually running two separate caches.
I've enclosed a copy of the entries from my vfstab for one of them below.

It presently doesn't support caching of / or /usr.

spenser:/export/s10-93/openwin/ow       /usr/cache      /usr/openwin    cachefs
3       yes     ro,backfstype=nfs,cachedir=/usr/cache,local-access
spenser:/export/s10-93/manpages/man     /usr/cache      /usr/share/man  cachefs
3       yes     ro,backfstype=nfs,cachedir=/usr/cache,local-access
chardonnay-5:/export/dist/local/pkgs/sunpro,v2.0.1/sol-2.sparc  /usr/cache
/opt/SUNWspro   cachefs 3       yes
ro,backfstype=nfs,cachedir=/usr/cache,local-access,noconst
chardonnay-5:/export/dist/local/pkgs/teamware,v1.0/5.x-sparc    /usr/cache
/opt/teamware   cachefs 3       yes
ro,backfstype=nfs,cachedir=/usr/cache,local-access,noconst

>From kru...@Tymnet.COM Thu Dec 16 18:48:37 1993

I use cacheFS on my machine at work to cache large directories, such
as /usr/openwin and /opt (in which we have over 500 MB of stuff). It
seems to work, and wasn't very hard to setup. As to performance, it
seems slower to start up openwindows (probably because it has to copy
the binaries to disk beofre starting it?), but performance after that
seems OK.

I use it on my machine at home, which connects via PPP, to cache any
remote filesystem. That works much better than doing the NFS mount
across the )much) slower link...

I haven't explicitly tried cacheing /usr, and am not sure how well it
would work given the initial requirements to have much of /usr around.
(I guess I mean that I would expect booting to be a bit slower as it
pages in /usr)

>From han...@pogo.fnal.gov Thu Dec 16 19:22:25 1993

In comp.unix.solaris you write:

>Can anyone relate any experiences with cache_fs?  The Sun book _Solaris
>2.3 Administering File Systems_ described how to set up a cache fs, but
>the description seemed incomplete.

So far seems to work nicely.

>Can /usr be mounted type cache_fs?

Not yet.  It's not a supported way of using it - some chicken and egg
stuff - you need to mount /usr before you can access the cachefs stuff,
so ---.  Sun claims to be fixing this, though it sounds like it may
well be end of '94.  So it's really not useful for /usr or /.  Boo.

>From bas...@soleil.inria.fr Fri Dec 17 11:25:03 1993

On my SunOS5.3 sun LX 24Mb RAM workstation, i'm cahce-fs mounting (readonly)
/usr/share/man == the manual
and /opt/SUNWspro == Sun bundled compilers

I seldom use them (i'm not accessing them as frequently as a /usr fs)
but i never crashed them -- i have installed SunOS5.3 2 weeks ago

So for me (and for this small usage) cahce fs is ok.
I don't know about cache fs mounting /usr.

.

>From c...@seismo.emr.ca Mon Dec 20 10:08:12 1993

In article 5...@reznor.larc.nasa.gov, cayw...@corn.larc.nasa.gov (John Caywood) writes:

>Can /usr be mounted type cache_fs?

According to Jim Engquist of Sun and his talk at the recent SUG the
answer is NO. I gather that / and /usr must be mounted early on in the
boot sequence and before the system knows about CacheFS. It sounded
like Sun was interested in finding a way to make /usr work under
CacheFS. The best use of CacheFS seems to be "read mostly" or "read
only" file systems. He suggested things like /usr/openwin would benefit
the most. Filesystems with files that you tend to read once only (like
mail and news) are not good candidates. Filesystems that are read/write
or "write mostly" are also not good candidates for CacheFS.

>From Phil.Me...@oryx.com Mon Dec 20 13:39:12 1993

We have been after SUN to explain why you CANNOT mount /usr as a cachefs
file system.  For us, 80% of uour NFS traffic is /usr to swapfull clients.

Cachefs in general is a very big win.  Every read from the network is
copied to disk.  If a file has not changed since the last read, it is
read from disk.  This means that an initial NFS file status is done for
every open, but for reads, it really makes a difference.

Now consider this:  The first thing we run on our workstations is xdm.
It takes about 20-40MB of stuff (fonts, libraries, app-defaults, etc.)
for a guy to log in.  How much cache is enough?  I now have 54MB of data
in cache, and I am a very simplistic user by comparison to what our users
do here.

Also, cachefs is kept over a reboot.  This means that if you had a
3GB disk to dedicate to cachefs, eventually, you would have all the
files (static files) you have ever used in cache!  This would be a big
win for us, since we do huge volumes of static data reads for all types
of siesmic data processing.

Now if we could just mout /usr as a cachefs filesystem, and if we could
figure out how much cache is really usefull...

>From lrw.uni-bremen.de!l33 Sat Jan  1 07:26:52 1994

Below I describe my experience with the cachefs feature and send this
letter to Doug Hughes, John Caywood and Andy Chittenden, from whom I
found postings in comp.unix.solaris.

For my opinion the documentation regarding the automount stuff is not
really clear. Using yp (nis) there was a file called auto_direct, whose
entries used the automounter to perform direct (1:1) mounts. Additional
entries in the auto_master seems to be indirect using a relative mount
point like auto_home does.

Probably the cachefs cannot cope theses relative mount points, the
documentation says nothing about that. Apart from "cfsadmin -l" there
is no further information about the state of a cachefs.

I administer a network of stand alone machines. The server shares the
user data, some program data (local and spro) and /var/mail. I am using
nis+ and automount for a long time now and I wanted to combine nis+,
automount and cachefs. My idea is:

1) Create auto_direct entry in auto_master table.

/net    -hosts
/home   auto_home
/-      auto_direct

2) Create a auto_direct nis+ table.

/usr/bin/nistbladm -c auto_mountmap key=S value= \
           auto_direct.org_dir.lrw.uni-bremen.de.

/usr/lib/nis/nisaddent -r -t auto_direct.org_dir key-value << HERE
/usr/local      -fstype=cachefs,cachedir=/var/cache,backfstype=nfs,
                 cacheid=local,rw     blue:/usr0/local
/usr/spro       -fstype=cachefs,cachedir=/var/cache,backfstype=nfs,
                 cacheid=spro,ro,local-access,noconst    blue:/usr0/opt/SUNWspro
HERE

Note that the auto_direct table is of type key-value although it has
three columns. (There are TWO lines inside the HERE script, I broke them
to keep the text more readable.)

This configuration works pretty well as long the client mount point is
different from the original file system name. The auto_direct setup above
leads to an odinary mount on the server by default. Hence it is not possible
to mount /var/mail to /var/mail. This works for the clients without having
a local /var/mail, but it fails for the server.

I use a vfstab entry for /var/mail, admintool generated auto_home entries
for the users and the auto_direct stuff above for the local and spro
directories. mount_cachefs is aware of the "-O" flag allowing overlay
mounts. Maybe this flag could be a solution for the /var/mail problem.

I didn't try further configuration details, because the machines are needed
for production. Hence there is no time left for experiments. The described
configuration is stable and so far it improves the startup times on the
clients and reduces the network traffic a lot. "snoop" finds far fewer nfs
packages since I use the cachefs feature than before.

Any comments are appreciated.

--
The opinions expressed herein are my own.---------------------------------
  !John Caywood, System Administrator           !J.S.Cayw...@LaRC.NASA.GOV
  !Computer Sciences Corp., under contract to   !cayw...@wyvern.wyvern.com
  !NASA Langley Research Center, Hampton, VA    !(804)864-2496 voice
  +---------------------------------------------!(804)864-8311 fax

 
 
 

1. Cached file system -- summary and /usr [second attempt]

There was a nice summary describing the use of cachefs under Solaris 2.3

One of the things stated in the message was that the cachefs cannot be used
for /usr. This is NOT true (even if Sun say it cannot be done it seems to
work just fine). I agree it doesn't work during startup but any time after
the system has booted a command such as the following overlay mounts /usr
(eg. from a script in /etc/rc3.d)

mount -O -F cachefs -o ro,backfstype=nfs,cachedir=/export/cache/cache1 hyacinthus:/export/exec/Solaris_2.3_sparc.all/usr /usr

The important option seems to be -O so that it can hide the /usr mount
point used during booting.

Is there some reason why I shouldn't do this that will make me regret it?
It certainly eliminates the NFS READs leaving just the GETATTRs quite
nicely (once the cache has run for a bit).

any comments?

/----------------------------------------------------------------------------\


| University of Aberdeen        |                                            |
| Foresterhill                  | [+44]-224-685645               (Fax)       |
| Aberdeen.  AB9 2ZD            | [+44]-224-681818 x53210        (Voice)     |
|----------------------------------------------------------------------------|
| 3 is not equal to 2, not even for large values of 2.                       |
\----------------------------------------------------------------------------/

2. shell filename Generation...

3. Cached file system -- summary and /usr

4. Just to change the hostname!!

5. Enhanced Filing system - file system like DEC Advanced File system for Linux

6. Problem with snmpdx

7. Summary: Veritas file system versus UFS.

8. Q: Variable name within a variable

9. SUMMARY: automounting local file systems

10. SUMMARY: Max # of mounted file systems

11. "Standard Journaled File System" vs "Large File Enabled Journaled File System"

12. Cache File System

13. Solaris 2.3 & The Cache Filing System ( SysAdm Question )