Who knows popper?

Who knows popper?

Post by Darksho » Thu, 26 Feb 1998 04:00:00



I'm still fighting processor usage on one of our internet servers,
5.0.4 with Fast Start. All email clients are POP3 virtual domain
types.

cpuhog shows that popper is what's sucking cycles, and they hang
around forever until they have the whole machine. sar shows idle
of 0% after the machine has been up for 2-3 hours, which is obviously
wrong, as it runs fine and is very quick. It does slow down some,
but nothing like sar says it should be - 97% sys usage. (!)

This is having secondary effects, in that sendmail requires me to keep
upping the queue trigger levels, and sometimes wedges and as to be
restarted. I mentioned more detail on this in an earlier message.

In any case, popper's man page mentions a -d option which pertains to
time-to-livem but it neglects ranges or what the default might be. It
says it gets it from a bvariable in a config file, but I can't find
it.

Most of these users are PPP-dialup, their ping rates are in the low 200
ms range from server-to-client, so WHAT should popper -d be set to so
the damned things will die before they take over the system?

Is there some special tuning I should do to 5.0.4 since I'm running
Fast Start on it? Regular (5.0.2 based) Fast Start 1.0 ran like a
bear- never had these weird little problems with it.

Please do point me somewhere; right now we're dealing with this by
watching it and fixing it by hand, 24/7

'Shot

 
 
 

Who knows popper?

Post by Bill Campbel » Fri, 27 Feb 1998 04:00:00



>I'm still fighting processor usage on one of our internet servers,
>5.0.4 with Fast Start. All email clients are POP3 virtual domain
>types.

>cpuhog shows that popper is what's sucking cycles, and they hang
>around forever until they have the whole machine. sar shows idle
>of 0% after the machine has been up for 2-3 hours, which is obviously
>wrong, as it runs fine and is very quick. It does slow down some,
>but nothing like sar says it should be - 97% sys usage. (!)

Which POP3 server are you running?  We use either ipop3d from the
University of Washington IMAP distribution or qpopper from Qualcomm.  We
use these at many of our ISP client sites which support thousands of e-mail
clients on SCO OSR-5 servers without seeing any problems like this.  Both
of these are available for download from our ftp site, ftp.celestial.com

Bill
--

UUCP:              camco!bill   2835 82nd Avenue S.E. S-100
FAX:           (206) 232-9186   Mercer Island, WA 98040; (206) 947-5591

"The strongest reason for the people to retain the right to keep and
 bear arms is, as a last resort, to protect themselves against tyranny
 in government." --1 Thomas Jefferson Papers, 334 (C.J.Boyd, Ed.,1950)

 
 
 

Who knows popper?

Post by Bela Lubki » Fri, 27 Feb 1998 04:00:00



> I'm still fighting processor usage on one of our internet servers,
> 5.0.4 with Fast Start. All email clients are POP3 virtual domain
> types.

> cpuhog shows that popper is what's sucking cycles, and they hang
> around forever until they have the whole machine. sar shows idle
> of 0% after the machine has been up for 2-3 hours, which is obviously
> wrong, as it runs fine and is very quick. It does slow down some,
> but nothing like sar says it should be - 97% sys usage. (!)

The machine can have 0% idle and still be fast.  CPU-sucking processes
get very low priority.  Interactive processes will still seem to get the
whole machine.  If you were running some intentional CPU-hogging process
(calculating the last digit of pi...), you would notice that it was only
getting a fraction of the CPU, forced to share it with those spinning
poppers.

Quote:> This is having secondary effects, in that sendmail requires me to keep
> upping the queue trigger levels, and sometimes wedges and as to be
> restarted. I mentioned more detail on this in an earlier message.

> In any case, popper's man page mentions a -d option which pertains to
> time-to-livem but it neglects ranges or what the default might be. It
> says it gets it from a bvariable in a config file, but I can't find
> it.

I can suggest an extremely lame kludge that will at least rid you of
most of these spinning processes, while you regroup and figure out why
it's happening.  The kludge is: replace the popper binary with a shell
script which sets a CPU limit on the process:

  # cd /etc
  # mv popper popper.real
  # cat > popper
  #!/bin/ksh
  ulimit -St 10    # die after 10 seconds of CPU time

(I'm assuming that /etc/popper is the path of the binary you're
running...)

I can also suggest a diagnostic, which is likely to be effective only if
you have not put the above workaround in place.  Get scotruss from
ftp://ftp.dgii.com/users/erics/scotruss.tar.Z; get lsof from
ftp://vic.cc.purdue.edu/pub/tools/unix/lsof/.  When you see one of these
spinning popper processes, run lsof and scotruss on it:

  lsof -p1234
  scotruss -p1234

lsof will hopefully tell you what files it has open.  scotruss will show
you what system calls it's making (you'll have to interrupt it after a
while, or scotruss will faithfully tell you about the infinite number of
system calls popper is making).  If you can't make sense of the results,
someone here probably can.

Quote:> Most of these users are PPP-dialup, their ping rates are in the low 200
> ms range from server-to-client, so WHAT should popper -d be set to so
> the damned things will die before they take over the system?

> Is there some special tuning I should do to 5.0.4 since I'm running
> Fast Start on it? Regular (5.0.2 based) Fast Start 1.0 ran like a
> bear- never had these weird little problems with it.

You might try grabbing the popper binary from your 5.0.2 system...

I've seen many cases of spinning poppers, generally caused by the pop
user rebooting his Windows machine.  That was on a LAN.  Presumably
similar effects ensue if they hang up the modem without ending their pop
session.  Whatever it is, it doesn't happen every time; there are some
other enabling conditions (which I never figured out -- the LAN
situation was fixed by using a different popper binary which,
empirically, was immune to whatever the fault conditions were).

Quote:>Bela<

--
Tales of our recent world trip, http://www.armory.com/~alexia/trip/trip.html
 
 
 

Who knows popper?

Post by Darksho » Fri, 27 Feb 1998 04:00:00



> Which POP3 server are you running?  We use either ipop3d from the
> University of Washington IMAP distribution or qpopper from Qualcomm.  We
> use these at many of our ISP client sites which support thousands of e-mail
> clients on SCO OSR-5 servers without seeing any problems like this.  Both
> of these are available for download from our ftp site, ftp.celestial.com

We're using the /etc/popper that came with 5.0.4 and Fast Start. I
don't know if it's the same as was on the 5.0.2 version of Fast Start,
but that one ran fine.

What was your reason for using ipop3d instead? IMAP? Or is SCO's popper
actually broken?

I have managed to fix it, just an hour ago. At least, load is typical
and the popper isn't* out anymore than its timeout says it
should.

The fix was to add a space to the end of the command /etc/popper -T 90
in the /etc/inetd.conf.

Is this a bug or a feature? ;-)

I'll post an update later; it's almost too soon to tell. I do think
it might be fixed, though- we have about a hundred users popping mail
right now and only 3 poppers show under ps -e. Before adding the space,
we'd have 25 or so by now..

I'll check out the ipop3d, Bill, and I'd appreciate any info and
suggestions on switching to it.

'Shot

 
 
 

Who knows popper?

Post by Darksho » Fri, 27 Feb 1998 04:00:00


<much snipped>

Quote:

> I've seen many cases of spinning poppers, generally caused by the pop
> user rebooting his Windows machine.  That was on a LAN.  Presumably
> similar effects ensue if they hang up the modem without ending their pop
> session.  Whatever it is, it doesn't happen every time; there are some
> other enabling conditions (which I never figured out -- the LAN
> situation was fixed by using a different popper binary which,
> empirically, was immune to whatever the fault conditions were).

> >Bela<

Thanks, Bela- I'll check out scotruss. Sounds handy.

Anyway, in my earlier messages I mentioned the -d option as being
timeout; it's actually -T and I used the correct one. Just had a
brainlock when I was writing about it. As I mentioned in an earlier
off-thread message, adding a space to the end of the popper command
in inetd.conf seems to have fixed it. Since I did this, I've seen
it spin up to 10 poppers, but they all went away as they should have.

Bug or feature? ;-)

'Shot

 
 
 

Who knows popper?

Post by Bill Campbel » Fri, 27 Feb 1998 04:00:00




....
>We're using the /etc/popper that came with 5.0.4 and Fast Start. I
>don't know if it's the same as was on the 5.0.2 version of Fast Start,
>but that one ran fine.

>What was your reason for using ipop3d instead? IMAP? Or is SCO's popper
>actually broken?

We started using the IMAP long before SCO had a working POPPER (maybe back
in Xenix days).  I know the guys at the U.W. pretty well, and like what
they've done with IMAP, Pine, etc. which is probably why I went with it
originally.  We have one large ISP customer who had some performance
problems with ipop3d (or thought they did), and asked me to get the
Qualcomm popper running for them and they're happy with it.  I prefer using
software where the source is available so that I can fix it if necessary
(and I lifted the user authentication code from Pine to use in radius and
other programs that didn't understand SCO's methods :-).

Quote:>I have managed to fix it, just an hour ago. At least, load is typical
>and the popper isn't* out anymore than its timeout says it
>should.

>The fix was to add a space to the end of the command /etc/popper -T 90
>in the /etc/inetd.conf.

Very wierd.

We run all our inetd stuff through tcp_wrappers, generally with the timeout
option to have an external control to kill off dead Microsoft originated
processes.  It also allows us to limit access to things like ipop3d, imapd,
etc. to specific domains.

...

Quote:>I'll check out the ipop3d, Bill, and I'd appreciate any info and
>suggestions on switching to it.

You can grab the tarball off our system, install using or normal procedures
(it goes into /usr/local/sbin), modify /etc/inetd.conf, then:

        kill -HUP `cat /etc/inetd.pid'

The imap programs insert a dummy message in each mailbox as a place holder
to allow them to see what the last message they've read is.  This can cause
some gripes by people who read mail locally as well as from POP clients.

The imap programs understand both MMDF and standard mailbox formats.  THe
version I've compiled default to standard instead of MMDF which only has an
effect if they find an empty mailbox.

Bill
--

UUCP:               camco!bill  PO Box 820; 2835 82nd Avenue S.E. S-100
FAX:            (206) 232-9186  Mercer Island, WA 98040-0820; (206) 236-1676
URL: http://www.veryComputer.com/

It is necessary for the welfare of society that genius should be
privileged to utter sedition, to blaspheme, to outrage good taste, to
corrupt the youthful mind, and generally to scandalize one's uncles.
                -- George Bernard Shaw

 
 
 

Who knows popper?

Post by Bela Lubki » Sun, 01 Mar 1998 04:00:00




> > I've seen many cases of spinning poppers, generally caused by the pop
> > user rebooting his Windows machine.  That was on a LAN.  Presumably
> > similar effects ensue if they hang up the modem without ending their pop
> > session.  Whatever it is, it doesn't happen every time; there are some
> > other enabling conditions (which I never figured out -- the LAN
> > situation was fixed by using a different popper binary which,
> > empirically, was immune to whatever the fault conditions were).
> Thanks, Bela- I'll check out scotruss. Sounds handy.

> Anyway, in my earlier messages I mentioned the -d option as being
> timeout; it's actually -T and I used the correct one. Just had a
> brainlock when I was writing about it. As I mentioned in an earlier
> off-thread message, adding a space to the end of the popper command
> in inetd.conf seems to have fixed it. Since I did this, I've seen
> it spin up to 10 poppers, but they all went away as they should have.

> Bug or feature? ;-)

Distraction.  You must have changed something else which fixed the
problem.  I just verified that inetd sends exactly the same arguments to
the called program, whether or not there is a trailing space on the line
in inetd.conf.  Well, I suppose it's vaguely possible that popper goes
looking for its own line in inetd.conf, but that's extremely unlikely.

Change it back and it'll keep working cleanly (unless you've by now
discovered that it isn't really fixed...)

Quote:>Bela<

--
Tales of our recent world trip, http://www.armory.com/~alexia/trip/trip.html
 
 
 

1. X-Windows (yea, I know, I know)

I have a strawberry i-mac 266. Runing LinuxPPC v. 4. I've followed the imac
PPC setup to a 't' and everything but x-windows is fine. I have
"video=atyfb:vmode:17" in bootx, but have X-windows to startup when I use
the startx command, else I get the infamous "disco X-windows" effect.
Anyway, when I go to start kde, the following error comes up. I redirected
it to a file and it is as follows:
-=-=-=-=-=-=-=-=-
-=-=-=-=-=-=-=-=-

Any thoughts, theories or (oh what joy) solutions would be _GREATLY_
appreciated, and my be rewarded with candy. tia. =)
Oh, cc: a copy to my email (below) if you could, It would be apprecaited.

2. Sendmail help

3. the WinTroll formerly known as "Taylor" is now known as "GERRI"

4. Sun TCP LFN (Long Fat Network) Patch

5. The schizophrenic formerly known as "GERRI" is now known as "Depardeau"

6. Example Solaris Certfication Exams

7. Wanna know ways to know all about the Solaris...

8. PPP Configuration (modem) messed up by Minicom??

9. rlogin (I know I know but we have to use it)

10. 3com 3c590b (I know, I know...) - problem

11. can I know the Can I know the battery power remind without apmd?

12. 386BSD (I know... I know)

13. to know DOS is to know Unix?