File corrupting bug in kernel 2.2.19 as well as 2.2.20 ?

File corrupting bug in kernel 2.2.19 as well as 2.2.20 ?

Post by Olive » Fri, 31 May 2002 19:40:09



hi everybody,

i have experienced strange happenings on the internet server in our LAN
here.

first of all:
the machine (quite old ;) ) is a pentium 120 MHz, 40 MB RAM, with two
harddisks (for the models please see below), one cdrom, four network
adapters (three pci and one isa) and a mainboard with VIA chipset (see
below as well). it is running on debian linux potato 2.2 rev.4 (which was
being shipped with kernel 2.2.19 back when i got it).

the issue:
it has happened maybe four times in a period of two months that the machine
had remounted the root fs (ext2) in ro-mode. that indicated that at least
one error had occurred, and then the system decided to remount ro cause
thats what fstab tells it to do in case of an error. running fsck
afterwards would find a lot of messy things in the filesystem (see below
as well). what i found occasionaly after such an "event" was that some
files seemed to be corrupted (e.g. /etc/apache/httpd.conf,
/var/lib/dpkg/available and others). those files had some parts replaced

were only some parts REPLACED in these files, the filelength had NOT
changed). thats not too funny for a running server as you can imagine ;) .

well anyway, what i have found out so far is, that this mess seems to have
occured always at the same time of day, which is, when the cron.daily
scripts were being run by the cron daemon in the morning at 6:25 am. and i
dont think the problem is being caused by the hardware (which i thought at
first) because i changed the (root-) harddisk, the mainboard from
INTEL-chipset to VIA, the RAM and even the IDE cable on the primary ide
port but the problem still persisted. so i believe now it might be a
problem of the kernel. i have tried both 2.2.19 and 2.2.20, but not 2.2.21
yet. in 2.2.19 and 2.2.20 the problem seems to be the same.

a (likely) special issues of this machine are that the cron job, when
working on the cron.daily-scripts might consume all the RAM (which is only
40 MB and there is not much available without the cronjobs anyway) and
then swapping starts and also the cronjobs start (which are quite many in
a debian distribution in /etc/cron.daily), so might there be a problem in
the VM concerning swapping while lots of jobs are running ?

maybe someone knows something about it ;)

thanks,

oliver

ps: for now i have out-commented the cron.daily stuff in /etc/crontab and
since then nothing has happened anymore, but of course this can only be a
temporary solution.

+++

Linux schlumpf 2.2.20 #1 SMP Fri May 10 00:18:33 CEST 2002 i586 unknown
+++

+++ about the installed cron package +++

Package: cron
Status: install ok installed
Priority: important
Section: admin
Installed-Size: 121

Version: 3.0pl1-57.3
Depends: libc6 (>= 2.1.2), bsdutils, debianutils (>= 1.7)
Recommends: smail | sendmail | mail-transport-agent
Suggests: anacron (>= 2.0-1), logrotate, lockfile-progs
+++

+++ content of /proc/pci +++
PCI devices found:
  Bus  0, device   0, function  0:
    Host bridge: VIA Technologies VT 82C585 Apollo VP1/VPX (rev 2).
      Medium devsel.  Fast back-to-back capable.  Master Capable.  
Latency=32.
  Bus  0, device   7, function  0:
    ISA bridge: VIA Technologies VT 82C586 Apollo ISA (rev 0).
      Medium devsel.  Master Capable.  No bursts.
  Bus  0, device   7, function  1:
    IDE interface: VIA Technologies VT 82C586 Apollo IDE (rev 2).
      Medium devsel.  Fast back-to-back capable.  Master Capable.  
Latency=32.
      I/O at 0x6000 [0x6001].
      Non-prefetchable 32 bit memory at 0xe0800000 [0xe0800000].
  Bus  0, device   8, function  0:
    Ethernet controller: Realtek 8029 (rev 0).
      Medium devsel.  IRQ 11.
      I/O at 0x6100 [0x6101].
  Bus  0, device   9, function  0:
    Ethernet controller: Realtek 8029 (rev 0).
      Medium devsel.  IRQ 10.
      I/O at 0x6200 [0x6201].
  Bus  0, device  10, function  0:
    VGA compatible controller: ARK Logic 2000MT (rev 0).
      Medium devsel.  Fast back-to-back capable.
      Prefetchable 32 bit memory at 0xe0000000 [0xe0000008].
  Bus  0, device  11, function  0:
    Ethernet controller: Winbond NE2000-PCI (rev 0).
      Medium devsel.  Fast back-to-back capable.  IRQ 9.
      I/O at 0x6300 [0x6301].
+++

+++

ide-cdrom version 4.58
ide-disk version 1.08
+++

+++

QUANTUM BIGFOOT1280A (root fs, ext2)
+++

+++

QUANTUM FIREBALL ST3.2A (only for ftp, ext2)
+++

+++

TOSHIBA CD-ROM XM-5602B
+++

+++ this is what fsck said (sorry, quite long, so i shortened it a bit) +++
+++ (if you want the complete log, just tell me) +++
schlumpf:/home/david# fsck.ext2 /dev/hda3
e2fsck 1.18, 11-Nov-1999 for EXT2 FS 0.5b, 95/08/09
/dev/hda3 contains a file system with errors, check forced.
Pass 1: Checking inodes, blocks, and sizes
Deleted inode 19958 has zero dtime.  Fix<y>? yes

Deleted inode 22468 has zero dtime.  Fix<y>? yes

Deleted inode 22469 has zero dtime.  Fix<y>? yes

Deleted inode 66427 has zero dtime.  Fix<y>? yes

Pass 2: Checking directory structure
Directory inode 20350, block 0, offset 2556: directory corrupted
Salvage<y>? yes

Directory inode 20351, block 0, offset 0: directory corrupted
Salvage<y>? yes

Missing '.' in directory inode 20351.
Fix<y>? yes

Setting filetype for entry '.' in ??? (20351) to 2.
Missing '..' in directory inode 20351.
Fix<y>? yes

Setting filetype for entry '..' in ??? (20351) to 2.

Pass 3: Checking directory connectivity
Unconnected directory inode 4949 (/var/spool/squid/06/???)
Connect to /lost+found<y>? yes

[... some more of the previous message ...]

Unconnected directory inode 4953 (/var/spool/squid/06/???)
Connect to /lost+found<y>? yes

'..' in /var/spool/squid/06/08 (20351) is <The NULL inode> (0), should be
/var/spool/squid/06 (20350).
Fix<y>? yes

Unconnected directory inode 20374 (/var/spool/squid/06/???)
Connect to /lost+found<y>? yes

[... many more of the previous message ...]

Unconnected directory inode 128337 (/var/spool/squid/06/???)
Connect to /lost+found<y>? yes

Pass 4: Checking reference counts
Inode 2 ref count is 19, should be 20.  Fix<y>? yes

Inode 4949 ref count is 3, should be 2.  Fix<y>? yes

[... many many more of the previous message ...]

Inode 128336 ref count is 3, should be 2.  Fix<y>? yes

Inode 128337 ref count is 3, should be 2.  Fix<y>? yes

Pass 5: Checking group summary information
Block bitmap differences:  -12203 -12204 -12205 -12206 -41547 -41548 -41549
-41550 -41551 -41552 -41553 -61786 -61787 -276132 -276133 -276134 -276135
-276136 -276137 -276138 -276140 -276141 -276142 -276143 -276144 -276145
-276146 -276148 -276149 -276150 -276151 -276152 -276153 -276154 -276156
-276157 -276158 -276159 -276160 -276161 -276162
Fix<y>? yes

Free blocks count wrong for group #0 (655, counted=659).
Fix<y>? yes

Free blocks count wrong for group #1 (4203, counted=4212).
Fix<y>? yes

Free blocks count wrong for group #8 (1513, counted=1541).
Fix<y>? yes

Free blocks count wrong (81341, counted=81382).
Fix<y>? yes

Inode bitmap differences:  -19958 -22468 -22469 -66427
Fix<y>? yes

Free inodes count wrong for group #1 (8347, counted=8350).
Fix<y>? yes

Free inodes count wrong for group #4 (8363, counted=8364).
Fix<y>? yes

Free inodes count wrong (75148, counted=75152).
Fix<y>? yes

/dev/hda3: ***** FILE SYSTEM WAS MODIFIED *****
/dev/hda3: 63664/138816 files (1.1% non-contiguous), 195818/277200 blocks
+++

--
Tomorrow will be canceled due to lack of interest.

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in

More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

 
 
 

File corrupting bug in kernel 2.2.19 as well as 2.2.20 ?

Post by Oliver Wegne » Fri, 31 May 2002 19:50:10


sorry,

that i did not have my complete name in the mail-header ;) didnt intend to
hide it from you, neither did i intend to ignore the netiquette. hope you
got my name now...

Oliver Wegner

--
"We'll cross out that bridge when we come back to it later."

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in

More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

 
 
 

File corrupting bug in kernel 2.2.19 as well as 2.2.20 ?

Post by Alan Co » Fri, 31 May 2002 20:10:08



> files seemed to be corrupted (e.g. /etc/apache/httpd.conf,
> /var/lib/dpkg/available and others). those files had some parts replaced

> were only some parts REPLACED in these files, the filelength had NOT
> changed). thats not too funny for a running server as you can imagine ;)

16 or 32 byte long chunks ?

.

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in

More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

 
 
 

File corrupting bug in kernel 2.2.19 as well as 2.2.20 ?

Post by Oliver Wegne » Fri, 31 May 2002 22:00:12


> 16 or 32 byte long chunks ?

much longer. see the excerpts of two example files below. the corrupted
data chunks seem to be of a length of 4096 (0x1000). see excerpt of
/var/lib/dpkg/status.

it seems that it not only are 0x00 bytes (as i stated before) but also
other byte values. but the 0x00 bytes are dominating though.

looks like if some memory content found its way onto disk, although it
should have stayed in RAM ;)

note concerning /var/lib/dpkg/status:
this excerpt is from somewhere in the middle of the file and the corruption
seems to start with "tc/cron.sh/ddupcron.sh" and ends right before "us:
purge. ok. not-installed.". the length of the corrupted chunk is 0x1000
bytes.

note concerning /etc/apache/httpd.conf:
the corruption in this case starts right in the beginning of the file
(which might be just the continuation of the corruption of a previous
damaged file). and after 2000-something bytes the file continues with the
normal content.

the excerpts of the files follow. if you need more example or the whole
stuff in hex, please write me.

thanks :)

oliver

+++ excerpt of file /var/lib/dpkg/status+++
0000:0000 [... beginning of /var/lib/dpkg/status ...]..Package: gilt.Statu
0000:0040 s: purge ok not-installed.Priority: optional.Section: devel..Pac
0000:0080 kage: perfotc/cron.sh/ddupcron.sh wilmskamp.dyndns.org).........
0000:00c0 ................................................................
0000:0100 ................................................................
0000:0140 ................................................................
0000:0180 ................................................................
0000:01c0 ................................................................
0000:0200 ................................................................
0000:0240 ................................................................
0000:0280 ................................................................
0000:02c0 ................................................................
0000:0300 ................................................................
0000:0340 ................................................................
0000:0380 ................................................................
0000:03c0 ................................................................
0000:0400 ................................................................
0000:0440 ................................................................
0000:0480 ................................................................
0000:04c0 ................................................................
0000:0500 ................................................................
0000:0540 ................................................................
0000:0580 ................................................................
0000:05c0 ................................................................
0000:0600 ................................................................
0000:0640 ................................................................
0000:0680 ................................................................
0000:06c0 ................................................................
0000:0700 ................................................................
0000:0740 ................................................................
0000:0780 ................................................................
0000:07c0 ................................................................
0000:0800 ................................................................
0000:0840 ................................................................
0000:0880 ................................................................
0000:08c0 ................................................................
0000:0900 ................................................................
0000:0940 ................................................................
0000:0980 ................................................................
0000:09c0 ................................................................
0000:0a00 ................................................................
0000:0a40 ................................................................
0000:0a80 ................................................................
0000:0ac0 ................................................................
0000:0b00 ................................................................
0000:0b40 ................................................................
0000:0b80 ................................................................
0000:0bc0 ................................................................
0000:0c00 ................................................................
0000:0c40 ................................................................
0000:0c80 ................................................................
0000:0cc0 ................................................................
0000:0d00 ................................................................
0000:0d40 ................................................................
0000:0d80 ................................................................
0000:0dc0 ................................................................
0000:0e00 ................................................................
0000:0e40 ................................................................
0000:0e80 ................................................................
0000:0ec0 ................................................................
0000:0f00 ................................................................
0000:0f40 ................................................................
0000:0f80 ................................................................
0000:0fc0 ................................................................
0000:1000 ................................................................
0000:1040 ................................................................
0000:1080 ...........us: purge ok not-installed.Priority: extra.Section: x
0000:10c0 11..Package: zephyr-clients.Status: purge ok not-installed.Prior
0000:1100 ity: optional.Section: net..[... end of /var/lib/dpkg/status ...
0000:1140 ].
+++ end /var/lib/dpkg/status +++

+++ excerpt of file /etc/apache/httpd.conf +++
0000:0000 ........u?<..%...................top.........................
0000:0040 ........w?<.............a.........date........................
0000:0080 ........u?<....D......4...........sh..........................
0000:00c0 ........u?<..........2.?.........sh..........................
0000:0100 ........u?<.......................cron........................
0000:0140 ................................................................
0000:0180 ................................................................
0000:01c0 ................................................................
0000:0200 ................................................................
0000:0240 ................................................................
0000:0280 ................................................................
0000:02c0 ................................................................
0000:0300 ................................................................
0000:0340 ................................................................
0000:0380 ................................................................
0000:03c0 ................................................................
0000:0400 ................................................................
0000:0440 ................................................................
0000:0480 ................................................................
0000:04c0 ................................................................
0000:0500 ................................................................
0000:0540 ................................................................
0000:0580 ................................................................
0000:05c0 ................................................................
0000:0600 ................................................................
0000:0640 ................................................................
0000:0680 ................................................................
0000:06c0 ................................................................
0000:0700 ................................................................
0000:0740 ................................................................
0000:0780 ................................................................
0000:07c0 ................................................................
0000:0800 ................................................................
0000:0840 ................................................................
0000:0880 ................................................................
0000:08c0 ................................................................
0000:0900 ................................................................
0000:0940 ................................................................
0000:0980 ................................................................
0000:09c0 ................................................................
0000:0a00 mod_log_config_ssl.so.# LoadModule mime_magic_module /usr/lib/ap
0000:0a40 ache/1.3/mod_mime_magic.so..[... normal httpd.conf ...].
+++ end /etc/apache/httpd.conf +++

--
T:      One big monster, he called TROLL.
        He don't rock, and he don't roll;
        Drink no wine, and smoke no stogies.
        He just Love To Eat Them Roguies.
                -- The Roguelet's ABC

-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the ...

read more »

 
 
 

1. Kernel 2.2.19 or 2.2.20?

Hello list.

I use two machines with Suse Linux 7.0. For the moment I use the kernel
2.2.19. The machines are use for firewall and proxy. What are advantages
of 2.2.20. Is it stable as 2.2.19. For machines are not updated for 1
year.

Thanks in advance.

Best regards.

Dirk Emmermacher

2. Linux partitions

3. Error from kernel(2.2.19 to 2.2.20) in use "make dep"

4. zsh as most powerful shell

5. zimage/bzimage changes between kernel 2.2.19 and 2.2.20

6. WWW rectriction router??

7. 2.2.19 + ide 2.2.19 03252001 patch problem

8. Genoa Phantom 64bit 2M xconfig problem

9. bug in kernel 2.2.19

10. 2.2.19/ide.03252001 bug: "kernel timer added twice"

11. kernel 2.2.19 bug

12. Linux Kernel 2.2.19 Available Memory Bug

13. 2.4.19pre3 hangs after enabling machine check; 2.2.20 was fine