Thread: [SSI-devel] before it crashes...
Brought to you by:
brucewalker,
rogertsang
From: Valery A.K. <va...@bi...> - 2004-04-30 07:17:44
|
Hi devels, i just have come and see my master node's (Dual CPU) 100% busy. `top' shows that processes are changing it others to take 99 % of CPU for about 20sec then comes the next process. The processes are however quite usual and relatively light. Just for instance: magicdev, gdmgreeter, metacity, rcd, gnome-session, ... slabinfo and meminfo are attached to this mail. -- Valery |
From: Valery A.K. <va...@bi...> - 2004-04-30 07:43:39
|
I have forgotten to say that 1. my RedHat9 cluster was and is idleing 2. the 99% CPU time spent is _system_ time: ---------------- top of my top --------------------------- 09:43:17 up 3 days, 23:59, 1 user, load average: 4.95, 7.27, 15.94 43 processes: 38 sleeping, 5 running, 0 zombie, 0 stopped CPU0 states: 0.0% user 101.0% system 0.0% nice 0.0% iowait 0.0% idle CPU1 states: 0.0% user 97.0% system 0.0% nice 0.0% iowait 2.0% idle Mem: 1025088k av, 1004244k used, 20844k free, 0k shrd, 2692k buff 86020k actv, 2432k in_d, 2232k in_c Swap: 2819328k av, 3000k used, 2816328k free 90272k cached PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME CPU COMMAND 1 root 25 0 220 188 140 R 99.9 0.0 19:47 1 init 83305 gdm 20 0 18272 17M 6216 R 99.9 1.7 4:21 1 gdmgreeter 83294 root 15 0 16720 8268 1904 S 3.9 0.8 1:04 0 X 66824 root 25 0 244 92 0 S 1.3 0.0 6:11 0 sshd 83219 vak 15 0 476 476 96 S 0.0 0.0 0:00 0 bash 66580 root 15 0 56 44 0 S 0.0 0.0 0:00 1 klogd 67621 root 39 19 676 384 236 R N 0.0 0.0 2:30 0 cupsd 83253 root 17 0 292 292 124 S 0.0 0.0 0:00 0 su ---------------- cut --------------------------- |
From: John B. <joh...@hp...> - 2004-04-30 15:50:08
|
Valery A.Khamenya wrote: > Hi devels, > > i just have come and see my master node's (Dual CPU) 100% busy. > `top' shows that processes are changing it others to take 99 % > of CPU for about 20sec then comes the next process. The processes > are however quite usual and relatively light. Just for instance: > magicdev, gdmgreeter, metacity, rcd, gnome-session, ... > > slabinfo and meminfo are attached to this mail. > > -- > Valery Thanks for the slabinfo. From the looks of it, we're leaking something between 64 and 128 bytes in size. I'll see what I can find. John > > > ------------------------------------------------------------------------ > > slabinfo - version: 1.1 (SMP) > kmem_cache 80 80 244 5 5 1 : 252 126 > ip_fib_hash 112 112 32 1 1 1 : 252 126 > ip_vs_conn 0 0 128 0 0 1 : 252 126 > clip_arp_cache 0 0 128 0 0 1 : 252 126 > ip_mrt_cache 0 0 128 0 0 1 : 252 126 > tcp_tw_bucket 270 270 128 9 9 1 : 252 126 > tcp_bind_bucket 336 336 32 3 3 1 : 252 126 > tcp_open_request 270 270 128 9 9 1 : 252 126 > inet_peer_cache 116 116 64 2 2 1 : 252 126 > ip_dst_cache 300 300 256 20 20 1 : 252 126 > arp_cache 60 60 128 2 2 1 : 252 126 > blkdev_requests 4110 4110 128 137 137 1 : 252 126 > nfs_write_data 106 230 384 15 23 1 : 124 62 > nfs_read_data 96 220 384 14 22 1 : 124 62 > nfs_page 168 420 128 9 14 1 : 252 126 > devfsd_event 126 166 20 1 1 1 : 252 126 > ext2_xattr 0 0 44 0 0 1 : 252 126 > journal_head 280 2926 48 4 38 1 : 252 126 > revoke_table 126 250 12 1 1 1 : 252 126 > revoke_record 308 560 32 5 5 1 : 252 126 > ext3_xattr 0 0 44 0 0 1 : 252 126 > dnotify_cache 166 166 20 1 1 1 : 252 126 > file_lock_cache 120 120 96 3 3 1 : 252 126 > fasync_cache 200 200 16 1 1 1 : 252 126 > uid_cache 224 224 32 2 2 1 : 252 126 > skbuff_head_cache 453 705 256 31 47 1 : 252 126 > sock 342 462 1408 32 42 4 : 60 30 > sigqueue 261 261 132 9 9 1 : 252 126 > kiobuf 0 0 64 0 0 1 : 252 126 > cdev_cache 260 638 64 8 11 1 : 252 126 > bdev_cache 454 580 64 10 10 1 : 252 126 > mnt_cache 30 30 128 1 1 1 : 252 126 > inode_cache 2260 5648 512 706 706 1 : 124 62 > dentry_cache 2088 9450 128 315 315 1 : 252 126 > dquot 0 0 128 0 0 1 : 252 126 > filp 3150 3150 128 105 105 1 : 252 126 > names_cache 63 63 4096 63 63 1 : 60 30 > buffer_head 17073 74025 108 537 2115 1 : 252 126 > mm_struct 330 330 256 22 22 1 : 252 126 > vm_area_struct 4530 6420 128 159 214 1 : 252 126 > fs_cache 348 348 64 6 6 1 : 252 126 > files_cache 196 196 512 28 28 1 : 124 62 > signal_cache 290 290 64 5 5 1 : 252 126 > sighand_cache 176 176 1408 16 16 4 : 60 30 > task_struct 0 0 2048 0 0 1 : 60 30 > pte_chain 846 10170 128 38 339 1 : 252 126 > size-131072(DMA) 0 0 131072 0 0 32 : 0 0 > size-131072 0 0 131072 0 0 32 : 0 0 > size-65536(DMA) 0 0 65536 0 0 16 : 0 0 > size-65536 1 2 65536 1 2 16 : 0 0 > size-32768(DMA) 0 0 32768 0 0 8 : 0 0 > size-32768 1 5 32768 1 5 8 : 0 0 > size-16384(DMA) 0 0 16384 0 0 4 : 0 0 > size-16384 2 6 16384 2 6 4 : 0 0 > size-8192(DMA) 0 0 8192 0 0 2 : 0 0 > size-8192 3 22 8192 3 22 2 : 0 0 > size-4096(DMA) 0 0 4096 0 0 1 : 60 30 > size-4096 134 134 4096 134 134 1 : 60 30 > size-2048(DMA) 0 0 2048 0 0 1 : 60 30 > size-2048 100 220 2048 60 110 1 : 60 30 > size-1024(DMA) 0 0 1024 0 0 1 : 124 62 > size-1024 364 364 1024 91 91 1 : 124 62 > size-512(DMA) 0 0 512 0 0 1 : 124 62 > size-512 380 504 512 50 63 1 : 124 62 > size-256(DMA) 0 0 256 0 0 1 : 252 126 > size-256 166194 330750 256 22036 22050 1 : 252 126 > size-128(DMA) 0 0 128 0 0 1 : 252 126 > size-128 5478930 5478930 128 182631 182631 1 : 252 126 > size-64(DMA) 0 0 128 0 0 1 : 252 126 > size-64 936 5220 128 60 174 1 : 252 126 > size-32(DMA) 0 0 64 0 0 1 : 252 126 > size-32 333730 509878 64 8785 8791 1 : 252 126 > > > ------------------------------------------------------------------------ > > total: used: free: shared: buffers: cached: > Mem: 1049690112 1040424960 9265152 0 2658304 123310080 > Swap: 2886991872 104660992 2782330880 > MemTotal: 1025088 kB > MemFree: 9048 kB > MemShared: 0 kB > Buffers: 2596 kB > Cached: 77352 kB > SwapCached: 43068 kB > Active: 101820 kB > ActiveAnon: 43704 kB > ActiveCache: 58116 kB > Inact_dirty: 2432 kB > Inact_laundry: 20620 kB > Inact_clean: 2308 kB > Inact_target: 25436 kB > HighTotal: 131056 kB > HighFree: 1536 kB > LowTotal: 894032 kB > LowFree: 7512 kB > SwapTotal: 2819328 kB > SwapFree: 2717120 kB |