i just wanted to report that the memory requirements of the software are not enough for 254 simultaneous discovery processes.
We are trying to find out how high you can go with 2G of Ram plus 2G of Swap; as currently the server runs out of memory.
I will report this as soon as I have this information.
We were able to circumvent the problem by invoking the script using the -L parameter in order to split the amount of data being loaded into the script.
The memory hogging issues no longer appear, however i think there must be a leak somewhere because I don't understand how can such process need so much memory.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Hello all,
i just wanted to report that the memory requirements of the software are not enough for 254 simultaneous discovery processes.
We are trying to find out how high you can go with 2G of Ram plus 2G of Swap; as currently the server runs out of memory.
I will report this as soon as I have this information.
Jun 11 09:20:44 esba-ipam-ip kernel: ip_update_gesti invoked oom-killer: gfp_mask=0x200da, order=0, oom_score_adj=0
Jun 11 09:20:45 esba-ipam-ip kernel: ip_update_gesti cpuset=/ mems_allowed=0
Jun 11 09:20:45 esba-ipam-ip kernel: CPU: 0 PID: 8557 Comm: ip_update_gesti Not tainted 3.10.0-327.10.1.el7.x86_64 #1
Jun 11 09:20:45 esba-ipam-ip kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
Jun 11 09:20:45 esba-ipam-ip kernel: ffff880006f8c500 00000000e31b1b71 ffff880004e8fa68 ffffffff816352cc
Jun 11 09:20:45 esba-ipam-ip kernel: ffff880004e8faf8 ffffffff8163026c ffff880079c209f0 ffff880079c20a08
Jun 11 09:20:45 esba-ipam-ip kernel: ffffffff00000206 fffeefff00000000 0000000000000002 ffffffff81128903
Jun 11 09:20:45 esba-ipam-ip kernel: Call Trace:
Jun 11 09:20:45 esba-ipam-ip kernel: [<ffffffff816352cc>] dump_stack+0x19/0x1b
Jun 11 09:20:45 esba-ipam-ip kernel: [<ffffffff8163026c>] dump_header+0x8e/0x214
Jun 11 09:20:45 esba-ipam-ip kernel: [<ffffffff81128903>] ? delayacct_end+0x73/0xb0
Jun 11 09:20:45 esba-ipam-ip kernel: [<ffffffff8116cebe>] oom_kill_process+0x24e/0x3b0
Jun 11 09:20:46 esba-ipam-ip kernel: [<ffffffff8116d6e6>] out_of_memory+0x4b6/0x4f0
Jun 11 09:20:46 esba-ipam-ip kernel: [<ffffffff811738c5>] alloc_pages_nodemask+0xa95/0xb90
Jun 11 09:20:46 esba-ipam-ip kernel: [<ffffffff811b798a>] alloc_pages_vma+0x9a/0x140
Jun 11 09:20:46 esba-ipam-ip kernel: [<ffffffff81194975>] do_wp_page+0xd5/0x800
Jun 11 09:20:46 esba-ipam-ip kernel: [<ffffffff811a9c2d>] ? swap_info_get+0x5d/0xe0
Jun 11 09:20:46 esba-ipam-ip kernel: [<ffffffff811971fc>] handle_mm_fault+0x65c/0xf50
Jun 11 09:20:46 esba-ipam-ip kernel: [<ffffffff81640f40>] do_page_fault+0x150/0x450
Jun 11 09:20:47 esba-ipam-ip kernel: [<ffffffff81641263>] do_page_fault+0x23/0x80
Jun 11 09:20:47 esba-ipam-ip kernel: [<ffffffff8163d4c8>] page_fault+0x28/0x30
Jun 11 09:20:47 esba-ipam-ip kernel: Mem-Info:
Jun 11 09:20:47 esba-ipam-ip kernel: Node 0 DMA per-cpu:
Jun 11 09:20:47 esba-ipam-ip kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jun 11 09:20:47 esba-ipam-ip kernel: Node 0 DMA32 per-cpu:
Jun 11 09:20:47 esba-ipam-ip kernel: CPU 0: hi: 186, btch: 31 usd: 30
Jun 11 09:20:47 esba-ipam-ip kernel: active_anon:315467 inactive_anon:105836 isolated_anon:0#012 active_file:89 inactive_file:90 isolated_file:13#012 unevictable:0 dirty:0 writeback:6 unstable:0#012 free:13063 slab_reclaimable:4209 slab_unreclaimable:10844#012 mapped:38 shmem:12 pagetables:12401 bounce:0#012 free_cma:0
Jun 11 09:20:47 esba-ipam-ip kernel: Node 0 DMA free:7664kB min:380kB low:472kB high:568kB active_anon:3648kB inactive_anon:3876kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:0kB dirty:0kB writeback:0kB mapped:44kB shmem:44kB slab_reclaimable:56kB slab_unreclaimable:300kB kernel_stack:16kB pagetables:280kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Jun 11 09:20:47 esba-ipam-ip kernel: lowmem_reserve[]: 0 1823 1823 1823
Jun 11 09:20:47 esba-ipam-ip kernel: Node 0 DMA32 free:44588kB min:44672kB low:55840kB high:67008kB active_anon:1258220kB inactive_anon:419468kB active_file:356kB inactive_file:360kB unevictable:0kB isolated(anon):0kB isolated(file):52kB present:2080704kB managed:1868604kB mlocked:0kB dirty:0kB writeback:24kB mapped:108kB shmem:4kB slab_reclaimable:16780kB slab_unreclaimable:43076kB kernel_stack:4448kB pagetables:49324kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:2164 all_unreclaimable? yes
Jun 11 09:20:47 esba-ipam-ip kernel: lowmem_reserve[]: 0 0 0 0
Jun 11 09:20:48 esba-ipam-ip kernel: Node 0 DMA: 24kB (UM) 58kB (UEM) 616kB (UEM) 1132kB (UEM) 664kB (UM) 1128kB (E) 6256kB (UEM) 4512kB (EM) 11024kB (E) 12048kB (R) 04096kB = 7664kB
Jun 11 09:20:48 esba-ipam-ip kernel: Node 0 DMA32: 16714kB (UE) 7708kB (UEM) 57416kB (UEM) 13332kB (UEM) 4664kB (UE) 36128kB (UEM) 2256kB (U) 0512kB 01024kB 32048kB (M) 14096kB (R) = 44588kB
Jun 11 09:20:48 esba-ipam-ip kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Jun 11 09:20:48 esba-ipam-ip kernel: 50567 total pagecache pages
Jun 11 09:20:48 esba-ipam-ip kernel: 50350 pages in swap cache
Jun 11 09:20:48 esba-ipam-ip kernel: Swap cache stats: add 242649728, delete 242599378, find 306212053/330275327
Jun 11 09:20:48 esba-ipam-ip kernel: Free swap = 0kB
Jun 11 09:20:48 esba-ipam-ip kernel: Total swap = 1679356kB
Jun 11 09:20:48 esba-ipam-ip kernel: 524174 pages RAM
Jun 11 09:20:48 esba-ipam-ip kernel: 0 pages HighMem/MovableOnly
Jun 11 09:20:48 esba-ipam-ip kernel: 53046 pages reserved
Jun 11 09:20:48 esba-ipam-ip kernel: [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
Jun 11 09:20:48 esba-ipam-ip kernel: [ 496] 0 496 48667 0 30 394 0 lvmetad
Jun 11 09:20:48 esba-ipam-ip kernel: [ 512] 0 512 11567 0 22 583 -1000 systemd-udevd
Jun 11 09:20:48 esba-ipam-ip kernel: [ 592] 0 592 12796 0 25 118 -1000 auditd
Jun 11 09:20:48 esba-ipam-ip kernel: [ 615] 0 615 90286 0 70 491 0 rsyslogd
Jun 11 09:20:48 esba-ipam-ip kernel: [ 617] 70 617 7552 19 19 58 0 avahi-daemon
Jun 11 09:20:48 esba-ipam-ip kernel: [ 618] 0 618 112503 0 71 498 0 NetworkManager
Jun 11 09:20:48 esba-ipam-ip kernel: [ 623] 81 623 25682 46 19 115 -900 dbus-daemon
Jun 11 09:20:48 esba-ipam-ip kernel: [ 624] 70 624 7521 0 18 60 0 avahi-daemon
Jun 11 09:20:48 esba-ipam-ip kernel: [ 631] 38 631 6822 21 18 129 0 ntpd
Jun 11 09:20:48 esba-ipam-ip kernel: [ 637] 0 637 7124 6 17 77 0 systemd-logind
Jun 11 09:20:48 esba-ipam-ip kernel: [ 645] 0 645 31583 1 18 158 0 crond
Jun 11 09:20:49 esba-ipam-ip kernel: [ 647] 0 647 13265 0 30 150 0 wpa_supplicant
Jun 11 09:20:49 esba-ipam-ip kernel: [ 648] 0 648 27508 1 9 31 0 agetty
Jun 11 09:20:49 esba-ipam-ip kernel: [ 650] 999 650 132388 0 55 1649 0 polkitd
Jun 11 09:20:49 esba-ipam-ip kernel: [ 873] 0 873 20638 0 43 215 -1000 sshd
Jun 11 09:20:49 esba-ipam-ip kernel: [ 874] 0 874 66178 24 130 673 0 /usr/sbin/httpd
Jun 11 09:20:49 esba-ipam-ip kernel: [ 875] 0 875 138290 79 88 3076 0 tuned
Jun 11 09:20:49 esba-ipam-ip kernel: [ 881] 995 881 11619 0 27 171 0 nrpe
Jun 11 09:20:49 esba-ipam-ip kernel: [ 882] 65 882 113047 0 54 779 0 nslcd
Jun 11 09:20:49 esba-ipam-ip kernel: [ 1032] 27 1032 28314 0 12 80 0 mysqld_safe
Jun 11 09:20:49 esba-ipam-ip kernel: [ 1548] 0 1548 22783 1 43 285 0 master
Jun 11 09:20:49 esba-ipam-ip kernel: [ 1565] 89 1565 23351 1 45 296 0 qmgr
Jun 11 09:20:49 esba-ipam-ip kernel: [ 2285] 48 2285 70924 1 140 1430 0 /usr/sbin/httpd
Jun 11 09:20:49 esba-ipam-ip kernel: [ 2477] 48 2477 71106 1 140 1600 0 /usr/sbin/httpd
Jun 11 09:20:49 esba-ipam-ip kernel: [ 2480] 48 2480 70966 1 140 1485 0 /usr/sbin/httpd
Jun 11 09:20:49 esba-ipam-ip kernel: [ 2855] 0 2855 58933 104 69 1582 0 snmpd
Jun 11 09:20:49 esba-ipam-ip kernel: [16960] 48 16960 71106 1 140 1603 0 /usr/sbin/httpd
Jun 11 09:20:49 esba-ipam-ip kernel: [25546] 0 25546 9204 10 20 73 0 systemd-journal
Jun 11 09:20:49 esba-ipam-ip kernel: [14210] 0 14210 62278 90 64 418 0 vmtoolsd
Jun 11 09:20:49 esba-ipam-ip kernel: [25490] 27 25490 294853 82 114 26609 0 mysqld
Jun 11 09:20:50 esba-ipam-ip kernel: [10307] 48 10307 67420 1 131 1425 0 /usr/sbin/httpd
Jun 11 09:20:50 esba-ipam-ip kernel: [11705] 48 11705 71106 1 140 1597 0 /usr/sbin/httpd
Jun 11 09:20:50 esba-ipam-ip kernel: [13859] 48 13859 71106 1 140 1595 0 /usr/sbin/httpd
Jun 11 09:20:50 esba-ipam-ip kernel: [21088] 48 21088 67415 1 131 1420 0 /usr/sbin/httpd
Jun 11 09:20:50 esba-ipam-ip kernel: [21089] 48 21089 70577 1 139 1064 0 /usr/sbin/httpd
Jun 11 09:20:50 esba-ipam-ip kernel: [21090] 48 21090 66736 0 130 722 0 /usr/sbin/httpd
Jun 11 09:20:50 esba-ipam-ip kernel: [ 7734] 0 7734 45565 0 45 249 0 crond
Jun 11 09:20:50 esba-ipam-ip kernel: [ 7743] 0 7743 28279 0 12 43 0 sh
Jun 11 09:20:50 esba-ipam-ip kernel: [ 7744] 0 7744 81896 531 80 11290 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8995] 0 8995 22801 0 46 253 0 sendmail
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8997] 0 8997 22793 0 45 265 0 postdrop
Jun 11 09:20:50 esba-ipam-ip kernel: [ 5505] 89 5505 23334 1 47 270 0 pickup
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8206] 0 8206 81897 3529 75 8293 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8207] 0 8207 81896 2369 75 9451 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8208] 0 8208 81897 3661 75 8160 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8209] 0 8209 81897 2872 75 8949 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8210] 0 8210 81897 3287 75 8534 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8211] 0 8211 81897 3704 75 8117 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8212] 0 8212 81897 3176 75 8646 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8213] 0 8213 81897 3787 75 8034 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8214] 0 8214 81897 3622 75 8200 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8215] 0 8215 81897 2615 75 9206 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8216] 0 8216 81897 2844 75 8977 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8217] 0 8217 81897 3056 75 8765 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8223] 0 8223 81897 2867 75 8954 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8224] 0 8224 81897 3505 75 8316 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8225] 0 8225 81897 3418 75 8403 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8226] 0 8226 81896 2174 75 9646 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8227] 0 8227 81897 3609 75 8212 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8228] 0 8228 81897 3694 75 8127 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8229] 0 8229 81897 3349 75 8472 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8230] 0 8230 81897 3675 75 8146 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8251] 0 8251 81897 3503 75 8318 0 ip_update_gesti
Jun 11 09:20:50 esba-ipam-ip kernel: [ 8252] 0 8252 81897 3390 75 8431 0 ip_update_gesti
Jun 11 09:20:51 esba-ipam-ip kernel: [ 8253] 0 8253 81897 2515 75 9306 0 ip_update_gesti
Jun 11 09:20:51 esba-ipam-ip kernel: [ 8254] 0 8254 81897 3482 75 8340 0 ip_update_gesti
Jun 11 09:20:51 esba-ipam-ip kernel: [ 8255] 0 8255 81897 3856 75 7965 0 ip_update_gesti
Jun 11 09:20:51 esba-ipam-ip kernel: [ 8256] 0 8256 81897 3530 75 8291 0 ip_update_gesti
Jun 11 09:20:51 esba-ipam-ip kernel: [ 8257] 0 8257 81897 3778 75 8043 0 ip_update_gesti
Jun 11 09:20:51 esba-ipam-ip kernel: [ 8280] 0 8280 81897 3353 75 8468 0 ip_update_gesti
Jun 11 09:20:51 esba-ipam-ip kernel: [ 8281] 0 8281 81897 3848 75 7973 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8282] 0 8282 81897 3873 75 7949 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8283] 0 8283 81897 3642 75 8179 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8284] 0 8284 81897 3625 75 8196 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8285] 0 8285 81897 2698 75 9123 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8286] 0 8286 81897 3059 75 8762 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8295] 0 8295 81897 3582 75 8239 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8296] 0 8296 81897 3326 75 8495 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8297] 0 8297 81897 3264 75 8557 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8298] 0 8298 81897 2959 75 8862 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8299] 0 8299 81897 3066 75 8755 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8300] 0 8300 81897 3435 75 8386 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8301] 0 8301 81897 3245 75 8576 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8310] 0 8310 81897 3456 75 8365 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8311] 0 8311 81896 3586 75 8234 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8312] 0 8312 81897 3118 75 8703 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8313] 0 8313 81897 3547 75 8274 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8314] 0 8314 81896 3716 75 8104 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8315] 0 8315 81897 2270 75 9551 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8316] 0 8316 81897 3418 75 8403 0 ip_update_gesti
Jun 11 09:20:52 esba-ipam-ip kernel: [ 8331] 0 8331 81897 2752 75 9069 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8332] 0 8332 81896 3522 75 8298 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8333] 0 8333 81897 3272 75 8549 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8334] 0 8334 81897 3326 75 8495 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8335] 0 8335 81897 3322 75 8499 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8336] 0 8336 81896 3720 75 8100 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8337] 0 8337 81897 2801 75 9020 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8352] 0 8352 81897 3205 75 8616 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8353] 0 8353 81896 3795 75 8025 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8354] 0 8354 81897 3552 75 8269 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8355] 0 8355 81896 3631 75 8189 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8356] 0 8356 81897 3275 75 8546 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8357] 0 8357 81897 3000 75 8821 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8358] 0 8358 81896 3430 75 8390 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8385] 0 8385 81897 3359 75 8462 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8386] 0 8386 81897 2951 75 8870 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8387] 0 8387 81896 2786 75 9034 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8395] 0 8395 81896 2828 75 8992 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8396] 0 8396 81897 3033 75 8788 0 ip_update_gesti
Jun 11 09:20:53 esba-ipam-ip kernel: [ 8397] 0 8397 81897 3093 75 8729 0 ip_update_gesti
Jun 11 09:20:54 esba-ipam-ip kernel: [ 8398] 0 8398 81896 3879 75 7941 0 ip_update_gesti
Jun 11 09:20:54 esba-ipam-ip kernel: [ 8399] 0 8399 81897 3318 75 8504 0 ip_update_gesti
Jun 11 09:20:54 esba-ipam-ip kernel: [ 8400] 0 8400 81897 3104 75 8717 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8412] 0 8412 81896 2612 75 9208 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8413] 0 8413 81897 2972 75 8849 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8414] 0 8414 81896 3696 75 8124 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8415] 0 8415 81897 2991 75 8830 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8416] 0 8416 81896 2914 75 8906 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8417] 0 8417 81896 3636 75 8184 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8418] 0 8418 81897 2620 75 9201 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8427] 0 8427 81896 3622 75 8198 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8428] 0 8428 81897 2827 75 8994 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8429] 0 8429 81897 2464 75 9358 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8430] 0 8430 81897 3062 75 8759 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8431] 0 8431 81897 3342 75 8479 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8432] 0 8432 81897 3106 75 8715 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8433] 0 8433 81897 2872 75 8949 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8434] 0 8434 81896 2731 75 9089 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8455] 0 8455 81897 2986 75 8835 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8456] 0 8456 81896 3654 75 8166 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8457] 0 8457 81897 2808 75 9013 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8458] 0 8458 81897 2600 75 9221 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8459] 0 8459 81896 3385 75 8435 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8460] 0 8460 81896 2780 75 9040 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8470] 0 8470 81896 3027 75 8793 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8471] 0 8471 81897 2641 75 9180 0 ip_update_gesti
Jun 11 09:20:55 esba-ipam-ip kernel: [ 8472] 0 8472 81897 3334 75 8487 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8473] 0 8473 81896 3598 75 8222 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8474] 0 8474 81897 2951 75 8870 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8475] 0 8475 81896 3625 75 8195 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8476] 0 8476 81897 3131 75 8690 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8483] 0 8483 81897 2918 75 8903 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8484] 0 8484 81897 2851 75 8970 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8485] 0 8485 81896 2530 75 9290 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8486] 0 8486 81896 3156 75 8664 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8487] 0 8487 81896 3491 75 8329 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8488] 0 8488 81897 2966 75 8855 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8489] 0 8489 81897 3106 75 8715 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8517] 0 8517 81896 3679 75 8141 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8518] 0 8518 81896 2992 75 8828 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8519] 0 8519 81897 2927 75 8894 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8520] 0 8520 81897 2297 75 9524 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8521] 0 8521 81896 2813 75 9007 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8522] 0 8522 81897 3114 75 8707 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8523] 0 8523 81897 3053 75 8768 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8538] 0 8538 81897 2940 75 8881 0 ip_update_gesti
Jun 11 09:20:57 esba-ipam-ip kernel: [ 8539] 0 8539 81897 2638 75 9183 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8540] 0 8540 81897 2961 75 8861 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8541] 0 8541 81896 3217 75 8603 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8542] 0 8542 81896 2206 75 9620 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8543] 0 8543 81896 3000 75 8820 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8544] 0 8544 81896 2789 75 9031 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8553] 0 8553 81896 2588 75 9232 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8554] 0 8554 81896 3244 75 8576 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8555] 0 8555 81897 3112 75 8709 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8556] 0 8556 81896 2803 75 9017 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8557] 0 8557 81896 2530 75 9290 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8558] 0 8558 81896 3343 75 8477 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8559] 0 8559 81896 2794 75 9026 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: [ 8560] 0 8560 81896 2863 75 8957 0 ip_update_gesti
Jun 11 09:20:58 esba-ipam-ip kernel: Out of memory: Kill process 25490 (mysqld) score 30 or sacrifice child
Jun 11 09:21:00 esba-ipam-ip kernel: Killed process 25490 (mysqld) total-vm:1179412kB, anon-rss:328kB, file-rss:0kB
Hi Ricky,
I will update the requirements in the documentation.
Thanks a lot
Marc
Currently, there are still memory leaks occuring and the update doesnt finish.
Mem: 4G SWAP: 4G
Paralel Processes: 32
output tail:
192.168.25.253: entry added: unknown
192.168.25.254: entry added: unknown
192.168.26.0/24
Cannot fork: Cannot allocate memory at /usr/local/share/perl5/Parallel/ForkManager.pm line 472.
root@esba-ipam-ip:tmp#
Last edit: Ricky 2016-07-12
we are in the process of dividing the update task by sites/locations so there's less data to process each time, hopefully the leak wont happen here
We were able to circumvent the problem by invoking the script using the -L parameter in order to split the amount of data being loaded into the script.
The memory hogging issues no longer appear, however i think there must be a leak somewhere because I don't understand how can such process need so much memory.