Назад | Перейти на главную страницу

Дженкинс не работает - OOM

без каких-либо заметных изменений на моем сервере (Ubuntu 16.04.1) мой Jenkins перестает работать примерно каждые пару часов. Когда я проверил логи от Jenkins, ничего не связанное. Затем я проверил системный журнал, и есть информация о OOM, вызванном ntpd.

Не могли бы вы помочь мне решить эту проблему?

Заранее спасибо !

Apr 21 16:58:36 (hostname) kernel: [86376.235517] ntpd invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_adj=0
Apr 21 16:58:36 (hostname) kernel: [86376.235521] ntpd cpuset=/ mems_allowed=0
Apr 21 16:58:36 (hostname) kernel: [86376.235526] CPU: 5 PID: 1569 Comm: ntpd Not tainted 4.4.0-177-generic #207-Ubuntu
Apr 21 16:58:36 (hostname) kernel: [86376.235527] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Apr 21 16:58:36 (hostname) kernel: [86376.235529]  0000000000000286 445f217ed0c39952 ffff8800bbbcf9e8 ffffffff8140d35b
Apr 21 16:58:36 (hostname) kernel: [86376.235531]  ffff8800bbbcfba0 ffff8802b11c1c00 ffff8800bbbcfa58 ffffffff8121a93e
Apr 21 16:58:36 (hostname) kernel: [86376.235533]  ffffffff813a5082 0000000000000010 0000000000000282 ffff8800bbbcfa20
Apr 21 16:58:36 (hostname) kernel: [86376.235535] Call Trace:
Apr 21 16:58:36 (hostname) kernel: [86376.235546]  [<ffffffff8140d35b>] dump_stack+0x6d/0x92
Apr 21 16:58:36 (hostname) kernel: [86376.235552]  [<ffffffff8121a93e>] dump_header+0x5a/0x1c3
Apr 21 16:58:36 (hostname) kernel: [86376.235557]  [<ffffffff813a5082>] ? apparmor_capable+0x22/0x1b0
Apr 21 16:58:36 (hostname) kernel: [86376.235562]  [<ffffffff8119e82b>] oom_kill_process+0x20b/0x3d0
Apr 21 16:58:36 (hostname) kernel: [86376.235564]  [<ffffffff8119ec38>] out_of_memory+0x1f8/0x470
Apr 21 16:58:36 (hostname) kernel: [86376.235566]  [<ffffffff811a4ca3>] __alloc_pages_slowpath.constprop.89+0x943/0xaf0
Apr 21 16:58:36 (hostname) kernel: [86376.235568]  [<ffffffff811a50d8>] __alloc_pages_nodemask+0x288/0x2a0
Apr 21 16:58:36 (hostname) kernel: [86376.235573]  [<ffffffff811f082c>] alloc_pages_current+0x8c/0x110
Apr 21 16:58:36 (hostname) kernel: [86376.235575]  [<ffffffff8119a94b>] __page_cache_alloc+0xab/0xc0
Apr 21 16:58:36 (hostname) kernel: [86376.235577]  [<ffffffff8119d280>] filemap_fault+0x160/0x440
Apr 21 16:58:36 (hostname) kernel: [86376.235581]  [<ffffffff812b4066>] ext4_filemap_fault+0x36/0x50
Apr 21 16:58:36 (hostname) kernel: [86376.235585]  [<ffffffff811caa57>] __do_fault+0x77/0x110
Apr 21 16:58:36 (hostname) kernel: [86376.235587]  [<ffffffff811ce9fc>] handle_mm_fault+0x125c/0x1b80
Apr 21 16:58:36 (hostname) kernel: [86376.235593]  [<ffffffff8103b592>] ? __fpu__restore_sig+0xa2/0x410
Apr 21 16:58:36 (hostname) kernel: [86376.235598]  [<ffffffff8106ee94>] __do_page_fault+0x1a4/0x410
Apr 21 16:58:36 (hostname) kernel: [86376.235600]  [<ffffffff8106f122>] do_page_fault+0x22/0x30
Apr 21 16:58:36 (hostname) kernel: [86376.235604]  [<ffffffff81869f78>] page_fault+0x28/0x30
Apr 21 16:58:36 (hostname) kernel: [86376.235605] Mem-Info:
Apr 21 16:58:36 (hostname) kernel: [86376.235609] active_anon:2453155 inactive_anon:4304 isolated_anon:0
Apr 21 16:58:36 (hostname) kernel: [86376.235609]  active_file:492 inactive_file:649 isolated_file:0
Apr 21 16:58:36 (hostname) kernel: [86376.235609]  unevictable:913 dirty:0 writeback:0 unstable:0
Apr 21 16:58:36 (hostname) kernel: [86376.235609]  slab_reclaimable:27955 slab_unreclaimable:8963
Apr 21 16:58:36 (hostname) kernel: [86376.235609]  mapped:5244 shmem:5743 pagetables:9522 bounce:0
Apr 21 16:58:36 (hostname) kernel: [86376.235609]  free:28313 free_pcp:739 free_cma:0
Apr 21 16:58:36 (hostname) kernel: [86376.235612] Node 0 DMA free:15864kB min:104kB low:128kB high:156kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0
kB isolated(file):0kB present:15992kB managed:15904kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:
0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Apr 21 16:58:36 (hostname) kernel: [86376.235617] lowmem_reserve[]: 0 2934 9940 9940 9940
Apr 21 16:58:36 (hostname) kernel: [86376.235619] Node 0 DMA32 free:47796kB min:19916kB low:24892kB high:29872kB active_anon:2928136kB inactive_anon:3396kB active_file:988kB inactive_file:1520kB unevictabl
e:196kB isolated(anon):0kB isolated(file):0kB present:3129216kB managed:3048304kB mlocked:196kB dirty:0kB writeback:0kB mapped:3524kB shmem:3540kB slab_reclaimable:34308kB slab_unreclaimable:6972kB kernel_st
ack:1616kB pagetables:10380kB unstable:0kB bounce:0kB free_pcp:1172kB local_pcp:80kB free_cma:0kB writeback_tmp:0kB pages_scanned:14312 all_unreclaimable? no
Apr 21 16:58:36 (hostname) kernel: [86376.235623] lowmem_reserve[]: 0 0 7006 7006 7006
Apr 21 16:58:36 (hostname) kernel: [86376.235625] Node 0 Normal free:49592kB min:47556kB low:59444kB high:71332kB active_anon:6884484kB inactive_anon:13820kB active_file:980kB inactive_file:1076kB unevicta
ble:3456kB isolated(anon):0kB isolated(file):0kB present:7340032kB managed:7174640kB mlocked:3456kB dirty:0kB writeback:0kB mapped:17452kB shmem:19432kB slab_reclaimable:77512kB slab_unreclaimable:28872kB ke
rnel_stack:5280kB pagetables:27708kB unstable:0kB bounce:0kB free_pcp:1812kB local_pcp:120kB free_cma:0kB writeback_tmp:0kB pages_scanned:972 all_unreclaimable? no
Apr 21 16:58:36 (hostname) kernel: [86376.235629] lowmem_reserve[]: 0 0 0 0 0
Apr 21 16:58:36 (hostname) kernel: [86376.235631] Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15864kB
Apr 21 16:58:36 (hostname) kernel: [86376.235638] Node 0 DMA32: 607*4kB (UE) 245*8kB (UME) 654*16kB (UME) 256*32kB (UE) 163*64kB (UME) 77*128kB (ME) 15*256kB (ME) 1*512kB (E) 0*1024kB 0*2048kB 0*4096kB = 47684kB
Apr 21 16:58:36 (hostname) kernel: [86376.235645] Node 0 Normal: 2082*4kB (UMEH) 1028*8kB (UMEH) 695*16kB (UMEH) 512*32kB (UMEH) 84*64kB (UMEH) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 49432kB
Apr 21 16:58:36 (hostname) kernel: [86376.235651] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Apr 21 16:58:36 (hostname) kernel: [86376.235652] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Apr 21 16:58:36 (hostname) kernel: [86376.235653] 7852 total pagecache pages
Apr 21 16:58:36 (hostname) kernel: [86376.235730] 0 pages in swap cache
Apr 21 16:58:36 (hostname) kernel: [86376.235732] Swap cache stats: add 0, delete 0, find 0/0
Apr 21 16:58:36 (hostname) kernel: [86376.235733] Free swap  = 0kB
Apr 21 16:58:36 (hostname) kernel: [86376.235733] Total swap = 0kB
Apr 21 16:58:36 (hostname) kernel: [86376.235734] 2621310 pages RAM
Apr 21 16:58:36 (hostname) kernel: [86376.235735] 0 pages HighMem/MovableOnly
Apr 21 16:58:36 (hostname) kernel: [86376.235735] 61598 pages reserved
Apr 21 16:58:36 (hostname) kernel: [86376.235736] 0 pages cma reserved
Apr 21 16:58:36 (hostname) kernel: [86376.235742] 0 pages hwpoisoned

Apr 21 16:58:36 (hostname) kernel: [86376.236225] Out of memory: Kill process 22539 (java) score 135 or sacrifice child
Apr 21 16:58:36 (hostname) kernel: [86376.236455] Killed process 22539 (java) total-vm:7428660kB, anon-rss:1384156kB, file-rss:0kB
Apr 21 16:58:36 (hostname) jenkins: jenkins: fatal: client (pid 22539) killed by signal 9, exiting```