CONTENTS
Lastmodified 2019-05-10 (金) 06:39:56
NICがリンクダウン(通信断)になると、リブートするスクリプトを仕込んでいたサーバのログ
May 10 03:53:43 sun1 kernel: pid 35773 (httpd), uid 80: exited on signal 6 May 10 03:53:45 sun1 kernel: pid 36141 (httpd), uid 80: exited on signal 6 May 10 03:54:16 sun1 kernel: pid 35776 (httpd), uid 80: exited on signal 6 May 10 03:54:17 sun1 kernel: pid 35778 (httpd), uid 80: exited on signal 6 May 10 03:55:00 sun1 /usr/sbin/cron[36151]: (operator) CMD (/usr/libexec/save-entropy) May 10 03:55:00 sun1 /usr/sbin/cron[36152]: (root) CMD (/usr/libexec/atrun) May 10 03:55:00 sun1 /usr/sbin/cron[36163]: (munin) CMD (/usr/local/bin/munin-cron) May 10 03:56:58 sun1 postfix/anvil[36137]: statistics: max connection rate 1/60s for (smtp:185.234.218.36) at May 10 03:51:49 May 10 03:56:58 sun1 postfix/anvil[36137]: statistics: max connection count 1 for (smtp:185.234.218.36) at May 10 03:51:49 May 10 03:56:58 sun1 postfix/anvil[36137]: statistics: max cache size 1 at May 10 03:51:49 May 10 03:59:56 sun1 smartd[686]: Device: /dev/ada0, SMART Usage Attribute: 194 Temperature_Celsius changed from 102 to 103 May 10 03:59:56 sun1 smartd[686]: Device: /dev/ada0, previous self-test completed without error May 10 03:59:56 sun1 smartd[686]: Device: /dev/ada1, previous self-test completed without error May 10 04:00:00 sun1 /usr/sbin/cron[36519]: (root) CMD (/root/bin/oc_unlock.sh) May 10 04:00:00 sun1 /usr/sbin/cron[36522]: (operator) CMD (/usr/libexec/save-entropy) May 10 04:00:00 sun1 /usr/sbin/cron[36525]: (munin) CMD (/usr/local/bin/munin-cron) May 10 04:00:00 sun1 /usr/sbin/cron[36523]: (root) CMD (newsyslog) May 10 04:00:00 sun1 /usr/sbin/cron[36524]: (root) CMD (/usr/libexec/atrun) May 10 04:00:09 sun1 postfix/pickup[36147]: 600946A4FBC0: uid=0 from=<root> May 10 04:00:09 sun1 postfix/cleanup[36606]: 600946A4FBC0: message-id=<20190509190009.600946A4FBC0@sun1.smb.net> May 10 04:00:09 sun1 postfix/qmgr[2054]: 600946A4FBC0: from=<root@sun1.smb.net>, size=662, nrcpt=1 (queue active) May 10 04:00:09 sun1 postfix/local[36608]: warning: database /etc/mail/aliases.db is older than source file /etc/mail/aliases May 10 04:00:09 sun1 postfix/local[36608]: 600946A4FBC0: to=<kuji@smb.net>, orig_to=<root>, relay=local, delay=9.1, delays=9.1/0.01/0/0, dsn=2.0.0, status=sent (delivered to mailbox) May 10 04:00:09 sun1 postfix/qmgr[2054]: 600946A4FBC0: removed May 10 04:00:28 sun1 kernel: em1: Watchdog timeout Queue[0]-- resetting May 10 04:00:28 sun1 kernel: Interface is RUNNING and ACTIVE May 10 04:00:28 sun1 kernel: em1: TX Queue 0 ------ May 10 04:00:28 sun1 kernel: em1: hw tdh = 120, hw tdt = 3 May 10 04:00:28 sun1 kernel: em1: Tx Queue Status = -2147483648 May 10 04:00:28 sun1 kernel: em1: TX descriptors avail = 115 May 10 04:00:28 sun1 kernel: em1: Tx Descriptors avail failure = 0 May 10 04:00:28 sun1 kernel: em1: RX Queue 0 ------ May 10 04:00:28 sun1 kernel: em1: hw rdh = 604, hw rdt = 603 May 10 04:00:28 sun1 kernel: em1: RX discarded packets = 0 May 10 04:00:28 sun1 kernel: em1: RX Next to Check = 604 May 10 04:00:28 sun1 kernel: em1: RX Next to Refresh = 603 May 10 04:00:28 sun1 kernel: em1: link state changed to DOWN May 10 04:00:29 sun1 reboot: rebooted by root May 10 04:00:29 sun1 kernel: May 10 04:00:29 sun1 reboot: rebooted by root
そのときの/var/log/httpd-error.log
Fatal error 'mutex 0x821651280 own 0x18ad9 is on list 0x0 0x82164f000' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:03:38.208187 2019] [core:notice] [pid 70455] AH00052: child pid 32202 exit signal Abort trap (6) Fatal error 'mutex 0x821651280 own 0x18af9 is on list 0x0 0x82164f000' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:03:39.209562 2019] [core:notice] [pid 70455] AH00052: child pid 32203 exit signal Abort trap (6) Fatal error 'mutex 0x821651280 own 0x18912 is on list 0x0 0x8216500e0' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:20:54.847417 2019] [core:notice] [pid 70455] AH00052: child pid 29645 exit signal Abort trap (6) Fatal error 'mutex 0x8216512e0 own 0x18b42 is on list 0x0 0x8216500e0' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:28:43.056200 2019] [core:notice] [pid 70455] AH00052: child pid 33812 exit signal Abort trap (6) Fatal error 'mutex 0x821651280 own 0x18b29 is on list 0x0 0x8216500e0' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:30:05.422888 2019] [core:notice] [pid 70455] AH00052: child pid 33330 exit signal Abort trap (6) Fatal error 'mutex 0x8216501a0 own 0x1873e is on list 0x0 0x8216500e0' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:34:39.635578 2019] [core:notice] [pid 70455] AH00052: child pid 34174 exit signal Abort trap (6) Fatal error 'mutex 0x8216512e0 own 0x18749 is on list 0x0 0x80a873040' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:53:44.723988 2019] [core:notice] [pid 70455] AH00052: child pid 35773 exit signal Abort trap (6) Fatal error 'mutex 0x821650200 own 0x187e5 is on list 0x0 0x82164f000' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:53:46.727015 2019] [core:notice] [pid 70455] AH00052: child pid 36141 exit signal Abort trap (6) Fatal error 'mutex 0x8216501a0 own 0x187c5 is on list 0x0 0x8216500e0' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:54:17.019563 2019] [core:notice] [pid 70455] AH00052: child pid 35776 exit signal Abort trap (6) Fatal error 'mutex 0x8216512e0 own 0x18ae7 is on list 0x0 0x8216500e0' at line 151 in file /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0) [Fri May 10 03:54:18.078924 2019] [core:notice] [pid 70455] AH00052: child pid 35778 exit signal Abort trap (6) [Fri May 10 04:00:29.663206 2019] [mpm_prefork:notice] [pid 70455] AH00169: caught SIGTERM, shutting down
https://hoshizuki.hateblo.jp/entry/20090220/p1
php.ini
;max_execution_time = 30 max_execution_time = 0
で様子見る
Total access 948:本日 1:昨日 0