Task 22144435

Name	hadam4h_b0qa_201111_5_882_012035954_4
Workunit	12035954
Created	10 Sep 2021, 22:09:39 UTC
Sent	10 Sep 2021, 23:38:52 UTC
Report deadline	24 Aug 2022, 4:58:52 UTC
Received	14 Oct 2021, 13:39:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1505235
Run time	13 days 10 hours 2 min 30 sec
CPU time	12 days 17 hours 6 min 18 sec
Validate state	Invalid
Credit	27,115.14
Device peak FLOPS	5.30 GFLOPS
Application version	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
Peak working set size	1,384.96 MB
Peak swap size	1,407.48 MB
Peak disk usage	12.93 MB
Stderr	<core_client_version>7.16.16</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:31:25 (310188): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc1560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a6780a] /lib/i386-linux-gnu/libc.so.6(+0xbc81d)[0xf7aec81d] /lib/i386-linux-gnu/libc.so.6(+0xbcbce)[0xf7aecbce] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aea8ab] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc1560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc1549] /lib/i386-linux-gnu/libc.so.6(+0xc7214)[0xf7af7214] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x62)[0xf7afdeb2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b33ca5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xed)[0xf7a4ea1d] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f76560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a1c80a] /lib/i386-linux-gnu/libc.so.6(+0xbc81d)[0xf7aa181d] /lib/i386-linux-gnu/libc.so.6(+0xbcbce)[0xf7aa1bce] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a9f8ab] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f76560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f76549] /lib/i386-linux-gnu/libc.so.6(+0xc7214)[0xf7aac214] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x62)[0xf7ab2eb2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae8ca5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xed)[0xf7a03a1d] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2d560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79d380a] /lib/i386-linux-gnu/libc.so.6(+0xbc81d)[0xf7a5881d] /lib/i386-linux-gnu/libc.so.6(+0xbcbce)[0xf7a58bce] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a568ab] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2d560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2d549] /lib/i386-linux-gnu/libc.so.6(+0xc7214)[0xf7a63214] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x62)[0xf7a69eb2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a9fca5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xed)[0xf79baa1d] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed4560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf797a80a] /lib/i386-linux-gnu/libc.so.6(+0xbc81d)[0xf79ff81d] /lib/i386-linux-gnu/libc.so.6(+0xbcbce)[0xf79ffbce] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf79fd8ab] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed4560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed4549] /lib/i386-linux-gnu/libc.so.6(+0xc7214)[0xf7a0a214] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x62)[0xf7a10eb2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a46ca5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xed)[0xf7961a1d] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edf560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf798580a] /lib/i386-linux-gnu/libc.so.6(+0xbc81d)[0xf7a0a81d] /lib/i386-linux-gnu/libc.so.6(+0xbcbce)[0xf7a0abce] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a088ab] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edf560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7edf549] /lib/i386-linux-gnu/libc.so.6(+0xc7214)[0xf7a15214] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x62)[0xf7a1beb2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a51ca5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xed)[0xf796ca1d] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 10:40:27 (1339313): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79d680a] /lib/i386-linux-gnu/libc.so.6(+0xbc81d)[0xf7a5b81d] /lib/i386-linux-gnu/libc.so.6(+0xbcbce)[0xf7a5bbce] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a598ab] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f30549] /lib/i386-linux-gnu/libc.so.6(+0xc7214)[0xf7a66214] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x62)[0xf7a6ceb2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aa2ca5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xed)[0xf79bda1d] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 12:24:55 (8460): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 12:24:55 (8460): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 16:37:58 (8465): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 16:37:58 (8465): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 21:57:13 (7881): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:58:57 (8076): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:58:58 (8076): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (20 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f02560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79a980a] /lib/i386-linux-gnu/libc.so.6(+0xbc81d)[0xf7a2e81d] /lib/i386-linux-gnu/libc.so.6(+0xbcbce)[0xf7a2ebce] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a2c8ab] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f02560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f02549] /lib/i386-linux-gnu/libc.so.6(+0xc7214)[0xf7a39214] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x62)[0xf7a3feb2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a75ca5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xed)[0xf7990a1d] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Sorry, too many model crashes! :-( 15:39:04 (4424): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Oct 2021 02:31:00	1505235	22144435	hadam4h_b0qa_201111_5_882_012035954_4	34,763	904,442	26.0174
09 Oct 2021 08:56:53	1505235	22144435	hadam4h_b0qa_201111_5_882_012035954_4	26,123	679,065	25.9949
06 Oct 2021 10:57:50	1505235	22144435	hadam4h_b0qa_201111_5_882_012035954_4	17,483	456,375	26.1039
03 Oct 2021 15:38:02	1505235	22144435	hadam4h_b0qa_201111_5_882_012035954_4	8,843	233,013	26.3500