Task 22186687

Name	hadam4h_101x_209102_4_921_012117387_3
Workunit	12117387
Created	10 Jan 2022, 10:14:43 UTC
Sent	18 Jan 2022, 5:20:13 UTC
Report deadline	31 Dec 2022, 10:40:13 UTC
Received	1 Feb 2022, 20:59:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1523867
Run time	11 days 8 hours 16 min 6 sec
CPU time	11 days 3 hours 38 min 39 sec
Validate state	Invalid
Credit	20,375.94
Device peak FLOPS	5.40 GFLOPS
Application version	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
Peak working set size	1,377.29 MB
Peak swap size	1,398.84 MB
Peak disk usage	12.92 MB
Stderr	<core_client_version>7.16.6</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234)</message> <stderr_txt> Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f26560] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a20552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aa4d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aa50ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa303b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f26560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f26549] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aaf693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aaf892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab6314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aea475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a07ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f23560] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a1d552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7aa1d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7aa20ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa003b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f23560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f23549] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7aac693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7aac892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7ab3314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae7475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a04ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc5560] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7abf552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b43d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b440ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b4203b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc5560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc5549] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b4e693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b4e892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b55314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b89475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7aa6ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f08560] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a02552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7a86d2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7a870ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a8503b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f08560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f08549] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7a91693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7a91892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7a98314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7acc475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf79e9ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2560] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a9b552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7b1fd2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7b200ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7b1e03b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa2560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa2549] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b2a693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b2a892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b31314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b65475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf5)[0xf7a82ee5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7f560] /lib/i386-linux-gnu/libc.so.6(getenv+0xa2)[0xf7a78552] /lib/i386-linux-gnu/libc.so.6(+0xbbd2d)[0xf7afcd2d] /lib/i386-linux-gnu/libc.so.6(+0xbc0ee)[0xf7afd0ee] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7afb03b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7f560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f7f549] /lib/i386-linux-gnu/libc.so.6(+0xc6693)[0xf7b07693] /lib/i386-linux-gnu/libc.so.6(clock_nanosleep+0x52)[0xf7b07892] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x24)[0xf7b0e314] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b42475] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d2114] /lib/i386-linux-gnu/libpthread.so.0(+0x8635)[0xf7f41635] /lib/i386-linux-gnu/libc.so.6(clone+0x6a)[0xf7b498fa] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xnnuj.pipe_dummy Sorry, too many model crashes! :-( 21:57:43 (2952853): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Jan 2022 10:25:39	1523867	22186687	hadam4h_101x_209102_4_921_012117387_3	26,123	767,476	29.3793
24 Jan 2022 12:14:24	1523867	22186687	hadam4h_101x_209102_4_921_012117387_3	17,483	470,904	26.9350
21 Jan 2022 07:04:07	1523867	22186687	hadam4h_101x_209102_4_921_012117387_3	8,843	228,696	25.8618