climateprediction.net home page
Task 13625999

Task 13625999

Name hadcm3n_u3v8_1980_40_007538442_2
Workunit 7735674
Created 10 Nov 2011, 0:43:14 UTC
Sent 16 Nov 2011, 14:27:20 UTC
Report deadline 15 Feb 2012, 21:54:31 UTC
Received 11 Dec 2011, 20:26:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1140527
Run time 8 days 3 hours 15 min 48 sec
CPU time 7 days 7 hours 57 min 27 sec
Validate state Invalid
Credit 4,043.52
Device peak FLOPS 2.82 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:55:12 (3947): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:55:14 (3947): No heartbeat from core client for 30 sec - exiting
16:55:15 (3947): No heartbeat from core client for 30 sec - exiting
16:55:16 (3947): No heartbeat from core client for 30 sec - exiting
16:55:17 (3947): No heartbeat from core client for 30 sec - exiting
16:55:18 (3947): No heartbeat from core client for 30 sec - exiting
16:55:19 (3947): No heartbeat from core client for 30 sec - exiting
16:55:20 (3947): No heartbeat from core client for 30 sec - exiting
16:55:21 (3947): No heartbeat from core client for 30 sec - exiting
16:55:22 (3947): No heartbeat from core client for 30 sec - exiting
16:55:23 (3947): No heartbeat from core client for 30 sec - exiting
16:55:24 (3947): No heartbeat from core client for 30 sec - exiting
16:55:25 (3947): No heartbeat from core client for 30 sec - exiting
16:55:26 (3947): No heartbeat from core client for 30 sec - exiting
16:55:27 (3947): No heartbeat from core client for 30 sec - exiting
16:55:28 (3947): No heartbeat from core client for 30 sec - exiting
16:55:29 (3947): No heartbeat from core client for 30 sec - exiting
16:55:30 (3947): No heartbeat from core client for 30 sec - exiting
16:55:31 (3947): No heartbeat from core client for 30 sec - exiting
16:55:32 (3947): No heartbeat from core client for 30 sec - exiting
16:55:33 (3947): No heartbeat from core client for 30 sec - exiting
16:55:34 (3947): No heartbeat from core client for 30 sec - exiting
16:55:35 (3947): No heartbeat from core client for 30 sec - exiting
16:55:36 (3947): No heartbeat from core client for 30 sec - exiting
16:55:37 (3947): No heartbeat from core client for 30 sec - exiting
16:55:38 (3947): No heartbeat from core client for 30 sec - exiting
16:55:39 (3947): No heartbeat from core client for 30 sec - exiting
16:55:40 (3947): No heartbeat from core client for 30 sec - exiting
16:55:41 (3947): No heartbeat from core client for 30 sec - exiting
16:55:42 (3947): No heartbeat from core client for 30 sec - exiting
16:55:43 (3947): No heartbeat from core client for 30 sec - exiting
16:55:44 (3947): No heartbeat from core client for 30 sec - exiting
16:55:45 (3947): No heartbeat from core client for 30 sec - exiting
16:55:46 (3947): No heartbeat from core client for 30 sec - exiting
16:55:47 (3947): No heartbeat from core client for 30 sec - exiting
16:55:48 (3947): No heartbeat from core client for 30 sec - exiting
16:55:49 (3947): No heartbeat from core client for 30 sec - exiting
16:55:50 (3947): No heartbeat from core client for 30 sec - exiting
16:55:51 (3947): No heartbeat from core client for 30 sec - exiting
16:55:52 (3947): No heartbeat from core client for 30 sec - exiting
16:55:53 (3947): No heartbeat from core client for 30 sec - exiting
16:55:54 (3947): No heartbeat from core client for 30 sec - exiting
16:55:55 (3947): No heartbeat from core client for 30 sec - exiting
16:55:56 (3947): No heartbeat from core client for 30 sec - exiting
16:55:57 (3947): No heartbeat from core client for 30 sec - exiting
16:55:58 (3947): No heartbeat from core client for 30 sec - exiting
16:55:59 (3947): No heartbeat from core client for 30 sec - exiting
16:56:00 (3947): No heartbeat from core client for 30 sec - exiting
16:56:01 (3947): No heartbeat from core client for 30 sec - exiting
16:56:02 (3947): No heartbeat from core client for 30 sec - exiting
16:56:03 (3947): No heartbeat from core client for 30 sec - exiting
16:56:04 (3947): No heartbeat from core client for 30 sec - exiting
16:56:05 (3947): No heartbeat from core client for 30 sec - exiting
16:56:06 (3947): No heartbeat from core client for 30 sec - exiting
16:56:07 (3947): No heartbeat from core client for 30 sec - exiting
16:56:08 (3947): No heartbeat from core client for 30 sec - exiting
16:56:09 (3947): No heartbeat from core client for 30 sec - exiting
16:56:10 (3947): No heartbeat from core client for 30 sec - exiting
16:56:11 (3947): No heartbeat from core client for 30 sec - exiting
16:56:12 (3947): No heartbeat from core client for 30 sec - exiting
16:56:13 (3947): No heartbeat from core client for 30 sec - exiting
16:56:14 (3947): No heartbeat from core client for 30 sec - exiting
16:56:15 (3947): No heartbeat from core client for 30 sec - exiting
16:56:16 (3947): No heartbeat from core client for 30 sec - exiting
16:56:17 (3947): No heartbeat from core client for 30 sec - exiting
16:56:18 (3947): No heartbeat from core client for 30 sec - exiting
16:56:19 (3947): No heartbeat from core client for 30 sec - exiting
16:56:20 (3947): No heartbeat from core client for 30 sec - exiting
16:56:21 (3947): No heartbeat from core client for 30 sec - exiting
16:56:22 (3947): No heartbeat from core client for 30 sec - exiting
16:56:23 (3947): No heartbeat from core client for 30 sec - exiting
16:56:24 (3947): No heartbeat from core client for 30 sec - exiting
16:56:25 (3947): No heartbeat from core client for 30 sec - exiting
16:56:26 (3947): No heartbeat from core client for 30 sec - exiting
16:56:27 (3947): No heartbeat from core client for 30 sec - exiting
16:56:28 (3947): No heartbeat from core client for 30 sec - exiting
16:56:29 (3947): No heartbeat from core client for 30 sec - exiting
16:56:30 (3947): No heartbeat from core client for 30 sec - exiting
16:56:31 (3947): No heartbeat from core client for 30 sec - exiting
16:56:32 (3947): No heartbeat from core client for 30 sec - exiting
16:56:33 (3947): No heartbeat from core client for 30 sec - exiting
16:56:34 (3947): No heartbeat from core client for 30 sec - exiting
16:56:35 (3947): No heartbeat from core client for 30 sec - exiting
16:56:36 (3947): No heartbeat from core client for 30 sec - exiting
16:56:37 (3947): No heartbeat from core client for 30 sec - exiting
16:56:38 (3947): No heartbeat from core client for 30 sec - exiting
16:56:39 (3947): No heartbeat from core client for 30 sec - exiting
16:56:40 (3947): No heartbeat from core client for 30 sec - exiting
16:56:41 (3947): No heartbeat from core client for 30 sec - exiting
16:56:42 (3947): No heartbeat from core client for 30 sec - exiting
16:56:43 (3947): No heartbeat from core client for 30 sec - exiting
16:56:44 (3947): No heartbeat from core client for 30 sec - exiting
16:56:45 (3947): No heartbeat from core client for 30 sec - exiting
16:56:46 (3947): No heartbeat from core client for 30 sec - exiting
16:56:47 (3947): No heartbeat from core client for 30 sec - exiting
16:56:48 (3947): No heartbeat from core client for 30 sec - exiting
16:56:49 (3947): No heartbeat from core client for 30 sec - exiting
16:56:50 (3947): No heartbeat from core client for 30 sec - exiting
16:56:51 (3947): No heartbeat from core client for 30 sec - exiting
16:56:52 (3947): No heartbeat from core client for 30 sec - exiting
16:56:53 (3947): No heartbeat from core client for 30 sec - exiting
16:56:54 (3947): No heartbeat from core client for 30 sec - exiting
16:56:55 (3947): No heartbeat from core client for 30 sec - exiting
16:56:56 (3947): No heartbeat from core client for 30 sec - exiting
16:56:57 (3947): No heartbeat from core client for 30 sec - exiting
16:56:58 (3947): No heartbeat from core client for 30 sec - exiting
16:56:59 (3947): No heartbeat from core client for 30 sec - exiting
16:57:00 (3947): No heartbeat from core client for 30 sec - exiting
16:57:01 (3947): No heartbeat from core client for 30 sec - exiting
16:57:02 (3947): No heartbeat from core client for 30 sec - exiting
16:57:03 (3947): No heartbeat from core client for 30 sec - exiting
16:57:04 (3947): No heartbeat from core client for 30 sec - exiting
16:57:05 (3947): No heartbeat from core client for 30 sec - exiting
16:57:06 (3947): No heartbeat from core client for 30 sec - exiting
16:57:07 (3947): No heartbeat from core client for 30 sec - exiting
16:57:08 (3947): No heartbeat from core client for 30 sec - exiting
16:57:09 (3947): No heartbeat from core client for 30 sec - exiting
16:57:10 (3947): No heartbeat from core client for 30 sec - exiting
16:58:24 (7831): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:25:44 (5937): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:25:45 (5937): No heartbeat from core client for 30 sec - exiting
20:25:46 (5937): No heartbeat from core client for 30 sec - exiting
20:25:47 (5937): No heartbeat from core client for 30 sec - exiting
20:25:48 (5937): No heartbeat from core client for 30 sec - exiting
20:25:49 (5937): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77c5400]
[0xf77c5430]
/lib32/libc.so.6(gsignal+0x51)[0xf7634921]
/lib32/libc.so.6(abort+0x182)[0xf7637d52]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7620bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6704, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7703400]
[0xf7703430]
/lib32/libc.so.6(gsignal+0x51)[0xf7572921]
/lib32/libc.so.6(abort+0x182)[0xf7575d52]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf755ebd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6704, iMonCtr=1
Model crash detected, will try to restart...
20:27:08 (6704): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7743400]
[0xf7743430]
/lib32/libc.so.6(gsignal+0x51)[0xf75b2921]
/lib32/libc.so.6(abort+0x182)[0xf75b5d52]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf759ebd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
CPDN Monitor - No 'heartbeat' from BOINC...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf778a400]
[0xf778a430]
/lib32/libc.so.6(gsignal+0x51)[0xf75f9921]
/lib32/libc.so.6(abort+0x182)[0xf75fcd52]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75e5bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6910, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7776400]
[0xf7776430]
/lib32/libc.so.6(gsignal+0x51)[0xf75e5921]
/lib32/libc.so.6(abort+0x182)[0xf75e8d52]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75d1bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6910, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76f9400]
[0xf76f9430]
/lib32/libc.so.6(gsignal+0x51)[0xf7568921]
/lib32/libc.so.6(abort+0x182)[0xf756bd52]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7554bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6910, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7766400]
[0xf7766430]
/lib32/libc.so.6(gsignal+0x51)[0xf75d5921]
/lib32/libc.so.6(abort+0x182)[0xf75d8d52]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75c1bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6910, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Dec 2011 11:27:26 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 336,960 602,554 1.7882
10 Dec 2011 18:35:41 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 311,040 546,279 1.7563
28 Nov 2011 09:50:56 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 285,120 493,905 1.7323
27 Nov 2011 13:06:51 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 259,200 442,727 1.7081
26 Nov 2011 21:52:23 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 233,280 392,530 1.6827
26 Nov 2011 03:23:12 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 207,360 342,245 1.6505
24 Nov 2011 12:32:38 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 181,440 293,587 1.6181
24 Nov 2011 02:55:05 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 155,520 258,909 1.6648
21 Nov 2011 14:55:07 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 129,600 217,886 1.6812
21 Nov 2011 02:47:03 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 103,680 174,323 1.6814
20 Nov 2011 14:04:00 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 77,760 129,956 1.6712
20 Nov 2011 02:41:30 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 51,840 87,235 1.6828
19 Nov 2011 13:40:06 1140527 13625999 hadcm3n_u3v8_1980_40_007538442_2 25,920 43,498 1.6782


©2024 climateprediction.net