climateprediction.net home page
Task 15450377

Task 15450377

Name hadcm3n_zif4_1880_40_008249883_0
Workunit 8405007
Created 22 Nov 2012, 1:57:14 UTC
Sent 22 Nov 2012, 1:59:41 UTC
Report deadline 21 Feb 2013, 9:26:52 UTC
Received 15 Dec 2012, 8:42:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1140527
Run time 20 days 23 hours 55 min 13 sec
CPU time 16 days 15 hours 38 min 12 sec
Validate state Invalid
Credit 9,020.16
Device peak FLOPS 2.89 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:02:22 (24268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:02:23 (24268): No heartbeat from core client for 30 sec - exiting
20:02:24 (24268): No heartbeat from core client for 30 sec - exiting
20:02:25 (24268): No heartbeat from core client for 30 sec - exiting
20:02:26 (24268): No heartbeat from core client for 30 sec - exiting
20:02:27 (24268): No heartbeat from core client for 30 sec - exiting
20:02:28 (24268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:48:23 (9934): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
03:22:54 (7894): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:37:52 (5880): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:37:53 (5880): No heartbeat from core client for 30 sec - exiting
03:45:09 (6978): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:46:00 (7479): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:46:01 (7479): No heartbeat from core client for 30 sec - exiting
03:46:02 (7479): No heartbeat from core client for 30 sec - exiting
03:46:03 (7479): No heartbeat from core client for 30 sec - exiting
03:46:04 (7479): No heartbeat from core client for 30 sec - exiting
03:46:05 (7479): No heartbeat from core client for 30 sec - exiting
03:46:06 (7479): No heartbeat from core client for 30 sec - exiting
03:46:07 (7479): No heartbeat from core client for 30 sec - exiting
04:11:12 (7586): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:18:47 (9323): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
07:03:34 (18388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:32:53 (20886): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:54:38 (22885): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:54:39 (22885): No heartbeat from core client for 30 sec - exiting
07:54:40 (22885): No heartbeat from core client for 30 sec - exiting
08:08:21 (24316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:38:25 (25389): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:02 (27323): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:03 (27323): No heartbeat from core client for 30 sec - exiting
08:52:04 (27323): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf778f400]
[0xf778f430]
/lib32/libc.so.6(gsignal+0x51)[0xf75f7951]
/lib32/libc.so.6(abort+0x182)[0xf75fad82]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75e3bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28286, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77bd400]
[0xf77bd430]
/lib32/libc.so.6(gsignal+0x51)[0xf7625951]
/lib32/libc.so.6(abort+0x182)[0xf7628d82]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7611bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28286, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf778f400]
[0xf778f430]
/lib32/libc.so.6(gsignal+0x51)[0xf75f7951]
/lib32/libc.so.6(abort+0x182)[0xf75fad82]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75e3bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28286, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7735400]
[0xf7735430]
/lib32/libc.so.6(gsignal+0x51)[0xf759d951]
/lib32/libc.so.6(abort+0x182)[0xf75a0d82]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7589bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28286, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76e6400]
[0xf76e6430]
/lib32/libc.so.6(gsignal+0x51)[0xf754e951]
/lib32/libc.so.6(abort+0x182)[0xf7551d82]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf753abd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28286, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7762400]
[0xf7762430]
/lib32/libc.so.6(gsignal+0x51)[0xf75ca951]
/lib32/libc.so.6(abort+0x182)[0xf75cdd82]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf75b6bd6]
/igel2/Vol1/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28286, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Dec 2012 01:17:00 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 751,680 1,419,473 1.8884
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 725,760 1,370,819 1.8888
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 699,840 1,321,392 1.8881
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 673,920 1,273,430 1.8896
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 648,000 1,225,747 1.8916
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 622,080 1,177,399 1.8927
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 596,160 1,129,490 1.8946
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 570,240 1,081,662 1.8969
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 544,320 1,035,647 1.9026
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 518,400 986,597 1.9032
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 492,480 941,177 1.9111
14 Dec 2012 14:47:39 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 466,560 893,948 1.9160
07 Dec 2012 22:18:55 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 440,640 844,150 1.9157
07 Dec 2012 06:01:31 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 414,720 794,988 1.9169
06 Dec 2012 15:55:26 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 388,800 743,491 1.9123
05 Dec 2012 23:01:26 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 362,880 693,555 1.9113
04 Dec 2012 21:10:21 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 336,960 643,533 1.9098
03 Dec 2012 22:29:33 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 311,040 594,056 1.9099
02 Dec 2012 22:17:13 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 285,120 543,741 1.9071
01 Dec 2012 23:01:37 1140527 15450377 hadcm3n_zif4_1880_40_008249883_0 259,200 492,968 1.9019


©2024 climateprediction.net