climateprediction.net home page
Task 15628514

Task 15628514

Name hadcm3n_4f38_1940_40_008307194_1
Workunit 8458329
Created 23 Feb 2013, 15:13:28 UTC
Sent 23 Feb 2013, 15:13:31 UTC
Report deadline 25 May 2013, 22:40:42 UTC
Received 11 Apr 2013, 21:35:43 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1223759
Run time 13 days 17 hours 36 min 54 sec
CPU time 13 days 0 hours 34 min 9 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 2.77 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:11:05 (6088): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:11:07 (6088): No heartbeat from core client for 30 sec - exiting
07:11:08 (6088): No heartbeat from core client for 30 sec - exiting
07:11:09 (6088): No heartbeat from core client for 30 sec - exiting
07:11:10 (6088): No heartbeat from core client for 30 sec - exiting
07:11:11 (6088): No heartbeat from core client for 30 sec - exiting
07:11:12 (6088): No heartbeat from core client for 30 sec - exiting
07:11:13 (6088): No heartbeat from core client for 30 sec - exiting
07:11:14 (6088): No heartbeat from core client for 30 sec - exiting
07:11:15 (6088): No heartbeat from core client for 30 sec - exiting
07:11:16 (6088): No heartbeat from core client for 30 sec - exiting
07:11:17 (6088): No heartbeat from core client for 30 sec - exiting
07:11:18 (6088): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:49:59 (7144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:50:00 (7144): No heartbeat from core client for 30 sec - exiting
12:50:01 (7144): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:17:21 (4940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:17:23 (4940): No heartbeat from core client for 30 sec - exiting
07:17:24 (4940): No heartbeat from core client for 30 sec - exiting
07:17:25 (4940): No heartbeat from core client for 30 sec - exiting
07:17:26 (4940): No heartbeat from core client for 30 sec - exiting
07:17:27 (4940): No heartbeat from core client for 30 sec - exiting
07:17:28 (4940): No heartbeat from core client for 30 sec - exiting
07:17:29 (4940): No heartbeat from core client for 30 sec - exiting
07:17:30 (4940): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
21:07:13 (8052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:07:15 (8052): No heartbeat from core client for 30 sec - exiting
21:07:16 (8052): No heartbeat from core client for 30 sec - exiting
21:07:17 (8052): No heartbeat from core client for 30 sec - exiting
21:07:18 (8052): No heartbeat from core client for 30 sec - exiting
21:07:19 (8052): No heartbeat from core client for 30 sec - exiting
21:07:20 (8052): No heartbeat from core client for 30 sec - exiting
21:07:21 (8052): No heartbeat from core client for 30 sec - exiting
21:07:22 (8052): No heartbeat from core client for 30 sec - exiting
21:07:23 (8052): No heartbeat from core client for 30 sec - exiting
21:07:24 (8052): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:30:58 (6188): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:30:59 (6188): No heartbeat from core client for 30 sec - exiting
07:31:00 (6188): No heartbeat from core client for 30 sec - exiting
07:31:01 (6188): No heartbeat from core client for 30 sec - exiting
07:31:02 (6188): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:05:55 (7048): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:05:59 (7048): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Apr 2013 17:59:16 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 907,200 1,164,341 1.2834
11 Apr 2013 00:11:15 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 881,280 1,130,966 1.2833
09 Apr 2013 14:35:53 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 855,360 1,097,595 1.2832
08 Apr 2013 21:04:48 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 829,440 1,064,611 1.2835
07 Apr 2013 22:33:13 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 803,520 1,031,249 1.2834
06 Apr 2013 23:59:53 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 777,600 997,317 1.2826
06 Apr 2013 03:11:25 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 751,680 963,583 1.2819
05 Apr 2013 16:37:14 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 725,760 930,441 1.2820
04 Apr 2013 15:15:38 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 699,840 897,273 1.2821
03 Apr 2013 14:45:34 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 673,920 863,999 1.2820
01 Apr 2013 13:45:23 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 648,000 830,443 1.2815
31 Mar 2013 15:50:44 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 622,080 797,322 1.2817
30 Mar 2013 21:40:43 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 596,160 764,352 1.2821
29 Mar 2013 22:25:42 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 570,240 731,376 1.2826
29 Mar 2013 04:18:51 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 544,320 698,377 1.2830
28 Mar 2013 19:12:09 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 518,400 665,531 1.2838
28 Mar 2013 00:40:48 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 492,480 632,439 1.2842
26 Mar 2013 23:22:49 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 466,560 599,077 1.2840
26 Mar 2013 05:19:46 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 440,640 565,909 1.2843
25 Mar 2013 04:01:04 1223759 15628514 hadcm3n_4f38_1940_40_008307194_1 414,720 532,916 1.2850


©2024 climateprediction.net