climateprediction.net home page
Task 15966393

Task 15966393

Name hadcm3n_3d1s_2020_40_008363166_3
Workunit 8514025
Created 30 Aug 2013, 4:59:22 UTC
Sent 30 Aug 2013, 5:06:42 UTC
Report deadline 29 Nov 2013, 12:33:53 UTC
Received 23 Sep 2013, 9:32:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1117652
Run time 19 days 10 hours 10 min 42 sec
CPU time 18 days 1 hours 2 min 45 sec
Validate state Invalid
Credit 6,531.84
Device peak FLOPS 1.89 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:28:00 (4904): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:28:17 (4904): No heartbeat from core client for 30 sec - exiting
13:28:18 (4904): No heartbeat from core client for 30 sec - exiting
13:28:19 (4904): No heartbeat from core client for 30 sec - exiting
13:28:20 (4904): No heartbeat from core client for 30 sec - exiting
13:28:22 (4904): No heartbeat from core client for 30 sec - exiting
13:28:23 (4904): No heartbeat from core client for 30 sec - exiting
13:28:24 (4904): No heartbeat from core client for 30 sec - exiting
13:33:00 (4120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:03:58 (6276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=728, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:20:01 (4896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:20:03 (4896): No heartbeat from core client for 30 sec - exiting
03:25:02 (5480): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:27:34 (2360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:45:18 (3816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:50:19 (5572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:52:41 (1848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:31:30 (6120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
10:55:55 (4420): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:28:41 (5100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
16:21:19 (3664): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:23:07 (5680): No heartbeat from core client for 30 sec - exiting
16:23:08 (5680): No heartbeat from core client for 30 sec - exiting
16:23:09 (5680): No heartbeat from core client for 30 sec - exiting
16:23:10 (5680): No heartbeat from core client for 30 sec - exiting
16:23:11 (5680): No heartbeat from core client for 30 sec - exiting
16:23:12 (5680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:36:03 (1808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:40:19 (2868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:40:23 (2868): No heartbeat from core client for 30 sec - exiting
19:40:24 (2868): No heartbeat from core client for 30 sec - exiting
19:40:25 (2868): No heartbeat from core client for 30 sec - exiting
19:40:26 (2868): No heartbeat from core client for 30 sec - exiting
19:40:27 (2868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
20:11:09 (5376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:15:00 (4352): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:10:19 (5228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:07:09 (2632): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
07:06:08 (3640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:59:30 (5312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:33:43 (4788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:33:58 (4788): No heartbeat from core client for 30 sec - exiting
18:34:02 (4788): No heartbeat from core client for 30 sec - exiting
18:34:04 (4788): No heartbeat from core client for 30 sec - exiting
18:34:05 (4788): No heartbeat from core client for 30 sec - exiting
18:34:06 (4788): No heartbeat from core client for 30 sec - exiting
18:34:07 (4788): No heartbeat from core client for 30 sec - exiting
18:34:08 (4788): No heartbeat from core client for 30 sec - exiting
18:34:09 (4788): No heartbeat from core client for 30 sec - exiting
18:34:10 (4788): No heartbeat from core client for 30 sec - exiting
18:34:11 (4788): No heartbeat from core client for 30 sec - exiting
18:34:12 (4788): No heartbeat from core client for 30 sec - exiting
18:34:13 (4788): No heartbeat from core client for 30 sec - exiting
18:34:14 (4788): No heartbeat from core client for 30 sec - exiting
18:34:16 (4788): No heartbeat from core client for 30 sec - exiting
18:34:17 (4788): No heartbeat from core client for 30 sec - exiting
18:34:19 (4788): No heartbeat from core client for 30 sec - exiting
18:34:22 (4788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Sep 2013 09:36:31 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 544,320 1,580,011 2.9027
21 Sep 2013 12:46:46 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 518,400 1,498,035 2.8897
20 Sep 2013 11:25:05 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 492,480 1,416,034 2.8753
19 Sep 2013 11:22:57 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 466,560 1,333,846 2.8589
18 Sep 2013 11:24:15 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 440,640 1,251,754 2.8408
17 Sep 2013 10:21:41 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 414,720 1,169,842 2.8208
16 Sep 2013 13:18:17 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 388,800 1,095,896 2.8187
15 Sep 2013 05:28:06 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 362,880 1,031,207 2.8417
12 Sep 2013 09:54:46 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 336,960 962,995 2.8579
10 Sep 2013 13:50:54 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 311,040 892,595 2.8697
09 Sep 2013 17:53:11 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 285,120 822,450 2.8846
08 Sep 2013 13:28:24 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 259,200 750,033 2.8936
07 Sep 2013 15:25:39 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 233,280 676,852 2.9015
06 Sep 2013 13:23:31 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 207,360 602,821 2.9071
05 Sep 2013 15:20:47 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 181,440 527,756 2.9087
04 Sep 2013 18:19:38 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 155,520 456,260 2.9338
03 Sep 2013 21:16:15 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 129,600 386,106 2.9792
02 Sep 2013 23:16:33 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 103,680 309,383 2.9840
02 Sep 2013 01:16:13 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 77,760 232,841 2.9944
01 Sep 2013 04:12:43 1117652 15966393 hadcm3n_3d1s_2020_40_008363166_3 51,840 157,672 3.0415


©2024 climateprediction.net