climateprediction.net home page
Task 13295384

Task 13295384

Name hadcm3n_p5bi_1940_40_007421994_2
Workunit 7619629
Created 25 Aug 2011, 8:54:46 UTC
Sent 25 Aug 2011, 8:56:33 UTC
Report deadline 24 Nov 2011, 16:23:44 UTC
Received 5 Oct 2011, 12:08:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1161960
Run time 31 days 11 hours 52 min 4 sec
CPU time 28 days 18 hours 14 min 12 sec
Validate state Invalid
Credit 9,953.28
Device peak FLOPS 1.69 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
17:24:36 (3600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:24:37 (3600): No heartbeat from core client for 30 sec - exiting
17:24:38 (3600): No heartbeat from core client for 30 sec - exiting
17:24:39 (3600): No heartbeat from core client for 30 sec - exiting
17:24:40 (3600): No heartbeat from core client for 30 sec - exiting
17:24:41 (3600): No heartbeat from core client for 30 sec - exiting
17:24:42 (3600): No heartbeat from core client for 30 sec - exiting
17:24:43 (3600): No heartbeat from core client for 30 sec - exiting
17:24:44 (3600): No heartbeat from core client for 30 sec - exiting
17:24:45 (3600): No heartbeat from core client for 30 sec - exiting
17:24:46 (3600): No heartbeat from core client for 30 sec - exiting
17:24:47 (3600): No heartbeat from core client for 30 sec - exiting
17:34:17 (2748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:34:18 (2748): No heartbeat from core client for 30 sec - exiting
17:34:19 (2748): No heartbeat from core client for 30 sec - exiting
17:34:20 (2748): No heartbeat from core client for 30 sec - exiting
17:34:21 (2748): No heartbeat from core client for 30 sec - exiting
17:34:22 (2748): No heartbeat from core client for 30 sec - exiting
17:34:23 (2748): No heartbeat from core client for 30 sec - exiting
17:34:24 (2748): No heartbeat from core client for 30 sec - exiting
17:34:25 (2748): No heartbeat from core client for 30 sec - exiting
17:34:26 (2748): No heartbeat from core client for 30 sec - exiting
17:34:27 (2748): No heartbeat from core client for 30 sec - exiting
17:34:28 (2748): No heartbeat from core client for 30 sec - exiting
15:04:33 (5576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:04:35 (5576): No heartbeat from core client for 30 sec - exiting
15:04:36 (5576): No heartbeat from core client for 30 sec - exiting
15:04:37 (5576): No heartbeat from core client for 30 sec - exiting
17:46:23 (4332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:46:25 (4332): No heartbeat from core client for 30 sec - exiting
17:46:26 (4332): No heartbeat from core client for 30 sec - exiting
17:40:31 (5740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:41:16 (5740): No heartbeat from core client for 30 sec - exiting
17:41:18 (5740): No heartbeat from core client for 30 sec - exiting
17:41:25 (5740): No heartbeat from core client for 30 sec - exiting
17:41:26 (5740): No heartbeat from core client for 30 sec - exiting
17:41:27 (5740): No heartbeat from core client for 30 sec - exiting
18:15:49 (4680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:15:56 (4680): No heartbeat from core client for 30 sec - exiting
18:16:00 (4680): No heartbeat from core client for 30 sec - exiting
18:19:01 (1724): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:19:04 (1724): No heartbeat from core client for 30 sec - exiting
18:19:05 (1724): No heartbeat from core client for 30 sec - exiting
18:19:06 (1724): No heartbeat from core client for 30 sec - exiting
18:19:07 (1724): No heartbeat from core client for 30 sec - exiting
18:19:08 (1724): No heartbeat from core client for 30 sec - exiting
18:19:09 (1724): No heartbeat from core client for 30 sec - exiting
18:19:10 (1724): No heartbeat from core client for 30 sec - exiting
18:19:11 (1724): No heartbeat from core client for 30 sec - exiting
17:47:03 (4916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:47:09 (4916): No heartbeat from core client for 30 sec - exiting
17:47:27 (4916): No heartbeat from core client for 30 sec - exiting
17:46:06 (4332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:48:55 (4332): No heartbeat from core client for 30 sec - exiting
17:47:43 (2728): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:56:05 (2728): No heartbeat from core client for 30 sec - exiting
18:17:15 (2368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:17:25 (2368): No heartbeat from core client for 30 sec - exiting
18:18:56 (2368): No heartbeat from core client for 30 sec - exiting
18:18:57 (2368): No heartbeat from core client for 30 sec - exiting
18:18:58 (2368): No heartbeat from core client for 30 sec - exiting
18:18:59 (2368): No heartbeat from core client for 30 sec - exiting
18:29:35 (4856): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:29:54 (4856): No heartbeat from core client for 30 sec - exiting
18:29:55 (4856): No heartbeat from core client for 30 sec - exiting
18:29:57 (4856): No heartbeat from core client for 30 sec - exiting
09:37:09 (5592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:55:10 (5960): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:55:18 (5960): No heartbeat from core client for 30 sec - exiting
17:55:19 (5960): No heartbeat from core client for 30 sec - exiting
17:55:20 (5960): No heartbeat from core client for 30 sec - exiting
18:05:10 (3328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:05:12 (3328): No heartbeat from core client for 30 sec - exiting
18:05:13 (3328): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
CPDN Monitor - Quit request from BOINC...
18:03:24 (3292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:17:16 (3372): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:17:17 (3372): No heartbeat from core client for 30 sec - exiting
18:17:18 (3372): No heartbeat from core client for 30 sec - exiting
20:34:28 (2840): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:27 (2840): No heartbeat from core client for 30 sec - exiting
20:35:30 (2840): No heartbeat from core client for 30 sec - exiting
20:35:31 (2840): No heartbeat from core client for 30 sec - exiting
20:35:32 (2840): No heartbeat from core client for 30 sec - exiting
20:35:35 (2840): No heartbeat from core client for 30 sec - exiting
20:35:36 (2840): No heartbeat from core client for 30 sec - exiting
20:35:37 (2840): No heartbeat from core client for 30 sec - exiting
20:35:38 (2840): No heartbeat from core client for 30 sec - exiting
20:35:39 (2840): No heartbeat from core client for 30 sec - exiting
20:35:40 (2840): No heartbeat from core client for 30 sec - exiting
20:35:41 (2840): No heartbeat from core client for 30 sec - exiting
20:35:42 (2840): No heartbeat from core client for 30 sec - exiting
20:35:43 (2840): No heartbeat from core client for 30 sec - exiting
20:35:44 (2840): No heartbeat from core client for 30 sec - exiting
20:35:45 (2840): No heartbeat from core client for 30 sec - exiting
20:35:46 (2840): No heartbeat from core client for 30 sec - exiting
20:35:47 (2840): No heartbeat from core client for 30 sec - exiting
20:35:56 (2840): No heartbeat from core client for 30 sec - exiting
20:35:57 (2840): No heartbeat from core client for 30 sec - exiting
17:33:31 (5036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:35:09 (5036): No heartbeat from core client for 30 sec - exiting
17:35:27 (5036): No heartbeat from core client for 30 sec - exiting
17:35:29 (5036): No heartbeat from core client for 30 sec - exiting
17:35:30 (5036): No heartbeat from core client for 30 sec - exiting
17:35:31 (5036): No heartbeat from core client for 30 sec - exiting
17:35:32 (5036): No heartbeat from core client for 30 sec - exiting
17:35:33 (5036): No heartbeat from core client for 30 sec - exiting
17:35:34 (5036): No heartbeat from core client for 30 sec - exiting
17:56:49 (6104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:56:51 (6104): No heartbeat from core client for 30 sec - exiting
17:24:11 (4844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:53:25 (1900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:53:27 (1900): No heartbeat from core client for 30 sec - exiting
17:53:28 (1900): No heartbeat from core client for 30 sec - exiting
17:54:41 (2652): No heartbeat from core client for 30 sec - exiting
17:54:42 (2652): No heartbeat from core client for 30 sec - exiting
17:54:43 (2652): No heartbeat from core client for 30 sec - exiting
17:54:44 (2652): No heartbeat from core client for 30 sec - exiting
17:54:45 (2652): No heartbeat from core client for 30 sec - exiting
17:54:46 (2652): No heartbeat from core client for 30 sec - exiting
17:54:47 (2652): No heartbeat from core client for 30 sec - exiting
17:54:48 (2652): No heartbeat from core client for 30 sec - exiting
17:54:49 (2652): No heartbeat from core client for 30 sec - exiting
17:54:50 (2652): No heartbeat from core client for 30 sec - exiting
17:54:51 (2652): No heartbeat from core client for 30 sec - exiting
17:54:52 (2652): No heartbeat from core client for 30 sec - exiting
17:54:53 (2652): No heartbeat from core client for 30 sec - exiting
17:54:54 (2652): No heartbeat from core client for 30 sec - exiting
17:54:55 (2652): No heartbeat from core client for 30 sec - exiting
17:54:56 (2652): No heartbeat from core client for 30 sec - exiting
17:54:57 (2652): No heartbeat from core client for 30 sec - exiting
17:54:58 (2652): No heartbeat from core client for 30 sec - exiting
17:54:59 (2652): No heartbeat from core client for 30 sec - exiting
17:55:00 (2652): No heartbeat from core client for 30 sec - exiting
17:55:01 (2652): No heartbeat from core client for 30 sec - exiting
17:55:02 (2652): No heartbeat from core client for 30 sec - exiting
17:55:03 (2652): No heartbeat from core client for 30 sec - exiting
17:55:04 (2652): No heartbeat from core client for 30 sec - exiting
17:55:05 (2652): No heartbeat from core client for 30 sec - exiting
17:55:06 (2652): No heartbeat from core client for 30 sec - exiting
17:55:07 (2652): No heartbeat from core client for 30 sec - exiting
17:55:08 (2652): No heartbeat from core client for 30 sec - exiting
17:55:09 (2652): No heartbeat from core client for 30 sec - exiting
17:55:10 (2652): No heartbeat from core client for 30 sec - exiting
17:55:11 (2652): No heartbeat from core client for 30 sec - exiting
17:55:12 (2652): No heartbeat from core client for 30 sec - exiting
17:55:13 (2652): No heartbeat from core client for 30 sec - exiting
17:55:15 (2652): No heartbeat from core client for 30 sec - exiting
17:55:16 (2652): No heartbeat from core client for 30 sec - exiting
17:55:17 (2652): No heartbeat from core client for 30 sec - exiting
17:55:18 (2652): No heartbeat from core client for 30 sec - exiting
17:55:19 (2652): No heartbeat from core client for 30 sec - exiting
17:55:25 (2652): No heartbeat from core client for 30 sec - exiting
17:55:28 (2652): No heartbeat from core client for 30 sec - exiting
17:55:29 (2652): No heartbeat from core client for 30 sec - exiting
17:55:30 (2652): No heartbeat from core client for 30 sec - exiting
17:55:31 (2652): No heartbeat from core client for 30 sec - exiting
17:55:32 (2652): No heartbeat from core client for 30 sec - exiting
17:55:33 (2652): No heartbeat from core client for 30 sec - exiting
17:55:34 (2652): No heartbeat from core client for 30 sec - exiting
17:55:36 (2652): No heartbeat from core client for 30 sec - exiting
17:55:37 (2652): No heartbeat from core client for 30 sec - exiting
17:55:38 (2652): No heartbeat from core client for 30 sec - exiting
17:55:39 (2652): No heartbeat from core client for 30 sec - exiting
17:55:40 (2652): No heartbeat from core client for 30 sec - exiting
17:55:42 (2652): No heartbeat from core client for 30 sec - exiting
17:55:43 (2652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1112, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1872, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1212, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Oct 2011 07:27:27 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 829,440 2,442,242 2.9444
30 Sep 2011 03:05:34 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 803,520 2,359,532 2.9365
29 Sep 2011 00:05:39 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 777,600 2,276,016 2.9270
27 Sep 2011 21:05:33 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 751,680 2,192,678 2.9170
26 Sep 2011 18:25:35 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 725,760 2,109,243 2.9063
25 Sep 2011 15:39:54 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 699,840 2,025,961 2.8949
24 Sep 2011 13:55:14 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 673,920 1,944,078 2.8847
23 Sep 2011 12:28:01 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 648,000 1,862,768 2.8746
22 Sep 2011 10:34:11 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 622,080 1,780,580 2.8623
21 Sep 2011 08:11:01 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 596,160 1,698,650 2.8493
16 Sep 2011 05:42:49 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 570,240 1,616,220 2.8343
15 Sep 2011 04:54:11 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 544,320 1,533,308 2.8169
14 Sep 2011 03:38:19 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 518,400 1,450,629 2.7983
13 Sep 2011 02:46:25 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 492,480 1,368,406 2.7786
12 Sep 2011 02:01:43 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 466,560 1,287,062 2.7586
11 Sep 2011 01:26:00 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 440,640 1,204,100 2.7326
10 Sep 2011 00:44:23 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 414,720 1,122,755 2.7073
09 Sep 2011 00:59:56 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 388,800 1,048,138 2.6958
08 Sep 2011 04:01:51 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 362,880 978,159 2.6955
07 Sep 2011 07:30:06 1161960 13295384 hadcm3n_p5bi_1940_40_007421994_2 336,960 908,320 2.6956


©2024 climateprediction.net