climateprediction.net home page
Task 13594784

Task 13594784

Name hadcm3n_o6mj_1940_40_007444077_4
Workunit 7641580
Created 4 Nov 2011, 22:48:01 UTC
Sent 4 Nov 2011, 22:54:24 UTC
Report deadline 4 Feb 2012, 6:21:35 UTC
Received 5 Jan 2012, 11:55:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1157438
Run time 23 days 7 hours 27 min 56 sec
CPU time 22 days 14 hours 55 min 28 sec
Validate state Invalid
Credit 7,153.92
Device peak FLOPS 2.26 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2004, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=800, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:47:18 (2096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6108, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4256, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2804, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:58:41 (3584): No heartbeat from core client for 30 sec - exiting
09:58:42 (3584): No heartbeat from core client for 30 sec - exiting
09:58:43 (3584): No heartbeat from core client for 30 sec - exiting
09:58:44 (3584): No heartbeat from core client for 30 sec - exiting
09:58:46 (3584): No heartbeat from core client for 30 sec - exiting
09:58:47 (3584): No heartbeat from core client for 30 sec - exiting
09:58:48 (3584): No heartbeat from core client for 30 sec - exiting
09:58:49 (3584): No heartbeat from core client for 30 sec - exiting
09:58:50 (3584): No heartbeat from core client for 30 sec - exiting
09:58:51 (3584): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3520, iMonCtr=1
Model crash detected, will try to restart...
16:05:29 (468): No heartbeat from core client for 30 sec - exiting
16:05:30 (468): No heartbeat from core client for 30 sec - exiting
16:05:31 (468): No heartbeat from core client for 30 sec - exiting
16:05:32 (468): No heartbeat from core client for 30 sec - exiting
16:05:33 (468): No heartbeat from core client for 30 sec - exiting
16:05:34 (468): No heartbeat from core client for 30 sec - exiting
16:05:35 (468): No heartbeat from core client for 30 sec - exiting
16:05:36 (468): No heartbeat from core client for 30 sec - exiting
16:05:37 (468): No heartbeat from core client for 30 sec - exiting
16:05:38 (468): No heartbeat from core client for 30 sec - exiting
16:05:39 (468): No heartbeat from core client for 30 sec - exiting
16:05:40 (468): No heartbeat from core client for 30 sec - exiting
16:05:41 (468): No heartbeat from core client for 30 sec - exiting
16:05:42 (468): No heartbeat from core client for 30 sec - exiting
16:05:43 (468): No heartbeat from core client for 30 sec - exiting
16:05:44 (468): No heartbeat from core client for 30 sec - exiting
16:05:45 (468): No heartbeat from core client for 30 sec - exiting
16:05:46 (468): No heartbeat from core client for 30 sec - exiting
16:05:47 (468): No heartbeat from core client for 30 sec - exiting
16:05:48 (468): No heartbeat from core client for 30 sec - exiting
16:05:49 (468): No heartbeat from core client for 30 sec - exiting
16:05:50 (468): No heartbeat from core client for 30 sec - exiting
16:05:51 (468): No heartbeat from core client for 30 sec - exiting
16:05:52 (468): No heartbeat from core client for 30 sec - exiting
16:05:53 (468): No heartbeat from core client for 30 sec - exiting
16:05:54 (468): No heartbeat from core client for 30 sec - exiting
16:05:55 (468): No heartbeat from core client for 30 sec - exiting
16:05:56 (468): No heartbeat from core client for 30 sec - exiting
16:05:57 (468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:16:35 (3396): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:10:02 (4428): No heartbeat from core client for 30 sec - exiting
15:10:03 (4428): No heartbeat from core client for 30 sec - exiting
15:10:05 (4428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:27:39 (4648): No heartbeat from core client for 30 sec - exiting
15:27:40 (4648): No heartbeat from core client for 30 sec - exiting
15:27:41 (4648): No heartbeat from core client for 30 sec - exiting
15:27:42 (4648): No heartbeat from core client for 30 sec - exiting
15:27:43 (4648): No heartbeat from core client for 30 sec - exiting
15:27:44 (4648): No heartbeat from core client for 30 sec - exiting
15:27:45 (4648): No heartbeat from core client for 30 sec - exiting
15:27:46 (4648): No heartbeat from core client for 30 sec - exiting
15:27:47 (4648): No heartbeat from core client for 30 sec - exiting
15:27:48 (4648): No heartbeat from core client for 30 sec - exiting
15:27:50 (4648): No heartbeat from core client for 30 sec - exiting
15:27:51 (4648): No heartbeat from core client for 30 sec - exiting
15:27:52 (4648): No heartbeat from core client for 30 sec - exiting
15:27:53 (4648): No heartbeat from core client for 30 sec - exiting
15:27:54 (4648): No heartbeat from core client for 30 sec - exiting
15:27:55 (4648): No heartbeat from core client for 30 sec - exiting
15:27:56 (4648): No heartbeat from core client for 30 sec - exiting
15:27:57 (4648): No heartbeat from core client for 30 sec - exiting
15:27:58 (4648): No heartbeat from core client for 30 sec - exiting
15:27:59 (4648): No heartbeat from core client for 30 sec - exiting
15:28:01 (4648): No heartbeat from core client for 30 sec - exiting
15:28:02 (4648): No heartbeat from core client for 30 sec - exiting
15:28:03 (4648): No heartbeat from core client for 30 sec - exiting
15:28:04 (4648): No heartbeat from core client for 30 sec - exiting
15:28:05 (4648): No heartbeat from core client for 30 sec - exiting
15:28:06 (4648): No heartbeat from core client for 30 sec - exiting
15:28:07 (4648): No heartbeat from core client for 30 sec - exiting
15:28:08 (4648): No heartbeat from core client for 30 sec - exiting
15:28:09 (4648): No heartbeat from core client for 30 sec - exiting
15:28:10 (4648): No heartbeat from core client for 30 sec - exiting
15:28:11 (4648): No heartbeat from core client for 30 sec - exiting
15:28:12 (4648): No heartbeat from core client for 30 sec - exiting
15:28:14 (4648): No heartbeat from core client for 30 sec - exiting
15:28:15 (4648): No heartbeat from core client for 30 sec - exiting
15:28:16 (4648): No heartbeat from core client for 30 sec - exiting
15:28:17 (4648): No heartbeat from core client for 30 sec - exiting
15:28:18 (4648): No heartbeat from core client for 30 sec - exiting
15:28:19 (4648): No heartbeat from core client for 30 sec - exiting
15:28:20 (4648): No heartbeat from core client for 30 sec - exiting
15:28:21 (4648): No heartbeat from core client for 30 sec - exiting
15:28:22 (4648): No heartbeat from core client for 30 sec - exiting
15:28:23 (4648): No heartbeat from core client for 30 sec - exiting
15:28:24 (4648): No heartbeat from core client for 30 sec - exiting
15:28:26 (4648): No heartbeat from core client for 30 sec - exiting
15:28:27 (4648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4636, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4636, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4636, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 Dec 2011 14:27:42 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 596,160 1,893,767 3.1766
30 Dec 2011 13:42:29 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 570,240 1,826,151 3.2024
29 Dec 2011 16:31:17 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 544,320 1,764,023 3.2408
28 Dec 2011 22:40:45 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 518,400 1,701,678 3.2826
28 Dec 2011 02:18:26 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 492,480 1,644,446 3.3391
26 Dec 2011 20:59:10 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 466,560 1,582,310 3.3914
26 Dec 2011 08:04:59 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 440,640 1,506,493 3.4189
24 Dec 2011 11:35:29 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 414,720 1,402,408 3.3816
16 Dec 2011 02:24:52 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 388,800 1,293,134 3.3260
09 Dec 2011 14:19:00 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 362,880 1,186,777 3.2704
08 Dec 2011 13:44:26 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 336,960 1,087,222 3.2266
06 Dec 2011 03:13:02 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 311,040 987,743 3.1756
05 Dec 2011 20:55:24 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 285,120 902,951 3.1669
05 Dec 2011 20:55:24 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 259,200 824,648 3.1815
03 Dec 2011 02:59:55 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 233,280 734,505 3.1486
19 Nov 2011 07:13:14 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 207,360 650,386 3.1365
17 Nov 2011 13:34:36 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 181,440 564,898 3.1134
16 Nov 2011 05:43:23 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 155,520 485,732 3.1233
16 Nov 2011 05:43:23 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 129,600 399,027 3.0789
16 Nov 2011 05:43:23 1157438 13594784 hadcm3n_o6mj_1940_40_007444077_4 103,680 312,809 3.0171


©2024 climateprediction.net