climateprediction.net home page
Task 16166642

Task 16166642

Name hadcm3n_odov_1900_40_008472866_2
Workunit 8623705
Created 29 Dec 2013, 10:13:35 UTC
Sent 29 Dec 2013, 10:13:50 UTC
Report deadline 30 Mar 2014, 17:41:01 UTC
Received 1 Jan 2014, 17:16:40 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1244729
Run time 3 days 0 hours 55 min 2 sec
CPU time 2 days 21 hours 18 min 20 sec
Validate state Invalid
Credit 2,799.36
Device peak FLOPS 3.34 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.2.33</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
08:38:16 (10348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:38:19 (10348): No heartbeat from core client for 30 sec - exiting
08:38:20 (10348): No heartbeat from core client for 30 sec - exiting
08:38:21 (10348): No heartbeat from core client for 30 sec - exiting
08:38:22 (10348): No heartbeat from core client for 30 sec - exiting
08:38:23 (10348): No heartbeat from core client for 30 sec - exiting
08:38:24 (10348): No heartbeat from core client for 30 sec - exiting
08:38:26 (10348): No heartbeat from core client for 30 sec - exiting
08:38:27 (10348): No heartbeat from core client for 30 sec - exiting
08:38:28 (10348): No heartbeat from core client for 30 sec - exiting
08:38:29 (10348): No heartbeat from core client for 30 sec - exiting
08:38:30 (10348): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:14:23 (22376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:24 (22376): No heartbeat from core client for 30 sec - exiting
20:14:26 (22376): No heartbeat from core client for 30 sec - exiting
20:14:27 (22376): No heartbeat from core client for 30 sec - exiting
20:14:28 (22376): No heartbeat from core client for 30 sec - exiting
20:14:29 (22376): No heartbeat from core client for 30 sec - exiting
20:14:30 (22376): No heartbeat from core client for 30 sec - exiting
20:14:31 (22376): No heartbeat from core client for 30 sec - exiting
20:14:32 (22376): No heartbeat from core client for 30 sec - exiting
20:14:33 (22376): No heartbeat from core client for 30 sec - exiting
20:14:34 (22376): No heartbeat from core client for 30 sec - exiting
03:04:25 (20664): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:04:26 (20664): No heartbeat from core client for 30 sec - exiting
03:04:27 (20664): No heartbeat from core client for 30 sec - exiting
03:04:28 (20664): No heartbeat from core client for 30 sec - exiting
03:04:29 (20664): No heartbeat from core client for 30 sec - exiting
03:04:30 (20664): No heartbeat from core client for 30 sec - exiting
03:04:32 (20664): No heartbeat from core client for 30 sec - exiting
03:04:33 (20664): No heartbeat from core client for 30 sec - exiting
03:04:34 (20664): No heartbeat from core client for 30 sec - exiting
03:04:35 (20664): No heartbeat from core client for 30 sec - exiting
03:04:36 (20664): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:01:36 (20612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:32 (8204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:34 (8204): No heartbeat from core client for 30 sec - exiting
05:50:35 (8204): No heartbeat from core client for 30 sec - exiting
05:50:36 (8204): No heartbeat from core client for 30 sec - exiting
05:50:37 (8204): No heartbeat from core client for 30 sec - exiting
05:50:38 (8204): No heartbeat from core client for 30 sec - exiting
05:50:40 (8204): No heartbeat from core client for 30 sec - exiting
05:50:41 (8204): No heartbeat from core client for 30 sec - exiting
05:50:42 (8204): No heartbeat from core client for 30 sec - exiting
05:50:43 (8204): No heartbeat from core client for 30 sec - exiting
05:50:44 (8204): No heartbeat from core client for 30 sec - exiting
09:54:17 (13212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:54:21 (13212): No heartbeat from core client for 30 sec - exiting
09:54:22 (13212): No heartbeat from core client for 30 sec - exiting
09:54:23 (13212): No heartbeat from core client for 30 sec - exiting
09:54:24 (13212): No heartbeat from core client for 30 sec - exiting
09:54:25 (13212): No heartbeat from core client for 30 sec - exiting
09:54:26 (13212): No heartbeat from core client for 30 sec - exiting
09:54:27 (13212): No heartbeat from core client for 30 sec - exiting
09:54:28 (13212): No heartbeat from core client for 30 sec - exiting
09:54:29 (13212): No heartbeat from core client for 30 sec - exiting
09:54:30 (13212): No heartbeat from core client for 30 sec - exiting
09:54:31 (13212): No heartbeat from core client for 30 sec - exiting
09:54:33 (13212): No heartbeat from core client for 30 sec - exiting
15:08:54 (24788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:08:55 (24788): No heartbeat from core client for 30 sec - exiting
15:08:56 (24788): No heartbeat from core client for 30 sec - exiting
15:08:57 (24788): No heartbeat from core client for 30 sec - exiting
15:08:58 (24788): No heartbeat from core client for 30 sec - exiting
15:08:59 (24788): No heartbeat from core client for 30 sec - exiting
18:01:18 (23640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:01:19 (23640): No heartbeat from core client for 30 sec - exiting
18:01:20 (23640): No heartbeat from core client for 30 sec - exiting
18:01:21 (23640): No heartbeat from core client for 30 sec - exiting
18:01:22 (23640): No heartbeat from core client for 30 sec - exiting
18:01:23 (23640): No heartbeat from core client for 30 sec - exiting
18:01:24 (23640): No heartbeat from core client for 30 sec - exiting
18:01:25 (23640): No heartbeat from core client for 30 sec - exiting
18:01:26 (23640): No heartbeat from core client for 30 sec - exiting
18:01:27 (23640): No heartbeat from core client for 30 sec - exiting
18:01:28 (23640): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
03:12:26 (1272): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:12:27 (1272): No heartbeat from core client for 30 sec - exiting
03:12:28 (1272): No heartbeat from core client for 30 sec - exiting
03:12:29 (1272): No heartbeat from core client for 30 sec - exiting
03:12:30 (1272): No heartbeat from core client for 30 sec - exiting
03:12:31 (1272): No heartbeat from core client for 30 sec - exiting
03:12:32 (1272): No heartbeat from core client for 30 sec - exiting
03:12:33 (1272): No heartbeat from core client for 30 sec - exiting
03:12:34 (1272): No heartbeat from core client for 30 sec - exiting
03:12:35 (1272): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
03:30:52 (15280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:53 (15280): No heartbeat from core client for 30 sec - exiting
03:30:54 (15280): No heartbeat from core client for 30 sec - exiting
03:30:55 (15280): No heartbeat from core client for 30 sec - exiting
03:30:56 (15280): No heartbeat from core client for 30 sec - exiting
03:30:57 (15280): No heartbeat from core client for 30 sec - exiting
03:30:58 (15280): No heartbeat from core client for 30 sec - exiting
08:35:22 (17828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:35:23 (17828): No heartbeat from core client for 30 sec - exiting
08:35:24 (17828): No heartbeat from core client for 30 sec - exiting
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=23856, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=23856, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=23856, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
09:00:54 (1100): No heartbeat from core client for 30 sec - exiting
09:01:19 (1100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8848, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8848, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8848, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Jan 2014 10:09:40 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 233,280 243,160 1.0424
01 Jan 2014 01:02:29 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 207,360 213,764 1.0309
31 Dec 2013 16:13:05 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 181,440 184,945 1.0193
31 Dec 2013 07:44:35 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 155,520 156,090 1.0037
30 Dec 2013 23:42:54 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 129,600 129,678 1.0006
30 Dec 2013 16:34:45 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 103,680 103,359 0.9969
30 Dec 2013 09:32:09 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 77,760 77,241 0.9933
30 Dec 2013 01:25:08 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 51,840 51,392 0.9914
29 Dec 2013 18:23:17 1244729 16166642 hadcm3n_odov_1900_40_008472866_2 25,920 25,372 0.9789


©2024 climateprediction.net