Task 13005199

Name	hadcm3n_s6zx_1940_40_007300734_2
Workunit	7498158
Created	25 Jun 2011, 15:08:20 UTC
Sent	25 Jun 2011, 15:08:22 UTC
Report deadline	24 Sep 2011, 22:35:33 UTC
Received	10 Jul 2011, 14:02:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1036109
Run time	4 days 4 hours 8 min 54 sec
CPU time	3 days 17 hours 20 min 11 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.88 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:43:44 (576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:49:22 (420): No heartbeat from core client for 30 sec - exiting 17:49:23 (420): No heartbeat from core client for 30 sec - exiting 17:49:25 (420): No heartbeat from core client for 30 sec - exiting 17:49:26 (420): No heartbeat from core client for 30 sec - exiting 17:49:27 (420): No heartbeat from core client for 30 sec - exiting 17:49:28 (420): No heartbeat from core client for 30 sec - exiting 17:49:29 (420): No heartbeat from core client for 30 sec - exiting 17:49:30 (420): No heartbeat from core client for 30 sec - exiting 17:49:31 (420): No heartbeat from core client for 30 sec - exiting 17:49:32 (420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:49:33 (420): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:00:46 (1864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:00:48 (1864): No heartbeat from core client for 30 sec - exiting 17:00:49 (1864): No heartbeat from core client for 30 sec - exiting 17:00:50 (1864): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 17:00:47 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6116, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:29:01 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5536, iMonCtr=1 Model crash detected, will try to restart... 18:59:52 (2916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5996, iMonCtr=1 Model crash detected, will try to restart... 18:01:18 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5660, iMonCtr=1 Model crash detected, will try to restart... 17:45:34 (972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:45:36 (972): No heartbeat from core client for 30 sec - exiting 17:45:37 (972): No heartbeat from core client for 30 sec - exiting 17:45:38 (972): No heartbeat from core client for 30 sec - exiting 17:45:39 (972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:05:59 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:06:00 (6408): No heartbeat from core client for 30 sec - exiting 03:06:02 (6408): No heartbeat from core client for 30 sec - exiting 03:06:03 (6408): No heartbeat from core client for 30 sec - exiting 03:06:04 (6408): No heartbeat from core client for 30 sec - exiting 03:06:05 (6408): No heartbeat from core client for 30 sec - exiting 03:06:06 (6408): No heartbeat from core client for 30 sec - exiting 03:06:07 (6408): No heartbeat from core client for 30 sec - exiting Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Jul 2011 11:53:01	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	233,280	351,864	1.5083
09 Jul 2011 14:52:24	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	207,360	307,907	1.4849
09 Jul 2011 04:23:08	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	181,440	267,544	1.4746
07 Jul 2011 17:54:47	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	155,520	226,299	1.4551
04 Jul 2011 15:43:14	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	129,600	186,667	1.4403
03 Jul 2011 01:06:48	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	103,680	151,201	1.4583
29 Jun 2011 20:49:51	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	77,760	109,200	1.4043
28 Jun 2011 16:13:43	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	51,840	67,136	1.2951
26 Jun 2011 03:55:03	1036109	13005199	hadcm3n_s6zx_1940_40_007300734_2	25,920	33,751	1.3021