Task 15864677

Name	hadcm3n_o5i3_2060_40_008395970_0
Workunit	8546829
Created	26 Jun 2013, 0:40:06 UTC
Sent	27 Jun 2013, 14:58:05 UTC
Report deadline	26 Sep 2013, 22:25:16 UTC
Received	11 Jul 2013, 20:32:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1255152
Run time	6 days 9 hours 19 min 56 sec
CPU time	6 days 7 hours 39 min 44 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:10:35 (9120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:53 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:20:37 (13388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:31:06 (7104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:07 (7104): No heartbeat from core client for 30 sec - exiting 16:31:08 (7104): No heartbeat from core client for 30 sec - exiting 16:31:09 (7104): No heartbeat from core client for 30 sec - exiting 16:31:10 (7104): No heartbeat from core client for 30 sec - exiting 16:31:11 (7104): No heartbeat from core client for 30 sec - exiting 16:31:12 (7104): No heartbeat from core client for 30 sec - exiting 16:31:13 (7104): No heartbeat from core client for 30 sec - exiting 16:31:14 (7104): No heartbeat from core client for 30 sec - exiting 16:31:15 (7104): No heartbeat from core client for 30 sec - exiting 16:31:16 (7104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:55:20 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6360, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6068, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6068, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6068, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jul 2013 14:57:53	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	777,600	539,514	0.6938
11 Jul 2013 00:47:49	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	751,680	521,213	0.6934
10 Jul 2013 05:05:05	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	725,760	502,500	0.6924
09 Jul 2013 23:08:14	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	699,840	483,991	0.6916
09 Jul 2013 03:16:31	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	673,920	466,783	0.6926
08 Jul 2013 22:46:57	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	648,000	450,270	0.6949
08 Jul 2013 03:01:06	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	622,080	432,594	0.6954
07 Jul 2013 21:39:30	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	596,160	414,947	0.6960
07 Jul 2013 17:19:53	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	570,240	397,166	0.6965
07 Jul 2013 01:56:46	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	544,320	379,047	0.6964
06 Jul 2013 20:59:59	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	518,400	361,327	0.6970
06 Jul 2013 16:44:45	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	492,480	343,122	0.6967
06 Jul 2013 05:39:29	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	466,560	324,797	0.6962
06 Jul 2013 05:29:58	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	440,640	306,986	0.6967
06 Jul 2013 05:15:06	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	414,720	289,500	0.6981
06 Jul 2013 04:26:20	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	388,800	271,143	0.6974
06 Jul 2013 04:11:09	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	362,880	253,555	0.6987
04 Jul 2013 16:05:42	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	336,960	234,797	0.6968
04 Jul 2013 14:04:56	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	311,040	216,661	0.6966
04 Jul 2013 14:00:48	1255152	15864677	hadcm3n_o5i3_2060_40_008395970_0	285,120	197,939	0.6942