Task 16100255

Name	hadcm3n_7nm5_1980_40_008441888_1
Workunit	8592744
Created	29 Nov 2013, 17:41:15 UTC
Sent	29 Nov 2013, 17:41:24 UTC
Report deadline	1 Mar 2014, 1:08:35 UTC
Received	12 Dec 2013, 15:36:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1261140
Run time	6 days 22 hours 39 min 52 sec
CPU time	6 days 21 hours 27 min 27 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	3.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:12:04 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2013 02:13:29	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	544,320	575,501	1.0573
06 Dec 2013 18:34:35	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	518,400	546,169	1.0536
06 Dec 2013 09:22:59	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	492,480	516,182	1.0481
06 Dec 2013 01:24:37	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	466,560	486,377	1.0425
05 Dec 2013 16:23:06	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	440,640	456,811	1.0367
05 Dec 2013 08:17:19	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	414,720	427,674	1.0312
05 Dec 2013 00:15:05	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	388,800	399,040	1.0263
04 Dec 2013 03:03:21	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	362,880	371,817	1.0246
03 Dec 2013 19:25:51	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	336,960	344,317	1.0218
03 Dec 2013 11:53:59	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	311,040	317,445	1.0206
03 Dec 2013 04:17:41	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	285,120	290,221	1.0179
02 Dec 2013 20:31:01	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	259,200	263,907	1.0182
02 Dec 2013 12:34:53	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	233,280	237,546	1.0183
02 Dec 2013 05:07:59	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	207,360	210,953	1.0173
01 Dec 2013 21:41:11	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	181,440	184,369	1.0161
01 Dec 2013 14:14:24	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	155,520	157,620	1.0135
01 Dec 2013 06:43:01	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	129,600	130,982	1.0107
30 Nov 2013 23:11:39	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	103,680	104,208	1.0051
30 Nov 2013 15:51:00	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	77,760	77,546	0.9972
30 Nov 2013 09:00:11	1261140	16100255	hadcm3n_7nm5_1980_40_008441888_1	51,840	51,348	0.9905