Task 15591671

Name	hadcm3n_4dmn_1940_40_008305547_0
Workunit	8456682
Created	7 Feb 2013, 6:34:31 UTC
Sent	7 Feb 2013, 6:43:51 UTC
Report deadline	9 May 2013, 14:11:02 UTC
Received	29 Mar 2013, 19:37:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1266267
Run time	16 days 8 hours 47 min 43 sec
CPU time	16 days 6 hours 29 min 30 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3908, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2320, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3944, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2616, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2616, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Mar 2013 19:26:32	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	648,000	1,372,737	2.1184
18 Mar 2013 04:32:33	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	622,080	1,318,136	2.1189
17 Mar 2013 12:24:46	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	596,160	1,260,417	2.1142
16 Mar 2013 20:29:43	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	570,240	1,203,695	2.1109
15 Mar 2013 21:08:08	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	544,320	1,146,494	2.1063
14 Mar 2013 04:18:35	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	518,400	1,093,351	2.1091
13 Mar 2013 13:40:10	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	492,480	1,040,681	2.1131
12 Mar 2013 23:12:26	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	466,560	988,670	2.1191
06 Mar 2013 04:39:52	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	440,640	933,392	2.1183
27 Feb 2013 15:45:43	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	414,720	876,833	2.1143
27 Feb 2013 15:45:43	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	388,800	824,130	2.1197
25 Feb 2013 06:49:04	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	362,880	777,955	2.1438
22 Feb 2013 23:50:09	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	336,960	719,691	2.1358
22 Feb 2013 06:31:32	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	311,040	662,807	2.1309
21 Feb 2013 11:55:20	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	285,120	607,128	2.1294
20 Feb 2013 14:30:27	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	259,200	550,567	2.1241
15 Feb 2013 22:41:41	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	233,280	490,452	2.1024
15 Feb 2013 06:31:41	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	207,360	433,482	2.0905
14 Feb 2013 05:30:03	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	181,440	377,566	2.0809
13 Feb 2013 22:13:06	1266267	15591671	hadcm3n_4dmn_1940_40_008305547_0	155,520	325,147	2.0907