Task 16355199

Name	hadcm3n_o09p_1980_40_008388446_3
Workunit	8539305
Created	7 Mar 2014, 2:38:32 UTC
Sent	7 Mar 2014, 2:38:42 UTC
Report deadline	6 Jun 2014, 10:05:53 UTC
Received	24 Mar 2014, 1:40:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1172941
Run time	11 days 10 hours 59 min 36 sec
CPU time	11 days 6 hours 53 min 9 sec
Validate state	Invalid
Credit	6,842.88
Device peak FLOPS	2.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.31</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o09pko.pji9c10 Error converting file to netcdf: dataout/o09pko.pii9c10 Error converting file to netcdf: dataout/o09pko.pfi9c10 Error converting file to netcdf: dataout/o09pka.phi9c10 Error converting file to netcdf: dataout/o09pka.pgi9c10 Error converting file to netcdf: dataout/o09pka.pei9c10 Error converting file to netcdf: dataout/o09pka.pdi9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Mar 2014 07:53:43	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	570,240	938,568	1.6459
22 Mar 2014 11:55:34	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	544,320	895,393	1.6450
21 Mar 2014 17:47:09	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	518,400	852,148	1.6438
21 Mar 2014 05:09:51	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	492,480	808,226	1.6411
20 Mar 2014 08:30:51	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	466,560	764,978	1.6396
19 Mar 2014 13:17:19	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	440,640	720,871	1.6360
18 Mar 2014 09:03:19	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	414,720	677,651	1.6340
17 Mar 2014 15:41:27	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	388,800	634,670	1.6324
17 Mar 2014 00:29:11	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	362,880	592,054	1.6315
16 Mar 2014 11:17:24	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	336,960	549,464	1.6307
15 Mar 2014 19:39:45	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	311,040	507,249	1.6308
15 Mar 2014 05:05:12	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	285,120	465,756	1.6335
14 Mar 2014 15:31:33	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	259,200	423,812	1.6351
14 Mar 2014 02:12:49	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	233,280	382,098	1.6379
13 Mar 2014 12:08:38	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	207,360	339,627	1.6379
12 Mar 2014 23:20:54	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	181,440	297,705	1.6408
12 Mar 2014 11:38:38	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	155,520	255,672	1.6440
11 Mar 2014 12:41:04	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	129,600	213,556	1.6478
10 Mar 2014 15:30:40	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	103,680	171,210	1.6513
09 Mar 2014 09:41:14	1172941	16355199	hadcm3n_o09p_1980_40_008388446_3	77,760	128,365	1.6508