Task 15587520

Name	hadcm3n_4cxy_1940_40_008302206_0
Workunit	8453341
Created	6 Feb 2013, 18:11:04 UTC
Sent	6 Feb 2013, 18:11:13 UTC
Report deadline	9 May 2013, 1:38:24 UTC
Received	26 Feb 2013, 14:04:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1238331
Run time	14 days 5 hours 1 min 2 sec
CPU time	13 days 17 hours 26 min 38 sec
Validate state	Invalid
Credit	9,953.28
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4cxyko.pjg3c10 Error converting file to netcdf: dataout/4cxyko.pig3c10 Error converting file to netcdf: dataout/4cxyko.pfg3c10 Error converting file to netcdf: dataout/4cxyka.phg3c10 Error converting file to netcdf: dataout/4cxyka.pgg3c10 Error converting file to netcdf: dataout/4cxyka.peg3c10 Error converting file to netcdf: dataout/4cxyka.pdg3c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4cxyko.pjg3c10 Error converting file to netcdf: dataout/4cxyko.pig3c10 Error converting file to netcdf: dataout/4cxyko.pfg3c10 Error converting file to netcdf: dataout/4cxyka.phg3c10 Error converting file to netcdf: dataout/4cxyka.pgg3c10 Error converting file to netcdf: dataout/4cxyka.peg3c10 Error converting file to netcdf: dataout/4cxyka.pdg3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Feb 2013 09:25:30	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	829,440	1,186,041	1.4299
25 Feb 2013 22:06:30	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	803,520	1,148,504	1.4293
24 Feb 2013 23:51:07	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	777,600	1,110,877	1.4286
24 Feb 2013 13:20:20	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	751,680	1,073,566	1.4282
24 Feb 2013 00:42:10	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	725,760	1,036,665	1.4284
23 Feb 2013 15:35:42	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	699,840	1,003,736	1.4342
23 Feb 2013 07:06:48	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	673,920	973,309	1.4443
22 Feb 2013 20:53:35	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	648,000	937,269	1.4464
22 Feb 2013 03:50:57	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	622,080	899,722	1.4463
21 Feb 2013 17:06:05	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	596,160	861,776	1.4455
19 Feb 2013 02:26:52	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	570,240	826,215	1.4489
18 Feb 2013 08:43:17	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	544,320	788,303	1.4482
17 Feb 2013 20:24:02	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	518,400	750,429	1.4476
17 Feb 2013 09:07:01	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	492,480	713,822	1.4494
16 Feb 2013 20:38:19	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	466,560	676,949	1.4509
16 Feb 2013 10:04:13	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	440,640	639,467	1.4512
15 Feb 2013 23:21:53	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	414,720	602,014	1.4516
15 Feb 2013 04:26:16	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	388,800	563,240	1.4487
14 Feb 2013 16:45:52	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	362,880	524,286	1.4448
13 Feb 2013 02:04:58	1238331	15587520	hadcm3n_4cxy_1940_40_008302206_0	336,960	486,008	1.4423