Task 15598631

Name	hadcm3n_491o_1940_40_008311102_0
Workunit	8462237
Created	8 Feb 2013, 3:17:36 UTC
Sent	8 Feb 2013, 22:54:10 UTC
Report deadline	11 May 2013, 6:21:21 UTC
Received	10 Mar 2013, 15:38:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1265347
Run time	9 days 12 hours 24 min 43 sec
CPU time	9 days 4 hours 24 min 13 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	3.04 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6608, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7292, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/491oko.pjf7c10 Error converting file to netcdf: dataout/491oko.pif7c10 Error converting file to netcdf: dataout/491oko.pff7c10 Error converting file to netcdf: dataout/491oka.phf7c10 Error converting file to netcdf: dataout/491oka.pgf7c10 Error converting file to netcdf: dataout/491oka.pef7c10 Error converting file to netcdf: dataout/491oka.pdf7c10 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2013 15:35:37	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	440,640	782,594	1.7760
05 Mar 2013 22:28:14	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	414,720	740,780	1.7862
28 Feb 2013 02:21:03	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	388,800	667,424	1.7166
26 Feb 2013 08:45:17	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	362,880	599,795	1.6529
22 Feb 2013 20:43:21	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	336,960	554,441	1.6454
19 Feb 2013 11:48:55	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	311,040	507,035	1.6301
18 Feb 2013 22:55:57	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	285,120	462,076	1.6206
15 Feb 2013 17:46:25	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	259,200	417,084	1.6091
15 Feb 2013 04:51:22	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	233,280	371,853	1.5940
14 Feb 2013 15:20:36	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	207,360	326,884	1.5764
12 Feb 2013 21:43:51	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	181,440	281,666	1.5524
11 Feb 2013 20:19:37	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	155,520	243,105	1.5632
11 Feb 2013 10:11:30	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	129,600	206,711	1.5950
11 Feb 2013 00:09:12	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	103,680	173,780	1.6761
10 Feb 2013 12:22:59	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	77,760	130,130	1.6735
09 Feb 2013 23:24:38	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	51,840	86,476	1.6681
09 Feb 2013 11:17:26	1265347	15598631	hadcm3n_491o_1940_40_008311102_0	25,920	42,833	1.6525