Task 15702600

Name	hadcm3n_o01y_2140_40_008268941_3
Workunit	8424065
Created	5 Apr 2013, 9:33:26 UTC
Sent	5 Apr 2013, 9:34:05 UTC
Report deadline	5 Jul 2013, 17:01:16 UTC
Received	6 May 2013, 16:41:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1262806
Run time	6 days 19 hours 57 min 27 sec
CPU time	6 days 10 hours 20 min 21 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4488, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4056, iMonCtr=1 Model crash detected, will try to restart... MainError: 03:04:28 PM No files match the supplied pattern. MainError: 03:04:28 PM No files match the supplied pattern. MainError: 08:39:35 PM No files match the supplied pattern. MainError: 08:39:35 PM No files match the supplied pattern. MainError: 02:15:02 AM No files match the supplied pattern. MainError: 02:15:02 AM No files match the supplied pattern. MainError: 07:58:42 AM No files match the supplied pattern. MainError: 07:58:42 AM No files match the supplied pattern. MainError: 01:24:10 PM No files match the supplied pattern. MainError: 01:24:10 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 08:47:08 PM No files match the supplied pattern. MainError: 08:47:08 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 02:55:29 PM No files match the supplied pattern. MainError: 02:55:29 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 11:40:19 AM No files match the supplied pattern. MainError: 11:40:19 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 12:43:56 AM No files match the supplied pattern. MainError: 12:43:56 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 08:25:07 PM No files match the supplied pattern. MainError: 08:25:07 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/o01yka.ph11c10 Error converting file to netcdf: dataout/o01yka.pg11c10 Error converting file to netcdf: dataout/o01yka.pe11c10 MainError: 03:40:18 PM No files match the supplied pattern. MainError: 03:40:18 PM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 May 2013 15:40:53	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	777,600	557,501	0.7170
03 May 2013 20:27:02	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	751,680	539,468	0.7177
02 May 2013 12:47:06	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	725,760	521,964	0.7192
01 May 2013 11:44:46	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	699,840	504,905	0.7215
01 May 2013 10:24:21	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	673,920	487,388	0.7232
29 Apr 2013 19:04:03	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	648,000	468,934	0.7237
27 Apr 2013 14:15:20	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	622,080	450,832	0.7247
27 Apr 2013 09:03:03	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	596,160	432,282	0.7251
27 Apr 2013 02:41:09	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	570,240	413,178	0.7246
26 Apr 2013 21:23:53	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	544,320	394,057	0.7239
26 Apr 2013 15:21:27	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	518,400	374,836	0.7231
25 Apr 2013 16:46:20	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	492,480	355,883	0.7226
23 Apr 2013 20:34:43	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	466,560	336,895	0.7221
22 Apr 2013 17:26:36	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	440,640	317,996	0.7217
22 Apr 2013 04:47:31	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	414,720	299,011	0.7210
21 Apr 2013 14:45:25	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	388,800	280,070	0.7203
21 Apr 2013 09:42:20	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	362,880	261,090	0.7195
20 Apr 2013 16:52:38	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	336,960	242,203	0.7188
19 Apr 2013 19:12:00	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	311,040	223,214	0.7176
18 Apr 2013 06:30:23	1262806	15702600	hadcm3n_o01y_2140_40_008268941_3	285,120	204,306	0.7166