Task 15729319

Name	hadcm3n_o22o_2140_40_008268857_4
Workunit	8423981
Created	17 Apr 2013, 19:46:15 UTC
Sent	17 Apr 2013, 19:46:43 UTC
Report deadline	18 Jul 2013, 3:13:54 UTC
Received	18 Jun 2013, 16:34:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1131246
Run time	7 days 22 hours 30 min 30 sec
CPU time	7 days 1 hours 50 min 34 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	4.07 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6864, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6988, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6980, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7044, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 07:49:11 PM No files match the supplied pattern. MainError: 07:49:11 PM No files match the supplied pattern. MainError: 06:25:11 PM No files match the supplied pattern. MainError: 06:25:11 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 07:30:05 PM No files match the supplied pattern. MainError: 07:30:05 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 06:26:42 PM No files match the supplied pattern. MainError: 06:26:42 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 04:12:16 PM No files match the supplied pattern. MainError: 04:12:16 PM No files match the supplied pattern. MainError: 09:24:14 AM No files match the supplied pattern. MainError: 09:24:14 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:11:14 PM No files match the supplied pattern. MainError: 03:11:14 PM No files match the supplied pattern. MainError: 05:58:45 PM No files match the supplied pattern. MainError: 05:58:45 PM No files match the supplied pattern. MainError: 07:14:04 PM No files match the supplied pattern. MainError: 07:14:04 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 05:24:12 PM No files match the supplied pattern. MainError: 05:24:12 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/o22oka.ph11c10 Error converting file to netcdf: dataout/o22oka.pg11c10 Error converting file to netcdf: dataout/o22oka.pe11c10 MainError: 07:13:57 PM No files match the supplied pattern. MainError: 07:13:57 PM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jun 2013 19:19:08	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	777,600	619,339	0.7965
15 Jun 2013 17:30:43	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	751,680	603,130	0.8024
15 Jun 2013 07:54:20	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	725,760	586,771	0.8085
13 Jun 2013 18:45:49	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	699,840	569,062	0.8131
12 Jun 2013 18:33:55	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	673,920	548,842	0.8144
09 Jun 2013 09:40:01	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	648,000	526,696	0.8128
07 Jun 2013 16:16:45	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	622,080	503,632	0.8096
04 Jun 2013 18:40:10	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	596,160	480,524	0.8060
01 Jun 2013 19:32:42	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	570,240	457,662	0.8026
28 May 2013 19:05:29	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	544,320	440,415	0.8091
28 May 2013 14:35:52	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	518,400	426,290	0.8223
26 May 2013 13:11:24	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	492,480	410,476	0.8335
23 May 2013 19:15:58	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	466,560	395,075	0.8468
23 May 2013 15:15:22	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	440,640	380,795	0.8642
23 May 2013 10:08:33	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	414,720	365,802	0.8820
21 May 2013 21:43:36	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	388,800	344,317	0.8856
20 May 2013 17:27:18	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	362,880	321,423	0.8858
17 May 2013 18:05:42	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	336,960	298,589	0.8861
14 May 2013 20:14:22	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	311,040	275,573	0.8860
14 May 2013 13:35:27	1131246	15729319	hadcm3n_o22o_2140_40_008268857_4	285,120	252,554	0.8858