Task 15719867

Name	hadcm3n_o1pf_2140_40_008270628_3
Workunit	8425752
Created	10 Apr 2013, 6:58:00 UTC
Sent	10 Apr 2013, 6:58:13 UTC
Report deadline	10 Jul 2013, 14:25:24 UTC
Received	26 Apr 2013, 15:29:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1274243
Run time	9 days 3 hours 23 min 19 sec
CPU time	7 days 17 hours 31 min 26 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	4.16 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 11:56:21 AM No files match the supplied pattern. MainError: 11:56:21 AM No files match the supplied pattern. MainError: 07:09:44 PM No files match the supplied pattern. MainError: 07:09:44 PM No files match the supplied pattern. MainError: 02:22:10 AM No files match the supplied pattern. MainError: 02:22:10 AM No files match the supplied pattern. MainError: 09:41:08 AM No files match the supplied pattern. MainError: 09:41:08 AM No files match the supplied pattern. MainError: 04:53:27 PM No files match the supplied pattern. MainError: 04:53:27 PM No files match the supplied pattern. MainError: 12:01:16 AM No files match the supplied pattern. MainError: 12:01:16 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 09:07:46 AM No files match the supplied pattern. MainError: 09:07:46 AM No files match the supplied pattern. MainError: 04:06:53 PM No files match the supplied pattern. MainError: 04:06:53 PM No files match the supplied pattern. MainError: 11:05:39 PM No files match the supplied pattern. MainError: 11:05:39 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 06:34:32 AM No files match the supplied pattern. MainError: 06:34:32 AM No files match the supplied pattern. Error converting file to netcdf: dataout/o1pfka.ph11c10 Error converting file to netcdf: dataout/o1pfka.pg11c10 Error converting file to netcdf: dataout/o1pfka.pe11c10 MainError: 01:38:33 PM No files match the supplied pattern. MainError: 01:38:33 PM No files match the supplied pattern. BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Apr 2013 13:45:07	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	777,600	777,763	1.0002
26 Apr 2013 06:47:17	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	751,680	752,490	1.0011
25 Apr 2013 23:19:38	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	725,760	726,046	1.0004
25 Apr 2013 16:26:09	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	699,840	701,070	1.0018
25 Apr 2013 09:32:15	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	673,920	676,077	1.0032
25 Apr 2013 00:34:17	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	648,000	651,529	1.0054
24 Apr 2013 17:23:15	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	622,080	626,030	1.0063
24 Apr 2013 10:15:37	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	596,160	600,286	1.0069
24 Apr 2013 02:38:06	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	570,240	574,512	1.0075
23 Apr 2013 19:53:58	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	544,320	548,743	1.0081
23 Apr 2013 12:25:16	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	518,400	522,928	1.0087
22 Apr 2013 21:55:14	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	492,480	497,268	1.0097
21 Apr 2013 15:40:36	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	466,560	471,339	1.0102
21 Apr 2013 08:42:03	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	440,640	445,737	1.0116
21 Apr 2013 01:45:00	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	414,720	419,835	1.0123
19 Apr 2013 23:05:30	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	388,800	394,020	1.0134
19 Apr 2013 15:45:44	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	362,880	368,000	1.0141
19 Apr 2013 08:28:30	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	336,960	342,042	1.0151
19 Apr 2013 01:01:04	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	311,040	315,570	1.0146
18 Apr 2013 17:37:21	1274243	15719867	hadcm3n_o1pf_2140_40_008270628_3	285,120	289,360	1.0149