Task 11420861

Name	famous_u0a3_1199_200_006633214_5
Workunit	6836586
Created	9 Jun 2010, 3:01:50 UTC
Sent	9 Jun 2010, 5:24:29 UTC
Report deadline	8 Sep 2010, 12:51:40 UTC
Received	19 Jun 2010, 22:01:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1052702
Run time	7 days 7 hours 5 min 4 sec
CPU time	6 days 19 hours 3 min 47 sec
Validate state	Invalid
Credit	2,717.67
Device peak FLOPS	1.62 GFLOPS
Application version	UK Met Office FAMOUS v6.10 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:16:02 (2680): No heartbeat from core client for 30 sec - exiting 02:16:03 (2680): No heartbeat from core client for 30 sec - exiting 02:16:05 (2680): No heartbeat from core client for 30 sec - exiting 02:16:06 (2680): No heartbeat from core client for 30 sec - exiting 02:16:07 (2680): No heartbeat from core client for 30 sec - exiting 02:16:08 (2680): No heartbeat from core client for 30 sec - exiting 02:16:09 (2680): No heartbeat from core client for 30 sec - exiting 02:16:10 (2680): No heartbeat from core client for 30 sec - exiting 02:16:11 (2680): No heartbeat from core client for 30 sec - exiting 02:16:12 (2680): No heartbeat from core client for 30 sec - exiting 02:16:13 (2680): No heartbeat from core client for 30 sec - exiting 02:16:14 (2680): No heartbeat from core client for 30 sec - exiting 02:16:16 (2680): No heartbeat from core client for 30 sec - exiting 02:16:17 (2680): No heartbeat from core client for 30 sec - exiting 02:16:18 (2680): No heartbeat from core client for 30 sec - exiting 02:16:19 (2680): No heartbeat from core client for 30 sec - exiting 02:16:20 (2680): No heartbeat from core client for 30 sec - exiting 02:16:21 (2680): No heartbeat from core client for 30 sec - exiting 02:16:22 (2680): No heartbeat from core client for 30 sec - exiting 02:16:23 (2680): No heartbeat from core client for 30 sec - exiting 02:16:24 (2680): No heartbeat from core client for 30 sec - exiting 02:16:25 (2680): No heartbeat from core client for 30 sec - exiting 02:16:26 (2680): No heartbeat from core client for 30 sec - exiting 02:16:28 (2680): No heartbeat from core client for 30 sec - exiting 02:16:29 (2680): No heartbeat from core client for 30 sec - exiting 02:16:30 (2680): No heartbeat from core client for 30 sec - exiting 02:16:31 (2680): No heartbeat from core client for 30 sec - exiting 02:16:32 (2680): No heartbeat from core client for 30 sec - exiting 02:16:33 (2680): No heartbeat from core client for 30 sec - exiting 02:16:34 (2680): No heartbeat from core client for 30 sec - exiting 02:16:35 (2680): No heartbeat from core client for 30 sec - exiting 02:16:36 (2680): No heartbeat from core client for 30 sec - exiting 02:16:37 (2680): No heartbeat from core client for 30 sec - exiting 02:16:38 (2680): No heartbeat from core client for 30 sec - exiting 02:16:40 (2680): No heartbeat from core client for 30 sec - exiting 02:16:41 (2680): No heartbeat from core client for 30 sec - exiting 02:16:42 (2680): No heartbeat from core client for 30 sec - exiting 02:16:43 (2680): No heartbeat from core client for 30 sec - exiting 02:16:44 (2680): No heartbeat from core client for 30 sec - exiting 02:16:45 (2680): No heartbeat from core client for 30 sec - exiting 02:16:46 (2680): No heartbeat from core client for 30 sec - exiting 02:16:47 (2680): No heartbeat from core client for 30 sec - exiting 02:16:48 (2680): No heartbeat from core client for 30 sec - exiting 02:16:49 (2680): No heartbeat from core client for 30 sec - exiting 02:16:50 (2680): No heartbeat from core client for 30 sec - exiting 02:16:52 (2680): No heartbeat from core client for 30 sec - exiting 02:16:53 (2680): No heartbeat from core client for 30 sec - exiting 02:16:54 (2680): No heartbeat from core client for 30 sec - exiting 02:16:55 (2680): No heartbeat from core client for 30 sec - exiting 02:16:56 (2680): No heartbeat from core client for 30 sec - exiting 02:16:57 (2680): No heartbeat from core client for 30 sec - exiting 02:16:58 (2680): No heartbeat from core client for 30 sec - exiting 02:16:59 (2680): No heartbeat from core client for 30 sec - exiting 02:17:00 (2680): No heartbeat from core client for 30 sec - exiting 02:17:01 (2680): No heartbeat from core client for 30 sec - exiting 02:17:02 (2680): No heartbeat from core client for 30 sec - exiting 02:17:04 (2680): No heartbeat from core client for 30 sec - exiting 02:17:05 (2680): No heartbeat from core client for 30 sec - exiting 02:17:06 (2680): No heartbeat from core client for 30 sec - exiting 02:17:07 (2680): No heartbeat from core client for 30 sec - exiting 02:17:08 (2680): No heartbeat from core client for 30 sec - exiting 02:17:09 (2680): No heartbeat from core client for 30 sec - exiting 02:17:10 (2680): No heartbeat from core client for 30 sec - exiting 02:17:11 (2680): No heartbeat from core client for 30 sec - exiting 02:17:12 (2680): No heartbeat from core client for 30 sec - exiting 02:17:13 (2680): No heartbeat from core client for 30 sec - exiting 02:17:14 (2680): No heartbeat from core client for 30 sec - exiting 02:17:16 (2680): No heartbeat from core client for 30 sec - exiting 02:17:17 (2680): No heartbeat from core client for 30 sec - exiting 02:17:18 (2680): No heartbeat from core client for 30 sec - exiting 02:17:19 (2680): No heartbeat from core client for 30 sec - exiting 02:17:20 (2680): No heartbeat from core client for 30 sec - exiting 02:17:21 (2680): No heartbeat from core client for 30 sec - exiting 02:17:22 (2680): No heartbeat from core client for 30 sec - exiting 02:17:23 (2680): No heartbeat from core client for 30 sec - exiting 02:17:24 (2680): No heartbeat from core client for 30 sec - exiting 02:17:25 (2680): No heartbeat from core client for 30 sec - exiting 02:17:26 (2680): No heartbeat from core client for 30 sec - exiting 02:17:28 (2680): No heartbeat from core client for 30 sec - exiting 02:17:29 (2680): No heartbeat from core client for 30 sec - exiting 02:17:30 (2680): No heartbeat from core client for 30 sec - exiting 02:17:31 (2680): No heartbeat from core client for 30 sec - exiting 02:17:32 (2680): No heartbeat from core client for 30 sec - exiting 02:17:33 (2680): No heartbeat from core client for 30 sec - exiting 02:17:34 (2680): No heartbeat from core client for 30 sec - exiting 02:17:35 (2680): No heartbeat from core client for 30 sec - exiting 02:17:36 (2680): No heartbeat from core client for 30 sec - exiting 02:17:37 (2680): No heartbeat from core client for 30 sec - exiting 02:17:38 (2680): No heartbeat from core client for 30 sec - exiting 02:17:40 (2680): No heartbeat from core client for 30 sec - exiting 02:17:41 (2680): No heartbeat from core client for 30 sec - exiting 02:17:42 (2680): No heartbeat from core client for 30 sec - exiting 02:17:43 (2680): No heartbeat from core client for 30 sec - exiting 02:17:44 (2680): No heartbeat from core client for 30 sec - exiting 02:17:45 (2680): No heartbeat from core client for 30 sec - exiting 02:17:46 (2680): No heartbeat from core client for 30 sec - exiting 02:17:47 (2680): No heartbeat from core client for 30 sec - exiting 02:17:48 (2680): No heartbeat from core client for 30 sec - exiting 02:17:49 (2680): No heartbeat from core client for 30 sec - exiting 02:17:51 (2680): No heartbeat from core client for 30 sec - exiting 02:17:52 (2680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 02:26:57 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:26:59 (2824): No heartbeat from core client for 30 sec - exiting 02:27:00 (2824): No heartbeat from core client for 30 sec - exiting 02:27:01 (2824): No heartbeat from core client for 30 sec - exiting 02:27:02 (2824): No heartbeat from core client for 30 sec - exiting 02:27:03 (2824): No heartbeat from core client for 30 sec - exiting 02:27:04 (2824): No heartbeat from core client for 30 sec - exiting 02:27:05 (2824): No heartbeat from core client for 30 sec - exiting 02:27:06 (2824): No heartbeat from core client for 30 sec - exiting 02:27:07 (2824): No heartbeat from core client for 30 sec - exiting 02:27:08 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 00:00:17 (3176): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Jun 2010 20:46:50	1052702	11420861	famous_u0a3_1199_200_006633214_5	823,706	582,436	0.7071
19 Jun 2010 18:53:25	1052702	11420861	famous_u0a3_1199_200_006633214_5	814,346	576,120	0.7075
19 Jun 2010 17:10:19	1052702	11420861	famous_u0a3_1199_200_006633214_5	804,986	569,764	0.7078
19 Jun 2010 15:22:34	1052702	11420861	famous_u0a3_1199_200_006633214_5	795,626	563,368	0.7081
19 Jun 2010 13:34:41	1052702	11420861	famous_u0a3_1199_200_006633214_5	786,266	556,971	0.7084
19 Jun 2010 11:45:12	1052702	11420861	famous_u0a3_1199_200_006633214_5	776,906	550,542	0.7086
19 Jun 2010 09:58:31	1052702	11420861	famous_u0a3_1199_200_006633214_5	767,546	544,144	0.7089
19 Jun 2010 08:09:09	1052702	11420861	famous_u0a3_1199_200_006633214_5	758,186	537,754	0.7093
19 Jun 2010 06:20:11	1052702	11420861	famous_u0a3_1199_200_006633214_5	748,826	531,352	0.7096
19 Jun 2010 04:32:46	1052702	11420861	famous_u0a3_1199_200_006633214_5	739,466	524,965	0.7099
19 Jun 2010 02:42:29	1052702	11420861	famous_u0a3_1199_200_006633214_5	730,106	518,574	0.7103
19 Jun 2010 01:04:28	1052702	11420861	famous_u0a3_1199_200_006633214_5	720,746	512,170	0.7106
18 Jun 2010 22:31:01	1052702	11420861	famous_u0a3_1199_200_006633214_5	711,386	505,772	0.7110
18 Jun 2010 20:43:24	1052702	11420861	famous_u0a3_1199_200_006633214_5	702,026	499,332	0.7113
18 Jun 2010 18:49:36	1052702	11420861	famous_u0a3_1199_200_006633214_5	692,666	492,865	0.7115
18 Jun 2010 17:00:19	1052702	11420861	famous_u0a3_1199_200_006633214_5	683,306	486,367	0.7118
18 Jun 2010 07:09:49	1052702	11420861	famous_u0a3_1199_200_006633214_5	673,946	479,738	0.7118
18 Jun 2010 05:23:27	1052702	11420861	famous_u0a3_1199_200_006633214_5	664,586	473,324	0.7122
18 Jun 2010 03:51:12	1052702	11420861	famous_u0a3_1199_200_006633214_5	655,226	466,883	0.7126
18 Jun 2010 01:47:06	1052702	11420861	famous_u0a3_1199_200_006633214_5	645,866	460,439	0.7129