Task 12419876

Name	famous_xkdl_1499_200_007088240_0
Workunit	7291540
Created	18 Dec 2010, 16:08:17 UTC
Sent	26 Dec 2010, 0:19:11 UTC
Report deadline	27 Mar 2011, 7:46:22 UTC
Received	30 Jan 2011, 21:25:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	493520
Run time	11 days 6 hours 23 min 19 sec
CPU time	9 days 15 hours 52 min 49 sec
Validate state	Invalid
Credit	3,397.07
Device peak FLOPS	1.94 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit requCPDN Monitor - Quit request from BOINC... 11:57:28 (4416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:29 (4416): No heartbeat from core client for 30 sec - exiting 12:56:01 (2056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:02 (2056): No heartbeat from core client for 30 sec - exiting 13:54:22 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:23 (4424): No heartbeat from core client for 30 sec - exiting 14:52:37 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:38 (5916): No heartbeat from core client for 30 sec - exiting 15:51:06 (3504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:07 (3504): No heartbeat from core client for 30 sec - exiting 16:49:36 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:37 (2120): No heartbeat from core client for 30 sec - exiting 17:47:55 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:56 (4628): No heartbeat from core client for 30 sec - exiting 18:45:56 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:57 (2000): No heartbeat from core client for 30 sec - exiting 19:44:14 (1816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:15 (1816): No heartbeat from core client for 30 sec - exiting 20:42:42 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:43 (5072): No heartbeat from core client for 30 sec - exiting 21:41:14 (5120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:15 (5120): No heartbeat from core client for 30 sec - exiting 22:39:44 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:45 (5308): No heartbeat from core client for 30 sec - exiting 23:38:09 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:10 (5072): No heartbeat from core client for 30 sec - exiting 00:36:19 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:20 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=608, selfPID=608, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:02:51 (1460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:02:53 (1460): No heartbeat from core client for 30 sec - exiting 12:59:44 (5156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:59:45 (5156): No heartbeat from core client for 30 sec - exiting 13:56:34 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:56:35 (4548): No heartbeat from core client for 30 sec - exiting 14:55:09 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:55:10 (3616): No heartbeat from core client for 30 sec - exiting 15:50:12 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:13 (4316): No heartbeat from core client for 30 sec - exiting 16:47:14 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:15 (5080): No heartbeat from core client for 30 sec - exiting 17:44:16 (4772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:17 (4772): No heartbeat from core client for 30 sec - exiting 18:42:05 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:06 (4264): No heartbeat from core client for 30 sec - exiting 19:36:16 (2092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:17 (2092): No heartbeat from core client for 30 sec - exiting 20:32:35 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:36 (6116): No heartbeat from core client for 30 sec - exiting 21:29:08 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:09 (2724): No heartbeat from core client for 30 sec - exiting 22:25:46 (568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:47 (568): No heartbeat from core client for 30 sec - exiting 23:22:41 (6244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:22:42 (6244): No heartbeat from core client for 30 sec - exiting 00:18:39 (7132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:40 (7132): No heartbeat from core client for 30 sec - exiting 01:14:47 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:14:48 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:23:40 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:41 (5960): No heartbeat from core client for 30 sec - exiting 20:19:26 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:27 (1072): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 21:15:19 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:20 (5352): No heartbeat from core client for 30 sec - exiting 22:11:20 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:11:21 (3096): No heartbeat from core client for 30 sec - exiting 23:07:20 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:21 (3948): No heartbeat from core client for 30 sec - exiting 00:03:07 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:09 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:41:14 (768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:41:15 (768): No heartbeat from core client for 30 sec - exiting 23:38:14 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:15 (4932): No heartbeat from core client for 30 sec - exiting 00:34:44 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:45 (4440): No heartbeat from core client for 30 sec - exiting 16:59:04 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:05 (5576): No heartbeat from core client for 30 sec - exiting 17:53:00 (844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:01 (844): No heartbeat from core client for 30 sec - exiting 18:45:33 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:34 (5724): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:37:05 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:06 (7680): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:23:59 (10208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:00 (10208): No heartbeat from core client for 30 sec - exiting 22:17:15 (10104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:16 (10104): No heartbeat from core client for 30 sec - exiting 23:10:54 (8968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:56 (8968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:52:11 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:12 (4572): No heartbeat from core client for 30 sec - exiting 11:41:13 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:14 (4948): No heartbeat from core client for 30 sec - exiting 12:36:01 (600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:02 (600): No heartbeat from core client for 30 sec - exiting 13:29:50 (1056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:51 (1056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:23:46 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:47 (3256): No heartbeat from core client for 30 sec - exiting 15:18:14 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:18:15 (4312): No heartbeat from core client for 30 sec - exiting 16:12:54 (632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:12:55 (632): No heartbeat from core client for 30 sec - exiting 18:00:05 (6660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:06 (6660): No heartbeat from core client for 30 sec - exiting 18:53:50 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:51 (8120): No heartbeat from core client for 30 sec - exiting 19:47:38 (6704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:39 (6704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:41:40 (7136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:41 (7136): No heartbeat from core client for 30 sec - exiting 21:35:58 (6224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:35:59 (6224): No heartbeat from core client for 30 sec - exiting 22:30:26 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:30:27 (1760): No heartbeat from core client for 30 sec - exiting 23:24:55 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:56 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4720, selfPID=4720, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 21:40:02 (1424): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jan 2011 22:15:53	493520	12419876	famous_xkdl_1499_200_007088240_0	1,029,626	835,726	0.8117
26 Jan 2011 10:22:57	493520	12419876	famous_xkdl_1499_200_007088240_0	1,020,266	828,483	0.8120
26 Jan 2011 08:11:12	493520	12419876	famous_xkdl_1499_200_007088240_0	1,010,906	821,245	0.8124
25 Jan 2011 19:53:37	493520	12419876	famous_xkdl_1499_200_007088240_0	1,001,546	813,846	0.8126
25 Jan 2011 17:14:07	493520	12419876	famous_xkdl_1499_200_007088240_0	992,186	806,218	0.8126
25 Jan 2011 14:44:02	493520	12419876	famous_xkdl_1499_200_007088240_0	982,826	798,265	0.8122
25 Jan 2011 00:27:01	493520	12419876	famous_xkdl_1499_200_007088240_0	973,466	790,827	0.8124
24 Jan 2011 21:16:45	493520	12419876	famous_xkdl_1499_200_007088240_0	964,106	783,315	0.8125
24 Jan 2011 18:22:49	493520	12419876	famous_xkdl_1499_200_007088240_0	954,746	775,677	0.8124
24 Jan 2011 15:55:05	493520	12419876	famous_xkdl_1499_200_007088240_0	945,386	768,064	0.8124
24 Jan 2011 13:32:55	493520	12419876	famous_xkdl_1499_200_007088240_0	936,026	760,350	0.8123
24 Jan 2011 11:13:21	493520	12419876	famous_xkdl_1499_200_007088240_0	926,666	752,603	0.8122
23 Jan 2011 21:27:14	493520	12419876	famous_xkdl_1499_200_007088240_0	917,306	744,748	0.8119
23 Jan 2011 19:02:00	493520	12419876	famous_xkdl_1499_200_007088240_0	907,946	737,056	0.8118
23 Jan 2011 16:21:33	493520	12419876	famous_xkdl_1499_200_007088240_0	898,586	728,989	0.8113
23 Jan 2011 12:27:18	493520	12419876	famous_xkdl_1499_200_007088240_0	889,226	720,898	0.8107
22 Jan 2011 23:28:59	493520	12419876	famous_xkdl_1499_200_007088240_0	879,866	712,673	0.8100
22 Jan 2011 21:25:37	493520	12419876	famous_xkdl_1499_200_007088240_0	870,506	705,202	0.8101
22 Jan 2011 19:18:54	493520	12419876	famous_xkdl_1499_200_007088240_0	861,146	697,753	0.8103
22 Jan 2011 15:59:45	493520	12419876	famous_xkdl_1499_200_007088240_0	851,786	690,259	0.8104