Task 12992456

Name	hadcm3n_s6gb_1940_40_007300542_2
Workunit	7497966
Created	21 Jun 2011, 0:54:55 UTC
Sent	21 Jun 2011, 0:55:40 UTC
Report deadline	20 Sep 2011, 8:22:51 UTC
Received	16 Jul 2011, 20:44:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1019465
Run time	5 days 8 hours 43 min 50 sec
CPU time	3 days 17 hours 49 min 16 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 14:09:34 (3244): No heartbeat from core client for 30 sec - exiting 14:09:35 (3244): No heartbeat from core client for 30 sec - exiting 14:09:36 (3244): No heartbeat from core client for 30 sec - exiting 14:09:37 (3244): No heartbeat from core client for 30 sec - exiting 14:09:38 (3244): No heartbeat from core client for 30 sec - exiting 14:09:39 (3244): No heartbeat from core client for 30 sec - exiting 14:09:40 (3244): No heartbeat from core client for 30 sec - exiting 14:09:41 (3244): No heartbeat from core client for 30 sec - exiting 14:09:42 (3244): No heartbeat from core client for 30 sec - exiting 14:09:43 (3244): No heartbeat from core client for 30 sec - exiting 14:09:44 (3244): No heartbeat from core client for 30 sec - exiting 14:09:45 (3244): No heartbeat from core client for 30 sec - exiting 14:09:46 (3244): No heartbeat from core client for 30 sec - exiting 14:09:47 (3244): No heartbeat from core client for 30 sec - exiting 14:09:48 (3244): No heartbeat from core client for 30 sec - exiting 14:09:49 (3244): No heartbeat from core client for 30 sec - exiting 14:09:50 (3244): No heartbeat from core client for 30 sec - exiting 14:09:51 (3244): No heartbeat from core client for 30 sec - exiting 14:09:52 (3244): No heartbeat from core client for 30 sec - exiting 14:09:53 (3244): No heartbeat from core client for 30 sec - exiting 14:09:54 (3244): No heartbeat from core client for 30 sec - exiting 14:09:55 (3244): No heartbeat from core client for 30 sec - exiting 14:09:56 (3244): No heartbeat from core client for 30 sec - exiting 14:09:57 (3244): No heartbeat from core client for 30 sec - exiting 14:09:58 (3244): No heartbeat from core client for 30 sec - exiting 14:09:59 (3244): No heartbeat from core client for 30 sec - exiting 14:10:00 (3244): No heartbeat from core client for 30 sec - exiting 14:10:01 (3244): No heartbeat from core client for 30 sec - exiting 14:10:02 (3244): No heartbeat from core client for 30 sec - exiting 14:10:03 (3244): No heartbeat from core client for 30 sec - exiting 14:10:04 (3244): No heartbeat from core client for 30 sec - exiting 14:10:05 (3244): No heartbeat from core client for 30 sec - exiting 14:10:06 (3244): No heartbeat from core client for 30 sec - exiting 14:10:07 (3244): No heartbeat from core client for 30 sec - exiting 14:10:08 (3244): No heartbeat from core client for 30 sec - exiting 14:10:09 (3244): No heartbeat from core client for 30 sec - exiting 14:10:10 (3244): No heartbeat from core client for 30 sec - exiting 14:10:11 (3244): No heartbeat from core client for 30 sec - exiting 14:10:12 (3244): No heartbeat from core client for 30 sec - exiting 14:10:13 (3244): No heartbeat from core client for 30 sec - exiting 14:10:14 (3244): No heartbeat from core client for 30 sec - exiting 14:10:15 (3244): No heartbeat from core client for 30 sec - exiting 14:10:16 (3244): No heartbeat from core client for 30 sec - exiting 14:10:17 (3244): No heartbeat from core client for 30 sec - exiting 14:10:18 (3244): No heartbeat from core client for 30 sec - exiting 14:10:19 (3244): No heartbeat from core client for 30 sec - exiting 14:10:20 (3244): No heartbeat from core client for 30 sec - exiting 14:10:21 (3244): No heartbeat from core client for 30 sec - exiting 14:10:22 (3244): No heartbeat from core client for 30 sec - exiting 14:10:23 (3244): No heartbeat from core client for 30 sec - exiting 14:10:24 (3244): No heartbeat from core client for 30 sec - exiting 14:10:25 (3244): No heartbeat from core client for 30 sec - exiting 14:10:26 (3244): No heartbeat from core client for 30 sec - exiting 14:10:27 (3244): No heartbeat from core client for 30 sec - exiting 14:10:28 (3244): No heartbeat from core client for 30 sec - exiting 14:10:29 (3244): No heartbeat from core client for 30 sec - exiting 14:10:30 (3244): No heartbeat from core client for 30 sec - exiting 14:10:31 (3244): No heartbeat from core client for 30 sec - exiting 14:10:32 (3244): No heartbeat from core client for 30 sec - exiting 14:10:33 (3244): No heartbeat from core client for 30 sec - exiting 14:10:34 (3244): No heartbeat from core client for 30 sec - exiting 14:10:35 (3244): No heartbeat from core client for 30 sec - exiting 14:10:36 (3244): No heartbeat from core client for 30 sec - exiting 14:10:37 (3244): No heartbeat from core client for 30 sec - exiting 14:10:38 (3244): No heartbeat from core client for 30 sec - exiting 14:10:39 (3244): No heartbeat from core client for 30 sec - exiting 14:10:40 (3244): No heartbeat from core client for 30 sec - exiting 14:10:41 (3244): No heartbeat from core client for 30 sec - exiting 14:10:42 (3244): No heartbeat from core client for 30 sec - exiting 14:10:43 (3244): No heartbeat from core client for 30 sec - exiting 14:10:44 (3244): No heartbeat from core client for 30 sec - exiting 14:10:45 (3244): No heartbeat from core client for 30 sec - exiting 14:10:46 (3244): No heartbeat from core client for 30 sec - exiting 14:10:47 (3244): No heartbeat from core client for 30 sec - exiting 14:10:48 (3244): No heartbeat from core client for 30 sec - exiting 14:10:49 (3244): No heartbeat from core client for 30 sec - exiting 14:10:50 (3244): No heartbeat from core client for 30 sec - exiting 14:10:51 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:52 (3244): No heartbeat from core client for 30 sec - exiting 14:10:53 (3244): No heartbeat from core client for 30 sec - exiting 14:13:21 (1532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:48:11 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:13:38 (3996): No heartbeat from core client for 30 sec - exiting 07:13:39 (3996): No heartbeat from core client for 30 sec - exiting 07:13:40 (3996): No heartbeat from core client for 30 sec - exiting 07:13:41 (3996): No heartbeat from core client for 30 sec - exiting 07:13:42 (3996): No heartbeat from core client for 30 sec - exiting 07:13:43 (3996): No heartbeat from core client for 30 sec - exiting 07:13:44 (3996): No heartbeat from core client for 30 sec - exiting 07:13:45 (3996): No heartbeat from core client for 30 sec - exiting 07:13:46 (3996): No heartbeat from core client for 30 sec - exiting 07:13:47 (3996): No heartbeat from core client for 30 sec - exiting 07:13:48 (3996): No heartbeat from core client for 30 sec - exiting 07:13:49 (3996): No heartbeat from core client for 30 sec - exiting 07:13:50 (3996): No heartbeat from core client for 30 sec - exiting 07:13:51 (3996): No heartbeat from core client for 30 sec - exiting 07:13:52 (3996): No heartbeat from core client for 30 sec - exiting 07:13:53 (3996): No heartbeat from core client for 30 sec - exiting 07:13:54 (3996): No heartbeat from core client for 30 sec - exiting 07:13:55 (3996): No heartbeat from core client for 30 sec - exiting 07:13:56 (3996): No heartbeat from core client for 30 sec - exiting 07:13:57 (3996): No heartbeat from core client for 30 sec - exiting 07:13:58 (3996): No heartbeat from core client for 30 sec - exiting 07:13:59 (3996): No heartbeat from core client for 30 sec - exiting 07:14:00 (3996): No heartbeat from core client for 30 sec - exiting 07:14:01 (3996): No heartbeat from core client for 30 sec - exiting 07:14:02 (3996): No heartbeat from core client for 30 sec - exiting 07:14:03 (3996): No heartbeat from core client for 30 sec - exiting 07:14:04 (3996): No heartbeat from core client for 30 sec - exiting 07:14:05 (3996): No heartbeat from core client for 30 sec - exiting 07:14:06 (3996): No heartbeat from core client for 30 sec - exiting 07:14:07 (3996): No heartbeat from core client for 30 sec - exiting 07:14:08 (3996): No heartbeat from core client for 30 sec - exiting 07:14:09 (3996): No heartbeat from core client for 30 sec - exiting 07:14:10 (3996): No heartbeat from core client for 30 sec - exiting 07:14:11 (3996): No heartbeat from core client for 30 sec - exiting 07:14:12 (3996): No heartbeat from core client for 30 sec - exiting 07:14:13 (3996): No heartbeat from core client for 30 sec - exiting 07:14:14 (3996): No heartbeat from core client for 30 sec - exiting 07:14:15 (3996): No heartbeat from core client for 30 sec - exiting 07:14:16 (3996): No heartbeat from core client for 30 sec - exiting 07:14:17 (3996): No heartbeat from core client for 30 sec - exiting 07:14:18 (3996): No heartbeat from core client for 30 sec - exiting 07:14:19 (3996): No heartbeat from core client for 30 sec - exiting 07:14:20 (3996): No heartbeat from core client for 30 sec - exiting 07:14:21 (3996): No heartbeat from core client for 30 sec - exiting 07:14:22 (3996): No heartbeat from core client for 30 sec - exiting 07:14:23 (3996): No heartbeat from core client for 30 sec - exiting 07:14:24 (3996): No heartbeat from core client for 30 sec - exiting 07:14:25 (3996): No heartbeat from core client for 30 sec - exiting 07:14:26 (3996): No heartbeat from core client for 30 sec - exiting 07:14:27 (3996): No heartbeat from core client for 30 sec - exiting 07:14:28 (3996): No heartbeat from core client for 30 sec - exiting 07:14:29 (3996): No heartbeat from core client for 30 sec - exiting 07:14:30 (3996): No heartbeat from core client for 30 sec - exiting 07:14:31 (3996): No heartbeat from core client for 30 sec - exiting 07:14:32 (3996): No heartbeat from core client for 30 sec - exiting 07:14:33 (3996): No heartbeat from core client for 30 sec - exiting 07:14:34 (3996): No heartbeat from core client for 30 sec - exiting 07:14:35 (3996): No heartbeat from core client for 30 sec - exiting 07:14:36 (3996): No heartbeat from core client for 30 sec - exiting 07:14:37 (3996): No heartbeat from core client for 30 sec - exiting 07:14:38 (3996): No heartbeat from core client for 30 sec - exiting 07:14:39 (3996): No heartbeat from core client for 30 sec - exiting 07:14:40 (3996): No heartbeat from core client for 30 sec - exiting 07:14:41 (3996): No heartbeat from core client for 30 sec - exiting 07:14:42 (3996): No heartbeat from core client for 30 sec - exiting 07:14:43 (3996): No heartbeat from core client for 30 sec - exiting 07:14:44 (3996): No heartbeat from core client for 30 sec - exiting 07:14:45 (3996): No heartbeat from core client for 30 sec - exiting 07:14:46 (3996): No heartbeat from core client for 30 sec - exiting 07:14:47 (3996): No heartbeat from core client for 30 sec - exiting 07:14:48 (3996): No heartbeat from core client for 30 sec - exiting 07:14:49 (3996): No heartbeat from core client for 30 sec - exiting 07:14:50 (3996): No heartbeat from core client for 30 sec - exiting 07:14:51 (3996): No heartbeat from core client for 30 sec - exiting 07:14:52 (3996): No heartbeat from core client for 30 sec - exiting 07:14:53 (3996): No heartbeat from core client for 30 sec - exiting 07:14:54 (3996): No heartbeat from core client for 30 sec - exiting 07:14:55 (3996): No heartbeat from core client for 30 sec - exiting 07:14:56 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:44 (1552): No heartbeat from core client for 30 sec - exiting 18:20:45 (1552): No heartbeat from core client for 30 sec - exiting 18:20:46 (1552): No heartbeat from core client for 30 sec - exiting 18:20:47 (1552): No heartbeat from core client for 30 sec - exiting 18:20:48 (1552): No heartbeat from core client for 30 sec - exiting 18:20:49 (1552): No heartbeat from core client for 30 sec - exiting 18:20:50 (1552): No heartbeat from core client for 30 sec - exiting 18:20:51 (1552): No heartbeat from core client for 30 sec - exiting 18:20:52 (1552): No heartbeat from core client for 30 sec - exiting 18:20:53 (1552): No heartbeat from core client for 30 sec - exiting 18:20:54 (1552): No heartbeat from core client for 30 sec - exiting 18:20:55 (1552): No heartbeat from core client for 30 sec - exiting 18:20:56 (1552): No heartbeat from core client for 30 sec - exiting 18:20:57 (1552): No heartbeat from core client for 30 sec - exiting 18:20:58 (1552): No heartbeat from core client for 30 sec - exiting 18:20:59 (1552): No heartbeat from core client for 30 sec - exiting 18:21:00 (1552): No heartbeat from core client for 30 sec - exiting 18:21:01 (1552): No heartbeat from core client for 30 sec - exiting 18:21:02 (1552): No heartbeat from core client for 30 sec - exiting 18:21:03 (1552): No heartbeat from core client for 30 sec - exiting 18:21:04 (1552): No heartbeat from core client for 30 sec - exiting 18:21:05 (1552): No heartbeat from core client for 30 sec - exiting 18:21:06 (1552): No heartbeat from core client for 30 sec - exiting 18:21:07 (1552): No heartbeat from core client for 30 sec - exiting 18:21:08 (1552): No heartbeat from core client for 30 sec - exiting 18:21:09 (1552): No heartbeat from core client for 30 sec - exiting 18:21:10 (1552): No heartbeat from core client for 30 sec - exiting 18:21:11 (1552): No heartbeat from core client for 30 sec - exiting 18:21:12 (1552): No heartbeat from core client for 30 sec - exiting 18:21:13 (1552): No heartbeat from core client for 30 sec - exiting 18:21:14 (1552): No heartbeat from core client for 30 sec - exiting 18:21:15 (1552): No heartbeat from core client for 30 sec - exiting 18:21:16 (1552): No heartbeat from core client for 30 sec - exiting 18:21:17 (1552): No heartbeat from core client for 30 sec - exiting 18:21:18 (1552): No heartbeat from core client for 30 sec - exiting 18:21:19 (1552): No heartbeat from core client for 30 sec - exiting 18:21:20 (1552): No heartbeat from core client for 30 sec - exiting 18:21:21 (1552): No heartbeat from core client for 30 sec - exiting 18:21:22 (1552): No heartbeat from core client for 30 sec - exiting 18:21:23 (1552): No heartbeat from core client for 30 sec - exiting 18:21:24 (1552): No heartbeat from core client for 30 sec - exiting 18:21:25 (1552): No heartbeat from core client for 30 sec - exiting 18:21:26 (1552): No heartbeat from core client for 30 sec - exiting 18:21:27 (1552): No heartbeat from core client for 30 sec - exiting 18:21:28 (1552): No heartbeat from core client for 30 sec - exiting 18:21:29 (1552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:51:09 (1032): No heartbeat from core client for 30 sec - exiting 19:51:10 (1032): No heartbeat from core client for 30 sec - exiting 19:51:11 (1032): No heartbeat from core client for 30 sec - exiting 19:51:12 (1032): No heartbeat from core client for 30 sec - exiting 19:51:13 (1032): No heartbeat from core client for 30 sec - exiting 19:51:14 (1032): No heartbeat from core client for 30 sec - exiting 19:51:15 (1032): No heartbeat from core client for 30 sec - exiting 19:51:16 (1032): No heartbeat from core client for 30 sec - exiting 19:51:17 (1032): No heartbeat from core client for 30 sec - exiting 19:51:18 (1032): No heartbeat from core client for 30 sec - exiting 19:51:19 (1032): No heartbeat from core client for 30 sec - exiting 19:51:20 (1032): No heartbeat from core client for 30 sec - exiting 19:51:21 (1032): No heartbeat from core client for 30 sec - exiting 19:51:22 (1032): No heartbeat from core client for 30 sec - exiting 19:51:23 (1032): No heartbeat from core client for 30 sec - exiting 19:51:24 (1032): No heartbeat from core client for 30 sec - exiting 19:51:25 (1032): No heartbeat from core client for 30 sec - exiting 19:51:26 (1032): No heartbeat from core client for 30 sec - exiting 19:51:27 (1032): No heartbeat from core client for 30 sec - exiting 19:51:28 (1032): No heartbeat from core client for 30 sec - exiting 19:51:29 (1032): No heartbeat from core client for 30 sec - exiting 19:51:30 (1032): No heartbeat from core client for 30 sec - exiting 19:51:31 (1032): No heartbeat from core client for 30 sec - exiting 19:51:32 (1032): No heartbeat from core client for 30 sec - exiting 19:51:33 (1032): No heartbeat from core client for 30 sec - exiting 19:51:34 (1032): No heartbeat from core client for 30 sec - exiting 19:51:35 (1032): No heartbeat from core client for 30 sec - exiting 19:51:36 (1032): No heartbeat from core client for 30 sec - exiting 19:51:37 (1032): No heartbeat from core client for 30 sec - exiting 19:51:38 (1032): No heartbeat from core client for 30 sec - exiting 19:51:39 (1032): No heartbeat from core client for 30 sec - exiting 19:51:40 (1032): No heartbeat from core client for 30 sec - exiting 19:51:41 (1032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:44:27 (816): No heartbeat from core client for 30 sec - exiting 19:44:29 (816): No heartbeat from core client for 30 sec - exiting 19:44:30 (816): No heartbeat from core client for 30 sec - exiting 19:44:31 (816): No heartbeat from core client for 30 sec - exiting 19:44:32 (816): No heartbeat from core client for 30 sec - exiting 19:44:33 (816): No heartbeat from core client for 30 sec - exiting 19:44:34 (816): No heartbeat from core client for 30 sec - exiting 19:44:35 (816): No heartbeat from core client for 30 sec - exiting 19:44:36 (816): No heartbeat from core client for 30 sec - exiting 19:44:37 (816): No heartbeat from core client for 30 sec - exiting 19:44:38 (816): No heartbeat from core client for 30 sec - exiting 19:44:39 (816): No heartbeat from core client for 30 sec - exiting 19:44:40 (816): No heartbeat from core client for 30 sec - exiting 19:44:41 (816): No heartbeat from core client for 30 sec - exiting 19:44:42 (816): No heartbeat from core client for 30 sec - exiting 19:44:43 (816): No heartbeat from core client for 30 sec - exiting 19:44:44 (816): No heartbeat from core client for 30 sec - exiting 19:44:45 (816): No heartbeat from core client for 30 sec - exiting 19:44:46 (816): No heartbeat from core client for 30 sec - exiting 19:44:47 (816): No heartbeat from core client for 30 sec - exiting 19:44:48 (816): No heartbeat from core client for 30 sec - exiting 19:44:49 (816): No heartbeat from core client for 30 sec - exiting 19:44:50 (816): No heartbeat from core client for 30 sec - exiting 19:44:51 (816): No heartbeat from core client for 30 sec - exiting 19:44:52 (816): No heartbeat from core client for 30 sec - exiting 19:44:53 (816): No heartbeat from core client for 30 sec - exiting 19:44:54 (816): No heartbeat from core client for 30 sec - exiting 19:44:55 (816): No heartbeat from core client for 30 sec - exiting 19:44:56 (816): No heartbeat from core client for 30 sec - exiting 19:44:57 (816): No heartbeat from core client for 30 sec - exiting 19:44:58 (816): No heartbeat from core client for 30 sec - exiting 19:44:59 (816): No heartbeat from core client for 30 sec - exiting 19:45:00 (816): No heartbeat from core client for 30 sec - exiting 19:45:01 (816): No heartbeat from core client for 30 sec - exiting 19:45:02 (816): No heartbeat from core client for 30 sec - exiting 19:45:03 (816): No heartbeat from core client for 30 sec - exiting 19:45:04 (816): No heartbeat from core client for 30 sec - exiting 19:45:05 (816): No heartbeat from core client for 30 sec - exiting 19:45:06 (816): No heartbeat from core client for 30 sec - exiting 19:45:07 (816): No heartbeat from core client for 30 sec - exiting 19:45:08 (816): No heartbeat from core client for 30 sec - exiting 19:45:09 (816): No heartbeat from core client for 30 sec - exiting 19:45:10 (816): No heartbeat from core client for 30 sec - exiting 19:45:11 (816): No heartbeat from core client for 30 sec - exiting 19:45:12 (816): No heartbeat from core client for 30 sec - exiting 19:45:13 (816): No heartbeat from core client for 30 sec - exiting 19:45:14 (816): No heartbeat from core client for 30 sec - exiting 19:45:15 (816): No heartbeat from core client for 30 sec - exiting 19:45:16 (816): No heartbeat from core client for 30 sec - exiting 19:45:17 (816): No heartbeat from core client for 30 sec - exiting 19:45:18 (816): No heartbeat from core client for 30 sec - exiting 19:45:19 (816): No heartbeat from core client for 30 sec - exiting 19:45:20 (816): No heartbeat from core client for 30 sec - exiting 19:45:21 (816): No heartbeat from core client for 30 sec - exiting 19:45:22 (816): No heartbeat from core client for 30 sec - exiting 19:45:23 (816): No heartbeat from core client for 30 sec - exiting 19:45:24 (816): No heartbeat from core client for 30 sec - exiting 19:45:25 (816): No heartbeat from core client for 30 sec - exiting 19:45:26 (816): No heartbeat from core client for 30 sec - exiting 19:45:27 (816): No heartbeat from core client for 30 sec - exiting 19:45:28 (816): No heartbeat from core client for 30 sec - exiting 19:45:29 (816): No heartbeat from core client for 30 sec - exiting 19:45:30 (816): No heartbeat from core client for 30 sec - exiting 19:45:31 (816): No heartbeat from core client for 30 sec - exiting 19:45:32 (816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:33:45 (3596): No heartbeat from core client for 30 sec - exiting 14:33:46 (3596): No heartbeat from core client for 30 sec - exiting 14:33:47 (3596): No heartbeat from core client for 30 sec - exiting 14:33:48 (3596): No heartbeat from core client for 30 sec - exiting 14:33:49 (3596): No heartbeat from core client for 30 sec - exiting 14:33:50 (3596): No heartbeat from core client for 30 sec - exiting 14:33:51 (3596): No heartbeat from core client for 30 sec - exiting 14:33:52 (3596): No heartbeat from core client for 30 sec - exiting 14:33:53 (3596): No heartbeat from core client for 30 sec - exiting 14:33:54 (3596): No heartbeat from core client for 30 sec - exiting 14:33:55 (3596): No heartbeat from core client for 30 sec - exiting 14:33:56 (3596): No heartbeat from core client for 30 sec - exiting 14:33:57 (3596): No heartbeat from core client for 30 sec - exiting 14:33:58 (3596): No heartbeat from core client for 30 sec - exiting 14:33:59 (3596): No heartbeat from core client for 30 sec - exiting 14:34:00 (3596): No heartbeat from core client for 30 sec - exiting 14:34:01 (3596): No heartbeat from core client for 30 sec - exiting 14:34:02 (3596): No heartbeat from core client for 30 sec - exiting 14:34:03 (3596): No heartbeat from core client for 30 sec - exiting 14:34:04 (3596): No heartbeat from core client for 30 sec - exiting 14:34:05 (3596): No heartbeat from core client for 30 sec - exiting 14:34:06 (3596): No heartbeat from core client for 30 sec - exiting 14:34:07 (3596): No heartbeat from core client for 30 sec - exiting 14:34:08 (3596): No heartbeat from core client for 30 sec - exiting 14:34:09 (3596): No heartbeat from core client for 30 sec - exiting 14:34:10 (3596): No heartbeat from core client for 30 sec - exiting 14:34:11 (3596): No heartbeat from core client for 30 sec - exiting 14:34:12 (3596): No heartbeat from core client for 30 sec - exiting 14:34:13 (3596): No heartbeat from core client for 30 sec - exiting 14:34:14 (3596): No heartbeat from core client for 30 sec - exiting 14:34:15 (3596): No heartbeat from core client for 30 sec - exiting 14:34:16 (3596): No heartbeat from core client for 30 sec - exiting 14:34:17 (3596): No heartbeat from core client for 30 sec - exiting 14:34:18 (3596): No heartbeat from core client for 30 sec - exiting 14:34:19 (3596): No heartbeat from core client for 30 sec - exiting 14:34:20 (3596): No heartbeat from core client for 30 sec - exiting 14:34:21 (3596): No heartbeat from core client for 30 sec - exiting 14:34:22 (3596): No heartbeat from core client for 30 sec - exiting 14:34:23 (3596): No heartbeat from core client for 30 sec - exiting 14:34:24 (3596): No heartbeat from core client for 30 sec - exiting 14:34:25 (3596): No heartbeat from core client for 30 sec - exiting 14:34:26 (3596): No heartbeat from core client for 30 sec - exiting 14:34:27 (3596): No heartbeat from core client for 30 sec - exiting 14:34:28 (3596): No heartbeat from core client for 30 sec - exiting 14:34:29 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:01:54 (2112): No heartbeat from core client for 30 sec - exiting 19:01:55 (2112): No heartbeat from core client for 30 sec - exiting 19:01:56 (2112): No heartbeat from core client for 30 sec - exiting 19:01:57 (2112): No heartbeat from core client for 30 sec - exiting 19:01:58 (2112): No heartbeat from core client for 30 sec - exiting 19:01:59 (2112): No heartbeat from core client for 30 sec - exiting 19:02:00 (2112): No heartbeat from core client for 30 sec - exiting 19:02:01 (2112): No heartbeat from core client for 30 sec - exiting 19:02:02 (2112): No heartbeat from core client for 30 sec - exiting 19:02:03 (2112): No heartbeat from core client for 30 sec - exiting 19:02:04 (2112): No heartbeat from core client for 30 sec - exiting 19:02:05 (2112): No heartbeat from core client for 30 sec - exiting 19:02:06 (2112): No heartbeat from core client for 30 sec - exiting 19:02:07 (2112): No heartbeat from core client for 30 sec - exiting 19:02:08 (2112): No heartbeat from core client for 30 sec - exiting 19:02:09 (2112): No heartbeat from core client for 30 sec - exiting 19:02:10 (2112): No heartbeat from core client for 30 sec - exiting 19:02:11 (2112): No heartbeat from core client for 30 sec - exiting 19:02:12 (2112): No heartbeat from core client for 30 sec - exiting 19:02:13 (2112): No heartbeat from core client for 30 sec - exiting 19:02:14 (2112): No heartbeat from core client for 30 sec - exiting 19:02:15 (2112): No heartbeat from core client for 30 sec - exiting 19:02:16 (2112): No heartbeat from core client for 30 sec - exiting 19:02:17 (2112): No heartbeat from core client for 30 sec - exiting 19:02:18 (2112): No heartbeat from core client for 30 sec - exiting 19:02:19 (2112): No heartbeat from core client for 30 sec - exiting 19:02:20 (2112): No heartbeat from core client for 30 sec - exiting 19:02:21 (2112): No heartbeat from core client for 30 sec - exiting 19:02:22 (2112): No heartbeat from core client for 30 sec - exiting 19:02:23 (2112): No heartbeat from core client for 30 sec - exiting 19:02:24 (2112): No heartbeat from core client for 30 sec - exiting 19:02:25 (2112): No heartbeat from core client for 30 sec - exiting 19:02:26 (2112): No heartbeat from core client for 30 sec - exiting 19:02:27 (2112): No heartbeat from core client for 30 sec - exiting 19:02:28 (2112): No heartbeat from core client for 30 sec - exiting 19:02:29 (2112): No heartbeat from core client for 30 sec - exiting 19:02:30 (2112): No heartbeat from core client for 30 sec - exiting 19:02:31 (2112): No heartbeat from core client for 30 sec - exiting 19:02:32 (2112): No heartbeat from core client for 30 sec - exiting 19:02:33 (2112): No heartbeat from core client for 30 sec - exiting 19:02:34 (2112): No heartbeat from core client for 30 sec - exiting 19:02:35 (2112): No heartbeat from core client for 30 sec - exiting 19:02:36 (2112): No heartbeat from core client for 30 sec - exiting 19:02:37 (2112): No heartbeat from core client for 30 sec - exiting 19:02:38 (2112): No heartbeat from core client for 30 sec - exiting 19:02:39 (2112): No heartbeat from core client for 30 sec - exiting 19:02:40 (2112): No heartbeat from core client for 30 sec - exiting 19:02:41 (2112): No heartbeat from core client for 30 sec - exiting 19:02:42 (2112): No heartbeat from core client for 30 sec - exiting 19:02:43 (2112): No heartbeat from core client for 30 sec - exiting 19:02:44 (2112): No heartbeat from core client for 30 sec - exiting 19:02:45 (2112): No heartbeat from core client for 30 sec - exiting 19:02:46 (2112): No heartbeat from core client for 30 sec - exiting 19:02:47 (2112): No heartbeat from core client for 30 sec - exiting 19:02:48 (2112): No heartbeat from core client for 30 sec - exiting 19:02:49 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:48:58 (3876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 15:41:01	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	233,280	378,887	1.6242
25 Jul 2011 15:00:42	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	207,360	339,446	1.6370
25 Jul 2011 14:52:28	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	181,440	301,417	1.6612
10 Jul 2011 23:50:12	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	155,520	260,247	1.6734
01 Jul 2011 00:44:56	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	129,600	217,662	1.6795
30 Jun 2011 08:24:24	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	103,680	175,985	1.6974
27 Jun 2011 11:24:45	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	77,760	133,014	1.7106
26 Jun 2011 19:13:48	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	51,840	92,498	1.7843
26 Jun 2011 03:14:38	1019465	12992456	hadcm3n_s6gb_1940_40_007300542_2	25,920	47,244	1.8227