Task 13295460

Name	hadcm3n_o7ab_1940_40_007423260_1
Workunit	7620895
Created	25 Aug 2011, 9:00:02 UTC
Sent	25 Aug 2011, 10:07:30 UTC
Report deadline	24 Nov 2011, 17:34:41 UTC
Received	12 Sep 2011, 23:52:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1091281
Run time	4 days 17 hours 52 min 39 sec
CPU time	4 days 10 hours 53 min 50 sec
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	1.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 20:11:07 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:02 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:33 (6164): No heartbeat from core client for 30 sec - exiting 05:24:34 (6164): No heartbeat from core client for 30 sec - exiting 05:24:35 (6164): No heartbeat from core client for 30 sec - exiting 05:24:36 (6164): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:36:36 (7124): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:12:05 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:41:54 (2320): No heartbeat from core client for 30 sec - exiting 12:41:55 (2320): No heartbeat from core client for 30 sec - exiting 12:41:56 (2320): No heartbeat from core client for 30 sec - exiting 12:41:57 (2320): No heartbeat from core client for 30 sec - exiting 12:41:58 (2320): No heartbeat from core client for 30 sec - exiting 12:41:59 (2320): No heartbeat from core client for 30 sec - exiting 12:42:00 (2320): No heartbeat from core client for 30 sec - exiting 12:42:01 (2320): No heartbeat from core client for 30 sec - exiting 12:42:02 (2320): No heartbeat from core client for 30 sec - exiting 12:42:03 (2320): No heartbeat from core client for 30 sec - exiting 12:42:04 (2320): No heartbeat from core client for 30 sec - exiting 12:42:05 (2320): No heartbeat from core client for 30 sec - exiting 12:42:06 (2320): No heartbeat from core client for 30 sec - exiting 12:42:07 (2320): No heartbeat from core client for 30 sec - exiting 12:42:08 (2320): No heartbeat from core client for 30 sec - exiting 12:42:09 (2320): No heartbeat from core client for 30 sec - exiting 12:42:10 (2320): No heartbeat from core client for 30 sec - exiting 12:42:11 (2320): No heartbeat from core client for 30 sec - exiting 12:42:12 (2320): No heartbeat from core client for 30 sec - exiting 12:42:13 (2320): No heartbeat from core client for 30 sec - exiting 12:42:14 (2320): No heartbeat from core client for 30 sec - exiting 12:42:15 (2320): No heartbeat from core client for 30 sec - exiting 12:42:16 (2320): No heartbeat from core client for 30 sec - exiting 12:42:17 (2320): No heartbeat from core client for 30 sec - exiting 12:42:18 (2320): No heartbeat from core client for 30 sec - exiting 12:42:19 (2320): No heartbeat from core client for 30 sec - exiting 12:42:20 (2320): No heartbeat from core client for 30 sec - exiting 12:42:21 (2320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:44:16 (5412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:44:56 (5412): No heartbeat from core client for 30 sec - exiting 12:45:02 (5412): No heartbeat from core client for 30 sec - exiting 12:45:03 (5412): No heartbeat from core client for 30 sec - exiting 12:45:04 (5412): No heartbeat from core client for 30 sec - exiting 12:45:05 (5412): No heartbeat from core client for 30 sec - exiting 12:45:06 (5412): No heartbeat from core client for 30 sec - exiting 12:45:07 (5412): No heartbeat from core client for 30 sec - exiting 12:45:08 (5412): No heartbeat from core client for 30 sec - exiting 12:45:11 (5412): No heartbeat from core client for 30 sec - exiting 12:45:12 (5412): No heartbeat from core client for 30 sec - exiting 12:45:13 (5412): No heartbeat from core client for 30 sec - exiting 12:45:14 (5412): No heartbeat from core client for 30 sec - exiting 12:45:15 (5412): No heartbeat from core client for 30 sec - exiting 12:45:16 (5412): No heartbeat from core client for 30 sec - exiting 12:45:17 (5412): No heartbeat from core client for 30 sec - exiting 12:45:18 (5412): No heartbeat from core client for 30 sec - exiting 12:45:19 (5412): No heartbeat from core client for 30 sec - exiting 12:45:20 (5412): No heartbeat from core client for 30 sec - exiting 12:45:21 (5412): No heartbeat from core client for 30 sec - exiting 12:45:22 (5412): No heartbeat from core client for 30 sec - exiting 12:45:23 (5412): No heartbeat from core client for 30 sec - exiting 12:45:24 (5412): No heartbeat from core client for 30 sec - exiting 12:45:25 (5412): No heartbeat from core client for 30 sec - exiting 12:45:26 (5412): No heartbeat from core client for 30 sec - exiting 12:45:27 (5412): No heartbeat from core client for 30 sec - exiting 12:45:28 (5412): No heartbeat from core client for 30 sec - exiting 12:45:29 (5412): No heartbeat from core client for 30 sec - exiting 12:45:30 (5412): No heartbeat from core client for 30 sec - exiting 12:45:31 (5412): No heartbeat from core client for 30 sec - exiting 12:45:32 (5412): No heartbeat from core client for 30 sec - exiting 12:45:33 (5412): No heartbeat from core client for 30 sec - exiting 12:45:34 (5412): No heartbeat from core client for 30 sec - exiting 12:45:35 (5412): No heartbeat from core client for 30 sec - exiting 12:45:36 (5412): No heartbeat from core client for 30 sec - exiting 12:45:37 (5412): No heartbeat from core client for 30 sec - exiting 13:26:08 (6104): No heartbeat from core client for 30 sec - exiting 13:26:14 (6104): No heartbeat from core client for 30 sec - exiting 13:26:15 (6104): No heartbeat from core client for 30 sec - exiting 13:26:16 (6104): No heartbeat from core client for 30 sec - exiting 13:26:17 (6104): No heartbeat from core client for 30 sec - exiting 13:26:18 (6104): No heartbeat from core client for 30 sec - exiting 13:26:19 (6104): No heartbeat from core client for 30 sec - exiting 13:26:20 (6104): No heartbeat from core client for 30 sec - exiting 13:26:21 (6104): No heartbeat from core client for 30 sec - exiting 13:26:22 (6104): No heartbeat from core client for 30 sec - exiting 13:26:23 (6104): No heartbeat from core client for 30 sec - exiting 13:26:24 (6104): No heartbeat from core client for 30 sec - exiting 13:26:25 (6104): No heartbeat from core client for 30 sec - exiting 13:26:26 (6104): No heartbeat from core client for 30 sec - exiting 13:26:27 (6104): No heartbeat from core client for 30 sec - exiting 13:26:28 (6104): No heartbeat from core client for 30 sec - exiting 13:26:29 (6104): No heartbeat from core client for 30 sec - exiting 13:26:30 (6104): No heartbeat from core client for 30 sec - exiting 13:26:31 (6104): No heartbeat from core client for 30 sec - exiting 13:26:32 (6104): No heartbeat from core client for 30 sec - exiting 13:26:33 (6104): No heartbeat from core client for 30 sec - exiting 13:26:34 (6104): No heartbeat from core client for 30 sec - exiting 13:26:35 (6104): No heartbeat from core client for 30 sec - exiting 13:26:36 (6104): No heartbeat from core client for 30 sec - exiting 13:26:37 (6104): No heartbeat from core client for 30 sec - exiting 13:26:38 (6104): No heartbeat from core client for 30 sec - exiting 13:26:39 (6104): No heartbeat from core client for 30 sec - exiting 13:26:40 (6104): No heartbeat from core client for 30 sec - exiting 13:26:41 (6104): No heartbeat from core client for 30 sec - exiting 13:26:44 (6104): No heartbeat from core client for 30 sec - exiting 13:26:45 (6104): No heartbeat from core client for 30 sec - exiting 13:26:46 (6104): No heartbeat from core client for 30 sec - exiting 13:26:47 (6104): No heartbeat from core client for 30 sec - exiting 13:26:51 (6104): No heartbeat from core client for 30 sec - exiting 13:26:52 (6104): No heartbeat from core client for 30 sec - exiting 13:26:53 (6104): No heartbeat from core client for 30 sec - exiting 13:26:54 (6104): No heartbeat from core client for 30 sec - exiting 13:26:55 (6104): No heartbeat from core client for 30 sec - exiting 13:26:56 (6104): No heartbeat from core client for 30 sec - exiting 13:26:57 (6104): No heartbeat from core client for 30 sec - exiting 13:26:58 (6104): No heartbeat from core client for 30 sec - exiting 13:26:59 (6104): No heartbeat from core client for 30 sec - exiting 13:27:00 (6104): No heartbeat from core client for 30 sec - exiting 13:27:01 (6104): No heartbeat from core client for 30 sec - exiting 13:27:02 (6104): No heartbeat from core client for 30 sec - exiting 13:27:03 (6104): No heartbeat from core client for 30 sec - exiting 13:27:04 (6104): No heartbeat from core client for 30 sec - exiting 13:27:05 (6104): No heartbeat from core client for 30 sec - exiting 13:27:06 (6104): No heartbeat from core client for 30 sec - exiting 13:27:07 (6104): No heartbeat from core client for 30 sec - exiting 13:27:08 (6104): No heartbeat from core client for 30 sec - exiting 13:27:09 (6104): No heartbeat from core client for 30 sec - exiting 13:27:10 (6104): No heartbeat from core client for 30 sec - exiting 13:27:11 (6104): No heartbeat from core client for 30 sec - exiting 13:27:12 (6104): No heartbeat from core client for 30 sec - exiting 13:27:13 (6104): No heartbeat from core client for 30 sec - exiting 13:27:14 (6104): No heartbeat from core client for 30 sec - exiting 13:27:15 (6104): No heartbeat from core client for 30 sec - exiting 13:27:16 (6104): No heartbeat from core client for 30 sec - exiting 13:27:17 (6104): No heartbeat from core client for 30 sec - exiting 13:27:18 (6104): No heartbeat from core client for 30 sec - exiting 13:27:19 (6104): No heartbeat from core client for 30 sec - exiting 13:27:20 (6104): No heartbeat from core client for 30 sec - exiting 13:27:21 (6104): No heartbeat from core client for 30 sec - exiting 13:27:22 (6104): No heartbeat from core client for 30 sec - exiting 13:27:23 (6104): No heartbeat from core client for 30 sec - exiting 13:27:24 (6104): No heartbeat from core client for 30 sec - exiting 13:27:25 (6104): No heartbeat from core client for 30 sec - exiting 13:27:26 (6104): No heartbeat from core client for 30 sec - exiting 13:27:27 (6104): No heartbeat from core client for 30 sec - exiting 13:27:28 (6104): No heartbeat from core client for 30 sec - exiting 13:27:29 (6104): No heartbeat from core client for 30 sec - exiting 13:27:30 (6104): No heartbeat from core client for 30 sec - exiting 13:27:31 (6104): No heartbeat from core client for 30 sec - exiting 13:27:32 (6104): No heartbeat from core client for 30 sec - exiting 13:27:33 (6104): No heartbeat from core client for 30 sec - exiting 13:27:34 (6104): No heartbeat from core client for 30 sec - exiting 13:27:35 (6104): No heartbeat from core client for 30 sec - exiting 13:27:36 (6104): No heartbeat from core client for 30 sec - exiting 13:27:37 (6104): No heartbeat from core client for 30 sec - exiting 13:27:38 (6104): No heartbeat from core client for 30 sec - exiting 13:27:39 (6104): No heartbeat from core client for 30 sec - exiting 13:27:40 (6104): No heartbeat from core client for 30 sec - exiting 13:27:41 (6104): No heartbeat from core client for 30 sec - exiting 13:27:42 (6104): No heartbeat from core client for 30 sec - exiting 13:27:43 (6104): No heartbeat from core client for 30 sec - exiting 13:27:44 (6104): No heartbeat from core client for 30 sec - exiting 13:27:45 (6104): No heartbeat from core client for 30 sec - exiting 13:27:46 (6104): No heartbeat from core client for 30 sec - exiting 13:27:47 (6104): No heartbeat from core client for 30 sec - exiting 13:27:48 (6104): No heartbeat from core client for 30 sec - exiting 13:27:49 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:53 (6104): No heartbeat from core client for 30 sec - exiting 13:27:54 (6104): No heartbeat from core client for 30 sec - exiting 13:27:55 (6104): No heartbeat from core client for 30 sec - exiting 13:27:56 (6104): No heartbeat from core client for 30 sec - exiting 13:27:57 (6104): No heartbeat from core client for 30 sec - exiting 13:27:58 (6104): No heartbeat from core client for 30 sec - exiting 13:27:59 (6104): No heartbeat from core client for 30 sec - exiting 13:28:00 (6104): No heartbeat from core client for 30 sec - exiting 13:28:01 (6104): No heartbeat from core client for 30 sec - exiting 13:28:02 (6104): No heartbeat from core client for 30 sec - exiting 13:28:03 (6104): No heartbeat from core client for 30 sec - exiting 13:28:04 (6104): No heartbeat from core client for 30 sec - exiting 13:28:05 (6104): No heartbeat from core client for 30 sec - exiting 13:28:06 (6104): No heartbeat from core client for 30 sec - exiting 13:28:07 (6104): No heartbeat from core client for 30 sec - exiting 13:28:08 (6104): No heartbeat from core client for 30 sec - exiting 13:28:09 (6104): No heartbeat from core client for 30 sec - exiting 13:28:10 (6104): No heartbeat from core client for 30 sec - exiting 13:28:11 (6104): No heartbeat from core client for 30 sec - exiting 13:28:12 (6104): No heartbeat from core client for 30 sec - exiting 13:28:13 (6104): No heartbeat from core client for 30 sec - exiting 13:28:14 (6104): No heartbeat from core client for 30 sec - exiting 13:28:15 (6104): No heartbeat from core client for 30 sec - exiting 13:28:16 (6104): No heartbeat from core client for 30 sec - exiting 13:28:17 (6104): No heartbeat from core client for 30 sec - exiting 13:28:18 (6104): No heartbeat from core client for 30 sec - exiting 13:28:19 (6104): No heartbeat from core client for 30 sec - exiting 14:11:41 (3004): No heartbeat from core client for 30 sec - exiting 14:12:28 (3004): No heartbeat from core client for 30 sec - exiting 14:12:44 (3004): No heartbeat from core client for 30 sec - exiting 14:12:59 (3004): No heartbeat from core client for 30 sec - exiting 14:13:00 (3004): No heartbeat from core client for 30 sec - exiting 14:13:01 (3004): No heartbeat from core client for 30 sec - exiting 14:13:02 (3004): No heartbeat from core client for 30 sec - exiting 14:13:03 (3004): No heartbeat from core client for 30 sec - exiting 14:13:04 (3004): No heartbeat from core client for 30 sec - exiting 14:13:05 (3004): No heartbeat from core client for 30 sec - exiting 14:13:06 (3004): No heartbeat from core client for 30 sec - exiting 14:13:07 (3004): No heartbeat from core client for 30 sec - exiting 14:13:08 (3004): No heartbeat from core client for 30 sec - exiting 14:13:09 (3004): No heartbeat from core client for 30 sec - exiting 14:13:10 (3004): No heartbeat from core client for 30 sec - exiting 14:13:11 (3004): No heartbeat from core client for 30 sec - exiting 14:13:12 (3004): No heartbeat from core client for 30 sec - exiting 14:13:13 (3004): No heartbeat from core client for 30 sec - exiting 14:13:14 (3004): No heartbeat from core client for 30 sec - exiting 14:13:15 (3004): No heartbeat from core client for 30 sec - exiting 14:13:16 (3004): No heartbeat from core client for 30 sec - exiting 14:13:17 (3004): No heartbeat from core client for 30 sec - exiting 14:13:18 (3004): No heartbeat from core client for 30 sec - exiting 14:13:19 (3004): No heartbeat from core client for 30 sec - exiting 14:13:20 (3004): No heartbeat from core client for 30 sec - exiting 14:13:21 (3004): No heartbeat from core client for 30 sec - exiting 14:13:22 (3004): No heartbeat from core client for 30 sec - exiting 14:13:23 (3004): No heartbeat from core client for 30 sec - exiting 14:13:24 (3004): No heartbeat from core client for 30 sec - exiting 14:13:25 (3004): No heartbeat from core client for 30 sec - exiting 14:13:26 (3004): No heartbeat from core client for 30 sec - exiting 14:13:27 (3004): No heartbeat from core client for 30 sec - exiting 14:13:30 (3004): No heartbeat from core client for 30 sec - exiting 14:13:31 (3004): No heartbeat from core client for 30 sec - exiting 14:13:32 (3004): No heartbeat from core client for 30 sec - exiting 14:13:33 (3004): No heartbeat from core client for 30 sec - exiting 14:13:34 (3004): No heartbeat from core client for 30 sec - exiting 14:13:35 (3004): No heartbeat from core client for 30 sec - exiting 14:13:36 (3004): No heartbeat from core client for 30 sec - exiting 14:13:37 (3004): No heartbeat from core client for 30 sec - exiting 14:13:38 (3004): No heartbeat from core client for 30 sec - exiting 14:13:39 (3004): No heartbeat from core client for 30 sec - exiting 14:13:40 (3004): No heartbeat from core client for 30 sec - exiting 14:13:41 (3004): No heartbeat from core client for 30 sec - exiting 14:13:42 (3004): No heartbeat from core client for 30 sec - exiting 14:13:43 (3004): No heartbeat from core client for 30 sec - exiting 14:13:44 (3004): No heartbeat from core client for 30 sec - exiting 14:13:45 (3004): No heartbeat from core client for 30 sec - exiting 14:13:46 (3004): No heartbeat from core client for 30 sec - exiting 14:13:47 (3004): No heartbeat from core client for 30 sec - exiting 14:13:48 (3004): No heartbeat from core client for 30 sec - exiting 14:13:49 (3004): No heartbeat from core client for 30 sec - exiting 14:13:50 (3004): No heartbeat from core client for 30 sec - exiting 14:13:51 (3004): No heartbeat from core client for 30 sec - exiting 14:13:52 (3004): No heartbeat from core client for 30 sec - exiting 14:13:53 (3004): No heartbeat from core client for 30 sec - exiting 14:13:54 (3004): No heartbeat from core client for 30 sec - exiting 14:13:55 (3004): No heartbeat from core client for 30 sec - exiting 14:13:56 (3004): No heartbeat from core client for 30 sec - exiting 14:13:57 (3004): No heartbeat from core client for 30 sec - exiting 14:13:58 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:59 (3004): No heartbeat from core client for 30 sec - exiting 14:14:00 (3004): No heartbeat from core client for 30 sec - exiting 15:03:23 (2272): No heartbeat from core client for 30 sec - exiting 15:03:29 (2272): No heartbeat from core client for 30 sec - exiting 15:03:30 (2272): No heartbeat from core client for 30 sec - exiting 15:03:31 (2272): No heartbeat from core client for 30 sec - exiting 15:03:32 (2272): No heartbeat from core client for 30 sec - exiting 15:03:33 (2272): No heartbeat from core client for 30 sec - exiting 15:03:34 (2272): No heartbeat from core client for 30 sec - exiting 15:03:35 (2272): No heartbeat from core client for 30 sec - exiting 15:03:36 (2272): No heartbeat from core client for 30 sec - exiting 15:03:37 (2272): No heartbeat from core client for 30 sec - exiting 15:03:38 (2272): No heartbeat from core client for 30 sec - exiting 15:03:39 (2272): No heartbeat from core client for 30 sec - exiting 15:03:40 (2272): No heartbeat from core client for 30 sec - exiting 15:03:41 (2272): No heartbeat from core client for 30 sec - exiting 15:03:42 (2272): No heartbeat from core client for 30 sec - exiting 15:03:43 (2272): No heartbeat from core client for 30 sec - exiting 15:03:44 (2272): No heartbeat from core client for 30 sec - exiting 15:03:45 (2272): No heartbeat from core client for 30 sec - exiting 15:03:46 (2272): No heartbeat from core client for 30 sec - exiting 15:03:47 (2272): No heartbeat from core client for 30 sec - exiting 15:03:48 (2272): No heartbeat from core client for 30 sec - exiting 15:03:49 (2272): No heartbeat from core client for 30 sec - exiting 15:03:50 (2272): No heartbeat from core client for 30 sec - exiting 15:03:51 (2272): No heartbeat from core client for 30 sec - exiting 15:03:52 (2272): No heartbeat from core client for 30 sec - exiting 15:03:53 (2272): No heartbeat from core client for 30 sec - exiting 15:03:54 (2272): No heartbeat from core client for 30 sec - exiting 15:03:58 (2272): No heartbeat from core client for 30 sec - exiting 15:03:59 (2272): No heartbeat from core client for 30 sec - exiting 15:04:00 (2272): No heartbeat from core client for 30 sec - exiting 15:04:01 (2272): No heartbeat from core client for 30 sec - exiting 15:04:02 (2272): No heartbeat from core client for 30 sec - exiting 15:04:03 (2272): No heartbeat from core client for 30 sec - exiting 15:04:04 (2272): No heartbeat from core client for 30 sec - exiting 15:04:05 (2272): No heartbeat from core client for 30 sec - exiting 15:04:06 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:04:07 (2272): No heartbeat from core client for 30 sec - exiting 15:04:08 (2272): No heartbeat from core client for 30 sec - exiting 15:04:09 (2272): No heartbeat from core client for 30 sec - exiting 15:04:10 (2272): No heartbeat from core client for 30 sec - exiting 15:04:11 (2272): No heartbeat from core client for 30 sec - exiting 15:04:12 (2272): No heartbeat from core client for 30 sec - exiting 15:04:13 (2272): No heartbeat from core client for 30 sec - exiting 15:04:14 (2272): No heartbeat from core client for 30 sec - exiting 15:04:15 (2272): No heartbeat from core client for 30 sec - exiting 15:04:16 (2272): No heartbeat from core client for 30 sec - exiting 15:04:17 (2272): No heartbeat from core client for 30 sec - exiting 15:04:18 (2272): No heartbeat from core client for 30 sec - exiting 15:04:19 (2272): No heartbeat from core client for 30 sec - exiting 15:04:20 (2272): No heartbeat from core client for 30 sec - exiting 15:04:21 (2272): No heartbeat from core client for 30 sec - exiting 15:04:22 (2272): No heartbeat from core client for 30 sec - exiting 15:04:23 (2272): No heartbeat from core client for 30 sec - exiting 15:46:51 (6176): No heartbeat from core client for 30 sec - exiting 15:46:55 (6176): No heartbeat from core client for 30 sec - exiting 15:46:56 (6176): No heartbeat from core client for 30 sec - exiting 15:46:57 (6176): No heartbeat from core client for 30 sec - exiting 15:46:58 (6176): No heartbeat from core client for 30 sec - exiting 15:46:59 (6176): No heartbeat from core client for 30 sec - exiting 15:47:00 (6176): No heartbeat from core client for 30 sec - exiting 15:47:01 (6176): No heartbeat from core client for 30 sec - exiting 15:47:02 (6176): No heartbeat from core client for 30 sec - exiting 15:47:03 (6176): No heartbeat from core client for 30 sec - exiting 15:47:04 (6176): No heartbeat from core client for 30 sec - exiting 15:47:05 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:22 (6652): No heartbeat from core client for 30 sec - exiting 16:36:28 (6652): No heartbeat from core client for 30 sec - exiting 16:36:29 (6652): No heartbeat from core client for 30 sec - exiting 16:36:30 (6652): No heartbeat from core client for 30 sec - exiting 16:36:31 (6652): No heartbeat from core client for 30 sec - exiting 16:36:32 (6652): No heartbeat from core client for 30 sec - exiting 16:36:33 (6652): No heartbeat from core client for 30 sec - exiting 16:36:34 (6652): No heartbeat from core client for 30 sec - exiting 16:36:35 (6652): No heartbeat from core client for 30 sec - exiting 16:36:36 (6652): No heartbeat from core client for 30 sec - exiting 16:36:37 (6652): No heartbeat from core client for 30 sec - exiting 16:36:38 (6652): No heartbeat from core client for 30 sec - exiting 16:36:39 (6652): No heartbeat from core client for 30 sec - exiting 16:36:40 (6652): No heartbeat from core client for 30 sec - exiting 16:36:41 (6652): No heartbeat from core client for 30 sec - exiting 16:36:42 (6652): No heartbeat from core client for 30 sec - exiting 16:36:43 (6652): No heartbeat from core client for 30 sec - exiting 16:36:44 (6652): No heartbeat from core client for 30 sec - exiting 16:36:45 (6652): No heartbeat from core client for 30 sec - exiting 16:36:46 (6652): No heartbeat from core client for 30 sec - exiting 16:36:48 (6652): No heartbeat from core client for 30 sec - exiting 16:36:49 (6652): No heartbeat from core client for 30 sec - exiting 16:36:50 (6652): No heartbeat from core client for 30 sec - exiting 16:36:51 (6652): No heartbeat from core client for 30 sec - exiting 16:36:52 (6652): No heartbeat from core client for 30 sec - exiting 16:36:53 (6652): No heartbeat from core client for 30 sec - exiting 16:36:54 (6652): No heartbeat from core client for 30 sec - exiting 16:36:55 (6652): No heartbeat from core client for 30 sec - exiting 16:36:56 (6652): No heartbeat from core client for 30 sec - exiting 16:36:57 (6652): No heartbeat from core client for 30 sec - exiting 16:36:58 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:59 (6652): No heartbeat from core client for 30 sec - exiting 16:37:00 (6652): No heartbeat from core client for 30 sec - exiting 16:37:01 (6652): No heartbeat from core client for 30 sec - exiting 16:37:02 (6652): No heartbeat from core client for 30 sec - exiting 16:37:03 (6652): No heartbeat from core client for 30 sec - exiting 16:37:04 (6652): No heartbeat from core client for 30 sec - exiting 16:37:05 (6652): No heartbeat from core client for 30 sec - exiting 16:37:06 (6652): No heartbeat from core client for 30 sec - exiting 16:37:07 (6652): No heartbeat from core client for 30 sec - exiting 16:37:08 (6652): No heartbeat from core client for 30 sec - exiting 16:37:09 (6652): No heartbeat from core client for 30 sec - exiting 16:37:10 (6652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:41:15 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:41:38 (5700): No heartbeat from core client for 30 sec - exiting 17:41:39 (5700): No heartbeat from core client for 30 sec - exiting 17:41:40 (5700): No heartbeat from core client for 30 sec - exiting 17:41:42 (5700): No heartbeat from core client for 30 sec - exiting 17:41:43 (5700): No heartbeat from core client for 30 sec - exiting 17:41:44 (5700): No heartbeat from core client for 30 sec - exiting 17:41:45 (5700): No heartbeat from core client for 30 sec - exiting 17:41:46 (5700): No heartbeat from core client for 30 sec - exiting 17:41:47 (5700): No heartbeat from core client for 30 sec - exiting 17:41:48 (5700): No heartbeat from core client for 30 sec - exiting 17:41:49 (5700): No heartbeat from core client for 30 sec - exiting 17:41:50 (5700): No heartbeat from core client for 30 sec - exiting 17:41:51 (5700): No heartbeat from core client for 30 sec - exiting 17:41:52 (5700): No heartbeat from core client for 30 sec - exiting 17:41:53 (5700): No heartbeat from core client for 30 sec - exiting 17:41:54 (5700): No heartbeat from core client for 30 sec - exiting 17:41:55 (5700): No heartbeat from core client for 30 sec - exiting 17:41:56 (5700): No heartbeat from core client for 30 sec - exiting 17:41:57 (5700): No heartbeat from core client for 30 sec - exiting 17:41:58 (5700): No heartbeat from core client for 30 sec - exiting 17:41:59 (5700): No heartbeat from core client for 30 sec - exiting 17:42:00 (5700): No heartbeat from core client for 30 sec - exiting 17:42:01 (5700): No heartbeat from core client for 30 sec - exiting 17:42:02 (5700): No heartbeat from core client for 30 sec - exiting 17:42:03 (5700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:47:17 (6440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:48:01 (6440): No heartbeat from core client for 30 sec - exiting 19:48:02 (6440): No heartbeat from core client for 30 sec - exiting 19:48:03 (6440): No heartbeat from core client for 30 sec - exiting 19:48:04 (6440): No heartbeat from core client for 30 sec - exiting 19:48:05 (6440): No heartbeat from core client for 30 sec - exiting 19:48:06 (6440): No heartbeat from core client for 30 sec - exiting 19:48:07 (6440): No heartbeat from core client for 30 sec - exiting 19:48:08 (6440): No heartbeat from core client for 30 sec - exiting 19:48:09 (6440): No heartbeat from core client for 30 sec - exiting 19:48:10 (6440): No heartbeat from core client for 30 sec - exiting 19:48:11 (6440): No heartbeat from core client for 30 sec - exiting 19:48:12 (6440): No heartbeat from core client for 30 sec - exiting 19:48:13 (6440): No heartbeat from core client for 30 sec - exiting 19:48:14 (6440): No heartbeat from core client for 30 sec - exiting 19:48:15 (6440): No heartbeat from core client for 30 sec - exiting 19:48:16 (6440): No heartbeat from core client for 30 sec - exiting 19:48:17 (6440): No heartbeat from core client for 30 sec - exiting 19:48:18 (6440): No heartbeat from core client for 30 sec - exiting 19:48:19 (6440): No heartbeat from core client for 30 sec - exiting 19:48:20 (6440): No heartbeat from core client for 30 sec - exiting 19:48:21 (6440): No heartbeat from core client for 30 sec - exiting 19:48:22 (6440): No heartbeat from core client for 30 sec - exiting 19:48:23 (6440): No heartbeat from core client for 30 sec - exiting 19:48:24 (6440): No heartbeat from core client for 30 sec - exiting 19:48:25 (6440): No heartbeat from core client for 30 sec - exiting 19:48:26 (6440): No heartbeat from core client for 30 sec - exiting 19:48:27 (6440): No heartbeat from core client for 30 sec - exiting 19:48:28 (6440): No heartbeat from core client for 30 sec - exiting 19:48:29 (6440): No heartbeat from core client for 30 sec - exiting 19:48:30 (6440): No heartbeat from core client for 30 sec - exiting 19:48:31 (6440): No heartbeat from core client for 30 sec - exiting 19:48:32 (6440): No heartbeat from core client for 30 sec - exiting 19:48:33 (6440): No heartbeat from core client for 30 sec - exiting 19:48:34 (6440): No heartbeat from core client for 30 sec - exiting 19:48:35 (6440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Sep 2011 21:04:56	1091281	13295460	hadcm3n_o7ab_1940_40_007423260_1	103,680	309,945	2.9894
03 Sep 2011 00:18:26	1091281	13295460	hadcm3n_o7ab_1940_40_007423260_1	77,760	232,115	2.9850
28 Aug 2011 21:23:49	1091281	13295460	hadcm3n_o7ab_1940_40_007423260_1	51,840	154,632	2.9829
26 Aug 2011 19:12:05	1091281	13295460	hadcm3n_o7ab_1940_40_007423260_1	25,920	76,807	2.9632