Task 15501078

Name	hadcm3n_39y1_1940_40_008268728_0
Workunit	8423852
Created	23 Dec 2012, 13:48:19 UTC
Sent	23 Dec 2012, 15:38:09 UTC
Report deadline	24 Mar 2013, 23:05:20 UTC
Received	7 Apr 2013, 14:19:10 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1065432
Run time	29 days 9 hours 58 min 50 sec
CPU time	20 days 7 hours 14 min 3 sec
Validate state	Invalid
Credit	8,398.08
Device peak FLOPS	1.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 06:37:35 (332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:16:17 (1376): No heartbeat from core client for 30 sec - exiting 20:16:18 (1376): No heartbeat from core client for 30 sec - exiting 20:16:19 (1376): No heartbeat from core client for 30 sec - exiting 20:16:20 (1376): No heartbeat from core client for 30 sec - exiting 20:16:21 (1376): No heartbeat from core client for 30 sec - exiting 20:16:22 (1376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:23 (1376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:39:14 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:39:15 (2296): No heartbeat from core client for 30 sec - exiting 17:39:16 (2296): No heartbeat from core client for 30 sec - exiting 17:39:17 (2296): No heartbeat from core client for 30 sec - exiting 17:39:18 (2296): No heartbeat from core client for 30 sec - exiting 17:39:20 (2296): No heartbeat from core client for 30 sec - exiting 17:39:21 (2296): No heartbeat from core client for 30 sec - exiting 17:39:22 (2296): No heartbeat from core client for 30 sec - exiting 17:39:23 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:22:49 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:50 (3276): No heartbeat from core client for 30 sec - exiting 21:22:51 (3276): No heartbeat from core client for 30 sec - exiting 21:22:52 (3276): No heartbeat from core client for 30 sec - exiting 21:22:53 (3276): No heartbeat from core client for 30 sec - exiting 21:22:54 (3276): No heartbeat from core client for 30 sec - exiting 21:22:55 (3276): No heartbeat from core client for 30 sec - exiting 21:22:56 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:30:46 (2580): No heartbeat from core client for 30 sec - exiting 09:30:47 (2580): No heartbeat from core client for 30 sec - exiting 09:30:48 (2580): No heartbeat from core client for 30 sec - exiting 09:30:49 (2580): No heartbeat from core client for 30 sec - exiting 09:30:50 (2580): No heartbeat from core client for 30 sec - exiting 09:30:51 (2580): No heartbeat from core client for 30 sec - exiting 09:30:52 (2580): No heartbeat from core client for 30 sec - exiting 09:30:54 (2580): No heartbeat from core client for 30 sec - exiting 09:30:55 (2580): No heartbeat from core client for 30 sec - exiting 09:30:56 (2580): No heartbeat from core client for 30 sec - exiting 09:30:57 (2580): No heartbeat from core client for 30 sec - exiting 09:30:58 (2580): No heartbeat from core client for 30 sec - exiting 09:30:59 (2580): No heartbeat from core client for 30 sec - exiting 09:31:00 (2580): No heartbeat from core client for 30 sec - exiting 09:31:01 (2580): No heartbeat from core client for 30 sec - exiting 09:31:02 (2580): No heartbeat from core client for 30 sec - exiting 09:31:03 (2580): No heartbeat from core client for 30 sec - exiting 09:31:05 (2580): No heartbeat from core client for 30 sec - exiting 09:31:06 (2580): No heartbeat from core client for 30 sec - exiting 09:31:07 (2580): No heartbeat from core client for 30 sec - exiting 09:31:08 (2580): No heartbeat from core client for 30 sec - exiting 09:31:09 (2580): No heartbeat from core client for 30 sec - exiting 09:31:10 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:11 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:51:21 (4012): No heartbeat from core client for 30 sec - exiting 12:51:22 (4012): No heartbeat from core client for 30 sec - exiting 12:51:23 (4012): No heartbeat from core client for 30 sec - exiting 12:51:24 (4012): No heartbeat from core client for 30 sec - exiting 12:51:25 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:29:58 (3852): No heartbeat from core client for 30 sec - exiting 14:29:59 (3852): No heartbeat from core client for 30 sec - exiting 14:30:01 (3852): No heartbeat from core client for 30 sec - exiting 14:30:02 (3852): No heartbeat from core client for 30 sec - exiting 14:30:03 (3852): No heartbeat from core client for 30 sec - exiting 14:30:04 (3852): No heartbeat from core client for 30 sec - exiting 14:30:05 (3852): No heartbeat from core client for 30 sec - exiting 14:30:06 (3852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:54:13 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:14 (3016): No heartbeat from core client for 30 sec - exiting 20:54:15 (3016): No heartbeat from core client for 30 sec - exiting 20:54:16 (3016): No heartbeat from core client for 30 sec - exiting 20:54:17 (3016): No heartbeat from core client for 30 sec - exiting 20:54:18 (3016): No heartbeat from core client for 30 sec - exiting 20:54:19 (3016): No heartbeat from core client for 30 sec - exiting 20:54:21 (3016): No heartbeat from core client for 30 sec - exiting 20:54:22 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:47:04 (2204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:23 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:17:32 (2216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:24 (2208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:21 (2420): No heartbeat from core client for 30 sec - exiting 10:31:22 (2420): No heartbeat from core client for 30 sec - exiting 10:31:23 (2420): No heartbeat from core client for 30 sec - exiting 10:31:24 (2420): No heartbeat from core client for 30 sec - exiting 10:31:25 (2420): No heartbeat from core client for 30 sec - exiting 10:31:26 (2420): No heartbeat from core client for 30 sec - exiting 10:31:27 (2420): No heartbeat from core client for 30 sec - exiting 10:31:29 (2420): No heartbeat from core client for 30 sec - exiting 10:31:30 (2420): No heartbeat from core client for 30 sec - exiting 10:31:31 (2420): No heartbeat from core client for 30 sec - exiting 10:31:32 (2420): No heartbeat from core client for 30 sec - exiting 10:31:33 (2420): No heartbeat from core client for 30 sec - exiting 10:31:34 (2420): No heartbeat from core client for 30 sec - exiting 10:31:35 (2420): No heartbeat from core client for 30 sec - exiting 10:31:36 (2420): No heartbeat from core client for 30 sec - exiting 10:31:37 (2420): No heartbeat from core client for 30 sec - exiting 10:31:38 (2420): No heartbeat from core client for 30 sec - exiting 10:31:39 (2420): No heartbeat from core client for 30 sec - exiting 10:31:41 (2420): No heartbeat from core client for 30 sec - exiting 10:31:42 (2420): No heartbeat from core client for 30 sec - exiting 10:31:43 (2420): No heartbeat from core client for 30 sec - exiting 10:31:44 (2420): No heartbeat from core client for 30 sec - exiting 10:31:45 (2420): No heartbeat from core client for 30 sec - exiting 10:31:46 (2420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:05 (2312): No heartbeat from core client for 30 sec - exiting 11:09:06 (2312): No heartbeat from core client for 30 sec - exiting 11:09:07 (2312): No heartbeat from core client for 30 sec - exiting 11:09:08 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:34:04 (808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:04 (812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:40:04 (316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:05 (316): No heartbeat from core client for 30 sec - exiting 21:40:06 (316): No heartbeat from core client for 30 sec - exiting 21:40:07 (316): No heartbeat from core client for 30 sec - exiting 21:40:09 (316): No heartbeat from core client for 30 sec - exiting 21:40:10 (316): No heartbeat from core client for 30 sec - exiting 21:40:11 (316): No heartbeat from core client for 30 sec - exiting 21:40:12 (316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:01:26 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:05:10 (956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:13:46 (3060): No heartbeat from core client for 30 sec - exiting 22:13:47 (3060): No heartbeat from core client for 30 sec - exiting 22:13:48 (3060): No heartbeat from core client for 30 sec - exiting 22:13:49 (3060): No heartbeat from core client for 30 sec - exiting 22:13:50 (3060): No heartbeat from core client for 30 sec - exiting 22:13:51 (3060): No heartbeat from core client for 30 sec - exiting 22:13:52 (3060): No heartbeat from core client for 30 sec - exiting 22:13:53 (3060): No heartbeat from core client for 30 sec - exiting 22:13:54 (3060): No heartbeat from core client for 30 sec - exiting 22:13:55 (3060): No heartbeat from core client for 30 sec - exiting 22:13:56 (3060): No heartbeat from core client for 30 sec - exiting 22:13:57 (3060): No heartbeat from core client for 30 sec - exiting 22:13:58 (3060): No heartbeat from core client for 30 sec - exiting 22:13:59 (3060): No heartbeat from core client for 30 sec - exiting 22:14:00 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:02:55 (304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:13:29 (2344): No heartbeat from core client for 30 sec - exiting 20:13:30 (2344): No heartbeat from core client for 30 sec - exiting 20:13:31 (2344): No heartbeat from core client for 30 sec - exiting 20:13:32 (2344): No heartbeat from core client for 30 sec - exiting 20:13:34 (2344): No heartbeat from core client for 30 sec - exiting 20:13:35 (2344): No heartbeat from core client for 30 sec - exiting 20:13:36 (2344): No heartbeat from core client for 30 sec - exiting 20:13:37 (2344): No heartbeat from core client for 30 sec - exiting 20:13:38 (2344): No heartbeat from core client for 30 sec - exiting 20:13:39 (2344): No heartbeat from core client for 30 sec - exiting 20:13:40 (2344): No heartbeat from core client for 30 sec - exiting 20:13:41 (2344): No heartbeat from core client for 30 sec - exiting 20:13:42 (2344): No heartbeat from core client for 30 sec - exiting 20:13:43 (2344): No heartbeat from core client for 30 sec - exiting 20:13:45 (2344): No heartbeat from core client for 30 sec - exiting 20:13:46 (2344): No heartbeat from core client for 30 sec - exiting 20:13:47 (2344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:29 (1204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:30 (1204): No heartbeat from core client for 30 sec - exiting 22:26:31 (1204): No heartbeat from core client for 30 sec - exiting 22:26:32 (1204): No heartbeat from core client for 30 sec - exiting 22:26:33 (1204): No heartbeat from core client for 30 sec - exiting 22:26:34 (1204): No heartbeat from core client for 30 sec - exiting 22:26:35 (1204): No heartbeat from core client for 30 sec - exiting 22:26:37 (1204): No heartbeat from core client for 30 sec - exiting 22:26:38 (1204): No heartbeat from core client for 30 sec - exiting 00:24:04 (1988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:06:59 (1768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:00 (1768): No heartbeat from core client for 30 sec - exiting 01:07:01 (1768): No heartbeat from core client for 30 sec - exiting 01:07:02 (1768): No heartbeat from core client for 30 sec - exiting 01:07:03 (1768): No heartbeat from core client for 30 sec - exiting 01:07:04 (1768): No heartbeat from core client for 30 sec - exiting 01:07:05 (1768): No heartbeat from core client for 30 sec - exiting 01:07:06 (1768): No heartbeat from core client for 30 sec - exiting 01:07:07 (1768): No heartbeat from core client for 30 sec - exiting 01:07:09 (1768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:54:00 (2960): No heartbeat from core client for 30 sec - exiting 22:54:01 (2960): No heartbeat from core client for 30 sec - exiting 22:54:02 (2960): No heartbeat from core client for 30 sec - exiting 22:54:03 (2960): No heartbeat from core client for 30 sec - exiting 22:54:04 (2960): No heartbeat from core client for 30 sec - exiting 22:54:05 (2960): No heartbeat from core client for 30 sec - exiting 22:54:06 (2960): No heartbeat from core client for 30 sec - exiting 22:54:07 (2960): No heartbeat from core client for 30 sec - exiting 22:54:08 (2960): No heartbeat from core client for 30 sec - exiting 22:54:09 (2960): No heartbeat from core client for 30 sec - exiting 22:54:11 (2960): No heartbeat from core client for 30 sec - exiting 22:54:12 (2960): No heartbeat from core client for 30 sec - exiting 22:54:13 (2960): No heartbeat from core client for 30 sec - exiting 22:54:14 (2960): No heartbeat from core client for 30 sec - exiting 22:54:15 (2960): No heartbeat from core client for 30 sec - exiting 22:54:16 (2960): No heartbeat from core client for 30 sec - exiting 22:54:17 (2960): No heartbeat from core client for 30 sec - exiting 22:54:18 (2960): No heartbeat from core client for 30 sec - exiting 22:54:19 (2960): No heartbeat from core client for 30 sec - exiting 22:54:20 (2960): No heartbeat from core client for 30 sec - exiting 22:54:21 (2960): No heartbeat from core client for 30 sec - exiting 22:54:23 (2960): No heartbeat from core client for 30 sec - exiting 22:54:24 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:54:25 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:28:24 (2912): No heartbeat from core client for 30 sec - exiting 01:28:25 (2912): No heartbeat from core client for 30 sec - exiting 01:28:26 (2912): No heartbeat from core client for 30 sec - exiting 01:28:27 (2912): No heartbeat from core client for 30 sec - exiting 01:28:28 (2912): No heartbeat from core client for 30 sec - exiting 01:28:29 (2912): No heartbeat from core client for 30 sec - exiting 01:28:31 (2912): No heartbeat from core client for 30 sec - exiting 01:28:32 (2912): No heartbeat from core client for 30 sec - exiting 01:28:33 (2912): No heartbeat from core client for 30 sec - exiting 01:28:34 (2912): No heartbeat from core client for 30 sec - exiting 01:28:35 (2912): No heartbeat from core client for 30 sec - exiting 01:28:36 (2912): No heartbeat from core client for 30 sec - exiting 01:28:37 (2912): No heartbeat from core client for 30 sec - exiting 01:28:38 (2912): No heartbeat from core client for 30 sec - exiting 01:28:39 (2912): No heartbeat from core client for 30 sec - exiting 01:28:40 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:24:09 (1816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:59:35 (1948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:15 (1128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:30:12 (3640): No heartbeat from core client for 30 sec - exiting 22:30:14 (3640): No heartbeat from core client for 30 sec - exiting 22:30:15 (3640): No heartbeat from core client for 30 sec - exiting 22:30:16 (3640): No heartbeat from core client for 30 sec - exiting 22:30:17 (3640): No heartbeat from core client for 30 sec - exiting 22:30:18 (3640): No heartbeat from core client for 30 sec - exiting 22:30:19 (3640): No heartbeat from core client for 30 sec - exiting 22:30:20 (3640): No heartbeat from core client for 30 sec - exiting 22:30:21 (3640): No heartbeat from core client for 30 sec - exiting 22:30:22 (3640): No heartbeat from core client for 30 sec - exiting 22:30:23 (3640): No heartbeat from core client for 30 sec - exiting 22:30:24 (3640): No heartbeat from core client for 30 sec - exiting 22:30:25 (3640): No heartbeat from core client for 30 sec - exiting 22:30:26 (3640): No heartbeat from core client for 30 sec - exiting 22:30:27 (3640): No heartbeat from core client for 30 sec - exiting 22:30:28 (3640): No heartbeat from core client for 30 sec - exiting 22:30:29 (3640): No heartbeat from core client for 30 sec - exiting 22:30:30 (3640): No heartbeat from core client for 30 sec - exiting 22:30:31 (3640): No heartbeat from core client for 30 sec - exiting 22:30:32 (3640): No heartbeat from core client for 30 sec - exiting 22:30:33 (3640): No heartbeat from core client for 30 sec - exiting 22:30:34 (3640): No heartbeat from core client for 30 sec - exiting 22:30:35 (3640): No heartbeat from core client for 30 sec - exiting 22:30:36 (3640): No heartbeat from core client for 30 sec - exiting 22:30:37 (3640): No heartbeat from core client for 30 sec - exiting 22:30:38 (3640): No heartbeat from core client for 30 sec - exiting 22:30:39 (3640): No heartbeat from core client for 30 sec - exiting 22:30:40 (3640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:27:17 (736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:52:36 (2756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C00:33:44 (2900): No heartbeat from core client for 30 sec - exiting 00:33:45 (2900): No heartbeat from core client for 30 sec - exiting 00:33:46 (2900): No heartbeat from core client for 30 sec - exiting 00:33:47 (2900): No heartbeat from core client for 30 sec - exiting 00:33:48 (2900): No heartbeat from core client for 30 sec - exiting 00:33:49 (2900): No heartbeat from core client for 30 sec - exiting 00:33:50 (2900): No heartbeat from core client for 30 sec - exiting 00:33:51 (2900): No heartbeat from core client for 30 sec - exiting 00:33:52 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:09:13 (2384): No heartbeat from core client for 30 sec - exiting 17:09:14 (2384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:26 (2292): No heartbeat from core client for 30 sec - exiting 18:10:27 (2292): No heartbeat from core client for 30 sec - exiting 18:10:28 (2292): No heartbeat from core client for 30 sec - exiting 18:10:29 (2292): No heartbeat from core client for 30 sec - exiting 18:10:31 (2292): No heartbeat from core client for 30 sec - exiting 18:10:32 (2292): No heartbeat from core client for 30 sec - exiting 18:10:33 (2292): No heartbeat from core client for 30 sec - exiting 18:10:34 (2292): No heartbeat from core client for 30 sec - exiting 18:10:35 (2292): No heartbeat from core client for 30 sec - exiting 18:10:36 (2292): No heartbeat from core client for 30 sec - exiting 18:10:37 (2292): No heartbeat from core client for 30 sec - exiting 18:10:38 (2292): No heartbeat from core client for 30 sec - exiting 18:10:39 (2292): No heartbeat from core client for 30 sec - exiting 18:10:40 (2292): No heartbeat from core client for 30 sec - exiting 18:10:41 (2292): No heartbeat from core client for 30 sec - exiting 18:10:43 (2292): No heartbeat from core client for 30 sec - exiting 18:10:44 (2292): No heartbeat from core client for 30 sec - exiting 18:10:45 (2292): No heartbeat from core client for 30 sec - exiting 18:10:46 (2292): No heartbeat from core client for 30 sec - exiting 18:10:47 (2292): No heartbeat from core client for 30 sec - exiting 18:10:48 (2292): No heartbeat from core client for 30 sec - exiting 18:10:49 (2292): No heartbeat from core client for 30 sec - exiting 18:10:50 (2292): No heartbeat from core client for 30 sec - exiting 18:10:51 (2292): No heartbeat from core client for 30 sec - exiting 18:10:52 (2292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:08:58 (3608): No heartbeat from core client for 30 sec - exiting 01:08:59 (3608): No heartbeat from core client for 30 sec - exiting 01:09:00 (3608): No heartbeat from core client for 30 sec - exiting 01:09:01 (3608): No heartbeat from core client for 30 sec - exiting 01:09:02 (3608): No heartbeat from core client for 30 sec - exiting 01:09:03 (3608): No heartbeat from core client for 30 sec - exiting 01:09:04 (3608): No heartbeat from core client for 30 sec - exiting 01:09:05 (3608): No heartbeat from core client for 30 sec - exiting 01:09:06 (3608): No heartbeat from core client for 30 sec - exiting 01:09:07 (3608): No heartbeat from core client for 30 sec - exiting 01:09:09 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:03:29 (2676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:30 (2676): No heartbeat from core client for 30 sec - exiting 02:03:32 (2676): No heartbeat from core client for 30 sec - exiting 02:03:33 (2676): No heartbeat from core client for 30 sec - exiting 02:03:34 (2676): No heartbeat from core client for 30 sec - exiting 02:03:35 (2676): No heartbeat from core client for 30 sec - exiting 02:03:36 (2676): No heartbeat from core client for 30 sec - exiting 02:03:37 (2676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:35:01 (2796): No heartbeat from core client for 30 sec - exiting 22:35:02 (2796): No heartbeat from core client for 30 sec - exiting 22:35:03 (2796): No heartbeat from core client for 30 sec - exiting 22:35:04 (2796): No heartbeat from core client for 30 sec - exiting 22:35:06 (2796): No heartbeat from core client for 30 sec - exiting 22:35:07 (2796): No heartbeat from core client for 30 sec - exiting 22:35:08 (2796): No heartbeat from core client for 30 sec - exiting 22:35:09 (2796): No heartbeat from core client for 30 sec - exiting 22:35:10 (2796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:19:38 (564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:39 (564): No heartbeat from core client for 30 sec - exiting 21:19:40 (564): No heartbeat from core client for 30 sec - exiting 21:19:41 (564): No heartbeat from core client for 30 sec - exiting 21:19:42 (564): No heartbeat from core client for 30 sec - exiting 21:19:43 (564): No heartbeat from core client for 30 sec - exiting 21:19:44 (564): No heartbeat from core client for 30 sec - exiting 21:19:45 (564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:41:58 (1484): No heartbeat from core client for 30 sec - exiting 21:42:00 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:54:42 (3140): No heartbeat from core client for 30 sec - exiting 21:54:43 (3140): No heartbeat from core client for 30 sec - exiting 21:54:44 (3140): No heartbeat from core client for 30 sec - exiting 21:54:46 (3140): No heartbeat from core client for 30 sec - exiting 21:54:47 (3140): No heartbeat from core client for 30 sec - exiting 21:54:48 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:22:03 (3488): No heartbeat from core client for 30 sec - exiting 22:22:05 (3488): No heartbeat from core client for 30 sec - exiting 22:22:06 (3488): No heartbeat from core client for 30 sec - exiting 22:22:07 (3488): No heartbeat from core client for 30 sec - exiting 22:22:08 (3488): No heartbeat from core client for 30 sec - exiting 22:22:09 (3488): No heartbeat from core client for 30 sec - exiting 22:22:10 (3488): No heartbeat from core client for 30 sec - exiting 22:22:11 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/39y1ko.pjf7c10 Error converting file to netcdf: dataout/39y1ko.pif7c10 Error converting file to netcdf: dataout/39y1ko.pff7c10 Error converting file to netcdf: dataout/39y1ka.phf7c10 Error converting file to netcdf: dataout/39y1ka.pgf7c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:44:05 (2196): No heartbeat from core client for 30 sec - exiting 22:44:06 (2196): No heartbeat from core client for 30 sec - exiting 22:44:07 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:03 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:12:04 (3648): No heartbeat from core client for 30 sec - exiting 06:12:05 (3648): No heartbeat from core client for 30 sec - exiting 06:12:06 (3648): No heartbeat from core client for 30 sec - exiting 06:12:07 (3648): No heartbeat from core client for 30 sec - exiting 06:12:08 (3648): No heartbeat from core client for 30 sec - exiting 06:12:09 (3648): No heartbeat from core client for 30 sec - exiting 06:12:10 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:45:36 (3000): No heartbeat from core client for 30 sec - exiting 00:45:37 (3000): No heartbeat from core client for 30 sec - exiting 00:45:39 (3000): No heartbeat from core client for 30 sec - exiting 00:45:40 (3000): No heartbeat from core client for 30 sec - exiting 00:45:41 (3000): No heartbeat from core client for 30 sec - exiting 00:45:42 (3000): No heartbeat from core client for 30 sec - exiting 00:45:43 (3000): No heartbeat from core client for 30 sec - exiting 00:45:44 (3000): No heartbeat from core client for 30 sec - exiting 00:45:45 (3000): No heartbeat from core client for 30 sec - exiting 00:45:46 (3000): No heartbeat from core client for 30 sec - exiting 00:45:47 (3000): No heartbeat from core client for 30 sec - exiting 00:45:48 (3000): No heartbeat from core client for 30 sec - exiting 00:45:49 (3000): No heartbeat from core client for 30 sec - exiting 00:45:51 (3000): No heartbeat from core client for 30 sec - exiting 00:45:52 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:45:04 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... 21:36:10 (2820): No heartbeat from core client for 30 sec - exiting 21:36:12 (2820): No heartbeat from core client for 30 sec - exiting 21:36:13 (2820): No heartbeat from core client for 30 sec - exiting 21:36:14 (2820): No heartbeat from core client for 30 sec - exiting 21:36:15 (2820): No heartbeat from core client for 30 sec - exiting 21:36:16 (2820): No heartbeat from core client for 30 sec - exiting 21:36:17 (2820): No heartbeat from core client for 30 sec - exiting 21:36:18 (2820): No heartbeat from core client for 30 sec - exiting 21:36:19 (2820): No heartbeat from core client for 30 sec - exiting 21:36:20 (2820): No heartbeat from core client for 30 sec - exiting 21:36:22 (2820): No heartbeat from core client for 30 sec - exiting 21:36:23 (2820): No heartbeat from core client for 30 sec - exiting 21:36:24 (2820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:52:36 (3116): No heartbeat from core client for 30 sec - exiting 20:52:37 (3116): No heartbeat from core client for 30 sec - exiting 20:52:38 (3116): No heartbeat from core client for 30 sec - exiting 20:52:39 (3116): No heartbeat from core client for 30 sec - exiting 20:52:40 (3116): No heartbeat from core client for 30 sec - exiting 20:52:41 (3116): No heartbeat from core client for 30 sec - exiting 20:52:42 (3116): No heartbeat from core client for 30 sec - exiting 20:52:43 (3116): No heartbeat from core client for 30 sec - exiting 20:52:45 (3116): No heartbeat from core client for 30 sec - exiting 20:52:46 (3116): No heartbeat from core client for 30 sec - exiting 20:52:47 (3116): No heartbeat from core client for 30 sec - exiting 20:52:48 (3116): No heartbeat from core client for 30 sec - exiting 20:52:49 (3116): No heartbeat from core client for 30 sec - exiting 20:52:50 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:50:43 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:12:07 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:12:08 (3288): No heartbeat from core client for 30 sec - exiting 22:12:09 (3288): No heartbeat from core client for 30 sec - exiting 22:12:10 (3288): No heartbeat from core client for 30 sec - exiting 22:12:11 (3288): No heartbeat from core client for 30 sec - exiting 22:12:12 (3288): No heartbeat from core client for 30 sec - exiting 22:12:13 (3288): No heartbeat from core client for 30 sec - exiting 22:12:14 (3288): No heartbeat from core client for 30 sec - exiting 22:12:15 (3288): No heartbeat from core client for 30 sec - exiting 22:12:16 (3288): No heartbeat from core client for 30 sec - exiting 22:12:18 (3288): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... 22:18:47 (2896): No heartbeat from core client for 30 sec - exiting 22:18:48 (2896): No heartbeat from core client for 30 sec - exiting 22:18:49 (2896): No heartbeat from core client for 30 sec - exiting 22:18:51 (2896): No heartbeat from core client for 30 sec - exiting 22:18:52 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1360, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Apr 2013 11:21:38	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	699,840	1,706,754	2.4388
31 Mar 2013 16:56:16	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	673,920	1,651,680	2.4509
30 Mar 2013 01:32:01	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	648,000	1,595,811	2.4627
26 Mar 2013 19:15:43	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	622,080	1,537,309	2.4712
24 Mar 2013 13:45:05	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	596,160	1,480,329	2.4831
23 Mar 2013 18:24:05	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	570,240	1,424,734	2.4985
22 Mar 2013 00:21:21	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	544,320	1,369,492	2.5160
18 Mar 2013 22:36:27	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	518,400	1,313,681	2.5341
15 Mar 2013 20:01:53	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	492,480	1,256,228	2.5508
10 Mar 2013 21:38:50	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	466,560	1,195,937	2.5633
06 Mar 2013 15:35:36	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	440,640	1,129,320	2.5629
02 Mar 2013 22:38:16	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	414,720	1,063,390	2.5641
24 Feb 2013 21:34:11	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	388,800	999,523	2.5708
23 Feb 2013 22:51:16	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	362,880	939,119	2.5880
19 Feb 2013 19:11:53	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	336,960	878,050	2.6058
16 Feb 2013 17:06:06	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	311,040	815,724	2.6226
14 Feb 2013 20:02:24	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	285,120	745,854	2.6159
11 Feb 2013 17:11:11	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	259,200	683,358	2.6364
10 Feb 2013 20:10:50	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	233,280	621,475	2.6641
08 Feb 2013 16:20:57	1065432	15501078	hadcm3n_39y1_1940_40_008268728_0	207,360	558,897	2.6953