Task 13552162

Name	hadcm3n_yfcx_1900_40_007523234_0
Workunit	7720709
Created	28 Oct 2011, 13:21:44 UTC
Sent	31 Oct 2011, 16:42:02 UTC
Report deadline	31 Jan 2012, 0:09:13 UTC
Received	1 Dec 2011, 22:34:24 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1052375
Run time	19 days 4 hours 33 min 21 sec
CPU time	18 days 23 hours 22 min 2 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.43 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:47:59 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:00 (3736): No heartbeat from core client for 30 sec - exiting 22:48:01 (3736): No heartbeat from core client for 30 sec - exiting 23:42:16 (984): No heartbeat from core client for 30 sec - exiting 23:42:18 (984): No heartbeat from core client for 30 sec - exiting 23:42:20 (984): No heartbeat from core client for 30 sec - exiting 23:42:22 (984): No heartbeat from core client for 30 sec - exiting 23:42:24 (984): No heartbeat from core client for 30 sec - exiting 23:42:26 (984): No heartbeat from core client for 30 sec - exiting 23:42:28 (984): No heartbeat from core client for 30 sec - exiting 23:42:29 (984): No heartbeat from core client for 30 sec - exiting 23:42:30 (984): No heartbeat from core client for 30 sec - exiting 23:42:31 (984): No heartbeat from core client for 30 sec - exiting 23:42:32 (984): No heartbeat from core client for 30 sec - exiting 23:42:34 (984): No heartbeat from core client for 30 sec - exiting 23:42:35 (984): No heartbeat from core client for 30 sec - exiting 23:42:36 (984): No heartbeat from core client for 30 sec - exiting 23:42:37 (984): No heartbeat from core client for 30 sec - exiting 23:42:38 (984): No heartbeat from core client for 30 sec - exiting 23:42:39 (984): No heartbeat from core client for 30 sec - exiting 23:42:40 (984): No heartbeat from core client for 30 sec - exiting 23:42:42 (984): No heartbeat from core client for 30 sec - exiting 23:42:43 (984): No heartbeat from core client for 30 sec - exiting 23:42:44 (984): No heartbeat from core client for 30 sec - exiting 23:42:45 (984): No heartbeat from core client for 30 sec - exiting 23:42:46 (984): No heartbeat from core client for 30 sec - exiting 23:42:47 (984): No heartbeat from core client for 30 sec - exiting 23:42:48 (984): No heartbeat from core client for 30 sec - exiting 23:42:49 (984): No heartbeat from core client for 30 sec - exiting 23:42:50 (984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:51 (984): No heartbeat from core client for 30 sec - exiting 23:42:53 (984): No heartbeat from core client for 30 sec - exiting 23:42:54 (984): No heartbeat from core client for 30 sec - exiting 06:50:09 (1484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:50:16 (1484): No heartbeat from core client for 30 sec - exiting 06:54:22 (3192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:54:25 (3192): No heartbeat from core client for 30 sec - exiting 06:54:26 (3192): No heartbeat from core client for 30 sec - exiting 06:54:28 (3192): No heartbeat from core client for 30 sec - exiting 06:54:29 (3192): No heartbeat from core client for 30 sec - exiting 06:54:30 (3192): No heartbeat from core client for 30 sec - exiting 06:54:31 (3192): No heartbeat from core client for 30 sec - exiting 07:00:01 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:00:11 (3996): No heartbeat from core client for 30 sec - exiting 07:00:12 (3996): No heartbeat from core client for 30 sec - exiting 07:00:23 (3996): No heartbeat from core client for 30 sec - exiting 07:00:24 (3996): No heartbeat from core client for 30 sec - exiting 07:00:25 (3996): No heartbeat from core client for 30 sec - exiting 07:03:57 (252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:04:14 (252): No heartbeat from core client for 30 sec - exiting 07:04:31 (252): No heartbeat from core client for 30 sec - exiting 07:04:23 (252): No heartbeat from core client for 30 sec - exiting 07:04:24 (252): No heartbeat from core client for 30 sec - exiting 07:04:25 (252): No heartbeat from core client for 30 sec - exiting 07:04:26 (252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:31:40 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:47 (3644): No heartbeat from core client for 30 sec - exiting 17:31:48 (3644): No heartbeat from core client for 30 sec - exiting 17:31:51 (3644): No heartbeat from core client for 30 sec - exiting 17:31:52 (3644): No heartbeat from core client for 30 sec - exiting 17:31:53 (3644): No heartbeat from core client for 30 sec - exiting 17:31:54 (3644): No heartbeat from core client for 30 sec - exiting 17:32:12 (3644): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 17:36:52 (2356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:43 (2356): No heartbeat from core client for 30 sec - exiting 17:36:44 (2356): No heartbeat from core client for 30 sec - exiting 17:36:46 (2356): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:36:17 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:23 (3948): No heartbeat from core client for 30 sec - exiting 00:36:24 (3948): No heartbeat from core client for 30 sec - exiting 00:36:29 (3948): No heartbeat from core client for 30 sec - exiting 00:36:30 (3948): No heartbeat from core client for 30 sec - exiting 00:36:31 (3948): No heartbeat from core client for 30 sec - exiting 00:36:32 (3948): No heartbeat from core client for 30 sec - exiting 00:36:34 (3948): No heartbeat from core client for 30 sec - exiting 00:37:44 (596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:37:45 (596): No heartbeat from core client for 30 sec - exiting 00:37:46 (596): No heartbeat from core client for 30 sec - exiting 00:42:35 (3664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:20 (892): No heartbeat from core client for 30 sec - exiting 00:44:21 (892): No heartbeat from core client for 30 sec - exiting 00:44:23 (892): No heartbeat from core client for 30 sec - exiting 00:44:24 (892): No heartbeat from core client for 30 sec - exiting 00:44:25 (892): No heartbeat from core client for 30 sec - exiting 00:44:26 (892): No heartbeat from core client for 30 sec - exiting 00:44:30 (892): No heartbeat from core client for 30 sec - exiting 00:44:31 (892): No heartbeat from core client for 30 sec - exiting 00:44:32 (892): No heartbeat from core client for 30 sec - exiting 00:44:33 (892): No heartbeat from core client for 30 sec - exiting 00:44:34 (892): No heartbeat from core client for 30 sec - exiting 00:44:35 (892): No heartbeat from core client for 30 sec - exiting 00:44:36 (892): No heartbeat from core client for 30 sec - exiting 00:44:38 (892): No heartbeat from core client for 30 sec - exiting 00:44:39 (892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:59 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:50:06 (3024): No heartbeat from core client for 30 sec - exiting 00:55:56 (3024): No heartbeat from core client for 30 sec - exiting 00:56:02 (3024): No heartbeat from core client for 30 sec - exiting 00:56:03 (3024): No heartbeat from core client for 30 sec - exiting 00:56:05 (3024): No heartbeat from core client for 30 sec - exiting 00:56:07 (3024): No heartbeat from core client for 30 sec - exiting 00:56:08 (3024): No heartbeat from core client for 30 sec - exiting 00:56:09 (3024): No heartbeat from core client for 30 sec - exiting 00:56:10 (3024): No heartbeat from core client for 30 sec - exiting 00:56:12 (3024): No heartbeat from core client for 30 sec - exiting 00:56:13 (3024): No heartbeat from core client for 30 sec - exiting 00:56:14 (3024): No heartbeat from core client for 30 sec - exiting 00:56:15 (3024): No heartbeat from core client for 30 sec - exiting 00:56:16 (3024): No heartbeat from core client for 30 sec - exiting 00:56:18 (3024): No heartbeat from core client for 30 sec - exiting 00:58:21 (892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:22 (892): No heartbeat from core client for 30 sec - exiting 01:05:09 (1764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:07 (1764): No heartbeat from core client for 30 sec - exiting 01:10:28 (1764): No heartbeat from core client for 30 sec - exiting 01:11:43 (1764): No heartbeat from core client for 30 sec - exiting 01:11:44 (1764): No heartbeat from core client for 30 sec - exiting 01:11:47 (1764): No heartbeat from core client for 30 sec - exiting 01:11:48 (1764): No heartbeat from core client for 30 sec - exiting 01:11:49 (1764): No heartbeat from core client for 30 sec - exiting 03:04:37 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:38 (3932): No heartbeat from core client for 30 sec - exiting 03:04:40 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 18:53:59 (3380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:02 (3380): No heartbeat from core client for 30 sec - exiting 18:54:03 (3380): No heartbeat from core client for 30 sec - exiting 18:54:04 (3380): No heartbeat from core client for 30 sec - exiting 18:54:05 (3380): No heartbeat from core client for 30 sec - exiting 18:54:06 (3380): No heartbeat from core client for 30 sec - exiting 18:54:07 (3380): No heartbeat from core client for 30 sec - exiting 13:45:04 (732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:09 (732): No heartbeat from core client for 30 sec - exiting 13:45:10 (732): No heartbeat from core client for 30 sec - exiting 13:45:11 (732): No heartbeat from core client for 30 sec - exiting 13:45:12 (732): No heartbeat from core client for 30 sec - exiting 13:45:13 (732): No heartbeat from core client for 30 sec - exiting 13:45:14 (732): No heartbeat from core client for 30 sec - exiting 13:45:15 (732): No heartbeat from core client for 30 sec - exiting 13:49:23 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:25 (3528): No heartbeat from core client for 30 sec - exiting 13:49:26 (3528): No heartbeat from core client for 30 sec - exiting 13:49:27 (3528): No heartbeat from core client for 30 sec - exiting 13:50:15 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C15:54:31 (2252): No heartbeat from core client for 30 sec - exiting 15:55:21 (2252): No heartbeat from core client for 30 sec - exiting 15:55:28 (2252): No heartbeat from core client for 30 sec - exiting 15:54:59 (2252): No heartbeat from core client for 30 sec - exiting 15:55:01 (2252): No heartbeat from core client for 30 sec - exiting 15:55:03 (2252): No heartbeat from core client for 30 sec - exiting 15:55:07 (2252): No heartbeat from core client for 30 sec - exiting 15:55:09 (2252): No heartbeat from core client for 30 sec - exiting 15:55:13 (2252): No heartbeat from core client for 30 sec - exiting 15:55:22 (2252): No heartbeat from core client for 30 sec - exiting 15:55:24 (2252): No heartbeat from core client for 30 sec - exiting 15:55:25 (2252): No heartbeat from core client for 30 sec - exiting 15:55:26 (2252): No heartbeat from core client for 30 sec - exiting 15:55:27 (2252): No heartbeat from core client for 30 sec - exiting 15:55:28 (2252): No heartbeat from core client for 30 sec - exiting 15:55:29 (2252): No heartbeat from core client for 30 sec - exiting 15:55:30 (2252): No heartbeat from core client for 30 sec - exiting 15:55:32 (2252): No heartbeat from core client for 30 sec - exiting 15:55:34 (2252): No heartbeat from core client for 30 sec - exiting 15:55:36 (2252): No heartbeat from core client for 30 sec - exiting 15:55:37 (2252): No heartbeat from core client for 30 sec - exiting 15:55:38 (2252): No heartbeat from core client for 30 sec - exiting 15:55:39 (2252): No heartbeat from core client for 30 sec - exiting 15:55:40 (2252): No heartbeat from core client for 30 sec - exiting 15:55:41 (2252): No heartbeat from core client for 30 sec - exiting 15:55:43 (2252): No heartbeat from core client for 30 sec - exiting 15:55:44 (2252): No heartbeat from core client for 30 sec - exiting 15:55:45 (2252): No heartbeat from core client for 30 sec - exiting 15:55:46 (2252): No heartbeat from core client for 30 sec - exiting 15:55:47 (2252): No heartbeat from core client for 30 sec - exiting 15:55:49 (2252): No heartbeat from core client for 30 sec - exiting 15:55:50 (2252): No heartbeat from core client for 30 sec - exiting 15:55:51 (2252): No heartbeat from core client for 30 sec - exiting 15:55:52 (2252): No heartbeat from core client for 30 sec - exiting 15:55:53 (2252): No heartbeat from core client for 30 sec - exiting 15:55:56 (2252): No heartbeat from core client for 30 sec - exiting 15:55:57 (2252): No heartbeat from core client for 30 sec - exiting 15:55:58 (2252): No heartbeat from core client for 30 sec - exiting 15:55:59 (2252): No heartbeat from core client for 30 sec - exiting 15:56:00 (2252): No heartbeat from core client for 30 sec - exiting 15:56:01 (2252): No heartbeat from core client for 30 sec - exiting 15:56:02 (2252): No heartbeat from core client for 30 sec - exiting 15:56:04 (2252): No heartbeat from core client for 30 sec - exiting 15:56:08 (2252): No heartbeat from core client for 30 sec - exiting 15:56:10 (2252): No heartbeat from core client for 30 sec - exiting 15:56:11 (2252): No heartbeat from core client for 30 sec - exiting 15:56:13 (2252): No heartbeat from core client for 30 sec - exiting 15:56:14 (2252): No heartbeat from core client for 30 sec - exiting 15:56:15 (2252): No heartbeat from core client for 30 sec - exiting 15:56:16 (2252): No heartbeat from core client for 30 sec - exiting 15:56:17 (2252): No heartbeat from core client for 30 sec - exiting 15:56:19 (2252): No heartbeat from core client for 30 sec - exiting 15:56:20 (2252): No heartbeat from core client for 30 sec - exiting 15:56:21 (2252): No heartbeat from core client for 30 sec - exiting 15:56:22 (2252): No heartbeat from core client for 30 sec - exiting 15:56:56 (2252): No heartbeat from core client for 30 sec - exiting 15:56:57 (2252): No heartbeat from core client for 30 sec - exiting 15:56:58 (2252): No heartbeat from core client for 30 sec - exiting 15:57:00 (2252): No heartbeat from core client for 30 sec - exiting 15:57:01 (2252): No heartbeat from core client for 30 sec - exiting 15:57:02 (2252): No heartbeat from core client for 30 sec - exiting 15:57:03 (2252): No heartbeat from core client for 30 sec - exiting 15:57:04 (2252): No heartbeat from core client for 30 sec - exiting 15:57:05 (2252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:28 (1492): No heartbeat from core client for 30 sec - exiting 15:59:29 (1492): No heartbeat from core client for 30 sec - exiting 15:59:30 (1492): No heartbeat from core client for 30 sec - exiting 15:59:31 (1492): No heartbeat from core client for 30 sec - exiting 15:59:32 (1492): No heartbeat from core client for 30 sec - exiting 15:59:33 (1492): No heartbeat from core client for 30 sec - exiting 15:59:34 (1492): No heartbeat from core client for 30 sec - exiting 15:59:35 (1492): No heartbeat from core client for 30 sec - exiting 15:59:36 (1492): No heartbeat from core client for 30 sec - exiting 15:59:37 (1492): No heartbeat from core client for 30 sec - exiting 15:59:39 (1492): No heartbeat from core client for 30 sec - exiting 15:59:40 (1492): No heartbeat from core client for 30 sec - exiting 15:59:41 (1492): No heartbeat from core client for 30 sec - exiting 15:59:42 (1492): No heartbeat from core client for 30 sec - exiting 15:59:43 (1492): No heartbeat from core client for 30 sec - exiting 15:59:44 (1492): No heartbeat from core client for 30 sec - exiting 15:59:45 (1492): No heartbeat from core client for 30 sec - exiting 15:59:46 (1492): No heartbeat from core client for 30 sec - exiting 15:59:47 (1492): No heartbeat from core client for 30 sec - exiting 15:59:48 (1492): No heartbeat from core client for 30 sec - exiting 15:59:50 (1492): No heartbeat from core client for 30 sec - exiting 15:59:51 (1492): No heartbeat from core client for 30 sec - exiting 15:59:52 (1492): No heartbeat from core client for 30 sec - exiting 15:59:53 (1492): No heartbeat from core client for 30 sec - exiting 15:59:54 (1492): No heartbeat from core client for 30 sec - exiting 15:59:55 (1492): No heartbeat from core client for 30 sec - exiting 15:59:56 (1492): No heartbeat from core client for 30 sec - exiting 15:59:57 (1492): No heartbeat from core client for 30 sec - exiting 15:59:58 (1492): No heartbeat from core client for 30 sec - exiting 15:59:59 (1492): No heartbeat from core client for 30 sec - exiting 16:00:00 (1492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:27 (3800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:08 (3800): No heartbeat from core client for 30 sec - exiting 16:03:20 (3800): No heartbeat from core client for 30 sec - exiting 21:03:35 (2920): No heartbeat from core client for 30 sec - exiting 21:03:37 (2920): No heartbeat from core client for 30 sec - exiting 21:03:38 (2920): No heartbeat from core client for 30 sec - exiting 21:03:39 (2920): No heartbeat from core client for 30 sec - exiting 21:03:40 (2920): No heartbeat from core client for 30 sec - exiting 21:03:41 (2920): No heartbeat from core client for 30 sec - exiting 21:03:43 (2920): No heartbeat from core client for 30 sec - exiting 21:03:44 (2920): No heartbeat from core client for 30 sec - exiting 21:03:45 (2920): No heartbeat from core client for 30 sec - exiting 21:03:46 (2920): No heartbeat from core client for 30 sec - exiting 21:03:47 (2920): No heartbeat from core client for 30 sec - exiting 21:03:49 (2920): No heartbeat from core client for 30 sec - exiting 21:03:50 (2920): No heartbeat from core client for 30 sec - exiting 21:03:51 (2920): No heartbeat from core client for 30 sec - exiting 21:03:54 (2920): No heartbeat from core client for 30 sec - exiting 21:03:55 (2920): No heartbeat from core client for 30 sec - exiting 21:03:58 (2920): No heartbeat from core client for 30 sec - exiting 21:04:00 (2920): No heartbeat from core client for 30 sec - exiting 21:04:01 (2920): No heartbeat from core client for 30 sec - exiting 21:04:06 (2920): No heartbeat from core client for 30 sec - exiting 21:04:07 (2920): No heartbeat from core client for 30 sec - exiting 21:04:09 (2920): No heartbeat from core client for 30 sec - exiting 21:04:45 (2920): No heartbeat from core client for 30 sec - exiting 21:04:46 (2920): No heartbeat from core client for 30 sec - exiting 21:04:47 (2920): No heartbeat from core client for 30 sec - exiting 21:04:48 (2920): No heartbeat from core client for 30 sec - exiting 21:04:50 (2920): No heartbeat from core client for 30 sec - exiting 21:04:51 (2920): No heartbeat from core client for 30 sec - exiting 21:05:27 (2920): No heartbeat from core client for 30 sec - exiting 21:05:28 (2920): No heartbeat from core client for 30 sec - exiting 21:05:29 (2920): No heartbeat from core client for 30 sec - exiting 21:05:30 (2920): No heartbeat from core client for 30 sec - exiting 21:05:32 (2920): No heartbeat from core client for 30 sec - exiting 21:05:33 (2920): No heartbeat from core client for 30 sec - exiting 21:05:34 (2920): No heartbeat from core client for 30 sec - exiting 21:05:35 (2920): No heartbeat from core client for 30 sec - exiting 21:05:36 (2920): No heartbeat from core client for 30 sec - exiting 21:05:37 (2920): No heartbeat from core client for 30 sec - exiting 21:05:38 (2920): No heartbeat from core client for 30 sec - exiting 21:05:39 (2920): No heartbeat from core client for 30 sec - exiting 21:05:40 (2920): No heartbeat from core client for 30 sec - exiting 21:05:41 (2920): No heartbeat from core client for 30 sec - exiting 21:05:43 (2920): No heartbeat from core client for 30 sec - exiting 21:05:44 (2920): No heartbeat from core client for 30 sec - exiting 21:09:26 (2920): No heartbeat from core client for 30 sec - exiting 21:09:41 (2920): No heartbeat from core client for 30 sec - exiting 21:12:47 (2920): No heartbeat from core client for 30 sec - exiting 21:15:45 (2920): No heartbeat from core client for 30 sec - exiting 21:11:18 (2920): No heartbeat from core client for 30 sec - exiting 21:11:30 (2920): No heartbeat from core client for 30 sec - exiting 21:11:31 (2920): No heartbeat from core client for 30 sec - exiting 21:11:32 (2920): No heartbeat from core client for 30 sec - exiting 21:17:58 (2920): No heartbeat from core client for 30 sec - exiting 21:18:15 (2920): No heartbeat from core client for 30 sec - exiting 21:18:16 (2920): No heartbeat from core client for 30 sec - exiting 21:18:17 (2920): No heartbeat from core client for 30 sec - exiting 21:18:19 (2920): No heartbeat from core client for 30 sec - exiting 21:18:20 (2920): No heartbeat from core client for 30 sec - exiting 21:18:21 (2920): No heartbeat from core client for 30 sec - exiting 21:18:22 (2920): No heartbeat from core client for 30 sec - exiting 21:18:24 (2920): No heartbeat from core client for 30 sec - exiting 21:18:25 (2920): No heartbeat from core client for 30 sec - exiting 21:18:26 (2920): No heartbeat from core client for 30 sec - exiting 21:18:27 (2920): No heartbeat from core client for 30 sec - exiting 21:18:28 (2920): No heartbeat from core client for 30 sec - exiting 21:18:30 (2920): No heartbeat from core client for 30 sec - exiting 21:18:31 (2920): No heartbeat from core client for 30 sec - exiting 21:18:32 (2920): No heartbeat from core client for 30 sec - exiting 21:18:33 (2920): No heartbeat from core client for 30 sec - exiting 21:18:34 (2920): No heartbeat from core client for 30 sec - exiting 21:18:35 (2920): No heartbeat from core client for 30 sec - exiting 21:18:36 (2920): No heartbeat from core client for 30 sec - exiting 21:18:37 (2920): No heartbeat from core client for 30 sec - exiting 21:18:38 (2920): No heartbeat from core client for 30 sec - exiting 21:18:39 (2920): No heartbeat from core client for 30 sec - exiting 21:18:40 (2920): No heartbeat from core client for 30 sec - exiting 21:18:42 (2920): No heartbeat from core client for 30 sec - exiting 21:18:43 (2920): No heartbeat from core client for 30 sec - exiting 21:18:44 (2920): No heartbeat from core client for 30 sec - exiting 21:18:45 (2920): No heartbeat from core client for 30 sec - exiting 21:18:46 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:47 (2920): No heartbeat from core client for 30 sec - exiting 21:18:48 (2920): No heartbeat from core client for 30 sec - exiting 21:18:49 (2920): No heartbeat from core client for 30 sec - exiting 21:18:50 (2920): No heartbeat from core client for 30 sec - exiting 21:18:52 (2920): No heartbeat from core client for 30 sec - exiting 21:18:53 (2920): No heartbeat from core client for 30 sec - exiting 21:18:54 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:49:22 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:27 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:33 (1752): No heartbeat from core client for 30 sec - exiting 00:53:34 (1752): No heartbeat from core client for 30 sec - exiting 00:53:35 (1752): No heartbeat from core client for 30 sec - exiting 00:53:36 (1752): No heartbeat from core client for 30 sec - exiting 00:53:37 (1752): No heartbeat from core client for 30 sec - exiting 00:53:38 (1752): No heartbeat from core client for 30 sec - exiting 01:01:43 (1464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:44 (1464): No heartbeat from core client for 30 sec - exiting 02:01:33 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:35 (2016): No heartbeat from core client for 30 sec - exiting 02:01:36 (2016): No heartbeat from core client for 30 sec - exiting 02:01:37 (2016): No heartbeat from core client for 30 sec - exiting 02:20:33 (648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:36 (648): No heartbeat from core client for 30 sec - exiting 02:20:37 (648): No heartbeat from core client for 30 sec - exiting 02:24:07 (2656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:24:10 (2656): No heartbeat from core client for 30 sec - exiting 02:24:11 (2656): No heartbeat from core client for 30 sec - exiting 02:24:12 (2656): No heartbeat from core client for 30 sec - exiting 02:24:13 (2656): No heartbeat from core client for 30 sec - exiting 02:24:15 (2656): No heartbeat from core client for 30 sec - exiting 02:32:57 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:33:03 (3164): No heartbeat from core client for 30 sec - exiting 02:33:04 (3164): No heartbeat from core client for 30 sec - exiting 02:33:06 (3164): No heartbeat from core client for 30 sec - exiting 02:33:07 (3164): No heartbeat from core client for 30 sec - exiting 02:33:09 (3164): No heartbeat from core client for 30 sec - exiting 02:33:11 (3164): No heartbeat from core client for 30 sec - exiting 02:33:12 (3164): No heartbeat from core client for 30 sec - exiting 02:33:13 (3164): No heartbeat from core client for 30 sec - exiting 02:33:15 (3164): No heartbeat from core client for 30 sec - exiting 02:33:16 (3164): No heartbeat from core client for 30 sec - exiting 02:33:17 (3164): No heartbeat from core client for 30 sec - exiting 02:37:41 (648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:37:44 (648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:28:20 (3692): No heartbeat from core client for 30 sec - exiting 19:28:22 (3692): No heartbeat from core client for 30 sec - exiting 19:28:24 (3692): No heartbeat from core client for 30 sec - exiting 19:28:25 (3692): No heartbeat from core client for 30 sec - exiting 19:28:26 (3692): No heartbeat from core client for 30 sec - exiting 19:28:27 (3692): No heartbeat from core client for 30 sec - exiting 19:28:28 (3692): No heartbeat from core client for 30 sec - exiting 19:28:29 (3692): No heartbeat from core client for 30 sec - exiting 19:28:31 (3692): No heartbeat from core client for 30 sec - exiting 19:28:32 (3692): No heartbeat from core client for 30 sec - exiting 19:28:33 (3692): No heartbeat from core client for 30 sec - exiting 19:28:34 (3692): No heartbeat from core client for 30 sec - exiting 19:28:35 (3692): No heartbeat from core client for 30 sec - exiting 19:28:36 (3692): No heartbeat from core client for 30 sec - exiting 19:29:10 (3692): No heartbeat from core client for 30 sec - exiting 19:29:12 (3692): No heartbeat from core client for 30 sec - exiting 19:29:13 (3692): No heartbeat from core client for 30 sec - exiting 19:29:14 (3692): No heartbeat from core client for 30 sec - exiting 19:29:15 (3692): No heartbeat from core client for 30 sec - exiting 19:29:17 (3692): No heartbeat from core client for 30 sec - exiting 19:29:18 (3692): No heartbeat from core client for 30 sec - exiting 19:29:20 (3692): No heartbeat from core client for 30 sec - exiting 19:29:21 (3692): No heartbeat from core client for 30 sec - exiting 19:29:22 (3692): No heartbeat from core client for 30 sec - exiting 19:30:23 (3692): No heartbeat from core client for 30 sec - exiting 19:30:24 (3692): No heartbeat from core client for 30 sec - exiting 19:30:25 (3692): No heartbeat from core client for 30 sec - exiting 19:30:26 (3692): No heartbeat from core client for 30 sec - exiting 19:30:27 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:00 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:13 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:16 (3444): No heartbeat from core client for 30 sec - exiting 20:41:17 (3444): No heartbeat from core client for 30 sec - exiting 09:53:25 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:55 (3184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:56 (3184): No heartbeat from core client for 30 sec - exiting 11:24:57 (3184): No heartbeat from core client for 30 sec - exiting 11:28:31 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:48 (4060): No heartbeat from core client for 30 sec - exiting 11:29:06 (4060): No heartbeat from core client for 30 sec - exiting 11:29:13 (4060): No heartbeat from core client for 30 sec - exiting 11:29:24 (4060): No heartbeat from core client for 30 sec - exiting 11:29:26 (4060):CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... 18:28:12 (3600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:06 (1852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:30:10 (1852): No heartbeat from core client for 30 sec - exiting 18:31:34 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:30 (668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:29:46 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:29:49 (3644): No heartbeat from core client for 30 sec - exiting 23:29:50 (3644): No heartbeat from core client for 30 sec - exiting 23:29:51 (3644): No heartbeat from core client for 30 sec - exiting 23:29:53 (3644): No heartbeat from core client for 30 sec - exiting 23:29:54 (3644): No heartbeat from core client for 30 sec - exiting 23:29:55 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:43:59 (4024): No heartbeat from core client for 30 sec - exiting 23:44:00 (4024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1052, iMonCtr=1 Model crash detected, will try to restart... 15:59:29 (3448): No heartbeat from core client for 30 sec - exiting 15:59:30 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2628, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:39:59 (3316): No heartbeat from core client for 30 sec - exiting 00:40:00 (3316): No heartbeat from core client for 30 sec - exiting 00:40:01 (3316): No heartbeat from core client for 30 sec - exiting 00:40:03 (3316): No heartbeat from core client for 30 sec - exiting 00:40:04 (3316): No heartbeat from core client for 30 sec - exiting 00:40:05 (3316): No heartbeat from core client for 30 sec - exiting 00:40:06 (3316): No heartbeat from core client for 30 sec - exiting 00:40:07 (3316): No heartbeat from core client for 30 sec - exiting 00:40:09 (3316): No heartbeat from core client for 30 sec - exiting 00:40:10 (3316): No heartbeat from core client for 30 sec - exiting 00:40:11 (3316): No heartbeat from core client for 30 sec - exiting 00:40:12 (3316): No heartbeat from core client for 30 sec - exiting 00:40:13 (3316): No heartbeat from core client for 30 sec - exiting 00:40:14 (3316): No heartbeat from core client for 30 sec - exiting 00:40:15 (3316): No heartbeat from core client for 30 sec - exiting 00:40:16 (3316): No heartbeat from core client for 30 sec - exiting 00:40:18 (3316): No heartbeat from core client for 30 sec - exiting 00:40:19 (3316): No heartbeat from core client for 30 sec - exiting 00:40:20 (3316): No heartbeat from core client for 30 sec - exiting 00:40:21 (3316): No heartbeat from core client for 30 sec - exiting 00:40:22 (3316): No heartbeat from core client for 30 sec - exiting 00:40:23 (3316): No heartbeat from core client for 30 sec - exiting 00:40:26 (3316): No heartbeat from core client for 30 sec - exiting 00:40:27 (3316): No heartbeat from core client for 30 sec - exiting 00:40:29 (3316): No heartbeat from core client for 30 sec - exiting 00:40:30 (3316): No heartbeat from core client for 30 sec - exiting 00:40:31 (3316): No heartbeat from core client for 30 sec - exiting 00:40:32 (3316): No heartbeat from core client for 30 sec - exiting 00:40:33 (3316): No heartbeat from core client for 30 sec - exiting 00:40:35 (3316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:36 (3316): No heartbeat from core client for 30 sec - exiting 00:40:37 (3316): No heartbeat from core client for 30 sec - exiting 00:40:38 (3316): No heartbeat from core client for 30 sec - exiting 00:40:39 (3316): No heartbeat from core client for 30 sec - exiting 00:40:40 (3316): No heartbeat from core client for 30 sec - exiting 00:40:41 (3316): No heartbeat from core client for 30 sec - exiting 00:40:43 (3316): No heartbeat from core client for 30 sec - exiting 00:40:44 (3316): No heartbeat from core client for 30 sec - exiting 00:40:45 (3316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2752, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=732, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3760, iMonCtr=1 Model crash detected, will try to restart... 08:44:35 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:06 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:59:56 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4364, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Dec 2011 22:29:10	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	1,036,800	1,638,753	1.5806
01 Dec 2011 06:24:58	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	1,010,880	1,596,683	1.5795
30 Nov 2011 16:32:13	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	984,960	1,548,328	1.5720
29 Nov 2011 15:27:44	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	959,040	1,502,144	1.5663
29 Nov 2011 05:45:12	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	933,120	1,467,265	1.5724
28 Nov 2011 16:12:34	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	907,200	1,418,858	1.5640
27 Nov 2011 15:42:32	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	881,280	1,370,872	1.5555
26 Nov 2011 11:10:11	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	855,360	1,334,390	1.5600
24 Nov 2011 23:58:33	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	829,440	1,299,501	1.5667
24 Nov 2011 04:40:31	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	803,520	1,265,144	1.5745
23 Nov 2011 17:44:36	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	777,600	1,225,881	1.5765
22 Nov 2011 23:05:07	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	751,680	1,177,362	1.5663
22 Nov 2011 07:03:19	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	725,760	1,130,608	1.5578
21 Nov 2011 10:39:01	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	699,840	1,084,600	1.5498
20 Nov 2011 21:55:38	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	673,920	1,038,689	1.5413
20 Nov 2011 07:27:32	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	648,000	990,465	1.5285
19 Nov 2011 18:06:33	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	622,080	942,549	1.5152
19 Nov 2011 05:02:42	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	596,160	895,666	1.5024
18 Nov 2011 05:43:20	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	570,240	847,849	1.4868
17 Nov 2011 14:14:47	1052375	13552162	hadcm3n_yfcx_1900_40_007523234_0	544,320	801,761	1.4730