Task 15870542

Name	hadcm3n_u3o8_2020_40_008339286_2
Workunit	8490147
Created	28 Jun 2013, 6:11:35 UTC
Sent	28 Jun 2013, 6:18:16 UTC
Report deadline	27 Sep 2013, 13:45:27 UTC
Received	18 Sep 2013, 18:38:31 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1154199
Run time	31 days 13 hours 58 min 50 sec
CPU time	27 days 8 hours 39 min 47 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 04:26:03 (740): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 04:26:05 (740): No heartbeat from core client for 30 sec - exiting 04:26:06 (740): No heartbeat from core client for 30 sec - exiting 04:26:07 (740): No heartbeat from core client for 30 sec - exiting 04:26:08 (740): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:12:37 (11388): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:12:43 (11388): No heartbeat from core client for 30 sec - exiting 16:12:45 (11388): No heartbeat from core client for 30 sec - exiting 16:12:46 (11388): No heartbeat from core client for 30 sec - exiting 16:12:47 (11388): No heartbeat from core client for 30 sec - exiting 16:12:48 (11388): No heartbeat from core client for 30 sec - exiting 16:12:49 (11388): No heartbeat from core client for 30 sec - exiting 16:12:51 (11388): No heartbeat from core client for 30 sec - exiting 16:12:52 (11388): No heartbeat from core client for 30 sec - exiting 16:12:53 (11388): No heartbeat from core client for 30 sec - exiting 16:12:54 (11388): No heartbeat from core client for 30 sec - exiting 16:12:55 (11388): No heartbeat from core client for 30 sec - exiting 16:12:56 (11388): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10544, iMonCtr=1 Model crash detected, will try to restart... 18:44:04 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:50:57 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:02 (6196): No heartbeat from core client for 30 sec - exiting 17:51:03 (6196): No heartbeat from core client for 30 sec - exiting 17:51:04 (6196): No heartbeat from core client for 30 sec - exiting 17:51:06 (6196): No heartbeat from core client for 30 sec - exiting 17:51:07 (6196): No heartbeat from core client for 30 sec - exiting 17:51:08 (6196): No heartbeat from core client for 30 sec - exiting 17:51:09 (6196): No heartbeat from core client for 30 sec - exiting 17:51:10 (6196): No heartbeat from core client for 30 sec - exiting 17:51:11 (6196): No heartbeat from core client for 30 sec - exiting 17:51:12 (6196): No heartbeat from core client for 30 sec - exiting 17:51:14 (6196): No heartbeat from core client for 30 sec - exiting 17:51:15 (6196): No heartbeat from core client for 30 sec - exiting 17:51:16 (6196): No heartbeat from core client for 30 sec - exiting 17:54:19 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:40:17 (1392): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:40:36 (1392): No heartbeat from core client for 30 sec - exiting 06:40:37 (1392): No heartbeat from core client for 30 sec - exiting 06:40:38 (1392): No heartbeat from core client for 30 sec - exiting 06:40:39 (1392): No heartbeat from core client for 30 sec - exiting 06:40:40 (1392): No heartbeat from core client for 30 sec - exiting 06:40:41 (1392): No heartbeat from core client for 30 sec - exiting 06:40:42 (1392): No heartbeat from core client for 30 sec - exiting 06:40:44 (1392): No heartbeat from core client for 30 sec - exiting 06:40:45 (1392): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:10:36 (7412): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:10:38 (7412): No heartbeat from core client for 30 sec - exiting 12:10:39 (7412): No heartbeat from core client for 30 sec - exiting 12:10:40 (7412): No heartbeat from core client for 30 sec - exiting 13:12:56 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:58 (2164): No heartbeat from core client for 30 sec - exiting 13:16:37 (1288): No heartbeat from core client for 30 sec - exiting 13:16:39 (1288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:16:40 (1288): No heartbeat from core client for 30 sec - exiting 13:17:17 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:38:22 (5384): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:12:30 (7336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:12:53 (7336): No heartbeat from core client for 30 sec - exiting 22:12:55 (7336): No heartbeat from core client for 30 sec - exiting 22:12:56 (7336): No heartbeat from core client for 30 sec - exiting 22:12:57 (7336): No heartbeat from core client for 30 sec - exiting 22:12:59 (7336): No heartbeat from core client for 30 sec - exiting 22:13:00 (7336): No heartbeat from core client for 30 sec - exiting 22:13:01 (7336): No heartbeat from core client for 30 sec - exiting 22:13:02 (7336): No heartbeat from core client for 30 sec - exiting 22:13:03 (7336): No heartbeat from core client for 30 sec - exiting 22:13:04 (7336): No heartbeat from core client for 30 sec - exiting 22:13:06 (7336): No heartbeat from core client for 30 sec - exiting 22:13:07 (7336): No heartbeat from core client for 30 sec - exiting 22:13:08 (7336): No heartbeat from core client for 30 sec - exiting 22:13:09 (7336): No heartbeat from core client for 30 sec - exiting 22:13:10 (7336): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:52:35 (5688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:52:39 (5688): No heartbeat from core client for 30 sec - exiting 20:52:40 (5688): No heartbeat from core client for 30 sec - exiting 20:52:41 (5688): No heartbeat from core client for 30 sec - exiting 20:52:42 (5688): No heartbeat from core client for 30 sec - exiting 20:52:43 (5688): No heartbeat from core client for 30 sec - exiting 20:52:44 (5688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:57:02 (3192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:57:15 (3192): No heartbeat from core client for 30 sec - exiting 08:57:18 (3192): No heartbeat from core client for 30 sec - exiting 08:57:19 (3192): No heartbeat from core client for 30 sec - exiting 08:57:20 (3192): No heartbeat from core client for 30 sec - exiting 08:57:22 (3192): No heartbeat from core client for 30 sec - exiting 08:57:25 (3192): No heartbeat from core client for 30 sec - exiting 08:57:55 (3192): No heartbeat from core client for 30 sec - exiting 08:57:57 (3192): No heartbeat from core client for 30 sec - exiting 08:57:58 (3192): No heartbeat from core client for 30 sec - exiting 08:57:59 (3192): No heartbeat from core client for 30 sec - exiting 08:58:00 (3192): No heartbeat from core client for 30 sec - exiting 08:58:01 (3192): No heartbeat from core client for 30 sec - exiting 08:58:02 (3192): No heartbeat from core client for 30 sec - exiting 08:58:03 (3192): No heartbeat from core client for 30 sec - exiting 08:58:04 (3192): No heartbeat from core client for 30 sec - exiting 08:58:06 (3192): No heartbeat from core client for 30 sec - exiting 08:58:07 (3192): No heartbeat from core client for 30 sec - exiting 08:58:08 (3192): No heartbeat from core client for 30 sec - exiting 08:58:09 (3192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:16:13 (9776): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 10:16:16 (9776): No heartbeat from core client for 30 sec - exiting 10:16:17 (9776): No heartbeat from core client for 30 sec - exiting 10:16:18 (9776): No heartbeat from core client for 30 sec - exiting 10:16:19 (9776): No heartbeat from core client for 30 sec - exiting 10:16:20 (9776): No heartbeat from core client for 30 sec - exiting 10:16:21 (9776): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1088, iMonCtr=1 Model crash detected, will try to restart... 01:04:43 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:14:58 (2576): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:15:00 (2576): No heartbeat from core client for 30 sec - exiting 06:15:01 (2576): No heartbeat from core client for 30 sec - exiting 06:15:02 (2576): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:15:20 (6540): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:15:21 (6540): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:13:19 (44168): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:13:20 (44168): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:51:56 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:27:35 (6408): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:27:36 (6408): No heartbeat from core client for 30 sec - exiting 17:27:37 (6408): No heartbeat from core client for 30 sec - exiting 17:27:38 (6408): No heartbeat from core client for 30 sec - exiting 17:27:39 (6408): No heartbeat from core client for 30 sec - exiting 17:27:40 (6408): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:50:39 (6196): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:51:16 (6196): No heartbeat from core client for 30 sec - exiting 03:51:17 (6196): No heartbeat from core client for 30 sec - exiting 03:51:18 (6196): No heartbeat from core client for 30 sec - exiting 03:51:19 (6196): No heartbeat from core client for 30 sec - exiting 03:51:20 (6196): No heartbeat from core client for 30 sec - exiting 03:51:21 (6196): No heartbeat from core client for 30 sec - exiting 03:51:23 (6196): No heartbeat from core client for 30 sec - exiting 03:51:24 (6196): No heartbeat from core client for 30 sec - exiting 03:51:25 (6196): No heartbeat from core client for 30 sec - exiting 03:51:26 (6196): No heartbeat from core client for 30 sec - exiting 03:51:27 (6196): No heartbeat from core client for 30 sec - exiting 03:51:28 (6196): No heartbeat from core client for 30 sec - exiting 03:51:29 (6196): No heartbeat from core client for 30 sec - exiting 03:51:30 (6196): No heartbeat from core client for 30 sec - exiting 03:51:32 (6196): No heartbeat from core client for 30 sec - exiting 03:51:34 (6196): No heartbeat from core client for 30 sec - exiting 03:51:35 (6196): No heartbeat from core client for 30 sec - exiting 03:51:36 (6196): No heartbeat from core client for 30 sec - exiting 03:51:37 (6196): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:14:59 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:19:51 (13308): No heartbeat from core client for 30 sec - exiting 06:19:53 (13308): No heartbeat from core client for 30 sec - exiting 06:19:54 (13308): No heartbeat from core client for 30 sec - exiting 06:19:55 (13308): No heartbeat from core client for 30 sec - exiting 06:19:56 (13308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:19:57 (13308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:40:37 (7320): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:40:39 (7320): No heartbeat from core client for 30 sec - exiting 17:40:40 (7320): No heartbeat from core client for 30 sec - exiting 18:56:30 (13136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:30 (13976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:33 (7028): No heartbeat from core client for 30 sec - exiting 19:02:34 (7028): No heartbeat from core client for 30 sec - exiting 19:02:35 (7028): No heartbeat from core client for 30 sec - exiting 19:02:36 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:31 (9008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:21:32 (13040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:32 (13188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:33 (13548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:35 (12512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:37 (12512): No heartbeat from core client for 30 sec - exiting 19:42:50 (1720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:36 (14068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:37 (14068): No heartbeat from core client for 30 sec - exiting 19:58:36 (13128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:06:37 (11524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:05 (11072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:39 (7520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:40 (7520): No heartbeat from core client for 30 sec - exiting 20:16:41 (7520): No heartbeat from core client for 30 sec - exiting 20:16:42 (7520): No heartbeat from core client for 30 sec - exiting 20:16:43 (7520): No heartbeat from core client for 30 sec - exiting 20:16:45 (7520): No heartbeat from core client for 30 sec - exiting 20:16:46 (7520): No heartbeat from core client for 30 sec - exiting 20:26:40 (13876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:41 (13876): No heartbeat from core client for 30 sec - exiting 20:31:40 (11656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:42 (11656): No heartbeat from core client for 30 sec - exiting 20:41:41 (12748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:43 (12748): No heartbeat from core client for 30 sec - exiting 20:46:42 (13056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:17 (9584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:47 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:46 (13504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:46 (7108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:11 (13024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:47 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:15 (6324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:16 (6324): No heartbeat from core client for 30 sec - exiting 21:13:17 (6324): No heartbeat from core client for 30 sec - exiting 21:21:48 (10748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:23:19 (10564): No heartbeat from core client for 30 sec - exiting 21:23:20 (10564): No heartbeat from core client for 30 sec - exiting 21:23:21 (10564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:48 (11664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:49 (11664): No heartbeat from core client for 30 sec - exiting 21:26:50 (11664): No heartbeat from core client for 30 sec - exiting 21:31:48 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:50 (6628): No heartbeat from core client for 30 sec - exiting 21:36:49 (6052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:50 (6052): No heartbeat from core client for 30 sec - exiting 21:38:56 (10604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:15 (13956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:56 (14024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:51 (14080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:37 (8272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:54 (7936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:35 (13456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:36 (13456): No heartbeat from core client for 30 sec - exiting 21:55:37 (13456): No heartbeat from core client for 30 sec - exiting 22:02:59 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:00 (5624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:54:35 (11904): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:54:36 (11904): No heartbeat from core client for 30 sec - exiting 14:54:37 (11904): No heartbeat from core client for 30 sec - exiting 14:54:39 (11904): No heartbeat from core client for 30 sec - exiting 15:34:58 (16264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:39:58 (15868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:40 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:43:42 (2856): No heartbeat from core client for 30 sec - exiting 15:43:43 (2856): No heartbeat from core client for 30 sec - exiting 15:43:44 (2856): No heartbeat from core client for 30 sec - exiting 15:43:45 (2856): No heartbeat from core client for 30 sec - exiting 15:43:46 (2856): No heartbeat from core client for 30 sec - exiting 15:43:48 (2856): No heartbeat from core client for 30 sec - exiting 15:43:49 (2856): No heartbeat from core client for 30 sec - exiting 15:43:50 (2856): No heartbeat from core client for 30 sec - exiting 15:43:51 (2856): No heartbeat from core client for 30 sec - exiting 15:43:52 (2856): No heartbeat from core client for 30 sec - exiting 15:43:53 (2856): No heartbeat from core client for 30 sec - exiting 15:46:10 (11684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:11 (16304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:13 (16304): No heartbeat from core client for 30 sec - exiting 15:51:14 (16304): No heartbeat from core client for 30 sec - exiting 15:56:12 (15552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:36 (12528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:55 (5520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:58 (5520): No heartbeat from core client for 30 sec - exiting 16:00:59 (5520): No heartbeat from core client for 30 sec - exiting 16:01:00 (5520): No heartbeat from core client for 30 sec - exiting 16:01:01 (5520): No heartbeat from core client for 30 sec - exiting 16:04:03 (10604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:42 (16212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:06:43 (16212): No heartbeat from core client for 30 sec - exiting 16:06:44 (16212): No heartbeat from core client for 30 sec - exiting 16:06:45 (16212): No heartbeat from core client for 30 sec - exiting 16:06:46 (16212): No heartbeat from core client for 30 sec - exiting 16:06:47 (16212): No heartbeat from core client for 30 sec - exiting 16:06:49 (16212): No heartbeat from core client for 30 sec - exiting 16:06:50 (16212): No heartbeat from core client for 30 sec - exiting 16:06:51 (16212): No heartbeat from core client for 30 sec - exiting 16:06:52 (16212): No heartbeat from core client for 30 sec - exiting 16:06:53 (16212): No heartbeat from core client for 30 sec - exiting 16:08:47 (15508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:42 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:44 (204): No heartbeat from core client for 30 sec - exiting 16:11:45 (204): No heartbeat from core client for 30 sec - exiting 16:16:43 (12116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:45 (15980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:46 (15980): No heartbeat from core client for 30 sec - exiting 16:21:48 (15980): No heartbeat from core client for 30 sec - exiting 16:21:49 (15980): No heartbeat from core client for 30 sec - exiting 16:21:50 (15980): No heartbeat from core client for 30 sec - exiting 16:21:51 (15980): No heartbeat from core client for 30 sec - exiting 16:21:52 (15980): No heartbeat from core client for 30 sec - exiting 16:21:53 (15980): No heartbeat from core client for 30 sec - exiting 16:21:54 (15980): No heartbeat from core client for 30 sec - exiting 16:21:55 (15980): No heartbeat from core client for 30 sec - exiting 16:21:56 (15980): No heartbeat from core client for 30 sec - exiting 16:23:24 (15396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:51 (13892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:54 (13892): No heartbeat from core client for 30 sec - exiting 16:26:56 (13892): No heartbeat from core client for 30 sec - exiting 16:26:57 (13892): No heartbeat from core client for 30 sec - exiting 16:29:01 (14820): No heartbeat from core client for 30 sec - exiting 16:29:02 (14820): No heartbeat from core client for 30 sec - exiting 16:29:03 (14820): No heartbeat from core client for 30 sec - exiting 16:29:04 (14820): No heartbeat from core client for 30 sec - exiting 16:29:05 (14820): No heartbeat from core client for 30 sec - exiting 16:29:06 (14820): No heartbeat from core client for 30 sec - exiting 16:29:07 (14820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:30:15 (14356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:07:17 (6784): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:58:28 (6116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 18:58:30 (6116): No heartbeat from core client for 30 sec - exiting 18:58:31 (6116): No heartbeat from core client for 30 sec - exiting 18:58:32 (6116): No heartbeat from core client for 30 sec - exiting 18:58:33 (6116): No heartbeat from core client for 30 sec - exiting 18:58:34 (6116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:30:08 (2104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:30:25 (2104): No heartbeat from core client for 30 sec - exiting 06:30:26 (2104): No heartbeat from core client for 30 sec - exiting 06:30:27 (2104): No heartbeat from core client for 30 sec - exiting 06:30:28 (2104): No heartbeat from core client for 30 sec - exiting 06:30:29 (2104): No heartbeat from core client for 30 sec - exiting 06:30:30 (2104): No heartbeat from core client for 30 sec - exiting 06:30:31 (2104): No heartbeat from core client for 30 sec - exiting 06:30:32 (2104): No heartbeat from core client for 30 sec - exiting 06:30:33 (2104): No heartbeat from core client for 30 sec - exiting 06:30:35 (2104): No heartbeat from core client for 30 sec - exiting 06:30:36 (2104): No heartbeat from core client for 30 sec - exiting 06:30:37 (2104): No heartbeat from core client for 30 sec - exiting 06:30:38 (2104): No heartbeat from core client for 30 sec - exiting 06:30:39 (2104): No heartbeat from core client for 30 sec - exiting 06:30:40 (2104): No heartbeat from core client for 30 sec - exiting 06:30:41 (2104): No heartbeat from core client for 30 sec - exiting 06:30:42 (2104): No heartbeat from core client for 30 sec - exiting 06:30:44 (2104): No heartbeat from core client for 30 sec - exiting 06:30:45 (2104): No heartbeat from core client for 30 sec - exiting 06:30:47 (2104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:27:27 (2104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:27:30 (2104): No heartbeat from core client for 30 sec - exiting 23:27:32 (2104): No heartbeat from core client for 30 sec - exiting 23:27:33 (2104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:47:08 (8376): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:47:23 (8376): No heartbeat from core client for 30 sec - exiting 09:47:24 (8376): No heartbeat from core client for 30 sec - exiting 09:47:25 (8376): No heartbeat from core client for 30 sec - exiting 09:47:27 (8376): No heartbeat from core client for 30 sec - exiting 09:47:28 (8376): No heartbeat from core client for 30 sec - exiting 09:47:29 (8376): No heartbeat from core client for 30 sec - exiting 09:47:30 (8376): No heartbeat from core client for 30 sec - exiting 09:47:32 (8376): No heartbeat from core client for 30 sec - exiting 09:47:33 (8376): No heartbeat from core client for 30 sec - exiting 09:47:34 (8376): No heartbeat from core client for 30 sec - exiting 09:47:35 (8376): No heartbeat from core client for 30 sec - exiting 09:47:36 (8376): No heartbeat from core client for 30 sec - exiting 09:47:37 (8376): No heartbeat from core client for 30 sec - exiting 09:47:38 (8376): No heartbeat from core client for 30 sec - exiting 09:47:40 (8376): No heartbeat from core client for 30 sec - exiting 09:47:41 (8376): No heartbeat from core client for 30 sec - exiting 09:47:42 (8376): No heartbeat from core client for 30 sec - exiting Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Sep 2013 18:17:57	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	1,036,800	2,363,208	2.2793
17 Sep 2013 08:58:01	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	1,010,880	2,303,926	2.2791
15 Sep 2013 04:37:46	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	984,960	2,243,081	2.2773
06 Sep 2013 13:53:40	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	959,040	2,184,125	2.2774
01 Sep 2013 10:39:48	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	933,120	2,121,454	2.2735
31 Aug 2013 05:23:24	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	907,200	2,058,935	2.2695
30 Aug 2013 05:51:08	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	881,280	1,996,539	2.2655
28 Aug 2013 18:30:53	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	855,360	1,933,248	2.2602
27 Aug 2013 01:39:14	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	829,440	1,869,870	2.2544
25 Aug 2013 17:29:54	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	803,520	1,807,225	2.2491
24 Aug 2013 11:28:47	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	777,600	1,751,081	2.2519
23 Aug 2013 11:14:08	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	751,680	1,682,257	2.2380
21 Aug 2013 06:06:08	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	725,760	1,619,056	2.2308
14 Aug 2013 16:10:17	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	699,840	1,558,992	2.2276
14 Aug 2013 16:10:17	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	673,920	1,502,159	2.2290
14 Aug 2013 16:10:17	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	648,000	1,444,735	2.2295
14 Aug 2013 16:10:17	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	622,080	1,387,216	2.2300
14 Aug 2013 16:10:17	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	596,160	1,329,294	2.2298
14 Aug 2013 16:10:17	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	570,240	1,271,523	2.2298
14 Aug 2013 16:10:17	1154199	15870542	hadcm3n_u3o8_2020_40_008339286_2	544,320	1,214,804	2.2318