Task 15543686

Name	hadcm3n_zkfz_1880_40_008246986_3
Workunit	8402110
Created	14 Jan 2013, 12:09:08 UTC
Sent	14 Jan 2013, 12:09:14 UTC
Report deadline	15 Apr 2013, 19:36:25 UTC
Received	27 Feb 2013, 6:23:47 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1131315
Run time	19 days 15 hours 7 min 58 sec
CPU time	19 days 1 hours 27 min 12 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 06:22:49 (23200): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19124, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:47:06 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:18:55 (5660): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:35:19 (9952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:21 (9952): No heartbeat from core client for 30 sec - exiting 12:36:47 (26376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:40:48 (16196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:42:27 (25692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:11:12 (26884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:42:11 (18308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:14 (18308): No heartbeat from core client for 30 sec - exiting 08:42:15 (18308): No heartbeat from core client for 30 sec - exiting 08:42:16 (18308): No heartbeat from core client for 30 sec - exiting 08:48:55 (6140): No heartbeat from core client for 30 sec - exiting 08:48:56 (6140): No heartbeat from core client for 30 sec - exiting 08:48:57 (6140): No heartbeat from core client for 30 sec - exiting 08:48:58 (6140): No heartbeat from core client for 30 sec - exiting 08:48:59 (6140): No heartbeat from core client for 30 sec - exiting 08:49:00 (6140): No heartbeat from core client for 30 sec - exiting 08:49:01 (6140): No heartbeat from core client for 30 sec - exiting 08:49:02 (6140): No heartbeat from core client for 30 sec - exiting 08:49:04 (6140): No heartbeat from core client for 30 sec - exiting 08:49:05 (6140): No heartbeat from core client for 30 sec - exiting 08:49:06 (6140): No heartbeat from core client for 30 sec - exiting 08:49:07 (6140): No heartbeat from core client for 30 sec - exiting 08:49:08 (6140): No heartbeat from core client for 30 sec - exiting 08:49:09 (6140): No heartbeat from core client for 30 sec - exiting 08:49:10 (6140): No heartbeat from core client for 30 sec - exiting 08:49:11 (6140): No heartbeat from core client for 30 sec - exiting 08:49:12 (6140): No heartbeat from core client for 30 sec - exiting 08:49:13 (6140): No heartbeat from core client for 30 sec - exiting 08:49:14 (6140): No heartbeat from core client for 30 sec - exiting 08:49:15 (6140): No heartbeat from core client for 30 sec - exiting 08:49:16 (6140): No heartbeat from core client for 30 sec - exiting 08:49:18 (6140): No heartbeat from core client for 30 sec - exiting 08:49:19 (6140): No heartbeat from core client for 30 sec - exiting 08:49:20 (6140): No heartbeat from core client for 30 sec - exiting 08:49:21 (6140): No heartbeat from core client for 30 sec - exiting 08:49:22 (6140): No heartbeat from core client for 30 sec - exiting 08:49:23 (6140): No heartbeat from core client for 30 sec - exiting 08:49:24 (6140): No heartbeat from core client for 30 sec - exiting 08:49:25 (6140): No heartbeat from core client for 30 sec - exiting 08:49:26 (6140): No heartbeat from core client for 30 sec - exiting 08:49:27 (6140): No heartbeat from core client for 30 sec - exiting 08:49:28 (6140): No heartbeat from core client for 30 sec - exiting 08:49:29 (6140): No heartbeat from core client for 30 sec - exiting 08:49:30 (6140): No heartbeat from core client for 30 sec - exiting 08:49:31 (6140): No heartbeat from core client for 30 sec - exiting 08:49:32 (6140): No heartbeat from core client for 30 sec - exiting 08:49:34 (6140): No heartbeat from core client for 30 sec - exiting 08:49:35 (6140): No heartbeat from core client for 30 sec - exiting 08:49:36 (6140): No heartbeat from core client for 30 sec - exiting 08:49:37 (6140): No heartbeat from core client for 30 sec - exiting 08:49:38 (6140): No heartbeat from core client for 30 sec - exiting 08:49:39 (6140): No heartbeat from core client for 30 sec - exiting 08:49:40 (6140): No heartbeat from core client for 30 sec - exiting 08:49:41 (6140): No heartbeat from core client for 30 sec - exiting 08:49:42 (6140): No heartbeat from core client for 30 sec - exiting 08:49:43 (6140): No heartbeat from core client for 30 sec - exiting 08:49:45 (6140): No heartbeat from core client for 30 sec - exiting 08:49:46 (6140): No heartbeat from core client for 30 sec - exiting 08:49:47 (6140): No heartbeat from core client for 30 sec - exiting 08:49:48 (6140): No heartbeat from core client for 30 sec - exiting 08:49:49 (6140): No heartbeat from core client for 30 sec - exiting 08:49:50 (6140): No heartbeat from core client for 30 sec - exiting 08:49:51 (6140): No heartbeat from core client for 30 sec - exiting 08:49:52 (6140): No heartbeat from core client for 30 sec - exiting 08:49:53 (6140): No heartbeat from core client for 30 sec - exiting 08:50:27 (6140): No heartbeat from core client for 30 sec - exiting 08:50:28 (6140): No heartbeat from core client for 30 sec - exiting 08:50:29 (6140): No heartbeat from core client for 30 sec - exiting 08:50:30 (6140): No heartbeat from core client for 30 sec - exiting 08:50:31 (6140): No heartbeat from core client for 30 sec - exiting 08:50:32 (6140): No heartbeat from core client for 30 sec - exiting 08:50:33 (6140): No heartbeat from core client for 30 sec - exiting 08:50:34 (6140): No heartbeat from core client for 30 sec - exiting 08:50:35 (6140): No heartbeat from core client for 30 sec - exiting 08:50:36 (6140): No heartbeat from core client for 30 sec - exiting 08:50:37 (6140): No heartbeat from core client for 30 sec - exiting 08:50:38 (6140): No heartbeat from core client for 30 sec - exiting 08:50:40 (6140): No heartbeat from core client for 30 sec - exiting 08:50:41 (6140): No heartbeat from core client for 30 sec - exiting 08:50:42 (6140): No heartbeat from core client for 30 sec - exiting 08:50:43 (6140): No heartbeat from core client for 30 sec - exiting 08:51:37 (6140): No heartbeat from core client for 30 sec - exiting 08:51:38 (6140): No heartbeat from core client for 30 sec - exiting 08:51:39 (6140): No heartbeat from core client for 30 sec - exiting 08:51:40 (6140): No heartbeat from core client for 30 sec - exiting 08:51:41 (6140): No heartbeat from core client for 30 sec - exiting 08:51:42 (6140): No heartbeat from core client for 30 sec - exiting 08:51:43 (6140): No heartbeat from core client for 30 sec - exiting 08:51:44 (6140): No heartbeat from core client for 30 sec - exiting 08:51:45 (6140): No heartbeat from core client for 30 sec - exiting 08:51:46 (6140): No heartbeat from core client for 30 sec - exiting 08:51:47 (6140): No heartbeat from core client for 30 sec - exiting 08:51:48 (6140): No heartbeat from core client for 30 sec - exiting 08:51:49 (6140): No heartbeat from core client for 30 sec - exiting 08:52:21 (6140): No heartbeat from core client for 30 sec - exiting 08:52:22 (6140): No heartbeat from core client for 30 sec - exiting 08:52:23 (6140): No heartbeat from core client for 30 sec - exiting 08:52:24 (6140): No heartbeat from core client for 30 sec - exiting 08:52:25 (6140): No heartbeat from core client for 30 sec - exiting 08:52:26 (6140): No heartbeat from core client for 30 sec - exiting 08:52:27 (6140): No heartbeat from core client for 30 sec - exiting 08:52:28 (6140): No heartbeat from core client for 30 sec - exiting 08:52:29 (6140): No heartbeat from core client for 30 sec - exiting 08:52:30 (6140): No heartbeat from core client for 30 sec - exiting 08:52:31 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:27 (30500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:30 (32432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:54 (7236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 09:08:46 (21724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:41 (6932): No heartbeat from core client for 30 sec - exiting 09:10:46 (6932): No heartbeat from core client for 30 sec - exiting 09:10:47 (6932): No heartbeat from core client for 30 sec - exiting 09:10:48 (6932): No heartbeat from core client for 30 sec - exiting 09:10:49 (6932): No heartbeat from core client for 30 sec - exiting 09:10:50 (6932): No heartbeat from core client for 30 sec - exiting 09:10:51 (6932): No heartbeat from core client for 30 sec - exiting 09:10:52 (6932): No heartbeat from core client for 30 sec - exiting 09:10:53 (6932): No heartbeat from core client for 30 sec - exiting 09:10:54 (6932): No heartbeat from core client for 30 sec - exiting 09:10:55 (6932): No heartbeat from core client for 30 sec - exiting 09:10:56 (6932): No heartbeat from core client for 30 sec - exiting 09:10:57 (6932): No heartbeat from core client for 30 sec - exiting 09:10:58 (6932): No heartbeat from core client for 30 sec - exiting 09:10:59 (6932): No heartbeat from core client for 30 sec - exiting 09:11:00 (6932): No heartbeat from core client for 30 sec - exiting 09:11:01 (6932): No heartbeat from core client for 30 sec - exiting 09:11:02 (6932): No heartbeat from core client for 30 sec - exiting 09:11:03 (6932): No heartbeat from core client for 30 sec - exiting 09:11:04 (6932): No heartbeat from core client for 30 sec - exiting 09:11:05 (6932): No heartbeat from core client for 30 sec - exiting 09:11:06 (6932): No heartbeat from core client for 30 sec - exiting 09:11:07 (6932): No heartbeat from core client for 30 sec - exiting 09:11:09 (6932): No heartbeat from core client for 30 sec - exiting 09:11:10 (6932): No heartbeat from core client for 30 sec - exiting 09:11:11 (6932): No heartbeat from core client for 30 sec - exiting 09:11:12 (6932): No heartbeat from core client for 30 sec - exiting 09:11:13 (6932): No heartbeat from core client for 30 sec - exiting 09:11:14 (6932): No heartbeat from core client for 30 sec - exiting 09:11:15 (6932): No heartbeat from core client for 30 sec - exiting 09:11:16 (6932): No heartbeat from core client for 30 sec - exiting 09:11:17 (6932): No heartbeat from core client for 30 sec - exiting 09:11:18 (6932): No heartbeat from core client for 30 sec - exiting 09:11:19 (6932): No heartbeat from core client for 30 sec - exiting 09:11:20 (6932): No heartbeat from core client for 30 sec - exiting 09:11:21 (6932): No heartbeat from core client for 30 sec - exiting 09:11:23 (6932): No heartbeat from core client for 30 sec - exiting 09:11:24 (6932): No heartbeat from core client for 30 sec - exiting 09:11:25 (6932): No heartbeat from core client for 30 sec - exiting 09:11:26 (6932): No heartbeat from core client for 30 sec - exiting 09:11:27 (6932): No heartbeat from core client for 30 sec - exiting 09:11:28 (6932): No heartbeat from core client for 30 sec - exiting 09:11:29 (6932): No heartbeat from core client for 30 sec - exiting 09:11:30 (6932): No heartbeat from core client for 30 sec - exiting 09:11:31 (6932): No heartbeat from core client for 30 sec - exiting 09:11:33 (6932): No heartbeat from core client for 30 sec - exiting 09:11:34 (6932): No heartbeat from core client for 30 sec - exiting 09:11:35 (6932): No heartbeat from core client for 30 sec - exiting 09:11:36 (6932): No heartbeat from core client for 30 sec - exiting 09:11:37 (6932): No heartbeat from core client for 30 sec - exiting 09:11:38 (6932): No heartbeat from core client for 30 sec - exiting 09:11:39 (6932): No heartbeat from core client for 30 sec - exiting 09:11:40 (6932): No heartbeat from core client for 30 sec - exiting 09:11:42 (6932): No heartbeat from core client for 30 sec - exiting 09:11:43 (6932): No heartbeat from core client for 30 sec - exiting 09:11:44 (6932): No heartbeat from core client for 30 sec - exiting 09:11:45 (6932): No heartbeat from core client for 30 sec - exiting 09:11:46 (6932): No heartbeat from core client for 30 sec - exiting 09:11:47 (6932): No heartbeat from core client for 30 sec - exiting 09:11:48 (6932): No heartbeat from core client for 30 sec - exiting 09:11:49 (6932): No heartbeat from core client for 30 sec - exiting 09:11:50 (6932): No heartbeat from core client for 30 sec - exiting 09:11:51 (6932): No heartbeat from core client for 30 sec - exiting 09:11:53 (6932): No heartbeat from core client for 30 sec - exiting 09:11:54 (6932): No heartbeat from core client for 30 sec - exiting 09:11:55 (6932): No heartbeat from core client for 30 sec - exiting 09:11:56 (6932): No heartbeat from core client for 30 sec - exiting 09:11:57 (6932): No heartbeat from core client for 30 sec - exiting 09:11:58 (6932): No heartbeat from core client for 30 sec - exiting 09:11:59 (6932): No heartbeat from core client for 30 sec - exiting 09:12:00 (6932): No heartbeat from core client for 30 sec - exiting 09:12:01 (6932): No heartbeat from core client for 30 sec - exiting 09:12:02 (6932): No heartbeat from core client for 30 sec - exiting 09:12:03 (6932): No heartbeat from core client for 30 sec - exiting 09:12:04 (6932): No heartbeat from core client for 30 sec - exiting 09:12:06 (6932): No heartbeat from core client for 30 sec - exiting 09:12:07 (6932): No heartbeat from core client for 30 sec - exiting 09:12:08 (6932): No heartbeat from core client for 30 sec - exiting 09:12:09 (6932): No heartbeat from core client for 30 sec - exiting 09:12:10 (6932): No heartbeat from core client for 30 sec - exiting 09:12:11 (6932): No heartbeat from core client for 30 sec - exiting 09:12:12 (6932): No heartbeat from core client for 30 sec - exiting 09:12:13 (6932): No heartbeat from core client for 30 sec - exiting 09:12:14 (6932): No heartbeat from core client for 30 sec - exiting 09:12:15 (6932): No heartbeat from core client for 30 sec - exiting 09:12:16 (6932): No heartbeat from core client for 30 sec - exiting 09:12:18 (6932): No heartbeat from core client for 30 sec - exiting 09:12:19 (6932): No heartbeat from core client for 30 sec - exiting 09:12:20 (6932): No heartbeat from core client for 30 sec - exiting 09:12:21 (6932): No heartbeat from core client for 30 sec - exiting 09:12:22 (6932): No heartbeat from core client for 30 sec - exiting 09:12:23 (6932): No heartbeat from core client for 30 sec - exiting 09:12:24 (6932): No heartbeat from core client for 30 sec - exiting 09:12:25 (6932): No heartbeat from core client for 30 sec - exiting 09:12:26 (6932): No heartbeat from core client for 30 sec - exiting 09:12:28 (6932): No heartbeat from core client for 30 sec - exiting 09:12:29 (6932): No heartbeat from core client for 30 sec - exiting 09:12:30 (6932): No heartbeat from core client for 30 sec - exiting 09:12:31 (6932): No heartbeat from core client for 30 sec - exiting 09:12:32 (6932): No heartbeat from core client for 30 sec - exiting 09:12:33 (6932): No heartbeat from core client for 30 sec - exiting 09:12:34 (6932): No heartbeat from core client for 30 sec - exiting 09:12:35 (6932): No heartbeat from core client for 30 sec - exiting 09:12:36 (6932): No heartbeat from core client for 30 sec - exiting 09:12:38 (6932): No heartbeat from core client for 30 sec - exiting 09:12:39 (6932): No heartbeat from core client for 30 sec - exiting 09:12:40 (6932): No heartbeat from core client for 30 sec - exiting 09:12:41 (6932): No heartbeat from core client for 30 sec - exiting 09:12:42 (6932): No heartbeat from core client for 30 sec - exiting 09:12:43 (6932): No heartbeat from core client for 30 sec - exiting 09:12:44 (6932): No heartbeat from core client for 30 sec - exiting 09:12:45 (6932): No heartbeat from core client for 30 sec - exiting 09:12:46 (6932): No heartbeat from core client for 30 sec - exiting 09:12:47 (6932): No heartbeat from core client for 30 sec - exiting 09:12:49 (6932): No heartbeat from core client for 30 sec - exiting 09:12:50 (6932): No heartbeat from core client for 30 sec - exiting 09:12:51 (6932): No heartbeat from core client for 30 sec - exiting 09:12:52 (6932): No heartbeat from core client for 30 sec - exiting 09:12:53 (6932): No heartbeat from core client for 30 sec - exiting 09:12:54 (6932): No heartbeat from core client for 30 sec - exiting 09:12:55 (6932): No heartbeat from core client for 30 sec - exiting 09:12:56 (6932): No heartbeat from core client for 30 sec - exiting 09:12:57 (6932): No heartbeat from core client for 30 sec - exiting 09:12:58 (6932): No heartbeat from core client for 30 sec - exiting 09:12:59 (6932): No heartbeat from core client for 30 sec - exiting 09:13:01 (6932): No heartbeat from core client for 30 sec - exiting 09:13:02 (6932): No heartbeat from core client for 30 sec - exiting 09:13:03 (6932): No heartbeat from core client for 30 sec - exiting 09:13:04 (6932): No heartbeat from core client for 30 sec - exiting 09:13:05 (6932): No heartbeat from core client for 30 sec - exiting 09:13:06 (6932): No heartbeat from core client for 30 sec - exiting 09:13:07 (6932): No heartbeat from core client for 30 sec - exiting 09:13:08 (6932): No heartbeat from core client for 30 sec - exiting 09:13:09 (6932): No heartbeat from core client for 30 sec - exiting 09:13:11 (6932): No heartbeat from core client for 30 sec - exiting 09:13:12 (6932): No heartbeat from core client for 30 sec - exiting 09:13:13 (6932): No heartbeat from core client for 30 sec - exiting 09:13:14 (6932): No heartbeat from core client for 30 sec - exiting 09:13:15 (6932): No heartbeat from core client for 30 sec - exiting 09:13:16 (6932): No heartbeat from core client for 30 sec - exiting 09:13:17 (6932): No heartbeat from core client for 30 sec - exiting 09:13:18 (6932): No heartbeat from core client for 30 sec - exiting 09:13:19 (6932): No heartbeat from core client for 30 sec - exiting 09:13:20 (6932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:21 (6932): No heartbeat from core client for 30 sec - exiting 09:13:23 (6932): No heartbeat from core client for 30 sec - exiting 09:13:24 (6932): No heartbeat from core client for 30 sec - exiting 09:14:49 (27072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:59 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:23 (8460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:19:58 (32660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:50 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:33:51 (2604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3032, iMonCtr=1 Model crash detected, will try to restart... 23:06:19 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=1 Model crash detected, will try to restart... 04:01:50 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:32:55 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:56:05 (2860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:56:41 (6700): No heartbeat from core client for 30 sec - exiting 07:56:42 (6700): No heartbeat from core client for 30 sec - exiting 07:56:43 (6700): No heartbeat from core client for 30 sec - exiting 07:56:45 (6700): No heartbeat from core client for 30 sec - exiting 07:56:46 (6700): No heartbeat from core client for 30 sec - exiting 07:56:47 (6700): No heartbeat from core client for 30 sec - exiting 07:56:48 (6700): No heartbeat from core client for 30 sec - exiting 07:56:49 (6700): No heartbeat from core client for 30 sec - exiting 07:56:50 (6700): No heartbeat from core client for 30 sec - exiting 07:56:51 (6700): No heartbeat from core client for 30 sec - exiting 07:56:52 (6700): No heartbeat from core client for 30 sec - exiting 07:56:53 (6700): No heartbeat from core client for 30 sec - exiting 07:56:54 (6700): No heartbeat from core client for 30 sec - exiting 07:56:55 (6700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Feb 2013 06:26:17	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	1,036,800	1,646,373	1.5879
26 Feb 2013 16:56:12	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	1,010,880	1,605,412	1.5881
26 Feb 2013 05:04:09	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	984,960	1,564,628	1.5885
25 Feb 2013 17:22:28	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	959,040	1,523,338	1.5884
25 Feb 2013 05:08:30	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	933,120	1,482,267	1.5885
24 Feb 2013 18:41:51	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	907,200	1,441,333	1.5888
24 Feb 2013 06:09:21	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	881,280	1,400,429	1.5891
23 Feb 2013 19:42:00	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	855,360	1,360,375	1.5904
23 Feb 2013 07:26:52	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	829,440	1,319,780	1.5912
22 Feb 2013 20:33:14	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	803,520	1,279,107	1.5919
22 Feb 2013 06:41:33	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	777,600	1,238,059	1.5922
21 Feb 2013 17:56:33	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	751,680	1,196,236	1.5914
21 Feb 2013 06:04:03	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	725,760	1,154,227	1.5904
20 Feb 2013 18:01:36	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	699,840	1,112,602	1.5898
20 Feb 2013 05:57:29	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	673,920	1,071,517	1.5900
19 Feb 2013 17:01:15	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	648,000	1,030,141	1.5897
19 Feb 2013 04:57:26	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	622,080	988,742	1.5894
18 Feb 2013 17:36:20	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	596,160	947,293	1.5890
18 Feb 2013 03:27:06	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	570,240	904,253	1.5857
17 Feb 2013 14:25:24	1131315	15543686	hadcm3n_zkfz_1880_40_008246986_3	544,320	861,603	1.5829