Task 16084150

Name	hadcm3n_4g23_1980_40_008410647_1
Workunit	8561503
Created	25 Nov 2013, 22:21:26 UTC
Sent	26 Nov 2013, 0:04:54 UTC
Report deadline	25 Feb 2014, 7:32:05 UTC
Received	24 Jan 2014, 14:29:38 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1204099
Run time	24 days 8 hours 15 min 23 sec
CPU time	22 days 23 hours 18 min 24 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... 16:40:14 (3312): No heartbeat from core client for 30 sec - exiting 16:40:15 (3312): No heartbeat from core client for 30 sec - exiting 16:40:16 (3312): No heartbeat from core client for 30 sec - exiting 16:40:17 (3312): No heartbeat from core client for 30 sec - exiting 16:40:18 (3312): No heartbeat from core client for 30 sec - exiting 16:40:19 (3312): No heartbeat from core client for 30 sec - exiting 16:40:20 (3312): No heartbeat from core client for 30 sec - exiting 16:40:21 (3312): No heartbeat from core client for 30 sec - exiting 16:40:22 (3312): No heartbeat from core client for 30 sec - exiting 16:40:24 (3312): No heartbeat from core client for 30 sec - exiting 16:40:25 (3312): No heartbeat from core client for 30 sec - exiting 16:40:26 (3312): No heartbeat from core client for 30 sec - exiting 16:40:27 (3312): No heartbeat from core client for 30 sec - exiting 16:40:28 (3312): No heartbeat from core client for 30 sec - exiting 16:40:29 (3312): No heartbeat from core client for 30 sec - exiting 16:40:30 (3312): No heartbeat from core client for 30 sec - exiting 16:40:31 (3312): No heartbeat from core client for 30 sec - exiting 16:40:32 (3312): No heartbeat from core client for 30 sec - exiting 16:40:33 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3728, iMonCtr=1 Model crash detected, will try to restart... 14:41:14 (1588): No heartbeat from core client for 30 sec - exiting 14:41:15 (1588): No heartbeat from core client for 30 sec - exiting 14:41:16 (1588): No heartbeat from core client for 30 sec - exiting 14:41:17 (1588): No heartbeat from core client for 30 sec - exiting 14:41:18 (1588): No heartbeat from core client for 30 sec - exiting 14:41:19 (1588): No heartbeat from core client for 30 sec - exiting 14:41:20 (1588): No heartbeat from core client for 30 sec - exiting 14:41:21 (1588): No heartbeat from core client for 30 sec - exiting 14:41:22 (1588): No heartbeat from core client for 30 sec - exiting 14:41:24 (1588): No heartbeat from core client for 30 sec - exiting 14:41:25 (1588): No heartbeat from core client for 30 sec - exiting 14:41:26 (1588): No heartbeat from core client for 30 sec - exiting 14:41:27 (1588): No heartbeat from core client for 30 sec - exiting 14:41:28 (1588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:04:45 (10212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:37:52 (6588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:53 (6588): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:48:53 (5900): No heartbeat from core client for 30 sec - exiting 08:48:54 (5900): No heartbeat from core client for 30 sec - exiting 08:48:55 (5900): No heartbeat from core client for 30 sec - exiting 08:48:56 (5900): No heartbeat from core client for 30 sec - exiting 08:48:57 (5900): No heartbeat from core client for 30 sec - exiting 08:48:58 (5900): No heartbeat from core client for 30 sec - exiting 08:48:59 (5900): No heartbeat from core client for 30 sec - exiting 08:49:00 (5900): No heartbeat from core client for 30 sec - exiting 08:49:01 (5900): No heartbeat from core client for 30 sec - exiting 08:49:02 (5900): No heartbeat from core client for 30 sec - exiting 08:49:03 (5900): No heartbeat from core client for 30 sec - exiting 08:49:05 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4352, iMonCtr=1 Model crash detected, will try to restart... 10:19:42 (2736): No heartbeat from core client for 30 sec - exiting 10:19:43 (2736): No heartbeat from core client for 30 sec - exiting 10:19:44 (2736): No heartbeat from core client for 30 sec - exiting 10:19:45 (2736): No heartbeat from core client for 30 sec - exiting 10:19:46 (2736): No heartbeat from core client for 30 sec - exiting 10:19:47 (2736): No heartbeat from core client for 30 sec - exiting 10:19:48 (2736): No heartbeat from core client for 30 sec - exiting 10:19:50 (2736): No heartbeat from core client for 30 sec - exiting 10:19:51 (2736): No heartbeat from core client for 30 sec - exiting 10:19:52 (2736): No heartbeat from core client for 30 sec - exiting 10:19:53 (2736): No heartbeat from core client for 30 sec - exiting 10:19:54 (2736): No heartbeat from core client for 30 sec - exiting 10:19:55 (2736): No heartbeat from core client for 30 sec - exiting 10:19:56 (2736): No heartbeat from core client for 30 sec - exiting 10:19:57 (2736): No heartbeat from core client for 30 sec - exiting 10:19:58 (2736): No heartbeat from core client for 30 sec - exiting 10:19:59 (2736): No heartbeat from core client for 30 sec - exiting 10:20:00 (2736): No heartbeat from core client for 30 sec - exiting 10:20:02 (2736): No heartbeat from core client for 30 sec - exiting 10:20:03 (2736): No heartbeat from core client for 30 sec - exiting 10:20:04 (2736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1412, iMonCtr=1 Model crash detected, will try to restart... 08:38:50 (1896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:04:53 (5280): No heartbeat from core client for 30 sec - exiting 11:04:54 (5280): No heartbeat from core client for 30 sec - exiting 11:04:55 (5280): No heartbeat from core client for 30 sec - exiting 11:04:56 (5280): No heartbeat from core client for 30 sec - exiting 11:04:57 (5280): No heartbeat from core client for 30 sec - exiting 11:04:59 (5280): No heartbeat from core client for 30 sec - exiting 11:05:00 (5280): No heartbeat from core client for 30 sec - exiting 11:05:01 (5280): No heartbeat from core client for 30 sec - exiting 11:05:02 (5280): No heartbeat from core client for 30 sec - exiting 11:05:03 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=1 Model crash detected, will try to restart... 08:36:25 (2260): No heartbeat from core client for 30 sec - exiting 08:36:26 (2260): No heartbeat from core client for 30 sec - exiting 08:36:27 (2260): No heartbeat from core client for 30 sec - exiting 08:36:28 (2260): No heartbeat from core client for 30 sec - exiting 08:36:29 (2260): No heartbeat from core client for 30 sec - exiting 08:36:30 (2260): No heartbeat from core client for 30 sec - exiting 08:36:31 (2260): No heartbeat from core client for 30 sec - exiting 08:36:33 (2260): No heartbeat from core client for 30 sec - exiting 08:36:34 (2260): No heartbeat from core client for 30 sec - exiting 08:36:35 (2260): No heartbeat from core client for 30 sec - exiting 08:36:36 (2260): No heartbeat from core client for 30 sec - exiting 08:36:37 (2260): No heartbeat from core client for 30 sec - exiting 08:36:38 (2260): No heartbeat from core client for 30 sec - exiting 08:36:39 (2260): No heartbeat from core client for 30 sec - exiting 08:36:40 (2260): No heartbeat from core client for 30 sec - exiting 08:36:41 (2260): No heartbeat from core client for 30 sec - exiting 08:36:42 (2260): No heartbeat from core client for 30 sec - exiting 08:36:43 (2260): No heartbeat from core client for 30 sec - exiting 08:36:45 (2260): No heartbeat from core client for 30 sec - exiting 08:36:46 (2260): No heartbeat from core client for 30 sec - exiting 08:36:47 (2260): No heartbeat from core client for 30 sec - exiting 08:36:48 (2260): No heartbeat from core client for 30 sec - exiting 08:36:49 (2260): No heartbeat from core client for 30 sec - exiting 08:36:50 (2260): No heartbeat from core client for 30 sec - exiting 08:36:51 (2260): No heartbeat from core client for 30 sec - exiting 08:36:52 (2260): No heartbeat from core client for 30 sec - exiting 08:36:53 (2260): No heartbeat from core client for 30 sec - exiting 08:36:54 (2260): No heartbeat from core client for 30 sec - exiting 08:36:55 (2260): No heartbeat from core client for 30 sec - exiting 08:36:57 (2260): No heartbeat from core client for 30 sec - exiting 08:36:58 (2260): No heartbeat from core client for 30 sec - exiting 08:36:59 (2260): No heartbeat from core client for 30 sec - exiting 08:37:00 (2260): No heartbeat from core client for 30 sec - exiting 08:37:01 (2260): No heartbeat from core client for 30 sec - exiting 08:37:02 (2260): No heartbeat from core client for 30 sec - exiting 08:37:03 (2260): No heartbeat from core client for 30 sec - exiting 08:37:04 (2260): No heartbeat from core client for 30 sec - exiting 08:37:05 (2260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:06 (2260): No heartbeat from core client for 30 sec - exiting 08:37:07 (2260): No heartbeat from core client for 30 sec - exiting 08:37:09 (2260): No heartbeat from core client for 30 sec - exiting 08:37:10 (2260): No heartbeat from core client for 30 sec - exiting 08:37:11 (2260): No heartbeat from core client for 30 sec - exiting 08:37:12 (2260): No heartbeat from core client for 30 sec - exiting 08:37:13 (2260): No heartbeat from core client for 30 sec - exiting 08:37:14 (2260): No heartbeat from core client for 30 sec - exiting 08:37:15 (2260): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:41:19 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:52:13 (5472): No heartbeat from core client for 30 sec - exiting 08:52:14 (5472): No heartbeat from core client for 30 sec - exiting 08:52:15 (5472): No heartbeat from core client for 30 sec - exiting 08:52:16 (5472): No heartbeat from core client for 30 sec - exiting 08:52:17 (5472): No heartbeat from core client for 30 sec - exiting 08:52:18 (5472): No heartbeat from core client for 30 sec - exiting 08:52:19 (5472): No heartbeat from core client for 30 sec - exiting 08:52:21 (5472): No heartbeat from core client for 30 sec - exiting 08:52:22 (5472): No heartbeat from core client for 30 sec - exiting 08:52:23 (5472): No heartbeat from core client for 30 sec - exiting 08:52:24 (5472): No heartbeat from core client for 30 sec - exiting 08:52:25 (5472): No heartbeat from core client for 30 sec - exiting 08:52:26 (5472): No heartbeat from core client for 30 sec - exiting 08:52:27 (5472): No heartbeat from core client for 30 sec - exiting 08:52:28 (5472): No heartbeat from core client for 30 sec - exiting 08:52:29 (5472): No heartbeat from core client for 30 sec - exiting 08:52:30 (5472): No heartbeat from core client for 30 sec - exiting 08:52:32 (5472): No heartbeat from core client for 30 sec - exiting 08:52:33 (5472): No heartbeat from core client for 30 sec - exiting 08:52:34 (5472): No heartbeat from core client for 30 sec - exiting 08:52:35 (5472): No heartbeat from core client for 30 sec - exiting 08:52:36 (5472): No heartbeat from core client for 30 sec - exiting 08:52:37 (5472): No heartbeat from core client for 30 sec - exiting 08:52:38 (5472): No heartbeat from core client for 30 sec - exiting 08:52:39 (5472): No heartbeat from core client for 30 sec - exiting 08:52:40 (5472): No heartbeat from core client for 30 sec - exiting 08:52:41 (5472): No heartbeat from core client for 30 sec - exiting 08:52:42 (5472): No heartbeat from core client for 30 sec - exiting 08:52:44 (5472): No heartbeat from core client for 30 sec - exiting 08:52:45 (5472): No heartbeat from core client for 30 sec - exiting 08:52:46 (5472): No heartbeat from core client for 30 sec - exiting 08:52:47 (5472): No heartbeat from core client for 30 sec - exiting 08:52:48 (5472): No heartbeat from core client for 30 sec - exiting 08:52:49 (5472): No heartbeat from core client for 30 sec - exiting 08:52:50 (5472): No heartbeat from core client for 30 sec - exiting BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4g23ko.pjl5c10 Error converting file to netcdf: dataout/4g23ko.pil5c10 Error converting file to netcdf: dataout/4g23ko.pfl5c10 Error converting file to netcdf: dataout/4g23ka.phl5c10 Error converting file to netcdf: dataout/4g23ka.pgl5c10 Error converting file to netcdf: dataout/4g23ka.pel5c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... 11:05:24 (748): No heartbeat from core client for 30 sec - exiting 11:05:25 (748): No heartbeat from core client for 30 sec - exiting 11:05:27 (748): No heartbeat from core client for 30 sec - exiting 11:05:28 (748): No heartbeat from core client for 30 sec - exiting 11:05:29 (748): No heartbeat from core client for 30 sec - exiting 11:05:30 (748): No heartbeat from core client for 30 sec - exiting 11:05:31 (748): No heartbeat from core client for 30 sec - exiting 11:05:32 (748): No heartbeat from core client for 30 sec - exiting 11:05:33 (748): No heartbeat from core client for 30 sec - exiting 11:05:34 (748): No heartbeat from core client for 30 sec - exiting 11:05:35 (748): No heartbeat from core client for 30 sec - exiting 11:05:36 (748): No heartbeat from core client for 30 sec - exiting 11:05:37 (748): No heartbeat from core client for 30 sec - exiting 11:05:39 (748): No heartbeat from core client for 30 sec - exiting 11:05:40 (748): No heartbeat from core client for 30 sec - exiting 11:05:41 (748): No heartbeat from core client for 30 sec - exiting 11:05:42 (748): No heartbeat from core client for 30 sec - exiting 11:05:43 (748): No heartbeat from core client for 30 sec - exiting 11:05:44 (748): No heartbeat from core client for 30 sec - exiting 11:05:45 (748): No heartbeat from core client for 30 sec - exiting 11:05:46 (748): No heartbeat from core client for 30 sec - exiting 11:05:47 (748): No heartbeat from core client for 30 sec - exiting 11:05:48 (748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:49 (748): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:46:07 (3352): No heartbeat from core client for 30 sec - exiting 08:46:09 (3352): No heartbeat from core client for 30 sec - exiting 08:46:10 (3352): No heartbeat from core client for 30 sec - exiting 08:46:11 (3352): No heartbeat from core client for 30 sec - exiting 08:46:12 (3352): No heartbeat from core client for 30 sec - exiting 08:46:13 (3352): No heartbeat from core client for 30 sec - exiting 08:46:14 (3352): No heartbeat from core client for 30 sec - exiting 08:46:15 (3352): No heartbeat from core client for 30 sec - exiting 08:46:16 (3352): No heartbeat from core client for 30 sec - exiting 08:46:17 (3352): No heartbeat from core client for 30 sec - exiting 08:46:18 (3352): No heartbeat from core client for 30 sec - exiting 08:46:20 (3352): No heartbeat from core client for 30 sec - exiting 08:46:21 (3352): No heartbeat from core client for 30 sec - exiting 08:46:22 (3352): No heartbeat from core client for 30 sec - exiting 08:46:23 (3352): No heartbeat from core client for 30 sec - exiting 08:46:24 (3352): No heartbeat from core client for 30 sec - exiting 08:46:25 (3352): No heartbeat from core client for 30 sec - exiting 08:46:26 (3352): No heartbeat from core client for 30 sec - exiting 08:46:27 (3352): No heartbeat from core client for 30 sec - exiting 08:46:28 (3352): No heartbeat from core client for 30 sec - exiting 08:46:29 (3352): No heartbeat from core client for 30 sec - exiting 08:46:30 (3352): No heartbeat from core client for 30 sec - exiting 08:46:32 (3352): No heartbeat from core client for 30 sec - exiting 08:46:33 (3352): No heartbeat from core client for 30 sec - exiting 08:46:34 (3352): No heartbeat from core client for 30 sec - exiting 08:46:35 (3352): No heartbeat from core client for 30 sec - exiting 08:46:36 (3352): No heartbeat from core client for 30 sec - exiting 08:46:37 (3352): No heartbeat from core client for 30 sec - exiting 08:46:38 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:39 (3352): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:06:08 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:53 (4492): No heartbeat from core client for 30 sec - exiting 13:29:54 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:57:49 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jan 2014 14:33:06	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	1,036,800	1,983,942	1.9135
24 Jan 2014 14:33:06	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	1,010,880	1,931,824	1.9110
13 Jan 2014 09:53:02	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	984,960	1,879,421	1.9081
09 Jan 2014 12:18:03	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	959,040	1,829,205	1.9073
08 Jan 2014 21:43:57	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	933,120	1,779,388	1.9069
08 Jan 2014 06:55:17	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	907,200	1,727,908	1.9047
06 Jan 2014 08:48:42	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	881,280	1,674,209	1.8997
19 Dec 2013 11:46:18	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	855,360	1,621,247	1.8954
18 Dec 2013 17:40:14	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	829,440	1,571,584	1.8948
18 Dec 2013 01:24:25	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	803,520	1,522,133	1.8943
17 Dec 2013 10:52:09	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	777,600	1,470,979	1.8917
16 Dec 2013 19:42:02	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	751,680	1,417,906	1.8863
13 Dec 2013 12:59:26	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	725,760	1,364,789	1.8805
12 Dec 2013 20:24:32	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	699,840	1,314,485	1.8783
12 Dec 2013 03:13:47	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	673,920	1,262,994	1.8741
11 Dec 2013 06:27:23	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	648,000	1,208,966	1.8657
10 Dec 2013 16:09:42	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	622,080	1,158,484	1.8623
09 Dec 2013 11:30:11	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	596,160	1,110,721	1.8631
08 Dec 2013 22:04:55	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	570,240	1,063,662	1.8653
08 Dec 2013 08:49:48	1204099	16084150	hadcm3n_4g23_1980_40_008410647_1	544,320	1,016,627	1.8677