Task 14904037

Name	hadam3p_pnw_bm0x_1985_1_008047144_1
Workunit	8202258
Created	12 Jul 2012, 1:12:56 UTC
Sent	12 Jul 2012, 1:16:09 UTC
Report deadline	24 Jun 2013, 6:36:09 UTC
Received	17 Aug 2012, 2:34:34 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1227142
Run time	4 days 19 hours 52 min 13 sec
CPU time	4 days 3 hours 35 min 17 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.82 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> for 30 sec - exiting 09:40:05 (4428): No heartbeat from core client for 30 sec - exiting 09:40:06 (4428): No heartbeat from core client for 30 sec - exiting 09:40:07 (4428): No heartbeat from core client for 30 sec - exiting 09:40:08 (4428): No heartbeat from core client for 30 sec - exiting 09:40:09 (4428): No heartbeat from core client for 30 sec - exiting 09:40:10 (4428): No heartbeat from core client for 30 sec - exiting 09:40:11 (4428): No heartbeat from core client for 30 sec - exiting 09:40:12 (4428): No heartbeat from core client for 30 sec - exiting 09:40:14 (4428): No heartbeat from core client for 30 sec - exiting 09:40:15 (4428): No heartbeat from core client for 30 sec - exiting 09:40:16 (4428): No heartbeat from core client for 30 sec - exiting 09:40:17 (4428): No heartbeat from core client for 30 sec - exiting 09:40:18 (4428): No heartbeat from core client for 30 sec - exiting 09:40:19 (4428): No heartbeat from core client for 30 sec - exiting 09:40:20 (4428): No heartbeat from core client for 30 sec - exiting 09:40:21 (4428): No heartbeat from core client for 30 sec - exiting 09:40:22 (4428): No heartbeat from core client for 30 sec - exiting 09:40:23 (4428): No heartbeat from core client for 30 sec - exiting 09:40:24 (4428): No heartbeat from core client for 30 sec - exiting 09:40:26 (4428): No heartbeat from core client for 30 sec - exiting 09:40:27 (4428): No heartbeat from core client for 30 sec - exiting 09:40:28 (4428): No heartbeat from core client for 30 sec - exiting 09:40:29 (4428): No heartbeat from core client for 30 sec - exiting 09:40:30 (4428): No heartbeat from core client for 30 sec - exiting 09:40:31 (4428): No heartbeat from core client for 30 sec - exiting 09:40:32 (4428): No heartbeat from core client for 30 sec - exiting 09:40:33 (4428): No heartbeat from core client for 30 sec - exiting 09:40:34 (4428): No heartbeat from core client for 30 sec - exiting 09:40:35 (4428): No heartbeat from core client for 30 sec - exiting 09:40:36 (4428): No heartbeat from core client for 30 sec - exiting 09:40:38 (4428): No heartbeat from core client for 30 sec - exiting 09:40:39 (4428): No heartbeat from core client for 30 sec - exiting 09:40:40 (4428): No heartbeat from core client for 30 sec - exiting 09:40:41 (4428): No heartbeat from core client for 30 sec - exiting 09:40:42 (4428): No heartbeat from core client for 30 sec - exiting 09:40:43 (4428): No heartbeat from core client for 30 sec - exiting 09:40:44 (4428): No heartbeat from core client for 30 sec - exiting 09:40:45 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:46 (4428): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:40:19 (5896): No heartbeat from core client for 30 sec - exiting 09:40:21 (5896): No heartbeat from core client for 30 sec - exiting 09:40:22 (5896): No heartbeat from core client for 30 sec - exiting 09:40:23 (5896): No heartbeat from core client for 30 sec - exiting 09:40:24 (5896): No heartbeat from core client for 30 sec - exiting 09:40:25 (5896): No heartbeat from core client for 30 sec - exiting 09:40:26 (5896): No heartbeat from core client for 30 sec - exiting 09:40:27 (5896): No heartbeat from core client for 30 sec - exiting 09:40:28 (5896): No heartbeat from core client for 30 sec - exiting 09:40:29 (5896): No heartbeat from core client for 30 sec - exiting 09:40:30 (5896): No heartbeat from core client for 30 sec - exiting 09:40:31 (5896): No heartbeat from core client for 30 sec - exiting 09:40:33 (5896): No heartbeat from core client for 30 sec - exiting 09:40:34 (5896): No heartbeat from core client for 30 sec - exiting 09:40:35 (5896): No heartbeat from core client for 30 sec - exiting 09:40:36 (5896): No heartbeat from core client for 30 sec - exiting 09:40:37 (5896): No heartbeat from core client for 30 sec - exiting 09:40:38 (5896): No heartbeat from core client for 30 sec - exiting 09:40:39 (5896): No heartbeat from core client for 30 sec - exiting 09:40:40 (5896): No heartbeat from core client for 30 sec - exiting 09:40:41 (5896): No heartbeat from core client for 30 sec - exiting 09:40:42 (5896): No heartbeat from core client for 30 sec - exiting 09:40:43 (5896): No heartbeat from core client for 30 sec - exiting 09:40:45 (5896): No heartbeat from core client for 30 sec - exiting 09:40:46 (5896): No heartbeat from core client for 30 sec - exiting 09:40:47 (5896): No heartbeat from core client for 30 sec - exiting 09:40:48 (5896): No heartbeat from core client for 30 sec - exiting 09:40:49 (5896): No heartbeat from core client for 30 sec - exiting 09:40:50 (5896): No heartbeat from core client for 30 sec - exiting 09:40:51 (5896): No heartbeat from core client for 30 sec - exiting 09:40:52 (5896): No heartbeat from core client for 30 sec - exiting 09:40:54 (5896): No heartbeat from core client for 30 sec - exiting 09:40:55 (5896): No heartbeat from core client for 30 sec - exiting 09:40:56 (5896): No heartbeat from core client for 30 sec - exiting 09:40:57 (5896): No heartbeat from core client for 30 sec - exiting 09:40:58 (5896): No heartbeat from core client for 30 sec - exiting 09:40:59 (5896): No heartbeat from core client for 30 sec - exiting 09:41:00 (5896): No heartbeat from core client for 30 sec - exiting 09:41:01 (5896): No heartbeat from core client for 30 sec - exiting 09:41:02 (5896): No heartbeat from core client for 30 sec - exiting 09:41:03 (5896): No heartbeat from core client for 30 sec - exiting 09:41:04 (5896): No heartbeat from core client for 30 sec - exiting 09:41:05 (5896): No heartbeat from core client for 30 sec - exiting 09:41:07 (5896): No heartbeat from core client for 30 sec - exiting 09:41:08 (5896): No heartbeat from core client for 30 sec - exiting 09:41:09 (5896): No heartbeat from core client for 30 sec - exiting 09:41:10 (5896): No heartbeat from core client for 30 sec - exiting 09:41:11 (5896): No heartbeat from core client for 30 sec - exiting 09:41:12 (5896): No heartbeat from core client for 30 sec - exiting 09:41:14 (5896): No heartbeat from core client for 30 sec - exiting 09:41:15 (5896): No heartbeat from core client for 30 sec - exiting 09:41:16 (5896): No heartbeat from core client for 30 sec - exiting 09:41:17 (5896): No heartbeat from core client for 30 sec - exiting 09:41:18 (5896): No heartbeat from core client for 30 sec - exiting 09:41:19 (5896): No heartbeat from core client for 30 sec - exiting 09:41:20 (5896): No heartbeat from core client for 30 sec - exiting 09:41:21 (5896): No heartbeat from core client for 30 sec - exiting 09:41:22 (5896): No heartbeat from core client for 30 sec - exiting 09:41:23 (5896): No heartbeat from core client for 30 sec - exiting 09:41:24 (5896): No heartbeat from core client for 30 sec - exiting 09:41:25 (5896): No heartbeat from core client for 30 sec - exiting 09:41:26 (5896): No heartbeat from core client for 30 sec - exiting 09:41:27 (5896): No heartbeat from core client for 30 sec - exiting 09:41:28 (5896): No heartbeat from core client for 30 sec - exiting 09:41:29 (5896): No heartbeat from core client for 30 sec - exiting 09:41:30 (5896): No heartbeat from core client for 30 sec - exiting 09:41:31 (5896): No heartbeat from core client for 30 sec - exiting 09:41:32 (5896): No heartbeat from core client for 30 sec - exiting 09:41:33 (5896): No heartbeat from core client for 30 sec - exiting 09:41:34 (5896): No heartbeat from core client for 30 sec - exiting 09:41:35 (5896): No heartbeat from core client for 30 sec - exiting 09:41:36 (5896): No heartbeat from core client for 30 sec - exiting 09:41:38 (5896): No heartbeat from core client for 30 sec - exiting 09:41:39 (5896): No heartbeat from core client for 30 sec - exiting 09:41:40 (5896): No heartbeat from core client for 30 sec - exiting 09:41:41 (5896): No heartbeat from core client for 30 sec - exiting 09:41:42 (5896): No heartbeat from core client for 30 sec - exiting 09:41:43 (5896): No heartbeat from core client for 30 sec - exiting 09:41:44 (5896): No heartbeat from core client for 30 sec - exiting 09:41:45 (5896): No heartbeat from core client for 30 sec - exiting 09:41:46 (5896): No heartbeat from core client for 30 sec - exiting 09:41:47 (5896): No heartbeat from core client for 30 sec - exiting 09:41:48 (5896): No heartbeat from core client for 30 sec - exiting 09:41:49 (5896): No heartbeat from core client for 30 sec - exiting 09:41:50 (5896): No heartbeat from core client for 30 sec - exiting 09:41:51 (5896): No heartbeat from core client for 30 sec - exiting 09:41:52 (5896): No heartbeat from core client for 30 sec - exiting 09:41:53 (5896): No heartbeat from core client for 30 sec - exiting 09:41:55 (5896): No heartbeat from core client for 30 sec - exiting 09:41:56 (5896): No heartbeat from core client for 30 sec - exiting 09:41:56 (5896): No heartbeat from core client for 30 sec - exiting 09:41:58 (5896): No heartbeat from core client for 30 sec - exiting 09:41:59 (5896): No heartbeat from core client for 30 sec - exiting 09:42:00 (5896): No heartbeat from core client for 30 sec - exiting 09:42:01 (5896): No heartbeat from core client for 30 sec - exiting 09:42:02 (5896): No heartbeat from core client for 30 sec - exiting 09:42:03 (5896): No heartbeat from core client for 30 sec - exiting 09:42:04 (5896): No heartbeat from core client for 30 sec - exiting 09:42:05 (5896): No heartbeat from core client for 30 sec - exiting 09:42:06 (5896): No heartbeat from core client for 30 sec - exiting 09:42:07 (5896): No heartbeat from core client for 30 sec - exiting 09:42:09 (5896): No heartbeat from core client for 30 sec - exiting 09:42:10 (5896): No heartbeat from core client for 30 sec - exiting 09:42:11 (5896): No heartbeat from core client for 30 sec - exiting 09:42:12 (5896): No heartbeat from core client for 30 sec - exiting 09:42:13 (5896): No heartbeat from core client for 30 sec - exiting 09:42:14 (5896): No heartbeat from core client for 30 sec - exiting 09:42:15 (5896): No heartbeat from core client for 30 sec - exiting 09:42:16 (5896): No heartbeat from core client for 30 sec - exiting 09:42:17 (5896): No heartbeat from core client for 30 sec - exiting 09:42:18 (5896): No heartbeat from core client for 30 sec - exiting 09:42:19 (5896): No heartbeat from core client for 30 sec - exiting 09:42:20 (5896): No heartbeat from core client for 30 sec - exiting 09:42:21 (5896): No heartbeat from core client for 30 sec - exiting 09:42:23 (5896): No heartbeat from core client for 30 sec - exiting 09:42:24 (5896): No heartbeat from core client for 30 sec - exiting 09:42:25 (5896): No heartbeat from core client for 30 sec - exiting 09:42:26 (5896): No heartbeat from core client for 30 sec - exiting 09:42:27 (5896): No heartbeat from core client for 30 sec - exiting 09:42:28 (5896): No heartbeat from core client for 30 sec - exiting 09:42:29 (5896): No heartbeat from core client for 30 sec - exiting 09:42:30 (5896): No heartbeat from core client for 30 sec - exiting 09:42:31 (5896): No heartbeat from core client for 30 sec - exiting 09:42:32 (5896): No heartbeat from core client for 30 sec - exiting 09:42:33 (5896): No heartbeat from core client for 30 sec - exiting 09:42:34 (5896): No heartbeat from core client for 30 sec - exiting 09:42:35 (5896): No heartbeat from core client for 30 sec - exiting 09:42:36 (5896): No heartbeat from core client for 30 sec - exiting 09:42:38 (5896): No heartbeat from core client for 30 sec - exiting 09:42:39 (5896): No heartbeat from core client for 30 sec - exiting 09:42:40 (5896): No heartbeat from core client for 30 sec - exiting 09:42:41 (5896): No heartbeat from core client for 30 sec - exiting 09:42:42 (5896): No heartbeat from core client for 30 sec - exiting 09:42:43 (5896): No heartbeat from core client for 30 sec - exiting 09:42:44 (5896): No heartbeat from core client for 30 sec - exiting 09:42:45 (5896): No heartbeat from core client for 30 sec - exiting 09:42:46 (5896): No heartbeat from core client for 30 sec - exiting 09:42:47 (5896): No heartbeat from core client for 30 sec - exiting 09:42:48 (5896): No heartbeat from core client for 30 sec - exiting 09:42:49 (5896): No heartbeat from core client for 30 sec - exiting 09:42:50 (5896): No heartbeat from core client for 30 sec - exiting 09:42:51 (5896): No heartbeat from core client for 30 sec - exiting 09:42:52 (5896): No heartbeat from core client for 30 sec - exiting 09:42:53 (5896): No heartbeat from core client for 30 sec - exiting 09:42:54 (5896): No heartbeat from core client for 30 sec - exiting 09:42:55 (5896): No heartbeat from core client for 30 sec - exiting 09:42:56 (5896): No heartbeat from core client for 30 sec - exiting 09:42:57 (5896): No heartbeat from core client for 30 sec - exiting 09:42:58 (5896): No heartbeat from core client for 30 sec - exiting 09:42:59 (5896): No heartbeat from core client for 30 sec - exiting 09:43:00 (5896): No heartbeat from core client for 30 sec - exiting 09:43:01 (5896): No heartbeat from core client for 30 sec - exiting 09:43:02 (5896): No heartbeat from core client for 30 sec - exiting 09:43:03 (5896): No heartbeat from core client for 30 sec - exiting 09:43:05 (5896): No heartbeat from core client for 30 sec - exiting 09:43:05 (5896): No heartbeat from core client for 30 sec - exiting 09:43:07 (5896): No heartbeat from core client for 30 sec - exiting 09:43:08 (5896): No heartbeat from core client for 30 sec - exiting 09:43:09 (5896): No heartbeat from core client for 30 sec - exiting 09:43:10 (5896): No heartbeat from core client for 30 sec - exiting 09:43:11 (5896): No heartbeat from core client for 30 sec - exiting 09:43:12 (5896): No heartbeat from core client for 30 sec - exiting 09:43:13 (5896): No heartbeat from core client for 30 sec - exiting 09:43:14 (5896): No heartbeat from core client for 30 sec - exiting 09:43:15 (5896): No heartbeat from core client for 30 sec - exiting 09:43:16 (5896): No heartbeat from core client for 30 sec - exiting 09:43:17 (5896): No heartbeat from core client for 30 sec - exiting 09:43:18 (5896): No heartbeat from core client for 30 sec - exiting 09:43:19 (5896): No heartbeat from core client for 30 sec - exiting 09:43:20 (5896): No heartbeat from core client for 30 sec - exiting 09:43:21 (5896): No heartbeat from core client for 30 sec - exiting 09:43:22 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:43:23 (5896): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:02:22 (4072): No heartbeat from core client for 30 sec - exiting 10:02:23 (4072): No heartbeat from core client for 30 sec - exiting 10:02:24 (4072): No heartbeat from core client for 30 sec - exiting 10:02:25 (4072): No heartbeat from core client for 30 sec - exiting 10:02:26 (4072): No heartbeat from core client for 30 sec - exiting 10:02:27 (4072): No heartbeat from core client for 30 sec - exiting 10:02:28 (4072): No heartbeat from core client for 30 sec - exiting 10:02:30 (4072): No heartbeat from core client for 30 sec - exiting 10:02:31 (4072): No heartbeat from core client for 30 sec - exiting 10:02:32 (4072): No heartbeat from core client for 30 sec - exiting 10:02:33 (4072): No heartbeat from core client for 30 sec - exiting 10:02:34 (4072): No heartbeat from core client for 30 sec - exiting 10:02:35 (4072): No heartbeat from core client for 30 sec - exiting 10:02:36 (4072): No heartbeat from core client for 30 sec - exiting 10:02:37 (4072): No heartbeat from core client for 30 sec - exiting 10:02:38 (4072): No heartbeat from core client for 30 sec - exiting 10:02:39 (4072): No heartbeat from core client for 30 sec - exiting 10:02:40 (4072): No heartbeat from core client for 30 sec - exiting 10:02:41 (4072): No heartbeat from core client for 30 sec - exiting 10:02:42 (4072): No heartbeat from core client for 30 sec - exiting 10:02:43 (4072): No heartbeat from core client for 30 sec - exiting 10:02:45 (4072): No heartbeat from core client for 30 sec - exiting 10:02:46 (4072): No heartbeat from core client for 30 sec - exiting 10:02:47 (4072): No heartbeat from core client for 30 sec - exiting 10:02:48 (4072): No heartbeat from core client for 30 sec - exiting 10:02:49 (4072): No heartbeat from core client for 30 sec - exiting 10:02:50 (4072): No heartbeat from core client for 30 sec - exiting 10:02:51 (4072): No heartbeat from core client for 30 sec - exiting 10:02:52 (4072): No heartbeat from core client for 30 sec - exiting 10:02:53 (4072): No heartbeat from core client for 30 sec - exiting 10:02:54 (4072): No heartbeat from core client for 30 sec - exiting 10:02:56 (4072): No heartbeat from core client for 30 sec - exiting 10:02:57 (4072): No heartbeat from core client for 30 sec - exiting 10:02:58 (4072): No heartbeat from core client for 30 sec - exiting 10:02:59 (4072): No heartbeat from core client for 30 sec - exiting 10:03:00 (4072): No heartbeat from core client for 30 sec - exiting 10:03:01 (4072): No heartbeat from core client for 30 sec - exiting 10:03:02 (4072): No heartbeat from core client for 30 sec - exiting 10:03:03 (4072): No heartbeat from core client for 30 sec - exiting 10:03:04 (4072): No heartbeat from core client for 30 sec - exiting 10:03:05 (4072): No heartbeat from core client for 30 sec - exiting 10:03:06 (4072): No heartbeat from core client for 30 sec - exiting 10:03:08 (4072): No heartbeat from core client for 30 sec - exiting 10:03:09 (4072): No heartbeat from core client for 30 sec - exiting 10:03:10 (4072): No heartbeat from core client for 30 sec - exiting 10:03:11 (4072): No heartbeat from core client for 30 sec - exiting 10:03:12 (4072): No heartbeat from core client for 30 sec - exiting 10:03:13 (4072): No heartbeat from core client for 30 sec - exiting 10:03:14 (4072): No heartbeat from core client for 30 sec - exiting 10:03:15 (4072): No heartbeat from core client for 30 sec - exiting 10:03:16 (4072): No heartbeat from core client for 30 sec - exiting 10:03:17 (4072): No heartbeat from core client for 30 sec - exiting 10:03:18 (4072): No heartbeat from core client for 30 sec - exiting 10:03:20 (4072): No heartbeat from core client for 30 sec - exiting 10:03:21 (4072): No heartbeat from core client for 30 sec - exiting 10:03:22 (4072): No heartbeat from core client for 30 sec - exiting 10:03:23 (4072): No heartbeat from core client for 30 sec - exiting 10:03:24 (4072): No heartbeat from core client for 30 sec - exiting 10:03:25 (4072): No heartbeat from core client for 30 sec - exiting 10:03:26 (4072): No heartbeat from core client for 30 sec - exiting 10:03:27 (4072): No heartbeat from core client for 30 sec - exiting 10:03:28 (4072): No heartbeat from core client for 30 sec - exiting 10:03:29 (4072): No heartbeat from core client for 30 sec - exiting 10:03:31 (4072): No heartbeat from core client for 30 sec - exiting 10:03:32 (4072): No heartbeat from core client for 30 sec - exiting 10:03:33 (4072): No heartbeat from core client for 30 sec - exiting 10:03:34 (4072): No heartbeat from core client for 30 sec - exiting 10:03:35 (4072): No heartbeat from core client for 30 sec - exiting 10:03:36 (4072): No heartbeat from core client for 30 sec - exiting 10:03:37 (4072): No heartbeat from core client for 30 sec - exiting 10:03:38 (4072): No heartbeat from core client for 30 sec - exiting 10:03:40 (4072): No heartbeat from core client for 30 sec - exiting 10:03:41 (4072): No heartbeat from core client for 30 sec - exiting 10:03:42 (4072): No heartbeat from core client for 30 sec - exiting 10:03:43 (4072): No heartbeat from core client for 30 sec - exiting 10:03:44 (4072): No heartbeat from core client for 30 sec - exiting 10:03:45 (4072): No heartbeat from core client for 30 sec - exiting 10:03:46 (4072): No heartbeat from core client for 30 sec - exiting 10:03:47 (4072): No heartbeat from core client for 30 sec - exiting 10:03:48 (4072): No heartbeat from core client for 30 sec - exiting 10:03:49 (4072): No heartbeat from core client for 30 sec - exiting 10:03:50 (4072): No heartbeat from core client for 30 sec - exiting 10:03:52 (4072): No heartbeat from core client for 30 sec - exiting 10:03:53 (4072): No heartbeat from core client for 30 sec - exiting 10:03:54 (4072): No heartbeat from core client for 30 sec - exiting 10:03:55 (4072): No heartbeat from core client for 30 sec - exiting 10:03:56 (4072): No heartbeat from core client for 30 sec - exiting 10:03:57 (4072): No heartbeat from core client for 30 sec - exiting 10:03:58 (4072): No heartbeat from core client for 30 sec - exiting 10:03:59 (4072): No heartbeat from core client for 30 sec - exiting 10:04:00 (4072): No heartbeat from core client for 30 sec - exiting 10:04:01 (4072): No heartbeat from core client for 30 sec - exiting 10:04:02 (4072): No heartbeat from core client for 30 sec - exiting 10:04:04 (4072): No heartbeat from core client for 30 sec - exiting 10:04:05 (4072): No heartbeat from core client for 30 sec - exiting 10:04:06 (4072): No heartbeat from core client for 30 sec - exiting 10:04:07 (4072): No heartbeat from core client for 30 sec - exiting 10:04:08 (4072): No heartbeat from core client for 30 sec - exiting 10:04:09 (4072): No heartbeat from core client for 30 sec - exiting 10:04:10 (4072): No heartbeat from core client for 30 sec - exiting 10:04:11 (4072): No heartbeat from core client for 30 sec - exiting 10:04:12 (4072): No heartbeat from core client for 30 sec - exiting 10:04:13 (4072): No heartbeat from core client for 30 sec - exiting 10:04:15 (4072): No heartbeat from core client for 30 sec - exiting 10:04:16 (4072): No heartbeat from core client for 30 sec - exiting 10:04:17 (4072): No heartbeat from core client for 30 sec - exiting 10:04:18 (4072): No heartbeat from core client for 30 sec - exiting 10:04:19 (4072): No heartbeat from core client for 30 sec - exiting 10:04:20 (4072): No heartbeat from core client for 30 sec - exiting 10:04:21 (4072): No heartbeat from core client for 30 sec - exiting 10:04:22 (4072): No heartbeat from core client for 30 sec - exiting 10:04:23 (4072): No heartbeat from core client for 30 sec - exiting 10:04:24 (4072): No heartbeat from core client for 30 sec - exiting 10:04:25 (4072): No heartbeat from core client for 30 sec - exiting 10:04:27 (4072): No heartbeat from core client for 30 sec - exiting 10:04:28 (4072): No heartbeat from core client for 30 sec - exiting 10:04:29 (4072): No heartbeat from core client for 30 sec - exiting 10:04:30 (4072): No heartbeat from core client for 30 sec - exiting 10:04:31 (4072): No heartbeat from core client for 30 sec - exiting 10:04:32 (4072): No heartbeat from core client for 30 sec - exiting 10:04:33 (4072): No heartbeat from core client for 30 sec - exiting 10:04:34 (4072): No heartbeat from core client for 30 sec - exiting 10:04:35 (4072): No heartbeat from core client for 30 sec - exiting 10:04:36 (4072): No heartbeat from core client for 30 sec - exiting 10:04:37 (4072): No heartbeat from core client for 30 sec - exiting 10:04:39 (4072): No heartbeat from core client for 30 sec - exiting 10:04:40 (4072): No heartbeat from core client for 30 sec - exiting 10:04:41 (4072): No heartbeat from core client for 30 sec - exiting 10:04:42 (4072): No heartbeat from core client for 30 sec - exiting 10:04:43 (4072): No heartbeat from core client for 30 sec - exiting 10:04:44 (4072): No heartbeat from core client for 30 sec - exiting 10:04:45 (4072): No heartbeat from core client for 30 sec - exiting 10:04:46 (4072): No heartbeat from core client for 30 sec - exiting 10:04:47 (4072): No heartbeat from core client for 30 sec - exiting 10:04:48 (4072): No heartbeat from core client for 30 sec - exiting 10:04:50 (4072): No heartbeat from core client for 30 sec - exiting 10:04:51 (4072): No heartbeat from core client for 30 sec - exiting 10:04:52 (4072): No heartbeat from core client for 30 sec - exiting 10:04:54 (4072): No heartbeat from core client for 30 sec - exiting 10:04:55 (4072): No heartbeat from core client for 30 sec - exiting 10:04:56 (4072): No heartbeat from core client for 30 sec - exiting 10:04:57 (4072): No heartbeat from core client for 30 sec - exiting 10:04:58 (4072): No heartbeat from core client for 30 sec - exiting 10:04:59 (4072): No heartbeat from core client for 30 sec - exiting 10:05:00 (4072): No heartbeat from core client for 30 sec - exiting 10:05:01 (4072): No heartbeat from core client for 30 sec - exiting 10:05:02 (4072): No heartbeat from core client for 30 sec - exiting 10:05:03 (4072): No heartbeat from core client for 30 sec - exiting 10:05:04 (4072): No heartbeat from core client for 30 sec - exiting 10:05:06 (4072): No heartbeat from core client for 30 sec - exiting 10:05:07 (4072): No heartbeat from core client for 30 sec - exiting 10:05:08 (4072): No heartbeat from core client for 30 sec - exiting 10:05:09 (4072): No heartbeat from core client for 30 sec - exiting 10:05:10 (4072): No heartbeat from core client for 30 sec - exiting 10:05:11 (4072): No heartbeat from core client for 30 sec - exiting 10:05:12 (4072): No heartbeat from core client for 30 sec - exiting 10:05:13 (4072): No heartbeat from core client for 30 sec - exiting 10:05:14 (4072): No heartbeat from core client for 30 sec - exiting 10:05:15 (4072): No heartbeat from core client for 30 sec - exiting 10:05:16 (4072): No heartbeat from core client for 30 sec - exiting 10:05:18 (4072): No heartbeat from core client for 30 sec - exiting 10:05:19 (4072): No heartbeat from core client for 30 sec - exiting 10:05:20 (4072): No heartbeat from core client for 30 sec - exiting 10:05:21 (4072): No heartbeat from core client for 30 sec - exiting 10:05:22 (4072): No heartbeat from core client for 30 sec - exiting 10:05:23 (4072): No heartbeat from core client for 30 sec - exiting 10:05:24 (4072): No heartbeat from core client for 30 sec - exiting 10:05:25 (4072): No heartbeat from core client for 30 sec - exiting 10:05:26 (4072): No heartbeat from core client for 30 sec - exiting 10:05:27 (4072): No heartbeat from core client for 30 sec - exiting 10:05:28 (4072): No heartbeat from core client for 30 sec - exiting 10:05:29 (4072): No heartbeat from core client for 30 sec - exiting 10:05:30 (4072): No heartbeat from core client for 30 sec - exiting 10:05:31 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:32 (4072): No heartbeat from core client for 30 sec - exiting 10:05:33 (4072): No heartbeat from core client for 30 sec - exiting 10:06:48 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5640, selfPID=5640, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:39:13 (4600): No heartbeat from core client for 30 sec - exiting 09:39:14 (4600): No heartbeat from core client for 30 sec - exiting 09:39:15 (4600): No heartbeat from core client for 30 sec - exiting 09:39:17 (4600): No heartbeat from core client for 30 sec - exiting 09:39:18 (4600): No heartbeat from core client for 30 sec - exiting 09:39:19 (4600): No heartbeat from core client for 30 sec - exiting 09:39:20 (4600): No heartbeat from core client for 30 sec - exiting 09:39:21 (4600): No heartbeat from core client for 30 sec - exiting 09:39:22 (4600): No heartbeat from core client for 30 sec - exiting 09:39:23 (4600): No heartbeat from core client for 30 sec - exiting 09:39:24 (4600): No heartbeat from core client for 30 sec - exiting 09:39:25 (4600): No heartbeat from core client for 30 sec - exiting 09:41:31 (4600): No heartbeat from core client for 30 sec - exiting 09:41:32 (4600): No heartbeat from core client for 30 sec - exiting 09:41:33 (4600): No heartbeat from core client for 30 sec - exiting 09:41:34 (4600): No heartbeat from core client for 30 sec - exiting 09:41:35 (4600): No heartbeat from core client for 30 sec - exiting 09:41:36 (4600): No heartbeat from core client for 30 sec - exiting 09:41:37 (4600): No heartbeat from core client for 30 sec - exiting 09:41:38 (4600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4280, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2536, iMonCtr=2 09:57:10 (4516): No heartbeat from core client for 30 sec - exiting 09:57:11 (4516): No heartbeat from core client for 30 sec - exiting 09:57:12 (4516): No heartbeat from core client for 30 sec - exiting 09:57:13 (4516): No heartbeat from core client for 30 sec - exiting 09:57:14 (4516): No heartbeat from core client for 30 sec - exiting 09:57:15 (4516): No heartbeat from core client for 30 sec - exiting 09:57:17 (4516): No heartbeat from core client for 30 sec - exiting 09:57:18 (4516): No heartbeat from core client for 30 sec - exiting 09:57:19 (4516): No heartbeat from core client for 30 sec - exiting 09:57:20 (4516): No heartbeat from core client for 30 sec - exiting 09:57:21 (4516): No heartbeat from core client for 30 sec - exiting 09:57:22 (4516): No heartbeat from core client for 30 sec - exiting 09:57:23 (4516): No heartbeat from core client for 30 sec - exiting 09:57:24 (4516): No heartbeat from core client for 30 sec - exiting 09:57:25 (4516): No heartbeat from core client for 30 sec - exiting 09:57:26 (4516): No heartbeat from core client for 30 sec - exiting 09:57:27 (4516): No heartbeat from core client for 30 sec - exiting 09:57:29 (4516): No heartbeat from core client for 30 sec - exiting 09:57:30 (4516): No heartbeat from core client for 30 sec - exiting 09:57:31 (4516): No heartbeat from core client for 30 sec - exiting 09:57:32 (4516): No heartbeat from core client for 30 sec - exiting 09:57:33 (4516): No heartbeat from core client for 30 sec - exiting 09:57:34 (4516): No heartbeat from core client for 30 sec - exiting 09:57:35 (4516): No heartbeat from core client for 30 sec - exiting 09:57:36 (4516): No heartbeat from core client for 30 sec - exiting 09:57:37 (4516): No heartbeat from core client for 30 sec - exiting 09:57:38 (4516): No heartbeat from core client for 30 sec - exiting 09:57:40 (4516): No heartbeat from core client for 30 sec - exiting 09:57:41 (4516): No heartbeat from core client for 30 sec - exiting 09:57:42 (4516): No heartbeat from core client for 30 sec - exiting 09:57:43 (4516): No heartbeat from core client for 30 sec - exiting 09:57:44 (4516): No heartbeat from core client for 30 sec - exiting 09:57:45 (4516): No heartbeat from core client for 30 sec - exiting 09:57:46 (4516): No heartbeat from core client for 30 sec - exiting 09:57:47 (4516): No heartbeat from core client for 30 sec - exiting 09:57:48 (4516): No heartbeat from core client for 30 sec - exiting 09:57:49 (4516): No heartbeat from core client for 30 sec - exiting 09:57:51 (4516): No heartbeat from core client for 30 sec - exiting 09:57:52 (4516): No heartbeat from core client for 30 sec - exiting 09:57:53 (4516): No heartbeat from core client for 30 sec - exiting 09:57:54 (4516): No heartbeat from core client for 30 sec - exiting 09:57:55 (4516): No heartbeat from core client for 30 sec - exiting 09:57:56 (4516): No heartbeat from core client for 30 sec - exiting 09:57:57 (4516): No heartbeat from core client for 30 sec - exiting 09:57:58 (4516): No heartbeat from core client for 30 sec - exiting 09:57:59 (4516): No heartbeat from core client for 30 sec - exiting 09:58:00 (4516): No heartbeat from core client for 30 sec - exiting 09:58:01 (4516): No heartbeat from core client for 30 sec - exiting 09:58:03 (4516): No heartbeat from core client for 30 sec - exiting 09:58:04 (4516): No heartbeat from core client for 30 sec - exiting 09:58:05 (4516): No heartbeat from core client for 30 sec - exiting 09:58:06 (4516): No heartbeat from core client for 30 sec - exiting 09:58:07 (4516): No heartbeat from core client for 30 sec - exiting 09:58:08 (4516): No heartbeat from core client for 30 sec - exiting 09:58:09 (4516): No heartbeat from core client for 30 sec - exiting 09:58:10 (4516): No heartbeat from core client for 30 sec - exiting 09:58:11 (4516): No heartbeat from core client for 30 sec - exiting 09:58:12 (4516): No heartbeat from core client for 30 sec - exiting 09:58:13 (4516): No heartbeat from core client for 30 sec - exiting 09:58:14 (4516): No heartbeat from core client for 30 sec - exiting 09:58:15 (4516): No heartbeat from core client for 30 sec - exiting 09:58:16 (4516): No heartbeat from core client for 30 sec - exiting 09:58:17 (4516): No heartbeat from core client for 30 sec - exiting 09:58:18 (4516): No heartbeat from core client for 30 sec - exiting 09:58:20 (4516): No heartbeat from core client for 30 sec - exiting 09:58:21 (4516): No heartbeat from core client for 30 sec - exiting 09:58:22 (4516): No heartbeat from core client for 30 sec - exiting 09:58:23 (4516): No heartbeat from core client for 30 sec - exiting 09:58:24 (4516): No heartbeat from core client for 30 sec - exiting 09:58:25 (4516): No heartbeat from core client for 30 sec - exiting 09:58:26 (4516): No heartbeat from core client for 30 sec - exiting 09:58:27 (4516): No heartbeat from core client for 30 sec - exiting 09:58:28 (4516): No heartbeat from core client for 30 sec - exiting 09:58:29 (4516): No heartbeat from core client for 30 sec - exiting 09:58:31 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:45:55 (5772): No heartbeat from core client for 30 sec - exiting 09:45:57 (5772): No heartbeat from core client for 30 sec - exiting 09:45:58 (5772): No heartbeat from core client for 30 sec - exiting 09:45:59 (5772): No heartbeat from core client for 30 sec - exiting 09:46:00 (5772): No heartbeat from core client for 30 sec - exiting 09:46:01 (5772): No heartbeat from core client for 30 sec - exiting 09:46:02 (5772): No heartbeat from core client for 30 sec - exiting 09:46:03 (5772): No heartbeat from core client for 30 sec - exiting 09:46:04 (5772): No heartbeat from core client for 30 sec - exiting 09:46:05 (5772): No heartbeat from core client for 30 sec - exiting 09:46:07 (5772): No heartbeat from core client for 30 sec - exiting 09:46:08 (5772): No heartbeat from core client for 30 sec - exiting 09:46:09 (5772): No heartbeat from core client for 30 sec - exiting 09:46:10 (5772): No heartbeat from core client for 30 sec - exiting 09:46:11 (5772): No heartbeat from core client for 30 sec - exiting 09:46:12 (5772): No heartbeat from core client for 30 sec - exiting 09:46:13 (5772): No heartbeat from core client for 30 sec - exiting 09:46:14 (5772): No heartbeat from core client for 30 sec - exiting 09:46:15 (5772): No heartbeat from core client for 30 sec - exiting 09:46:16 (5772): No heartbeat from core client for 30 sec - exiting 09:46:17 (5772): No heartbeat from core client for 30 sec - exiting 09:46:19 (5772): No heartbeat from core client for 30 sec - exiting 09:46:20 (5772): No heartbeat from core client for 30 sec - exiting 09:46:21 (5772): No heartbeat from core client for 30 sec - exiting 09:46:22 (5772): No heartbeat from core client for 30 sec - exiting 09:46:23 (5772): No heartbeat from core client for 30 sec - exiting 09:46:24 (5772): No heartbeat from core client for 30 sec - exiting 09:46:25 (5772): No heartbeat from core client for 30 sec - exiting 09:46:26 (5772): No heartbeat from core client for 30 sec - exiting 09:46:27 (5772): No heartbeat from core client for 30 sec - exiting 09:46:28 (5772): No heartbeat from core client for 30 sec - exiting 09:46:30 (5772): No heartbeat from core client for 30 sec - exiting 09:46:31 (5772): No heartbeat from core client for 30 sec - exiting 09:46:32 (5772): No heartbeat from core client for 30 sec - exiting 09:46:33 (5772): No heartbeat from core client for 30 sec - exiting 09:46:34 (5772): No heartbeat from core client for 30 sec - exiting 09:46:35 (5772): No heartbeat from core client for 30 sec - exiting 09:46:36 (5772): No heartbeat from core client for 30 sec - exiting 09:46:37 (5772): No heartbeat from core client for 30 sec - exiting 09:46:38 (5772): No heartbeat from core client for 30 sec - exiting 09:46:39 (5772): No heartbeat from core client for 30 sec - exiting 09:46:40 (5772): No heartbeat from core client for 30 sec - exiting 09:46:41 (5772): No heartbeat from core client for 30 sec - exiting 09:46:43 (5772): No heartbeat from core client for 30 sec - exiting 09:46:44 (5772): No heartbeat from core client for 30 sec - exiting 09:46:45 (5772): No heartbeat from core client for 30 sec - exiting 09:46:46 (5772): No heartbeat from core client for 30 sec - exiting 09:46:47 (5772): No heartbeat from core client for 30 sec - exiting 09:46:48 (5772): No heartbeat from core client for 30 sec - exiting 09:46:49 (5772): No heartbeat from core client for 30 sec - exiting 09:46:50 (5772): No heartbeat from core client for 30 sec - exiting 09:46:52 (5772): No heartbeat from core client for 30 sec - exiting 09:46:53 (5772): No heartbeat from core client for 30 sec - exiting 09:46:55 (5772): No heartbeat from core client for 30 sec - exiting 09:46:56 (5772): No heartbeat from core client for 30 sec - exiting 09:46:57 (5772): No heartbeat from core client for 30 sec - exiting 09:47:42 (5772): No heartbeat from core client for 30 sec - exiting 09:47:43 (5772): No heartbeat from core client for 30 sec - exiting 09:47:44 (5772): No heartbeat from core client for 30 sec - exiting 09:47:45 (5772): No heartbeat from core client for 30 sec - exiting 09:47:46 (5772): No heartbeat from core client for 30 sec - exiting 09:47:47 (5772): No heartbeat from core client for 30 sec - exiting 09:47:48 (5772): No heartbeat from core client for 30 sec - exiting 09:47:49 (5772): No heartbeat from core client for 30 sec - exiting 09:47:51 (5772): No heartbeat from core client for 30 sec - exiting 09:47:52 (5772): No heartbeat from core client for 30 sec - exiting 09:47:53 (5772): No heartbeat from core client for 30 sec - exiting 09:47:54 (5772): No heartbeat from core client for 30 sec - exiting 09:47:55 (5772): No heartbeat from core client for 30 sec - exiting 09:47:56 (5772): No heartbeat from core client for 30 sec - exiting 09:47:57 (5772): No heartbeat from core client for 30 sec - exiting 09:47:58 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2940, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6092, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr=2 Model crash detected, will try to restart... 09:50:18 (4372): No heartbeat from core client for 30 sec - exiting 09:50:19 (4372): No heartbeat from core client for 30 sec - exiting 09:50:20 (4372): No heartbeat from core client for 30 sec - exiting 09:50:21 (4372): No heartbeat from core client for 30 sec - exiting 09:50:22 (4372): No heartbeat from core client for 30 sec - exiting 09:50:23 (4372): No heartbeat from core client for 30 sec - exiting 09:50:24 (4372): No heartbeat from core client for 30 sec - exiting 09:50:25 (4372): No heartbeat from core client for 30 sec - exiting 09:50:26 (4372): No heartbeat from core client for 30 sec - exiting 09:50:27 (4372): No heartbeat from core client for 30 sec - exiting 09:50:29 (4372): No heartbeat from core client for 30 sec - exiting 09:50:30 (4372): No heartbeat from core client for 30 sec - exiting 09:50:31 (4372): No heartbeat from core client for 30 sec - exiting 09:50:32 (4372): No heartbeat from core client for 30 sec - exiting 09:50:33 (4372): No heartbeat from core client for 30 sec - exiting 09:50:34 (4372): No heartbeat from core client for 30 sec - exiting 09:50:35 (4372): No heartbeat from core client for 30 sec - exiting 09:50:36 (4372): No heartbeat from core client for 30 sec - exiting 09:50:38 (4372): No heartbeat from core client for 30 sec - exiting 09:50:39 (4372): No heartbeat from core client for 30 sec - exiting 09:50:40 (4372): No heartbeat from core client for 30 sec - exiting 09:50:41 (4372): No heartbeat from core client for 30 sec - exiting 09:50:42 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:46:39 (4972): No heartbeat from core client for 30 sec - exiting 09:46:40 (4972): No heartbeat from core client for 30 sec - exiting 09:46:41 (4972): No heartbeat from core client for 30 sec - exiting 09:46:43 (4972): No heartbeat from core client for 30 sec - exiting 09:46:44 (4972): No heartbeat from core client for 30 sec - exiting 09:46:45 (4972): No heartbeat from core client for 30 sec - exiting 09:46:46 (4972): No heartbeat from core client for 30 sec - exiting 09:46:47 (4972): No heartbeat from core client for 30 sec - exiting 09:46:48 (4972): No heartbeat from core client for 30 sec - exiting 09:46:49 (4972): No heartbeat from core client for 30 sec - exiting 09:46:50 (4972): No heartbeat from core client for 30 sec - exiting 09:46:51 (4972): No heartbeat from core client for 30 sec - exiting 09:46:52 (4972): No heartbeat from core client for 30 sec - exiting 09:46:54 (4972): No heartbeat from core client for 30 sec - exiting 09:46:55 (4972): No heartbeat from core client for 30 sec - exiting 09:46:56 (4972): No heartbeat from core client for 30 sec - exiting 09:46:57 (4972): No heartbeat from core client for 30 sec - exiting 09:46:58 (4972): No heartbeat from core client for 30 sec - exiting 09:46:59 (4972): No heartbeat from core client for 30 sec - exiting 09:47:00 (4972): No heartbeat from core client for 30 sec - exiting 09:47:01 (4972): No heartbeat from core client for 30 sec - exiting 09:47:02 (4972): No heartbeat from core client for 30 sec - exiting 09:47:03 (4972): No heartbeat from core client for 30 sec - exiting 09:47:04 (4972): No heartbeat from core client for 30 sec - exiting 09:47:05 (4972): No heartbeat from core client for 30 sec - exiting 09:47:06 (4972): No heartbeat from core client for 30 sec - exiting 09:47:07 (4972): No heartbeat from core client for 30 sec - exiting 09:47:09 (4972): No heartbeat from core client for 30 sec - exiting 09:47:10 (4972): No heartbeat from core client for 30 sec - exiting 09:47:11 (4972): No heartbeat from core client for 30 sec - exiting 09:47:12 (4972): No heartbeat from core client for 30 sec - exiting 09:47:13 (4972): No heartbeat from core client for 30 sec - exiting 09:47:14 (4972): No heartbeat from core client for 30 sec - exiting 09:47:15 (4972): No heartbeat from core client for 30 sec - exiting 09:47:16 (4972): No heartbeat from core client for 30 sec - exiting 09:47:17 (4972): No heartbeat from core client for 30 sec - exiting 09:47:18 (4972): No heartbeat from core client for 30 sec - exiting 09:47:19 (4972): No heartbeat from core client for 30 sec - exiting 09:47:20 (4972): No heartbeat from core client for 30 sec - exiting 09:47:21 (4972): No heartbeat from core client for 30 sec - exiting 09:47:23 (4972): No heartbeat from core client for 30 sec - exiting 09:47:24 (4972): No heartbeat from core client for 30 sec - exiting 09:47:25 (4972): No heartbeat from core client for 30 sec - exiting 09:47:26 (4972): No heartbeat from core client for 30 sec - exiting 09:47:27 (4972): No heartbeat from core client for 30 sec - exiting 09:47:28 (4972): No heartbeat from core client for 30 sec - exiting 09:47:29 (4972): No heartbeat from core client for 30 sec - exiting 09:47:30 (4972): No heartbeat from core client for 30 sec - exiting 09:47:31 (4972): No heartbeat from core client for 30 sec - exiting 09:47:32 (4972): No heartbeat from core client for 30 sec - exiting 09:47:33 (4972): No heartbeat from core client for 30 sec - exiting 09:47:35 (4972): No heartbeat from core client for 30 sec - exiting 09:47:36 (4972): No heartbeat from core client for 30 sec - exiting 09:47:37 (4972): No heartbeat from core client for 30 sec - exiting 09:47:38 (4972): No heartbeat from core client for 30 sec - exiting 09:47:39 (4972): No heartbeat from core client for 30 sec - exiting 09:47:40 (4972): No heartbeat from core client for 30 sec - exiting 09:47:41 (4972): No heartbeat from core client for 30 sec - exiting 09:47:42 (4972): No heartbeat from core client for 30 sec - exiting 09:47:43 (4972): No heartbeat from core client for 30 sec - exiting 09:47:45 (4972): No heartbeat from core client for 30 sec - exiting 09:47:46 (4972): No heartbeat from core client for 30 sec - exiting 09:47:47 (4972): No heartbeat from core client for 30 sec - exiting 09:47:48 (4972): No heartbeat from core client for 30 sec - exiting 09:47:49 (4972): No heartbeat from core client for 30 sec - exiting 09:47:50 (4972): No heartbeat from core client for 30 sec - exiting 09:47:51 (4972): No heartbeat from core client for 30 sec - exiting 09:47:52 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3572, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 09:48:59 (4564): No heartbeat from core client for 30 sec - exiting 09:49:00 (4564): No heartbeat from core client for 30 sec - exiting 09:49:02 (4564): No heartbeat from core client for 30 sec - exiting 09:49:03 (4564): No heartbeat from core client for 30 sec - exiting 09:49:04 (4564): No heartbeat from core client for 30 sec - exiting 09:49:05 (4564): No heartbeat from core client for 30 sec - exiting 09:49:06 (4564): No heartbeat from core client for 30 sec - exiting 09:49:07 (4564): No heartbeat from core client for 30 sec - exiting 09:49:08 (4564): No heartbeat from core client for 30 sec - exiting 09:49:09 (4564): No heartbeat from core client for 30 sec - exiting 09:49:10 (4564): No heartbeat from core client for 30 sec - exiting 09:49:11 (4564): No heartbeat from core client for 30 sec - exiting 09:49:12 (4564): No heartbeat from core client for 30 sec - exiting 09:49:13 (4564): No heartbeat from core client for 30 sec - exiting 09:49:14 (4564): No heartbeat from core client for 30 sec - exiting 09:49:15 (4564): No heartbeat from core client for 30 sec - exiting 09:49:16 (4564): No heartbeat from core client for 30 sec - exiting 09:49:17 (4564): No heartbeat from core client for 30 sec - exiting 09:49:19 (4564): No heartbeat from core client for 30 sec - exiting 09:49:20 (4564): No heartbeat from core client for 30 sec - exiting 09:49:21 (4564): No heartbeat from core client for 30 sec - exiting 09:49:22 (4564): No heartbeat from core client for 30 sec - exiting 09:49:23 (4564): No heartbeat from core client for 30 sec - exiting 09:49:24 (4564): No heartbeat from core client for 30 sec - exiting 09:49:25 (4564): No heartbeat from core client for 30 sec - exiting 09:49:27 (4564): No heartbeat from core client for 30 sec - exiting 09:49:28 (4564): No heartbeat from core client for 30 sec - exiting 09:49:29 (4564): No heartbeat from core client for 30 sec - exiting 09:49:30 (4564): No heartbeat from core client for 30 sec - exiting 09:49:31 (4564): No heartbeat from core client for 30 sec - exiting 09:49:32 (4564): No heartbeat from core client for 30 sec - exiting 09:49:33 (4564): No heartbeat from core client for 30 sec - exiting 09:49:34 (4564): No heartbeat from core client for 30 sec - exiting 09:49:35 (4564): No heartbeat from core client for 30 sec - exiting 09:49:36 (4564): No heartbeat from core client for 30 sec - exiting 09:49:37 (4564): No heartbeat from core client for 30 sec - exiting 09:49:39 (4564): No heartbeat from core client for 30 sec - exiting 09:49:40 (4564): No heartbeat from core client for 30 sec - exiting 09:49:41 (4564): No heartbeat from core client for 30 sec - exiting 09:49:42 (4564): No heartbeat from core client for 30 sec - exiting 09:49:43 (4564): No heartbeat from core client for 30 sec - exiting 09:49:44 (4564): No heartbeat from core client for 30 sec - exiting 09:49:45 (4564): No heartbeat from core client for 30 sec - exiting 09:49:46 (4564): No heartbeat from core client for 30 sec - exiting 09:49:47 (4564): No heartbeat from core client for 30 sec - exiting 09:49:48 (4564): No heartbeat from core client for 30 sec - exiting 09:49:50 (4564): No heartbeat from core client for 30 sec - exiting 09:49:51 (4564): No heartbeat from core client for 30 sec - exiting 09:49:52 (4564): No heartbeat from core client for 30 sec - exiting 09:49:53 (4564): No heartbeat from core client for 30 sec - exiting 09:49:54 (4564): No heartbeat from core client for 30 sec - exiting 09:49:55 (4564): No heartbeat from core client for 30 sec - exiting 09:49:56 (4564): No heartbeat from core client for 30 sec - exiting 09:49:57 (4564): No heartbeat from core client for 30 sec - exiting 09:49:58 (4564): No heartbeat from core client for 30 sec - exiting 09:49:59 (4564): No heartbeat from core client for 30 sec - exiting 09:50:00 (4564): No heartbeat from core client for 30 sec - exiting 09:50:02 (4564): No heartbeat from core client for 30 sec - exiting 09:50:03 (4564): No heartbeat from core client for 30 sec - exiting 09:50:04 (4564): No heartbeat from core client for 30 sec - exiting 09:50:05 (4564): No heartbeat from core client for 30 sec - exiting 09:50:06 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Aug 2012 02:38:43	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	138,336	357,882	2.5870
14 Aug 2012 23:53:09	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	126,816	326,868	2.5775
13 Aug 2012 00:32:36	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	115,296	296,144	2.5686
08 Aug 2012 03:00:46	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	103,776	265,833	2.5616
06 Aug 2012 01:17:41	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	92,256	236,170	2.5599
02 Aug 2012 21:54:16	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	80,742	208,318	2.5800
02 Aug 2012 03:15:59	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	80,736	207,937	2.5755
31 Jul 2012 01:51:00	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	69,216	178,152	2.5739
31 Jul 2012 01:51:00	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	57,705	148,649	2.5760
27 Jul 2012 02:08:54	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	57,696	148,276	2.5700
25 Jul 2012 00:00:23	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	46,183	119,528	2.5881
24 Jul 2012 23:00:08	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	46,176	119,214	2.5817
23 Jul 2012 00:15:56	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	34,656	90,818	2.6206
18 Jul 2012 22:39:04	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	23,136	57,545	2.4872
16 Jul 2012 22:53:01	1227142	14904037	hadam3p_pnw_bm0x_1985_1_008047144_1	11,616	29,736	2.5599