Task 15118763

Name	hadam3p_pnw_33gn_1985_1_008145178_0
Workunit	8300302
Created	14 Aug 2012, 19:07:21 UTC
Sent	21 Aug 2012, 18:25:28 UTC
Report deadline	3 Aug 2013, 23:45:28 UTC
Received	15 Sep 2012, 14:12:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1170350
Run time	2 days 12 hours 7 min 33 sec
CPU time	2 days 10 hours 12 min 30 sec
Validate state	Invalid
Credit	1,504.13
Device peak FLOPS	2.54 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> uspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:21:38 (4380): No heartbeat from core client for 30 sec - exiting 15:21:39 (4380): No heartbeat from core client for 30 sec - exiting 15:21:40 (4380): No heartbeat from core client for 30 sec - exiting 15:21:41 (4380): No heartbeat from core client for 30 sec - exiting 15:21:42 (4380): No heartbeat from core client for 30 sec - exiting 15:21:43 (4380): No heartbeat from core client for 30 sec - exiting 15:21:44 (4380): No heartbeat from core client for 30 sec - exiting 15:21:45 (4380): No heartbeat from core client for 30 sec - exiting 15:21:46 (4380): No heartbeat from core client for 30 sec - exiting 15:21:47 (4380): No heartbeat from core client for 30 sec - exiting 15:21:48 (4380): No heartbeat from core client for 30 sec - exiting 15:21:49 (4380): No heartbeat from core client for 30 sec - exiting 15:21:50 (4380): No heartbeat from core client for 30 sec - exiting 15:21:51 (4380): No heartbeat from core client for 30 sec - exiting 15:21:52 (4380): No heartbeat from core client for 30 sec - exiting 15:21:53 (4380): No heartbeat from core client for 30 sec - exiting 15:21:54 (4380): No heartbeat from core client for 30 sec - exiting 15:21:55 (4380): No heartbeat from core client for 30 sec - exiting 15:21:56 (4380): No heartbeat from core client for 30 sec - exiting 15:21:57 (4380): No heartbeat from core client for 30 sec - exiting 15:21:58 (4380): No heartbeat from core client for 30 sec - exiting 15:21:59 (4380): No heartbeat from core client for 30 sec - exiting 15:22:00 (4380): No heartbeat from core client for 30 sec - exiting 15:22:01 (4380): No heartbeat from core client for 30 sec - exiting 15:22:02 (4380): No heartbeat from core client for 30 sec - exiting 15:22:03 (4380): No heartbeat from core client for 30 sec - exiting 15:22:04 (4380): No heartbeat from core client for 30 sec - exiting 15:22:05 (4380): No heartbeat from core client for 30 sec - exiting 15:22:06 (4380): No heartbeat from core client for 30 sec - exiting 15:24:25 (4380): No heartbeat from core client for 30 sec - exiting 15:24:26 (4380): No heartbeat from core client for 30 sec - exiting 15:24:27 (4380): No heartbeat from core client for 30 sec - exiting 15:24:28 (4380): No heartbeat from core client for 30 sec - exiting 15:24:29 (4380): No heartbeat from core client for 30 sec - exiting 15:24:30 (4380): No heartbeat from core client for 30 sec - exiting 15:24:31 (4380): No heartbeat from core client for 30 sec - exiting 15:24:32 (4380): No heartbeat from core client for 30 sec - exiting 15:24:33 (4380): No heartbeat from core client for 30 sec - exiting 15:24:34 (4380): No heartbeat from core client for 30 sec - exiting 15:24:35 (4380): No heartbeat from core client for 30 sec - exiting 15:24:36 (4380): No heartbeat from core client for 30 sec - exiting 15:24:37 (4380): No heartbeat from core client for 30 sec - exiting 15:24:38 (4380): No heartbeat from core client for 30 sec - exiting 15:24:39 (4380): No heartbeat from core client for 30 sec - exiting 15:24:40 (4380): No heartbeat from core client for 30 sec - exiting 15:24:41 (4380): No heartbeat from core client for 30 sec - exiting 15:24:42 (4380): No heartbeat from core client for 30 sec - exiting 15:24:43 (4380): No heartbeat from core client for 30 sec - exiting 15:24:44 (4380): No heartbeat from core client for 30 sec - exiting 15:24:45 (4380): No heartbeat from core client for 30 sec - exiting 15:24:46 (4380): No heartbeat from core client for 30 sec - exiting 15:24:47 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:03:46 (528): No heartbeat from core client for 30 sec - exiting 19:03:47 (528): No heartbeat from core client for 30 sec - exiting 19:03:48 (528): No heartbeat from core client for 30 sec - exiting 19:03:49 (528): No heartbeat from core client for 30 sec - exiting 19:03:50 (528): No heartbeat from core client for 30 sec - exiting 19:03:51 (528): No heartbeat from core client for 30 sec - exiting 19:03:52 (528): No heartbeat from core client for 30 sec - exiting 19:03:53 (528): No heartbeat from core client for 30 sec - exiting 19:03:54 (528): No heartbeat from core client for 30 sec - exiting 19:03:55 (528): No heartbeat from core client for 30 sec - exiting 19:03:56 (528): No heartbeat from core client for 30 sec - exiting 19:03:57 (528): No heartbeat from core client for 30 sec - exiting 19:03:58 (528): No heartbeat from core client for 30 sec - exiting 19:03:59 (528): No heartbeat from core client for 30 sec - exiting 19:04:00 (528): No heartbeat from core client for 30 sec - exiting 19:04:01 (528): No heartbeat from core client for 30 sec - exiting 19:04:02 (528): No heartbeat from core client for 30 sec - exiting 19:04:03 (528): No heartbeat from core client for 30 sec - exiting 19:04:04 (528): No heartbeat from core client for 30 sec - exiting 19:04:05 (528): No heartbeat from core client for 30 sec - exiting 19:04:06 (528): No heartbeat from core client for 30 sec - exiting 19:04:07 (528): No heartbeat from core client for 30 sec - exiting 19:05:42 (528): No heartbeat from core client for 30 sec - exiting 19:05:43 (528): No heartbeat from core client for 30 sec - exiting 19:05:44 (528): No heartbeat from core client for 30 sec - exiting 19:05:45 (528): No heartbeat from core client for 30 sec - exiting 19:05:46 (528): No heartbeat from core client for 30 sec - exiting 19:05:47 (528): No heartbeat from core client for 30 sec - exiting 19:05:48 (528): No heartbeat from core client for 30 sec - exiting 19:05:49 (528): No heartbeat from core client for 30 sec - exiting 19:05:50 (528): No heartbeat from core client for 30 sec - exiting 19:05:51 (528): No heartbeat from core client for 30 sec - exiting 19:05:52 (528): No heartbeat from core client for 30 sec - exiting 19:05:53 (528): No heartbeat from core client for 30 sec - exiting 19:05:54 (528): No heartbeat from core client for 30 sec - exiting 19:05:55 (528): No heartbeat from core client for 30 sec - exiting 19:05:56 (528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:10 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2760, selfPID=2760, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7548, selfPID=1240, iMonCtr=1 Model crash detected, will try to restart... 15:49:09 (5776): No heartbeat from core client for 30 sec - exiting 15:49:11 (5776): No heartbeat from core client for 30 sec - exiting 15:49:12 (5776): No heartbeat from core client for 30 sec - exiting 15:49:13 (5776): No heartbeat from core client for 30 sec - exiting 15:49:14 (5776): No heartbeat from core client for 30 sec - exiting 15:49:15 (5776): No heartbeat from core client for 30 sec - exiting 15:49:16 (5776): No heartbeat from core client for 30 sec - exiting 15:49:17 (5776): No heartbeat from core client for 30 sec - exiting 15:49:18 (5776): No heartbeat from core client for 30 sec - exiting 15:49:19 (5776): No heartbeat from core client for 30 sec - exiting 15:49:20 (5776): No heartbeat from core client for 30 sec - exiting 15:49:21 (5776): No heartbeat from core client for 30 sec - exiting 15:49:22 (5776): No heartbeat from core client for 30 sec - exiting 15:49:23 (5776): No heartbeat from core client for 30 sec - exiting 15:49:24 (5776): No heartbeat from core client for 30 sec - exiting 15:49:25 (5776): No heartbeat from core client for 30 sec - exiting 15:49:26 (5776): No heartbeat from core client for 30 sec - exiting 15:49:27 (5776): No heartbeat from core client for 30 sec - exiting 15:49:28 (5776): No heartbeat from core client for 30 sec - exiting 15:49:29 (5776): No heartbeat from core client for 30 sec - exiting 15:49:30 (5776): No heartbeat from core client for 30 sec - exiting 15:49:31 (5776): No heartbeat from core client for 30 sec - exiting 15:49:32 (5776): No heartbeat from core client for 30 sec - exiting 15:49:33 (5776): No heartbeat from core client for 30 sec - exiting 15:49:34 (5776): No heartbeat from core client for 30 sec - exiting 15:49:35 (5776): No heartbeat from core client for 30 sec - exiting 15:49:36 (5776): No heartbeat from core client for 30 sec - exiting 15:49:37 (5776): No heartbeat from core client for 30 sec - exiting 15:49:38 (5776): No heartbeat from core client for 30 sec - exiting 15:49:39 (5776): No heartbeat from core client for 30 sec - exiting 15:49:40 (5776): No heartbeat from core client for 30 sec - exiting 15:49:41 (5776): No heartbeat from core client for 30 sec - exiting 15:49:42 (5776): No heartbeat from core client for 30 sec - exiting 15:49:43 (5776): No heartbeat from core client for 30 sec - exiting 15:49:44 (5776): No heartbeat from core client for 30 sec - exiting 15:49:45 (5776): No heartbeat from core client for 30 sec - exiting 15:49:46 (5776): No heartbeat from core client for 30 sec - exiting 15:49:47 (5776): No heartbeat from core client for 30 sec - exiting 15:49:48 (5776): No heartbeat from core client for 30 sec - exiting 15:51:24 (5776): No heartbeat from core client for 30 sec - exiting 15:51:25 (5776): No heartbeat from core client for 30 sec - exiting 15:51:26 (5776): No heartbeat from core client for 30 sec - exiting 15:51:27 (5776): No heartbeat from core client for 30 sec - exiting 15:51:28 (5776): No heartbeat from core client for 30 sec - exiting 15:51:29 (5776): No heartbeat from core client for 30 sec - exiting 15:51:30 (5776): No heartbeat from core client for 30 sec - exiting 15:51:31 (5776): No heartbeat from core client for 30 sec - exiting 15:51:32 (5776): No heartbeat from core client for 30 sec - exiting 15:51:33 (5776): No heartbeat from core client for 30 sec - exiting 15:51:34 (5776): No heartbeat from core client for 30 sec - exiting 15:51:35 (5776): No heartbeat from core client for 30 sec - exiting 15:51:36 (5776): No heartbeat from core client for 30 sec - exiting 15:51:37 (5776): No heartbeat from core client for 30 sec - exiting 15:51:38 (5776): No heartbeat from core client for 30 sec - exiting 15:51:39 (5776): No heartbeat from core client for 30 sec - exiting 15:51:40 (5776): No heartbeat from core client for 30 sec - exiting 15:51:41 (5776): No heartbeat from core client for 30 sec - exiting 15:51:42 (5776): No heartbeat from core client for 30 sec - exiting 15:51:43 (5776): No heartbeat from core client for 30 sec - exiting 15:51:44 (5776): No heartbeat from core client for 30 sec - exiting 15:51:45 (5776): No heartbeat from core client for 30 sec - exiting 15:51:46 (5776): No heartbeat from core client for 30 sec - exiting 15:51:47 (5776): No heartbeat from core client for 30 sec - exiting 15:51:48 (5776): No heartbeat from core client for 30 sec - exiting 15:51:49 (5776): No heartbeat from core client for 30 sec - exiting 15:51:50 (5776): No heartbeat from core client for 30 sec - exiting 15:51:51 (5776): No heartbeat from core client for 30 sec - exiting 15:51:52 (5776): No heartbeat from core client for 30 sec - exiting 15:51:53 (5776): No heartbeat from core client for 30 sec - exiting 15:51:54 (5776): No heartbeat from core client for 30 sec - exiting 15:51:55 (5776): No heartbeat from core client for 30 sec - exiting 15:51:56 (5776): No heartbeat from core client for 30 sec - exiting 15:51:57 (5776): No heartbeat from core client for 30 sec - exiting 15:51:58 (5776): No heartbeat from core client for 30 sec - exiting 15:51:59 (5776): No heartbeat from core client for 30 sec - exiting 15:52:00 (5776): No heartbeat from core client for 30 sec - exiting 15:52:01 (5776): No heartbeat from core client for 30 sec - exiting 15:52:02 (5776): No heartbeat from core client for 30 sec - exiting 15:52:03 (5776): No heartbeat from core client for 30 sec - exiting 15:52:04 (5776): No heartbeat from core client for 30 sec - exiting 15:52:05 (5776): No heartbeat from core client for 30 sec - exiting 15:52:06 (5776): No heartbeat from core client for 30 sec - exiting 15:52:07 (5776): No heartbeat from core client for 30 sec - exiting 15:52:08 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:59:49 (5804): No heartbeat from core client for 30 sec - exiting 18:59:50 (5804): No heartbeat from core client for 30 sec - exiting 18:59:51 (5804): No heartbeat from core client for 30 sec - exiting 18:59:52 (5804): No heartbeat from core client for 30 sec - exiting 18:59:53 (5804): No heartbeat from core client for 30 sec - exiting 18:59:54 (5804): No heartbeat from core client for 30 sec - exiting 18:59:55 (5804): No heartbeat from core client for 30 sec - exiting 18:59:56 (5804): No heartbeat from core client for 30 sec - exiting 18:59:57 (5804): No heartbeat from core client for 30 sec - exiting 18:59:58 (5804): No heartbeat from core client for 30 sec - exiting 18:59:59 (5804): No heartbeat from core client for 30 sec - exiting 19:00:00 (5804): No heartbeat from core client for 30 sec - exiting 19:00:01 (5804): No heartbeat from core client for 30 sec - exiting 19:00:02 (5804): No heartbeat from core client for 30 sec - exiting 19:00:03 (5804): No heartbeat from core client for 30 sec - exiting 19:00:04 (5804): No heartbeat from core client for 30 sec - exiting 19:00:05 (5804): No heartbeat from core client for 30 sec - exiting 19:00:06 (5804): No heartbeat from core client for 30 sec - exiting 19:00:07 (5804): No heartbeat from core client for 30 sec - exiting 19:00:08 (5804): No heartbeat from core client for 30 sec - exiting 19:00:09 (5804): No heartbeat from core client for 30 sec - exiting 19:00:10 (5804): No heartbeat from core client for 30 sec - exiting 19:00:11 (5804): No heartbeat from core client for 30 sec - exiting 19:00:12 (5804): No heartbeat from core client for 30 sec - exiting 19:00:13 (5804): No heartbeat from core client for 30 sec - exiting 19:00:14 (5804): No heartbeat from core client for 30 sec - exiting 19:01:28 (5804): No heartbeat from core client for 30 sec - exiting 19:01:29 (5804): No heartbeat from core client for 30 sec - exiting 19:01:30 (5804): No heartbeat from core client for 30 sec - exiting 19:01:31 (5804): No heartbeat from core client for 30 sec - exiting 19:01:32 (5804): No heartbeat from core client for 30 sec - exiting 19:01:33 (5804): No heartbeat from core client for 30 sec - exiting 19:01:34 (5804): No heartbeat from core client for 30 sec - exiting 19:01:35 (5804): No heartbeat from core client for 30 sec - exiting 19:01:36 (5804): No heartbeat from core client for 30 sec - exiting 19:01:37 (5804): No heartbeat from core client for 30 sec - exiting 19:01:38 (5804): No heartbeat from core client for 30 sec - exiting 19:01:39 (5804): No heartbeat from core client for 30 sec - exiting 19:01:40 (5804): No heartbeat from core client for 30 sec - exiting 19:01:41 (5804): No heartbeat from core client for 30 sec - exiting 19:01:42 (5804): No heartbeat from core client for 30 sec - exiting 19:01:43 (5804): No heartbeat from core client for 30 sec - exiting 19:01:44 (5804): No heartbeat from core client for 30 sec - exiting 19:01:45 (5804): No heartbeat from core client for 30 sec - exiting 19:01:46 (5804): No heartbeat from core client for 30 sec - exiting 19:01:47 (5804): No heartbeat from core client for 30 sec - exiting 19:01:48 (5804): No heartbeat from core client for 30 sec - exiting 19:01:49 (5804): No heartbeat from core client for 30 sec - exiting 19:01:50 (5804): No heartbeat from core client for 30 sec - exiting 19:01:51 (5804): No heartbeat from core client for 30 sec - exiting 19:01:52 (5804): No heartbeat from core client for 30 sec - exiting 19:01:53 (5804): No heartbeat from core client for 30 sec - exiting 19:01:54 (5804): No heartbeat from core client for 30 sec - exiting 19:01:55 (5804): No heartbeat from core client for 30 sec - exiting 19:01:56 (5804): No heartbeat from core client for 30 sec - exiting 19:01:57 (5804): No heartbeat from core client for 30 sec - exiting 19:01:58 (5804): No heartbeat from core client for 30 sec - exiting 19:01:59 (5804): No heartbeat from core client for 30 sec - exiting 19:02:00 (5804): No heartbeat from core client for 30 sec - exiting 19:02:01 (5804): No heartbeat from core client for 30 sec - exiting 19:02:02 (5804): No heartbeat from core client for 30 sec - exiting 19:02:03 (5804): No heartbeat from core client for 30 sec - exiting 19:02:04 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:10 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3876, selfPID=3876, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:48:01 (612): No heartbeat from core client for 30 sec - exiting 21:48:03 (612): No heartbeat from core client for 30 sec - exiting 21:48:04 (612): No heartbeat from core client for 30 sec - exiting 21:48:05 (612): No heartbeat from core client for 30 sec - exiting 21:48:06 (612): No heartbeat from core client for 30 sec - exiting 21:48:07 (612): No heartbeat from core client for 30 sec - exiting 21:48:08 (612): No heartbeat from core client for 30 sec - exiting 21:48:09 (612): No heartbeat from core client for 30 sec - exiting 21:48:10 (612): No heartbeat from core client for 30 sec - exiting 21:48:11 (612): No heartbeat from core client for 30 sec - exiting 21:48:12 (612): No heartbeat from core client for 30 sec - exiting 21:48:13 (612): No heartbeat from core client for 30 sec - exiting 21:48:14 (612): No heartbeat from core client for 30 sec - exiting 21:48:49 (612): No heartbeat from core client for 30 sec - exiting 21:48:50 (612): No heartbeat from core client for 30 sec - exiting 21:48:51 (612): No heartbeat from core client for 30 sec - exiting 21:48:52 (612): No heartbeat from core client for 30 sec - exiting 21:48:53 (612): No heartbeat from core client for 30 sec - exiting 21:48:54 (612): No heartbeat from core client for 30 sec - exiting 21:48:55 (612): No heartbeat from core client for 30 sec - exiting 21:48:56 (612): No heartbeat from core client for 30 sec - exiting 21:48:57 (612): No heartbeat from core client for 30 sec - exiting 21:48:58 (612): No heartbeat from core client for 30 sec - exiting 21:48:59 (612): No heartbeat from core client for 30 sec - exiting 21:49:00 (612): No heartbeat from core client for 30 sec - exiting 21:49:01 (612): No heartbeat from core client for 30 sec - exiting 21:49:02 (612): No heartbeat from core client for 30 sec - exiting 21:49:03 (612): No heartbeat from core client for 30 sec - exiting 21:49:04 (612): No heartbeat from core client for 30 sec - exiting 21:49:05 (612): No heartbeat from core client for 30 sec - exiting 21:49:06 (612): No heartbeat from core client for 30 sec - exiting 21:49:07 (612): No heartbeat from core client for 30 sec - exiting 21:49:08 (612): No heartbeat from core client for 30 sec - exiting 21:49:09 (612): No heartbeat from core client for 30 sec - exiting 21:49:10 (612): No heartbeat from core client for 30 sec - exiting 21:49:11 (612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:53:59 (4388): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5072, iMonCtr=2 15:29:34 (2676): No heartbeat from core client for 30 sec - exiting 15:29:36 (2676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2784, selfPID=2336, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 15:34:12 (2604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:34:13 (2604): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:00:31 (1488): No heartbeat from core client for 30 sec - exiting 19:00:32 (1488): No heartbeat from core client for 30 sec - exiting 19:00:33 (1488): No heartbeat from core client for 30 sec - exiting 19:00:34 (1488): No heartbeat from core client for 30 sec - exiting 19:00:35 (1488): No heartbeat from core client for 30 sec - exiting 19:00:36 (1488): No heartbeat from core client for 30 sec - exiting 19:00:37 (1488): No heartbeat from core client for 30 sec - exiting 19:00:38 (1488): No heartbeat from core client for 30 sec - exiting 19:00:39 (1488): No heartbeat from core client for 30 sec - exiting 19:00:40 (1488): No heartbeat from core client for 30 sec - exiting 19:00:41 (1488): No heartbeat from core client for 30 sec - exiting 19:00:42 (1488): No heartbeat from core client for 30 sec - exiting 19:00:43 (1488): No heartbeat from core client for 30 sec - exiting 19:00:44 (1488): No heartbeat from core client for 30 sec - exiting 19:00:45 (1488): No heartbeat from core client for 30 sec - exiting 19:00:46 (1488): No heartbeat from core client for 30 sec - exiting 19:00:47 (1488): No heartbeat from core client for 30 sec - exiting 19:00:48 (1488): No heartbeat from core client for 30 sec - exiting 19:00:49 (1488): No heartbeat from core client for 30 sec - exiting 19:00:50 (1488): No heartbeat from core client for 30 sec - exiting 19:00:51 (1488): No heartbeat from core client for 30 sec - exiting 19:00:52 (1488): No heartbeat from core client for 30 sec - exiting 19:00:53 (1488): No heartbeat from core client for 30 sec - exiting 19:00:54 (1488): No heartbeat from core client for 30 sec - exiting 19:00:55 (1488): No heartbeat from core client for 30 sec - exiting 19:00:56 (1488): No heartbeat from core client for 30 sec - exiting 19:00:57 (1488): No heartbeat from core client for 30 sec - exiting 19:00:58 (1488): No heartbeat from core client for 30 sec - exiting 19:00:59 (1488): No heartbeat from core client for 30 sec - exiting 19:02:56 (1488): No heartbeat from core client for 30 sec - exiting 19:02:57 (1488): No heartbeat from core client for 30 sec - exiting 19:02:58 (1488): No heartbeat from core client for 30 sec - exiting 19:02:59 (1488): No heartbeat from core client for 30 sec - exiting 19:03:00 (1488): No heartbeat from core client for 30 sec - exiting 19:03:01 (1488): No heartbeat from core client for 30 sec - exiting 19:03:02 (1488): No heartbeat from core client for 30 sec - exiting 19:03:03 (1488): No heartbeat from core client for 30 sec - exiting 19:03:04 (1488): No heartbeat from core client for 30 sec - exiting 19:03:05 (1488): No heartbeat from core client for 30 sec - exiting 19:03:06 (1488): No heartbeat from core client for 30 sec - exiting 19:03:07 (1488): No heartbeat from core client for 30 sec - exiting 19:03:08 (1488): No heartbeat from core client for 30 sec - exiting 19:03:09 (1488): No heartbeat from core client for 30 sec - exiting 19:03:10 (1488): No heartbeat from core client for 30 sec - exiting 19:03:11 (1488): No heartbeat from core client for 30 sec - exiting 19:03:12 (1488): No heartbeat from core client for 30 sec - exiting 19:03:13 (1488): No heartbeat from core client for 30 sec - exiting 19:03:14 (1488): No heartbeat from core client for 30 sec - exiting 19:03:15 (1488): No heartbeat from core client for 30 sec - exiting 19:03:16 (1488): No heartbeat from core client for 30 sec - exiting 19:03:17 (1488): No heartbeat from core client for 30 sec - exiting 19:03:18 (1488): No heartbeat from core client for 30 sec - exiting 19:03:19 (1488): No heartbeat from core client for 30 sec - exiting 19:03:20 (1488): No heartbeat from core client for 30 sec - exiting 19:03:21 (1488): No heartbeat from core client for 30 sec - exiting 19:03:22 (1488): No heartbeat from core client for 30 sec - exiting 19:03:23 (1488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:56 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6972, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5188, iMonCtr=2 Model crash detected, will try to restart... 19:02:10 (4576): No heartbeat from core client for 30 sec - exiting 19:02:11 (4576): No heartbeat from core client for 30 sec - exiting 19:02:12 (4576): No heartbeat from core client for 30 sec - exiting 19:02:13 (4576): No heartbeat from core client for 30 sec - exiting 19:02:14 (4576): No heartbeat from core client for 30 sec - exiting 19:02:15 (4576): No heartbeat from core client for 30 sec - exiting 19:02:16 (4576): No heartbeat from core client for 30 sec - exiting 19:02:17 (4576): No heartbeat from core client for 30 sec - exiting 19:02:18 (4576): No heartbeat from core client for 30 sec - exiting 19:02:19 (4576): No heartbeat from core client for 30 sec - exiting 19:02:20 (4576): No heartbeat from core client for 30 sec - exiting 19:02:21 (4576): No heartbeat from core client for 30 sec - exiting 19:02:22 (4576): No heartbeat from core client for 30 sec - exiting 19:02:23 (4576): No heartbeat from core client for 30 sec - exiting 19:02:24 (4576): No heartbeat from core client for 30 sec - exiting 19:02:25 (4576): No heartbeat from core client for 30 sec - exiting 19:02:26 (4576): No heartbeat from core client for 30 sec - exiting 19:02:27 (4576): No heartbeat from core client for 30 sec - exiting 19:02:28 (4576): No heartbeat from core client for 30 sec - exiting 19:02:29 (4576): No heartbeat from core client for 30 sec - exiting 19:02:30 (4576): No heartbeat from core client for 30 sec - exiting 19:02:31 (4576): No heartbeat from core client for 30 sec - exiting 19:02:32 (4576): No heartbeat from core client for 30 sec - exiting 19:02:33 (4576): No heartbeat from core client for 30 sec - exiting 19:02:34 (4576): No heartbeat from core client for 30 sec - exiting 19:02:35 (4576): No heartbeat from core client for 30 sec - exiting 19:02:36 (4576): No heartbeat from core client for 30 sec - exiting 19:02:37 (4576): No heartbeat from core client for 30 sec - exiting 19:02:38 (4576): No heartbeat from core client for 30 sec - exiting 19:02:39 (4576): No heartbeat from core client for 30 sec - exiting 19:02:40 (4576): No heartbeat from core client for 30 sec - exiting 19:02:41 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:54:39 (4340): No heartbeat from core client for 30 sec - exiting 20:54:40 (4340): No heartbeat from core client for 30 sec - exiting 20:54:41 (4340): No heartbeat from core client for 30 sec - exiting 20:54:42 (4340): No heartbeat from core client for 30 sec - exiting 20:54:43 (4340): No heartbeat from core client for 30 sec - exiting 20:54:44 (4340): No heartbeat from core client for 30 sec - exiting 20:54:45 (4340): No heartbeat from core client for 30 sec - exiting 20:54:46 (4340): No heartbeat from core client for 30 sec - exiting 20:54:47 (4340): No heartbeat from core client for 30 sec - exiting 20:54:48 (4340): No heartbeat from core client for 30 sec - exiting 20:54:49 (4340): No heartbeat from core client for 30 sec - exiting 20:54:50 (4340): No heartbeat from core client for 30 sec - exiting 20:54:51 (4340): No heartbeat from core client for 30 sec - exiting 20:54:52 (4340): No heartbeat from core client for 30 sec - exiting 20:54:53 (4340): No heartbeat from core client for 30 sec - exiting 20:54:54 (4340): No heartbeat from core client for 30 sec - exiting 20:54:55 (4340): No heartbeat from core client for 30 sec - exiting 20:54:56 (4340): No heartbeat from core client for 30 sec - exiting 20:54:57 (4340): No heartbeat from core client for 30 sec - exiting 20:54:58 (4340): No heartbeat from core client for 30 sec - exiting 20:54:59 (4340): No heartbeat from core client for 30 sec - exiting 20:55:00 (4340): No heartbeat from core client for 30 sec - exiting 20:55:01 (4340): No heartbeat from core client for 30 sec - exiting 20:55:02 (4340): No heartbeat from core client for 30 sec - exiting 20:55:03 (4340): No heartbeat from core client for 30 sec - exiting 20:55:04 (4340): No heartbeat from core client for 30 sec - exiting 20:55:05 (4340): No heartbeat from core client for 30 sec - exiting 20:55:06 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:43:49 (5372): No heartbeat from core client for 30 sec - exiting 15:43:50 (5372): No heartbeat from core client for 30 sec - exiting 15:43:51 (5372): No heartbeat from core client for 30 sec - exiting 15:43:52 (5372): No heartbeat from core client for 30 sec - exiting 15:43:53 (5372): No heartbeat from core client for 30 sec - exiting 15:43:54 (5372): No heartbeat from core client for 30 sec - exiting 15:43:55 (5372): No heartbeat from core client for 30 sec - exiting 15:43:56 (5372): No heartbeat from core client for 30 sec - exiting 15:43:57 (5372): No heartbeat from core client for 30 sec - exiting 15:43:58 (5372): No heartbeat from core client for 30 sec - exiting 15:43:59 (5372): No heartbeat from core client for 30 sec - exiting 15:44:00 (5372): No heartbeat from core client for 30 sec - exiting 15:44:01 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:15:44 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7208, iMonCtr=2 21:24:48 (5484): No heartbeat from core client for 30 sec - exiting 21:24:49 (5484): No heartbeat from core client for 30 sec - exiting 21:24:50 (5484): No heartbeat from core client for 30 sec - exiting 21:24:51 (5484): No heartbeat from core client for 30 sec - exiting 21:24:52 (5484): No heartbeat from core client for 30 sec - exiting 21:24:53 (5484): No heartbeat from core client for 30 sec - exiting 21:24:54 (5484): No heartbeat from core client for 30 sec - exiting 21:24:55 (5484): No heartbeat from core client for 30 sec - exiting 21:24:56 (5484): No heartbeat from core client for 30 sec - exiting 21:24:57 (5484): No heartbeat from core client for 30 sec - exiting 21:24:58 (5484): No heartbeat from core client for 30 sec - exiting 21:24:59 (5484): No heartbeat from core client for 30 sec - exiting 21:25:00 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:54:32 (4340): No heartbeat from core client for 30 sec - exiting 15:54:34 (4340): No heartbeat from core client for 30 sec - exiting 15:54:35 (4340): No heartbeat from core client for 30 sec - exiting 15:54:36 (4340): No heartbeat from core client for 30 sec - exiting 15:54:37 (4340): No heartbeat from core client for 30 sec - exiting 15:54:38 (4340): No heartbeat from core client for 30 sec - exiting 15:54:39 (4340): No heartbeat from core client for 30 sec - exiting 15:54:40 (4340): No heartbeat from core client for 30 sec - exiting 15:54:41 (4340): No heartbeat from core client for 30 sec - exiting 15:54:42 (4340): No heartbeat from core client for 30 sec - exiting 15:54:43 (4340): No heartbeat from core client for 30 sec - exiting 15:54:44 (4340): No heartbeat from core client for 30 sec - exiting 15:54:45 (4340): No heartbeat from core client for 30 sec - exiting 15:54:46 (4340): No heartbeat from core client for 30 sec - exiting 15:54:47 (4340): No heartbeat from core client for 30 sec - exiting 15:54:48 (4340): No heartbeat from core client for 30 sec - exiting 15:54:49 (4340): No heartbeat from core client for 30 sec - exiting 15:54:50 (4340): No heartbeat from core client for 30 sec - exiting 15:54:51 (4340): No heartbeat from core client for 30 sec - exiting 15:54:52 (4340): No heartbeat from core client for 30 sec - exiting 15:54:53 (4340): No heartbeat from core client for 30 sec - exiting 15:54:54 (4340): No heartbeat from core client for 30 sec - exiting 15:54:55 (4340): No heartbeat from core client for 30 sec - exiting 15:54:56 (4340): No heartbeat from core client for 30 sec - exiting 15:54:57 (4340): No heartbeat from core client for 30 sec - exiting 15:54:58 (4340): No heartbeat from core client for 30 sec - exiting 15:54:59 (4340): No heartbeat from core client for 30 sec - exiting 15:55:00 (4340): No heartbeat from core client for 30 sec - exiting 15:55:01 (4340): No heartbeat from core client for 30 sec - exiting 15:55:02 (4340): No heartbeat from core client for 30 sec - exiting 15:55:03 (4340): No heartbeat from core client for 30 sec - exiting 15:55:04 (4340): No heartbeat from core client for 30 sec - exiting 15:55:05 (4340): No heartbeat from core client for 30 sec - exiting 15:55:06 (4340): No heartbeat from core client for 30 sec - exiting 15:55:07 (4340): No heartbeat from core client for 30 sec - exiting 15:55:08 (4340): No heartbeat from core client for 30 sec - exiting 15:55:09 (4340): No heartbeat from core client for 30 sec - exiting 15:55:10 (4340): No heartbeat from core client for 30 sec - exiting 15:55:11 (4340): No heartbeat from core client for 30 sec - exiting 15:55:12 (4340): No heartbeat from core client for 30 sec - exiting 15:55:13 (4340): No heartbeat from core client for 30 sec - exiting 15:55:14 (4340): No heartbeat from core client for 30 sec - exiting 15:55:15 (4340): No heartbeat from core client for 30 sec - exiting 15:55:16 (4340): No heartbeat from core client for 30 sec - exiting 15:55:17 (4340): No heartbeat from core client for 30 sec - exiting 15:55:18 (4340): No heartbeat from core client for 30 sec - exiting 15:55:19 (4340): No heartbeat from core client for 30 sec - exiting 15:55:20 (4340): No heartbeat from core client for 30 sec - exiting 15:55:21 (4340): No heartbeat from core client for 30 sec - exiting 15:55:22 (4340): No heartbeat from core client for 30 sec - exiting 15:55:23 (4340): No heartbeat from core client for 30 sec - exiting 15:55:24 (4340): No heartbeat from core client for 30 sec - exiting 15:55:25 (4340): No heartbeat from core client for 30 sec - exiting 15:55:26 (4340): No heartbeat from core client for 30 sec - exiting 15:55:27 (4340): No heartbeat from core client for 30 sec - exiting 15:55:28 (4340): No heartbeat from core client for 30 sec - exiting 15:55:29 (4340): No heartbeat from core client for 30 sec - exiting 15:55:30 (4340): No heartbeat from core client for 30 sec - exiting 15:55:31 (4340): No heartbeat from core client for 30 sec - exiting 15:55:32 (4340): No heartbeat from core client for 30 sec - exiting 15:55:33 (4340): No heartbeat from core client for 30 sec - exiting 15:55:34 (4340): No heartbeat from core client for 30 sec - exiting 15:55:35 (4340): No heartbeat from core client for 30 sec - exiting 15:55:36 (4340): No heartbeat from core client for 30 sec - exiting 15:55:37 (4340): No heartbeat from core client for 30 sec - exiting 15:55:38 (4340): No heartbeat from core client for 30 sec - exiting 15:55:39 (4340): No heartbeat from core client for 30 sec - exiting 15:55:40 (4340): No heartbeat from core client for 30 sec - exiting 15:55:41 (4340): No heartbeat from core client for 30 sec - exiting 15:55:42 (4340): No heartbeat from core client for 30 sec - exiting 15:55:43 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:00:07 (3548): No heartbeat from core client for 30 sec - exiting 19:00:08 (3548): No heartbeat from core client for 30 sec - exiting 19:00:09 (3548): No heartbeat from core client for 30 sec - exiting 19:00:10 (3548): No heartbeat from core client for 30 sec - exiting 19:00:12 (3548): No heartbeat from core client for 30 sec - exiting 19:00:13 (3548): No heartbeat from core client for 30 sec - exiting 19:00:14 (3548): No heartbeat from core client for 30 sec - exiting 19:00:15 (3548): No heartbeat from core client for 30 sec - exiting 19:00:16 (3548): No heartbeat from core client for 30 sec - exiting 19:00:17 (3548): No heartbeat from core client for 30 sec - exiting 19:00:18 (3548): No heartbeat from core client for 30 sec - exiting 19:00:19 (3548): No heartbeat from core client for 30 sec - exiting 19:00:20 (3548): No heartbeat from core client for 30 sec - exiting 19:00:21 (3548): No heartbeat from core client for 30 sec - exiting 19:00:22 (3548): No heartbeat from core client for 30 sec - exiting 19:00:24 (3548): No heartbeat from core client for 30 sec - exiting 19:00:25 (3548): No heartbeat from core client for 30 sec - exiting 19:00:26 (3548): No heartbeat from core client for 30 sec - exiting 19:00:27 (3548): No heartbeat from core client for 30 sec - exiting 19:00:28 (3548): No heartbeat from core client for 30 sec - exiting 19:00:29 (3548): No heartbeat from core client for 30 sec - exiting 19:00:30 (3548): No heartbeat from core client for 30 sec - exiting 19:00:31 (3548): No heartbeat from core client for 30 sec - exiting 19:00:32 (3548): No heartbeat from core client for 30 sec - exiting 19:00:33 (3548): No heartbeat from core client for 30 sec - exiting 19:00:34 (3548): No heartbeat from core client for 30 sec - exiting 19:00:36 (3548): No heartbeat from core client for 30 sec - exiting 19:00:37 (3548): No heartbeat from core client for 30 sec - exiting 19:00:38 (3548): No heartbeat from core client for 30 sec - exiting 19:00:39 (3548): No heartbeat from core client for 30 sec - exiting 19:00:40 (3548): No heartbeat from core client for 30 sec - exiting 19:00:41 (3548): No heartbeat from core client for 30 sec - exiting 19:00:42 (3548): No heartbeat from core client for 30 sec - exiting 19:00:43 (3548): No heartbeat from core client for 30 sec - exiting 19:00:44 (3548): No heartbeat from core client for 30 sec - exiting 19:00:45 (3548): No heartbeat from core client for 30 sec - exiting 19:00:46 (3548): No heartbeat from core client for 30 sec - exiting 19:00:48 (3548): No heartbeat from core client for 30 sec - exiting 19:00:49 (3548): No heartbeat from core client for 30 sec - exiting 19:00:50 (3548): No heartbeat from core client for 30 sec - exiting 19:00:51 (3548): No heartbeat from core client for 30 sec - exiting 19:00:52 (3548): No heartbeat from core client for 30 sec - exiting 19:00:53 (3548): No heartbeat from core client for 30 sec - exiting 19:00:54 (3548): No heartbeat from core client for 30 sec - exiting 19:00:55 (3548): No heartbeat from core client for 30 sec - exiting 19:00:56 (3548): No heartbeat from core client for 30 sec - exiting 19:00:57 (3548): No heartbeat from core client for 30 sec - exiting 19:00:58 (3548): No heartbeat from core client for 30 sec - exiting 19:00:59 (3548): No heartbeat from core client for 30 sec - exiting 19:01:00 (3548): No heartbeat from core client for 30 sec - exiting 19:01:01 (3548): No heartbeat from core client for 30 sec - exiting 19:01:02 (3548): No heartbeat from core client for 30 sec - exiting 19:01:03 (3548): No heartbeat from core client for 30 sec - exiting 19:01:04 (3548): No heartbeat from core client for 30 sec - exiting 19:01:05 (3548): No heartbeat from core client for 30 sec - exiting 19:01:06 (3548): No heartbeat from core client for 30 sec - exiting 19:01:07 (3548): No heartbeat from core client for 30 sec - exiting 19:01:08 (3548): No heartbeat from core client for 30 sec - exiting 19:01:09 (3548): No heartbeat from core client for 30 sec - exiting 19:01:10 (3548): No heartbeat from core client for 30 sec - exiting 19:01:11 (3548): No heartbeat from core client for 30 sec - exiting 19:01:12 (3548): No heartbeat from core client for 30 sec - exiting 19:01:13 (3548): No heartbeat from core client for 30 sec - exiting 19:01:14 (3548): No heartbeat from core client for 30 sec - exiting 19:01:15 (3548): No heartbeat from core client for 30 sec - exiting 19:01:16 (3548): No heartbeat from core client for 30 sec - exiting 19:01:17 (3548): No heartbeat from core client for 30 sec - exiting 19:01:18 (3548): No heartbeat from core client for 30 sec - exiting 19:01:19 (3548): No heartbeat from core client for 30 sec - exiting 19:01:20 (3548): No heartbeat from core client for 30 sec - exiting 19:01:21 (3548): No heartbeat from core client for 30 sec - exiting 19:01:22 (3548): No heartbeat from core client for 30 sec - exiting 19:01:23 (3548): No heartbeat from core client for 30 sec - exiting 19:01:24 (3548): No heartbeat from core client for 30 sec - exiting 19:01:25 (3548): No heartbeat from core client for 30 sec - exiting 19:01:26 (3548): No heartbeat from core client for 30 sec - exiting 19:01:27 (3548): No heartbeat from core client for 30 sec - exiting 19:01:28 (3548): No heartbeat from core client for 30 sec - exiting 19:01:29 (3548): No heartbeat from core client for 30 sec - exiting 19:01:30 (3548): No heartbeat from core client for 30 sec - exiting 19:01:31 (3548): No heartbeat from core client for 30 sec - exiting 19:01:32 (3548): No heartbeat from core client for 30 sec - exiting 19:01:33 (3548): No heartbeat from core client for 30 sec - exiting 19:01:34 (3548): No heartbeat from core client for 30 sec - exiting 19:01:35 (3548): No heartbeat from core client for 30 sec - exiting 19:01:36 (3548): No heartbeat from core client for 30 sec - exiting 19:01:37 (3548): No heartbeat from core client for 30 sec - exiting 19:01:38 (3548): No heartbeat from core client for 30 sec - exiting 19:01:39 (3548): No heartbeat from core client for 30 sec - exiting 19:01:40 (3548): No heartbeat from core client for 30 sec - exiting 19:01:41 (3548): No heartbeat from core client for 30 sec - exiting 19:01:42 (3548): No heartbeat from core client for 30 sec - exiting 19:01:43 (3548): No heartbeat from core client for 30 sec - exiting 19:02:37 (3548): No heartbeat from core client for 30 sec - exiting 19:02:38 (3548): No heartbeat from core client for 30 sec - exiting 19:02:39 (3548): No heartbeat from core client for 30 sec - exiting 19:02:40 (3548): No heartbeat from core client for 30 sec - exiting 19:02:41 (3548): No heartbeat from core client for 30 sec - exiting 19:02:42 (3548): No heartbeat from core client for 30 sec - exiting 19:02:43 (3548): No heartbeat from core client for 30 sec - exiting 19:02:44 (3548): No heartbeat from core client for 30 sec - exiting 19:02:45 (3548): No heartbeat from core client for 30 sec - exiting 19:02:46 (3548): No heartbeat from core client for 30 sec - exiting 19:02:47 (3548): No heartbeat from core client for 30 sec - exiting 19:02:48 (3548): No heartbeat from core client for 30 sec - exiting 19:02:49 (3548): No heartbeat from core client for 30 sec - exiting 19:02:50 (3548): No heartbeat from core client for 30 sec - exiting 19:02:51 (3548): No heartbeat from core client for 30 sec - exiting 19:02:52 (3548): No heartbeat from core client for 30 sec - exiting 19:02:53 (3548): No heartbeat from core client for 30 sec - exiting 19:02:54 (3548): No heartbeat from core client for 30 sec - exiting 19:02:55 (3548): No heartbeat from core client for 30 sec - exiting 19:02:56 (3548): No heartbeat from core client for 30 sec - exiting 19:02:57 (3548): No heartbeat from core client for 30 sec - exiting 19:02:58 (3548): No heartbeat from core client for 30 sec - exiting 19:02:59 (3548): No heartbeat from core client for 30 sec - exiting 19:03:00 (3548): No heartbeat from core client for 30 sec - exiting 19:03:01 (3548): No heartbeat from core client for 30 sec - exiting 19:03:02 (3548): No heartbeat from core client for 30 sec - exiting 19:03:03 (3548): No heartbeat from core client for 30 sec - exiting 19:03:04 (3548): No heartbeat from core client for 30 sec - exiting 19:03:05 (3548): No heartbeat from core client for 30 sec - exiting 19:03:06 (3548): No heartbeat from core client for 30 sec - exiting 19:03:07 (3548): No heartbeat from core client for 30 sec - exiting 19:03:08 (3548): No heartbeat from core client for 30 sec - exiting 19:03:09 (3548): No heartbeat from core client for 30 sec - exiting 19:03:10 (3548): No heartbeat from core client for 30 sec - exiting 19:03:11 (3548): No heartbeat from core client for 30 sec - exiting 19:03:12 (3548): No heartbeat from core client for 30 sec - exiting 19:03:13 (3548): No heartbeat from core client for 30 sec - exiting 19:03:14 (3548): No heartbeat from core client for 30 sec - exiting 19:03:15 (3548): No heartbeat from core client for 30 sec - exiting 19:03:16 (3548): No heartbeat from core client for 30 sec - exiting 19:03:17 (3548): No heartbeat from core client for 30 sec - exiting 19:03:18 (3548): No heartbeat from core client for 30 sec - exiting 19:03:19 (3548): No heartbeat from core client for 30 sec - exiting 19:03:20 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4808, selfPID=3244, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_33gn_1985_1_008145178_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_33gn_1985_1_008145178_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_33gn_1985_1_008145178_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_33gn_1985_1_008145178_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_33gn_1985_1_008145178_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_33gn_1985_1_008145178_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Sep 2012 19:32:31	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	69,223	200,111	2.8908
12 Sep 2012 18:20:08	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	69,216	199,750	2.8859
08 Sep 2012 13:47:53	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	57,699	166,361	2.8833
07 Sep 2012 21:43:28	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	57,696	165,955	2.8764
04 Sep 2012 17:07:30	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	46,179	132,214	2.8631
04 Sep 2012 13:12:05	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	46,176	131,863	2.8557
30 Aug 2012 18:28:21	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	34,656	100,067	2.8874
27 Aug 2012 20:32:26	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	23,136	67,484	2.9168
24 Aug 2012 20:56:51	1170350	15118763	hadam3p_pnw_33gn_1985_1_008145178_0	11,616	33,931	2.9211