Task 15400267

Name	hadcm3n_o4e8_2060_40_008239523_1
Workunit	8394647
Created	26 Oct 2012, 17:58:28 UTC
Sent	26 Oct 2012, 17:58:46 UTC
Report deadline	26 Jan 2013, 1:25:57 UTC
Received	7 Apr 2013, 2:27:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1184653
Run time	19 days 11 hours 8 min 57 sec
CPU time	19 days 11 hours 8 min 57 sec
Validate state	Invalid
Credit	8,709.12
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.4.5</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> pend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:02:15 (5372): No heartbeat from core client for 30 sec - exiting 10:02:16 (5372): No heartbeat from core client for 30 sec - exiting 10:02:17 (5372): No heartbeat from core client for 30 sec - exiting 10:02:18 (5372): No heartbeat from core client for 30 sec - exiting 10:02:19 (5372): No heartbeat from core client for 30 sec - exiting 10:02:20 (5372): No heartbeat from core client for 30 sec - exiting 10:02:21 (5372): No heartbeat from core client for 30 sec - exiting 10:02:22 (5372): No heartbeat from core client for 30 sec - exiting 10:02:23 (5372): No heartbeat from core client for 30 sec - exiting 10:02:24 (5372): No heartbeat from core client for 30 sec - exiting 10:02:25 (5372): No heartbeat from core client for 30 sec - exiting 10:02:26 (5372): No heartbeat from core client for 30 sec - exiting 10:02:27 (5372): No heartbeat from core client for 30 sec - exiting 10:02:28 (5372): No heartbeat from core client for 30 sec - exiting 10:02:29 (5372): No heartbeat from core client for 30 sec - exiting 10:02:30 (5372): No heartbeat from core client for 30 sec - exiting 10:02:31 (5372): No heartbeat from core client for 30 sec - exiting 10:02:32 (5372): No heartbeat from core client for 30 sec - exiting 10:02:33 (5372): No heartbeat from core client for 30 sec - exiting 10:02:34 (5372): No heartbeat from core client for 30 sec - exiting 10:02:35 (5372): No heartbeat from core client for 30 sec - exiting 10:02:36 (5372): No heartbeat from core client for 30 sec - exiting 10:02:38 (5372): No heartbeat from core client for 30 sec - exiting 10:02:39 (5372): No heartbeat from core client for 30 sec - exiting 10:02:40 (5372): No heartbeat from core client for 30 sec - exiting 10:02:41 (5372): No heartbeat from core client for 30 sec - exiting 10:02:42 (5372): No heartbeat from core client for 30 sec - exiting 10:02:43 (5372): No heartbeat from core client for 30 sec - exiting 10:02:44 (5372): No heartbeat from core client for 30 sec - exiting 10:02:45 (5372): No heartbeat from core client for 30 sec - exiting 10:02:46 (5372): No heartbeat from core client for 30 sec - exiting 10:02:47 (5372): No heartbeat from core client for 30 sec - exiting 10:02:48 (5372): No heartbeat from core client for 30 sec - exiting 10:02:49 (5372): No heartbeat from core client for 30 sec - exiting 10:02:50 (5372): No heartbeat from core client for 30 sec - exiting 10:02:51 (5372): No heartbeat from core client for 30 sec - exiting 10:02:52 (5372): No heartbeat from core client for 30 sec - exiting 10:02:53 (5372): No heartbeat from core client for 30 sec - exiting 10:02:54 (5372): No heartbeat from core client for 30 sec - exiting 10:02:55 (5372): No heartbeat from core client for 30 sec - exiting 10:02:56 (5372): No heartbeat from core client for 30 sec - exiting 10:02:57 (5372): No heartbeat from core client for 30 sec - exiting 10:02:58 (5372): No heartbeat from core client for 30 sec - exiting 10:02:59 (5372): No heartbeat from core client for 30 sec - exiting 10:03:00 (5372): No heartbeat from core client for 30 sec - exiting 10:03:01 (5372): No heartbeat from core client for 30 sec - exiting 10:03:02 (5372): No heartbeat from core client for 30 sec - exiting 10:03:03 (5372): No heartbeat from core client for 30 sec - exiting 10:03:04 (5372): No heartbeat from core client for 30 sec - exiting 10:03:05 (5372): No heartbeat from core client for 30 sec - exiting 10:03:06 (5372): No heartbeat from core client for 30 sec - exiting 10:03:07 (5372): No heartbeat from core client for 30 sec - exiting 10:03:08 (5372): No heartbeat from core client for 30 sec - exiting 10:03:09 (5372): No heartbeat from core client for 30 sec - exiting 10:03:10 (5372): No heartbeat from core client for 30 sec - exiting 10:03:11 (5372): No heartbeat from core client for 30 sec - exiting 10:03:12 (5372): No heartbeat from core client for 30 sec - exiting 10:03:13 (5372): No heartbeat from core client for 30 sec - exiting 10:03:14 (5372): No heartbeat from core client for 30 sec - exiting 10:03:15 (5372): No heartbeat from core client for 30 sec - exiting 10:03:16 (5372): No heartbeat from core client for 30 sec - exiting 10:03:17 (5372): No heartbeat from core client for 30 sec - exiting 10:03:18 (5372): No heartbeat from core client for 30 sec - exiting 10:03:19 (5372): No heartbeat from core client for 30 sec - exiting 10:03:20 (5372): No heartbeat from core client for 30 sec - exiting 10:03:21 (5372): No heartbeat from core client for 30 sec - exiting 10:03:22 (5372): No heartbeat from core client for 30 sec - exiting 10:03:23 (5372): No heartbeat from core client for 30 sec - exiting 10:03:24 (5372): No heartbeat from core client for 30 sec - exiting 10:03:25 (5372): No heartbeat from core client for 30 sec - exiting 10:03:26 (5372): No heartbeat from core client for 30 sec - exiting 10:03:27 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:21:57 (4308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:22:04 (4308): No heartbeat from core client for 30 sec - exiting 11:22:05 (4308): No heartbeat from core client for 30 sec - exiting 11:22:06 (4308): No heartbeat from core client for 30 sec - exiting 11:22:07 (4308): No heartbeat from core client for 30 sec - exiting 11:22:08 (4308): No heartbeat from core client for 30 sec - exiting 11:22:09 (4308): No heartbeat from core client for 30 sec - exiting 11:22:10 (4308): No heartbeat from core client for 30 sec - exiting 11:22:11 (4308): No heartbeat from core client for 30 sec - exiting 11:22:12 (4308): No heartbeat from core client for 30 sec - exiting 11:22:13 (4308): No heartbeat from core client for 30 sec - exiting 11:22:14 (4308): No heartbeat from core client for 30 sec - exiting 11:22:15 (4308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:52:46 (5976): No heartbeat from core client for 30 sec - exiting 11:52:47 (5976): No heartbeat from core client for 30 sec - exiting 11:52:48 (5976): No heartbeat from core client for 30 sec - exiting 11:52:49 (5976): No heartbeat from core client for 30 sec - exiting 11:52:50 (5976): No heartbeat from core client for 30 sec - exiting 11:52:51 (5976): No heartbeat from core client for 30 sec - exiting 11:52:52 (5976): No heartbeat from core client for 30 sec - exiting 11:52:53 (5976): No heartbeat from core client for 30 sec - exiting 11:52:54 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:55 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:03 (4852): No heartbeat from core client for 30 sec - exiting 16:17:04 (4852): No heartbeat from core client for 30 sec - exiting 16:17:05 (4852): No heartbeat from core client for 30 sec - exiting 16:17:06 (4852): No heartbeat from core client for 30 sec - exiting 16:17:07 (4852): No heartbeat from core client for 30 sec - exiting 16:17:11 (4852): No heartbeat from core client for 30 sec - exiting 16:17:12 (4852): No heartbeat from core client for 30 sec - exiting 16:17:13 (4852): No heartbeat from core client for 30 sec - exiting 16:17:14 (4852): No heartbeat from core client for 30 sec - exiting 16:17:15 (4852): No heartbeat from core client for 30 sec - exiting 16:31:36 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:47 (5812): No heartbeat from core client for 30 sec - exiting 16:31:49 (5812): No heartbeat from core client for 30 sec - exiting 16:31:50 (5812): No heartbeat from core client for 30 sec - exiting 16:31:51 (5812): No heartbeat from core client for 30 sec - exiting 16:31:52 (5812): No heartbeat from core client for 30 sec - exiting 16:31:53 (5812): No heartbeat from core client for 30 sec - exiting 16:31:54 (5812): No heartbeat from core client for 30 sec - exiting 16:31:55 (5812): No heartbeat from core client for 30 sec - exiting 16:31:56 (5812): No heartbeat from core client for 30 sec - exiting 16:31:57 (5812): No heartbeat from core client for 30 sec - exiting 16:31:58 (5812): No heartbeat from core client for 30 sec - exiting 16:31:59 (5812): No heartbeat from core client for 30 sec - exiting 16:32:00 (5812): No heartbeat from core client for 30 sec - exiting 16:32:01 (5812): No heartbeat from core client for 30 sec - exiting 16:32:02 (5812): No heartbeat from core client for 30 sec - exiting 16:32:03 (5812): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4776, iMonCtr=1 Model crash detected, will try to restart... 17:31:12 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:31:13 (2288): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 18:01:48 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:01 (4516): No heartbeat from core client for 30 sec - exiting 18:03:02 (4516): No heartbeat from core client for 30 sec - exiting 18:03:03 (4516): No heartbeat from core client for 30 sec - exiting 18:13:36 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:39 (3796): No heartbeat from core client for 30 sec - exiting 18:13:40 (3796): No heartbeat from core client for 30 sec - exiting 18:13:41 (3796): No heartbeat from core client for 30 sec - exiting 18:13:42 (3796): No heartbeat from core client for 30 sec - exiting 18:13:43 (3796): No heartbeat from core client for 30 sec - exiting 18:13:44 (3796): No heartbeat from core client for 30 sec - exiting 18:13:45 (3796): No heartbeat from core client for 30 sec - exiting 18:13:46 (3796): No heartbeat from core client for 30 sec - exiting 18:13:47 (3796): No heartbeat from core client for 30 sec - exiting 18:13:48 (3796): No heartbeat from core client for 30 sec - exiting 18:38:15 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:16 (5884): No heartbeat from core client for 30 sec - exiting 18:38:17 (5884): No heartbeat from core client for 30 sec - exiting 18:47:15 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:16 (3764): No heartbeat from core client for 30 sec - exiting 18:55:32 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:00 (3540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:03 (3540): No heartbeat from core client for 30 sec - exiting 19:17:04 (3540): No heartbeat from core client for 30 sec - exiting 19:17:05 (3540): No heartbeat from core client for 30 sec - exiting 19:17:06 (3540): No heartbeat from core client for 30 sec - exiting 19:17:07 (3540): No heartbeat from core client for 30 sec - exiting 19:17:08 (3540): No heartbeat from core client for 30 sec - exiting 19:17:09 (3540): No heartbeat from core client for 30 sec - exiting 19:17:10 (3540): No heartbeat from core client for 30 sec - exiting 19:17:12 (3540): No heartbeat from core client for 30 sec - exiting 19:17:13 (3540): No heartbeat from core client for 30 sec - exiting 19:17:14 (3540): No heartbeat from core client for 30 sec - exiting 19:27:08 (584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:11 (584): No heartbeat from core client for 30 sec - exiting 19:27:12 (584): No heartbeat from core client for 30 sec - exiting 19:27:13 (584): No heartbeat from core client for 30 sec - exiting 19:27:14 (584): No heartbeat from core client for 30 sec - exiting 19:27:15 (584): No heartbeat from core client for 30 sec - exiting 19:27:16 (584): No heartbeat from core client for 30 sec - exiting 19:27:17 (584): No heartbeat from core client for 30 sec - exiting 19:27:18 (584): No heartbeat from core client for 30 sec - exiting 19:27:19 (584): No heartbeat from core client for 30 sec - exiting 19:27:20 (584): No heartbeat from core client for 30 sec - exiting 19:27:21 (584): No heartbeat from core client for 30 sec - exiting 19:27:22 (584): No heartbeat from core client for 30 sec - exiting 19:27:23 (584): No heartbeat from core client for 30 sec - exiting 19:27:24 (584): No heartbeat from core client for 30 sec - exiting 19:27:25 (584): No heartbeat from core client for 30 sec - exiting 19:53:56 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:57 (3260): No heartbeat from core client for 30 sec - exiting 19:53:58 (3260): No heartbeat from core client for 30 sec - exiting 19:53:59 (3260): No heartbeat from core client for 30 sec - exiting 20:12:33 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:11 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:27 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:37 (5016): No heartbeat from core client for 30 sec - exiting 20:34:38 (5016): No heartbeat from core client for 30 sec - exiting 20:34:40 (5016): No heartbeat from core client for 30 sec - exiting 20:34:42 (5016): No heartbeat from core client for 30 sec - exiting 20:34:43 (5016): No heartbeat from core client for 30 sec - exiting 20:34:44 (5016): No heartbeat from core client for 30 sec - exiting 20:34:45 (5016): No heartbeat from core client for 30 sec - exiting 20:34:46 (5016): No heartbeat from core client for 30 sec - exiting 20:34:47 (5016): No heartbeat from core client for 30 sec - exiting 20:34:48 (5016): No heartbeat from core client for 30 sec - exiting 20:34:49 (5016): No heartbeat from core client for 30 sec - exiting 20:34:50 (5016): No heartbeat from core client for 30 sec - exiting 20:34:51 (5016): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=1 Model crash detected, will try to restart... 16:53:45 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:46 (4280): No heartbeat from core client for 30 sec - exiting 16:53:47 (4280): No heartbeat from core client for 30 sec - exiting 17:05:55 (628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:57 (628): No heartbeat from core client for 30 sec - exiting 17:05:58 (628): No heartbeat from core client for 30 sec - exiting 17:05:59 (628): No heartbeat from core client for 30 sec - exiting 17:15:43 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:45 (5840): No heartbeat from core client for 30 sec - exiting 17:15:46 (5840): No heartbeat from core client for 30 sec - exiting 17:15:47 (5840): No heartbeat from core client for 30 sec - exiting 17:15:48 (5840): No heartbeat from core client for 30 sec - exiting 17:42:15 (5600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:18 (5600): No heartbeat from core client for 30 sec - exiting 17:42:19 (5600): No heartbeat from core client for 30 sec - exiting 17:42:20 (5600): No heartbeat from core client for 30 sec - exiting 17:42:21 (5600): No heartbeat from core client for 30 sec - exiting 17:53:42 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:49 (4276): No heartbeat from core client for 30 sec - exiting 17:53:50 (4276): No heartbeat from core client for 30 sec - exiting 17:53:51 (4276): No heartbeat from core client for 30 sec - exiting 17:53:52 (4276): No heartbeat from core client for 30 sec - exiting 17:53:53 (4276): No heartbeat from core client for 30 sec - exiting 17:53:54 (4276): No heartbeat from core client for 30 sec - exiting 17:53:55 (4276): No heartbeat from core client for 30 sec - exiting 17:53:56 (4276): No heartbeat from core client for 30 sec - exiting 17:53:57 (4276): No heartbeat from core client for 30 sec - exiting 17:53:58 (4276): No heartbeat from core client for 30 sec - exiting 07:43:44 (3460): No heartbeat from core client for 30 sec - exiting 07:43:48 (3460): No heartbeat from core client for 30 sec - exiting 07:43:49 (3460): No heartbeat from core client for 30 sec - exiting 07:43:50 (3460): No heartbeat from core client for 30 sec - exiting 07:43:51 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:52 (3460): No heartbeat from core client for 30 sec - exiting 07:43:53 (3460): No heartbeat from core client for 30 sec - exiting 07:43:54 (3460): No heartbeat from core client for 30 sec - exiting 07:43:55 (3460): No heartbeat from core client for 30 sec - exiting 07:43:56 (3460): No heartbeat from core client for 30 sec - exiting 07:43:57 (3460): No heartbeat from core client for 30 sec - exiting 16:08:04 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:34 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:35 (3496): No heartbeat from core client for 30 sec - exiting 16:31:36 (3496): No heartbeat from core client for 30 sec - exiting 16:47:46 (1844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:47 (1844): No heartbeat from core client for 30 sec - exiting 16:56:58 (3392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:59 (3392): No heartbeat from core client for 30 sec - exiting 17:05:51 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:58 (4072): No heartbeat from core client for 30 sec - exiting 17:05:59 (4072): No heartbeat from core client for 30 sec - exiting 17:06:00 (4072): No heartbeat from core client for 30 sec - exiting 17:06:01 (4072): No heartbeat from core client for 30 sec - exiting 17:06:03 (4072): No heartbeat from core client for 30 sec - exiting 17:06:04 (4072): No heartbeat from core client for 30 sec - exiting 17:06:07 (4072): No heartbeat from core client for 30 sec - exiting 17:06:09 (4072): No heartbeat from core client for 30 sec - exiting 18:05:49 (5800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:51 (5800): No heartbeat from core client for 30 sec - exiting 18:05:52 (5800): No heartbeat from core client for 30 sec - exiting 18:05:53 (5800): No heartbeat from core client for 30 sec - exiting 10:06:40 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:41 (5200): No heartbeat from core client for 30 sec - exiting 10:06:42 (5200): No heartbeat from core client for 30 sec - exiting 10:16:54 (3540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:56 (3540): No heartbeat from core client for 30 sec - exiting 10:16:57 (3540): No heartbeat from core client for 30 sec - exiting 10:16:58 (3540): No heartbeat from core client for 30 sec - exiting 10:27:43 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:45 (3500): No heartbeat from core client for 30 sec - exiting 10:27:46 (3500): No heartbeat from core client for 30 sec - exiting 10:27:47 (3500): No heartbeat from core client for 30 sec - exiting 10:39:39 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:41 (1680): No heartbeat from core client for 30 sec - exiting 10:39:42 (1680): No heartbeat from core client for 30 sec - exiting 10:39:43 (1680): No heartbeat from core client for 30 sec - exiting 10:39:44 (1680): No heartbeat from core client for 30 sec - exiting 10:39:45 (1680): No heartbeat from core client for 30 sec - exiting 10:49:22 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:24 (5900): No heartbeat from core client for 30 sec - exiting 10:49:25 (5900): No heartbeat from core client for 30 sec - exiting 10:49:26 (5900): No heartbeat from core client for 30 sec - exiting 10:49:27 (5900): No heartbeat from core client for 30 sec - exiting 10:49:28 (5900): No heartbeat from core client for 30 sec - exiting 10:58:33 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:36 (5132): No heartbeat from core client for 30 sec - exiting 10:58:37 (5132): No heartbeat from core client for 30 sec - exiting 10:58:38 (5132): No heartbeat from core client for 30 sec - exiting 11:07:44 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:07:54 (3060): No heartbeat from core client for 30 sec - exiting 11:07:55 (3060): No heartbeat from core client for 30 sec - exiting 11:07:56 (3060): No heartbeat from core client for 30 sec - exiting 11:07:57 (3060): No heartbeat from core client for 30 sec - exiting 11:07:59 (3060): No heartbeat from core client for 30 sec - exiting 11:08:00 (3060): No heartbeat from core client for 30 sec - exiting 11:08:01 (3060): No heartbeat from core client for 30 sec - exiting 11:08:02 (3060): No heartbeat from core client for 30 sec - exiting 11:08:04 (3060): No heartbeat from core client for 30 sec - exiting 11:08:05 (3060): No heartbeat from core client for 30 sec - exiting 11:08:06 (3060): No heartbeat from core client for 30 sec - exiting 11:08:07 (3060): No heartbeat from core client for 30 sec - exiting 11:08:08 (3060): No heartbeat from core client for 30 sec - exiting 11:08:09 (3060): No heartbeat from core client for 30 sec - exiting 11:08:10 (3060): No heartbeat from core client for 30 sec - exiting 11:20:35 (5652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:39 (5652): No heartbeat from core client for 30 sec - exiting 11:20:40 (5652): No heartbeat from core client for 30 sec - exiting 11:20:41 (5652): No heartbeat from core client for 30 sec - exiting 11:20:42 (5652): No heartbeat from core client for 30 sec - exiting 11:20:43 (5652): No heartbeat from core client for 30 sec - exiting 11:31:05 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:11 (6020): No heartbeat from core client for 30 sec - exiting 11:31:12 (6020): No heartbeat from core client for 30 sec - exiting 11:31:13 (6020): No heartbeat from core client for 30 sec - exiting 11:31:14 (6020): No heartbeat from core client for 30 sec - exiting 11:31:15 (6020): No heartbeat from core client for 30 sec - exiting 11:31:16 (6020): No heartbeat from core client for 30 sec - exiting 11:31:17 (6020): No heartbeat from core client for 30 sec - exiting 11:31:18 (6020): No heartbeat from core client for 30 sec - exiting 11:31:19 (6020): No heartbeat from core client for 30 sec - exiting 11:41:41 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:50 (4168): No heartbeat from core client for 30 sec - exiting 11:41:51 (4168): No heartbeat from core client for 30 sec - exiting 11:41:57 (4168): No heartbeat from core client for 30 sec - exiting 11:41:58 (4168): No heartbeat from core client for 30 sec - exiting 11:41:59 (4168): No heartbeat from core client for 30 sec - exiting 11:42:00 (4168): No heartbeat from core client for 30 sec - exiting 11:42:02 (4168): No heartbeat from core client for 30 sec - exiting 11:42:03 (4168): No heartbeat from core client for 30 sec - exiting 11:42:04 (4168):11:52:57 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:59 (3644): No heartbeat from core client for 30 sec - exiting 11:53:00 (3644): No heartbeat from core client for 30 sec - exiting 11:53:01 (3644): No heartbeat from core client for 30 sec - exiting 12:01:29 (3072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:40 (3072): No heartbeat from core client for 30 sec - exiting 12:01:43 (3072): No heartbeat from core client for 30 sec - exiting 12:01:44 (3072): No heartbeat from core client for 30 sec - exiting 12:01:46 (3072): No heartbeat from core client for 30 sec - exiting 12:01:47 (3072): No heartbeat from core client for 30 sec - exiting 12:01:48 (3072): No heartbeat from core client for 30 sec - exiting 12:01:49 (3072): No heartbeat from core client for 30 sec - exiting 12:01:50 (3072): No heartbeat from core client for 30 sec - exiting 12:01:51 (3072): No heartbeat from core client for 30 sec - exiting 12:01:52 (3072): No heartbeat from core client for 30 sec - exiting 12:01:53 (3072): No heartbeat from core client for 30 sec - exiting 12:14:41 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:14:46 (5148): No heartbeat from core client for 30 sec - exiting 12:14:47 (5148): No heartbeat from core client for 30 sec - exiting 12:14:49 (5148): No heartbeat from core client for 30 sec - exiting 12:14:50 (5148): No heartbeat from core client for 30 sec - exiting 12:14:51 (5148): No heartbeat from core client for 30 sec - exiting 12:14:52 (5148): No heartbeat from core client for 30 sec - exiting 12:14:53 (5148): No heartbeat from core client for 30 sec - exiting 12:24:42 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:48 (5784): No heartbeat from core client for 30 sec - exiting 12:24:50 (5784): No heartbeat from core client for 30 sec - exiting 12:24:51 (5784): No heartbeat from core client for 30 sec - exiting 12:24:52 (5784): No heartbeat from core client for 30 sec - exiting 12:24:54 (5784): No heartbeat from core client for 30 sec - exiting 12:24:55 (5784): No heartbeat from core client for 30 sec - exiting 12:24:56 (5784): No heartbeat from core client for 30 sec - exiting 12:24:57 (5784): No heartbeat from core client for 30 sec - exiting 12:24:58 (5784): No heartbeat from core client for 30 sec - exiting 12:34:44 (1304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:30 (2748): No heartbeat from core client for 30 sec - exiting 12:38:31 (2748): No heartbeat from core client for 30 sec - exiting 12:38:32 (2748): No heartbeat from core client for 30 sec - exiting 12:38:33 (2748): No heartbeat from core client for 30 sec - exiting 12:38:34 (2748): No heartbeat from core client for 30 sec - exiting 12:38:35 (2748): No heartbeat from core client for 30 sec - exiting 12:38:36 (2748): No heartbeat from core client for 30 sec - exiting 12:38:37 (2748): No heartbeat from core client for 30 sec - exiting 12:38:38 (2748): No heartbeat from core client for 30 sec - exiting 12:38:39 (2748): No heartbeat from core client for 30 sec - exiting 12:38:40 (2748): No heartbeat from core client for 30 sec - exiting 12:38:41 (2748): No heartbeat from core client for 30 sec - exiting 12:38:42 (2748): No heartbeat from core client for 30 sec - exiting 12:38:43 (2748): No heartbeat from core client for 30 sec - exiting 12:38:44 (2748): No heartbeat from core client for 30 sec - exiting 12:38:45 (2748): No heartbeat from core client for 30 sec - exiting 12:38:46 (2748): No heartbeat from core client for 30 sec - exiting 12:38:47 (2748): No heartbeat from core client for 30 sec - exiting 12:38:48 (2748): No heartbeat from core client for 30 sec - exiting 12:38:49 (2748): No heartbeat from core client for 30 sec - exiting 12:38:50 (2748): No heartbeat from core client for 30 sec - exiting 12:38:51 (2748): No heartbeat from core client for 30 sec - exiting 12:38:52 (2748): No heartbeat from core client for 30 sec - exiting 12:38:53 (2748): No heartbeat from core client for 30 sec - exiting 12:38:54 (2748): No heartbeat from core client for 30 sec - exiting 12:38:55 (2748): No heartbeat from core client for 30 sec - exiting 12:38:56 (2748): No heartbeat from core client for 30 sec - exiting 12:38:57 (2748): No heartbeat from core client for 30 sec - exiting 12:38:58 (2748): No heartbeat from core client for 30 sec - exiting 12:38:59 (2748): No heartbeat from core client for 30 sec - exiting 12:39:00 (2748): No heartbeat from core client for 30 sec - exiting 12:39:01 (2748): No heartbeat from core client for 30 sec - exiting 12:39:02 (2748): No heartbeat from core client for 30 sec - exiting 12:39:03 (2748): No heartbeat from core client for 30 sec - exiting 12:39:04 (2748): No heartbeat from core client for 30 sec - exiting 12:39:05 (2748): No heartbeat from core client for 30 sec - exiting 12:39:06 (2748): No heartbeat from core client for 30 sec - exiting 12:39:07 (2748): No heartbeat from core client for 30 sec - exiting 12:39:08 (2748): No heartbeat from core client for 30 sec - exiting 12:39:09 (2748): No heartbeat from core client for 30 sec - exiting 12:39:10 (2748): No heartbeat from core client for 30 sec - exiting 12:39:11 (2748): No heartbeat from core client for 30 sec - exiting 12:39:12 (2748): No heartbeat from core client for 30 sec - exiting 12:39:13 (2748): No heartbeat from core client for 30 sec - exiting 12:39:14 (2748): No heartbeat from core client for 30 sec - exiting 12:39:15 (2748): No heartbeat from core client for 30 sec - exiting 12:39:16 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:17 (2748): No heartbeat from core client for 30 sec - exiting 12:46:54 (3784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:57 (3784): No heartbeat from core client for 30 sec - exiting 12:46:58 (3784): No heartbeat from core client for 30 sec - exiting 12:46:59 (3784): No heartbeat from core client for 30 sec - exiting 12:47:00 (3784): No heartbeat from core client for 30 sec - exiting 12:47:01 (3784): No heartbeat from core client for 30 sec - exiting 12:47:02 (3784): No heartbeat from core client for 30 sec - exiting 12:47:03 (3784): No heartbeat from core client for 30 sec - exiting 12:47:08 (3784): No heartbeat from core client for 30 sec - exiting 12:47:09 (3784): No heartbeat from core client for 30 sec - exiting 12:58:00 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:08 (3968): No heartbeat from core client for 30 sec - exiting 12:58:17 (3968): No heartbeat from core client for 30 sec - exiting 12:58:19 (3968): No heartbeat from core client for 30 sec - exiting 12:58:20 (3968): No heartbeat from core client for 30 sec - exiting 12:58:21 (3968): No heartbeat from core client for 30 sec - exiting 12:58:22 (3968): No heartbeat from core client for 30 sec - exiting 12:58:23 (3968): No heartbeat from core client for 30 sec - exiting 12:58:28 (3968): No heartbeat from core client for 30 sec - exiting 12:58:31 (3968): No heartbeat from core client for 30 sec - exiting 12:58:35 (3968): No heartbeat from core client for 30 sec - exiting 12:58:36 (3968): No heartbeat from core client for 30 sec - exiting 12:58:38 (3968): No heartbeat from core client for 30 sec - exiting 12:58:39 (3968): No heartbeat from core client for 30 sec - exiting 12:58:40 (3968):13:11:06 (1568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:11:10 (1568): No heartbeat from core client for 30 sec - exiting 13:11:11 (1568): No heartbeat from core client for 30 sec - exiting 13:11:12 (1568): No heartbeat from core client for 30 sec - exiting 13:11:13 (1568): No heartbeat from core client for 30 sec - exiting 13:11:14 (1568): No heartbeat from core client for 30 sec - exiting 13:11:15 (1568): No heartbeat from core client for 30 sec - exiting 13:11:16 (1568): No heartbeat from core client for 30 sec - exiting 13:11:17 (1568): No heartbeat from core client for 30 sec - exiting 13:11:18 (1568): No heartbeat from core client for 30 sec - exiting 13:11:19 (1568): No heartbeat from core client for 30 sec - exiting 13:11:20 (1568): No heartbeat from core client for 30 sec - exiting 13:11:21 (1568): No heartbeat from core client for 30 sec - exiting 13:24:33 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:45 (3056): No heartbeat from core client for 30 sec - exiting 13:24:46 (3056): No heartbeat from core client for 30 sec - exiting 13:24:50 (3056): No heartbeat from core client for 30 sec - exiting 13:24:52 (3056): No heartbeat from core client for 30 sec - exiting 13:24:54 (3056): No heartbeat from core client for 30 sec - exiting 13:24:56 (3056): No heartbeat from core client for 30 sec - exiting 13:24:58 (3056): No heartbeat from core client for 30 sec - exiting 13:25:00 (3056): No heartbeat from core client for 30 sec - exiting 13:25:01 (3056): No heartbeat from core client for 30 sec - exiting 13:25:02 (3056): No heartbeat from core client for 30 sec - exiting 13:25:03 (3056): No heartbeat from core client for 30 sec - exiting 13:25:04 (3056): No heartbeat from core client for 30 sec - exiting 13:25:05 (3056): No heartbeat from core client for 30 sec - exiting 13:38:21 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:37 (4396): No heartbeat from core client for 30 sec - exiting 13:38:38 (4396): No heartbeat from core client for 30 sec - exiting 13:38:39 (4396): No heartbeat from core client for 30 sec - exiting 13:38:40 (4396): No heartbeat from core client for 30 sec - exiting 13:38:42 (4396): No heartbeat from core client for 30 sec - exiting 13:38:46 (4396): No heartbeat from core client for 30 sec - exiting 13:38:48 (4396): No heartbeat from core client for 30 sec - exiting 13:38:49 (4396): No heartbeat from core client for 30 sec - exiting 13:38:50 (4396): No heartbeat from core client for 30 sec - exiting 13:38:51 (4396): No heartbeat from core client for 30 sec - exiting 13:38:52 (4396): No heartbeat from core client for 30 sec - exiting 13:38:53 (4396): No heartbeat from core client for 30 sec - exiting 13:38:54 (4396): No heartbeat from core client for 30 sec - exiting 13:38:55 (4396): No heartbeat from core client for 30 sec - exiting 13:38:56 (4396):13:50:33 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:40 (3696): No heartbeat from core client for 30 sec - exiting 13:50:41 (3696): No heartbeat from core client for 30 sec - exiting 13:50:42 (3696): No heartbeat from core client for 30 sec - exiting 13:50:43 (3696): No heartbeat from core client for 30 sec - exiting 13:50:44 (3696): No heartbeat from core client for 30 sec - exiting 13:50:45 (3696): No heartbeat from core client for 30 sec - exiting 13:50:46 (3696): No heartbeat from core client for 30 sec - exiting 13:50:47 (3696): No heartbeat from core client for 30 sec - exiting 13:50:48 (3696): No heartbeat from core client for 30 sec - exiting 13:50:49 (3696): No heartbeat from core client for 30 sec - exiting 13:50:50 (3696): No heartbeat from core client for 30 sec - exiting 13:50:52 (3696): No heartbeat from core client for 30 sec - exiting 13:50:54 (3696): No heartbeat from core client for 30 sec - exiting 13:50:56 (3696): No heartbeat from core client for 30 sec - exiting 14:02:11 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:02:21 (3584): No heartbeat from core client for 30 sec - exiting 14:02:32 (3584): No heartbeat from core client for 30 sec - exiting 14:02:34 (3584): No heartbeat from core client for 30 sec - exiting 14:02:35 (3584): No heartbeat from core client for 30 sec - exiting 14:02:36 (3584): No heartbeat from core client for 30 sec - exiting 14:02:37 (3584): No heartbeat from core client for 30 sec - exiting 14:02:39 (3584): No heartbeat from core client for 30 sec - exiting 14:02:41 (3584): No heartbeat from core client for 30 sec - exiting 14:02:44 (3584): No heartbeat from core client for 30 sec - exiting 14:02:48 (3584): No heartbeat from core client for 30 sec - exiting 14:02:49 (3584): No heartbeat from core client for 30 sec - exiting 14:15:09 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:15:18 (4688): No heartbeat from core client for 30 sec - exiting 14:15:19 (4688): No heartbeat from core client for 30 sec - exiting 14:15:20 (4688): No heartbeat from core client for 30 sec - exiting 14:15:23 (4688): No heartbeat from core client for 30 sec - exiting 14:15:24 (4688): No heartbeat from core client for 30 sec - exiting 14:15:25 (4688): No heartbeat from core client for 30 sec - exiting 14:15:26 (4688): No heartbeat from core client for 30 sec - exiting 14:15:27 (4688): No heartbeat from core client for 30 sec - exiting 14:15:28 (4688): No heartbeat from core client for 30 sec - exiting 14:15:30 (4688): No heartbeat from core client for 30 sec - exiting 14:15:31 (4688): No heartbeat from core client for 30 sec - exiting 14:27:14 (2836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:27:23 (2836): No heartbeat from core client for 30 sec - exiting 14:27:27 (2836): No heartbeat from core client for 30 sec - exiting 14:27:28 (2836): No heartbeat from core client for 30 sec - exiting 14:27:29 (2836): No heartbeat from core client for 30 sec - exiting 14:27:30 (2836): No heartbeat from core client for 30 sec - exiting 14:27:31 (2836): No heartbeat from core client for 30 sec - exiting 14:27:32 (2836): No heartbeat from core client for 30 sec - exiting 14:27:40 (2836): No heartbeat from core client for 30 sec - exiting 14:27:41 (2836): No heartbeat from core client for 30 sec - exiting 14:27:45 (2836): No heartbeat from core client for 30 sec - exiting 14:39:55 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:03 (3144): No heartbeat from core client for 30 sec - exiting 14:40:07 (3144): No heartbeat from core client for 30 sec - exiting 14:40:08 (3144): No heartbeat from core client for 30 sec - exiting 14:40:10 (3144): No heartbeat from core client for 30 sec - exiting 14:40:11 (3144): No heartbeat from core client for 30 sec - exiting 14:40:12 (3144): No heartbeat from core client for 30 sec - exiting 14:40:13 (3144): No heartbeat from core client for 30 sec - exiting 14:40:14 (3144): No heartbeat from core client for 30 sec - exiting 14:40:15 (3144): No heartbeat from core client for 30 sec - exiting 14:40:17 (3144): No heartbeat from core client for 30 sec - exiting 14:40:18 (3144): No heartbeat from core client for 30 sec - exiting 14:40:21 (3144): No heartbeat from core client for 30 sec - exiting 14:52:43 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:52 (4404): No heartbeat from core client for 30 sec - exiting 14:52:54 (4404): No heartbeat from core client for 30 sec - exiting 14:52:55 (4404): No heartbeat from core client for 30 sec - exiting 14:52:59 (4404): No heartbeat from core client for 30 sec - exiting 14:53:03 (4404): No heartbeat from core client for 30 sec - exiting 14:53:04 (4404): No heartbeat from core client for 30 sec - exiting 14:53:05 (4404): No heartbeat from core client for 30 sec - exiting 14:53:07 (4404): No heartbeat from core client for 30 sec - exiting 14:53:08 (4404): No heartbeat from core client for 30 sec - exiting 14:53:09 (4404): No heartbeat from core client for 30 sec - exiting 14:53:10 (4404): No heartbeat from core client for 30 sec - exiting 14:53:11 (4404): No heartbeat from core client for 30 sec - exiting 14:53:14 (4404): No heartbeat from core client for 30 sec - exiting 14:53:15 (4404): No heartbeat from core client for 30 sec - exiting 14:53:16 (4404): No heartbeat from core client for 30 sec - exiting 14:53:20 (4404): No heartbeat from core client for 30 sec - exiting 14:53:21 (4404): No heartbeat from core client for 30 sec - exiting 14:53:22 (4404): No heartbeat from core client for 30 sec - exiting 14:53:23 (4404): No heartbeat from core client for 30 sec - exiting 14:53:24 (4404): No heartbeat from core client for 30 sec - exiting 14:53:25 (4404): No heartbeat from core client for 30 sec - exiting 14:53:26 (4404): No heartbeat from core client for 30 sec - exiting 14:53:27 (4404): No heartbeat from core client for 30 sec - exiting 14:53:28 (4404): No heartbeat from core client for 30 sec - exiting 15:06:05 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:06:17 (4792): No heartbeat from core client for 30 sec - exiting 15:06:18 (4792): No heartbeat from core client for 30 sec - exiting 15:06:19 (4792): No heartbeat from core client for 30 sec - exiting 15:06:20 (4792): No heartbeat from core client for 30 sec - exiting 15:06:21 (4792): No heartbeat from core client for 30 sec - exiting 15:06:22 (4792): No heartbeat from core client for 30 sec - exiting 15:06:24 (4792): No heartbeat from core client for 30 sec - exiting 15:06:25 (4792): No heartbeat from core client for 30 sec - exiting 15:06:26 (4792): No heartbeat from core client for 30 sec - exiting 15:06:28 (4792): No heartbeat from core client for 30 sec - exiting 15:06:30 (4792): No heartbeat from core client for 30 sec - exiting 15:06:32 (4792): No heartbeat from core client for 30 sec - exiting 15:06:33 (4792): No heartbeat from core client for 30 sec - exiting 15:18:59 (3416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:19:07 (3416): No heartbeat from core client for 30 sec - exiting 15:19:13 (3416): No heartbeat from core client for 30 sec - exiting 15:19:15 (3416): No heartbeat from core client for 30 sec - exiting 15:19:16 (3416): No heartbeat from core client for 30 sec - exiting 15:19:17 (3416): No heartbeat from core client for 30 sec - exiting 15:19:18 (3416): No heartbeat from core client for 30 sec - exiting 15:19:19 (3416): No heartbeat from core client for 30 sec - exiting 15:19:20 (3416): No heartbeat from core client for 30 sec - exiting 15:31:35 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:38 (4180): No heartbeat from core client for 30 sec - exiting 15:31:39 (4180): No heartbeat from core client for 30 sec - exiting 15:31:40 (4180): No heartbeat from core client for 30 sec - exiting 15:31:41 (4180): No heartbeat from core client for 30 sec - exiting 15:31:42 (4180): No heartbeat from core client for 30 sec - exiting 15:31:43 (4180): No heartbeat from core client for 30 sec - exiting 15:31:44 (4180): No heartbeat from core client for 30 sec - exiting 15:31:45 (4180): No heartbeat from core client for 30 sec - exiting 15:31:46 (4180): No heartbeat from core client for 30 sec - exiting 15:31:47 (4180): No heartbeat from core client for 30 sec - exiting 15:31:48 (4180): No heartbeat from core client for 30 sec - exiting 15:31:49 (4180): No heartbeat from core client for 30 sec - exiting 15:59:30 (5344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:31 (5344): No heartbeat from core client for 30 sec - exiting 07:19:03 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:30 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:00 (6104): No heartbeat from core client for 30 sec - exiting 00:00:01 (6104): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=1 Model crash detected, will try to restart... 02:29:45 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:46 (3936): No heartbeat from core client for 30 sec - exiting 07:14:15 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5676, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2076, iMonCtr=1 Model crash detected, will try to restart... 06:20:59 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:22:52 (1512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:43 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:37 (3196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 12:04:16 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:47 (3232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:22 (2072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:24 (2072): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=1 Model crash detected, will try to restart... 11:11:13 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:30 (5864): No heartbeat from core client for 30 sec - exiting 11:12:31 (5864): No heartbeat from core client for 30 sec - exiting 11:12:32 (5864): No heartbeat from core client for 30 sec - exiting 11:12:33 (5864): No heartbeat from core client for 30 sec - exiting 11:12:34 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:29 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4052, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3720, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3484, iMonCtr=1 Model crash detected, will try to restart... 05:45:08 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5188, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5900, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 20:20:26 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1440, iMonCtr=1 Model crash detected, will try to restart... 19:53:43 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:44 (3532): No heartbeat from core client for 30 sec - exiting 15:21:14 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:27:25 (5080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4208, iMonCtr=1 Model crash detected, will try to restart... 10:45:19 (4856): No heartbeat from core client for 30 sec - exiting 10:45:20 (4856): No heartbeat from core client for 30 sec - exiting 10:45:21 (4856): No heartbeat from core client for 30 sec - exiting 10:45:22 (4856): No heartbeat from core client for 30 sec - exiting 10:45:23 (4856): No heartbeat from core client for 30 sec - exiting 10:45:24 (4856): No heartbeat from core client for 30 sec - exiting 10:45:25 (4856): No heartbeat from core client for 30 sec - exiting 10:45:26 (4856): No heartbeat from core client for 30 sec - exiting 10:45:27 (4856): No heartbeat from core client for 30 sec - exiting 10:45:28 (4856): No heartbeat from core client for 30 sec - exiting 10:45:29 (4856): No heartbeat from core client for 30 sec - exiting 10:45:30 (4856): No heartbeat from core client for 30 sec - exiting 10:45:31 (4856): No heartbeat from core client for 30 sec - exiting 10:45:32 (4856): No heartbeat from core client for 30 sec - exiting 10:45:33 (4856): No heartbeat from core client for 30 sec - exiting 10:45:34 (4856): No heartbeat from core client for 30 sec - exiting 10:45:35 (4856): No heartbeat from core client for 30 sec - exiting 10:45:36 (4856): No heartbeat from core client for 30 sec - exiting 10:45:37 (4856): No heartbeat from core client for 30 sec - exiting 10:45:38 (4856): No heartbeat from core client for 30 sec - exiting 10:45:39 (4856): No heartbeat from core client for 30 sec - exiting 10:45:40 (4856): No heartbeat from core client for 30 sec - exiting 10:45:41 (4856): No heartbeat from core client for 30 sec - exiting 10:45:42 (4856): No heartbeat from core client for 30 sec - exiting 10:45:43 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:44 (4856): No heartbeat from core client for 30 sec - exiting 10:57:18 (4852): No heartbeat from core client for 30 sec - exiting 10:57:19 (4852): No heartbeat from core client for 30 sec - exiting 10:57:20 (4852): No heartbeat from core client for 30 sec - exiting 10:57:21 (4852): No heartbeat from core client for 30 sec - exiting 10:57:22 (4852): No heartbeat from core client for 30 sec - exiting 10:57:23 (4852): No heartbeat from core client for 30 sec - exiting 10:57:24 (4852): No heartbeat from core client for 30 sec - exiting 10:57:25 (4852): No heartbeat from core client for 30 sec - exiting 10:57:26 (4852): No heartbeat from core client for 30 sec - exiting 10:57:27 (4852): No heartbeat from core client for 30 sec - exiting 10:57:28 (4852): No heartbeat from core client for 30 sec - exiting 10:57:29 (4852): No heartbeat from core client for 30 sec - exiting 10:57:30 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CBUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3640, iMonCtr=1 Model crash detected, will try to restart... 14:07:22 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:37 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=620, iMonCtr=1 Model crash detected, will try to restart... 13:47:42 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Jan 2013 19:47:20	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	725,760	197,081	0.2716
11 Jan 2013 18:50:09	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	699,840	122,783	0.1754
10 Jan 2013 07:38:27	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	673,920	49,587	0.0736
04 Jan 2013 19:36:43	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	648,000	1,869,434	2.8849
01 Jan 2013 10:06:36	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	622,080	1,795,628	2.8865
30 Dec 2012 11:45:11	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	596,160	1,719,757	2.8847
29 Dec 2012 03:39:14	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	570,240	1,642,464	2.8803
27 Dec 2012 09:49:37	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	544,320	1,567,699	2.8801
24 Dec 2012 19:25:06	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	518,400	1,494,026	2.8820
23 Dec 2012 05:22:23	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	492,480	1,417,729	2.8788
17 Dec 2012 05:44:07	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	466,560	1,344,146	2.8810
16 Dec 2012 01:28:06	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	440,640	1,268,350	2.8784
14 Dec 2012 08:44:55	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	414,720	1,193,967	2.8790
14 Dec 2012 03:09:50	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	388,800	1,119,163	2.8785
14 Dec 2012 03:09:50	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	362,880	1,044,951	2.8796
06 Dec 2012 19:58:25	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	336,960	969,402	2.8769
03 Dec 2012 00:27:44	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	311,040	893,414	2.8723
27 Nov 2012 22:39:12	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	285,120	818,687	2.8714
22 Nov 2012 11:23:00	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	259,200	742,439	2.8643
20 Nov 2012 17:17:36	1184653	15400267	hadcm3n_o4e8_2060_40_008239523_1	233,280	666,737	2.8581