Task 15435028

Name	hadcm3n_zh4q_1920_40_008244503_0
Workunit	8399627
Created	14 Nov 2012, 18:47:42 UTC
Sent	14 Nov 2012, 18:47:44 UTC
Report deadline	14 Feb 2013, 2:14:55 UTC
Received	21 Feb 2013, 20:04:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1251442
Run time	24 days 19 hours 1 min 27 sec
CPU time	17 days 20 hours 27 min 35 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> est from BOINC... 14:43:03 (4748): No heartbeat from core client for 30 sec - exiting 14:43:05 (4748): No heartbeat from core client for 30 sec - exiting 14:43:06 (4748): No heartbeat from core client for 30 sec - exiting 14:43:07 (4748): No heartbeat from core client for 30 sec - exiting 14:43:08 (4748): No heartbeat from core client for 30 sec - exiting 14:43:09 (4748): No heartbeat from core client for 30 sec - exiting 14:43:10 (4748): No heartbeat from core client for 30 sec - exiting 14:43:11 (4748): No heartbeat from core client for 30 sec - exiting 14:43:12 (4748): No heartbeat from core client for 30 sec - exiting 14:43:13 (4748): No heartbeat from core client for 30 sec - exiting 14:43:14 (4748): No heartbeat from core client for 30 sec - exiting 14:43:16 (4748): No heartbeat from core client for 30 sec - exiting 14:43:17 (4748): No heartbeat from core client for 30 sec - exiting 14:43:18 (4748): No heartbeat from core client for 30 sec - exiting 14:43:19 (4748): No heartbeat from core client for 30 sec - exiting 14:43:20 (4748): No heartbeat from core client for 30 sec - exiting 14:43:21 (4748): No heartbeat from core client for 30 sec - exiting 14:43:22 (4748): No heartbeat from core client for 30 sec - exiting 14:43:23 (4748): No heartbeat from core client for 30 sec - exiting 14:43:24 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:01 (6428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6060, iMonCtr=1 Model crash detected, will try to restart... 19:39:11 (4560): No heartbeat from core client for 30 sec - exiting 19:39:12 (4560): No heartbeat from core client for 30 sec - exiting 19:39:13 (4560): No heartbeat from core client for 30 sec - exiting 19:39:14 (4560): No heartbeat from core client for 30 sec - exiting 19:39:15 (4560): No heartbeat from core client for 30 sec - exiting 19:39:16 (4560): No heartbeat from core client for 30 sec - exiting 19:39:18 (4560): No heartbeat from core client for 30 sec - exiting 19:39:19 (4560): No heartbeat from core client for 30 sec - exiting 19:39:20 (4560): No heartbeat from core client for 30 sec - exiting 19:39:21 (4560): No heartbeat from core client for 30 sec - exiting 19:39:22 (4560): No heartbeat from core client for 30 sec - exiting 19:39:23 (4560): No heartbeat from core client for 30 sec - exiting 19:39:24 (4560): No heartbeat from core client for 30 sec - exiting 19:39:25 (4560): No heartbeat from core client for 30 sec - exiting 19:39:26 (4560): No heartbeat from core client for 30 sec - exiting 19:39:27 (4560): No heartbeat from core client for 30 sec - exiting 19:39:28 (4560): No heartbeat from core client for 30 sec - exiting 19:39:30 (4560): No heartbeat from core client for 30 sec - exiting 19:39:31 (4560): No heartbeat from core client for 30 sec - exiting 19:39:32 (4560): No heartbeat from core client for 30 sec - exiting 19:39:33 (4560): No heartbeat from core client for 30 sec - exiting 19:39:34 (4560): No heartbeat from core client for 30 sec - exiting 19:39:35 (4560): No heartbeat from core client for 30 sec - exiting 19:39:37 (4560): No heartbeat from core client for 30 sec - exiting 19:39:38 (4560): No heartbeat from core client for 30 sec - exiting 19:39:39 (4560): No heartbeat from core client for 30 sec - exiting 19:39:40 (4560): No heartbeat from core client for 30 sec - exiting 19:39:41 (4560): No heartbeat from core client for 30 sec - exiting 19:39:42 (4560): No heartbeat from core client for 30 sec - exiting 19:39:43 (4560): No heartbeat from core client for 30 sec - exiting 19:39:44 (4560): No heartbeat from core client for 30 sec - exiting 19:39:46 (4560): No heartbeat from core client for 30 sec - exiting 19:39:47 (4560): No heartbeat from core client for 30 sec - exiting 19:39:48 (4560): No heartbeat from core client for 30 sec - exiting 19:39:49 (4560): No heartbeat from core client for 30 sec - exiting 19:39:50 (4560): No heartbeat from core client for 30 sec - exiting 19:39:51 (4560): No heartbeat from core client for 30 sec - exiting 19:39:52 (4560): No heartbeat from core client for 30 sec - exiting 19:39:53 (4560): No heartbeat from core client for 30 sec - exiting 19:39:54 (4560): No heartbeat from core client for 30 sec - exiting 19:39:55 (4560): No heartbeat from core client for 30 sec - exiting 19:39:57 (4560): No heartbeat from core client for 30 sec - exiting 19:39:58 (4560): No heartbeat from core client for 30 sec - exiting 19:39:59 (4560): No heartbeat from core client for 30 sec - exiting 19:40:33 (4560): No heartbeat from core client for 30 sec - exiting 19:40:34 (4560): No heartbeat from core client for 30 sec - exiting 19:40:35 (4560): No heartbeat from core client for 30 sec - exiting 19:40:36 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:27 (7084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7908, iMonCtr=1 Model crash detected, will try to restart... 10:25:09 (4436): No heartbeat from core client for 30 sec - exiting 10:25:10 (4436): No heartbeat from core client for 30 sec - exiting 10:25:11 (4436): No heartbeat from core client for 30 sec - exiting 10:25:12 (4436): No heartbeat from core client for 30 sec - exiting 10:25:14 (4436): No heartbeat from core client for 30 sec - exiting 10:25:15 (4436): No heartbeat from core client for 30 sec - exiting 10:25:16 (4436): No heartbeat from core client for 30 sec - exiting 10:25:17 (4436): No heartbeat from core client for 30 sec - exiting 10:25:18 (4436): No heartbeat from core client for 30 sec - exiting 10:25:19 (4436): No heartbeat from core client for 30 sec - exiting 10:25:20 (4436): No heartbeat from core client for 30 sec - exiting 10:25:22 (4436): No heartbeat from core client for 30 sec - exiting 10:25:23 (4436): No heartbeat from core client for 30 sec - exiting 10:25:24 (4436): No heartbeat from core client for 30 sec - exiting 10:25:25 (4436): No heartbeat from core client for 30 sec - exiting 10:25:26 (4436): No heartbeat from core client for 30 sec - exiting 10:25:27 (4436): No heartbeat from core client for 30 sec - exiting 10:25:28 (4436): No heartbeat from core client for 30 sec - exiting 10:25:29 (4436): No heartbeat from core client for 30 sec - exiting 10:25:30 (4436): No heartbeat from core client for 30 sec - exiting 10:25:31 (4436): No heartbeat from core client for 30 sec - exiting 10:25:33 (4436): No heartbeat from core client for 30 sec - exiting 10:25:34 (4436): No heartbeat from core client for 30 sec - exiting 10:25:35 (4436): No heartbeat from core client for 30 sec - exiting 10:25:36 (4436): No heartbeat from core client for 30 sec - exiting 10:25:37 (4436): No heartbeat from core client for 30 sec - exiting 10:25:38 (4436): No heartbeat from core client for 30 sec - exiting 10:25:39 (4436): No heartbeat from core client for 30 sec - exiting 10:25:40 (4436): No heartbeat from core client for 30 sec - exiting 10:25:41 (4436): No heartbeat from core client for 30 sec - exiting 10:25:42 (4436): No heartbeat from core client for 30 sec - exiting 10:25:43 (4436): No heartbeat from core client for 30 sec - exiting 10:25:45 (4436): No heartbeat from core client for 30 sec - exiting 10:25:46 (4436): No heartbeat from core client for 30 sec - exiting 10:25:47 (4436): No heartbeat from core client for 30 sec - exiting 10:25:48 (4436): No heartbeat from core client for 30 sec - exiting 10:25:49 (4436): No heartbeat from core client for 30 sec - exiting 10:25:50 (4436): No heartbeat from core client for 30 sec - exiting 10:25:51 (4436): No heartbeat from core client for 30 sec - exiting 10:25:52 (4436): No heartbeat from core client for 30 sec - exiting 10:25:53 (4436): No heartbeat from core client for 30 sec - exiting 10:25:54 (4436): No heartbeat from core client for 30 sec - exiting 10:25:55 (4436): No heartbeat from core client for 30 sec - exiting 10:25:57 (4436): No heartbeat from core client for 30 sec - exiting 10:25:58 (4436): No heartbeat from core client for 30 sec - exiting 10:25:59 (4436): No heartbeat from core client for 30 sec - exiting 10:26:00 (4436): No heartbeat from core client for 30 sec - exiting 10:26:01 (4436): No heartbeat from core client for 30 sec - exiting 10:26:02 (4436): No heartbeat from core client for 30 sec - exiting 10:26:04 (4436): No heartbeat from core client for 30 sec - exiting 10:26:05 (4436): No heartbeat from core client for 30 sec - exiting 10:26:06 (4436): No heartbeat from core client for 30 sec - exiting 10:26:07 (4436): No heartbeat from core client for 30 sec - exiting 10:26:08 (4436): No heartbeat from core client for 30 sec - exiting 10:26:09 (4436): No heartbeat from core client for 30 sec - exiting 10:26:10 (4436): No heartbeat from core client for 30 sec - exiting 10:26:11 (4436): No heartbeat from core client for 30 sec - exiting 10:26:12 (4436): No heartbeat from core client for 30 sec - exiting 10:26:13 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:34 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:14 (1340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3216, iMonCtr=1 Model crash detected, will try to restart... 09:50:22 (6032): No heartbeat from core client for 30 sec - exiting 09:50:24 (6032): No heartbeat from core client for 30 sec - exiting 09:50:25 (6032): No heartbeat from core client for 30 sec - exiting 09:50:26 (6032): No heartbeat from core client for 30 sec - exiting 09:50:27 (6032): No heartbeat from core client for 30 sec - exiting 09:50:28 (6032): No heartbeat from core client for 30 sec - exiting 09:50:29 (6032): No heartbeat from core client for 30 sec - exiting 09:50:30 (6032): No heartbeat from core client for 30 sec - exiting 09:50:32 (6032): No heartbeat from core client for 30 sec - exiting 09:50:33 (6032): No heartbeat from core client for 30 sec - exiting 09:50:34 (6032): No heartbeat from core client for 30 sec - exiting 09:50:35 (6032): No heartbeat from core client for 30 sec - exiting 09:50:36 (6032): No heartbeat from core client for 30 sec - exiting 09:50:37 (6032): No heartbeat from core client for 30 sec - exiting 09:50:38 (6032): No heartbeat from core client for 30 sec - exiting 09:50:39 (6032): No heartbeat from core client for 30 sec - exiting 09:50:41 (6032): No heartbeat from core client for 30 sec - exiting 09:50:42 (6032): No heartbeat from core client for 30 sec - exiting 09:50:43 (6032): No heartbeat from core client for 30 sec - exiting 09:50:44 (6032): No heartbeat from core client for 30 sec - exiting 09:50:45 (6032): No heartbeat from core client for 30 sec - exiting 09:50:46 (6032): No heartbeat from core client for 30 sec - exiting 09:50:47 (6032): No heartbeat from core client for 30 sec - exiting 09:50:49 (6032): No heartbeat from core client for 30 sec - exiting 09:50:50 (6032): No heartbeat from core client for 30 sec - exiting 09:50:51 (6032): No heartbeat from core client for 30 sec - exiting 09:50:52 (6032): No heartbeat from core client for 30 sec - exiting 09:50:53 (6032): No heartbeat from core client for 30 sec - exiting 09:50:54 (6032): No heartbeat from core client for 30 sec - exiting 09:50:55 (6032): No heartbeat from core client for 30 sec - exiting 09:50:56 (6032): No heartbeat from core client for 30 sec - exiting 09:50:57 (6032): No heartbeat from core client for 30 sec - exiting 09:50:58 (6032): No heartbeat from core client for 30 sec - exiting 09:51:00 (6032): No heartbeat from core client for 30 sec - exiting 09:51:01 (6032): No heartbeat from core client for 30 sec - exiting 09:51:02 (6032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... 08:51:49 (5660): No heartbeat from core client for 30 sec - exiting 08:51:50 (5660): No heartbeat from core client for 30 sec - exiting 08:51:51 (5660): No heartbeat from core client for 30 sec - exiting 08:51:52 (5660): No heartbeat from core client for 30 sec - exiting 08:51:54 (5660): No heartbeat from core client for 30 sec - exiting 08:51:55 (5660): No heartbeat from core client for 30 sec - exiting 08:51:56 (5660): No heartbeat from core client for 30 sec - exiting 08:51:57 (5660): No heartbeat from core client for 30 sec - exiting 08:51:58 (5660): No heartbeat from core client for 30 sec - exiting 08:51:59 (5660): No heartbeat from core client for 30 sec - exiting 08:52:00 (5660): No heartbeat from core client for 30 sec - exiting 08:52:01 (5660): No heartbeat from core client for 30 sec - exiting 08:52:03 (5660): No heartbeat from core client for 30 sec - exiting 08:52:04 (5660): No heartbeat from core client for 30 sec - exiting 08:52:05 (5660): No heartbeat from core client for 30 sec - exiting 08:52:06 (5660): No heartbeat from core client for 30 sec - exiting 08:52:07 (5660): No heartbeat from core client for 30 sec - exiting 08:52:08 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=1 Model crash detected, will try to restart... 10:50:55 (5252): No heartbeat from core client for 30 sec - exiting 10:50:56 (5252): No heartbeat from core client for 30 sec - exiting 10:50:57 (5252): No heartbeat from core client for 30 sec - exiting 10:50:58 (5252): No heartbeat from core client for 30 sec - exiting 10:51:00 (5252): No heartbeat from core client for 30 sec - exiting 10:51:01 (5252): No heartbeat from core client for 30 sec - exiting 10:51:02 (5252): No heartbeat from core client for 30 sec - exiting 10:51:03 (5252): No heartbeat from core client for 30 sec - exiting 10:51:37 (5252): No heartbeat from core client for 30 sec - exiting 10:51:38 (5252): No heartbeat from core client for 30 sec - exiting 10:51:39 (5252): No heartbeat from core client for 30 sec - exiting 10:51:40 (5252): No heartbeat from core client for 30 sec - exiting 10:51:41 (5252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:22 (5536): No heartbeat from core client for 30 sec - exiting 17:15:23 (5536): No heartbeat from core client for 30 sec - exiting 17:15:24 (5536): No heartbeat from core client for 30 sec - exiting 17:15:26 (5536): No heartbeat from core client for 30 sec - exiting 17:15:27 (5536): No heartbeat from core client for 30 sec - exiting 17:15:28 (5536): No heartbeat from core client for 30 sec - exiting 17:15:29 (5536): No heartbeat from core client for 30 sec - exiting 17:15:30 (5536): No heartbeat from core client for 30 sec - exiting 17:15:31 (5536): No heartbeat from core client for 30 sec - exiting 17:15:32 (5536): No heartbeat from core client for 30 sec - exiting 17:15:33 (5536): No heartbeat from core client for 30 sec - exiting 17:15:35 (5536): No heartbeat from core client for 30 sec - exiting 17:15:36 (5536): No heartbeat from core client for 30 sec - exiting 17:15:37 (5536): No heartbeat from core client for 30 sec - exiting 17:15:38 (5536): No heartbeat from core client for 30 sec - exiting 17:15:39 (5536): No heartbeat from core client for 30 sec - exiting 17:15:40 (5536): No heartbeat from core client for 30 sec - exiting 17:15:41 (5536): No heartbeat from core client for 30 sec - exiting 17:15:42 (5536): No heartbeat from core client for 30 sec - exiting 17:15:43 (5536): No heartbeat from core client for 30 sec - exiting 17:15:44 (5536): No heartbeat from core client for 30 sec - exiting 17:15:46 (5536): No heartbeat from core client for 30 sec - exiting 17:15:47 (5536): No heartbeat from core client for 30 sec - exiting 17:15:48 (5536): No heartbeat from core client for 30 sec - exiting 17:15:49 (5536): No heartbeat from core client for 30 sec - exiting 17:15:50 (5536): No heartbeat from core client for 30 sec - exiting 17:15:51 (5536): No heartbeat from core client for 30 sec - exiting 17:15:52 (5536): No heartbeat from core client for 30 sec - exiting 17:15:53 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:42 (2260): No heartbeat from core client for 30 sec - exiting 10:38:47 (2260): No heartbeat from core client for 30 sec - exiting 10:38:48 (2260): No heartbeat from core client for 30 sec - exiting 10:38:49 (2260): No heartbeat from core client for 30 sec - exiting 10:38:51 (2260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... 18:27:06 (4536): No heartbeat from core client for 30 sec - exiting 18:27:07 (4536): No heartbeat from core client for 30 sec - exiting 18:27:08 (4536): No heartbeat from core client for 30 sec - exiting 18:27:10 (4536): No heartbeat from core client for 30 sec - exiting 18:27:11 (4536): No heartbeat from core client for 30 sec - exiting 18:27:12 (4536): No heartbeat from core client for 30 sec - exiting 18:27:13 (4536): No heartbeat from core client for 30 sec - exiting 18:27:14 (4536): No heartbeat from core client for 30 sec - exiting 18:27:15 (4536): No heartbeat from core client for 30 sec - exiting 18:27:16 (4536): No heartbeat from core client for 30 sec - exiting 18:27:17 (4536): No heartbeat from core client for 30 sec - exiting 18:27:18 (4536): No heartbeat from core client for 30 sec - exiting 18:27:19 (4536): No heartbeat from core client for 30 sec - exiting 18:27:20 (4536): No heartbeat from core client for 30 sec - exiting 18:27:22 (4536): No heartbeat from core client for 30 sec - exiting 18:27:23 (4536): No heartbeat from core client for 30 sec - exiting 18:27:24 (4536): No heartbeat from core client for 30 sec - exiting 18:27:25 (4536): No heartbeat from core client for 30 sec - exiting 18:27:26 (4536): No heartbeat from core client for 30 sec - exiting 18:27:27 (4536): No heartbeat from core client for 30 sec - exiting 18:27:28 (4536): No heartbeat from core client for 30 sec - exiting 18:27:29 (4536): No heartbeat from core client for 30 sec - exiting 18:27:30 (4536): No heartbeat from core client for 30 sec - exiting 18:27:31 (4536): No heartbeat from core client for 30 sec - exiting 18:27:32 (4536): No heartbeat from core client for 30 sec - exiting 18:27:34 (4536): No heartbeat from core client for 30 sec - exiting 18:27:35 (4536): No heartbeat from core client for 30 sec - exiting 18:27:36 (4536): No heartbeat from core client for 30 sec - exiting 18:27:37 (4536): No heartbeat from core client for 30 sec - exiting 18:27:38 (4536): No heartbeat from core client for 30 sec - exiting 18:27:39 (4536): No heartbeat from core client for 30 sec - exiting 18:27:40 (4536): No heartbeat from core client for 30 sec - exiting 18:27:42 (4536): No heartbeat from core client for 30 sec - exiting 18:27:43 (4536): No heartbeat from core client for 30 sec - exiting 18:27:44 (4536): No heartbeat from core client for 30 sec - exiting 18:27:45 (4536): No heartbeat from core client for 30 sec - exiting 18:27:46 (4536): No heartbeat from core client for 30 sec - exiting 18:27:47 (4536): No heartbeat from core client for 30 sec - exiting 18:27:48 (4536): No heartbeat from core client for 30 sec - exiting 18:27:49 (4536): No heartbeat from core client for 30 sec - exiting 18:27:50 (4536): No heartbeat from core client for 30 sec - exiting 18:27:52 (4536): No heartbeat from core client for 30 sec - exiting 18:28:53 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:54 (4536): No heartbeat from core client for 30 sec - exiting 13:38:01 (1520): No heartbeat from core client for 30 sec - exiting 13:38:03 (1520): No heartbeat from core client for 30 sec - exiting 13:38:04 (1520): No heartbeat from core client for 30 sec - exiting 13:38:05 (1520): No heartbeat from core client for 30 sec - exiting 13:38:06 (1520): No heartbeat from core client for 30 sec - exiting 13:38:07 (1520): No heartbeat from core client for 30 sec - exiting 13:38:08 (1520): No heartbeat from core client for 30 sec - exiting 13:38:10 (1520): No heartbeat from core client for 30 sec - exiting 13:38:11 (1520): No heartbeat from core client for 30 sec - exiting 13:38:12 (1520): No heartbeat from core client for 30 sec - exiting 13:38:13 (1520): No heartbeat from core client for 30 sec - exiting 13:38:14 (1520): No heartbeat from core client for 30 sec - exiting 13:38:15 (1520): No heartbeat from core client for 30 sec - exiting 13:38:16 (1520): No heartbeat from core client for 30 sec - exiting 13:38:17 (1520): No heartbeat from core client for 30 sec - exiting 13:38:18 (1520): No heartbeat from core client for 30 sec - exiting 13:38:20 (1520): No heartbeat from core client for 30 sec - exiting 13:38:21 (1520): No heartbeat from core client for 30 sec - exiting 13:38:22 (1520): No heartbeat from core client for 30 sec - exiting 13:38:23 (1520): No heartbeat from core client for 30 sec - exiting 13:38:24 (1520): No heartbeat from core client for 30 sec - exiting 13:38:25 (1520): No heartbeat from core client for 30 sec - exiting 13:38:27 (1520): No heartbeat from core client for 30 sec - exiting 13:38:28 (1520): No heartbeat from core client for 30 sec - exiting 13:38:29 (1520): No heartbeat from core client for 30 sec - exiting 13:38:30 (1520): No heartbeat from core client for 30 sec - exiting 13:38:31 (1520): No heartbeat from core client for 30 sec - exiting 13:38:32 (1520): No heartbeat from core client for 30 sec - exiting 13:38:33 (1520): No heartbeat from core client for 30 sec - exiting 13:38:34 (1520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:25 (3396): No heartbeat from core client for 30 sec - exiting 20:24:26 (3396): No heartbeat from core client for 30 sec - exiting 20:24:28 (3396): No heartbeat from core client for 30 sec - exiting 20:24:29 (3396): No heartbeat from core client for 30 sec - exiting 20:24:30 (3396): No heartbeat from core client for 30 sec - exiting 20:24:31 (3396): No heartbeat from core client for 30 sec - exiting 20:24:32 (3396): No heartbeat from core client for 30 sec - exiting 20:24:33 (3396): No heartbeat from core client for 30 sec - exiting 20:24:34 (3396): No heartbeat from core client for 30 sec - exiting 20:24:35 (3396): No heartbeat from core client for 30 sec - exiting 20:24:36 (3396): No heartbeat from core client for 30 sec - exiting 20:24:37 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:58:13 (5288): No heartbeat from core client for 30 sec - exiting 10:58:14 (5288): No heartbeat from core client for 30 sec - exiting 10:58:15 (5288): No heartbeat from core client for 30 sec - exiting 10:58:16 (5288): No heartbeat from core client for 30 sec - exiting 10:58:17 (5288): No heartbeat from core client for 30 sec - exiting 10:58:18 (5288): No heartbeat from core client for 30 sec - exiting 10:58:20 (5288): No heartbeat from core client for 30 sec - exiting 10:58:21 (5288): No heartbeat from core client for 30 sec - exiting 10:58:22 (5288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:23 (5288): No heartbeat from core client for 30 sec - exiting 10:58:24 (5288): No heartbeat from core client for 30 sec - exiting 10:58:25 (5288): No heartbeat from core client for 30 sec - exiting 10:58:26 (5288): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6052, iMonCtr=1 Model crash detected, will try to restart... 16:27:02 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:19:44 (1784): No heartbeat from core client for 30 sec - exiting 15:19:45 (1784): No heartbeat from core client for 30 sec - exiting 15:19:46 (1784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:59 (2516): No heartbeat from core client for 30 sec - exiting 18:59:00 (2516): No heartbeat from core client for 30 sec - exiting 18:59:01 (2516): No heartbeat from core client for 30 sec - exiting 18:59:03 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:04 (2516): No heartbeat from core client for 30 sec - exiting 18:59:05 (2516): No heartbeat from core client for 30 sec - exiting 18:59:06 (2516): No heartbeat from core client for 30 sec - exiting 18:59:07 (2516): No heartbeat from core client for 30 sec - exiting 18:59:08 (2516): No heartbeat from core client for 30 sec - exiting 18:59:09 (2516): No heartbeat from core client for 30 sec - exiting 10:45:55 (4372): No heartbeat from core client for 30 sec - exiting 10:45:56 (4372): No heartbeat from core client for 30 sec - exiting 10:45:58 (4372): No heartbeat from core client for 30 sec - exiting 10:45:59 (4372): No heartbeat from core client for 30 sec - exiting 10:46:00 (4372): No heartbeat from core client for 30 sec - exiting 10:46:01 (4372): No heartbeat from core client for 30 sec - exiting 10:46:02 (4372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:38 (4572): No heartbeat from core client for 30 sec - exiting 10:51:40 (4572): No heartbeat from core client for 30 sec - exiting 10:51:41 (4572): No heartbeat from core client for 30 sec - exiting 10:51:42 (4572): No heartbeat from core client for 30 sec - exiting 10:51:43 (4572): No heartbeat from core client for 30 sec - exiting 10:51:44 (4572): No heartbeat from core client for 30 sec - exiting 10:51:45 (4572): No heartbeat from core client for 30 sec - exiting 10:51:46 (4572): No heartbeat from core client for 30 sec - exiting 10:51:48 (4572): No heartbeat from core client for 30 sec - exiting 10:51:49 (4572): No heartbeat from core client for 30 sec - exiting 10:51:50 (4572): No heartbeat from core client for 30 sec - exiting 10:51:51 (4572): No heartbeat from core client for 30 sec - exiting 10:51:52 (4572): No heartbeat from core client for 30 sec - exiting 10:51:53 (4572): No heartbeat from core client for 30 sec - exiting 10:51:54 (4572): No heartbeat from core client for 30 sec - exiting 10:51:55 (4572): No heartbeat from core client for 30 sec - exiting 10:51:56 (4572): No heartbeat from core client for 30 sec - exiting 10:51:57 (4572): No heartbeat from core client for 30 sec - exiting 10:51:58 (4572): No heartbeat from core client for 30 sec - exiting 10:51:59 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4776, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4776, iMonCtr=1 Model crash detected, will try to restart... 18:18:23 (5320): No heartbeat from core client for 30 sec - exiting 18:18:24 (5320): No heartbeat from core client for 30 sec - exiting 18:18:25 (5320): No heartbeat from core client for 30 sec - exiting 18:18:26 (5320): No heartbeat from core client for 30 sec - exiting 18:18:27 (5320): No heartbeat from core client for 30 sec - exiting 18:18:28 (5320): No heartbeat from core client for 30 sec - exiting 18:18:29 (5320): No heartbeat from core client for 30 sec - exiting 18:18:31 (5320): No heartbeat from core client for 30 sec - exiting 18:18:32 (5320): No heartbeat from core client for 30 sec - exiting 18:18:33 (5320): No heartbeat from core client for 30 sec - exiting 18:18:34 (5320): No heartbeat from core client for 30 sec - exiting 18:18:35 (5320): No heartbeat from core client for 30 sec - exiting 18:18:36 (5320): No heartbeat from core client for 30 sec - exiting 18:18:37 (5320): No heartbeat from core client for 30 sec - exiting 18:18:38 (5320): No heartbeat from core client for 30 sec - exiting 18:18:40 (5320): No heartbeat from core client for 30 sec - exiting 18:18:41 (5320): No heartbeat from core client for 30 sec - exiting 18:18:42 (5320): No heartbeat from core client for 30 sec - exiting 18:18:43 (5320): No heartbeat from core client for 30 sec - exiting 18:18:44 (5320): No heartbeat from core client for 30 sec - exiting 18:18:45 (5320): No heartbeat from core client for 30 sec - exiting 18:18:46 (5320): No heartbeat from core client for 30 sec - exiting 18:18:47 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 23:34:04 (5076): No heartbeat from core client for 30 sec - exiting 23:34:05 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:06 (5076): No heartbeat from core client for 30 sec - exiting 23:35:25 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:37 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2492, iMonCtr=1 Model crash detected, will try to restart... 14:54:09 (6020): No heartbeat from core client for 30 sec - exiting 14:54:11 (6020): No heartbeat from core client for 30 sec - exiting 14:54:12 (6020): No heartbeat from core client for 30 sec - exiting 14:54:13 (6020): No heartbeat from core client for 30 sec - exiting 14:54:14 (6020): No heartbeat from core client for 30 sec - exiting 14:54:15 (6020): No heartbeat from core client for 30 sec - exiting 14:54:16 (6020): No heartbeat from core client for 30 sec - exiting 14:54:17 (6020): No heartbeat from core client for 30 sec - exiting 14:54:18 (6020): No heartbeat from core client for 30 sec - exiting 14:54:52 (6020): No heartbeat from core client for 30 sec - exiting 14:54:53 (6020): No heartbeat from core client for 30 sec - exiting 14:54:54 (6020): No heartbeat from core client for 30 sec - exiting 14:54:55 (6020): No heartbeat from core client for 30 sec - exiting 14:54:57 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:23 (5532): No heartbeat from core client for 30 sec - exiting 10:49:24 (5532): No heartbeat from core client for 30 sec - exiting 10:49:26 (5532): No heartbeat from core client for 30 sec - exiting 10:49:27 (5532): No heartbeat from core client for 30 sec - exiting 10:49:28 (5532): No heartbeat from core client for 30 sec - exiting 10:49:29 (5532): No heartbeat from core client for 30 sec - exiting 10:49:30 (5532): No heartbeat from core client for 30 sec - exiting 10:49:31 (5532): No heartbeat from core client for 30 sec - exiting 10:49:32 (5532): No heartbeat from core client for 30 sec - exiting 10:49:33 (5532): No heartbeat from core client for 30 sec - exiting 10:49:34 (5532): No heartbeat from core client for 30 sec - exiting 10:49:35 (5532): No heartbeat from core client for 30 sec - exiting 10:49:36 (5532): No heartbeat from core client for 30 sec - exiting 10:49:37 (5532): No heartbeat from core client for 30 sec - exiting 10:49:38 (5532): No heartbeat from core client for 30 sec - exiting 10:49:39 (5532): No heartbeat from core client for 30 sec - exiting 10:49:40 (5532): No heartbeat from core client for 30 sec - exiting 10:49:41 (5532): No heartbeat from core client for 30 sec - exiting 10:49:42 (5532): No heartbeat from core client for 30 sec - exiting 10:49:43 (5532): No heartbeat from core client for 30 sec - exiting 10:49:44 (5532): No heartbeat from core client for 30 sec - exiting 10:49:45 (5532): No heartbeat from core client for 30 sec - exiting 10:49:46 (5532): No heartbeat from core client for 30 sec - exiting 10:49:47 (5532): No heartbeat from core client for 30 sec - exiting 10:49:48 (5532): No heartbeat from core client for 30 sec - exiting 10:49:49 (5532): No heartbeat from core client for 30 sec - exiting 10:49:50 (5532): No heartbeat from core client for 30 sec - exiting 10:49:51 (5532): No heartbeat from core client for 30 sec - exiting 10:49:52 (5532): No heartbeat from core client for 30 sec - exiting 10:49:53 (5532): No heartbeat from core client for 30 sec - exiting 10:49:54 (5532): No heartbeat from core client for 30 sec - exiting 10:49:55 (5532): No heartbeat from core client for 30 sec - exiting 10:49:56 (5532): No heartbeat from core client for 30 sec - exiting 10:49:57 (5532): No heartbeat from core client for 30 sec - exiting 10:49:58 (5532): No heartbeat from core client for 30 sec - exiting 10:49:59 (5532): No heartbeat from core client for 30 sec - exiting 10:50:00 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:15:08 (6452): No heartbeat from core client for 30 sec - exiting 17:15:09 (6452): No heartbeat from core client for 30 sec - exiting 17:15:10 (6452): No heartbeat from core client for 30 sec - exiting 17:15:11 (6452): No heartbeat from core client for 30 sec - exiting 17:15:12 (6452): No heartbeat from core client for 30 sec - exiting 17:15:13 (6452): No heartbeat from core client for 30 sec - exiting 17:15:14 (6452): No heartbeat from core client for 30 sec - exiting 17:15:16 (6452): No heartbeat from core client for 30 sec - exiting 17:15:17 (6452): No heartbeat from core client for 30 sec - exiting 17:15:18 (6452): No heartbeat from core client for 30 sec - exiting 17:15:19 (6452): No heartbeat from core client for 30 sec - exiting 17:15:20 (6452): No heartbeat from core client for 30 sec - exiting 17:15:21 (6452): No heartbeat from core client for 30 sec - exiting 17:15:22 (6452): No heartbeat from core client for 30 sec - exiting 17:15:23 (6452): No heartbeat from core client for 30 sec - exiting 17:15:24 (6452): No heartbeat from core client for 30 sec - exiting 17:15:25 (6452): No heartbeat from core client for 30 sec - exiting 17:15:27 (6452): No heartbeat from core client for 30 sec - exiting 17:15:28 (6452): No heartbeat from core client for 30 sec - exiting 17:15:29 (6452): No heartbeat from core client for 30 sec - exiting 17:15:30 (6452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:12 (5260): No heartbeat from core client for 30 sec - exiting 16:03:13 (5260): No heartbeat from core client for 30 sec - exiting 16:03:15 (5260): No heartbeat from core client for 30 sec - exiting 16:03:16 (5260): No heartbeat from core client for 30 sec - exiting 16:03:17 (5260): No heartbeat from core client for 30 sec - exiting 16:03:18 (5260): No heartbeat from core client for 30 sec - exiting 16:03:19 (5260): No heartbeat from core client for 30 sec - exiting 16:03:20 (5260): No heartbeat from core client for 30 sec - exiting 16:03:21 (5260): No heartbeat from core client for 30 sec - exiting 16:03:22 (5260): No heartbeat from core client for 30 sec - exiting 16:03:23 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:39 (2052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:21:25 (4780): No heartbeat from core client for 30 sec - exiting 17:21:26 (4780): No heartbeat from core client for 30 sec - exiting 17:21:27 (4780): No heartbeat from core client for 30 sec - exiting 17:21:28 (4780): No heartbeat from core client for 30 sec - exiting 17:21:29 (4780): No heartbeat from core client for 30 sec - exiting 17:21:30 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:27 (5948): No heartbeat from core client for 30 sec - exiting 15:17:29 (5948): No heartbeat from core client for 30 sec - exiting 15:17:30 (5948): No heartbeat from core client for 30 sec - exiting 15:17:31 (5948): No heartbeat from core client for 30 sec - exiting 15:17:32 (5948): No heartbeat from core client for 30 sec - exiting 15:17:33 (5948): No heartbeat from core client for 30 sec - exiting 15:17:34 (5948): No heartbeat from core client for 30 sec - exiting 15:17:36 (5948): No heartbeat from core client for 30 sec - exiting 15:17:37 (5948): No heartbeat from core client for 30 sec - exiting 15:17:38 (5948): No heartbeat from core client for 30 sec - exiting 15:17:39 (5948): No heartbeat from core client for 30 sec - exiting 15:17:40 (5948): No heartbeat from core client for 30 sec - exiting 15:17:41 (5948): No heartbeat from core client for 30 sec - exiting 15:17:42 (5948): No heartbeat from core client for 30 sec - exiting 15:17:44 (5948): No heartbeat from core client for 30 sec - exiting 15:17:45 (5948): No heartbeat from core client for 30 sec - exiting 15:17:46 (5948): No heartbeat from core client for 30 sec - exiting 15:17:47 (5948): No heartbeat from core client for 30 sec - exiting 15:17:48 (5948): No heartbeat from core client for 30 sec - exiting 15:17:49 (5948): No heartbeat from core client for 30 sec - exiting 15:17:50 (5948): No heartbeat from core client for 30 sec - exiting 15:17:51 (5948): No heartbeat from core client for 30 sec - exiting 15:17:53 (5948): No heartbeat from core client for 30 sec - exiting 15:17:54 (5948): No heartbeat from core client for 30 sec - exiting 15:17:55 (5948): No heartbeat from core client for 30 sec - exiting 15:17:56 (5948): No heartbeat from core client for 30 sec - exiting 15:17:57 (5948): No heartbeat from core client for 30 sec - exiting 15:17:58 (5948): No heartbeat from core client for 30 sec - exiting 15:17:59 (5948): No heartbeat from core client for 30 sec - exiting 15:18:00 (5948): No heartbeat from core client for 30 sec - exiting 15:18:02 (5948): No heartbeat from core client for 30 sec - exiting 15:18:03 (5948): No heartbeat from core client for 30 sec - exiting 15:18:04 (5948): No heartbeat from core client for 30 sec - exiting 15:18:05 (5948): No heartbeat from core client for 30 sec - exiting 15:18:06 (5948): No heartbeat from core client for 30 sec - exiting 15:18:07 (5948): No heartbeat from core client for 30 sec - exiting 15:18:41 (5948): No heartbeat from core client for 30 sec - exiting 15:18:42 (5948): No heartbeat from core client for 30 sec - exiting 15:18:43 (5948): No heartbeat from core client for 30 sec - exiting 15:18:44 (5948): No heartbeat from core client for 30 sec - exiting 15:18:45 (5948): No heartbeat from core client for 30 sec - exiting 15:18:46 (5948): No heartbeat from core client for 30 sec - exiting 15:18:47 (5948): No heartbeat from core client for 30 sec - exiting 15:18:49 (5948): No heartbeat from core client for 30 sec - exiting 15:18:50 (5948): No heartbeat from core client for 30 sec - exiting 15:18:51 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:18:34 (5956): No heartbeat from core client for 30 sec - exiting 19:18:35 (5956): No heartbeat from core client for 30 sec - exiting 19:18:36 (5956): No heartbeat from core client for 30 sec - exiting 19:18:37 (5956): No heartbeat from core client for 30 sec - exiting 19:18:39 (5956): No heartbeat from core client for 30 sec - exiting 19:18:40 (5956): No heartbeat from core client for 30 sec - exiting 19:18:41 (5956): No heartbeat from core client for 30 sec - exiting 19:18:42 (5956): No heartbeat from core client for 30 sec - exiting 19:18:43 (5956): No heartbeat from core client for 30 sec - exiting 19:18:44 (5956): No heartbeat from core client for 30 sec - exiting 19:18:45 (5956): No heartbeat from core client for 30 sec - exiting 19:18:46 (5956): No heartbeat from core client for 30 sec - exiting 19:18:47 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:18:49 (5956): No heartbeat from core client for 30 sec - exiting 17:44:11 (3568): No heartbeat from core client for 30 sec - exiting 17:44:13 (3568): No heartbeat from core client for 30 sec - exiting 17:44:14 (3568): No heartbeat from core client for 30 sec - exiting 17:44:15 (3568): No heartbeat from core client for 30 sec - exiting 17:44:16 (3568): No heartbeat from core client for 30 sec - exiting 17:44:17 (3568): No heartbeat from core client for 30 sec - exiting 17:44:18 (3568): No heartbeat from core client for 30 sec - exiting 17:44:19 (3568): No heartbeat from core client for 30 sec - exiting 17:44:20 (3568): No heartbeat from core client for 30 sec - exiting 17:44:21 (3568): No heartbeat from core client for 30 sec - exiting 17:44:22 (3568): No heartbeat from core client for 30 sec - exiting 17:44:24 (3568): No heartbeat from core client for 30 sec - exiting 17:44:25 (3568): No heartbeat from core client for 30 sec - exiting 17:44:26 (3568): No heartbeat from core client for 30 sec - exiting 17:44:27 (3568): No heartbeat from core client for 30 sec - exiting 17:44:28 (3568): No heartbeat from core client for 30 sec - exiting 17:44:29 (3568): No heartbeat from core client for 30 sec - exiting 17:44:30 (3568): No heartbeat from core client for 30 sec - exiting 17:44:31 (3568): No heartbeat from core client for 30 sec - exiting 17:44:32 (3568): No heartbeat from core client for 30 sec - exiting 17:44:33 (3568): No heartbeat from core client for 30 sec - exiting 17:44:35 (3568): No heartbeat from core client for 30 sec - exiting 17:44:36 (3568): No heartbeat from core client for 30 sec - exiting 17:44:37 (3568): No heartbeat from core client for 30 sec - exiting 17:44:38 (3568): No heartbeat from core client for 30 sec - exiting 17:44:39 (3568): No heartbeat from core client for 30 sec - exiting 17:44:40 (3568): No heartbeat from core client for 30 sec - exiting 17:44:41 (3568): No heartbeat from core client for 30 sec - exiting 17:44:42 (3568): No heartbeat from core client for 30 sec - exiting 17:44:43 (3568): No heartbeat from core client for 30 sec - exiting 17:44:44 (3568): No heartbeat from core client for 30 sec - exiting 17:44:46 (3568): No heartbeat from core client for 30 sec - exiting 17:44:47 (3568): No heartbeat from core client for 30 sec - exiting 17:44:48 (3568): No heartbeat from core client for 30 sec - exiting 17:44:49 (3568): No heartbeat from core client for 30 sec - exiting 17:44:50 (3568): No heartbeat from core client for 30 sec - exiting 17:44:51 (3568): No heartbeat from core client for 30 sec - exiting 17:44:52 (3568): No heartbeat from core client for 30 sec - exiting 17:44:53 (3568): No heartbeat from core client for 30 sec - exiting 17:44:54 (3568): No heartbeat from core client for 30 sec - exiting 17:44:56 (3568): No heartbeat from core client for 30 sec - exiting 17:44:57 (3568): No heartbeat from core client for 30 sec - exiting 17:44:58 (3568): No heartbeat from core client for 30 sec - exiting 17:44:59 (3568): No heartbeat from core client for 30 sec - exiting 17:45:00 (3568): No heartbeat from core client for 30 sec - exiting 17:45:01 (3568): No heartbeat from core client for 30 sec - exiting 17:45:02 (3568): No heartbeat from core client for 30 sec - exiting 17:45:03 (3568): No heartbeat from core client for 30 sec - exiting 17:45:04 (3568): No heartbeat from core client for 30 sec - exiting 17:45:06 (3568): No heartbeat from core client for 30 sec - exiting 17:45:07 (3568): No heartbeat from core client for 30 sec - exiting 17:45:08 (3568): No heartbeat from core client for 30 sec - exiting 17:45:09 (3568): No heartbeat from core client for 30 sec - exiting 17:45:10 (3568): No heartbeat from core client for 30 sec - exiting 17:45:11 (3568): No heartbeat from core client for 30 sec - exiting 17:45:12 (3568): No heartbeat from core client for 30 sec - exiting 17:45:13 (3568): No heartbeat from core client for 30 sec - exiting 17:45:15 (3568): No heartbeat from core client for 30 sec - exiting 17:45:16 (3568): No heartbeat from core client for 30 sec - exiting 17:45:17 (3568): No heartbeat from core client for 30 sec - exiting 17:45:18 (3568): No heartbeat from core client for 30 sec - exiting 17:45:19 (3568): No heartbeat from core client for 30 sec - exiting 17:45:20 (3568): No heartbeat from core client for 30 sec - exiting 17:45:21 (3568): No heartbeat from core client for 30 sec - exiting 17:45:22 (3568): No heartbeat from core client for 30 sec - exiting 17:45:56 (3568): No heartbeat from core client for 30 sec - exiting 17:45:57 (3568): No heartbeat from core client for 30 sec - exiting 17:45:58 (3568): No heartbeat from core client for 30 sec - exiting 17:46:00 (3568): No heartbeat from core client for 30 sec - exiting 17:46:01 (3568): No heartbeat from core client for 30 sec - exiting 17:46:02 (3568): No heartbeat from core client for 30 sec - exiting 17:46:03 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4612, iMonCtr=1 Model crash detected, will try to restart... 09:51:22 (5888): No heartbeat from core client for 30 sec - exiting 09:51:23 (5888): No heartbeat from core client for 30 sec - exiting 09:51:24 (5888): No heartbeat from core client for 30 sec - exiting 09:51:25 (5888): No heartbeat from core client for 30 sec - exiting 09:51:26 (5888): No heartbeat from core client for 30 sec - exiting 09:51:27 (5888): No heartbeat from core client for 30 sec - exiting 09:51:29 (5888): No heartbeat from core client for 30 sec - exiting 09:51:30 (5888): No heartbeat from core client for 30 sec - exiting 09:51:31 (5888): No heartbeat from core client for 30 sec - exiting 09:51:32 (5888): No heartbeat from core client for 30 sec - exiting 09:51:33 (5888): No heartbeat from core client for 30 sec - exiting 09:51:34 (5888): No heartbeat from core client for 30 sec - exiting 09:51:35 (5888): No heartbeat from core client for 30 sec - exiting 09:51:36 (5888): No heartbeat from core client for 30 sec - exiting 09:51:38 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:31 (1348): No heartbeat from core client for 30 sec - exiting 09:23:33 (1348): No heartbeat from core client for 30 sec - exiting 09:23:34 (1348): No heartbeat from core client for 30 sec - exiting 09:23:35 (1348): No heartbeat from core client for 30 sec - exiting 09:23:36 (1348): No heartbeat from core client for 30 sec - exiting 09:23:37 (1348): No heartbeat from core client for 30 sec - exiting 09:23:38 (1348): No heartbeat from core client for 30 sec - exiting 09:23:39 (1348): No heartbeat from core client for 30 sec - exiting 09:23:40 (1348): No heartbeat from core client for 30 sec - exiting 09:23:41 (1348): No heartbeat from core client for 30 sec - exiting 09:23:42 (1348): No heartbeat from core client for 30 sec - exiting 09:23:44 (1348): No heartbeat from core client for 30 sec - exiting 09:23:45 (1348): No heartbeat from core client for 30 sec - exiting 09:23:46 (1348): No heartbeat from core client for 30 sec - exiting 09:23:47 (1348): No heartbeat from core client for 30 sec - exiting 09:23:48 (1348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:51 (6872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:25 (5172): No heartbeat from core client for 30 sec - exiting 14:48:26 (5172): No heartbeat from core client for 30 sec - exiting 14:48:27 (5172): No heartbeat from core client for 30 sec - exiting 14:48:28 (5172): No heartbeat from core client for 30 sec - exiting 14:48:29 (5172): No heartbeat from core client for 30 sec - exiting 14:48:31 (5172): No heartbeat from core client for 30 sec - exiting 14:48:32 (5172): No heartbeat from core client for 30 sec - exiting 14:48:33 (5172): No heartbeat from core client for 30 sec - exiting 14:48:34 (5172): No heartbeat from core client for 30 sec - exiting 14:48:35 (5172): No heartbeat from core client for 30 sec - exiting 14:48:36 (5172): No heartbeat from core client for 30 sec - exiting 14:48:37 (5172): No heartbeat from core client for 30 sec - exiting 14:48:38 (5172): No heartbeat from core client for 30 sec - exiting 14:48:39 (5172): No heartbeat from core client for 30 sec - exiting 14:48:40 (5172): No heartbeat from core client for 30 sec - exiting 14:48:42 (5172): No heartbeat from core client for 30 sec - exiting 14:48:43 (5172): No heartbeat from core client for 30 sec - exiting 14:48:44 (5172): No heartbeat from core client for 30 sec - exiting 14:48:45 (5172): No heartbeat from core client for 30 sec - exiting 14:48:46 (5172): No heartbeat from core client for 30 sec - exiting 14:48:47 (5172): No heartbeat from core client for 30 sec - exiting 14:48:48 (5172): No heartbeat from core client for 30 sec - exiting 14:48:49 (5172): No heartbeat from core client for 30 sec - exiting 14:48:50 (5172): No heartbeat from core client for 30 sec - exiting 14:48:51 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:52:08 (5896): No heartbeat from core client for 30 sec - exiting 12:52:09 (5896): No heartbeat from core client for 30 sec - exiting 12:52:10 (5896): No heartbeat from core client for 30 sec - exiting 12:52:11 (5896): No heartbeat from core client for 30 sec - exiting 12:52:12 (5896): No heartbeat from core client for 30 sec - exiting 12:52:13 (5896): No heartbeat from core client for 30 sec - exiting 12:52:14 (5896): No heartbeat from core client for 30 sec - exiting 12:52:15 (5896): No heartbeat from core client for 30 sec - exiting 12:52:16 (5896): No heartbeat from core client for 30 sec - exiting 12:52:18 (5896): No heartbeat from core client for 30 sec - exiting 12:52:19 (5896): No heartbeat from core client for 30 sec - exiting 12:52:20 (5896): No heartbeat from core client for 30 sec - exiting 12:52:21 (5896): No heartbeat from core client for 30 sec - exiting 12:52:22 (5896): No heartbeat from core client for 30 sec - exiting 12:52:23 (5896): No heartbeat from core client for 30 sec - exiting 12:52:24 (5896): No heartbeat from core client for 30 sec - exiting 12:52:25 (5896): No heartbeat from core client for 30 sec - exiting 12:52:26 (5896): No heartbeat from core client for 30 sec - exiting 12:52:27 (5896): No heartbeat from core client for 30 sec - exiting 12:52:29 (5896): No heartbeat from core client for 30 sec - exiting 12:52:30 (5896): No heartbeat from core client for 30 sec - exiting 12:52:31 (5896): No heartbeat from core client for 30 sec - exiting 12:52:32 (5896): No heartbeat from core client for 30 sec - exiting 12:53:06 (5896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:36 (5060): No heartbeat from core client for 30 sec - exiting 19:51:37 (5060): No heartbeat from core client for 30 sec - exiting 19:51:38 (5060): No heartbeat from core client for 30 sec - exiting 19:51:39 (5060): No heartbeat from core client for 30 sec - exiting 19:51:41 (5060): No heartbeat from core client for 30 sec - exiting 19:51:42 (5060): No heartbeat from core client for 30 sec - exiting 19:51:43 (5060): No heartbeat from core client for 30 sec - exiting 19:51:44 (5060): No heartbeat from core client for 30 sec - exiting 19:51:45 (5060): No heartbeat from core client for 30 sec - exiting 19:51:46 (5060): No heartbeat from core client for 30 sec - exiting 19:51:47 (5060): No heartbeat from core client for 30 sec - exiting 19:51:49 (5060): No heartbeat from core client for 30 sec - exiting 19:51:50 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:03 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:44 (5856): No heartbeat from core client for 30 sec - exiting 15:00:46 (5856): No heartbeat from core client for 30 sec - exiting 15:00:47 (5856): No heartbeat from core client for 30 sec - exiting 15:00:48 (5856): No heartbeat from core client for 30 sec - exiting 15:00:49 (5856): No heartbeat from core client for 30 sec - exiting 15:00:50 (5856): No heartbeat from core client for 30 sec - exiting 15:00:51 (5856): No heartbeat from core client for 30 sec - exiting 15:00:52 (5856): No heartbeat from core client for 30 sec - exiting 15:00:53 (5856): No heartbeat from core client for 30 sec - exiting 15:00:54 (5856): No heartbeat from core client for 30 sec - exiting 15:00:56 (5856): No heartbeat from core client for 30 sec - exiting 15:00:57 (5856): No heartbeat from core client for 30 sec - exiting 15:00:58 (5856): No heartbeat from core client for 30 sec - exiting 15:00:59 (5856): No heartbeat from core client for 30 sec - exiting 15:01:00 (5856): No heartbeat from core client for 30 sec - exiting 15:01:01 (5856): No heartbeat from core client for 30 sec - exiting 15:01:02 (5856): No heartbeat from core client for 30 sec - exiting 15:01:03 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:44:17 (3496): No heartbeat from core client for 30 sec - exiting 15:44:19 (3496): No heartbeat from core client for 30 sec - exiting 15:44:20 (3496): No heartbeat from core client for 30 sec - exiting 15:44:21 (3496): No heartbeat from core client for 30 sec - exiting 15:44:22 (3496): No heartbeat from core client for 30 sec - exiting 15:44:23 (3496): No heartbeat from core client for 30 sec - exiting 15:44:24 (3496): No heartbeat from core client for 30 sec - exiting 15:44:25 (3496): No heartbeat from core client for 30 sec - exiting 15:44:26 (3496): No heartbeat from core client for 30 sec - exiting 15:44:27 (3496): No heartbeat from core client for 30 sec - exiting 15:44:29 (3496): No heartbeat from core client for 30 sec - exiting 15:44:30 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:58 (5452): No heartbeat from core client for 30 sec - exiting 07:52:59 (5452): No heartbeat from core client for 30 sec - exiting 07:53:01 (5452): No heartbeat from core client for 30 sec - exiting 07:53:02 (5452): No heartbeat from core client for 30 sec - exiting 07:53:03 (5452): No heartbeat from core client for 30 sec - exiting 07:53:04 (5452): No heartbeat from core client for 30 sec - exiting 07:53:05 (5452): No heartbeat from core client for 30 sec - exiting 07:53:07 (5452): No heartbeat from core client for 30 sec - exiting 07:53:08 (5452): No heartbeat from core client for 30 sec - exiting 07:53:09 (5452): No heartbeat from core client for 30 sec - exiting 07:53:10 (5452): No heartbeat from core client for 30 sec - exiting 07:53:11 (5452): No heartbeat from core client for 30 sec - exiting 07:53:12 (5452): No heartbeat from core client for 30 sec - exiting 07:53:13 (5452): No heartbeat from core client for 30 sec - exiting 07:53:14 (5452): No heartbeat from core client for 30 sec - exiting 07:53:16 (5452): No heartbeat from core client for 30 sec - exiting 07:53:17 (5452): No heartbeat from core client for 30 sec - exiting 07:53:18 (5452): No heartbeat from core client for 30 sec - exiting 07:53:19 (5452): No heartbeat from core client for 30 sec - exiting 07:53:20 (5452): No heartbeat from core client for 30 sec - exiting 07:53:21 (5452): No heartbeat from core client for 30 sec - exiting 07:53:22 (5452): No heartbeat from core client for 30 sec - exiting 07:53:23 (5452): No heartbeat from core client for 30 sec - exiting 07:53:24 (5452): No heartbeat from core client for 30 sec - exiting 07:53:26 (5452): No heartbeat from core client for 30 sec - exiting 07:53:27 (5452): No heartbeat from core client for 30 sec - exiting 07:53:28 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:52:29 (4616): No heartbeat from core client for 30 sec - exiting 17:52:31 (4616): No heartbeat from core client for 30 sec - exiting 17:52:32 (4616): No heartbeat from core client for 30 sec - exiting 17:52:33 (4616): No heartbeat from core client for 30 sec - exiting 17:52:34 (4616): No heartbeat from core client for 30 sec - exiting 17:52:35 (4616): No heartbeat from core client for 30 sec - exiting 17:52:36 (4616): No heartbeat from core client for 30 sec - exiting 17:52:37 (4616): No heartbeat from core client for 30 sec - exiting 17:52:38 (4616): No heartbeat from core client for 30 sec - exiting 17:52:40 (4616): No heartbeat from core client for 30 sec - exiting 17:52:41 (4616): No heartbeat from core client for 30 sec - exiting 17:52:42 (4616): No heartbeat from core client for 30 sec - exiting 17:52:43 (4616): No heartbeat from core client for 30 sec - exiting 17:52:44 (4616): No heartbeat from core client for 30 sec - exiting 17:52:45 (4616): No heartbeat from core client for 30 sec - exiting 17:52:46 (4616): No heartbeat from core client for 30 sec - exiting 17:52:47 (4616): No heartbeat from core client for 30 sec - exiting 17:52:48 (4616): No heartbeat from core client for 30 sec - exiting 17:52:49 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:22 (248): No heartbeat from core client for 30 sec - exiting 21:02:23 (248): No heartbeat from core client for 30 sec - exiting 21:02:25 (248): No heartbeat from core client for 30 sec - exiting 21:02:26 (248): No heartbeat from core client for 30 sec - exiting 21:02:27 (248): No heartbeat from core client for 30 sec - exiting 21:02:28 (248): No heartbeat from core client for 30 sec - exiting 21:02:29 (248): No heartbeat from core client for 30 sec - exiting 21:02:30 (248): No heartbeat from core client for 30 sec - exiting 21:02:31 (248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:28 (5784): No heartbeat from core client for 30 sec - exiting 10:05:29 (5784): No heartbeat from core client for 30 sec - exiting 10:05:30 (5784): No heartbeat from core client for 30 sec - exiting 10:05:31 (5784): No heartbeat from core client for 30 sec - exiting 10:05:32 (5784): No heartbeat from core client for 30 sec - exiting 10:05:33 (5784): No heartbeat from core client for 30 sec - exiting 10:05:34 (5784): No heartbeat from core client for 30 sec - exiting 10:05:35 (5784): No heartbeat from core client for 30 sec - exiting 10:05:36 (5784): No heartbeat from core client for 30 sec - exiting 10:05:38 (5784): No heartbeat from core client for 30 sec - exiting 10:05:39 (5784): No heartbeat from core client for 30 sec - exiting 10:05:40 (5784): No heartbeat from core client for 30 sec - exiting 10:05:41 (5784): No heartbeat from core client for 30 sec - exiting 10:05:42 (5784): No heartbeat from core client for 30 sec - exiting 10:05:43 (5784): No heartbeat from core client for 30 sec - exiting 10:05:44 (5784): No heartbeat from core client for 30 sec - exiting 10:05:45 (5784): No heartbeat from core client for 30 sec - exiting 10:05:46 (5784): No heartbeat from core client for 30 sec - exiting 10:05:47 (5784): No heartbeat from core client for 30 sec - exiting 10:05:48 (5784): No heartbeat from core client for 30 sec - exiting 10:05:50 (5784): No heartbeat from core client for 30 sec - exiting 10:05:51 (5784): No heartbeat from core client for 30 sec - exiting 10:05:52 (5784): No heartbeat from core client for 30 sec - exiting 10:05:53 (5784): No heartbeat from core client for 30 sec - exiting 10:05:54 (5784): No heartbeat from core client for 30 sec - exiting 10:05:55 (5784): No heartbeat from core client for 30 sec - exiting 10:05:56 (5784): No heartbeat from core client for 30 sec - exiting 10:05:57 (5784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4960, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4632, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77AE3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77463AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Dec 2012 14:25:42	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	388,800	918,812	2.3632
29 Dec 2012 18:48:23	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	362,880	856,080	2.3591
27 Dec 2012 23:37:16	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	336,960	794,419	2.3576
25 Dec 2012 20:09:42	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	311,040	731,617	2.3522
23 Dec 2012 21:52:44	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	285,120	668,699	2.3453
21 Dec 2012 18:32:54	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	259,200	607,307	2.3430
20 Dec 2012 01:04:33	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	233,280	545,290	2.3375
17 Dec 2012 22:29:49	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	207,360	484,457	2.3363
15 Dec 2012 02:27:19	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	181,440	424,121	2.3375
13 Dec 2012 17:46:20	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	155,520	363,133	2.3350
06 Dec 2012 20:49:12	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	129,600	301,541	2.3267
03 Dec 2012 19:16:36	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	103,680	240,456	2.3192
28 Nov 2012 17:08:44	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	77,760	179,862	2.3130
24 Nov 2012 04:22:29	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	51,840	120,085	2.3165
21 Nov 2012 02:27:48	1251442	15435028	hadcm3n_zh4q_1920_40_008244503_0	25,920	59,314	2.2883