Task 13351785

Name	hadcm3n_t671_1940_40_007444378_3
Workunit	7641881
Created	9 Sep 2011, 4:33:11 UTC
Sent	9 Sep 2011, 4:36:29 UTC
Report deadline	9 Dec 2011, 12:03:40 UTC
Received	18 Mar 2012, 8:11:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1124341
Run time	9 days 11 hours 24 min 44 sec
CPU time	8 days 19 hours 34 min 17 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 06:40:08 (4412): No heartbeat from core client for 30 sec - exiting 06:40:09 (4412): No heartbeat from core client for 30 sec - exiting 06:40:11 (4412): No heartbeat from core client for 30 sec - exiting 06:40:12 (4412): No heartbeat from core client for 30 sec - exiting 06:40:13 (4412): No heartbeat from core client for 30 sec - exiting 06:40:14 (4412): No heartbeat from core client for 30 sec - exiting 06:40:15 (4412): No heartbeat from core client for 30 sec - exiting 06:40:16 (4412): No heartbeat from core client for 30 sec - exiting 06:40:17 (4412): No heartbeat from core client for 30 sec - exiting 06:40:18 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:00 (4620): No heartbeat from core client for 30 sec - exiting 17:27:01 (4620): No heartbeat from core client for 30 sec - exiting 17:27:02 (4620): No heartbeat from core client for 30 sec - exiting 17:27:03 (4620): No heartbeat from core client for 30 sec - exiting 17:27:05 (4620): No heartbeat from core client for 30 sec - exiting 17:27:06 (4620): No heartbeat from core client for 30 sec - exiting 17:27:07 (4620): No heartbeat from core client for 30 sec - exiting 17:27:08 (4620): No heartbeat from core client for 30 sec - exiting 17:27:09 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:58:46 (4572): No heartbeat from core client for 30 sec - exiting 00:58:47 (4572): No heartbeat from core client for 30 sec - exiting 00:58:48 (4572): No heartbeat from core client for 30 sec - exiting 00:58:50 (4572): No heartbeat from core client for 30 sec - exiting 00:58:51 (4572): No heartbeat from core client for 30 sec - exiting 00:58:52 (4572): No heartbeat from core client for 30 sec - exiting 00:58:53 (4572): No heartbeat from core client for 30 sec - exiting 00:58:54 (4572): No heartbeat from core client for 30 sec - exiting 00:58:55 (4572): No heartbeat from core client for 30 sec - exiting 00:58:56 (4572): No heartbeat from core client for 30 sec - exiting 00:58:57 (4572): No heartbeat from core client for 30 sec - exiting 00:58:58 (4572): No heartbeat from core client for 30 sec - exiting 00:58:59 (4572): No heartbeat from core client for 30 sec - exiting 00:59:00 (4572): No heartbeat from core client for 30 sec - exiting 00:59:02 (4572): No heartbeat from core client for 30 sec - exiting 00:59:03 (4572): No heartbeat from core client for 30 sec - exiting 00:59:04 (4572): No heartbeat from core client for 30 sec - exiting 00:59:05 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:06 (4572): No heartbeat from core client for 30 sec - exiting 09:06:56 (4388): No heartbeat from core client for 30 sec - exiting 09:06:57 (4388): No heartbeat from core client for 30 sec - exiting 09:06:58 (4388): No heartbeat from core client for 30 sec - exiting 09:07:00 (4388): No heartbeat from core client for 30 sec - exiting 09:07:01 (4388): No heartbeat from core client for 30 sec - exiting 09:07:02 (4388): No heartbeat from core client for 30 sec - exiting 09:07:03 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:28 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:06:59 (4136): No heartbeat from core client for 30 sec - exiting 19:07:00 (4136): No heartbeat from core client for 30 sec - exiting 19:07:01 (4136): No heartbeat from core client for 30 sec - exiting 19:07:02 (4136): No heartbeat from core client for 30 sec - exiting 19:07:03 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5616, iMonCtr=1 Model crash detected, will try to restart... 01:05:06 (4964): No heartbeat from core client for 30 sec - exiting 01:05:07 (4964): No heartbeat from core client for 30 sec - exiting 01:05:08 (4964): No heartbeat from core client for 30 sec - exiting 01:05:09 (4964): No heartbeat from core client for 30 sec - exiting 01:05:10 (4964): No heartbeat from core client for 30 sec - exiting 01:05:11 (4964): No heartbeat from core client for 30 sec - exiting 01:05:12 (4964): No heartbeat from core client for 30 sec - exiting 01:05:13 (4964): No heartbeat from core client for 30 sec - exiting 01:05:14 (4964): No heartbeat from core client for 30 sec - exiting 01:05:15 (4964): No heartbeat from core client for 30 sec - exiting 01:05:16 (4964): No heartbeat from core client for 30 sec - exiting 01:05:17 (4964): No heartbeat from core client for 30 sec - exiting 01:05:18 (4964): No heartbeat from core client for 30 sec - exiting 01:05:19 (4964): No heartbeat from core client for 30 sec - exiting 01:05:20 (4964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:21 (4964): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:25:37 (4576): No heartbeat from core client for 30 sec - exiting 08:25:38 (4576): No heartbeat from core client for 30 sec - exiting 08:25:39 (4576): No heartbeat from core client for 30 sec - exiting 08:25:40 (4576): No heartbeat from core client for 30 sec - exiting 08:25:41 (4576): No heartbeat from core client for 30 sec - exiting 08:25:42 (4576): No heartbeat from core client for 30 sec - exiting 08:25:43 (4576): No heartbeat from core client for 30 sec - exiting 08:25:45 (4576): No heartbeat from core client for 30 sec - exiting 08:25:46 (4576): No heartbeat from core client for 30 sec - exiting 08:25:47 (4576): No heartbeat from core client for 30 sec - exiting 08:25:48 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:08:06 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:35:59 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... 02:02:12 (4356): No heartbeat from core client for 30 sec - exiting 02:02:13 (4356): No heartbeat from core client for 30 sec - exiting 02:02:15 (4356): No heartbeat from core client for 30 sec - exiting 02:02:16 (4356): No heartbeat from core client for 30 sec - exiting 02:02:17 (4356): No heartbeat from core client for 30 sec - exiting 02:02:18 (4356): No heartbeat from core client for 30 sec - exiting 02:02:19 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:19 (3760): No heartbeat from core client for 30 sec - exiting 02:34:21 (3760): No heartbeat from core client for 30 sec - exiting 02:34:22 (3760): No heartbeat from core client for 30 sec - exiting 02:34:23 (3760): No heartbeat from core client for 30 sec - exiting 02:34:24 (3760): No heartbeat from core client for 30 sec - exiting 02:34:25 (3760): No heartbeat from core client for 30 sec - exiting 02:34:26 (3760): No heartbeat from core client for 30 sec - exiting 02:34:27 (3760): No heartbeat from core client for 30 sec - exiting 02:34:28 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:29 (3760): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=1 Model crash detected, will try to restart... 08:45:52 (4464): No heartbeat from core client for 30 sec - exiting 08:45:53 (4464): No heartbeat from core client for 30 sec - exiting 08:45:54 (4464): No heartbeat from core client for 30 sec - exiting 08:45:55 (4464): No heartbeat from core client for 30 sec - exiting 08:45:56 (4464): No heartbeat from core client for 30 sec - exiting 08:45:57 (4464): No heartbeat from core client for 30 sec - exiting 08:45:58 (4464): No heartbeat from core client for 30 sec - exiting 08:45:59 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:36 (3000): No heartbeat from core client for 30 sec - exiting 15:48:37 (3000): No heartbeat from core client for 30 sec - exiting 15:48:38 (3000): No heartbeat from core client for 30 sec - exiting 15:48:39 (3000): No heartbeat from core client for 30 sec - exiting 15:48:40 (3000): No heartbeat from core client for 30 sec - exiting 15:48:42 (3000): No heartbeat from core client for 30 sec - exiting 15:48:43 (3000): No heartbeat from core client for 30 sec - exiting 15:48:44 (3000): No heartbeat from core client for 30 sec - exiting 15:48:45 (3000): No heartbeat from core client for 30 sec - exiting 15:48:46 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:34 (4488): No heartbeat from core client for 30 sec - exiting 06:40:35 (4488): No heartbeat from core client for 30 sec - exiting 06:40:36 (4488): No heartbeat from core client for 30 sec - exiting 06:40:37 (4488): No heartbeat from core client for 30 sec - exiting 06:40:38 (4488): No heartbeat from core client for 30 sec - exiting 06:40:39 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:48 (4396): No heartbeat from core client for 30 sec - exiting 16:04:49 (4396): No heartbeat from core client for 30 sec - exiting 16:04:50 (4396): No heartbeat from core client for 30 sec - exiting 16:04:51 (4396): No heartbeat from core client for 30 sec - exiting 16:04:52 (4396): No heartbeat from core client for 30 sec - exiting 16:04:53 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:01:33 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:32 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:32:53 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:42:38 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:06:37 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:58 (4204): No heartbeat from core client for 30 sec - exiting 18:25:59 (4204): No heartbeat from core client for 30 sec - exiting 18:26:00 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:55:38 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:51 (1952): No heartbeat from core client for 30 sec - exiting 23:05:52 (1952): No heartbeat from core client for 30 sec - exiting 23:05:53 (1952): No heartbeat from core client for 30 sec - exiting 23:05:54 (1952): No heartbeat from core client for 30 sec - exiting 23:05:55 (1952): No heartbeat from core client for 30 sec - exiting 23:05:56 (1952): No heartbeat from core client for 30 sec - exiting 23:05:57 (1952): No heartbeat from core client for 30 sec - exiting 23:05:58 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:29:23 (3712): No heartbeat from core client for 30 sec - exiting 08:29:24 (3712): No heartbeat from core client for 30 sec - exiting 08:29:25 (3712): No heartbeat from core client for 30 sec - exiting 08:29:26 (3712): No heartbeat from core client for 30 sec - exiting 08:29:27 (3712): No heartbeat from core client for 30 sec - exiting 08:29:29 (3712): No heartbeat from core client for 30 sec - exiting 08:29:30 (3712): No heartbeat from core client for 30 sec - exiting 08:29:31 (3712): No heartbeat from core client for 30 sec - exiting 08:29:32 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:35:53 (3908): No heartbeat from core client for 30 sec - exiting 08:35:54 (3908): No heartbeat from core client for 30 sec - exiting 08:35:55 (3908): No heartbeat from core client for 30 sec - exiting 08:35:56 (3908): No heartbeat from core client for 30 sec - exiting 08:35:57 (3908): No heartbeat from core client for 30 sec - exiting 08:35:58 (3908): No heartbeat from core client for 30 sec - exiting 08:35:59 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:40:26 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:03 (2036): No heartbeat from core client for 30 sec - exiting 13:14:04 (2036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:11:40 (1948): No heartbeat from core client for 30 sec - exiting 22:11:41 (1948): No heartbeat from core client for 30 sec - exiting 22:11:42 (1948): No heartbeat from core client for 30 sec - exiting 22:11:43 (1948): No heartbeat from core client for 30 sec - exiting 22:11:44 (1948): No heartbeat from core client for 30 sec - exiting 22:11:46 (1948): No heartbeat from core client for 30 sec - exiting 22:11:47 (1948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:08:43 (392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:55 (3500): No heartbeat from core client for 30 sec - exiting 14:04:57 (3500): No heartbeat from core client for 30 sec - exiting 14:04:58 (3500): No heartbeat from core client for 30 sec - exiting 14:04:59 (3500): No heartbeat from core client for 30 sec - exiting 14:05:00 (3500): No heartbeat from core client for 30 sec - exiting 14:05:01 (3500): No heartbeat from core client for 30 sec - exiting 14:05:02 (3500): No heartbeat from core client for 30 sec - exiting 14:05:03 (3500): No heartbeat from core client for 30 sec - exiting 14:05:04 (3500): No heartbeat from core client for 30 sec - exiting 14:05:05 (3500): No heartbeat from core client for 30 sec - exiting 14:05:06 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:42 (2196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:36:26 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3048, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5260, selfPID=5260, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t671ko.pjf5c10 Error converting file to netcdf: dataout/t671ko.pif5c10 Error converting file to netcdf: dataout/t671ko.pff5c10 Error converting file to netcdf: dataout/t671ka.phf5c10 Error converting file to netcdf: dataout/t671ka.pgf5c10 Error converting file to netcdf: dataout/t671ka.pef5c10 15:01:20 (2840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:06:08 (3068): No heartbeat from core client for 30 sec - exiting 00:06:10 (3068): No heartbeat from core client for 30 sec - exiting 00:06:11 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:12:27 (428): No heartbeat from core client for 30 sec - exiting 07:12:28 (428): No heartbeat from core client for 30 sec - exiting 07:12:29 (428): No heartbeat from core client for 30 sec - exiting 07:12:31 (428): No heartbeat from core client for 30 sec - exiting 07:12:32 (428): No heartbeat from core client for 30 sec - exiting 07:12:33 (428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:22 (1816): No heartbeat from core client for 30 sec - exiting 22:17:23 (1816): No heartbeat from core client for 30 sec - exiting 22:17:24 (1816): No heartbeat from core client for 30 sec - exiting 22:17:25 (1816): No heartbeat from core client for 30 sec - exiting 22:17:26 (1816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:20:26 (1628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:58:32 (2880): No heartbeat from core client for 30 sec - exiting 14:58:34 (2880): No heartbeat from core client for 30 sec - exiting 14:58:35 (2880): No heartbeat from core client for 30 sec - exiting 14:58:36 (2880): No heartbeat from core client for 30 sec - exiting 14:58:37 (2880): No heartbeat from core client for 30 sec - exiting 14:58:38 (2880): No heartbeat from core client for 30 sec - exiting 14:58:39 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:31 (1672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:51:14 (1692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:07:50 (1252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:32:58 (1780): No heartbeat from core client for 30 sec - exiting 16:32:59 (1780): No heartbeat from core client for 30 sec - exiting 16:33:00 (1780): No heartbeat from core client for 30 sec - exiting 16:33:01 (1780): No heartbeat from core client for 30 sec - exiting 16:33:02 (1780): No heartbeat from core client for 30 sec - exiting 16:33:03 (1780): No heartbeat from core client for 30 sec - exiting 16:33:04 (1780): No heartbeat from core client for 30 sec - exiting 16:33:05 (1780): No heartbeat from core client for 30 sec - exiting 16:33:06 (1780): No heartbeat from core client for 30 sec - exiting 16:33:07 (1780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:42 (688): No heartbeat from core client for 30 sec - exiting 00:01:43 (688): No heartbeat from core client for 30 sec - exiting 00:01:44 (688): No heartbeat from core client for 30 sec - exiting 00:01:45 (688): No heartbeat from core client for 30 sec - exiting 00:01:46 (688): No heartbeat from core client for 30 sec - exiting 00:01:47 (688): No heartbeat from core client for 30 sec - exiting 00:01:48 (688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:13 (1740): No heartbeat from core client for 30 sec - exiting 08:14:15 (1740): No heartbeat from core client for 30 sec - exiting 08:14:16 (1740): No heartbeat from core client for 30 sec - exiting 08:14:17 (1740): No heartbeat from core client for 30 sec - exiting 08:14:18 (1740): No heartbeat from core client for 30 sec - exiting 08:14:19 (1740): No heartbeat from core client for 30 sec - exiting 08:14:20 (1740): No heartbeat from core client for 30 sec - exiting 08:14:21 (1740): No heartbeat from core client for 30 sec - exiting 08:14:22 (1740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:08:40 (3068): No heartbeat from core client for 30 sec - exiting 13:08:41 (3068): No heartbeat from core client for 30 sec - exiting 13:08:42 (3068): No heartbeat from core client for 30 sec - exiting 13:08:43 (3068): No heartbeat from core client for 30 sec - exiting 13:08:44 (3068): No heartbeat from core client for 30 sec - exiting 13:08:45 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:14:24 (1256): No heartbeat from core client for 30 sec - exiting 17:14:25 (1256): No heartbeat from core client for 30 sec - exiting 17:14:26 (1256): No heartbeat from core client for 30 sec - exiting 17:14:27 (1256): No heartbeat from core client for 30 sec - exiting 17:14:28 (1256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:10:18 (2088): No heartbeat from core client for 30 sec - exiting 17:10:19 (2088): No heartbeat from core client for 30 sec - exiting 17:10:20 (2088): No heartbeat from core client for 30 sec - exiting 17:10:21 (2088): No heartbeat from core client for 30 sec - exiting 17:10:22 (2088): No heartbeat from core client for 30 sec - exiting 17:10:23 (2088): No heartbeat from core client for 30 sec - exiting 17:10:24 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2112, iMonCtr=1 Model crash detected, will try to restart... 06:15:29 (3068): No heartbeat from core client for 30 sec - exiting 06:15:30 (3068): No heartbeat from core client for 30 sec - exiting 06:15:32 (3068): No heartbeat from core client for 30 sec - exiting 06:15:33 (3068): No heartbeat from core client for 30 sec - exiting 06:15:34 (3068): No heartbeat from core client for 30 sec - exiting 06:15:35 (3068): No heartbeat from core client for 30 sec - exiting 06:15:36 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:37 (3068): No heartbeat from core client for 30 sec - exiting 14:39:16 (1164): No heartbeat from core client for 30 sec - exiting 14:39:17 (1164): No heartbeat from core client for 30 sec - exiting 14:39:18 (1164): No heartbeat from core client for 30 sec - exiting 14:39:19 (1164): No heartbeat from core client for 30 sec - exiting 14:39:20 (1164): No heartbeat from core client for 30 sec - exiting 14:39:21 (1164): No heartbeat from core client for 30 sec - exiting 14:39:23 (1164): No heartbeat from core client for 30 sec - exiting 14:39:24 (1164): No heartbeat from core client for 30 sec - exiting 14:39:25 (1164): No heartbeat from core client for 30 sec - exiting 14:39:26 (1164): No heartbeat from core client for 30 sec - exiting 14:39:27 (1164): No heartbeat from core client for 30 sec - exiting 14:39:28 (1164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:57:12 (1624): No heartbeat from core client for 30 sec - exiting 13:57:13 (1624): No heartbeat from core client for 30 sec - exiting 13:57:14 (1624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:24:07 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:17:31 (2180): No heartbeat from core client for 30 sec - exiting 15:17:32 (2180): No heartbeat from core client for 30 sec - exiting 15:17:33 (2180): No heartbeat from core client for 30 sec - exiting 15:17:34 (2180): No heartbeat from core client for 30 sec - exiting 15:17:35 (2180): No heartbeat from core client for 30 sec - exiting 15:17:36 (2180): No heartbeat from core client for 30 sec - exiting 15:17:37 (2180): No heartbeat from core client for 30 sec - exiting 15:17:39 (2180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:30:24 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:28:32 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77A23F99 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Mar 2012 20:43:16	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	518,400	751,342	1.4493
31 Oct 2011 16:46:37	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	492,480	715,955	1.4538
31 Oct 2011 15:26:12	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	466,560	678,275	1.4538
31 Oct 2011 15:26:12	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	440,640	640,678	1.4540
31 Oct 2011 15:26:11	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	414,720	602,556	1.4529
16 Oct 2011 18:47:09	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	388,800	565,172	1.4536
14 Oct 2011 04:35:36	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	362,880	528,735	1.4571
09 Oct 2011 14:37:11	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	336,960	492,388	1.4613
05 Oct 2011 23:14:05	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	311,040	456,388	1.4673
02 Oct 2011 15:52:09	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	285,120	418,954	1.4694
01 Oct 2011 12:26:59	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	259,200	381,922	1.4735
29 Sep 2011 18:11:59	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	233,280	344,899	1.4785
27 Sep 2011 04:40:21	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	207,360	308,903	1.4897
25 Sep 2011 17:06:02	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	181,440	271,064	1.4940
22 Sep 2011 19:27:05	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	155,520	232,505	1.4950
20 Sep 2011 13:46:19	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	129,600	193,751	1.4950
13 Sep 2011 01:43:55	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	103,680	154,341	1.4886
12 Sep 2011 14:18:03	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	77,760	115,042	1.4794
11 Sep 2011 10:33:39	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	51,840	76,172	1.4694
10 Sep 2011 16:28:19	1124341	13351785	hadcm3n_t671_1940_40_007444378_3	25,920	38,148	1.4718