Task 15073233

Name	hadcm3n_100j_1980_40_007955748_2
Workunit	8110860
Created	8 Aug 2012, 5:11:27 UTC
Sent	8 Aug 2012, 5:11:32 UTC
Report deadline	7 Nov 2012, 12:38:43 UTC
Received	19 Sep 2012, 11:58:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1111322
Run time	30 days 9 hours 23 min 17 sec
CPU time	26 days 20 hours 49 min 28 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.31 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 00:35:13 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:14 (3252): No heartbeat from core client for 30 sec - exiting 00:35:15 (3252): No heartbeat from core client for 30 sec - exiting 00:35:16 (3252): No heartbeat from core client for 30 sec - exiting 00:35:17 (3252): No heartbeat from core client for 30 sec - exiting 00:35:18 (3252): No heartbeat from core client for 30 sec - exiting 00:35:19 (3252): No heartbeat from core client for 30 sec - exiting 00:35:20 (3252): No heartbeat from core client for 30 sec - exiting 00:35:21 (3252): No heartbeat from core client for 30 sec - exiting 00:35:22 (3252): No heartbeat from core client for 30 sec - exiting 00:35:23 (3252): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1472, iMonCtr=1 Model crash detected, will try to restart... 00:35:47 (1472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:45:41 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:41 (7928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:26:05 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:49 (5632): No heartbeat from core client for 30 sec - exiting 19:49:50 (5632): No heartbeat from core client for 30 sec - exiting 19:49:52 (5632): No heartbeat from core client for 30 sec - exiting 19:49:53 (5632): No heartbeat from core client for 30 sec - exiting 19:49:54 (5632): No heartbeat from core client for 30 sec - exiting 19:49:56 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:57 (5632): No heartbeat from core client for 30 sec - exiting 19:32:47 (880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:41:21 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:50 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:50:54 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:50 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:11 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:12 (5320): No heartbeat from core client for 30 sec - exiting 01:20:13 (5320): No heartbeat from core client for 30 sec - exiting 01:20:14 (5320): No heartbeat from core client for 30 sec - exiting 01:20:15 (5320): No heartbeat from core client for 30 sec - exiting 01:20:16 (5320): No heartbeat from core client for 30 sec - exiting 01:20:17 (5320): No heartbeat from core client for 30 sec - exiting 01:20:18 (5320): No heartbeat from core client for 30 sec - exiting 01:20:19 (5320): No heartbeat from core client for 30 sec - exiting 01:20:20 (5320): No heartbeat from core client for 30 sec - exiting 01:20:21 (5320): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:59:43 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:42:00 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:15 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 02:44:20 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:44:11 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:06 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:10 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:11 (4704): No heartbeat from core client for 30 sec - exiting 22:51:04 (2684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:51:05 (2684): No heartbeat from core client for 30 sec - exiting 00:21:20 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:49 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:19:16 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:51:07 (872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:49 (8180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:17 (1796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:19 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:28 (2276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:26 (6620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:21:32 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:49 (3328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:40 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:24 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:24:25 (7224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:21:59 (6244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:42 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:44 (5972): No heartbeat from core client for 30 sec - exiting 18:58:07 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:08 (5584): No heartbeat from core client for 30 sec - exiting 19:01:31 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:33 (4184): No heartbeat from core client for 30 sec - exiting 19:05:08 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:09 (4556): No heartbeat from core client for 30 sec - exiting 19:08:31 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:32 (2232): No heartbeat from core client for 30 sec - exiting 19:11:56 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:57 (4912): No heartbeat from core client for 30 sec - exiting 19:15:32 (1376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:33 (1376): No heartbeat from core client for 30 sec - exiting 19:18:56 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:18:57 (5856): No heartbeat from core client for 30 sec - exiting 19:22:21 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:22 (4472): No heartbeat from core client for 30 sec - exiting 19:25:58 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:59 (4824): No heartbeat from core client for 30 sec - exiting 19:29:20 (308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:21 (308): No heartbeat from core client for 30 sec - exiting 19:32:45 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:46 (4816): No heartbeat from core client for 30 sec - exiting 19:36:21 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:22 (2096): No heartbeat from core client for 30 sec - exiting 19:39:43 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:44 (4752): No heartbeat from core client for 30 sec - exiting 19:43:08 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:09 (5792): No heartbeat from core client for 30 sec - exiting 19:46:33 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:34 (2980): No heartbeat from core client for 30 sec - exiting 19:49:57 (5588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:58 (5588): No heartbeat from core client for 30 sec - exiting 19:53:33 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:34 (4300): No heartbeat from core client for 30 sec - exiting 19:56:56 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:57 (5204): No heartbeat from core client for 30 sec - exiting 20:00:21 (5804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:23 (5804): No heartbeat from core client for 30 sec - exiting 20:03:58 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:00 (4036): No heartbeat from core client for 30 sec - exiting 20:07:21 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:23 (4352): No heartbeat from core client for 30 sec - exiting 20:10:45 (5276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:46 (5276): No heartbeat from core client for 30 sec - exiting 20:14:23 (3664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:24 (3664): No heartbeat from core client for 30 sec - exiting 20:17:46 (3628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:47 (3628): No heartbeat from core client for 30 sec - exiting 20:21:11 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:13 (5648): No heartbeat from core client for 30 sec - exiting 20:24:47 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:49 (5144): No heartbeat from core client for 30 sec - exiting 20:28:10 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:11 (5164): No heartbeat from core client for 30 sec - exiting 20:31:35 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:36 (5736): No heartbeat from core client for 30 sec - exiting 20:35:12 (5956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:14 (5956): No heartbeat from core client for 30 sec - exiting 20:38:36 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:37 (3496): No heartbeat from core client for 30 sec - exiting 20:48:15 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:16 (3452): No heartbeat from core client for 30 sec - exiting 20:51:52 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:53 (4432): No heartbeat from core client for 30 sec - exiting 20:55:15 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:16 (2972): No heartbeat from core client for 30 sec - exiting 20:58:40 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:41 (5488): No heartbeat from core client for 30 sec - exiting 21:02:18 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:19 (4632): No heartbeat from core client for 30 sec - exiting 21:05:42 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:43 (4592): No heartbeat from core client for 30 sec - exiting 21:09:07 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:08 (5540): No heartbeat from core client for 30 sec - exiting 21:12:44 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:45 (5332): No heartbeat from core client for 30 sec - exiting 21:16:08 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:09 (4184): No heartbeat from core client for 30 sec - exiting 21:19:32 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:33 (4764): No heartbeat from core client for 30 sec - exiting 21:29:10 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:11 (4804): No heartbeat from core client for 30 sec - exiting 21:32:34 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:35 (5968): No heartbeat from core client for 30 sec - exiting 21:35:59 (2080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:00 (2080): No heartbeat from core client for 30 sec - exiting 21:39:36 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:37 (5504): No heartbeat from core client for 30 sec - exiting 21:42:59 (292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:01 (292): No heartbeat from core client for 30 sec - exiting 21:46:24 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:25 (6004): No heartbeat from core client for 30 sec - exiting 21:50:01 (336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:50:03 (336): No heartbeat from core client for 30 sec - exiting 21:53:25 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:27 (4760): No heartbeat from core client for 30 sec - exiting 21:56:49 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:50 (4700): No heartbeat from core client for 30 sec - exiting 22:00:27 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:28 (5900): No heartbeat from core client for 30 sec - exiting 22:03:51 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:52 (5512): No heartbeat from core client for 30 sec - exiting 22:07:15 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:17 (5384): No heartbeat from core client for 30 sec - exiting 22:10:53 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:54 (5904): No heartbeat from core client for 30 sec - exiting 22:14:16 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:17 (5132): No heartbeat from core client for 30 sec - exiting 22:17:41 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:17:43 (6016): No heartbeat from core client for 30 sec - exiting 22:21:19 (5228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:21:20 (5228): No heartbeat from core client for 30 sec - exiting 22:24:42 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:43 (4700): No heartbeat from core client for 30 sec - exiting 22:28:06 (4552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:08 (4552): No heartbeat from core client for 30 sec - exiting 22:31:44 (5592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:31:45 (5592): No heartbeat from core client for 30 sec - exiting 22:35:08 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:09 (4660): No heartbeat from core client for 30 sec - exiting 22:38:31 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:33 (6104): No heartbeat from core client for 30 sec - exiting 22:41:56 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:41:58 (4412): No heartbeat from core client for 30 sec - exiting 22:45:21 (5460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:22 (5460): No heartbeat from core client for 30 sec - exiting 22:49:02 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:03 (4596): No heartbeat from core client for 30 sec - exiting 22:52:25 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:52:26 (3576): No heartbeat from core client for 30 sec - exiting 22:55:49 (456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:50 (456): No heartbeat from core client for 30 sec - exiting 22:59:26 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:59:27 (4740): No heartbeat from core client for 30 sec - exiting 23:02:51 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:52 (5060): No heartbeat from core client for 30 sec - exiting 23:06:15 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:06:16 (4612): No heartbeat from core client for 30 sec - exiting 23:09:58 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:09:59 (5300): No heartbeat from core client for 30 sec - exiting 23:13:20 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:13:21 (5628): No heartbeat from core client for 30 sec - exiting 23:16:45 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:46 (5484): No heartbeat from core client for 30 sec - exiting 23:20:24 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:20:25 (4824): No heartbeat from core client for 30 sec - exiting 23:23:48 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:23:49 (4128): No heartbeat from core client for 30 sec - exiting 23:27:14 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:15 (4352): No heartbeat from core client for 30 sec - exiting 23:30:51 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:53 (3672): No heartbeat from core client for 30 sec - exiting 23:34:16 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:17 (5160): No heartbeat from core client for 30 sec - exiting 23:37:42 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:43 (6040): No heartbeat from core client for 30 sec - exiting 23:41:20 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:41:21 (5136): No heartbeat from core client for 30 sec - exiting 23:44:44 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:45 (5928): No heartbeat from core client for 30 sec - exiting 23:48:08 (1368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:09 (1368): No heartbeat from core client for 30 sec - exiting 23:51:44 (4816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:46 (4816): No heartbeat from core client for 30 sec - exiting 23:55:08 (6096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:10 (6096): No heartbeat from core client for 30 sec - exiting 23:58:50 (2772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:58:51 (2772): No heartbeat from core client for 30 sec - exiting 00:02:08 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:09 (4352): No heartbeat from core client for 30 sec - exiting 00:08:38 (264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:08:40 (264): No heartbeat from core client for 30 sec - exiting 00:12:02 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:03 (5332): No heartbeat from core client for 30 sec - exiting 00:18:42 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:43 (4160): No heartbeat from core client for 30 sec - exiting 00:21:51 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:22:01 (5888): No heartbeat from core client for 30 sec - exiting 00:23:34 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:36 (5816): No heartbeat from core client for 30 sec - exiting 00:32:57 (3276): No heartbeat from core client for 30 sec - exiting 00:33:04 (3276): No heartbeat from core client for 30 sec - exiting 00:33:10 (3276): No heartbeat from core client for 30 sec - exiting 00:33:17 (3276): No heartbeat from core client for 30 sec - exiting 00:33:24 (3276): No heartbeat from core client for 30 sec - exiting 00:33:29 (3276): No heartbeat from core client for 30 sec - exiting 00:33:35 (3276): No heartbeat from core client for 30 sec - exiting 00:33:40 (3276): No heartbeat from core client for 30 sec - exiting 00:33:45 (3276): No heartbeat from core client for 30 sec - exiting 00:33:50 (3276): No heartbeat from core client for 30 sec - exiting 00:33:55 (3276): No heartbeat from core client for 30 sec - exiting 00:33:58 (3276): No heartbeat from core client for 30 sec - exiting 00:33:59 (3276): No heartbeat from core client for 30 sec - exiting 00:34:01 (3276): No heartbeat from core client for 30 sec - exiting 00:34:03 (3276): No heartbeat from core client for 30 sec - exiting 00:34:05 (3276): No heartbeat from core client for 30 sec - exiting 00:34:08 (3276): No heartbeat from core client for 30 sec - exiting 00:34:12 (3276): No heartbeat from core client for 30 sec - exiting 00:34:14 (3276): No heartbeat from core client for 30 sec - exiting 00:34:17 (3276): No heartbeat from core client for 30 sec - exiting 00:34:20 (3276): No heartbeat from core client for 30 sec - exiting 00:34:22 (3276): No heartbeat from core client for 30 sec - exiting 00:34:27 (3276): No heartbeat from core client for 30 sec - exiting 00:34:28 (3276): No heartbeat from core client for 30 sec - exiting 00:34:30 (3276): No heartbeat from core client for 30 sec - exiting 00:34:32 (3276): No heartbeat from core client for 30 sec - exiting 00:34:35 (3276): No heartbeat from core client for 30 sec - exiting 00:34:37 (3276): No heartbeat from core client for 30 sec - exiting 00:34:40 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:42 (3276): No heartbeat from core client for 30 sec - exiting 00:35:55 (2420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:00 (2420): No heartbeat from core client for 30 sec - exiting 00:41:45 (5888): No heartbeat from core client for 30 sec - exiting 00:41:48 (5888): No heartbeat from core client for 30 sec - exiting 00:41:54 (5888): No heartbeat from core client for 30 sec - exiting 00:41:58 (5888): No heartbeat from core client for 30 sec - exiting 00:42:03 (5888): No heartbeat from core client for 30 sec - exiting 00:42:08 (5888): No heartbeat from core client for 30 sec - exiting 00:42:10 (5888): No heartbeat from core client for 30 sec - exiting 00:42:14 (5888): No heartbeat from core client for 30 sec - exiting 00:42:15 (5888): No heartbeat from core client for 30 sec - exiting 00:42:17 (5888): No heartbeat from core client for 30 sec - exiting 00:42:21 (5888): No heartbeat from core client for 30 sec - exiting 00:42:25 (5888): No heartbeat from core client for 30 sec - exiting 00:42:30 (5888): No heartbeat from core client for 30 sec - exiting 00:42:34 (5888): No heartbeat from core client for 30 sec - exiting 00:42:38 (5888): No heartbeat from core client for 30 sec - exiting 00:42:41 (5888): No heartbeat from core client for 30 sec - exiting 00:42:43 (5888): No heartbeat from core client for 30 sec - exiting 00:42:47 (5888): No heartbeat from core client for 30 sec - exiting 00:42:51 (5888): No heartbeat from core client for 30 sec - exiting 00:42:55 (5888): No heartbeat from core client for 30 sec - exiting 00:43:00 (5888): No heartbeat from core client for 30 sec - exiting 00:43:04 (5888): No heartbeat from core client for 30 sec - exiting 00:43:09 (5888): No heartbeat from core client for 30 sec - exiting 00:43:12 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:43:15 (5888): No heartbeat from core client for 30 sec - exiting 00:44:21 (5368): No heartbeat from core client for 30 sec - exiting 00:44:23 (5368): No heartbeat from core client for 30 sec - exiting 00:44:26 (5368): No heartbeat from core client for 30 sec - exiting 00:44:28 (5368): No heartbeat from core client for 30 sec - exiting 00:44:29 (5368): No heartbeat from core client for 30 sec - exiting 00:44:31 (5368): No heartbeat from core client for 30 sec - exiting 00:44:33 (5368): No heartbeat from core client for 30 sec - exiting 00:44:34 (5368): No heartbeat from core client for 30 sec - exiting 00:44:36 (5368): No heartbeat from core client for 30 sec - exiting 00:44:37 (5368): No heartbeat from core client for 30 sec - exiting 00:44:41 (5368): No heartbeat from core client for 30 sec - exiting 00:44:43 (5368): No heartbeat from core client for 30 sec - exiting 00:44:48 (5368): No heartbeat from core client for 30 sec - exiting 00:44:52 (5368): No heartbeat from core client for 30 sec - exiting 00:44:54 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:56 (5368): No heartbeat from core client for 30 sec - exiting 00:46:57 (1132): No heartbeat from core client for 30 sec - exiting 00:47:18 (1132): No heartbeat from core client for 30 sec - exiting 00:47:29 (1132): No heartbeat from core client for 30 sec - exiting 00:47:33 (1132): No heartbeat from core client for 30 sec - exiting 00:47:37 (1132): No heartbeat from core client for 30 sec - exiting 00:47:41 (1132): No heartbeat from core client for 30 sec - exiting 00:47:46 (1132): No heartbeat from core client for 30 sec - exiting 00:47:51 (1132): No heartbeat from core client for 30 sec - exiting 00:47:55 (1132): No heartbeat from core client for 30 sec - exiting 00:48:00 (1132): No heartbeat from core client for 30 sec - exiting 00:48:04 (1132): No heartbeat from core client for 30 sec - exiting 00:48:10 (1132): No heartbeat from core client for 30 sec - exiting 00:48:16 (1132): No heartbeat from core client for 30 sec - exiting 00:48:21 (1132): No heartbeat from core client for 30 sec - exiting 00:48:27 (1132): No heartbeat from core client for 30 sec - exiting 00:48:33 (1132): No heartbeat from core client for 30 sec - exiting 00:48:37 (1132): No heartbeat from core client for 30 sec - exiting 00:48:42 (1132): No heartbeat from core client for 30 sec - exiting 00:48:48 (1132): No heartbeat from core client for 30 sec - exiting 00:48:53 (1132): No heartbeat from core client for 30 sec - exiting 00:48:59 (1132): No heartbeat from core client for 30 sec - exiting 00:49:05 (1132): No heartbeat from core client for 30 sec - exiting 00:49:10 (1132): No heartbeat from core client for 30 sec - exiting 00:49:15 (1132): No heartbeat from core client for 30 sec - exiting 00:49:21 (1132): No heartbeat from core client for 30 sec - exiting 00:49:27 (1132): No heartbeat from core client for 30 sec - exiting 00:49:33 (1132): No heartbeat from core client for 30 sec - exiting 00:49:40 (1132): No heartbeat from core client for 30 sec - exiting 00:49:46 (1132): No heartbeat from core client for 30 sec - exiting 00:49:52 (1132): No heartbeat from core client for 30 sec - exiting 00:49:57 (1132): No heartbeat from core client for 30 sec - exiting 00:50:03 (1132): No heartbeat from core client for 30 sec - exiting 00:50:08 (1132): No heartbeat from core client for 30 sec - exiting 00:50:14 (1132): No heartbeat from core client for 30 sec - exiting 00:50:20 (1132): No heartbeat from core client for 30 sec - exiting 00:50:27 (1132): No heartbeat from core client for 30 sec - exiting 00:50:34 (1132): No heartbeat from core client for 30 sec - exiting 00:50:42 (1132): No heartbeat from core client for 30 sec - exiting 00:50:49 (1132): No heartbeat from core client for 30 sec - exiting 00:50:57 (1132): No heartbeat from core client for 30 sec - exiting 00:51:03 (1132): No heartbeat from core client for 30 sec - exiting 00:51:09 (1132): No heartbeat from core client for 30 sec - exiting 00:51:16 (1132): No heartbeat from core client for 30 sec - exiting 00:51:24 (1132): No heartbeat from core client for 30 sec - exiting 00:51:29 (1132): No heartbeat from core client for 30 sec - exiting 00:51:35 (1132): No heartbeat from core client for 30 sec - exiting 00:51:41 (1132): No heartbeat from core client for 30 sec - exiting 00:51:47 (1132): No heartbeat from core client for 30 sec - exiting 00:51:52 (1132): No heartbeat from core client for 30 sec - exiting 00:51:57 (1132): No heartbeat from core client for 30 sec - exiting 00:51:59 (1132): No heartbeat from core client for 30 sec - exiting 00:52:04 (1132): No heartbeat from core client for 30 sec - exiting 00:52:08 (1132): No heartbeat from core client for 30 sec - exiting 00:52:14 (1132): No heartbeat from core client for 30 sec - exiting 00:52:19 (1132): No heartbeat from core client for 30 sec - exiting 00:52:25 (1132): No heartbeat from core client for 30 sec - exiting 00:52:26 (1132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:50 (1132): No heartbeat from core client for 30 sec - exiting 00:56:07 (4488): No heartbeat from core client for 30 sec - exiting 00:56:15 (4488): No heartbeat from core client for 30 sec - exiting 00:56:18 (4488): No heartbeat from core client for 30 sec - exiting 00:56:27 (4488): No heartbeat from core client for 30 sec - exiting 00:56:29 (4488): No heartbeat from core client for 30 sec - exiting 00:56:35 (4488): No heartbeat from core client for 30 sec - exiting 00:56:47 (4488): No heartbeat from core client for 30 sec - exiting 00:56:58 (4488): No heartbeat from core client for 30 sec - exiting 00:57:02 (4488): No heartbeat from core client for 30 sec - exiting 00:57:18 (4488): No heartbeat from core client for 30 sec - exiting 00:57:25 (4488): No heartbeat from core client for 30 sec - exiting 00:57:31 (4488): No heartbeat from core client for 30 sec - exiting 00:57:35 (4488): No heartbeat from core client for 30 sec - exiting 00:57:38 (4488): No heartbeat from core client for 30 sec - exiting 00:57:43 (4488): No heartbeat from core client for 30 sec - exiting 00:57:47 (4488): No heartbeat from core client for 30 sec - exiting 00:57:54 (4488): No heartbeat from core client for 30 sec - exiting 00:57:58 (4488): No heartbeat from core client for 30 sec - exiting 00:58:04 (4488): No heartbeat from core client for 30 sec - exiting 00:58:06 (4488): No heartbeat from core client for 30 sec - exiting 00:58:08 (4488): No heartbeat from core client for 30 sec - exiting 00:58:13 (4488): No heartbeat from core client for 30 sec - exiting 00:58:17 (4488): No heartbeat from core client for 30 sec - exiting 00:58:21 (4488): No heartbeat from core client for 30 sec - exiting 00:58:26 (4488): No heartbeat from core client for 30 sec - exiting 00:58:31 (4488): No heartbeat from core client for 30 sec - exiting 00:58:38 (4488): No heartbeat from core client for 30 sec - exiting 00:58:44 (4488): No heartbeat from core client for 30 sec - exiting 00:58:49 (4488): No heartbeat from core client for 30 sec - exiting 00:58:53 (4488): No heartbeat from core client for 30 sec - exiting 00:58:55 (4488): No heartbeat from core client for 30 sec - exiting 00:58:58 (4488): No heartbeat from core client for 30 sec - exiting 00:58:59 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:01 (4488): No heartbeat from core client for 30 sec - exiting 00:59:50 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:57 (6140): No heartbeat from core client for 30 sec - exiting 01:01:50 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:51 (4624): No heartbeat from core client for 30 sec - exiting 01:03:29 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:39 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 02:18:56 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:58 (4912): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:10:29 (1872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:42:06 (7496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5432, selfPID=5432, iMonCtr=1 13:07:58 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:00 (5660): No heartbeat from core client for 30 sec - exiting 13:09:36 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:37 (4160): No heartbeat from core client for 30 sec - exiting 13:10:23 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:25 (3752): No heartbeat from core client for 30 sec - exiting 13:11:22 (4240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:11:24 (4240): No heartbeat from core client for 30 sec - exiting 13:13:36 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:37 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77186E5F read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6016, selfPID=6016, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77161BD4 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Sep 2012 05:34:45	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	518,400	2,320,986	4.4772
17 Sep 2012 05:34:30	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	492,480	2,239,465	4.5473
12 Sep 2012 14:36:03	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	466,560	2,111,770	4.5263
06 Sep 2012 21:31:25	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	440,640	1,988,206	4.5121
02 Sep 2012 22:33:52	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	414,720	1,866,765	4.5013
01 Sep 2012 10:40:48	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	388,800	1,750,747	4.5030
30 Aug 2012 23:03:05	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	362,880	1,633,876	4.5025
29 Aug 2012 10:30:47	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	336,960	1,512,174	4.4877
27 Aug 2012 20:47:39	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	311,040	1,389,556	4.4675
26 Aug 2012 07:50:06	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	285,120	1,266,355	4.4415
24 Aug 2012 20:41:43	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	259,200	1,149,178	4.4336
23 Aug 2012 09:06:30	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	233,280	1,030,800	4.4187
21 Aug 2012 07:14:35	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	207,360	911,386	4.3952
19 Aug 2012 18:42:15	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	181,440	807,476	4.4504
18 Aug 2012 13:39:58	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	155,520	706,998	4.5460
17 Aug 2012 03:48:56	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	129,600	594,720	4.5889
15 Aug 2012 08:24:55	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	103,680	474,734	4.5788
13 Aug 2012 20:53:37	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	77,760	357,454	4.5969
12 Aug 2012 04:49:35	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	51,840	239,068	4.6117
10 Aug 2012 16:38:39	1111322	15073233	hadcm3n_100j_1980_40_007955748_2	25,920	118,470	4.5706