Task 12738130

Name	hadcm3n_o2f8_1900_40_007198471_1
Workunit	7396751
Created	28 Mar 2011, 14:03:30 UTC
Sent	1 Apr 2011, 1:08:29 UTC
Report deadline	1 Jul 2011, 8:35:40 UTC
Received	28 Apr 2011, 22:47:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	976430
Run time	7 days 10 hours 47 min 54 sec
CPU time	5 days 23 hours 54 min 34 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.67 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 03:21:38 (6172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:21:39 (6172): No heartbeat from core client for 30 sec - exiting 03:21:40 (6172): No heartbeat from core client for 30 sec - exiting 03:21:41 (6172): No heartbeat from core client for 30 sec - exiting 03:21:42 (6172): No heartbeat from core client for 30 sec - exiting 03:21:43 (6172): No heartbeat from core client for 30 sec - exiting 09:22:20 (8848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:22 (8848): No heartbeat from core client for 30 sec - exiting 09:22:23 (8848): No heartbeat from core client for 30 sec - exiting 09:22:24 (8848): No heartbeat from core client for 30 sec - exiting 11:14:49 (9212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:50 (9212): No heartbeat from core client for 30 sec - exiting 11:14:51 (9212): No heartbeat from core client for 30 sec - exiting 11:14:52 (9212): No heartbeat from core client for 30 sec - exiting 11:14:53 (9212): No heartbeat from core client for 30 sec - exiting 11:30:33 (7256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:30:35 (7256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 11:49:35 (9136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:36 (9136): No heartbeat from core client for 30 sec - exiting 12:11:12 (7640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:13 (7640): No heartbeat from core client for 30 sec - exiting 12:30:52 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:54 (6764): No heartbeat from core client for 30 sec - exiting 14:59:33 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:34 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:56:38 (7020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:39 (7020): No heartbeat from core client for 30 sec - exiting 18:56:40 (7020): No heartbeat from core client for 30 sec - exiting 18:56:41 (7020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:03:28 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:03:29 (5200): No heartbeat from core client for 30 sec - exiting 02:03:30 (5200): No heartbeat from core client for 30 sec - exiting 02:26:39 (9724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:38:23 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:24 (3892): No heartbeat from core client for 30 sec - exiting 05:38:25 (3892): No heartbeat from core client for 30 sec - exiting 05:38:26 (3892): No heartbeat from core client for 30 sec - exiting 05:57:29 (7456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:15 (10156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:16 (10156): No heartbeat from core client for 30 sec - exiting 08:14:17 (10156): No heartbeat from core client for 30 sec - exiting 08:14:18 (10156): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 01:33:32 (9568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:33:34 (9568): No heartbeat from core client for 30 sec - exiting 08:47:20 (8656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:22 (8656): No heartbeat from core client for 30 sec - exiting 08:47:23 (8656): No heartbeat from core client for 30 sec - exiting 08:47:24 (8656): No heartbeat from core client for 30 sec - exiting 08:47:25 (8656): No heartbeat from core client for 30 sec - exiting 08:47:26 (8656): No heartbeat from core client for 30 sec - exiting 08:47:27 (8656): No heartbeat from core client for 30 sec - exiting 08:47:28 (8656): No heartbeat from core client for 30 sec - exiting 08:47:29 (8656): No heartbeat from core client for 30 sec - exiting 08:47:30 (8656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 04:51:31 (9700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:51:32 (9700): No heartbeat from core client for 30 sec - exiting 04:51:33 (9700): No heartbeat from core client for 30 sec - exiting 10:21:17 (7272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:04 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:05 (7096): No heartbeat from core client for 30 sec - exiting 11:36:06 (7096): No heartbeat from core client for 30 sec - exiting 11:36:07 (7096): No heartbeat from core client for 30 sec - exiting 11:36:08 (7096): No heartbeat from core client for 30 sec - exiting 11:36:09 (7096): No heartbeat from core client for 30 sec - exiting 11:36:10 (7096): No heartbeat from core client for 30 sec - exiting 11:36:11 (7096): No heartbeat from core client for 30 sec - exiting 11:36:12 (7096): No heartbeat from core client for 30 sec - exiting 11:36:13 (7096): No heartbeat from core client for 30 sec - exiting 11:36:14 (7096): No heartbeat from core client for 30 sec - exiting 11:36:15 (7096): No heartbeat from core client for 30 sec - exiting 11:36:16 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:37:30 (6136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:37:31 (6136): No heartbeat from core client for 30 sec - exiting 09:47:53 (6524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:54 (6524): No heartbeat from core client for 30 sec - exiting 09:47:55 (6524): No heartbeat from core client for 30 sec - exiting 09:47:56 (6524): No heartbeat from core client for 30 sec - exiting 09:47:57 (6524): No heartbeat from core client for 30 sec - exiting 09:47:58 (6524): No heartbeat from core client for 30 sec - exiting 09:47:59 (6524): No heartbeat from core client for 30 sec - exiting 09:48:00 (6524): No heartbeat from core client for 30 sec - exiting 09:48:01 (6524): No heartbeat from core client for 30 sec - exiting 09:48:02 (6524): No heartbeat from core client for 30 sec - exiting 18:45:52 (8852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:54 (8852): No heartbeat from core client for 30 sec - exiting 18:45:55 (8852): No heartbeat from core client for 30 sec - exiting 18:45:56 (8852): No heartbeat from core client for 30 sec - exiting 20:09:51 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:52 (2928): No heartbeat from core client for 30 sec - exiting 20:27:20 (8440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:21 (8440): No heartbeat from core client for 30 sec - exiting 20:27:22 (8440): No heartbeat from core client for 30 sec - exiting 20:27:23 (8440): No heartbeat from core client for 30 sec - exiting 20:27:24 (8440): No heartbeat from core client for 30 sec - exiting 20:27:25 (8440): No heartbeat from core client for 30 sec - exiting 20:27:26 (8440): No heartbeat from core client for 30 sec - exiting 20:27:28 (8440): No heartbeat from core client for 30 sec - exiting 20:27:29 (8440): No heartbeat from core client for 30 sec - exiting 20:27:30 (8440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 02:09:26 (7648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:09:28 (7648): No heartbeat from core client for 30 sec - exiting 02:09:29 (7648): No heartbeat from core client for 30 sec - exiting 02:51:55 (10164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:51:56 (10164): No heartbeat from core client for 30 sec - exiting 02:51:57 (10164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:39:40 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:42 (4908): No heartbeat from core client for 30 sec - exiting 10:39:43 (4908): No heartbeat from core client for 30 sec - exiting 10:39:44 (4908): No heartbeat from core client for 30 sec - exiting 10:39:45 (4908): No heartbeat from core client for 30 sec - exiting 12:42:34 (7476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:42:35 (7476): No heartbeat from core client for 30 sec - exiting 12:42:36 (7476): No heartbeat from core client for 30 sec - exiting 12:42:37 (7476): No heartbeat from core client for 30 sec - exiting 12:42:38 (7476): No heartbeat from core client for 30 sec - exiting 12:42:39 (7476): No heartbeat from core client for 30 sec - exiting 12:42:40 (7476): No heartbeat from core client for 30 sec - exiting 12:42:41 (7476): No heartbeat from core client for 30 sec - exiting 12:42:42 (7476): No heartbeat from core client for 30 sec - exiting 12:42:43 (7476): No heartbeat from core client for 30 sec - exiting 12:49:45 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:46 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 04:17:44 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:33:08 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:09 (6260): No heartbeat from core client for 30 sec - exiting 03:33:10 (6260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 10:39:39 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:40 (6488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77196E0F read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6036, selfPID=6036, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77198801 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... 04:10:17 (7648): No heartbeat from core client for 30 sec - exiting 04:10:18 (7648): No heartbeat from core client for 30 sec - exiting 04:10:19 (7648): No heartbeat from core client for 30 sec - exiting 04:10:20 (7648): No heartbeat from core client for 30 sec - exiting 04:10:21 (7648): No heartbeat from core client for 30 sec - exiting 04:10:22 (7648): No heartbeat from core client for 30 sec - exiting 04:10:23 (7648): No heartbeat from core client for 30 sec - exiting 04:10:24 (7648): No heartbeat from core client for 30 sec - exiting 04:10:25 (7648): No heartbeat from core client for 30 sec - exiting 04:10:26 (7648): No heartbeat from core client for 30 sec - exiting 04:10:27 (7648): No heartbeat from core client for 30 sec - exiting 04:10:28 (7648): No heartbeat from core client for 30 sec - exiting 04:10:29 (7648): No heartbeat from core client for 30 sec - exiting 04:10:30 (7648): No heartbeat from core client for 30 sec - exiting 04:10:31 (7648): No heartbeat from core client for 30 sec - exiting 04:10:32 (7648): No heartbeat from core client for 30 sec - exiting 04:10:33 (7648): No heartbeat from core client for 30 sec - exiting 04:10:34 (7648): No heartbeat from core client for 30 sec - exiting 04:10:35 (7648): No heartbeat from core client for 30 sec - exiting 04:10:36 (7648): No heartbeat from core client for 30 sec - exiting 04:10:37 (7648): No heartbeat from core client for 30 sec - exiting 04:10:38 (7648): No heartbeat from core client for 30 sec - exiting 04:10:39 (7648): No heartbeat from core client for 30 sec - exiting 04:10:40 (7648): No heartbeat from core client for 30 sec - exiting 04:10:41 (7648): No heartbeat from core client for 30 sec - exiting 04:10:42 (7648): No heartbeat from core client for 30 sec - exiting 04:10:43 (7648): No heartbeat from core client for 30 sec - exiting 04:10:44 (7648): No heartbeat from core client for 30 sec - exiting 04:10:45 (7648): No heartbeat from core client for 30 sec - exiting 04:10:46 (7648): No heartbeat from core client for 30 sec - exiting 04:10:47 (7648): No heartbeat from core client for 30 sec - exiting 04:10:48 (7648): No heartbeat from core client for 30 sec - exiting 04:10:49 (7648): No heartbeat from core client for 30 sec - exiting 04:10:50 (7648): No heartbeat from core client for 30 sec - exiting 04:10:51 (7648): No heartbeat from core client for 30 sec - exiting 04:24:12 (7648): No heartbeat from core client for 30 sec - exiting 04:24:14 (7648): No heartbeat from core client for 30 sec - exiting 04:24:15 (7648): No heartbeat from core client for 30 sec - exiting 04:24:16 (7648): No heartbeat from core client for 30 sec - exiting 04:24:17 (7648): No heartbeat from core client for 30 sec - exiting 04:24:18 (7648): No heartbeat from core client for 30 sec - exiting 04:24:19 (7648): No heartbeat from core client for 30 sec - exiting 04:24:20 (7648): No heartbeat from core client for 30 sec - exiting 04:24:21 (7648): No heartbeat from core client for 30 sec - exiting 04:24:22 (7648): No heartbeat from core client for 30 sec - exiting 04:24:23 (7648): No heartbeat from core client for 30 sec - exiting 04:24:24 (7648): No heartbeat from core client for 30 sec - exiting 04:24:25 (7648): No heartbeat from core client for 30 sec - exiting 04:24:26 (7648): No heartbeat from core client for 30 sec - exiting 04:24:27 (7648): No heartbeat from core client for 30 sec - exiting 04:24:28 (7648): No heartbeat from core client for 30 sec - exiting 04:24:29 (7648): No heartbeat from core client for 30 sec - exiting 04:24:30 (7648): No heartbeat from core client for 30 sec - exiting 04:24:31 (7648): No heartbeat from core client for 30 sec - exiting 04:24:32 (7648): No heartbeat from core client for 30 sec - exiting 04:24:33 (7648): No heartbeat from core client for 30 sec - exiting 04:24:34 (7648): No heartbeat from core client for 30 sec - exiting 04:41:12 (7648): No heartbeat from core client for 30 sec - exiting 04:41:13 (7648): No heartbeat from core client for 30 sec - exiting 04:41:14 (7648): No heartbeat from core client for 30 sec - exiting 04:41:15 (7648): No heartbeat from core client for 30 sec - exiting 04:41:16 (7648): No heartbeat from core client for 30 sec - exiting 04:41:17 (7648): No heartbeat from core client for 30 sec - exiting 04:41:18 (7648): No heartbeat from core client for 30 sec - exiting 04:41:19 (7648): No heartbeat from core client for 30 sec - exiting 04:41:20 (7648): No heartbeat from core client for 30 sec - exiting 04:41:21 (7648): No heartbeat from core client for 30 sec - exiting 04:41:22 (7648): No heartbeat from core client for 30 sec - exiting 04:41:23 (7648): No heartbeat from core client for 30 sec - exiting 04:41:24 (7648): No heartbeat from core client for 30 sec - exiting 04:41:25 (7648): No heartbeat from core client for 30 sec - exiting 05:00:30 (7648): No heartbeat from core client for 30 sec - exiting 05:00:31 (7648): No heartbeat from core client for 30 sec - exiting 05:00:32 (7648): No heartbeat from core client for 30 sec - exiting 05:00:33 (7648): No heartbeat from core client for 30 sec - exiting 05:00:34 (7648): No heartbeat from core client for 30 sec - exiting 05:00:35 (7648): No heartbeat from core client for 30 sec - exiting 05:00:36 (7648): No heartbeat from core client for 30 sec - exiting 05:00:37 (7648): No heartbeat from core client for 30 sec - exiting 05:00:39 (7648): No heartbeat from core client for 30 sec - exiting 05:00:40 (7648): No heartbeat from core client for 30 sec - exiting 05:00:41 (7648): No heartbeat from core client for 30 sec - exiting 05:00:42 (7648): No heartbeat from core client for 30 sec - exiting 05:00:43 (7648): No heartbeat from core client for 30 sec - exiting 05:00:44 (7648): No heartbeat from core client for 30 sec - exiting 05:00:45 (7648): No heartbeat from core client for 30 sec - exiting 05:00:46 (7648): No heartbeat from core client for 30 sec - exiting 05:00:47 (7648): No heartbeat from core client for 30 sec - exiting 05:00:48 (7648): No heartbeat from core client for 30 sec - exiting 05:00:49 (7648): No heartbeat from core client for 30 sec - exiting 05:00:50 (7648): No heartbeat from core client for 30 sec - exiting 05:00:51 (7648): No heartbeat from core client for 30 sec - exiting 05:00:52 (7648): No heartbeat from core client for 30 sec - exiting 05:00:53 (7648): No heartbeat from core client for 30 sec - exiting 05:00:54 (7648): No heartbeat from core client for 30 sec - exiting 05:00:55 (7648): No heartbeat from core client for 30 sec - exiting 05:00:56 (7648): No heartbeat from core client for 30 sec - exiting 05:00:57 (7648): No heartbeat from core client for 30 sec - exiting 05:00:58 (7648): No heartbeat from core client for 30 sec - exiting 05:00:59 (7648): No heartbeat from core client for 30 sec - exiting 05:01:00 (7648): No heartbeat from core client for 30 sec - exiting 05:01:01 (7648): No heartbeat from core client for 30 sec - exiting 05:01:02 (7648): No heartbeat from core client for 30 sec - exiting 05:01:03 (7648): No heartbeat from core client for 30 sec - exiting 05:01:04 (7648): No heartbeat from core client for 30 sec - exiting 05:01:05 (7648): No heartbeat from core client for 30 sec - exiting 05:01:06 (7648): No heartbeat from core client for 30 sec - exiting 05:01:07 (7648): No heartbeat from core client for 30 sec - exiting 05:01:08 (7648): No heartbeat from core client for 30 sec - exiting 05:01:09 (7648): No heartbeat from core client for 30 sec - exiting 05:01:10 (7648): No heartbeat from core client for 30 sec - exiting 05:01:11 (7648): No heartbeat from core client for 30 sec - exiting 05:01:12 (7648): No heartbeat from core client for 30 sec - exiting 05:01:13 (7648): No heartbeat from core client for 30 sec - exiting 05:01:14 (7648): No heartbeat from core client for 30 sec - exiting 05:01:15 (7648): No heartbeat from core client for 30 sec - exiting 05:01:16 (7648): No heartbeat from core client for 30 sec - exiting 05:01:17 (7648): No heartbeat from core client for 30 sec - exiting 05:01:18 (7648): No heartbeat from core client for 30 sec - exiting 05:01:19 (7648): No heartbeat from core client for 30 sec - exiting 05:01:20 (7648): No heartbeat from core client for 30 sec - exiting 05:01:21 (7648): No heartbeat from core client for 30 sec - exiting 05:01:22 (7648): No heartbeat from core client for 30 sec - exiting 05:01:23 (7648): No heartbeat from core client for 30 sec - exiting 05:01:24 (7648): No heartbeat from core client for 30 sec - exiting 05:01:25 (7648): No heartbeat from core client for 30 sec - exiting 05:01:26 (7648): No heartbeat from core client for 30 sec - exiting 05:01:27 (7648): No heartbeat from core client for 30 sec - exiting 05:01:28 (7648): No heartbeat from core client for 30 sec - exiting 05:01:29 (7648): No heartbeat from core client for 30 sec - exiting 05:01:30 (7648): No heartbeat from core client for 30 sec - exiting 05:01:31 (7648): No heartbeat from core client for 30 sec - exiting 05:01:32 (7648): No heartbeat from core client for 30 sec - exiting 05:01:33 (7648): No heartbeat from core client for 30 sec - exiting 05:01:34 (7648): No heartbeat from core client for 30 sec - exiting 05:01:35 (7648): No heartbeat from core client for 30 sec - exiting 05:01:36 (7648): No heartbeat from core client for 30 sec - exiting 05:01:37 (7648): No heartbeat from core client for 30 sec - exiting 05:01:38 (7648): No heartbeat from core client for 30 sec - exiting 05:01:39 (7648): No heartbeat from core client for 30 sec - exiting 05:01:40 (7648): No heartbeat from core client for 30 sec - exiting 05:01:41 (7648): No heartbeat from core client for 30 sec - exiting 05:01:42 (7648): No heartbeat from core client for 30 sec - exiting 05:01:43 (7648): No heartbeat from core client for 30 sec - exiting 05:01:44 (7648): No heartbeat from core client for 30 sec - exiting 05:01:45 (7648): No heartbeat from core client for 30 sec - exiting 05:01:46 (7648): No heartbeat from core client for 30 sec - exiting 05:01:47 (7648): No heartbeat from core client for 30 sec - exiting 05:01:48 (7648): No heartbeat from core client for 30 sec - exiting 05:01:49 (7648): No heartbeat from core client for 30 sec - exiting 05:01:50 (7648): No heartbeat from core client for 30 sec - exiting 05:01:51 (7648): No heartbeat from core client for 30 sec - exiting 05:01:52 (7648): No heartbeat from core client for 30 sec - exiting 05:01:53 (7648): No heartbeat from core client for 30 sec - exiting 05:01:54 (7648): No heartbeat from core client for 30 sec - exiting 05:01:55 (7648): No heartbeat from core client for 30 sec - exiting 05:01:56 (7648): No heartbeat from core client for 30 sec - exiting 05:01:57 (7648): No heartbeat from core client for 30 sec - exiting 05:01:58 (7648): No heartbeat from core client for 30 sec - exiting 05:01:59 (7648): No heartbeat from core client for 30 sec - exiting 05:02:00 (7648): No heartbeat from core client for 30 sec - exiting 05:02:01 (7648): No heartbeat from core client for 30 sec - exiting 05:02:02 (7648): No heartbeat from core client for 30 sec - exiting 05:02:03 (7648): No heartbeat from core client for 30 sec - exiting 05:02:04 (7648): No heartbeat from core client for 30 sec - exiting 05:02:05 (7648): No heartbeat from core client for 30 sec - exiting 05:02:06 (7648): No heartbeat from core client for 30 sec - exiting 05:02:07 (7648): No heartbeat from core client for 30 sec - exiting 05:02:08 (7648): No heartbeat from core client for 30 sec - exiting 05:02:09 (7648): No heartbeat from core client for 30 sec - exiting 05:02:10 (7648): No heartbeat from core client for 30 sec - exiting 05:02:11 (7648): No heartbeat from core client for 30 sec - exiting 05:02:12 (7648): No heartbeat from core client for 30 sec - exiting 05:02:13 (7648): No heartbeat from core client for 30 sec - exiting 05:02:14 (7648): No heartbeat from core client for 30 sec - exiting 05:02:15 (7648): No heartbeat from core client for 30 sec - exiting 05:02:16 (7648): No heartbeat from core client for 30 sec - exiting 05:02:17 (7648): No heartbeat from core client for 30 sec - exiting 05:02:18 (7648): No heartbeat from core client for 30 sec - exiting 05:02:19 (7648): No heartbeat from core client for 30 sec - exiting 05:02:20 (7648): No heartbeat from core client for 30 sec - exiting 05:02:21 (7648): No heartbeat from core client for 30 sec - exiting 05:02:22 (7648): No heartbeat from core client for 30 sec - exiting 05:02:23 (7648): No heartbeat from core client for 30 sec - exiting 05:02:24 (7648): No heartbeat from core client for 30 sec - exiting 05:02:25 (7648): No heartbeat from core client for 30 sec - exiting 05:02:26 (7648): No heartbeat from core client for 30 sec - exiting 05:02:27 (7648): No heartbeat from core client for 30 sec - exiting 05:02:28 (7648): No heartbeat from core client for 30 sec - exiting 05:02:29 (7648): No heartbeat from core client for 30 sec - exiting 05:02:30 (7648): No heartbeat from core client for 30 sec - exiting 05:02:31 (7648): No heartbeat from core client for 30 sec - exiting 05:02:32 (7648): No heartbeat from core client for 30 sec - exiting 05:02:33 (7648): No heartbeat from core client for 30 sec - exiting 05:02:34 (7648): No heartbeat from core client for 30 sec - exiting 05:02:35 (7648): No heartbeat from core client for 30 sec - exiting 05:02:36 (7648): No heartbeat from core client for 30 sec - exiting 05:02:37 (7648): No heartbeat from core client for 30 sec - exiting 05:02:38 (7648): No heartbeat from core client for 30 sec - exiting 05:02:39 (7648): No heartbeat from core client for 30 sec - exiting 05:02:40 (7648): No heartbeat from core client for 30 sec - exiting 05:02:41 (7648): No heartbeat from core client for 30 sec - exiting 05:02:42 (7648): No heartbeat from core client for 30 sec - exiting 05:02:43 (7648): No heartbeat from core client for 30 sec - exiting 05:02:44 (7648): No heartbeat from core client for 30 sec - exiting 05:02:45 (7648): No heartbeat from core client for 30 sec - exiting 05:02:46 (7648): No heartbeat from core client for 30 sec - exiting 05:02:47 (7648): No heartbeat from core client for 30 sec - exiting 05:02:48 (7648): No heartbeat from core client for 30 sec - exiting 05:02:49 (7648): No heartbeat from core client for 30 sec - exiting 05:02:50 (7648): No heartbeat from core client for 30 sec - exiting 05:02:51 (7648): No heartbeat from core client for 30 sec - exiting 05:02:52 (7648): No heartbeat from core client for 30 sec - exiting 05:02:53 (7648): No heartbeat from core client for 30 sec - exiting 05:02:54 (7648): No heartbeat from core client for 30 sec - exiting 05:02:55 (7648): No heartbeat from core client for 30 sec - exiting 05:02:56 (7648): No heartbeat from core client for 30 sec - exiting 05:02:57 (7648): No heartbeat from core client for 30 sec - exiting 05:02:58 (7648): No heartbeat from core client for 30 sec - exiting 05:02:59 (7648): No heartbeat from core client for 30 sec - exiting 05:03:00 (7648): No heartbeat from core client for 30 sec - exiting 05:03:01 (7648): No heartbeat from core client for 30 sec - exiting 05:03:02 (7648): No heartbeat from core client for 30 sec - exiting 05:03:03 (7648): No heartbeat from core client for 30 sec - exiting 05:03:04 (7648): No heartbeat from core client for 30 sec - exiting 05:03:05 (7648): No heartbeat from core client for 30 sec - exiting 05:03:06 (7648): No heartbeat from core client for 30 sec - exiting 05:03:07 (7648): No heartbeat from core client for 30 sec - exiting 05:03:08 (7648): No heartbeat from core client for 30 sec - exiting 05:03:09 (7648): No heartbeat from core client for 30 sec - exiting 05:03:10 (7648): No heartbeat from core client for 30 sec - exiting 05:03:11 (7648): No heartbeat from core client for 30 sec - exiting 05:03:12 (7648): No heartbeat from core client for 30 sec - exiting 05:03:13 (7648): No heartbeat from core client for 30 sec - exiting 05:03:14 (7648): No heartbeat from core client for 30 sec - exiting 05:03:15 (7648): No heartbeat from core client for 30 sec - exiting 05:03:16 (7648): No heartbeat from core client for 30 sec - exiting 05:03:17 (7648): No heartbeat from core client for 30 sec - exiting 05:03:18 (7648): No heartbeat from core client for 30 sec - exiting 05:03:19 (7648): No heartbeat from core client for 30 sec - exiting 05:03:20 (7648): No heartbeat from core client for 30 sec - exiting 05:03:21 (7648): No heartbeat from core client for 30 sec - exiting 05:03:22 (7648): No heartbeat from core client for 30 sec - exiting 05:03:23 (7648): No heartbeat from core client for 30 sec - exiting 05:03:24 (7648): No heartbeat from core client for 30 sec - exiting 05:03:25 (7648): No heartbeat from core client for 30 sec - exiting 05:03:26 (7648): No heartbeat from core client for 30 sec - exiting 05:03:27 (7648): No heartbeat from core client for 30 sec - exiting 05:03:28 (7648): No heartbeat from core client for 30 sec - exiting 05:03:29 (7648): No heartbeat from core client for 30 sec - exiting 05:03:30 (7648): No heartbeat from core client for 30 sec - exiting 05:03:31 (7648): No heartbeat from core client for 30 sec - exiting 05:03:32 (7648): No heartbeat from core client for 30 sec - exiting 05:03:33 (7648): No heartbeat from core client for 30 sec - exiting 05:03:34 (7648): No heartbeat from core client for 30 sec - exiting 05:03:35 (7648): No heartbeat from core client for 30 sec - exiting 05:03:36 (7648): No heartbeat from core client for 30 sec - exiting 05:03:37 (7648): No heartbeat from core client for 30 sec - exiting 05:03:38 (7648): No heartbeat from core client for 30 sec - exiting 05:03:39 (7648): No heartbeat from core client for 30 sec - exiting 05:03:40 (7648): No heartbeat from core client for 30 sec - exiting 05:03:41 (7648): No heartbeat from core client for 30 sec - exiting 05:03:42 (7648): No heartbeat from core client for 30 sec - exiting 05:03:43 (7648): No heartbeat from core client for 30 sec - exiting 05:03:44 (7648): No heartbeat from core client for 30 sec - exiting 05:03:45 (7648): No heartbeat from core client for 30 sec - exiting 05:03:46 (7648): No heartbeat from core client for 30 sec - exiting 05:03:47 (7648): No heartbeat from core client for 30 sec - exiting 05:03:48 (7648): No heartbeat from core client for 30 sec - exiting 05:03:49 (7648): No heartbeat from core client for 30 sec - exiting 05:03:50 (7648): No heartbeat from core client for 30 sec - exiting 05:03:51 (7648): No heartbeat from core client for 30 sec - exiting 05:03:52 (7648): No heartbeat from core client for 30 sec - exiting 05:03:53 (7648): No heartbeat from core client for 30 sec - exiting 05:03:54 (7648): No heartbeat from core client for 30 sec - exiting 05:03:55 (7648): No heartbeat from core client for 30 sec - exiting 05:03:56 (7648): No heartbeat from core client for 30 sec - exiting 05:03:57 (7648): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772A8801 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772A6E0F read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Apr 2011 15:43:32	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	259,200	506,371	1.9536
24 Apr 2011 17:30:41	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	233,280	455,040	1.9506
22 Apr 2011 08:34:57	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	207,360	403,701	1.9469
21 Apr 2011 03:22:01	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	181,440	352,219	1.9412
21 Apr 2011 03:22:01	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	155,520	301,128	1.9363
21 Apr 2011 03:22:01	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	129,600	250,031	1.9293
12 Apr 2011 05:51:01	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	103,680	199,922	1.9283
10 Apr 2011 08:04:58	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	77,760	148,711	1.9124
05 Apr 2011 07:10:21	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	51,840	98,594	1.9019
03 Apr 2011 17:04:58	976430	12738130	hadcm3n_o2f8_1900_40_007198471_1	25,920	49,562	1.9121