Task 13929933

Name	hadcm3n_y9fi_1980_40_007683919_2
Workunit	7839006
Created	16 Jan 2012, 15:05:28 UTC
Sent	16 Jan 2012, 15:07:45 UTC
Report deadline	16 Apr 2012, 22:34:56 UTC
Received	9 Feb 2012, 7:53:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1140498
Run time	5 days 16 hours 0 min 33 sec
CPU time	4 days 19 hours 30 min 50 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.58 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:57:36 (27668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:03:36 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:36 (27904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:38 (36536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:11:22 (26796): Can't acquire lockfile (32) - waiting 35s 02:11:57 (26796): Can't acquire lockfile (32) - exiting 02:11:57 (26796): Error: The process cannot access the file because it is being used by another process. (0x20) CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:01:39 (69712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=97676, selfPID=97676, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: STWORK : Error in PP_FILE tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:31:29 (73552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:18 (62936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:50 (74064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:37:23 (66516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:55 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:58 (67380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:01 (73064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:44:33 (74836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:05 (75528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:47:37 (4248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:49:41 (69540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:52:15 (44612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:17 (75976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:57 (76976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:57:54 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:00:27 (76588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:00 (77436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:34 (66652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:05:36 (76156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:23 (75728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:08:25 (76348): No heartbeat from core client for 30 sec - exiting 03:08:26 (76348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:41 (77280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:28 (77580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:57 (73336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:19:10 (62824): No heartbeat from core client for 30 sec - exiting 03:19:11 (62824): No heartbeat from core client for 30 sec - exiting 03:19:12 (62824): No heartbeat from core client for 30 sec - exiting 03:19:13 (62824): No heartbeat from core client for 30 sec - exiting 03:19:14 (62824): No heartbeat from core client for 30 sec - exiting 03:19:15 (62824): No heartbeat from core client for 30 sec - exiting 03:19:16 (62824): No heartbeat from core client for 30 sec - exiting 03:19:17 (62824): No heartbeat from core client for 30 sec - exiting 03:19:18 (62824): No heartbeat from core client for 30 sec - exiting 03:19:19 (62824): No heartbeat from core client for 30 sec - exiting 03:19:20 (62824): No heartbeat from core client for 30 sec - exiting 03:19:21 (62824): No heartbeat from core client for 30 sec - exiting 03:19:22 (62824): No heartbeat from core client for 30 sec - exiting 03:19:23 (62824): No heartbeat from core client for 30 sec - exiting 03:19:24 (62824): No heartbeat from core client for 30 sec - exiting 03:19:25 (62824): No heartbeat from core client for 30 sec - exiting 03:19:27 (62824): No heartbeat from core client for 30 sec - exiting 03:19:28 (62824): No heartbeat from core client for 30 sec - exiting 03:19:29 (62824): No heartbeat from core client for 30 sec - exiting 03:19:30 (62824): No heartbeat from core client for 30 sec - exiting 03:19:31 (62824): No heartbeat from core client for 30 sec - exiting 03:19:32 (62824): No heartbeat from core client for 30 sec - exiting 03:19:33 (62824): No heartbeat from core client for 30 sec - exiting 03:19:34 (62824): No heartbeat from core client for 30 sec - exiting 03:19:35 (62824): No heartbeat from core client for 30 sec - exiting 03:19:36 (62824): No heartbeat from core client for 30 sec - exiting 03:19:37 (62824): No heartbeat from core client for 30 sec - exiting 03:19:38 (62824): No heartbeat from core client for 30 sec - exiting 03:19:39 (62824): No heartbeat from core client for 30 sec - exiting 03:19:40 (62824): No heartbeat from core client for 30 sec - exiting 03:19:41 (62824): No heartbeat from core client for 30 sec - exiting 03:19:42 (62824): No heartbeat from core client for 30 sec - exiting 03:19:43 (62824): No heartbeat from core client for 30 sec - exiting 03:19:44 (62824): No heartbeat from core client for 30 sec - exiting 03:19:45 (62824): No heartbeat from core client for 30 sec - exiting 03:19:46 (62824): No heartbeat from core client for 30 sec - exiting 03:19:47 (62824): No heartbeat from core client for 30 sec - exiting 03:19:48 (62824): No heartbeat from core client for 30 sec - exiting 03:19:49 (62824): No heartbeat from core client for 30 sec - exiting 03:19:50 (62824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:51 (62824): No heartbeat from core client for 30 sec - exiting 03:19:52 (62824): No heartbeat from core client for 30 sec - exiting 03:19:53 (62824): No heartbeat from core client for 30 sec - exiting 03:19:54 (62824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 03:28:56 (77396): No heartbeat from core client for 30 sec - exiting 03:28:57 (77396): No heartbeat from core client for 30 sec - exiting 03:28:58 (77396): No heartbeat from core client for 30 sec - exiting 03:28:59 (77396): No heartbeat from core client for 30 sec - exiting 03:29:00 (77396): No heartbeat from core client for 30 sec - exiting 03:29:01 (77396): No heartbeat from core client for 30 sec - exiting 03:29:02 (77396): No heartbeat from core client for 30 sec - exiting 03:29:03 (77396): No heartbeat from core client for 30 sec - exiting 03:29:04 (77396): No heartbeat from core client for 30 sec - exiting 03:29:05 (77396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:19 (76276): No heartbeat from core client for 30 sec - exiting 03:31:20 (76276): No heartbeat from core client for 30 sec - exiting 03:31:21 (76276): No heartbeat from core client for 30 sec - exiting 03:31:22 (76276): No heartbeat from core client for 30 sec - exiting 03:31:23 (76276): No heartbeat from core client for 30 sec - exiting 03:31:24 (76276): No heartbeat from core client for 30 sec - exiting 03:31:25 (76276): No heartbeat from core client for 30 sec - exiting 03:31:26 (76276): No heartbeat from core client for 30 sec - exiting 03:31:27 (76276): No heartbeat from core client for 30 sec - exiting 03:31:28 (76276): No heartbeat from core client for 30 sec - exiting 03:31:29 (76276): No heartbeat from core client for 30 sec - exiting 03:31:30 (76276): No heartbeat from core client for 30 sec - exiting 03:31:31 (76276): No heartbeat from core client for 30 sec - exiting 03:31:32 (76276): No heartbeat from core client for 30 sec - exiting 03:31:33 (76276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:22 (76600): No heartbeat from core client for 30 sec - exiting 03:34:23 (76600): No heartbeat from core client for 30 sec - exiting 03:34:24 (76600): No heartbeat from core client for 30 sec - exiting 03:34:25 (76600): No heartbeat from core client for 30 sec - exiting 03:34:26 (76600): No heartbeat from core client for 30 sec - exiting 03:34:27 (76600): No heartbeat from core client for 30 sec - exiting 03:34:28 (76600): No heartbeat from core client for 30 sec - exiting 03:34:29 (76600): No heartbeat from core client for 30 sec - exiting 03:34:30 (76600): No heartbeat from core client for 30 sec - exiting 03:34:31 (76600): No heartbeat from core client for 30 sec - exiting 03:34:32 (76600): No heartbeat from core client for 30 sec - exiting 03:34:33 (76600): No heartbeat from core client for 30 sec - exiting 03:34:34 (76600): No heartbeat from core client for 30 sec - exiting 03:34:35 (76600): No heartbeat from core client for 30 sec - exiting 03:34:36 (76600): No heartbeat from core client for 30 sec - exiting 03:34:37 (76600): No heartbeat from core client for 30 sec - exiting 03:34:38 (76600): No heartbeat from core client for 30 sec - exiting 03:34:39 (76600): No heartbeat from core client for 30 sec - exiting 03:34:40 (76600): No heartbeat from core client for 30 sec - exiting 03:34:41 (76600): No heartbeat from core client for 30 sec - exiting 03:34:42 (76600): No heartbeat from core client for 30 sec - exiting 03:34:43 (76600): No heartbeat from core client for 30 sec - exiting 03:34:44 (76600): No heartbeat from core client for 30 sec - exiting 03:34:45 (76600): No heartbeat from core client for 30 sec - exiting 03:34:46 (76600): No heartbeat from core client for 30 sec - exiting 03:34:47 (76600): No heartbeat from core client for 30 sec - exiting 03:34:48 (76600): No heartbeat from core client for 30 sec - exiting 03:34:49 (76600): No heartbeat from core client for 30 sec - exiting 03:34:50 (76600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:56 (72712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:41 (76388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:46 (76100): No heartbeat from core client for 30 sec - exiting 03:44:47 (76100): No heartbeat from core client for 30 sec - exiting 03:44:48 (76100): No heartbeat from core client for 30 sec - exiting 03:44:49 (76100): No heartbeat from core client for 30 sec - exiting 03:44:50 (76100): No heartbeat from core client for 30 sec - exiting 03:44:51 (76100): No heartbeat from core client for 30 sec - exiting 03:44:52 (76100): No heartbeat from core client for 30 sec - exiting 03:44:53 (76100): No heartbeat from core client for 30 sec - exiting 03:44:54 (76100): No heartbeat from core client for 30 sec - exiting 03:44:55 (76100): No heartbeat from core client for 30 sec - exiting 03:44:56 (76100): No heartbeat from core client for 30 sec - exiting 03:44:57 (76100): No heartbeat from core client for 30 sec - exiting 03:44:58 (76100): No heartbeat from core client for 30 sec - exiting 03:44:59 (76100): No heartbeat from core client for 30 sec - exiting 03:45:00 (76100): No heartbeat from core client for 30 sec - exiting 03:45:01 (76100): No heartbeat from core client for 30 sec - exiting 03:45:02 (76100): No heartbeat from core client for 30 sec - exiting 03:45:03 (76100): No heartbeat from core client for 30 sec - exiting 03:45:04 (76100): No heartbeat from core client for 30 sec - exiting 03:45:05 (76100): No heartbeat from core client for 30 sec - exiting 03:45:06 (76100): No heartbeat from core client for 30 sec - exiting 03:45:07 (76100): No heartbeat from core client for 30 sec - exiting 03:45:08 (76100): No heartbeat from core client for 30 sec - exiting 03:45:09 (76100): No heartbeat from core client for 30 sec - exiting 03:45:10 (76100): No heartbeat from core client for 30 sec - exiting 03:45:11 (76100): No heartbeat from core client for 30 sec - exiting 03:45:12 (76100): No heartbeat from core client for 30 sec - exiting 03:45:13 (76100): No heartbeat from core client for 30 sec - exiting 03:45:14 (76100): No heartbeat from core client for 30 sec - exiting 03:45:15 (76100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:48:07 (75192): No heartbeat from core client for 30 sec - exiting 03:48:08 (75192): No heartbeat from core client for 30 sec - exiting 03:48:09 (75192): No heartbeat from core client for 30 sec - exiting 03:48:10 (75192): No heartbeat from core client for 30 sec - exiting 03:48:11 (75192): No heartbeat from core client for 30 sec - exiting 03:48:12 (75192): No heartbeat from core client for 30 sec - exiting 03:48:13 (75192): No heartbeat from core client for 30 sec - exiting 03:48:14 (75192): No heartbeat from core client for 30 sec - exiting 03:48:15 (75192): No heartbeat from core client for 30 sec - exiting 03:48:16 (75192): No heartbeat from core client for 30 sec - exiting 03:48:17 (75192): No heartbeat from core client for 30 sec - exiting 03:48:18 (75192): No heartbeat from core client for 30 sec - exiting 03:48:19 (75192): No heartbeat from core client for 30 sec - exiting 03:48:20 (75192): No heartbeat from core client for 30 sec - exiting 03:48:21 (75192): No heartbeat from core client for 30 sec - exiting 03:48:22 (75192): No heartbeat from core client for 30 sec - exiting 03:48:23 (75192): No heartbeat from core client for 30 sec - exiting 03:48:24 (75192): No heartbeat from core client for 30 sec - exiting 03:48:25 (75192): No heartbeat from core client for 30 sec - exiting 03:48:26 (75192): No heartbeat from core client for 30 sec - exiting 03:48:27 (75192): No heartbeat from core client for 30 sec - exiting 03:48:28 (75192): No heartbeat from core client for 30 sec - exiting 03:48:29 (75192): No heartbeat from core client for 30 sec - exiting 03:48:30 (75192): No heartbeat from core client for 30 sec - exiting 03:48:31 (75192): No heartbeat from core client for 30 sec - exiting 03:48:32 (75192): No heartbeat from core client for 30 sec - exiting 03:48:33 (75192): No heartbeat from core client for 30 sec - exiting 03:48:34 (75192): No heartbeat from core client for 30 sec - exiting 03:48:35 (75192): No heartbeat from core client for 30 sec - exiting 03:48:36 (75192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:39 (77124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:28 (77400): No heartbeat from core client for 30 sec - exiting 03:56:30 (77400): No heartbeat from core client for 30 sec - exiting 03:56:31 (77400): No heartbeat from core client for 30 sec - exiting 03:56:32 (77400): No heartbeat from core client for 30 sec - exiting 03:56:33 (77400): No heartbeat from core client for 30 sec - exiting 03:56:34 (77400): No heartbeat from core client for 30 sec - exiting 03:56:35 (77400): No heartbeat from core client for 30 sec - exiting 03:56:36 (77400): No heartbeat from core client for 30 sec - exiting 03:56:37 (77400): No heartbeat from core client for 30 sec - exiting 03:56:38 (77400): No heartbeat from core client for 30 sec - exiting 03:56:39 (77400): No heartbeat from core client for 30 sec - exiting 03:56:40 (77400): No heartbeat from core client for 30 sec - exiting 03:56:41 (77400): No heartbeat from core client for 30 sec - exiting 03:56:42 (77400): No heartbeat from core client for 30 sec - exiting 03:56:43 (77400): No heartbeat from core client for 30 sec - exiting 03:56:44 (77400): No heartbeat from core client for 30 sec - exiting 03:56:45 (77400): No heartbeat from core client for 30 sec - exiting 03:56:46 (77400): No heartbeat from core client for 30 sec - exiting 03:56:47 (77400): No heartbeat from core client for 30 sec - exiting 03:56:48 (77400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:09 (75812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:13 (57516): No heartbeat from core client for 30 sec - exiting 04:01:15 (57516): No heartbeat from core client for 30 sec - exiting 04:01:16 (57516): No heartbeat from core client for 30 sec - exiting 04:01:17 (57516): No heartbeat from core client for 30 sec - exiting 04:01:18 (57516): No heartbeat from core client for 30 sec - exiting 04:01:19 (57516): No heartbeat from core client for 30 sec - exiting 04:01:20 (57516): No heartbeat from core client for 30 sec - exiting 04:01:21 (57516): No heartbeat from core client for 30 sec - exiting 04:01:22 (57516): No heartbeat from core client for 30 sec - exiting 04:01:23 (57516): No heartbeat from core client for 30 sec - exiting 04:01:24 (57516): No heartbeat from core client for 30 sec - exiting 04:01:25 (57516): No heartbeat from core client for 30 sec - exiting 04:01:26 (57516): No heartbeat from core client for 30 sec - exiting 04:01:27 (57516): No heartbeat from core client for 30 sec - exiting 04:01:58 (57516): No heartbeat from core client for 30 sec - exiting 04:01:59 (57516): No heartbeat from core client for 30 sec - exiting 04:02:00 (57516): No heartbeat from core client for 30 sec - exiting 04:02:01 (57516): No heartbeat from core client for 30 sec - exiting 04:02:02 (57516): No heartbeat from core client for 30 sec - exiting 04:02:03 (57516): No heartbeat from core client for 30 sec - exiting 04:02:04 (57516): No heartbeat from core client for 30 sec - exiting 04:02:05 (57516): No heartbeat from core client for 30 sec - exiting 04:02:06 (57516): No heartbeat from core client for 30 sec - exiting 04:02:07 (57516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:06 (78484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:05:11 (78484): No heartbeat from core client for 30 sec - exiting 04:05:12 (78484): No heartbeat from core client for 30 sec - exiting 04:05:13 (78484): No heartbeat from core client for 30 sec - exiting 04:05:14 (78484): No heartbeat from core client for 30 sec - exiting 04:06:36 (79724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:08:09 (75564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:10 (78460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:42 (4912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:14:04 (78532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:54 (75940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:22 (79548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:37 (77968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:09 (75476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:35 (78912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:15:54 (76348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:30 (80608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77795EAB read attempt to address 0x40D36CCF Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=75584, selfPID=75584, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77795EAB read attempt to address 0x40D36CCF Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Feb 2012 06:43:32	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	259,200	414,271	1.5983
07 Feb 2012 15:48:46	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	233,280	374,644	1.6060
31 Jan 2012 07:25:49	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	207,360	342,594	1.6522
25 Jan 2012 13:51:17	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	181,440	297,303	1.6386
23 Jan 2012 08:25:10	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	155,520	254,309	1.6352
22 Jan 2012 16:22:44	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	129,600	210,118	1.6213
22 Jan 2012 01:44:41	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	103,680	165,905	1.6002
21 Jan 2012 12:51:40	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	77,760	124,071	1.5956
20 Jan 2012 07:09:26	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	51,840	82,007	1.5819
18 Jan 2012 08:34:06	1140498	13929933	hadcm3n_y9fi_1980_40_007683919_2	25,920	41,596	1.6048