Task 15880620

Name	hadcm3n_zetw_1960_40_008390512_2
Workunit	8541371
Created	4 Jul 2013, 10:23:50 UTC
Sent	4 Jul 2013, 10:48:17 UTC
Report deadline	3 Oct 2013, 18:15:28 UTC
Received	24 Jul 2013, 20:06:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1109730
Run time	5 days 3 hours 8 min 18 sec
CPU time	4 days 22 hours 53 min 33 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 06:49:48 (1208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4416, iMonCtr=1 Model crash detected, will try to restart... 14:51:13 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:53 (4920): No heartbeat from core client for 30 sec - exiting 07:26:54 (4920): No heartbeat from core client for 30 sec - exiting 07:26:55 (4920): No heartbeat from core client for 30 sec - exiting 07:26:57 (4920): No heartbeat from core client for 30 sec - exiting 07:26:58 (4920): No heartbeat from core client for 30 sec - exiting 07:26:59 (4920): No heartbeat from core client for 30 sec - exiting 07:27:00 (4920): No heartbeat from core client for 30 sec - exiting 07:27:01 (4920): No heartbeat from core client for 30 sec - exiting 07:27:02 (4920): No heartbeat from core client for 30 sec - exiting 07:27:03 (4920): No heartbeat from core client for 30 sec - exiting 07:27:04 (4920): No heartbeat from core client for 30 sec - exiting 07:27:05 (4920): No heartbeat from core client for 30 sec - exiting 07:27:07 (4920): No heartbeat from core client for 30 sec - exiting 07:27:08 (4920): No heartbeat from core client for 30 sec - exiting 07:27:09 (4920): No heartbeat from core client for 30 sec - exiting 07:27:10 (4920): No heartbeat from core client for 30 sec - exiting 07:27:11 (4920): No heartbeat from core client for 30 sec - exiting 07:27:12 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:27:13 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:55:04 (4624): No heartbeat from core client for 30 sec - exiting 12:55:05 (4624): No heartbeat from core client for 30 sec - exiting 12:55:06 (4624): No heartbeat from core client for 30 sec - exiting 12:55:07 (4624): No heartbeat from core client for 30 sec - exiting 12:55:08 (4624): No heartbeat from core client for 30 sec - exiting 12:55:09 (4624): No heartbeat from core client for 30 sec - exiting 12:55:10 (4624): No heartbeat from core client for 30 sec - exiting 12:55:11 (4624): No heartbeat from core client for 30 sec - exiting 12:55:12 (4624): No heartbeat from core client for 30 sec - exiting 12:55:13 (4624): No heartbeat from core client for 30 sec - exiting 12:55:14 (4624): No heartbeat from core client for 30 sec - exiting 12:55:16 (4624): No heartbeat from core client for 30 sec - exiting 12:55:17 (4624): No heartbeat from core client for 30 sec - exiting 12:55:18 (4624): No heartbeat from core client for 30 sec - exiting 12:55:19 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:17 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:44:43 (4652): No heartbeat from core client for 30 sec - exiting 06:44:44 (4652): No heartbeat from core client for 30 sec - exiting 06:44:45 (4652): No heartbeat from core client for 30 sec - exiting 06:44:46 (4652): No heartbeat from core client for 30 sec - exiting 06:44:47 (4652): No heartbeat from core client for 30 sec - exiting 06:44:49 (4652): No heartbeat from core client for 30 sec - exiting 06:44:50 (4652): No heartbeat from core client for 30 sec - exiting 06:44:51 (4652): No heartbeat from core client for 30 sec - exiting 06:44:52 (4652): No heartbeat from core client for 30 sec - exiting 06:44:53 (4652): No heartbeat from core client for 30 sec - exiting 06:44:54 (4652): No heartbeat from core client for 30 sec - exiting 06:44:55 (4652): No heartbeat from core client for 30 sec - exiting 06:44:56 (4652): No heartbeat from core client for 30 sec - exiting 06:44:57 (4652): No heartbeat from core client for 30 sec - exiting 06:44:58 (4652): No heartbeat from core client for 30 sec - exiting 06:44:59 (4652): No heartbeat from core client for 30 sec - exiting 06:45:01 (4652): No heartbeat from core client for 30 sec - exiting 06:45:02 (4652): No heartbeat from core client for 30 sec - exiting 06:45:03 (4652): No heartbeat from core client for 30 sec - exiting 06:45:04 (4652): No heartbeat from core client for 30 sec - exiting 06:45:05 (4652): No heartbeat from core client for 30 sec - exiting 06:45:06 (4652): No heartbeat from core client for 30 sec - exiting 06:45:07 (4652): No heartbeat from core client for 30 sec - exiting 06:45:08 (4652): No heartbeat from core client for 30 sec - exiting 06:45:09 (4652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:10 (4652): No heartbeat from core client for 30 sec - exiting 06:45:12 (4652): No heartbeat from core client for 30 sec - exiting 06:45:13 (4652): No heartbeat from core client for 30 sec - exiting 06:45:14 (4652): No heartbeat from core client for 30 sec - exiting 06:45:15 (4652): No heartbeat from core client for 30 sec - exiting 06:45:16 (4652): No heartbeat from core client for 30 sec - exiting 06:45:17 (4652): No heartbeat from core client for 30 sec - exiting 06:45:18 (4652): No heartbeat from core client for 30 sec - exiting 06:49:20 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:50:50 (4260): No heartbeat from core client for 30 sec - exiting 06:50:51 (4260): No heartbeat from core client for 30 sec - exiting 06:50:52 (4260): No heartbeat from core client for 30 sec - exiting 06:50:53 (4260): No heartbeat from core client for 30 sec - exiting 06:50:54 (4260): No heartbeat from core client for 30 sec - exiting 06:50:55 (4260): No heartbeat from core client for 30 sec - exiting 06:50:56 (4260): No heartbeat from core client for 30 sec - exiting 06:50:57 (4260): No heartbeat from core client for 30 sec - exiting 06:50:58 (4260): No heartbeat from core client for 30 sec - exiting 06:50:59 (4260): No heartbeat from core client for 30 sec - exiting 06:51:01 (4260): No heartbeat from core client for 30 sec - exiting 06:51:02 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:03 (4260): No heartbeat from core client for 30 sec - exiting 06:51:04 (4260): No heartbeat from core client for 30 sec - exiting 06:51:05 (4260): No heartbeat from core client for 30 sec - exiting 06:51:06 (4260): No heartbeat from core client for 30 sec - exiting 06:51:07 (4260): No heartbeat from core client for 30 sec - exiting 06:51:08 (4260): No heartbeat from core client for 30 sec - exiting 06:51:09 (4260): No heartbeat from core client for 30 sec - exiting 06:51:10 (4260): No heartbeat from core client for 30 sec - exiting 06:51:12 (4260): No heartbeat from core client for 30 sec - exiting 06:51:13 (4260): No heartbeat from core client for 30 sec - exiting 06:54:52 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:29:42 (5540): No heartbeat from core client for 30 sec - exiting 07:29:43 (5540): No heartbeat from core client for 30 sec - exiting 07:29:44 (5540): No heartbeat from core client for 30 sec - exiting 07:29:45 (5540): No heartbeat from core client for 30 sec - exiting 07:29:46 (5540): No heartbeat from core client for 30 sec - exiting 07:29:47 (5540): No heartbeat from core client for 30 sec - exiting 07:29:48 (5540): No heartbeat from core client for 30 sec - exiting 07:29:49 (5540): No heartbeat from core client for 30 sec - exiting 07:29:50 (5540): No heartbeat from core client for 30 sec - exiting 07:29:52 (5540): No heartbeat from core client for 30 sec - exiting 07:29:53 (5540): No heartbeat from core client for 30 sec - exiting 07:29:54 (5540): No heartbeat from core client for 30 sec - exiting 07:29:55 (5540): No heartbeat from core client for 30 sec - exiting 07:29:56 (5540): No heartbeat from core client for 30 sec - exiting 07:29:57 (5540): No heartbeat from core client for 30 sec - exiting 07:29:58 (5540): No heartbeat from core client for 30 sec - exiting 07:29:59 (5540): No heartbeat from core client for 30 sec - exiting 07:30:00 (5540): No heartbeat from core client for 30 sec - exiting 07:30:01 (5540): No heartbeat from core client for 30 sec - exiting 07:30:03 (5540): No heartbeat from core client for 30 sec - exiting 07:30:04 (5540): No heartbeat from core client for 30 sec - exiting 07:30:05 (5540): No heartbeat from core client for 30 sec - exiting 07:30:06 (5540): No heartbeat from core client for 30 sec - exiting 07:30:07 (5540): No heartbeat from core client for 30 sec - exiting 07:30:08 (5540): No heartbeat from core client for 30 sec - exiting 07:30:09 (5540): No heartbeat from core client for 30 sec - exiting 07:30:10 (5540): No heartbeat from core client for 30 sec - exiting 07:30:11 (5540): No heartbeat from core client for 30 sec - exiting 07:30:12 (5540): No heartbeat from core client for 30 sec - exiting 07:30:13 (5540): No heartbeat from core client for 30 sec - exiting 07:30:15 (5540): No heartbeat from core client for 30 sec - exiting 07:30:16 (5540): No heartbeat from core client for 30 sec - exiting 07:30:17 (5540): No heartbeat from core client for 30 sec - exiting 07:30:18 (5540): No heartbeat from core client for 30 sec - exiting 07:30:19 (5540): No heartbeat from core client for 30 sec - exiting 07:30:20 (5540): No heartbeat from core client for 30 sec - exiting 07:30:21 (5540): No heartbeat from core client for 30 sec - exiting 07:30:22 (5540): No heartbeat from core client for 30 sec - exiting 07:30:23 (5540): No heartbeat from core client for 30 sec - exiting 07:30:24 (5540): No heartbeat from core client for 30 sec - exiting 07:30:25 (5540): No heartbeat from core client for 30 sec - exiting 07:30:27 (5540): No heartbeat from core client for 30 sec - exiting 07:30:28 (5540): No heartbeat from core client for 30 sec - exiting 07:30:29 (5540): No heartbeat from core client for 30 sec - exiting 07:30:30 (5540): No heartbeat from core client for 30 sec - exiting 07:30:31 (5540): No heartbeat from core client for 30 sec - exiting 07:30:32 (5540): No heartbeat from core client for 30 sec - exiting 07:30:33 (5540): No heartbeat from core client for 30 sec - exiting 07:30:34 (5540): No heartbeat from core client for 30 sec - exiting 07:30:35 (5540): No heartbeat from core client for 30 sec - exiting 07:30:36 (5540): No heartbeat from core client for 30 sec - exiting 07:30:37 (5540): No heartbeat from core client for 30 sec - exiting 07:30:39 (5540): No heartbeat from core client for 30 sec - exiting 07:30:40 (5540): No heartbeat from core client for 30 sec - exiting 07:30:41 (5540): No heartbeat from core client for 30 sec - exiting 07:30:42 (5540): No heartbeat from core client for 30 sec - exiting 07:30:43 (5540): No heartbeat from core client for 30 sec - exiting 07:30:44 (5540): No heartbeat from core client for 30 sec - exiting 07:30:45 (5540): No heartbeat from core client for 30 sec - exiting 07:30:46 (5540): No heartbeat from core client for 30 sec - exiting 07:30:47 (5540): No heartbeat from core client for 30 sec - exiting 07:30:48 (5540): No heartbeat from core client for 30 sec - exiting 07:30:50 (5540): No heartbeat from core client for 30 sec - exiting 07:30:51 (5540): No heartbeat from core client for 30 sec - exiting 07:30:52 (5540): No heartbeat from core client for 30 sec - exiting 07:30:53 (5540): No heartbeat from core client for 30 sec - exiting 07:30:54 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:34:09 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:07:37 (4420): No heartbeat from core client for 30 sec - exiting 12:07:38 (4420): No heartbeat from core client for 30 sec - exiting 12:07:39 (4420): No heartbeat from core client for 30 sec - exiting 12:07:40 (4420): No heartbeat from core client for 30 sec - exiting 12:07:41 (4420): No heartbeat from core client for 30 sec - exiting 12:07:42 (4420): No heartbeat from core client for 30 sec - exiting 12:07:43 (4420): No heartbeat from core client for 30 sec - exiting 12:07:44 (4420): No heartbeat from core client for 30 sec - exiting 12:07:45 (4420): No heartbeat from core client for 30 sec - exiting 12:07:47 (4420): No heartbeat from core client for 30 sec - exiting 12:07:48 (4420): No heartbeat from core client for 30 sec - exiting 12:07:49 (4420): No heartbeat from core client for 30 sec - exiting 12:07:50 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:51 (4420): No heartbeat from core client for 30 sec - exiting 12:07:52 (4420): No heartbeat from core client for 30 sec - exiting 12:07:53 (4420): No heartbeat from core client for 30 sec - exiting 12:07:54 (4420): No heartbeat from core client for 30 sec - exiting 12:07:55 (4420): No heartbeat from core client for 30 sec - exiting 12:07:56 (4420): No heartbeat from core client for 30 sec - exiting 12:07:58 (4420): No heartbeat from core client for 30 sec - exiting 12:07:59 (4420): No heartbeat from core client for 30 sec - exiting 12:08:00 (4420): No heartbeat from core client for 30 sec - exiting 12:08:01 (4420): No heartbeat from core client for 30 sec - exiting 12:10:32 (544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:13:04 (4160): No heartbeat from core client for 30 sec - exiting 13:13:05 (4160): No heartbeat from core client for 30 sec - exiting 13:13:06 (4160): No heartbeat from core client for 30 sec - exiting 13:13:07 (4160): No heartbeat from core client for 30 sec - exiting 13:13:08 (4160): No heartbeat from core client for 30 sec - exiting 13:13:09 (4160): No heartbeat from core client for 30 sec - exiting 13:13:10 (4160): No heartbeat from core client for 30 sec - exiting 13:13:11 (4160): No heartbeat from core client for 30 sec - exiting 13:13:13 (4160): No heartbeat from core client for 30 sec - exiting 13:13:14 (4160): No heartbeat from core client for 30 sec - exiting 13:13:15 (4160): No heartbeat from core client for 30 sec - exiting 13:13:16 (4160): No heartbeat from core client for 30 sec - exiting 13:13:18 (4160): No heartbeat from core client for 30 sec - exiting 13:13:19 (4160): No heartbeat from core client for 30 sec - exiting 13:13:20 (4160): No heartbeat from core client for 30 sec - exiting 13:13:21 (4160): No heartbeat from core client for 30 sec - exiting 13:13:22 (4160): No heartbeat from core client for 30 sec - exiting 13:13:23 (4160): No heartbeat from core client for 30 sec - exiting 13:13:25 (4160): No heartbeat from core client for 30 sec - exiting 13:13:26 (4160): No heartbeat from core client for 30 sec - exiting 13:13:27 (4160): No heartbeat from core client for 30 sec - exiting 13:13:28 (4160): No heartbeat from core client for 30 sec - exiting 13:13:29 (4160): No heartbeat from core client for 30 sec - exiting 13:13:30 (4160): No heartbeat from core client for 30 sec - exiting 13:13:31 (4160): No heartbeat from core client for 30 sec - exiting 13:13:32 (4160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:33 (4160): No heartbeat from core client for 30 sec - exiting 13:14:27 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:15 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... 07:29:37 (4724): No heartbeat from core client for 30 sec - exiting 07:29:38 (4724): No heartbeat from core client for 30 sec - exiting 07:29:39 (4724): No heartbeat from core client for 30 sec - exiting 07:29:40 (4724): No heartbeat from core client for 30 sec - exiting 07:29:42 (4724): No heartbeat from core client for 30 sec - exiting 07:29:43 (4724): No heartbeat from core client for 30 sec - exiting 07:29:44 (4724): No heartbeat from core client for 30 sec - exiting 07:29:45 (4724): No heartbeat from core client for 30 sec - exiting 07:29:46 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:47 (4724): No heartbeat from core client for 30 sec - exiting 07:29:48 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:22:36 (2500): No heartbeat from core client for 30 sec - exiting 07:22:37 (2500): No heartbeat from core client for 30 sec - exiting 07:22:38 (2500): No heartbeat from core client for 30 sec - exiting 07:22:40 (2500): No heartbeat from core client for 30 sec - exiting 07:22:41 (2500): No heartbeat from core client for 30 sec - exiting 07:22:42 (2500): No heartbeat from core client for 30 sec - exiting 07:22:43 (2500): No heartbeat from core client for 30 sec - exiting 07:22:44 (2500): No heartbeat from core client for 30 sec - exiting 07:22:45 (2500): No heartbeat from core client for 30 sec - exiting 07:22:46 (2500): No heartbeat from core client for 30 sec - exiting 07:22:47 (2500): No heartbeat from core client for 30 sec - exiting 07:22:48 (2500): No heartbeat from core client for 30 sec - exiting 07:22:49 (2500): No heartbeat from core client for 30 sec - exiting 07:22:50 (2500): No heartbeat from core client for 30 sec - exiting 07:22:52 (2500): No heartbeat from core client for 30 sec - exiting 07:22:53 (2500): No heartbeat from core client for 30 sec - exiting 07:22:54 (2500): No heartbeat from core client for 30 sec - exiting 07:22:55 (2500): No heartbeat from core client for 30 sec - exiting 07:22:56 (2500): No heartbeat from core client for 30 sec - exiting 07:22:57 (2500): No heartbeat from core client for 30 sec - exiting 07:22:58 (2500): No heartbeat from core client for 30 sec - exiting 07:22:59 (2500): No heartbeat from core client for 30 sec - exiting 07:23:00 (2500): No heartbeat from core client for 30 sec - exiting 07:23:01 (2500): No heartbeat from core client for 30 sec - exiting 07:23:02 (2500): No heartbeat from core client for 30 sec - exiting 07:23:04 (2500): No heartbeat from core client for 30 sec - exiting 07:23:05 (2500): No heartbeat from core client for 30 sec - exiting 07:23:06 (2500): No heartbeat from core client for 30 sec - exiting 07:23:07 (2500): No heartbeat from core client for 30 sec - exiting 07:23:08 (2500): No heartbeat from core client for 30 sec - exiting 07:23:09 (2500): No heartbeat from core client for 30 sec - exiting 07:23:10 (2500): No heartbeat from core client for 30 sec - exiting 07:23:11 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:12 (2500): No heartbeat from core client for 30 sec - exiting 07:23:13 (2500): No heartbeat from core client for 30 sec - exiting 07:25:26 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:27 (6088): No heartbeat from core client for 30 sec - exiting 07:25:28 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:24:03 (4356): No heartbeat from core client for 30 sec - exiting 07:24:04 (4356): No heartbeat from core client for 30 sec - exiting 07:24:05 (4356): No heartbeat from core client for 30 sec - exiting 07:24:06 (4356): No heartbeat from core client for 30 sec - exiting 07:24:07 (4356): No heartbeat from core client for 30 sec - exiting 07:24:08 (4356): No heartbeat from core client for 30 sec - exiting 07:24:09 (4356): No heartbeat from core client for 30 sec - exiting 07:24:10 (4356): No heartbeat from core client for 30 sec - exiting 07:24:12 (4356): No heartbeat from core client for 30 sec - exiting 07:24:13 (4356): No heartbeat from core client for 30 sec - exiting 07:24:14 (4356): No heartbeat from core client for 30 sec - exiting 07:24:15 (4356): No heartbeat from core client for 30 sec - exiting 07:24:16 (4356): No heartbeat from core client for 30 sec - exiting 07:24:17 (4356): No heartbeat from core client for 30 sec - exiting 07:24:18 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:59 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:28:46 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:57 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6980, iMonCtr=1 Model crash detected, will try to restart... 07:25:52 (3792): No heartbeat from core client for 30 sec - exiting 07:25:53 (3792): No heartbeat from core client for 30 sec - exiting 07:25:54 (3792): No heartbeat from core client for 30 sec - exiting 07:25:55 (3792): No heartbeat from core client for 30 sec - exiting 07:25:56 (3792): No heartbeat from core client for 30 sec - exiting 07:25:57 (3792): No heartbeat from core client for 30 sec - exiting 07:25:58 (3792): No heartbeat from core client for 30 sec - exiting 07:25:59 (3792): No heartbeat from core client for 30 sec - exiting 07:26:01 (3792): No heartbeat from core client for 30 sec - exiting 07:26:02 (3792): No heartbeat from core client for 30 sec - exiting 07:26:03 (3792): No heartbeat from core client for 30 sec - exiting 07:26:04 (3792): No heartbeat from core client for 30 sec - exiting 07:26:05 (3792): No heartbeat from core client for 30 sec - exiting 07:26:06 (3792): No heartbeat from core client for 30 sec - exiting 07:26:07 (3792): No heartbeat from core client for 30 sec - exiting 07:26:08 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:47 (5096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:29:05 (5292): No heartbeat from core client for 30 sec - exiting 07:29:06 (5292): No heartbeat from core client for 30 sec - exiting 07:29:07 (5292): No heartbeat from core client for 30 sec - exiting 07:29:08 (5292): No heartbeat from core client for 30 sec - exiting 07:29:09 (5292): No heartbeat from core client for 30 sec - exiting 07:29:10 (5292): No heartbeat from core client for 30 sec - exiting 07:29:11 (5292): No heartbeat from core client for 30 sec - exiting 07:29:12 (5292): No heartbeat from core client for 30 sec - exiting 07:29:13 (5292): No heartbeat from core client for 30 sec - exiting 07:29:14 (5292): No heartbeat from core client for 30 sec - exiting 07:29:16 (5292): No heartbeat from core client for 30 sec - exiting 07:29:17 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:18 (5292): No heartbeat from core client for 30 sec - exiting 07:29:19 (5292): No heartbeat from core client for 30 sec - exiting 07:29:20 (5292): No heartbeat from core client for 30 sec - exiting 07:29:21 (5292): No heartbeat from core client for 30 sec - exiting 07:31:03 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:43 (1240): No heartbeat from core client for 30 sec - exiting 13:22:44 (1240): No heartbeat from core client for 30 sec - exiting 13:22:45 (1240): No heartbeat from core client for 30 sec - exiting 13:22:46 (1240): No heartbeat from core client for 30 sec - exiting 13:22:48 (1240): No heartbeat from core client for 30 sec - exiting 13:22:49 (1240): No heartbeat from core client for 30 sec - exiting 13:22:50 (1240): No heartbeat from core client for 30 sec - exiting 13:22:51 (1240): No heartbeat from core client for 30 sec - exiting 13:22:52 (1240): No heartbeat from core client for 30 sec - exiting 13:22:53 (1240): No heartbeat from core client for 30 sec - exiting 13:22:54 (1240): No heartbeat from core client for 30 sec - exiting 13:22:55 (1240): No heartbeat from core client for 30 sec - exiting 13:22:56 (1240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:49 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:28 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:30:16 (4636): No heartbeat from core client for 30 sec - exiting 07:30:17 (4636): No heartbeat from core client for 30 sec - exiting 07:30:18 (4636): No heartbeat from core client for 30 sec - exiting 07:30:19 (4636): No heartbeat from core client for 30 sec - exiting 07:30:20 (4636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:33 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:07 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:29 (1916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773E3AB3 read attempt to address 0x40AFC2BB Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zetw_1960_40_008390512/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jul 2013 20:07:28	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	259,200	428,012	1.6513
23 Jul 2013 22:15:55	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	233,280	392,895	1.6842
23 Jul 2013 21:48:35	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	207,360	354,113	1.7077
23 Jul 2013 19:52:30	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	181,440	313,692	1.7289
23 Jul 2013 17:29:24	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	155,520	277,735	1.7858
23 Jul 2013 14:55:26	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	129,600	237,805	1.8349
23 Jul 2013 14:55:25	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	103,680	191,928	1.8512
23 Jul 2013 14:55:25	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	77,760	143,935	1.8510
10 Jul 2013 20:46:19	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	51,840	95,974	1.8514
09 Jul 2013 15:54:54	1109730	15880620	hadcm3n_zetw_1960_40_008390512_2	25,920	48,201	1.8596