Task 15229633

Name	hadam3p_saf_195d_1960_1_006930089_2
Workunit	7133405
Created	3 Sep 2012, 16:46:27 UTC
Sent	3 Sep 2012, 19:25:28 UTC
Report deadline	17 Aug 2013, 0:45:28 UTC
Received	13 Sep 2012, 19:05:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1169139
Run time	3 days 3 hours 39 min 15 sec
CPU time	2 days 21 hours 5 min 23 sec
Validate state	Invalid
Credit	1,870.62
Device peak FLOPS	2.40 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:44:18 (4304): No heartbeat from core client for 30 sec - exiting 20:44:19 (4304): No heartbeat from core client for 30 sec - exiting 20:44:20 (4304): No heartbeat from core client for 30 sec - exiting 20:44:21 (4304): No heartbeat from core client for 30 sec - exiting 20:44:22 (4304): No heartbeat from core client for 30 sec - exiting 20:44:23 (4304): No heartbeat from core client for 30 sec - exiting 20:44:24 (4304): No heartbeat from core client for 30 sec - exiting 20:44:25 (4304): No heartbeat from core client for 30 sec - exiting 20:44:26 (4304): No heartbeat from core client for 30 sec - exiting 20:44:27 (4304): No heartbeat from core client for 30 sec - exiting 20:44:28 (4304): No heartbeat from core client for 30 sec - exiting 20:44:29 (4304): No heartbeat from core client for 30 sec - exiting 20:44:30 (4304): No heartbeat from core client for 30 sec - exiting 20:44:31 (4304): No heartbeat from core client for 30 sec - exiting 20:44:32 (4304): No heartbeat from core client for 30 sec - exiting 20:44:33 (4304): No heartbeat from core client for 30 sec - exiting 20:44:34 (4304): No heartbeat from core client for 30 sec - exiting 20:44:35 (4304): No heartbeat from core client for 30 sec - exiting 20:44:36 (4304): No heartbeat from core client for 30 sec - exiting 20:44:37 (4304): No heartbeat from core client for 30 sec - exiting 20:44:38 (4304): No heartbeat from core client for 30 sec - exiting 20:44:39 (4304): No heartbeat from core client for 30 sec - exiting 20:44:40 (4304): No heartbeat from core client for 30 sec - exiting 20:44:41 (4304): No heartbeat from core client for 30 sec - exiting 20:44:42 (4304): No heartbeat from core client for 30 sec - exiting 20:44:43 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:54:59 (4120): No heartbeat from core client for 30 sec - exiting 19:55:01 (4120): No heartbeat from core client for 30 sec - exiting 19:55:02 (4120): No heartbeat from core client for 30 sec - exiting 19:55:03 (4120): No heartbeat from core client for 30 sec - exiting 19:55:04 (4120): No heartbeat from core client for 30 sec - exiting 19:55:05 (4120): No heartbeat from core client for 30 sec - exiting 19:55:06 (4120): No heartbeat from core client for 30 sec - exiting 19:55:07 (4120): No heartbeat from core client for 30 sec - exiting 19:55:08 (4120): No heartbeat from core client for 30 sec - exiting 19:55:09 (4120): No heartbeat from core client for 30 sec - exiting 19:55:10 (4120): No heartbeat from core client for 30 sec - exiting 19:55:11 (4120): No heartbeat from core client for 30 sec - exiting 19:55:12 (4120): No heartbeat from core client for 30 sec - exiting 19:55:13 (4120): No heartbeat from core client for 30 sec - exiting 19:55:14 (4120): No heartbeat from core client for 30 sec - exiting 19:55:15 (4120): No heartbeat from core client for 30 sec - exiting 19:55:16 (4120): No heartbeat from core client for 30 sec - exiting 19:55:17 (4120): No heartbeat from core client for 30 sec - exiting 19:55:18 (4120): No heartbeat from core client for 30 sec - exiting 19:55:19 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:04:51 (4340): No heartbeat from core client for 30 sec - exiting 19:04:52 (4340): No heartbeat from core client for 30 sec - exiting 19:04:53 (4340): No heartbeat from core client for 30 sec - exiting 19:04:54 (4340): No heartbeat from core client for 30 sec - exiting 19:04:55 (4340): No heartbeat from core client for 30 sec - exiting 19:04:56 (4340): No heartbeat from core client for 30 sec - exiting 19:04:57 (4340): No heartbeat from core client for 30 sec - exiting 19:04:58 (4340): No heartbeat from core client for 30 sec - exiting 19:04:59 (4340): No heartbeat from core client for 30 sec - exiting 19:05:00 (4340): No heartbeat from core client for 30 sec - exiting 19:05:01 (4340): No heartbeat from core client for 30 sec - exiting 19:05:02 (4340): No heartbeat from core client for 30 sec - exiting 19:05:03 (4340): No heartbeat from core client for 30 sec - exiting 19:05:04 (4340): No heartbeat from core client for 30 sec - exiting 19:05:05 (4340): No heartbeat from core client for 30 sec - exiting 19:05:06 (4340): No heartbeat from core client for 30 sec - exiting 19:05:07 (4340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5160, iMonCtr=2 20:18:00 (4960): No heartbeat from core client for 30 sec - exiting 20:18:01 (4960): No heartbeat from core client for 30 sec - exiting 20:18:02 (4960): No heartbeat from core client for 30 sec - exiting 20:18:03 (4960): No heartbeat from core client for 30 sec - exiting 20:18:04 (4960): No heartbeat from core client for 30 sec - exiting 20:18:05 (4960): No heartbeat from core client for 30 sec - exiting 20:18:06 (4960): No heartbeat from core client for 30 sec - exiting 20:18:07 (4960): No heartbeat from core client for 30 sec - exiting 20:18:08 (4960): No heartbeat from core client for 30 sec - exiting 20:18:09 (4960): No heartbeat from core client for 30 sec - exiting 20:18:10 (4960): No heartbeat from core client for 30 sec - exiting 20:18:11 (4960): No heartbeat from core client for 30 sec - exiting 20:18:12 (4960): No heartbeat from core client for 30 sec - exiting 20:18:13 (4960): No heartbeat from core client for 30 sec - exiting 20:18:14 (4960): No heartbeat from core client for 30 sec - exiting 20:18:15 (4960): No heartbeat from core client for 30 sec - exiting 20:18:16 (4960): No heartbeat from core client for 30 sec - exiting 20:18:17 (4960): No heartbeat from core client for 30 sec - exiting 20:18:18 (4960): No heartbeat from core client for 30 sec - exiting 20:18:19 (4960): No heartbeat from core client for 30 sec - exiting 20:18:20 (4960): No heartbeat from core client for 30 sec - exiting 20:18:21 (4960): No heartbeat from core client for 30 sec - exiting 20:18:22 (4960): No heartbeat from core client for 30 sec - exiting 20:18:23 (4960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:49:39 (4796): No heartbeat from core client for 30 sec - exiting 20:49:40 (4796): No heartbeat from core client for 30 sec - exiting 20:49:41 (4796): No heartbeat from core client for 30 sec - exiting 20:49:42 (4796): No heartbeat from core client for 30 sec - exiting 20:49:44 (4796): No heartbeat from core client for 30 sec - exiting 20:49:45 (4796): No heartbeat from core client for 30 sec - exiting 20:49:46 (4796): No heartbeat from core client for 30 sec - exiting 20:49:47 (4796): No heartbeat from core client for 30 sec - exiting 20:49:48 (4796): No heartbeat from core client for 30 sec - exiting 20:49:49 (4796): No heartbeat from core client for 30 sec - exiting 20:49:50 (4796): No heartbeat from core client for 30 sec - exiting 20:49:51 (4796): No heartbeat from core client for 30 sec - exiting 20:49:52 (4796): No heartbeat from core client for 30 sec - exiting 20:49:53 (4796): No heartbeat from core client for 30 sec - exiting 20:49:54 (4796): No heartbeat from core client for 30 sec - exiting 20:49:55 (4796): No heartbeat from core client for 30 sec - exiting 20:49:56 (4796): No heartbeat from core client for 30 sec - exiting 20:49:57 (4796): No heartbeat from core client for 30 sec - exiting 20:49:58 (4796): No heartbeat from core client for 30 sec - exiting 20:49:59 (4796): No heartbeat from core client for 30 sec - exiting 20:50:00 (4796): No heartbeat from core client for 30 sec - exiting 20:50:01 (4796): No heartbeat from core client for 30 sec - exiting 20:50:02 (4796): No heartbeat from core client for 30 sec - exiting 20:50:03 (4796): No heartbeat from core client for 30 sec - exiting 20:50:04 (4796): No heartbeat from core client for 30 sec - exiting 20:50:05 (4796): No heartbeat from core client for 30 sec - exiting 20:50:06 (4796): No heartbeat from core client for 30 sec - exiting 20:50:07 (4796): No heartbeat from core client for 30 sec - exiting 20:50:08 (4796): No heartbeat from core client for 30 sec - exiting 20:50:09 (4796): No heartbeat from core client for 30 sec - exiting 20:50:10 (4796): No heartbeat from core client for 30 sec - exiting 20:50:11 (4796): No heartbeat from core client for 30 sec - exiting 20:50:12 (4796): No heartbeat from core client for 30 sec - exiting 20:50:13 (4796): No heartbeat from core client for 30 sec - exiting 20:50:14 (4796): No heartbeat from core client for 30 sec - exiting 20:50:15 (4796): No heartbeat from core client for 30 sec - exiting 20:50:16 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:54:23 (3252): No heartbeat from core client for 30 sec - exiting 21:54:24 (3252): No heartbeat from core client for 30 sec - exiting 21:54:25 (3252): No heartbeat from core client for 30 sec - exiting 21:54:26 (3252): No heartbeat from core client for 30 sec - exiting 21:54:27 (3252): No heartbeat from core client for 30 sec - exiting 21:54:28 (3252): No heartbeat from core client for 30 sec - exiting 21:54:29 (3252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:37:37 (1292): No heartbeat from core client for 30 sec - exiting 22:37:38 (1292): No heartbeat from core client for 30 sec - exiting 22:37:39 (1292): No heartbeat from core client for 30 sec - exiting 22:37:40 (1292): No heartbeat from core client for 30 sec - exiting 22:37:41 (1292): No heartbeat from core client for 30 sec - exiting 22:37:42 (1292): No heartbeat from core client for 30 sec - exiting 22:37:43 (1292): No heartbeat from core client for 30 sec - exiting 22:37:44 (1292): No heartbeat from core client for 30 sec - exiting 22:37:45 (1292): No heartbeat from core client for 30 sec - exiting 22:37:46 (1292): No heartbeat from core client for 30 sec - exiting 22:37:47 (1292): No heartbeat from core client for 30 sec - exiting 22:37:48 (1292): No heartbeat from core client for 30 sec - exiting 22:37:49 (1292): No heartbeat from core client for 30 sec - exiting 22:37:50 (1292): No heartbeat from core client for 30 sec - exiting 22:37:51 (1292): No heartbeat from core client for 30 sec - exiting 22:37:52 (1292): No heartbeat from core client for 30 sec - exiting 22:37:53 (1292): No heartbeat from core client for 30 sec - exiting 22:37:54 (1292): No heartbeat from core client for 30 sec - exiting 22:37:55 (1292): No heartbeat from core client for 30 sec - exiting 22:37:56 (1292): No heartbeat from core client for 30 sec - exiting 22:37:57 (1292): No heartbeat from core client for 30 sec - exiting 22:37:58 (1292): No heartbeat from core client for 30 sec - exiting 22:37:59 (1292): No heartbeat from core client for 30 sec - exiting 22:38:00 (1292): No heartbeat from core client for 30 sec - exiting 22:38:01 (1292): No heartbeat from core client for 30 sec - exiting 22:38:02 (1292): No heartbeat from core client for 30 sec - exiting 22:38:03 (1292): No heartbeat from core client for 30 sec - exiting 22:38:04 (1292): No heartbeat from core client for 30 sec - exiting 22:38:05 (1292): No heartbeat from core client for 30 sec - exiting 22:38:06 (1292): No heartbeat from core client for 30 sec - exiting 22:38:07 (1292): No heartbeat from core client for 30 sec - exiting 22:38:08 (1292): No heartbeat from core client for 30 sec - exiting 22:38:09 (1292): No heartbeat from core client for 30 sec - exiting 22:38:10 (1292): No heartbeat from core client for 30 sec - exiting 22:38:11 (1292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:10:14 (3716): No heartbeat from core client for 30 sec - exiting 23:10:15 (3716): No heartbeat from core client for 30 sec - exiting 23:10:16 (3716): No heartbeat from core client for 30 sec - exiting 23:10:17 (3716): No heartbeat from core client for 30 sec - exiting 23:10:18 (3716): No heartbeat from core client for 30 sec - exiting 23:10:19 (3716): No heartbeat from core client for 30 sec - exiting 23:10:20 (3716): No heartbeat from core client for 30 sec - exiting 23:10:21 (3716): No heartbeat from core client for 30 sec - exiting 23:10:22 (3716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:18:39 (260): No heartbeat from core client for 30 sec - exiting 23:18:40 (260): No heartbeat from core client for 30 sec - exiting 23:18:41 (260): No heartbeat from core client for 30 sec - exiting 23:18:42 (260): No heartbeat from core client for 30 sec - exiting 23:18:43 (260): No heartbeat from core client for 30 sec - exiting 23:18:44 (260): No heartbeat from core client for 30 sec - exiting 23:18:45 (260): No heartbeat from core client for 30 sec - exiting 23:18:46 (260): No heartbeat from core client for 30 sec - exiting 23:18:47 (260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:22:55 (1848): No heartbeat from core client for 30 sec - exiting 09:22:57 (1848): No heartbeat from core client for 30 sec - exiting 09:22:58 (1848): No heartbeat from core client for 30 sec - exiting 09:22:59 (1848): No heartbeat from core client for 30 sec - exiting 09:23:00 (1848): No heartbeat from core client for 30 sec - exiting 09:23:01 (1848): No heartbeat from core client for 30 sec - exiting 09:23:02 (1848): No heartbeat from core client for 30 sec - exiting 09:23:03 (1848): No heartbeat from core client for 30 sec - exiting 09:23:04 (1848): No heartbeat from core client for 30 sec - exiting 09:23:05 (1848): No heartbeat from core client for 30 sec - exiting 09:23:06 (1848): No heartbeat from core client for 30 sec - exiting 09:23:07 (1848): No heartbeat from core client for 30 sec - exiting 09:23:08 (1848): No heartbeat from core client for 30 sec - exiting 09:23:09 (1848): No heartbeat from core client for 30 sec - exiting 09:23:10 (1848): No heartbeat from core client for 30 sec - exiting 09:23:11 (1848): No heartbeat from core client for 30 sec - exiting 09:23:12 (1848): No heartbeat from core client for 30 sec - exiting 09:23:13 (1848): No heartbeat from core client for 30 sec - exiting 09:23:14 (1848): No heartbeat from core client for 30 sec - exiting 09:23:15 (1848): No heartbeat from core client for 30 sec - exiting 09:23:16 (1848): No heartbeat from core client for 30 sec - exiting 09:23:17 (1848): No heartbeat from core client for 30 sec - exiting 09:23:18 (1848): No heartbeat from core client for 30 sec - exiting 09:23:19 (1848): No heartbeat from core client for 30 sec - exiting 09:23:20 (1848): No heartbeat from core client for 30 sec - exiting 09:23:21 (1848): No heartbeat from core client for 30 sec - exiting 09:23:22 (1848): No heartbeat from core client for 30 sec - exiting 09:23:23 (1848): No heartbeat from core client for 30 sec - exiting 09:23:24 (1848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:47:37 (4812): No heartbeat from core client for 30 sec - exiting 10:47:38 (4812): No heartbeat from core client for 30 sec - exiting 10:47:39 (4812): No heartbeat from core client for 30 sec - exiting 10:47:40 (4812): No heartbeat from core client for 30 sec - exiting 10:47:41 (4812): No heartbeat from core client for 30 sec - exiting 10:47:42 (4812): No heartbeat from core client for 30 sec - exiting 10:47:43 (4812): No heartbeat from core client for 30 sec - exiting 10:47:45 (4812): No heartbeat from core client for 30 sec - exiting 10:47:46 (4812): No heartbeat from core client for 30 sec - exiting 10:47:47 (4812): No heartbeat from core client for 30 sec - exiting 10:47:48 (4812): No heartbeat from core client for 30 sec - exiting 10:47:49 (4812): No heartbeat from core client for 30 sec - exiting 10:47:50 (4812): No heartbeat from core client for 30 sec - exiting 10:47:51 (4812): No heartbeat from core client for 30 sec - exiting 10:47:52 (4812): No heartbeat from core client for 30 sec - exiting 10:47:53 (4812): No heartbeat from core client for 30 sec - exiting 10:47:54 (4812): No heartbeat from core client for 30 sec - exiting 10:47:55 (4812): No heartbeat from core client for 30 sec - exiting 10:47:56 (4812): No heartbeat from core client for 30 sec - exiting 10:47:57 (4812): No heartbeat from core client for 30 sec - exiting 10:47:58 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:40:23 (864): No heartbeat from core client for 30 sec - exiting 11:40:24 (864): No heartbeat from core client for 30 sec - exiting 11:40:25 (864): No heartbeat from core client for 30 sec - exiting 11:40:26 (864): No heartbeat from core client for 30 sec - exiting 11:40:27 (864): No heartbeat from core client for 30 sec - exiting 11:40:28 (864): No heartbeat from core client for 30 sec - exiting 11:40:29 (864): No heartbeat from core client for 30 sec - exiting 11:40:30 (864): No heartbeat from core client for 30 sec - exiting 11:40:31 (864): No heartbeat from core client for 30 sec - exiting 11:40:32 (864): No heartbeat from core client for 30 sec - exiting 11:40:33 (864): No heartbeat from core client for 30 sec - exiting 11:40:35 (864): No heartbeat from core client for 30 sec - exiting 11:40:36 (864): No heartbeat from core client for 30 sec - exiting 11:40:37 (864): No heartbeat from core client for 30 sec - exiting 11:40:38 (864): No heartbeat from core client for 30 sec - exiting 11:40:39 (864): No heartbeat from core client for 30 sec - exiting 11:40:40 (864): No heartbeat from core client for 30 sec - exiting 11:40:41 (864): No heartbeat from core client for 30 sec - exiting 11:40:42 (864): No heartbeat from core client for 30 sec - exiting 11:40:43 (864): No heartbeat from core client for 30 sec - exiting 11:40:44 (864): No heartbeat from core client for 30 sec - exiting 11:40:45 (864): No heartbeat from core client for 30 sec - exiting 11:40:46 (864): No heartbeat from core client for 30 sec - exiting 11:40:47 (864): No heartbeat from core client for 30 sec - exiting 11:40:48 (864): No heartbeat from core client for 30 sec - exiting 11:40:49 (864): No heartbeat from core client for 30 sec - exiting 11:40:50 (864): No heartbeat from core client for 30 sec - exiting 11:40:51 (864): No heartbeat from core client for 30 sec - exiting 11:40:52 (864): No heartbeat from core client for 30 sec - exiting 11:40:53 (864): No heartbeat from core client for 30 sec - exiting 11:40:54 (864): No heartbeat from core client for 30 sec - exiting 11:40:55 (864): No heartbeat from core client for 30 sec - exiting 11:40:56 (864): No heartbeat from core client for 30 sec - exiting 11:40:57 (864): No heartbeat from core client for 30 sec - exiting 11:40:58 (864): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6800, selfPID=6800, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6800, selfPID=4428, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_195d_1960_1_006930089_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_195d_1960_1_006930089_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Sep 2012 15:29:31	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	115,314	246,914	2.1412
11 Sep 2012 14:19:08	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	115,296	246,598	2.1388
10 Sep 2012 23:43:25	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	103,776	224,861	2.1668
10 Sep 2012 12:38:02	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	92,256	200,198	2.1700
10 Sep 2012 03:35:40	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	80,736	175,440	2.1730
09 Sep 2012 13:51:09	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	69,216	150,147	2.1693
09 Sep 2012 02:43:44	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	57,696	125,380	2.1731
06 Sep 2012 19:29:12	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	46,176	100,607	2.1788
06 Sep 2012 06:07:36	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	34,656	75,669	2.1834
05 Sep 2012 05:04:38	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	23,136	50,621	2.1880
04 Sep 2012 08:00:58	1169139	15229633	hadam3p_saf_195d_1960_1_006930089_2	11,616	25,672	2.2101