Task 16398073

Name	hadam3p_anz_n778_2012_1_008583020_0
Workunit	8729532
Created	25 Mar 2014, 19:21:02 UTC
Sent	26 Mar 2014, 7:40:36 UTC
Report deadline	8 Mar 2015, 13:00:36 UTC
Received	2 Jun 2014, 8:13:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1321010
Run time	4 days 22 hours 45 min 49 sec
CPU time	4 days 20 hours 25 min 2 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:27:22 (7864): No heartbeat from core client for 30 sec - exiting 10:27:23 (7864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:54 (1532): No heartbeat from core client for 30 sec - exiting 08:19:55 (1532): No heartbeat from core client for 30 sec - exiting 08:19:56 (1532): No heartbeat from core client for 30 sec - exiting 08:19:57 (1532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:07:10 (7572): No heartbeat from core client for 30 sec - exiting 08:07:11 (7572): No heartbeat from core client for 30 sec - exiting 08:07:12 (7572): No heartbeat from core client for 30 sec - exiting 08:07:13 (7572): No heartbeat from core client for 30 sec - exiting 08:07:14 (7572): No heartbeat from core client for 30 sec - exiting 08:07:15 (7572): No heartbeat from core client for 30 sec - exiting 08:07:16 (7572): No heartbeat from core client for 30 sec - exiting 08:07:18 (7572): No heartbeat from core client for 30 sec - exiting 08:07:19 (7572): No heartbeat from core client for 30 sec - exiting 08:07:20 (7572): No heartbeat from core client for 30 sec - exiting 08:07:21 (7572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:26 (6180): No heartbeat from core client for 30 sec - exiting 13:48:27 (6180): No heartbeat from core client for 30 sec - exiting 13:48:28 (6180): No heartbeat from core client for 30 sec - exiting 13:48:29 (6180): No heartbeat from core client for 30 sec - exiting 13:48:30 (6180): No heartbeat from core client for 30 sec - exiting 13:48:31 (6180): No heartbeat from core client for 30 sec - exiting 13:48:32 (6180): No heartbeat from core client for 30 sec - exiting 13:48:33 (6180): No heartbeat from core client for 30 sec - exiting 13:48:34 (6180): No heartbeat from core client for 30 sec - exiting 13:48:35 (6180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:21:36 (7976): No heartbeat from core client for 30 sec - exiting 09:21:37 (7976): No heartbeat from core client for 30 sec - exiting 09:21:38 (7976): No heartbeat from core client for 30 sec - exiting 09:21:39 (7976): No heartbeat from core client for 30 sec - exiting 09:21:40 (7976): No heartbeat from core client for 30 sec - exiting 09:21:41 (7976): No heartbeat from core client for 30 sec - exiting 09:21:42 (7976): No heartbeat from core client for 30 sec - exiting 09:21:43 (7976): No heartbeat from core client for 30 sec - exiting 09:21:44 (7976): No heartbeat from core client for 30 sec - exiting 09:21:45 (7976): No heartbeat from core client for 30 sec - exiting 09:21:46 (7976): No heartbeat from core client for 30 sec - exiting 09:21:47 (7976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8660, selfPID=8660, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 15:43:51 (7540): No heartbeat from core client for 30 sec - exiting 15:43:52 (7540): No heartbeat from core client for 30 sec - exiting 15:43:53 (7540): No heartbeat from core client for 30 sec - exiting 15:43:54 (7540): No heartbeat from core client for 30 sec - exiting 15:43:55 (7540): No heartbeat from core client for 30 sec - exiting 15:43:56 (7540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:24:39 (7152): No heartbeat from core client for 30 sec - exiting 13:24:40 (7152): No heartbeat from core client for 30 sec - exiting 13:24:41 (7152): No heartbeat from core client for 30 sec - exiting 13:24:42 (7152): No heartbeat from core client for 30 sec - exiting 13:24:43 (7152): No heartbeat from core client for 30 sec - exiting 13:24:45 (7152): No heartbeat from core client for 30 sec - exiting 13:24:46 (7152): No heartbeat from core client for 30 sec - exiting 13:24:47 (7152): No heartbeat from core client for 30 sec - exiting 13:24:48 (7152): No heartbeat from core client for 30 sec - exiting 13:24:49 (7152): No heartbeat from core client for 30 sec - exiting 13:24:50 (7152): No heartbeat from core client for 30 sec - exiting 13:24:51 (7152): No heartbeat from core client for 30 sec - exiting 13:24:52 (7152): No heartbeat from core client for 30 sec - exiting 13:24:53 (7152): No heartbeat from core client for 30 sec - exiting 13:24:54 (7152): No heartbeat from core client for 30 sec - exiting 13:24:55 (7152): No heartbeat from core client for 30 sec - exiting 13:24:57 (7152): No heartbeat from core client for 30 sec - exiting 13:24:58 (7152): No heartbeat from core client for 30 sec - exiting 13:24:59 (7152): No heartbeat from core client for 30 sec - exiting 13:25:00 (7152): No heartbeat from core client for 30 sec - exiting 13:25:01 (7152): No heartbeat from core client for 30 sec - exiting 13:25:02 (7152): No heartbeat from core client for 30 sec - exiting 13:25:03 (7152): No heartbeat from core client for 30 sec - exiting 13:25:04 (7152): No heartbeat from core client for 30 sec - exiting 13:25:05 (7152): No heartbeat from core client for 30 sec - exiting 13:25:06 (7152): No heartbeat from core client for 30 sec - exiting 13:25:07 (7152): No heartbeat from core client for 30 sec - exiting 13:25:09 (7152): No heartbeat from core client for 30 sec - exiting 13:25:10 (7152): No heartbeat from core client for 30 sec - exiting 13:25:11 (7152): No heartbeat from core client for 30 sec - exiting 13:25:12 (7152): No heartbeat from core client for 30 sec - exiting 13:25:13 (7152): No heartbeat from core client for 30 sec - exiting 13:25:14 (7152): No heartbeat from core client for 30 sec - exiting 13:25:15 (7152): No heartbeat from core client for 30 sec - exiting 13:25:16 (7152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:33:14 (4388): No heartbeat from core client for 30 sec - exiting 13:33:15 (4388): No heartbeat from core client for 30 sec - exiting 13:33:16 (4388): No heartbeat from core client for 30 sec - exiting 13:33:17 (4388): No heartbeat from core client for 30 sec - exiting 13:33:19 (4388): No heartbeat from core client for 30 sec - exiting 13:33:20 (4388): No heartbeat from core client for 30 sec - exiting 13:33:21 (4388): No heartbeat from core client for 30 sec - exiting 13:33:22 (4388): No heartbeat from core client for 30 sec - exiting 13:33:23 (4388): No heartbeat from core client for 30 sec - exiting 13:33:24 (4388): No heartbeat from core client for 30 sec - exiting 13:33:25 (4388): No heartbeat from core client for 30 sec - exiting 13:33:26 (4388): No heartbeat from core client for 30 sec - exiting 13:33:27 (4388): No heartbeat from core client for 30 sec - exiting 13:33:28 (4388): No heartbeat from core client for 30 sec - exiting 13:33:29 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:38:15 (1936): No heartbeat from core client for 30 sec - exiting 20:38:16 (1936): No heartbeat from core client for 30 sec - exiting 20:38:17 (1936): No heartbeat from core client for 30 sec - exiting 20:38:19 (1936): No heartbeat from core client for 30 sec - exiting 20:38:20 (1936): No heartbeat from core client for 30 sec - exiting 20:38:21 (1936): No heartbeat from core client for 30 sec - exiting 20:38:22 (1936): No heartbeat from core client for 30 sec - exiting 20:38:23 (1936): No heartbeat from core client for 30 sec - exiting 20:38:24 (1936): No heartbeat from core client for 30 sec - exiting 20:38:25 (1936): No heartbeat from core client for 30 sec - exiting 20:38:26 (1936): No heartbeat from core client for 30 sec - exiting 20:38:27 (1936): No heartbeat from core client for 30 sec - exiting 20:38:28 (1936): No heartbeat from core client for 30 sec - exiting 20:38:29 (1936): No heartbeat from core client for 30 sec - exiting 20:38:31 (1936): No heartbeat from core client for 30 sec - exiting 20:38:32 (1936): No heartbeat from core client for 30 sec - exiting 20:38:33 (1936): No heartbeat from core client for 30 sec - exiting 20:38:34 (1936): No heartbeat from core client for 30 sec - exiting 20:38:35 (1936): No heartbeat from core client for 30 sec - exiting 20:38:36 (1936): No heartbeat from core client for 30 sec - exiting 20:38:37 (1936): No heartbeat from core client for 30 sec - exiting 20:38:38 (1936): No heartbeat from core client for 30 sec - exiting 20:38:39 (1936): No heartbeat from core client for 30 sec - exiting 20:38:40 (1936): No heartbeat from core client for 30 sec - exiting 20:38:41 (1936): No heartbeat from core client for 30 sec - exiting 20:38:43 (1936): No heartbeat from core client for 30 sec - exiting 20:38:44 (1936): No heartbeat from core client for 30 sec - exiting 20:38:45 (1936): No heartbeat from core client for 30 sec - exiting 20:38:46 (1936): No heartbeat from core client for 30 sec - exiting 20:38:47 (1936): No heartbeat from core client for 30 sec - exiting 20:38:48 (1936): No heartbeat from core client for 30 sec - exiting 20:38:49 (1936): No heartbeat from core client for 30 sec - exiting 20:38:50 (1936): No heartbeat from core client for 30 sec - exiting 20:38:51 (1936): No heartbeat from core client for 30 sec - exiting 20:38:52 (1936): No heartbeat from core client for 30 sec - exiting 20:38:53 (1936): No heartbeat from core client for 30 sec - exiting 20:38:55 (1936): No heartbeat from core client for 30 sec - exiting 20:38:56 (1936): No heartbeat from core client for 30 sec - exiting 20:38:57 (1936): No heartbeat from core client for 30 sec - exiting 20:38:58 (1936): No heartbeat from core client for 30 sec - exiting 20:38:59 (1936): No heartbeat from core client for 30 sec - exiting 20:39:00 (1936): No heartbeat from core client for 30 sec - exiting 20:39:01 (1936): No heartbeat from core client for 30 sec - exiting 20:39:02 (1936): No heartbeat from core client for 30 sec - exiting 20:39:03 (1936): No heartbeat from core client for 30 sec - exiting 20:39:04 (1936): No heartbeat from core client for 30 sec - exiting 20:39:05 (1936): No heartbeat from core client for 30 sec - exiting 20:39:07 (1936): No heartbeat from core client for 30 sec - exiting 20:39:08 (1936): No heartbeat from core client for 30 sec - exiting 20:39:09 (1936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:53:49 (7564): No heartbeat from core client for 30 sec - exiting 08:53:51 (7564): No heartbeat from core client for 30 sec - exiting 08:53:52 (7564): No heartbeat from core client for 30 sec - exiting 08:53:53 (7564): No heartbeat from core client for 30 sec - exiting 08:53:54 (7564): No heartbeat from core client for 30 sec - exiting 08:53:55 (7564): No heartbeat from core client for 30 sec - exiting 08:53:56 (7564): No heartbeat from core client for 30 sec - exiting 08:53:57 (7564): No heartbeat from core client for 30 sec - exiting 08:53:58 (7564): No heartbeat from core client for 30 sec - exiting 08:53:59 (7564): No heartbeat from core client for 30 sec - exiting 08:54:00 (7564): No heartbeat from core client for 30 sec - exiting 08:54:01 (7564): No heartbeat from core client for 30 sec - exiting 08:54:03 (7564): No heartbeat from core client for 30 sec - exiting 08:54:04 (7564): No heartbeat from core client for 30 sec - exiting 08:54:05 (7564): No heartbeat from core client for 30 sec - exiting 08:54:06 (7564): No heartbeat from core client for 30 sec - exiting 08:54:07 (7564): No heartbeat from core client for 30 sec - exiting 08:54:08 (7564): No heartbeat from core client for 30 sec - exiting 08:54:09 (7564): No heartbeat from core client for 30 sec - exiting 08:54:10 (7564): No heartbeat from core client for 30 sec - exiting 08:54:11 (7564): No heartbeat from core client for 30 sec - exiting 08:54:12 (7564): No heartbeat from core client for 30 sec - exiting 08:54:13 (7564): No heartbeat from core client for 30 sec - exiting 08:54:15 (7564): No heartbeat from core client for 30 sec - exiting 08:54:16 (7564): No heartbeat from core client for 30 sec - exiting 08:54:17 (7564): No heartbeat from core client for 30 sec - exiting 08:54:18 (7564): No heartbeat from core client for 30 sec - exiting 08:54:19 (7564): No heartbeat from core client for 30 sec - exiting 08:54:20 (7564): No heartbeat from core client for 30 sec - exiting 08:54:21 (7564): No heartbeat from core client for 30 sec - exiting 08:54:22 (7564): No heartbeat from core client for 30 sec - exiting 08:54:23 (7564): No heartbeat from core client for 30 sec - exiting 08:54:24 (7564): No heartbeat from core client for 30 sec - exiting 08:54:25 (7564): No heartbeat from core client for 30 sec - exiting 08:54:27 (7564): No heartbeat from core client for 30 sec - exiting 08:54:28 (7564): No heartbeat from core client for 30 sec - exiting 08:54:29 (7564): No heartbeat from core client for 30 sec - exiting 08:54:30 (7564): No heartbeat from core client for 30 sec - exiting 08:54:31 (7564): No heartbeat from core client for 30 sec - exiting 08:54:32 (7564): No heartbeat from core client for 30 sec - exiting 08:54:33 (7564): No heartbeat from core client for 30 sec - exiting 08:54:34 (7564): No heartbeat from core client for 30 sec - exiting 08:54:35 (7564): No heartbeat from core client for 30 sec - exiting 08:54:36 (7564): No heartbeat from core client for 30 sec - exiting 08:54:37 (7564): No heartbeat from core client for 30 sec - exiting 08:54:39 (7564): No heartbeat from core client for 30 sec - exiting 08:54:40 (7564): No heartbeat from core client for 30 sec - exiting 08:54:41 (7564): No heartbeat from core client for 30 sec - exiting 08:54:42 (7564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:07:07 (1356): No heartbeat from core client for 30 sec - exiting 19:07:08 (1356): No heartbeat from core client for 30 sec - exiting 19:07:09 (1356): No heartbeat from core client for 30 sec - exiting 19:07:10 (1356): No heartbeat from core client for 30 sec - exiting 19:07:11 (1356): No heartbeat from core client for 30 sec - exiting 19:07:12 (1356): No heartbeat from core client for 30 sec - exiting 19:07:13 (1356): No heartbeat from core client for 30 sec - exiting 19:07:14 (1356): No heartbeat from core client for 30 sec - exiting 19:07:15 (1356): No heartbeat from core client for 30 sec - exiting 19:07:16 (1356): No heartbeat from core client for 30 sec - exiting 19:07:17 (1356): No heartbeat from core client for 30 sec - exiting 19:07:18 (1356): No heartbeat from core client for 30 sec - exiting 19:07:19 (1356): No heartbeat from core client for 30 sec - exiting 19:07:20 (1356): No heartbeat from core client for 30 sec - exiting 19:07:21 (1356): No heartbeat from core client for 30 sec - exiting 19:07:22 (1356): No heartbeat from core client for 30 sec - exiting 19:07:23 (1356): No heartbeat from core client for 30 sec - exiting 19:07:24 (1356): No heartbeat from core client for 30 sec - exiting 19:07:25 (1356): No heartbeat from core client for 30 sec - exiting 19:07:26 (1356): No heartbeat from core client for 30 sec - exiting 19:07:27 (1356): No heartbeat from core client for 30 sec - exiting 19:07:28 (1356): No heartbeat from core client for 30 sec - exiting 19:07:29 (1356): No heartbeat from core client for 30 sec - exiting 19:07:30 (1356): No heartbeat from core client for 30 sec - exiting 19:07:31 (1356): No heartbeat from core client for 30 sec - exiting 19:07:32 (1356): No heartbeat from core client for 30 sec - exiting 19:07:33 (1356): No heartbeat from core client for 30 sec - exiting 19:07:34 (1356): No heartbeat from core client for 30 sec - exiting 19:07:35 (1356): No heartbeat from core client for 30 sec - exiting 19:07:36 (1356): No heartbeat from core client for 30 sec - exiting 19:07:37 (1356): No heartbeat from core client for 30 sec - exiting 19:07:38 (1356): No heartbeat from core client for 30 sec - exiting 19:07:39 (1356): No heartbeat from core client for 30 sec - exiting 19:07:40 (1356): No heartbeat from core client for 30 sec - exiting 19:07:41 (1356): No heartbeat from core client for 30 sec - exiting 19:07:42 (1356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5504, selfPID=5504, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:15:33 (7680): No heartbeat from core client for 30 sec - exiting 13:15:34 (7680): No heartbeat from core client for 30 sec - exiting 13:15:35 (7680): No heartbeat from core client for 30 sec - exiting 13:15:36 (7680): No heartbeat from core client for 30 sec - exiting 13:15:37 (7680): No heartbeat from core client for 30 sec - exiting 13:15:38 (7680): No heartbeat from core client for 30 sec - exiting 13:15:39 (7680): No heartbeat from core client for 30 sec - exiting 13:15:40 (7680): No heartbeat from core client for 30 sec - exiting 13:15:41 (7680): No heartbeat from core client for 30 sec - exiting 13:15:42 (7680): No heartbeat from core client for 30 sec - exiting 13:15:43 (7680): No heartbeat from core client for 30 sec - exiting 13:15:44 (7680): No heartbeat from core client for 30 sec - exiting 13:15:45 (7680): No heartbeat from core client for 30 sec - exiting 13:15:46 (7680): No heartbeat from core client for 30 sec - exiting 13:15:47 (7680): No heartbeat from core client for 30 sec - exiting 13:15:48 (7680): No heartbeat from core client for 30 sec - exiting 13:15:49 (7680): No heartbeat from core client for 30 sec - exiting 13:15:50 (7680): No heartbeat from core client for 30 sec - exiting 13:15:51 (7680): No heartbeat from core client for 30 sec - exiting 13:15:52 (7680): No heartbeat from core client for 30 sec - exiting 13:15:53 (7680): No heartbeat from core client for 30 sec - exiting 13:15:54 (7680): No heartbeat from core client for 30 sec - exiting 13:15:55 (7680): No heartbeat from core client for 30 sec - exiting 13:15:56 (7680): No heartbeat from core client for 30 sec - exiting 13:15:57 (7680): No heartbeat from core client for 30 sec - exiting 13:15:58 (7680): No heartbeat from core client for 30 sec - exiting 13:15:59 (7680): No heartbeat from core client for 30 sec - exiting 13:16:00 (7680): No heartbeat from core client for 30 sec - exiting 13:16:01 (7680): No heartbeat from core client for 30 sec - exiting 13:16:02 (7680): No heartbeat from core client for 30 sec - exiting 13:16:03 (7680): No heartbeat from core client for 30 sec - exiting 13:16:04 (7680): No heartbeat from core client for 30 sec - exiting 13:16:05 (7680): No heartbeat from core client for 30 sec - exiting 13:16:06 (7680): No heartbeat from core client for 30 sec - exiting 13:16:07 (7680): No heartbeat from core client for 30 sec - exiting 13:16:08 (7680): No heartbeat from core client for 30 sec - exiting 13:16:09 (7680): No heartbeat from core client for 30 sec - exiting 13:16:10 (7680): No heartbeat from core client for 30 sec - exiting 13:16:11 (7680): No heartbeat from core client for 30 sec - exiting 13:16:12 (7680): No heartbeat from core client for 30 sec - exiting 13:16:13 (7680): No heartbeat from core client for 30 sec - exiting 13:16:14 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:33:19 (6888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:40:14 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 19:10:22 (4896): No heartbeat from core client for 30 sec - exiting 19:10:23 (4896): No heartbeat from core client for 30 sec - exiting 19:10:24 (4896): No heartbeat from core client for 30 sec - exiting 19:10:25 (4896): No heartbeat from core client for 30 sec - exiting 19:10:26 (4896): No heartbeat from core client for 30 sec - exiting 19:10:27 (4896): No heartbeat from core client for 30 sec - exiting 19:10:28 (4896): No heartbeat from core client for 30 sec - exiting 19:10:29 (4896): No heartbeat from core client for 30 sec - exiting 19:10:30 (4896): No heartbeat from core client for 30 sec - exiting 19:10:31 (4896): No heartbeat from core client for 30 sec - exiting 19:10:32 (4896): No heartbeat from core client for 30 sec - exiting 19:10:33 (4896): No heartbeat from core client for 30 sec - exiting 19:10:34 (4896): No heartbeat from core client for 30 sec - exiting 19:10:35 (4896): No heartbeat from core client for 30 sec - exiting 19:10:36 (4896): No heartbeat from core client for 30 sec - exiting 19:10:37 (4896): No heartbeat from core client for 30 sec - exiting 19:10:38 (4896): No heartbeat from core client for 30 sec - exiting 19:10:39 (4896): No heartbeat from core client for 30 sec - exiting 19:10:40 (4896): No heartbeat from core client for 30 sec - exiting 19:10:41 (4896): No heartbeat from core client for 30 sec - exiting 19:10:42 (4896): No heartbeat from core client for 30 sec - exiting 19:10:43 (4896): No heartbeat from core client for 30 sec - exiting 19:10:44 (4896): No heartbeat from core client for 30 sec - exiting 19:10:45 (4896): No heartbeat from core client for 30 sec - exiting 19:10:46 (4896): No heartbeat from core client for 30 sec - exiting 19:10:47 (4896): No heartbeat from core client for 30 sec - exiting 19:10:48 (4896): No heartbeat from core client for 30 sec - exiting 19:10:49 (4896): No heartbeat from core client for 30 sec - exiting 19:10:50 (4896): No heartbeat from core client for 30 sec - exiting 19:10:51 (4896): No heartbeat from core client for 30 sec - exiting 19:10:52 (4896): No heartbeat from core client for 30 sec - exiting 19:10:53 (4896): No heartbeat from core client for 30 sec - exiting 19:10:54 (4896): No heartbeat from core client for 30 sec - exiting 19:10:55 (4896): No heartbeat from core client for 30 sec - exiting 19:10:56 (4896): No heartbeat from core client for 30 sec - exiting 19:10:57 (4896): No heartbeat from core client for 30 sec - exiting 19:10:58 (4896): No heartbeat from core client for 30 sec - exiting 19:10:59 (4896): No heartbeat from core client for 30 sec - exiting 19:11:00 (4896): No heartbeat from core client for 30 sec - exiting 19:11:01 (4896): No heartbeat from core client for 30 sec - exiting 19:11:02 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:58:24 (5636): No heartbeat from core client for 30 sec - exiting 13:58:25 (5636): No heartbeat from core client for 30 sec - exiting 13:58:26 (5636): No heartbeat from core client for 30 sec - exiting 13:58:27 (5636): No heartbeat from core client for 30 sec - exiting 13:58:28 (5636): No heartbeat from core client for 30 sec - exiting 13:58:29 (5636): No heartbeat from core client for 30 sec - exiting 13:58:30 (5636): No heartbeat from core client for 30 sec - exiting 13:58:31 (5636): No heartbeat from core client for 30 sec - exiting 13:58:32 (5636): No heartbeat from core client for 30 sec - exiting 13:58:33 (5636): No heartbeat from core client for 30 sec - exiting 13:58:34 (5636): No heartbeat from core client for 30 sec - exiting 13:58:35 (5636): No heartbeat from core client for 30 sec - exiting 13:58:36 (5636): No heartbeat from core client for 30 sec - exiting 13:58:37 (5636): No heartbeat from core client for 30 sec - exiting 13:58:38 (5636): No heartbeat from core client for 30 sec - exiting 13:58:39 (5636): No heartbeat from core client for 30 sec - exiting 13:58:40 (5636): No heartbeat from core client for 30 sec - exiting 13:58:41 (5636): No heartbeat from core client for 30 sec - exiting 13:58:42 (5636): No heartbeat from core client for 30 sec - exiting 13:58:43 (5636): No heartbeat from core client for 30 sec - exiting 13:58:44 (5636): No heartbeat from core client for 30 sec - exiting 13:58:45 (5636): No heartbeat from core client for 30 sec - exiting 13:58:46 (5636): No heartbeat from core client for 30 sec - exiting 13:58:47 (5636): No heartbeat from core client for 30 sec - exiting 13:58:48 (5636): No heartbeat from core client for 30 sec - exiting 13:58:49 (5636): No heartbeat from core client for 30 sec - exiting 13:58:50 (5636): No heartbeat from core client for 30 sec - exiting 13:58:51 (5636): No heartbeat from core client for 30 sec - exiting 13:58:52 (5636): No heartbeat from core client for 30 sec - exiting 13:58:53 (5636): No heartbeat from core client for 30 sec - exiting 13:58:54 (5636): No heartbeat from core client for 30 sec - exiting 13:58:55 (5636): No heartbeat from core client for 30 sec - exiting 13:58:56 (5636): No heartbeat from core client for 30 sec - exiting 13:58:57 (5636): No heartbeat from core client for 30 sec - exiting 13:58:58 (5636): No heartbeat from core client for 30 sec - exiting 13:58:59 (5636): No heartbeat from core client for 30 sec - exiting 13:59:00 (5636): No heartbeat from core client for 30 sec - exiting 13:59:01 (5636): No heartbeat from core client for 30 sec - exiting 13:59:02 (5636): No heartbeat from core client for 30 sec - exiting 13:59:03 (5636): No heartbeat from core client for 30 sec - exiting 13:59:04 (5636): No heartbeat from core client for 30 sec - exiting 13:59:05 (5636): No heartbeat from core client for 30 sec - exiting 13:59:06 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:19:17 (8148): No heartbeat from core client for 30 sec - exiting 10:19:18 (8148): No heartbeat from core client for 30 sec - exiting 10:19:19 (8148): No heartbeat from core client for 30 sec - exiting 10:19:20 (8148): No heartbeat from core client for 30 sec - exiting 10:19:21 (8148): No heartbeat from core client for 30 sec - exiting 10:19:22 (8148): No heartbeat from core client for 30 sec - exiting 10:19:23 (8148): No heartbeat from core client for 30 sec - exiting 10:19:24 (8148): No heartbeat from core client for 30 sec - exiting 10:19:25 (8148): No heartbeat from core client for 30 sec - exiting 10:19:26 (8148): No heartbeat from core client for 30 sec - exiting 10:19:27 (8148): No heartbeat from core client for 30 sec - exiting 10:19:28 (8148): No heartbeat from core client for 30 sec - exiting 10:19:29 (8148): No heartbeat from core client for 30 sec - exiting 10:19:30 (8148): No heartbeat from core client for 30 sec - exiting 10:19:31 (8148): No heartbeat from core client for 30 sec - exiting 10:19:32 (8148): No heartbeat from core client for 30 sec - exiting 10:19:33 (8148): No heartbeat from core client for 30 sec - exiting 10:19:34 (8148): No heartbeat from core client for 30 sec - exiting 10:19:35 (8148): No heartbeat from core client for 30 sec - exiting 10:19:36 (8148): No heartbeat from core client for 30 sec - exiting 10:19:37 (8148): No heartbeat from core client for 30 sec - exiting 10:19:38 (8148): No heartbeat from core client for 30 sec - exiting 10:19:39 (8148): No heartbeat from core client for 30 sec - exiting 10:19:40 (8148): No heartbeat from core client for 30 sec - exiting 10:19:41 (8148): No heartbeat from core client for 30 sec - exiting 10:19:42 (8148): No heartbeat from core client for 30 sec - exiting 10:19:43 (8148): No heartbeat from core client for 30 sec - exiting 10:19:44 (8148): No heartbeat from core client for 30 sec - exiting 10:19:45 (8148): No heartbeat from core client for 30 sec - exiting 10:19:46 (8148): No heartbeat from core client for 30 sec - exiting 10:19:47 (8148): No heartbeat from core client for 30 sec - exiting 10:19:48 (8148): No heartbeat from core client for 30 sec - exiting 10:19:49 (8148): No heartbeat from core client for 30 sec - exiting 10:19:50 (8148): No heartbeat from core client for 30 sec - exiting 10:19:51 (8148): No heartbeat from core client for 30 sec - exiting 10:19:52 (8148): No heartbeat from core client for 30 sec - exiting 10:19:53 (8148): No heartbeat from core client for 30 sec - exiting 10:19:54 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:08:38 (700): No heartbeat from core client for 30 sec - exiting 19:08:39 (700): No heartbeat from core client for 30 sec - exiting 19:08:41 (700): No heartbeat from core client for 30 sec - exiting 19:08:42 (700): No heartbeat from core client for 30 sec - exiting 19:08:43 (700): No heartbeat from core client for 30 sec - exiting 19:08:44 (700): No heartbeat from core client for 30 sec - exiting 19:08:45 (700): No heartbeat from core client for 30 sec - exiting 19:08:46 (700): No heartbeat from core client for 30 sec - exiting 19:08:47 (700): No heartbeat from core client for 30 sec - exiting 19:08:48 (700): No heartbeat from core client for 30 sec - exiting 19:08:49 (700): No heartbeat from core client for 30 sec - exiting 19:08:50 (700): No heartbeat from core client for 30 sec - exiting 19:08:51 (700): No heartbeat from core client for 30 sec - exiting 19:08:53 (700): No heartbeat from core client for 30 sec - exiting 19:08:54 (700): No heartbeat from core client for 30 sec - exiting 19:08:55 (700): No heartbeat from core client for 30 sec - exiting 19:08:56 (700): No heartbeat from core client for 30 sec - exiting 19:08:57 (700): No heartbeat from core client for 30 sec - exiting 19:08:58 (700): No heartbeat from core client for 30 sec - exiting 19:08:59 (700): No heartbeat from core client for 30 sec - exiting 19:09:00 (700): No heartbeat from core client for 30 sec - exiting 19:09:01 (700): No heartbeat from core client for 30 sec - exiting 19:09:02 (700): No heartbeat from core client for 30 sec - exiting 19:09:03 (700): No heartbeat from core client for 30 sec - exiting 19:09:05 (700): No heartbeat from core client for 30 sec - exiting 19:09:06 (700): No heartbeat from core client for 30 sec - exiting 19:09:07 (700): No heartbeat from core client for 30 sec - exiting 19:09:08 (700): No heartbeat from core client for 30 sec - exiting 19:09:09 (700): No heartbeat from core client for 30 sec - exiting 19:09:10 (700): No heartbeat from core client for 30 sec - exiting 19:09:11 (700): No heartbeat from core client for 30 sec - exiting 19:09:12 (700): No heartbeat from core client for 30 sec - exiting 19:09:13 (700): No heartbeat from core client for 30 sec - exiting 19:09:14 (700): No heartbeat from core client for 30 sec - exiting 19:09:15 (700): No heartbeat from core client for 30 sec - exiting 19:09:17 (700): No heartbeat from core client for 30 sec - exiting 19:09:18 (700): No heartbeat from core client for 30 sec - exiting 19:09:19 (700): No heartbeat from core client for 30 sec - exiting 19:09:20 (700): No heartbeat from core client for 30 sec - exiting 19:09:21 (700): No heartbeat from core client for 30 sec - exiting 19:09:22 (700): No heartbeat from core client for 30 sec - exiting 19:09:23 (700): No heartbeat from core client for 30 sec - exiting 19:09:24 (700): No heartbeat from core client for 30 sec - exiting 19:09:25 (700): No heartbeat from core client for 30 sec - exiting 19:09:26 (700): No heartbeat from core client for 30 sec - exiting 19:09:27 (700): No heartbeat from core client for 30 sec - exiting 19:09:29 (700): No heartbeat from core client for 30 sec - exiting 19:09:30 (700): No heartbeat from core client for 30 sec - exiting 19:09:31 (700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6348, selfPID=6348, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:11:43 (8708): No heartbeat from core client for 30 sec - exiting 10:11:44 (8708): No heartbeat from core client for 30 sec - exiting 10:11:46 (8708): No heartbeat from core client for 30 sec - exiting 10:11:47 (8708): No heartbeat from core client for 30 sec - exiting 10:11:48 (8708): No heartbeat from core client for 30 sec - exiting 10:11:49 (8708): No heartbeat from core client for 30 sec - exiting 10:11:50 (8708): No heartbeat from core client for 30 sec - exiting 10:11:51 (8708): No heartbeat from core client for 30 sec - exiting 10:11:52 (8708): No heartbeat from core client for 30 sec - exiting 10:11:53 (8708): No heartbeat from core client for 30 sec - exiting 10:11:54 (8708): No heartbeat from core client for 30 sec - exiting 10:11:55 (8708): No heartbeat from core client for 30 sec - exiting 10:11:56 (8708): No heartbeat from core client for 30 sec - exiting 10:11:58 (8708): No heartbeat from core client for 30 sec - exiting 10:11:59 (8708): No heartbeat from core client for 30 sec - exiting 10:12:00 (8708): No heartbeat from core client for 30 sec - exiting 10:12:01 (8708): No heartbeat from core client for 30 sec - exiting 10:12:02 (8708): No heartbeat from core client for 30 sec - exiting 10:12:03 (8708): No heartbeat from core client for 30 sec - exiting 10:12:04 (8708): No heartbeat from core client for 30 sec - exiting 10:12:05 (8708): No heartbeat from core client for 30 sec - exiting 10:12:06 (8708): No heartbeat from core client for 30 sec - exiting 10:12:07 (8708): No heartbeat from core client for 30 sec - exiting 10:12:08 (8708): No heartbeat from core client for 30 sec - exiting 10:12:10 (8708): No heartbeat from core client for 30 sec - exiting 10:12:11 (8708): No heartbeat from core client for 30 sec - exiting 10:12:12 (8708): No heartbeat from core client for 30 sec - exiting 10:12:13 (8708): No heartbeat from core client for 30 sec - exiting 10:12:14 (8708): No heartbeat from core client for 30 sec - exiting 10:12:15 (8708): No heartbeat from core client for 30 sec - exiting 10:12:16 (8708): No heartbeat from core client for 30 sec - exiting 10:12:17 (8708): No heartbeat from core client for 30 sec - exiting 10:12:18 (8708): No heartbeat from core client for 30 sec - exiting 10:12:19 (8708): No heartbeat from core client for 30 sec - exiting 10:12:20 (8708): No heartbeat from core client for 30 sec - exiting 10:12:22 (8708): No heartbeat from core client for 30 sec - exiting 10:12:23 (8708): No heartbeat from core client for 30 sec - exiting 10:12:24 (8708): No heartbeat from core client for 30 sec - exiting 10:12:25 (8708): No heartbeat from core client for 30 sec - exiting 10:12:26 (8708): No heartbeat from core client for 30 sec - exiting 10:12:27 (8708): No heartbeat from core client for 30 sec - exiting 10:12:28 (8708): No heartbeat from core client for 30 sec - exiting 10:12:29 (8708): No heartbeat from core client for 30 sec - exiting 10:12:30 (8708): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4820, selfPID=7912, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n778_2012_1_008583020_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n778_2012_1_008583020_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n778_2012_1_008583020_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n778_2012_1_008583020_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n778_2012_1_008583020_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n778_2012_1_008583020_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 May 2014 09:06:31	1321010	16398073	hadam3p_anz_n778_2012_1_008583020_0	69,419	402,910	5.8040
30 May 2014 12:12:44	1321010	16398073	hadam3p_anz_n778_2012_1_008583020_0	57,899	336,294	5.8083
29 May 2014 14:37:55	1321010	16398073	hadam3p_anz_n778_2012_1_008583020_0	46,379	268,911	5.7981
05 May 2014 05:48:12	1321010	16398073	hadam3p_anz_n778_2012_1_008583020_0	34,859	202,205	5.8007
29 Mar 2014 06:25:34	1321010	16398073	hadam3p_anz_n778_2012_1_008583020_0	23,339	136,066	5.8300
28 Mar 2014 09:22:15	1321010	16398073	hadam3p_anz_n778_2012_1_008583020_0	11,819	69,946	5.9181