Task 15075143

Name	hadam3p_eu_2ldo_1990_1_008118139_1
Workunit	8273253
Created	8 Aug 2012, 16:36:58 UTC
Sent	8 Aug 2012, 16:37:04 UTC
Report deadline	21 Jul 2013, 21:57:04 UTC
Received	21 Aug 2012, 0:22:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1 (0xFFFFFFFF) Unknown error code
Computer ID	1287694
Run time	7 days 0 hours 2 min 46 sec
CPU time	4 days 17 hours 44 min 29 sec
Validate state	Invalid
Credit	2,187.67
Device peak FLOPS	1.96 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1 (0xffffffff) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5284, selfPID=4168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 19:07:18 (4128): No heartbeat from core client for 30 sec - exiting 19:07:19 (4128): No heartbeat from core client for 30 sec - exiting 19:07:20 (4128): No heartbeat from core client for 30 sec - exiting 19:07:21 (4128): No heartbeat from core client for 30 sec - exiting 19:07:22 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:35:12 (968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:15 (968): No heartbeat from core client for 30 sec - exiting 20:35:16 (968): No heartbeat from core client for 30 sec - exiting 20:35:17 (968): No heartbeat from core client for 30 sec - exiting 20:37:03 (4836): No heartbeat from core client for 30 sec - exiting 20:37:04 (4836): No heartbeat from core client for 30 sec - exiting 20:37:05 (4836): No heartbeat from core client for 30 sec - exiting 20:37:07 (4836): No heartbeat from core client for 30 sec - exiting 20:37:08 (4836): No heartbeat from core client for 30 sec - exiting 20:37:09 (4836): No heartbeat from core client for 30 sec - exiting 20:37:10 (4836): No heartbeat from core client for 30 sec - exiting 20:37:11 (4836): No heartbeat from core client for 30 sec - exiting 20:37:12 (4836): No heartbeat from core client for 30 sec - exiting 20:37:13 (4836): No heartbeat from core client for 30 sec - exiting 20:37:14 (4836): No heartbeat from core client for 30 sec - exiting 20:37:15 (4836): No heartbeat from core client for 30 sec - exiting 20:37:16 (4836): No heartbeat from core client for 30 sec - exiting 20:37:18 (4836): No heartbeat from core client for 30 sec - exiting 20:37:19 (4836): No heartbeat from core client for 30 sec - exiting 20:37:20 (4836): No heartbeat from core client for 30 sec - exiting 20:37:21 (4836): No heartbeat from core client for 30 sec - exiting 20:37:22 (4836): No heartbeat from core client for 30 sec - exiting 20:37:23 (4836): No heartbeat from core client for 30 sec - exiting 20:37:24 (4836): No heartbeat from core client for 30 sec - exiting 20:37:25 (4836): No heartbeat from core client for 30 sec - exiting 20:37:26 (4836): No heartbeat from core client for 30 sec - exiting 20:41:39 (6288): No heartbeat from core client for 30 sec - exiting 20:41:40 (6288): No heartbeat from core client for 30 sec - exiting 20:41:41 (6288): No heartbeat from core client for 30 sec - exiting 20:41:42 (6288): No heartbeat from core client for 30 sec - exiting 20:41:43 (6288): No heartbeat from core client for 30 sec - exiting 20:41:45 (6288): No heartbeat from core client for 30 sec - exiting 20:41:46 (6288): No heartbeat from core client for 30 sec - exiting 20:41:47 (6288): No heartbeat from core client for 30 sec - exiting 20:41:48 (6288): No heartbeat from core client for 30 sec - exiting 20:41:49 (6288): No heartbeat from core client for 30 sec - exiting 20:41:50 (6288): No heartbeat from core client for 30 sec - exiting 20:41:51 (6288): No heartbeat from core client for 30 sec - exiting 20:41:52 (6288): No heartbeat from core client for 30 sec - exiting 20:41:53 (6288): No heartbeat from core client for 30 sec - exiting 20:41:54 (6288): No heartbeat from core client for 30 sec - exiting 20:41:55 (6288): No heartbeat from core client for 30 sec - exiting 20:41:57 (6288): No heartbeat from core client for 30 sec - exiting 20:41:58 (6288): No heartbeat from core client for 30 sec - exiting 20:41:59 (6288): No heartbeat from core client for 30 sec - exiting 20:42:00 (6288): No heartbeat from core client for 30 sec - exiting 20:42:01 (6288): No heartbeat from core client for 30 sec - exiting 20:42:02 (6288): No heartbeat from core client for 30 sec - exiting 20:42:03 (6288): No heartbeat from core client for 30 sec - exiting 20:42:04 (6288): No heartbeat from core client for 30 sec - exiting 20:42:05 (6288): No heartbeat from core client for 30 sec - exiting 20:42:06 (6288): No heartbeat from core client for 30 sec - exiting 20:42:08 (6288): No heartbeat from core client for 30 sec - exiting 20:42:09 (6288): No heartbeat from core client for 30 sec - exiting 20:42:10 (6288): No heartbeat from core client for 30 sec - exiting 20:42:11 (6288): No heartbeat from core client for 30 sec - exiting 20:42:12 (6288): No heartbeat from core client for 30 sec - exiting 20:42:13 (6288): No heartbeat from core client for 30 sec - exiting 20:42:14 (6288): No heartbeat from core client for 30 sec - exiting 20:42:15 (6288): No heartbeat from core client for 30 sec - exiting 20:42:16 (6288): No heartbeat from core client for 30 sec - exiting 20:42:17 (6288): No heartbeat from core client for 30 sec - exiting 20:42:18 (6288): No heartbeat from core client for 30 sec - exiting 20:42:20 (6288): No heartbeat from core client for 30 sec - exiting 20:42:21 (6288): No heartbeat from core client for 30 sec - exiting 20:42:22 (6288): No heartbeat from core client for 30 sec - exiting 20:42:23 (6288): No heartbeat from core client for 30 sec - exiting 20:42:24 (6288): No heartbeat from core client for 30 sec - exiting 20:42:25 (6288): No heartbeat from core client for 30 sec - exiting 20:42:26 (6288): No heartbeat from core client for 30 sec - exiting 20:42:27 (6288): No heartbeat from core client for 30 sec - exiting 20:42:28 (6288): No heartbeat from core client for 30 sec - exiting 20:42:29 (6288): No heartbeat from core client for 30 sec - exiting 20:42:30 (6288): No heartbeat from core client for 30 sec - exiting 20:42:32 (6288): No heartbeat from core client for 30 sec - exiting 20:42:33 (6288): No heartbeat from core client for 30 sec - exiting 20:42:34 (6288): No heartbeat from core client for 30 sec - exiting 20:42:35 (6288): No heartbeat from core client for 30 sec - exiting 20:42:36 (6288): No heartbeat from core client for 30 sec - exiting 20:42:37 (6288): No heartbeat from core client for 30 sec - exiting 20:42:38 (6288): No heartbeat from core client for 30 sec - exiting 20:42:39 (6288): No heartbeat from core client for 30 sec - exiting 20:42:40 (6288): No heartbeat from core client for 30 sec - exiting 20:42:41 (6288): No heartbeat from core client for 30 sec - exiting 20:42:43 (6288): No heartbeat from core client for 30 sec - exiting 20:42:44 (6288): No heartbeat from core client for 30 sec - exiting 20:42:45 (6288): No heartbeat from core client for 30 sec - exiting 20:42:46 (6288): No heartbeat from core client for 30 sec - exiting 20:42:47 (6288): No heartbeat from core client for 30 sec - exiting 20:42:48 (6288): No heartbeat from core client for 30 sec - exiting 20:42:49 (6288): No heartbeat from core client for 30 sec - exiting 20:42:50 (6288): No heartbeat from core client for 30 sec - exiting 20:42:51 (6288): No heartbeat from core client for 30 sec - exiting 20:42:52 (6288): No heartbeat from core client for 30 sec - exiting 20:42:54 (6288): No heartbeat from core client for 30 sec - exiting 20:42:55 (6288): No heartbeat from core client for 30 sec - exiting 20:42:56 (6288): No heartbeat from core client for 30 sec - exiting 20:42:57 (6288): No heartbeat from core client for 30 sec - exiting 20:42:58 (6288): No heartbeat from core client for 30 sec - exiting 20:42:59 (6288): No heartbeat from core client for 30 sec - exiting 20:43:00 (6288): No heartbeat from core client for 30 sec - exiting 20:43:01 (6288): No heartbeat from core client for 30 sec - exiting 20:43:02 (6288): No heartbeat from core client for 30 sec - exiting 20:43:03 (6288): No heartbeat from core client for 30 sec - exiting 20:43:04 (6288): No heartbeat from core client for 30 sec - exiting 20:43:06 (6288): No heartbeat from core client for 30 sec - exiting 20:43:07 (6288): No heartbeat from core client for 30 sec - exiting 20:43:08 (6288): No heartbeat from core client for 30 sec - exiting 20:43:09 (6288): No heartbeat from core client for 30 sec - exiting 20:43:10 (6288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... C03:31:04 (4948): No heartbeat from core client for 30 sec - exiting 03:31:05 (4948): No heartbeat from core client for 30 sec - exiting 03:31:06 (4948): No heartbeat from core client for 30 sec - exiting 03:31:08 (4948): No heartbeat from core client for 30 sec - exiting 03:31:09 (4948): No heartbeat from core client for 30 sec - exiting 03:31:10 (4948): No heartbeat from core client for 30 sec - exiting 03:31:11 (4948): No heartbeat from core client for 30 sec - exiting 03:31:12 (4948): No heartbeat from core client for 30 sec - exiting 03:31:13 (4948): No heartbeat from core client for 30 sec - exiting 03:31:14 (4948): No heartbeat from core client for 30 sec - exiting 03:31:15 (4948): No heartbeat from core client for 30 sec - exiting 03:31:16 (4948): No heartbeat from core client for 30 sec - exiting 03:31:17 (4948): No heartbeat from core client for 30 sec - exiting 03:31:19 (4948): No heartbeat from core client for 30 sec - exiting 03:31:20 (4948): No heartbeat from core client for 30 sec - exiting 03:31:21 (4948): No heartbeat from core client for 30 sec - exiting 03:31:22 (4948): No heartbeat from core client for 30 sec - exiting 03:31:23 (4948): No heartbeat from core client for 30 sec - exiting 03:31:24 (4948): No heartbeat from core client for 30 sec - exiting 03:31:25 (4948): No heartbeat from core client for 30 sec - exiting 03:31:26 (4948): No heartbeat from core client for 30 sec - exiting 03:31:27 (4948): No heartbeat from core client for 30 sec - exiting 03:31:28 (4948): No heartbeat from core client for 30 sec - exiting 03:31:29 (4948): No heartbeat from core client for 30 sec - exiting 03:31:31 (4948): No heartbeat from core client for 30 sec - exiting 03:31:32 (4948): No heartbeat from core client for 30 sec - exiting 03:31:33 (4948): No heartbeat from core client for 30 sec - exiting 03:31:34 (4948): No heartbeat from core client for 30 sec - exiting 03:31:35 (4948): No heartbeat from core client for 30 sec - exiting 03:31:36 (4948): No heartbeat from core client for 30 sec - exiting 03:31:37 (4948): No heartbeat from core client for 30 sec - exiting 03:31:38 (4948): No heartbeat from core client for 30 sec - exiting 03:31:39 (4948): No heartbeat from core client for 30 sec - exiting 03:31:40 (4948): No heartbeat from core client for 30 sec - exiting 03:31:42 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8564, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8500, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7740, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 09:50:14 (4168): No heartbeat from core client for 30 sec - exiting 09:50:15 (4168): No heartbeat from core client for 30 sec - exiting 09:50:16 (4168): No heartbeat from core client for 30 sec - exiting 09:50:17 (4168): No heartbeat from core client for 30 sec - exiting 09:50:18 (4168): No heartbeat from core client for 30 sec - exiting 09:50:19 (4168): No heartbeat from core client for 30 sec - exiting 09:50:21 (4168): No heartbeat from core client for 30 sec - exiting 09:50:22 (4168): No heartbeat from core client for 30 sec - exiting 09:50:23 (4168): No heartbeat from core client for 30 sec - exiting 09:50:24 (4168): No heartbeat from core client for 30 sec - exiting 09:50:25 (4168): No heartbeat from core client for 30 sec - exiting 09:50:26 (4168): No heartbeat from core client for 30 sec - exiting 09:50:27 (4168): No heartbeat from core client for 30 sec - exiting 09:50:28 (4168): No heartbeat from core client for 30 sec - exiting 09:50:29 (4168): No heartbeat from core client for 30 sec - exiting 09:51:19 (4168): No heartbeat from core client for 30 sec - exiting 09:51:20 (4168): No heartbeat from core client for 30 sec - exiting 09:51:21 (4168): No heartbeat from core client for 30 sec - exiting 09:51:22 (4168): No heartbeat from core client for 30 sec - exiting 09:51:23 (4168): No heartbeat from core client for 30 sec - exiting 09:51:24 (4168): No heartbeat from core client for 30 sec - exiting 09:51:25 (4168): No heartbeat from core client for 30 sec - exiting 09:51:26 (4168): No heartbeat from core client for 30 sec - exiting 09:51:28 (4168): No heartbeat from core client for 30 sec - exiting 09:51:29 (4168): No heartbeat from core client for 30 sec - exiting 09:51:30 (4168): No heartbeat from core client for 30 sec - exiting 09:51:31 (4168): No heartbeat from core client for 30 sec - exiting 09:51:32 (4168): No heartbeat from core client for 30 sec - exiting 09:51:33 (4168): No heartbeat from core client for 30 sec - exiting 09:51:34 (4168): No heartbeat from core client for 30 sec - exiting 09:51:35 (4168): No heartbeat from core client for 30 sec - exiting 09:51:36 (4168): No heartbeat from core client for 30 sec - exiting 09:51:37 (4168): No heartbeat from core client for 30 sec - exiting 09:51:38 (4168): No heartbeat from core client for 30 sec - exiting 09:51:40 (4168): No heartbeat from core client for 30 sec - exiting 09:51:41 (4168): No heartbeat from core client for 30 sec - exiting 09:51:42 (4168): No heartbeat from core client for 30 sec - exiting 09:51:43 (4168): No heartbeat from core client for 30 sec - exiting 09:51:44 (4168): No heartbeat from core client for 30 sec - exiting 09:51:45 (4168): No heartbeat from core client for 30 sec - exiting 09:51:46 (4168): No heartbeat from core client for 30 sec - exiting 09:51:47 (4168): No heartbeat from core client for 30 sec - exiting 09:51:48 (4168): No heartbeat from core client for 30 sec - exiting 09:51:49 (4168): No heartbeat from core client for 30 sec - exiting 09:51:50 (4168): No heartbeat from core client for 30 sec - exiting 09:51:52 (4168): No heartbeat from core client for 30 sec - exiting 09:51:53 (4168): No heartbeat from core client for 30 sec - exiting 09:51:54 (4168): No heartbeat from core client for 30 sec - exiting 09:51:55 (4168): No heartbeat from core client for 30 sec - exiting 09:51:56 (4168): No heartbeat from core client for 30 sec - exiting 09:51:57 (4168): No heartbeat from core client for 30 sec - exiting 09:51:58 (4168): No heartbeat from core client for 30 sec - exiting 09:51:59 (4168): No heartbeat from core client for 30 sec - exiting 09:52:00 (4168): No heartbeat from core client for 30 sec - exiting 09:52:01 (4168): No heartbeat from core client for 30 sec - exiting 09:52:03 (4168): No heartbeat from core client for 30 sec - exiting 09:52:04 (4168): No heartbeat from core client for 30 sec - exiting 09:52:05 (4168): No heartbeat from core client for 30 sec - exiting 09:52:06 (4168): No heartbeat from core client for 30 sec - exiting 09:52:07 (4168): No heartbeat from core client for 30 sec - exiting 09:52:08 (4168): No heartbeat from core client for 30 sec - exiting 09:52:09 (4168): No heartbeat from core client for 30 sec - exiting 09:52:10 (4168): No heartbeat from core client for 30 sec - exiting 09:52:11 (4168): No heartbeat from core client for 30 sec - exiting 09:52:12 (4168): No heartbeat from core client for 30 sec - exiting 09:52:13 (4168): No heartbeat from core client for 30 sec - exiting 09:52:14 (4168): No heartbeat from core client for 30 sec - exiting 09:52:15 (4168): No heartbeat from core client for 30 sec - exiting 09:52:17 (4168): No heartbeat from core client for 30 sec - exiting 09:52:18 (4168): No heartbeat from core client for 30 sec - exiting 09:52:19 (4168): No heartbeat from core client for 30 sec - exiting 09:52:20 (4168): No heartbeat from core client for 30 sec - exiting 09:52:21 (4168): No heartbeat from core client for 30 sec - exiting 09:52:22 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:52:23 (4168): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2480, iMonCtr=2 23:21:03 (5348): No heartbeat from core client for 30 sec - exiting 23:21:05 (5348): No heartbeat from core client for 30 sec - exiting 23:21:06 (5348): No heartbeat from core client for 30 sec - exiting 23:21:07 (5348): No heartbeat from core client for 30 sec - exiting 23:21:08 (5348): No heartbeat from core client for 30 sec - exiting 23:21:09 (5348): No heartbeat from core client for 30 sec - exiting 23:21:10 (5348): No heartbeat from core client for 30 sec - exiting 23:21:11 (5348): No heartbeat from core client for 30 sec - exiting 23:21:12 (5348): No heartbeat from core client for 30 sec - exiting 23:21:14 (5348): No heartbeat from core client for 30 sec - exiting 23:21:15 (5348): No heartbeat from core client for 30 sec - exiting 23:21:16 (5348): No heartbeat from core client for 30 sec - exiting 23:21:17 (5348): No heartbeat from core client for 30 sec - exiting 23:21:18 (5348): No heartbeat from core client for 30 sec - exiting 23:21:19 (5348): No heartbeat from core client for 30 sec - exiting 23:21:20 (5348): No heartbeat from core client for 30 sec - exiting 23:21:21 (5348): No heartbeat from core client for 30 sec - exiting 23:21:22 (5348): No heartbeat from core client for 30 sec - exiting 23:21:23 (5348): No heartbeat from core client for 30 sec - exiting 23:21:24 (5348): No heartbeat from core client for 30 sec - exiting 23:21:26 (5348): No heartbeat from core client for 30 sec - exiting 23:21:27 (5348): No heartbeat from core client for 30 sec - exiting 23:21:28 (5348): No heartbeat from core client for 30 sec - exiting 23:21:29 (5348): No heartbeat from core client for 30 sec - exiting 23:21:30 (5348): No heartbeat from core client for 30 sec - exiting 23:21:31 (5348): No heartbeat from core client for 30 sec - exiting 23:21:32 (5348): No heartbeat from core client for 30 sec - exiting 23:21:33 (5348): No heartbeat from core client for 30 sec - exiting 23:21:34 (5348): No heartbeat from core client for 30 sec - exiting 23:21:35 (5348): No heartbeat from core client for 30 sec - exiting 23:21:37 (5348): No heartbeat from core client for 30 sec - exiting 23:21:38 (5348): No heartbeat from core client for 30 sec - exiting 23:21:39 (5348): No heartbeat from core client for 30 sec - exiting 23:21:40 (5348): No heartbeat from core client for 30 sec - exiting 23:21:41 (5348): No heartbeat from core client for 30 sec - exiting 23:21:42 (5348): No heartbeat from core client for 30 sec - exiting 23:21:43 (5348): No heartbeat from core client for 30 sec - exiting 23:21:44 (5348): No heartbeat from core client for 30 sec - exiting 23:21:45 (5348): No heartbeat from core client for 30 sec - exiting 23:21:46 (5348): No heartbeat from core client for 30 sec - exiting 23:21:48 (5348): No heartbeat from core client for 30 sec - exiting 23:21:49 (5348): No heartbeat from core client for 30 sec - exiting 23:21:50 (5348): No heartbeat from core client for 30 sec - exiting 23:21:51 (5348): No heartbeat from core client for 30 sec - exiting 23:21:52 (5348): No heartbeat from core client for 30 sec - exiting 23:21:53 (5348): No heartbeat from core client for 30 sec - exiting 23:21:54 (5348): No heartbeat from core client for 30 sec - exiting 23:21:55 (5348): No heartbeat from core client for 30 sec - exiting 23:21:56 (5348): No heartbeat from core client for 30 sec - exiting 23:21:57 (5348): No heartbeat from core client for 30 sec - exiting 23:21:58 (5348): No heartbeat from core client for 30 sec - exiting 23:22:00 (5348): No heartbeat from core client for 30 sec - exiting 23:22:01 (5348): No heartbeat from core client for 30 sec - exiting 23:22:02 (5348): No heartbeat from core client for 30 sec - exiting 23:22:03 (5348): No heartbeat from core client for 30 sec - exiting 23:22:04 (5348): No heartbeat from core client for 30 sec - exiting 23:22:05 (5348): No heartbeat from core client for 30 sec - exiting 23:22:06 (5348): No heartbeat from core client for 30 sec - exiting 23:22:07 (5348): No heartbeat from core client for 30 sec - exiting 23:22:08 (5348): No heartbeat from core client for 30 sec - exiting 23:22:09 (5348): No heartbeat from core client for 30 sec - exiting 23:22:10 (5348): No heartbeat from core client for 30 sec - exiting 23:22:12 (5348): No heartbeat from core client for 30 sec - exiting 23:22:13 (5348): No heartbeat from core client for 30 sec - exiting 23:22:14 (5348): No heartbeat from core client for 30 sec - exiting 23:22:15 (5348): No heartbeat from core client for 30 sec - exiting 23:22:16 (5348): No heartbeat from core client for 30 sec - exiting 23:22:17 (5348): No heartbeat from core client for 30 sec - exiting 23:22:18 (5348): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Aug 2012 06:03:37	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	126,816	387,244	3.0536
17 Aug 2012 15:26:18	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	115,296	351,359	3.0475
17 Aug 2012 01:13:26	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	103,776	315,493	3.0401
16 Aug 2012 10:31:16	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	92,256	281,413	3.0503
15 Aug 2012 00:48:24	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	80,736	246,868	3.0577
14 Aug 2012 09:56:42	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	69,216	212,352	3.0680
13 Aug 2012 18:15:16	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	57,696	177,553	3.0774
12 Aug 2012 15:06:53	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	46,176	140,946	3.0524
11 Aug 2012 09:16:59	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	34,656	104,179	3.0061
10 Aug 2012 02:25:42	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	23,136	68,460	2.9590
09 Aug 2012 12:32:04	1185536	15075143	hadam3p_eu_2ldo_1990_1_008118139_1	11,616	34,328	2.9552