Task 13838014

Name	hadam3p_saf_1ga1_1986_1_007624555_0
Workunit	7802874
Created	30 Dec 2011, 9:33:25 UTC
Sent	30 Dec 2011, 9:54:03 UTC
Report deadline	11 Dec 2012, 15:14:03 UTC
Received	6 Jan 2012, 2:03:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	912294
Run time	1 days 19 hours 58 min 36 sec
CPU time	1 days 19 hours 58 min 36 sec
Validate state	Invalid
Credit	1,309.70
Device peak FLOPS	3.13 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9668, selfPID=9668, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8808, selfPID=8808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 18:35:22 (5172): No heartbeat from core client for 30 sec - exiting 18:35:23 (5172): No heartbeat from core client for 30 sec - exiting 18:35:24 (5172): No heartbeat from core client for 30 sec - exiting 18:35:25 (5172): No heartbeat from core client for 30 sec - exiting 18:35:27 (5172): No heartbeat from core client for 30 sec - exiting 18:35:28 (5172): No heartbeat from core client for 30 sec - exiting 18:35:29 (5172): No heartbeat from core client for 30 sec - exiting 18:35:30 (5172): No heartbeat from core client for 30 sec - exiting 18:35:31 (5172): No heartbeat from core client for 30 sec - exiting 18:35:32 (5172): No heartbeat from core client for 30 sec - exiting 18:35:33 (5172): No heartbeat from core client for 30 sec - exiting 18:35:34 (5172): No heartbeat from core client for 30 sec - exiting 18:35:35 (5172): No heartbeat from core client for 30 sec - exiting 18:35:36 (5172): No heartbeat from core client for 30 sec - exiting 18:35:37 (5172): No heartbeat from core client for 30 sec - exiting 18:35:39 (5172): No heartbeat from core client for 30 sec - exiting 18:35:40 (5172): No heartbeat from core client for 30 sec - exiting 18:35:41 (5172): No heartbeat from core client for 30 sec - exiting 18:35:42 (5172): No heartbeat from core client for 30 sec - exiting 18:35:43 (5172): No heartbeat from core client for 30 sec - exiting 18:35:44 (5172): No heartbeat from core client for 30 sec - exiting 18:35:45 (5172): No heartbeat from core client for 30 sec - exiting 18:35:46 (5172): No heartbeat from core client for 30 sec - exiting 18:35:47 (5172): No heartbeat from core client for 30 sec - exiting 18:35:48 (5172): No heartbeat from core client for 30 sec - exiting 18:35:49 (5172): No heartbeat from core client for 30 sec - exiting 18:35:51 (5172): No heartbeat from core client for 30 sec - exiting 18:35:52 (5172): No heartbeat from core client for 30 sec - exiting 18:35:53 (5172): No heartbeat from core client for 30 sec - exiting 18:35:54 (5172): No heartbeat from core client for 30 sec - exiting 18:35:55 (5172): No heartbeat from core client for 30 sec - exiting 18:35:56 (5172): No heartbeat from core client for 30 sec - exiting 18:35:57 (5172): No heartbeat from core client for 30 sec - exiting 18:35:58 (5172): No heartbeat from core client for 30 sec - exiting 18:35:59 (5172): No heartbeat from core client for 30 sec - exiting 18:36:00 (5172): No heartbeat from core client for 30 sec - exiting 18:36:02 (5172): No heartbeat from core client for 30 sec - exiting 18:36:03 (5172): No heartbeat from core client for 30 sec - exiting 18:36:04 (5172): No heartbeat from core client for 30 sec - exiting 18:36:05 (5172): No heartbeat from core client for 30 sec - exiting 18:36:06 (5172): No heartbeat from core client for 30 sec - exiting 18:36:07 (5172): No heartbeat from core client for 30 sec - exiting 18:36:08 (5172): No heartbeat from core client for 30 sec - exiting 18:36:09 (5172): No heartbeat from core client for 30 sec - exiting 18:36:10 (5172): No heartbeat from core client for 30 sec - exiting 18:36:11 (5172): No heartbeat from core client for 30 sec - exiting 18:36:12 (5172): No heartbeat from core client for 30 sec - exiting 18:36:14 (5172): No heartbeat from core client for 30 sec - exiting 18:36:15 (5172): No heartbeat from core client for 30 sec - exiting 18:36:16 (5172): No heartbeat from core client for 30 sec - exiting 18:36:17 (5172): No heartbeat from core client for 30 sec - exiting 18:36:18 (5172): No heartbeat from core client for 30 sec - exiting 18:36:19 (5172): No heartbeat from core client for 30 sec - exiting 18:36:20 (5172): No heartbeat from core client for 30 sec - exiting 18:36:21 (5172): No heartbeat from core client for 30 sec - exiting 18:36:22 (5172): No heartbeat from core client for 30 sec - exiting 18:36:23 (5172): No heartbeat from core client for 30 sec - exiting 18:36:24 (5172): No heartbeat from core client for 30 sec - exiting 18:36:26 (5172): No heartbeat from core client for 30 sec - exiting 18:36:27 (5172): No heartbeat from core client for 30 sec - exiting 18:36:28 (5172): No heartbeat from core client for 30 sec - exiting 18:36:29 (5172): No heartbeat from core client for 30 sec - exiting 18:36:30 (5172): No heartbeat from core client for 30 sec - exiting 18:36:31 (5172): No heartbeat from core client for 30 sec - exiting 18:36:32 (5172): No heartbeat from core client for 30 sec - exiting 18:36:33 (5172): No heartbeat from core client for 30 sec - exiting 18:36:34 (5172): No heartbeat from core client for 30 sec - exiting 18:36:35 (5172): No heartbeat from core client for 30 sec - exiting 18:36:37 (5172): No heartbeat from core client for 30 sec - exiting 18:36:38 (5172): No heartbeat from core client for 30 sec - exiting 18:36:39 (5172): No heartbeat from core client for 30 sec - exiting 18:36:40 (5172): No heartbeat from core client for 30 sec - exiting 18:36:41 (5172): No heartbeat from core client for 30 sec - exiting 18:36:42 (5172): No heartbeat from core client for 30 sec - exiting 18:36:43 (5172): No heartbeat from core client for 30 sec - exiting 18:36:44 (5172): No heartbeat from core client for 30 sec - exiting 18:36:45 (5172): No heartbeat from core client for 30 sec - exiting 18:36:46 (5172): No heartbeat from core client for 30 sec - exiting 18:36:47 (5172): No heartbeat from core client for 30 sec - exiting 18:36:49 (5172): No heartbeat from core client for 30 sec - exiting 18:36:50 (5172): No heartbeat from core client for 30 sec - exiting 18:36:51 (5172): No heartbeat from core client for 30 sec - exiting 18:36:52 (5172): No heartbeat from core client for 30 sec - exiting 18:36:53 (5172): No heartbeat from core client for 30 sec - exiting 18:36:54 (5172): No heartbeat from core client for 30 sec - exiting 18:36:55 (5172): No heartbeat from core client for 30 sec - exiting 18:36:56 (5172): No heartbeat from core client for 30 sec - exiting 18:36:57 (5172): No heartbeat from core client for 30 sec - exiting 18:36:58 (5172): No heartbeat from core client for 30 sec - exiting 18:36:59 (5172): No heartbeat from core client for 30 sec - exiting 18:37:01 (5172): No heartbeat from core client for 30 sec - exiting 18:37:02 (5172): No heartbeat from core client for 30 sec - exiting 18:37:03 (5172): No heartbeat from core client for 30 sec - exiting 18:37:04 (5172): No heartbeat from core client for 30 sec - exiting 18:37:05 (5172): No heartbeat from core client for 30 sec - exiting 18:37:06 (5172): No heartbeat from core client for 30 sec - exiting 18:37:07 (5172): No heartbeat from core client for 30 sec - exiting 18:37:08 (5172): No heartbeat from core client for 30 sec - exiting 18:37:09 (5172): No heartbeat from core client for 30 sec - exiting 18:37:10 (5172): No heartbeat from core client for 30 sec - exiting 18:37:12 (5172): No heartbeat from core client for 30 sec - exiting 18:37:13 (5172): No heartbeat from core client for 30 sec - exiting 18:37:14 (5172): No heartbeat from core client for 30 sec - exiting 18:37:15 (5172): No heartbeat from core client for 30 sec - exiting 18:37:16 (5172): No heartbeat from core client for 30 sec - exiting 18:37:17 (5172): No heartbeat from core client for 30 sec - exiting 18:37:18 (5172): No heartbeat from core client for 30 sec - exiting 18:37:19 (5172): No heartbeat from core client for 30 sec - exiting 18:37:20 (5172): No heartbeat from core client for 30 sec - exiting 18:37:21 (5172): No heartbeat from core client for 30 sec - exiting 18:37:22 (5172): No heartbeat from core client for 30 sec - exiting 18:37:24 (5172): No heartbeat from core client for 30 sec - exiting 18:37:25 (5172): No heartbeat from core client for 30 sec - exiting 18:37:26 (5172): No heartbeat from core client for 30 sec - exiting 18:37:27 (5172): No heartbeat from core client for 30 sec - exiting 18:37:28 (5172): No heartbeat from core client for 30 sec - exiting 18:37:29 (5172): No heartbeat from core client for 30 sec - exiting 18:37:30 (5172): No heartbeat from core client for 30 sec - exiting 18:37:31 (5172): No heartbeat from core client for 30 sec - exiting 18:37:32 (5172): No heartbeat from core client for 30 sec - exiting 18:37:33 (5172): No heartbeat from core client for 30 sec - exiting 18:37:34 (5172): No heartbeat from core client for 30 sec - exiting 18:37:36 (5172): No heartbeat from core client for 30 sec - exiting 18:37:37 (5172): No heartbeat from core client for 30 sec - exiting 18:37:38 (5172): No heartbeat from core client for 30 sec - exiting 18:37:39 (5172): No heartbeat from core client for 30 sec - exiting 18:37:40 (5172): No heartbeat from core client for 30 sec - exiting 18:37:41 (5172): No heartbeat from core client for 30 sec - exiting 18:37:42 (5172): No heartbeat from core client for 30 sec - exiting 18:37:43 (5172): No heartbeat from core client for 30 sec - exiting 18:37:44 (5172): No heartbeat from core client for 30 sec - exiting 18:37:45 (5172): No heartbeat from core client for 30 sec - exiting 18:37:47 (5172): No heartbeat from core client for 30 sec - exiting 18:37:48 (5172): No heartbeat from core client for 30 sec - exiting 18:37:49 (5172): No heartbeat from core client for 30 sec - exiting 18:37:50 (5172): No heartbeat from core client for 30 sec - exiting 18:37:51 (5172): No heartbeat from core client for 30 sec - exiting 18:37:52 (5172): No heartbeat from core client for 30 sec - exiting 18:37:53 (5172): No heartbeat from core client for 30 sec - exiting 18:37:54 (5172): No heartbeat from core client for 30 sec - exiting 18:37:55 (5172): No heartbeat from core client for 30 sec - exiting 18:37:56 (5172): No heartbeat from core client for 30 sec - exiting 18:37:57 (5172): No heartbeat from core client for 30 sec - exiting 18:37:59 (5172): No heartbeat from core client for 30 sec - exiting 18:38:00 (5172): No heartbeat from core client for 30 sec - exiting 18:38:01 (5172): No heartbeat from core client for 30 sec - exiting 18:38:02 (5172): No heartbeat from core client for 30 sec - exiting 18:38:03 (5172): No heartbeat from core client for 30 sec - exiting 18:38:04 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... RegionaController:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4016, selfPID=4016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8792, selfPID=8792, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4292, selfPID=4292, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5736, selfPID=5736, iMonCtr=2 05:09:02 (3400): No heartbeat from core client for 30 sec - exiting 05:09:03 (3400): No heartbeat from core client for 30 sec - exiting 05:09:05 (3400): No heartbeat from core client for 30 sec - exiting 05:09:06 (3400): No heartbeat from core client for 30 sec - exiting 05:09:07 (3400): No heartbeat from core client for 30 sec - exiting 05:09:08 (3400): No heartbeat from core client for 30 sec - exiting 05:09:09 (3400): No heartbeat from core client for 30 sec - exiting 05:09:10 (3400): No heartbeat from core client for 30 sec - exiting 05:09:11 (3400): No heartbeat from core client for 30 sec - exiting 05:09:12 (3400): No heartbeat from core client for 30 sec - exiting 05:09:13 (3400): No heartbeat from core client for 30 sec - exiting 05:09:14 (3400): No heartbeat from core client for 30 sec - exiting 05:09:16 (3400): No heartbeat from core client for 30 sec - exiting 05:09:17 (3400): No heartbeat from core client for 30 sec - exiting 05:09:18 (3400): No heartbeat from core client for 30 sec - exiting 05:09:19 (3400): No heartbeat from core client for 30 sec - exiting 05:09:20 (3400): No heartbeat from core client for 30 sec - exiting 05:09:21 (3400): No heartbeat from core client for 30 sec - exiting 05:09:22 (3400): No heartbeat from core client for 30 sec - exiting 05:09:23 (3400): No heartbeat from core client for 30 sec - exiting 05:09:24 (3400): No heartbeat from core client for 30 sec - exiting 05:09:25 (3400): No heartbeat from core client for 30 sec - exiting 05:09:26 (3400): No heartbeat from core client for 30 sec - exiting 05:09:28 (3400): No heartbeat from core client for 30 sec - exiting 05:09:29 (3400): No heartbeat from core client for 30 sec - exiting 05:09:30 (3400): No heartbeat from core client for 30 sec - exiting 05:09:31 (3400): No heartbeat from core client for 30 sec - exiting 05:09:32 (3400): No heartbeat from core client for 30 sec - exiting 05:09:33 (3400): No heartbeat from core client for 30 sec - exiting 05:09:34 (3400): No heartbeat from core client for 30 sec - exiting 05:09:35 (3400): No heartbeat from core client for 30 sec - exiting 05:09:36 (3400): No heartbeat from core client for 30 sec - exiting 05:09:37 (3400): No heartbeat from core client for 30 sec - exiting 05:09:38 (3400): No heartbeat from core client for 30 sec - exiting 05:09:40 (3400): No heartbeat from core client for 30 sec - exiting 05:09:41 (3400): No heartbeat from core client for 30 sec - exiting 05:09:42 (3400): No heartbeat from core client for 30 sec - exiting 05:09:43 (3400): No heartbeat from core client for 30 sec - exiting 05:09:44 (3400): No heartbeat from core client for 30 sec - exiting 05:09:45 (3400): No heartbeat from core client for 30 sec - exiting 05:09:46 (3400): No heartbeat from core client for 30 sec - exiting 05:09:47 (3400): No heartbeat from core client for 30 sec - exiting 05:09:48 (3400): No heartbeat from core client for 30 sec - exiting 05:09:49 (3400): No heartbeat from core client for 30 sec - exiting 05:09:51 (3400): No heartbeat from core client for 30 sec - exiting 05:09:52 (3400): No heartbeat from core client for 30 sec - exiting 05:09:53 (3400): No heartbeat from core client for 30 sec - exiting 05:09:54 (3400): No heartbeat from core client for 30 sec - exiting 05:09:55 (3400): No heartbeat from core client for 30 sec - exiting 05:09:56 (3400): No heartbeat from core client for 30 sec - exiting 05:09:57 (3400): No heartbeat from core client for 30 sec - exiting 05:09:58 (3400): No heartbeat from core client for 30 sec - exiting 05:09:59 (3400): No heartbeat from core client for 30 sec - exiting 05:10:00 (3400): No heartbeat from core client for 30 sec - exiting 05:10:01 (3400): No heartbeat from core client for 30 sec - exiting 05:10:03 (3400): No heartbeat from core client for 30 sec - exiting 05:10:04 (3400): No heartbeat from core client for 30 sec - exiting 05:10:05 (3400): No heartbeat from core client for 30 sec - exiting 05:10:06 (3400): No heartbeat from core client for 30 sec - exiting 05:10:07 (3400): No heartbeat from core client for 30 sec - exiting 05:10:08 (3400): No heartbeat from core client for 30 sec - exiting 05:10:09 (3400): No heartbeat from core client for 30 sec - exiting 05:10:10 (3400): No heartbeat from core client for 30 sec - exiting 05:10:11 (3400): No heartbeat from core client for 30 sec - exiting 05:10:12 (3400): No heartbeat from core client for 30 sec - exiting 05:10:13 (3400): No heartbeat from core client for 30 sec - exiting 05:10:15 (3400): No heartbeat from core client for 30 sec - exiting 05:10:16 (3400): No heartbeat from core client for 30 sec - exiting 05:10:17 (3400): No heartbeat from core client for 30 sec - exiting 05:10:18 (3400): No heartbeat from core client for 30 sec - exiting 05:10:19 (3400): No heartbeat from core client for 30 sec - exiting 05:10:20 (3400): No heartbeat from core client for 30 sec - exiting 05:10:21 (3400): No heartbeat from core client for 30 sec - exiting 05:10:22 (3400): No heartbeat from core client for 30 sec - exiting 05:10:23 (3400): No heartbeat from core client for 30 sec - exiting 05:10:24 (3400): No heartbeat from core client for 30 sec - exiting 05:10:26 (3400): No heartbeat from core client for 30 sec - exiting 05:10:27 (3400): No heartbeat from core client for 30 sec - exiting 05:10:28 (3400): No heartbeat from core client for 30 sec - exiting 05:10:29 (3400): No heartbeat from core client for 30 sec - exiting 05:10:30 (3400): No heartbeat from core client for 30 sec - exiting 05:10:31 (3400): No heartbeat from core client for 30 sec - exiting 05:10:32 (3400): No heartbeat from core client for 30 sec - exiting 05:10:33 (3400): No heartbeat from core client for 30 sec - exiting 05:10:34 (3400): No heartbeat from core client for 30 sec - exiting 05:10:35 (3400): No heartbeat from core client for 30 sec - exiting 05:10:36 (3400): No heartbeat from core client for 30 sec - exiting 05:10:38 (3400): No heartbeat from core client for 30 sec - exiting 05:10:39 (3400): No heartbeat from core client for 30 sec - exiting 05:10:40 (3400): No heartbeat from core client for 30 sec - exiting 05:10:41 (3400): No heartbeat from core client for 30 sec - exiting 05:10:42 (3400): No heartbeat from core client for 30 sec - exiting 05:10:43 (3400): No heartbeat from core client for 30 sec - exiting 05:10:44 (3400): No heartbeat from core client for 30 sec - exiting 05:10:45 (3400): No heartbeat from core client for 30 sec - exiting 05:10:46 (3400): No heartbeat from core client for 30 sec - exiting 05:10:47 (3400): No heartbeat from core client for 30 sec - exiting 05:10:48 (3400): No heartbeat from core client for 30 sec - exiting 05:10:50 (3400): No heartbeat from core client for 30 sec - exiting 05:10:51 (3400): No heartbeat from core client for 30 sec - exiting 05:10:52 (3400): No heartbeat from core client for 30 sec - exiting 05:10:53 (3400): No heartbeat from core client for 30 sec - exiting 05:10:54 (3400): No heartbeat from core client for 30 sec - exiting 05:10:55 (3400): No heartbeat from core client for 30 sec - exiting 05:10:56 (3400): No heartbeat from core client for 30 sec - exiting 05:10:57 (3400): No heartbeat from core client for 30 sec - exiting 05:10:58 (3400): No heartbeat from core client for 30 sec - exiting 05:10:59 (3400): No heartbeat from core client for 30 sec - exiting 05:11:01 (3400): No heartbeat from core client for 30 sec - exiting 05:11:02 (3400): No heartbeat from core client for 30 sec - exiting 05:11:03 (3400): No heartbeat from core client for 30 sec - exiting 05:11:04 (3400): No heartbeat from core client for 30 sec - exiting 05:11:05 (3400): No heartbeat from core client for 30 sec - exiting 05:11:06 (3400): No heartbeat from core client for 30 sec - exiting 05:11:07 (3400): No heartbeat from core client for 30 sec - exiting 05:11:08 (3400): No heartbeat from core client for 30 sec - exiting 05:11:09 (3400): No heartbeat from core client for 30 sec - exiting 05:11:10 (3400): No heartbeat from core client for 30 sec - exiting 05:11:11 (3400): No heartbeat from core client for 30 sec - exiting 05:11:13 (3400): No heartbeat from core client for 30 sec - exiting 05:11:14 (3400): No heartbeat from core client for 30 sec - exiting 05:11:15 (3400): No heartbeat from core client for 30 sec - exiting 05:11:16 (3400): No heartbeat from core client for 30 sec - exiting 05:11:17 (3400): No heartbeat from core client for 30 sec - exiting 05:11:18 (3400): No heartbeat from core client for 30 sec - exiting 05:11:19 (3400): No heartbeat from core client for 30 sec - exiting 05:11:20 (3400): No heartbeat from core client for 30 sec - exiting 05:11:21 (3400): No heartbeat from core client for 30 sec - exiting 05:11:22 (3400): No heartbeat from core client for 30 sec - exiting 05:11:24 (3400): No heartbeat from core client for 30 sec - exiting 05:11:25 (3400): No heartbeat from core client for 30 sec - exiting 05:11:26 (3400): No heartbeat from core client for 30 sec - exiting 05:11:27 (3400): No heartbeat from core client for 30 sec - exiting 05:11:28 (3400): No heartbeat from core client for 30 sec - exiting 05:11:29 (3400): No heartbeat from core client for 30 sec - exiting 05:11:30 (3400): No heartbeat from core client for 30 sec - exiting 05:11:31 (3400): No heartbeat from core client for 30 sec - exiting 05:11:32 (3400): No heartbeat from core client for 30 sec - exiting 05:11:33 (3400): No heartbeat from core client for 30 sec - exiting 05:11:34 (3400): No heartbeat from core client for 30 sec - exiting 05:11:36 (3400): No heartbeat from core client for 30 sec - exiting 05:11:37 (3400): No heartbeat from core client for 30 sec - exiting 05:11:38 (3400): No heartbeat from core client for 30 sec - exiting 05:11:39 (3400): No heartbeat from core client for 30 sec - exiting 05:11:40 (3400): No heartbeat from core client for 30 sec - exiting 05:11:41 (3400): No heartbeat from core client for 30 sec - exiting 05:11:42 (3400): No heartbeat from core client for 30 sec - exiting 05:11:43 (3400): No heartbeat from core client for 30 sec - exiting 05:11:44 (3400): No heartbeat from core client for 30 sec - exiting 05:11:45 (3400): No heartbeat from core client for 30 sec - exiting 05:11:46 (3400): No heartbeat from core client for 30 sec - exiting 05:11:48 (3400): No heartbeat from core client for 30 sec - exiting 05:11:49 (3400): No heartbeat from core client for 30 sec - exiting 05:11:50 (3400): No heartbeat from core client for 30 sec - exiting 05:11:51 (3400): No heartbeat from core client for 30 sec - exiting 05:11:52 (3400): No heartbeat from core client for 30 sec - exiting 05:11:53 (3400): No heartbeat from core client for 30 sec - exiting 05:11:54 (3400): No heartbeat from core client for 30 sec - exiting 05:11:55 (3400): No heartbeat from core client for 30 sec - exiting 05:11:56 (3400): No heartbeat from core client for 30 sec - exiting 05:11:57 (3400): No heartbeat from core client for 30 sec - exiting 05:11:59 (3400): No heartbeat from core client for 30 sec - exiting 05:12:00 (3400): No heartbeat from core client for 30 sec - exiting 05:12:01 (3400): No heartbeat from core client for 30 sec - exiting 05:12:02 (3400): No heartbeat from core client for 30 sec - exiting 05:12:03 (3400): No heartbeat from core client for 30 sec - exiting 05:12:04 (3400): No heartbeat from core client for 30 sec - exiting 05:12:05 (3400): No heartbeat from core client for 30 sec - exiting 05:12:06 (3400): No heartbeat from core client for 30 sec - exiting 05:12:07 (3400): No heartbeat from core client for 30 sec - exiting 05:12:08 (3400): No heartbeat from core client for 30 sec - exiting 05:12:09 (3400): No heartbeat from core client for 30 sec - exiting 05:12:11 (3400): No heartbeat from core client for 30 sec - exiting 05:12:12 (3400): No heartbeat from core client for 30 sec - exiting 05:12:13 (3400): No heartbeat from core client for 30 sec - exiting 05:12:14 (3400): No heartbeat from core client for 30 sec - exiting 05:12:15 (3400): No heartbeat from core client for 30 sec - exiting 05:12:16 (3400): No heartbeat from core client for 30 sec - exiting 05:12:17 (3400): No heartbeat from core client for 30 sec - exiting 05:12:18 (3400): No heartbeat from core client for 30 sec - exiting 05:12:19 (3400): No heartbeat from core client for 30 sec - exiting 05:12:20 (3400): No heartbeat from core client for 30 sec - exiting 05:12:21 (3400): No heartbeat from core client for 30 sec - exiting 05:12:23 (3400): No heartbeat from core client for 30 sec - exiting 05:12:24 (3400): No heartbeat from core client for 30 sec - exiting 05:12:25 (3400): No heartbeat from core client for 30 sec - exiting 05:12:26 (3400): No heartbeat from core client for 30 sec - exiting 05:12:27 (3400): No heartbeat from core client for 30 sec - exiting 05:12:28 (3400): No heartbeat from core client for 30 sec - exiting 05:12:29 (3400): No heartbeat from core client for 30 sec - exiting 05:12:30 (3400): No heartbeat from core client for 30 sec - exiting 05:12:31 (3400): No heartbeat from core client for 30 sec - exiting 05:12:32 (3400): No heartbeat from core client for 30 sec - exiting 05:12:34 (3400): No heartbeat from core client for 30 sec - exiting 05:12:35 (3400): No heartbeat from core client for 30 sec - exiting 05:12:36 (3400): No heartbeat from core client for 30 sec - exiting 05:12:37 (3400): No heartbeat from core client for 30 sec - exiting 05:12:38 (3400): No heartbeat from core client for 30 sec - exiting 05:12:39 (3400): No heartbeat from core client for 30 sec - exiting 05:12:40 (3400): No heartbeat from core client for 30 sec - exiting 05:12:41 (3400): No heartbeat from core client for 30 sec - exiting 05:12:42 (3400): No heartbeat from core client for 30 sec - exiting 05:12:43 (3400): No heartbeat from core client for 30 sec - exiting 05:12:44 (3400): No heartbeat from core client for 30 sec - exiting 05:12:46 (3400): No heartbeat from core client for 30 sec - exiting 05:12:47 (3400): No heartbeat from core client for 30 sec - exiting 05:12:48 (3400): No heartbeat from core client for 30 sec - exiting 05:12:49 (3400): No heartbeat from core client for 30 sec - exiting 05:12:50 (3400): No heartbeat from core client for 30 sec - exiting 05:12:51 (3400): No heartbeat from core client for 30 sec - exiting 05:12:52 (3400): No heartbeat from core client for 30 sec - exiting 05:12:53 (3400): No heartbeat from core client for 30 sec - exiting 05:12:54 (3400): No heartbeat from core client for 30 sec - exiting 05:12:55 (3400): No heartbeat from core client for 30 sec - exiting 05:12:56 (3400): No heartbeat from core client for 30 sec - exiting 05:12:58 (3400): No heartbeat from core client for 30 sec - exiting 05:12:59 (3400): No heartbeat from core client for 30 sec - exiting 05:13:00 (3400): No heartbeat from core client for 30 sec - exiting 05:13:01 (3400): No heartbeat from core client for 30 sec - exiting 05:13:02 (3400): No heartbeat from core client for 30 sec - exiting 05:13:03 (3400): No heartbeat from core client for 30 sec - exiting 05:13:04 (3400): No heartbeat from core client for 30 sec - exiting 05:13:05 (3400): No heartbeat from core client for 30 sec - exiting 05:13:06 (3400): No heartbeat from core client for 30 sec - exiting 05:13:07 (3400): No heartbeat from core client for 30 sec - exiting 05:13:09 (3400): No heartbeat from core client for 30 sec - exiting 05:13:10 (3400): No heartbeat from core client for 30 sec - exiting 05:13:11 (3400): No heartbeat from core client for 30 sec - exiting 05:13:12 (3400): No heartbeat from core client for 30 sec - exiting 05:13:13 (3400): No heartbeat from core client for 30 sec - exiting 05:13:14 (3400): No heartbeat from core client for 30 sec - exiting 05:13:15 (3400): No heartbeat from core client for 30 sec - exiting 05:13:16 (3400): No heartbeat from core client for 30 sec - exiting 05:13:17 (3400): No heartbeat from core client for 30 sec - exiting 05:13:18 (3400): No heartbeat from core client for 30 sec - exiting 05:13:19 (3400): No heartbeat from core client for 30 sec - exiting 05:13:21 (3400): No heartbeat from core client for 30 sec - exiting 05:13:22 (3400): No heartbeat from core client for 30 sec - exiting 05:13:23 (3400): No heartbeat from core client for 30 sec - exiting 05:13:24 (3400): No heartbeat from core client for 30 sec - exiting 05:13:25 (3400): No heartbeat from core client for 30 sec - exiting 05:13:26 (3400): No heartbeat from core client for 30 sec - exiting 05:13:27 (3400): No heartbeat from core client for 30 sec - exiting 05:13:28 (3400): No heartbeat from core client for 30 sec - exiting 05:13:29 (3400): No heartbeat from core client for 30 sec - exiting 05:13:30 (3400): No heartbeat from core client for 30 sec - exiting 05:13:31 (3400): No heartbeat from core client for 30 sec - exiting 05:13:33 (3400): No heartbeat from core client for 30 sec - exiting 05:13:34 (3400): No heartbeat from core client for 30 sec - exiting 05:13:35 (3400): No heartbeat from core client for 30 sec - exiting 05:13:36 (3400): No heartbeat from core client for 30 sec - exiting 05:13:37 (3400): No heartbeat from core client for 30 sec - exiting 05:13:38 (3400): No heartbeat from core client for 30 sec - exiting 05:13:39 (3400): No heartbeat from core client for 30 sec - exiting 05:13:40 (3400): No heartbeat from core client for 30 sec - exiting 05:13:41 (3400): No heartbeat from core client for 30 sec - exiting 05:13:42 (3400): No heartbeat from core client for 30 sec - exiting 05:13:44 (3400): No heartbeat from core client for 30 sec - exiting 05:13:45 (3400): No heartbeat from core client for 30 sec - exiting 05:13:46 (3400): No heartbeat from core client for 30 sec - exiting 05:13:47 (3400): No heartbeat from core client for 30 sec - exiting 05:13:48 (3400): No heartbeat from core client for 30 sec - exiting 05:13:49 (3400): No heartbeat from core client for 30 sec - exiting 05:13:50 (3400): No heartbeat from core client for 30 sec - exiting 05:13:51 (3400): No heartbeat from core client for 30 sec - exiting 05:13:52 (3400): No heartbeat from core client for 30 sec - exiting 05:13:53 (3400): No heartbeat from core client for 30 sec - exiting 05:13:54 (3400): No heartbeat from core client for 30 sec - exiting 05:13:56 (3400): No heartbeat from core client for 30 sec - exiting 05:13:57 (3400): No heartbeat from core client for 30 sec - exiting 05:13:58 (3400): No heartbeat from core client for 30 sec - exiting 05:13:59 (3400): No heartbeat from core client for 30 sec - exiting 05:14:00 (3400): No heartbeat from core client for 30 sec - exiting 05:14:01 (3400): No heartbeat from core client for 30 sec - exiting 05:14:02 (3400): No heartbeat from core client for 30 sec - exiting 05:14:03 (3400): No heartbeat from core client for 30 sec - exiting 05:14:04 (3400): No heartbeat from core client for 30 sec - exiting 05:14:05 (3400): No heartbeat from core client for 30 sec - exiting 05:14:06 (3400): No heartbeat from core client for 30 sec - exiting 05:14:08 (3400): No heartbeat from core client for 30 sec - exiting 05:14:09 (3400): No heartbeat from core client for 30 sec - exiting 05:14:10 (3400): No heartbeat from core client for 30 sec - exiting 05:14:11 (3400): No heartbeat from core client for 30 sec - exiting 05:14:12 (3400): No heartbeat from core client for 30 sec - exiting 05:14:13 (3400): No heartbeat from core client for 30 sec - exiting 05:14:14 (3400): No heartbeat from core client for 30 sec - exiting 05:14:15 (3400): No heartbeat from core client for 30 sec - exiting 05:14:16 (3400): No heartbeat from core client for 30 sec - exiting 05:14:17 (3400): No heartbeat from core client for 30 sec - exiting 05:14:19 (3400): No heartbeat from core client for 30 sec - exiting 05:14:20 (3400): No heartbeat from core client for 30 sec - exiting 05:14:21 (3400): No heartbeat from core client for 30 sec - exiting 05:14:22 (3400): No heartbeat from core client for 30 sec - exiting 05:14:23 (3400): No heartbeat from core client for 30 sec - exiting 05:14:24 (3400): No heartbeat from core client for 30 sec - exiting 05:14:25 (3400): No heartbeat from core client for 30 sec - exiting 05:14:26 (3400): No heartbeat from core client for 30 sec - exiting 05:14:27 (3400): No heartbeat from core client for 30 sec - exiting 05:14:28 (3400): No heartbeat from core client for 30 sec - exiting 05:14:29 (3400): No heartbeat from core client for 30 sec - exiting 05:14:31 (3400): No heartbeat from core client for 30 sec - exiting 05:14:32 (3400): No heartbeat from core client for 30 sec - exiting 05:14:33 (3400): No heartbeat from core client for 30 sec - exiting 05:14:34 (3400): No heartbeat from core client for 30 sec - exiting 05:14:35 (3400): No heartbeat from core client for 30 sec - exiting 05:14:36 (3400): No heartbeat from core client for 30 sec - exiting 05:14:37 (3400): No heartbeat from core client for 30 sec - exiting 05:14:38 (3400): No heartbeat from core client for 30 sec - exiting 05:14:39 (3400): No heartbeat from core client for 30 sec - exiting 05:14:40 (3400): No heartbeat from core client for 30 sec - exiting 05:14:41 (3400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:43 (3400): No heartbeat from core client for 30 sec - exiting Regional Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jan 2012 14:10:51	912294	13838014	hadam3p_saf_1ga1_1986_1_007624555_0	80,736	151,986	1.8825
05 Jan 2012 04:18:24	912294	13838014	hadam3p_saf_1ga1_1986_1_007624555_0	69,216	131,496	1.8998
04 Jan 2012 12:16:59	912294	13838014	hadam3p_saf_1ga1_1986_1_007624555_0	57,696	110,268	1.9112
03 Jan 2012 23:13:35	912294	13838014	hadam3p_saf_1ga1_1986_1_007624555_0	46,176	88,062	1.9071
03 Jan 2012 12:37:07	912294	13838014	hadam3p_saf_1ga1_1986_1_007624555_0	34,656	66,316	1.9136
03 Jan 2012 03:40:03	912294	13838014	hadam3p_saf_1ga1_1986_1_007624555_0	23,136	44,467	1.9220
02 Jan 2012 01:28:16	912294	13838014	hadam3p_saf_1ga1_1986_1_007624555_0	11,616	22,886	1.9702