Task 13255229

Name	hadam3p_saf_2dig_1995_1_007407156_0
Workunit	7604586
Created	15 Aug 2011, 10:12:37 UTC
Sent	15 Aug 2011, 20:29:35 UTC
Report deadline	28 Jul 2012, 1:49:35 UTC
Received	1 Jan 2012, 15:51:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1123362
Run time	9 days 4 hours 8 min 3 sec
CPU time	4 days 14 hours 11 min 29 sec
Validate state	Invalid
Credit	562.19
Device peak FLOPS	0.99 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5056, selfPID=5056, iMonCtr=2 CPDN Monitor - Quit request from BOINC... RegioCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5380, selfPID=5380, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3888, selfPID=5544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:08:35 (4572): No heartbeat from core client for 30 sec - exiting 05:08:36 (4572): No heartbeat from core client for 30 sec - exiting 05:08:37 (4572): No heartbeat from core client for 30 sec - exiting 05:08:38 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:40 (932): No heartbeat from core client for 30 sec - exiting 17:36:41 (932): No heartbeat from core client for 30 sec - exiting 17:36:42 (932): No heartbeat from core client for 30 sec - exiting 17:36:43 (932): No heartbeat from core client for 30 sec - exiting 17:36:44 (932): No heartbeat from core client for 30 sec - exiting 17:36:45 (932): No heartbeat from core client for 30 sec - exiting 17:36:46 (932): No heartbeat from core client for 30 sec - exiting 17:36:47 (932): No heartbeat from core client for 30 sec - exiting 17:36:48 (932): No heartbeat from core client for 30 sec - exiting 17:36:49 (932): No heartbeat from core client for 30 sec - exiting 17:36:51 (932): No heartbeat from core client for 30 sec - exiting 17:36:52 (932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:14:08 (5004): No heartbeat from core client for 30 sec - exiting 05:14:09 (5004): No heartbeat from core client for 30 sec - exiting 05:14:10 (5004): No heartbeat from core client for 30 sec - exiting 05:14:12 (5004): No heartbeat from core client for 30 sec - exiting 05:14:13 (5004): No heartbeat from core client for 30 sec - exiting 05:14:14 (5004): No heartbeat from core client for 30 sec - exiting 05:14:15 (5004): No heartbeat from core client for 30 sec - exiting 05:14:16 (5004): No heartbeat from core client for 30 sec - exiting 05:14:17 (5004): No heartbeat from core client for 30 sec - exiting 05:14:18 (5004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:49:53 (4936): No heartbeat from core client for 30 sec - exiting 17:49:54 (4936): No heartbeat from core client for 30 sec - exiting 17:49:56 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4388, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 23:04:11 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:13 (976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:13 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:22 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:22 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5812, selfPID=5812, iMonCtr=2 23:21:19 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4728, selfPID=4728, iMonCtr=2 23:25:20 (316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:21 (2412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:31:22 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:22 (4832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:23 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1032, selfPID=1032, iMonCtr=2 23:41:23 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:23 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:49:37 (5488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:53:38 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=5952, iMonCtr=2 23:57:40 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:41 (996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:41 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:51:02 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3760, selfPID=3760, iMonCtr=2 19:51:03 (3572): No heartbeat from core client for 30 sec - exiting 20:03:19 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:20 (3820): No heartbeat from core client for 30 sec - exiting 20:03:21 (3820): No heartbeat from core client for 30 sec - exiting 20:03:22 (3820): No heartbeat from core client for 30 sec - exiting 20:03:23 (3820): No heartbeat from core client for 30 sec - exiting 20:03:24 (3820): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4784, selfPID=4784, iMonCtr=2 21:35:45 (636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:35:46 (636): No heartbeat from core client for 30 sec - exiting 21:35:47 (636): No heartbeat from core client for 30 sec - exiting 21:35:48 (636): No heartbeat from core client for 30 sec - exiting 21:35:49 (636): No heartbeat from core client for 30 sec - exiting 21:35:50 (636): No heartbeat from core client for 30 sec - exiting 21:35:51 (636): No heartbeat from core client for 30 sec - exiting 21:35:52 (636): No heartbeat from core client for 30 sec - exiting 21:35:53 (636): No heartbeat from core client for 30 sec - exiting 21:35:54 (636): No heartbeat from core client for 30 sec - exiting 21:35:55 (636): No heartbeat from core client for 30 sec - exiting 22:08:07 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:08 (5980): No heartbeat from core client for 30 sec - exiting 22:08:09 (5980): No heartbeat from core client for 30 sec - exiting 22:08:10 (5980): No heartbeat from core client for 30 sec - exiting 22:08:11 (5980): No heartbeat from core client for 30 sec - exiting 22:08:12 (5980): No heartbeat from core client for 30 sec - exiting 01:19:10 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:18 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:19 (5320): No heartbeat from core client for 30 sec - exiting 01:20:20 (5320): No heartbeat from core client for 30 sec - exiting 01:20:21 (5320): No heartbeat from core client for 30 sec - exiting 01:20:22 (5320): No heartbeat from core client for 30 sec - exiting 01:20:23 (5320): No heartbeat from core client for 30 sec - exiting 01:20:24 (5320): No heartbeat from core client for 30 sec - exiting 01:20:25 (5320): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5200, selfPID=5200, iMonCtr=2 02:49:34 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:59:22 (2156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:47 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:48 (3588): No heartbeat from core client for 30 sec - exiting 04:28:49 (3588): No heartbeat from core client for 30 sec - exiting 04:32:07 (4108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:32:08 (4108): No heartbeat from core client for 30 sec - exiting 04:32:09 (4108): No heartbeat from core client for 30 sec - exiting 04:32:10 (4108): No heartbeat from core client for 30 sec - exiting 04:32:11 (4108): No heartbeat from core client for 30 sec - exiting 04:32:12 (4108): No heartbeat from core client for 30 sec - exiting 10:28:09 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5672, selfPID=5672, iMonCtr=2 10:28:10 (4724): No heartbeat from core client for 30 sec - exiting 10:28:11 (4724): No heartbeat from core client for 30 sec - exiting 10:28:12 (4724): No heartbeat from core client for 30 sec - exiting 10:28:13 (4724): No heartbeat from core client for 30 sec - exiting 10:28:14 (4724): No heartbeat from core client for 30 sec - exiting 12:46:21 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:22 (5336): No heartbeat from core client for 30 sec - exiting 12:46:23 (5336): No heartbeat from core client for 30 sec - exiting 12:46:24 (5336): No heartbeat from core client for 30 sec - exiting 12:46:25 (5336): No heartbeat from core client for 30 sec - exiting 13:28:04 (3048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:33 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:34 (3932): No heartbeat from core client for 30 sec - exiting 13:29:35 (3932): No heartbeat from core client for 30 sec - exiting 13:29:36 (3932): No heartbeat from core client for 30 sec - exiting 13:29:37 (3932): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=992, selfPID=992, iMonCtr=2 13:33:06 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:07 (3804): No heartbeat from core client for 30 sec - exiting 13:33:08 (3804): No heartbeat from core client for 30 sec - exiting 13:39:56 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:09 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:10 (5892): No heartbeat from core client for 30 sec - exiting 13:54:11 (5892): No heartbeat from core client for 30 sec - exiting 13:54:12 (5892): No heartbeat from core client for 30 sec - exiting 14:05:46 (244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6116, selfPID=6116, iMonCtr=2 14:39:34 (6132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:35 (6132): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4860, selfPID=4860, iMonCtr=2 14:40:43 (5568): No heartbeat from core client for 30 sec - exiting 14:40:44 (5568): No heartbeat from core client for 30 sec - exiting 14:40:45 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:42:51 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:01 (1384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:02 (1384): No heartbeat from core client for 30 sec - exiting 14:49:03 (1384): No heartbeat from core client for 30 sec - exiting 14:49:04 (1384): No heartbeat from core client for 30 sec - exiting 14:49:05 (1384): No heartbeat from core client for 30 sec - exiting 14:49:06 (1384): No heartbeat from core client for 30 sec - exiting 14:49:07 (1384): No heartbeat from core client for 30 sec - exiting 16:18:41 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:42 (3076): No heartbeat from core client for 30 sec - exiting 16:18:43 (3076): No heartbeat from core client for 30 sec - exiting 16:18:44 (3076): No heartbeat from core client for 30 sec - exiting 16:18:45 (3076): No heartbeat from core client for 30 sec - exiting 16:18:46 (3076): No heartbeat from core client for 30 sec - exiting 16:18:47 (3076): No heartbeat from core client for 30 sec - exiting 20:07:32 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:33 (5412): No heartbeat from core client for 30 sec - exiting 20:22:30 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:31 (3888): No heartbeat from core client for 30 sec - exiting 20:22:32 (3888): No heartbeat from core client for 30 sec - exiting 20:22:33 (3888): No heartbeat from core client for 30 sec - exiting 20:22:34 (3888): No heartbeat from core client for 30 sec - exiting 20:22:35 (3888): No heartbeat from core client for 30 sec - exiting 18:44:46 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:56 (628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5700, selfPID=5700, iMonCtr=2 19:15:52 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:53 (4540): No heartbeat from core client for 30 sec - exiting 19:16:52 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:53 (5256): No heartbeat from core client for 30 sec - exiting 19:16:54 (5256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:30:09 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1896, iMonCtr=2 Model crash detected, will try to restart... 21:51:33 (4732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:34 (4732): No heartbeat from core client for 30 sec - exiting 21:51:35 (4732): No heartbeat from core client for 30 sec - exiting 21:51:36 (4732): No heartbeat from core client for 30 sec - exiting 21:51:37 (4732): No heartbeat from core client for 30 sec - exiting 21:51:38 (4732): No heartbeat from core client for 30 sec - exiting 22:02:47 (3168): No heartbeat from core client for 30 sec - exiting 22:02:48 (3168): No heartbeat from core client for 30 sec - exiting 22:02:49 (3168): No heartbeat from core client for 30 sec - exiting 22:02:50 (3168): No heartbeat from core client for 30 sec - exiting 22:02:51 (3168): No heartbeat from core client for 30 sec - exiting 22:02:52 (3168): No heartbeat from core client for 30 sec - exiting 22:02:53 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3040, selfPID=3040, iMonCtr=2 22:31:34 (152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:31:35 (152): No heartbeat from core client for 30 sec - exiting 22:31:36 (152): No heartbeat from core client for 30 sec - exiting 22:31:37 (152): No heartbeat from core client for 30 sec - exiting 13:12:00 (4848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:06 (4848): No heartbeat from core client for 30 sec - exiting 14:22:50 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:51 (5920): No heartbeat from core client for 30 sec - exiting 14:22:52 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3944, selfPID=3944, iMonCtr=2 23:21:20 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:21:21 (5560): No heartbeat from core client for 30 sec - exiting 23:21:22 (5560): No heartbeat from core client for 30 sec - exiting 23:21:23 (5560): No heartbeat from core client for 30 sec - exiting 23:21:24 (5560): No heartbeat from core client for 30 sec - exiting 23:21:25 (5560): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1396, iMonCtr=2 Model crash detected, will try to restart... 21:21:16 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:17 (6044): No heartbeat from core client for 30 sec - exiting 21:21:18 (6044): No heartbeat from core client for 30 sec - exiting 21:21:19 (6044): No heartbeat from core client for 30 sec - exiting 21:21:20 (6044): No heartbeat from core client for 30 sec - exiting 21:21:21 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:44:07 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:03:53 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1380, selfPID=1380, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 14:50:20 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:50:21 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:58:08 (4232): No heartbeat from core client for 30 sec - exiting 20:58:09 (4232): No heartbeat from core client for 30 sec - exiting 20:58:10 (4232): No heartbeat from core client for 30 sec - exiting 20:58:11 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:12 (4232): No heartbeat from core client for 30 sec - exiting 20:58:13 (4232): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6036, selfPID=2524, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6036, selfPID=6036, iMonCtr=2 18:05:59 (1992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:00 (1992): No heartbeat from core client for 30 sec - exiting 18:06:01 (1992): No heartbeat from core client for 30 sec - exiting 18:06:02 (1992): No heartbeat from core client for 30 sec - exiting 18:06:03 (1992): No heartbeat from core client for 30 sec - exiting 18:06:04 (1992): No heartbeat from core client for 30 sec - exiting 18:06:05 (1992): No heartbeat from core client for 30 sec - exiting 18:06:06 (1992): No heartbeat from core client for 30 sec - exiting 18:06:07 (1992): No heartbeat from core client for 30 sec - exiting 18:06:08 (1992): No heartbeat from core client for 30 sec - exiting 18:06:09 (1992): No heartbeat from core client for 30 sec - exiting 18:08:51 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:08:52 (4080): No heartbeat from core client for 30 sec - exiting 18:08:53 (4080): No heartbeat from core client for 30 sec - exiting 18:08:54 (4080): No heartbeat from core client for 30 sec - exiting 18:13:24 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:25 (5892): No heartbeat from core client for 30 sec - exiting 18:13:26 (5892): No heartbeat from core client for 30 sec - exiting 18:13:27 (5892): No heartbeat from core client for 30 sec - exiting 18:13:28 (5892): No heartbeat from core client for 30 sec - exiting 18:13:29 (5892): No heartbeat from core client for 30 sec - exiting 18:17:28 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:29 (1092): No heartbeat from core client for 30 sec - exiting 18:17:30 (1092): No heartbeat from core client for 30 sec - exiting 18:17:31 (1092): No heartbeat from core client for 30 sec - exiting 18:17:32 (1092): No heartbeat from core client for 30 sec - exiting 18:17:33 (1092): No heartbeat from core client for 30 sec - exiting 18:17:34 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6024, selfPID=6024, iMonCtr=2 12:46:24 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:25 (4920): No heartbeat from core client for 30 sec - exiting 12:46:26 (4920): No heartbeat from core client for 30 sec - exiting 12:46:27 (4920): No heartbeat from core client for 30 sec - exiting 12:46:28 (4920): No heartbeat from core client for 30 sec - exiting 12:46:29 (4920): No heartbeat from core client for 30 sec - exiting 12:46:30 (4920): No heartbeat from core client for 30 sec - exiting 12:46:31 (4920): No heartbeat from core client for 30 sec - exiting 12:46:32 (4920): No heartbeat from core client for 30 sec - exiting 12:46:33 (4920): No heartbeat from core client for 30 sec - exiting 12:46:34 (4920): No heartbeat from core client for 30 sec - exiting 12:46:35 (4920): No heartbeat from core client for 30 sec - exiting 12:46:36 (4920): No heartbeat from core client for 30 sec - exiting 12:46:37 (4920): No heartbeat from core client for 30 sec - exiting 12:46:38 (4920): No heartbeat from core client for 30 sec - exiting 12:46:39 (4920): No heartbeat from core client for 30 sec - exiting 12:46:40 (4920): No heartbeat from core client for 30 sec - exiting 12:46:41 (4920): No heartbeat from core client for 30 sec - exiting 12:47:42 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:26 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:27 (6028): No heartbeat from core client for 30 sec - exiting 16:40:28 (6028): No heartbeat from core client for 30 sec - exiting 16:40:29 (6028): No heartbeat from core client for 30 sec - exiting 16:40:30 (6028): No heartbeat from core client for 30 sec - exiting 16:40:31 (6028): No heartbeat from core client for 30 sec - exiting 17:26:27 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:28:16 (2844): No heartbeat from core client for 30 sec - exiting 17:28:17 (2844): No heartbeat from core client for 30 sec - exiting 17:28:18 (2844): No heartbeat from core client for 30 sec - exiting 17:28:19 (2844): No heartbeat from core client for 30 sec - exiting 17:28:20 (2844): No heartbeat from core client for 30 sec - exiting 17:28:21 (2844): No heartbeat from core client for 30 sec - exiting 17:28:22 (2844): No heartbeat from core client for 30 sec - exiting 17:28:23 (2844): No heartbeat from core client for 30 sec - exiting 17:28:24 (2844): No heartbeat from core client for 30 sec - exiting 17:28:25 (2844): No heartbeat from core client for 30 sec - exiting 17:28:26 (2844): No heartbeat from core client for 30 sec - exiting 17:28:27 (2844): No heartbeat from core client for 30 sec - exiting 17:28:28 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:42 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:19 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:20 (5364): No heartbeat from core client for 30 sec - exiting 21:52:33 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:52:34 (5772): No heartbeat from core client for 30 sec - exiting 21:52:35 (5772): No heartbeat from core client for 30 sec - exiting 21:52:36 (5772): No heartbeat from core client for 30 sec - exiting 21:52:37 (5772): No heartbeat from core client for 30 sec - exiting 21:52:38 (5772): No heartbeat from core client for 30 sec - exiting 21:52:39 (5772): No heartbeat from core client for 30 sec - exiting 21:52:40 (5772): No heartbeat from core client for 30 sec - exiting 21:52:41 (5772): No heartbeat from core client for 30 sec - exiting 21:52:42 (5772): No heartbeat from core client for 30 sec - exiting 21:52:43 (5772): No heartbeat from core client for 30 sec - exiting 22:00:05 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5676, selfPID=5676, iMonCtr=2 22:17:36 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5308, selfPID=5308, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4676, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:21:39 (4664): No heartbeat from core client for 30 sec - exiting 18:21:40 (4664): No heartbeat from core client for 30 sec - exiting 18:21:41 (4664): No heartbeat from core client for 30 sec - exiting 18:21:42 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:43 (4664): No heartbeat from core client for 30 sec - exiting 18:21:44 (4664): No heartbeat from core client for 30 sec - exiting 18:21:45 (4664): No heartbeat from core client for 30 sec - exiting 18:21:46 (4664): No heartbeat from core client for 30 sec - exiting 18:21:47 (4664): No heartbeat from core client for 30 sec - exiting 18:21:48 (4664): No heartbeat from core client for 30 sec - exiting 18:21:49 (4664): No heartbeat from core client for 30 sec - exiting 18:21:50 (4664): No heartbeat from core client for 30 sec - exiting 10:03:02 (3828): No heartbeat from core client for 30 sec - exiting 10:03:03 (3828): No heartbeat from core client for 30 sec - exiting 10:03:04 (3828): No heartbeat from core client for 30 sec - exiting 10:03:05 (3828): No heartbeat from core client for 30 sec - exiting 10:03:07 (3828): No heartbeat from core client for 30 sec - exiting 10:03:08 (3828): No heartbeat from core client for 30 sec - exiting 10:03:09 (3828): No heartbeat from core client for 30 sec - exiting 10:03:10 (3828): No heartbeat from core client for 30 sec - exiting 10:03:11 (3828): No heartbeat from core client for 30 sec - exiting 10:03:12 (3828): No heartbeat from core client for 30 sec - exiting 10:03:13 (3828): No heartbeat from core client for 30 sec - exiting 10:03:14 (3828): No heartbeat from core client for 30 sec - exiting 10:03:15 (3828): No heartbeat from core client for 30 sec - exiting 10:03:16 (3828): No heartbeat from core client for 30 sec - exiting 10:03:17 (3828): No heartbeat from core client for 30 sec - exiting 10:03:19 (3828): No heartbeat from core client for 30 sec - exiting 10:03:20 (3828): No heartbeat from core client for 30 sec - exiting 10:03:21 (3828): No heartbeat from core client for 30 sec - exiting 10:03:22 (3828): No heartbeat from core client for 30 sec - exiting 10:03:23 (3828): No heartbeat from core client for 30 sec - exiting 10:03:24 (3828): No heartbeat from core client for 30 sec - exiting 10:03:25 (3828): No heartbeat from core client for 30 sec - exiting 10:03:26 (3828): No heartbeat from core client for 30 sec - exiting 10:03:27 (3828): No heartbeat from core client for 30 sec - exiting 10:03:28 (3828): No heartbeat from core client for 30 sec - exiting 10:03:29 (3828): No heartbeat from core client for 30 sec - exiting 10:03:31 (3828): No heartbeat from core client for 30 sec - exiting 10:03:32 (3828): No heartbeat from core client for 30 sec - exiting 10:03:33 (3828): No heartbeat from core client for 30 sec - exiting 10:03:34 (3828): No heartbeat from core client for 30 sec - exiting 10:03:35 (3828): No heartbeat from core client for 30 sec - exiting 10:03:36 (3828): No heartbeat from core client for 30 sec - exiting 10:03:38 (3828): No heartbeat from core client for 30 sec - exiting 10:03:39 (3828): No heartbeat from core client for 30 sec - exiting 10:03:40 (3828): No heartbeat from core client for 30 sec - exiting 10:03:41 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:38 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2616, selfPID=2616, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5572, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:08:32 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6176, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 15:17:40 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:41 (4880): No heartbeat from core client for 30 sec - exiting 15:17:42 (4880): No heartbeat from core client for 30 sec - exiting 15:17:43 (4880): No heartbeat from core client for 30 sec - exiting 15:17:44 (4880): No heartbeat from core client for 30 sec - exiting 15:17:45 (4880): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2480, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:25:43 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1320, selfPID=1320, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2824, selfPID=5696, iMonCtr=1 Model crash detected, will try to restart... 16:24:36 (4388): No heartbeat from core client for 30 sec - exiting 16:24:37 (4388): No heartbeat from core client for 30 sec - exiting 16:24:38 (4388): No heartbeat from core client for 30 sec - exiting 16:24:39 (4388): No heartbeat from core client for 30 sec - exiting 16:24:40 (4388): No heartbeat from core client for 30 sec - exiting 16:24:42 (4388): No heartbeat from core client for 30 sec - exiting 16:24:43 (4388): No heartbeat from core client for 30 sec - exiting 16:24:44 (4388): No heartbeat from core client for 30 sec - exiting 16:24:45 (4388): No heartbeat from core client for 30 sec - exiting 16:24:46 (4388): No heartbeat from core client for 30 sec - exiting 16:24:47 (4388): No heartbeat from core client for 30 sec - exiting 16:24:48 (4388): No heartbeat from core client for 30 sec - exiting 16:24:49 (4388): No heartbeat from core client for 30 sec - exiting 16:24:50 (4388): No heartbeat from core client for 30 sec - exiting 16:24:51 (4388): No heartbeat from core client for 30 sec - exiting 16:24:52 (4388): No heartbeat from core client for 30 sec - exiting 16:24:54 (4388): No heartbeat from core client for 30 sec - exiting 16:24:55 (4388): No heartbeat from core client for 30 sec - exiting 16:24:56 (4388): No heartbeat from core client for 30 sec - exiting 16:24:57 (4388): No heartbeat from core client for 30 sec - exiting 16:24:58 (4388): No heartbeat from core client for 30 sec - exiting 16:24:59 (4388): No heartbeat from core client for 30 sec - exiting 16:25:00 (4388): No heartbeat from core client for 30 sec - exiting 16:25:01 (4388): No heartbeat from core client for 30 sec - exiting 16:25:03 (4388): No heartbeat from core client for 30 sec - exiting 16:25:04 (4388): No heartbeat from core client for 30 sec - exiting 16:25:05 (4388): No heartbeat from core client for 30 sec - exiting 16:25:06 (4388): No heartbeat from core client for 30 sec - exiting 16:25:07 (4388): No heartbeat from core client for 30 sec - exiting 16:25:08 (4388): No heartbeat from core client for 30 sec - exiting 16:25:09 (4388): No heartbeat from core client for 30 sec - exiting 16:25:10 (4388): No heartbeat from core client for 30 sec - exiting 16:25:11 (4388): No heartbeat from core client for 30 sec - exiting 16:25:12 (4388): No heartbeat from core client for 30 sec - exiting 16:25:13 (4388): No heartbeat from core client for 30 sec - exiting 16:25:15 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:58 (1140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:59 (1140): No heartbeat from core client for 30 sec - exiting 21:07:00 (1140): No heartbeat from core client for 30 sec - exiting 21:07:01 (1140): No heartbeat from core client for 30 sec - exiting 21:07:02 (1140): No heartbeat from core client for 30 sec - exiting 21:07:03 (1140): No heartbeat from core client for 30 sec - exiting 20:48:55 (4256): No heartbeat from core client for 30 sec - exiting 20:48:56 (4256): No heartbeat from core client for 30 sec - exiting 20:48:57 (4256): No heartbeat from core client for 30 sec - exiting 20:48:58 (4256): No heartbeat from core client for 30 sec - exiting 20:48:59 (4256): No heartbeat from core client for 30 sec - exiting 20:49:00 (4256): No heartbeat from core client for 30 sec - exiting 20:49:01 (4256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:08:12 (5040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:38 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:41 (5732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:42 (5732): No heartbeat from core client for 30 sec - exiting 14:31:43 (5732): No heartbeat from core client for 30 sec - exiting 14:31:44 (5732): No heartbeat from core client for 30 sec - exiting 14:31:45 (5732): No heartbeat from core client for 30 sec - exiting 14:31:46 (5732): No heartbeat from core client for 30 sec - exiting 14:31:47 (5732): No heartbeat from core client for 30 sec - exiting 14:31:48 (5732): No heartbeat from core client for 30 sec - exiting 14:31:49 (5732): No heartbeat from core client for 30 sec - exiting 14:44:56 (1044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not runnin14:44:57 (1044): No heartbeat from core client for 30 sec - exiting 18:53:46 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:47 (4032): No heartbeat from core client for 30 sec - exiting 18:53:48 (4032): No heartbeat from core client for 30 sec - exiting 18:53:49 (4032): No heartbeat from core client for 30 sec - exiting 18:53:50 (4032): No heartbeat from core client for 30 sec - exiting 18:53:51 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5984, selfPID=5984, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3212, selfPID=1108, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4176, selfPID=4176, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4296, selfPID=4296, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2080, selfPID=2080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6036, selfPID=6036, iMonCtr=2 CCPDN Monitor - Quit request from BOINC... 16:20:59 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:00 (1232): No heartbeat from core client for 30 sec - exiting 16:21:01 (1232): No heartbeat from core client for 30 sec - exiting 16:21:02 (1232): No heartbeat from core client for 30 sec - exiting 16:21:03 (1232): No heartbeat from core client for 30 sec - exiting 16:21:04 (1232): No heartbeat from core client for 30 sec - exiting 22:11:57 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5600, selfPID=5600, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 13:08:32 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:33 (2416): No heartbeat from core client for 30 sec - exiting 13:08:34 (2416): No heartbeat from core client for 30 sec - exiting 13:08:35 (2416): No heartbeat from core client for 30 sec - exiting 13:08:36 (2416): No heartbeat from core client for 30 sec - exiting 13:08:37 (2416): No heartbeat from core client for 30 sec - exiting 13:08:38 (2416): No heartbeat from core client for 30 sec - exiting 13:08:39 (2416): No heartbeat from core client for 30 sec - exiting 13:08:40 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Nov 2011 21:38:56	1123362	13255229	hadam3p_saf_2dig_1995_1_007407156_0	34,656	295,619	8.5301
31 Oct 2011 13:04:23	1123362	13255229	hadam3p_saf_2dig_1995_1_007407156_0	23,140	197,008	8.5137
31 Oct 2011 13:04:23	1123362	13255229	hadam3p_saf_2dig_1995_1_007407156_0	23,136	195,570	8.4531
08 Oct 2011 11:42:35	1123362	13255229	hadam3p_saf_2dig_1995_1_007407156_0	11,616	98,809	8.5063