Task 13189316

Name	hadam3p_eu_2iqj_1966_1_007386907_0
Workunit	7584337
Created	1 Aug 2011, 21:25:39 UTC
Sent	1 Aug 2011, 21:33:53 UTC
Report deadline	14 Jul 2012, 2:53:53 UTC
Received	11 Sep 2011, 6:43:19 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1016212
Run time	10 days 8 hours 28 min 43 sec
CPU time	6 days 8 hours 38 min 7 sec
Validate state	Workunit error - check skipped
Credit	2,386.39
Device peak FLOPS	1.63 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2512, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6016, selfPID=5280, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5584, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3424, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5100, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5560, selfPID=5980, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5188, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5276, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4712, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5752, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5184, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4264, selfPID=5408, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4536, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4020, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2324, selfPID=5420, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5796, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4328, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5856, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6040, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2520, selfPID=5948, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2480, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 05:31:46 (5224): No heartbeat from core client for 30 sec - exiting 05:31:47 (5224): No heartbeat from core client for 30 sec - exiting 05:31:48 (5224): No heartbeat from core client for 30 sec - exiting 05:31:49 (5224): No heartbeat from core client for 30 sec - exiting 05:31:50 (5224): No heartbeat from core client for 30 sec - exiting 05:31:51 (5224): No heartbeat from core client for 30 sec - exiting 05:31:52 (5224): No heartbeat from core client for 30 sec - exiting 05:31:53 (5224): No heartbeat from core client for 30 sec - exiting 05:31:54 (5224): No heartbeat from core client for 30 sec - exiting 05:31:55 (5224): No heartbeat from core client for 30 sec - exiting 05:31:56 (5224): No heartbeat from core client for 30 sec - exiting 05:31:57 (5224): No heartbeat from core client for 30 sec - exiting 05:31:58 (5224): No heartbeat from core client for 30 sec - exiting 05:31:59 (5224): No heartbeat from core client for 30 sec - exiting 05:32:00 (5224): No heartbeat from core client for 30 sec - exiting 05:32:01 (5224): No heartbeat from core client for 30 sec - exiting 05:32:02 (5224): No heartbeat from core client for 30 sec - exiting 05:32:03 (5224): No heartbeat from core client for 30 sec - exiting 05:32:04 (5224): No heartbeat from core client for 30 sec - exiting 05:32:05 (5224): No heartbeat from core client for 30 sec - exiting 05:32:06 (5224): No heartbeat from core client for 30 sec - exiting 05:32:07 (5224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4888, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3176, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5804, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4432, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5800, iMonCtr=2 Mode l crash detected, will try to restart... Leaving CPDN_Main::Monitor... CGntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=2 onCtr=2 rash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3428, selfPID=4972, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4596, iMonCtr=2 Model crash detected, will try to restart... obal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=680, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5560, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4308, selfPID=6112, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5188, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=2 Model crash detected, will try to restart... LeController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=2 Model crash detected, will try to restart... 05:22:09 (5096): No heartbeat from core client for 30 sec - exiting 05:22:10 (5096): No heartbeat from core client for 30 sec - exiting 05:22:11 (5096): No heartbeat from core client for 30 sec - exiting 05:22:12 (5096): No heartbeat from core client for 30 sec - exiting 05:22:13 (5096): No heartbeat from core client for 30 sec - exiting 05:22:14 (5096): No heartbeat from core client for 30 sec - exiting 05:22:15 (5096): No heartbeat from core client for 30 sec - exiting 05:22:16 (5096): No heartbeat from core client for 30 sec - exiting 05:22:17 (5096): No heartbeat from core client for 30 sec - exiting 05:22:18 (5096): No heartbeat from core client for 30 sec - exiting 05:22:19 (5096): No heartbeat from core client for 30 sec - exiting 05:22:20 (5096): No heartbeat from core client for 30 sec - exiting 05:22:21 (5096): No heartbeat from core client for 30 sec - exiting 05:22:22 (5096): No heartbeat from core client for 30 sec - exiting 05:22:23 (5096): No heartbeat from core client for 30 sec - exiting 05:22:24 (5096): No heartbeat from core client for 30 sec - exiting 05:22:25 (5096): No heartbeat from core client for 30 sec - exiting 05:22:26 (5096): No heartbeat from core client for 30 sec - exiting 05:22:27 (5096): No heartbeat from core client for 30 sec - exiting 05:22:28 (5096): No heartbeat from core client for 30 sec - exiting 05:22:30 (5096): No heartbeat from core client for 30 sec - exiting 05:22:31 (5096): No heartbeat from core client for 30 sec - exiting 05:22:32 (5096): No heartbeat from core client for 30 sec - exiting 05:22:33 (5096): No heartbeat from core client for 30 sec - exiting 05:22:34 (5096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2700, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5360, iMonCtr=2 Leaving CPDN_Main::Monitor... Global WController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3764, selfPID=6108, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6064, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5796, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4968, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5712, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2656, iMonCtr=2 Leaving CPDN_Main::Monitor... 22:03:20 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:21 (5312): No heartbeat from core client for 30 sec - exiting 22:03:22 (5312): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3232, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5164, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3792, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5236, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3800, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4880, selfPID=5696, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5408, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4704, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5800, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5756, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4808, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1472, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3524, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5620, selfPID=5044, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1968, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3600, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5540, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6096, selfPID=5256, iMonCtr=1 Model crash detected, will try to restart... 17:16:06 (5324): No heartbeat from core client for 30 sec - exiting 17:16:07 (5324): No heartbeat from core client for 30 sec - exiting 17:16:08 (5324): No heartbeat from core client for 30 sec - exiting 17:16:09 (5324): No heartbeat from core client for 30 sec - exiting 17:16:10 (5324): No heartbeat from core client for 30 sec - exiting 17:16:11 (5324): No heartbeat from core client for 30 sec - exiting 17:16:13 (5324): No heartbeat from core client for 30 sec - exiting 17:16:14 (5324): No heartbeat from core client for 30 sec - exiting 17:16:15 (5324): No heartbeat from core client for 30 sec - exiting 17:16:16 (5324): No heartbeat from core client for 30 sec - exiting 17:16:17 (5324): No heartbeat from core client for 30 sec - exiting 17:16:18 (5324): No heartbeat from core client for 30 sec - exiting 17:16:19 (5324): No heartbeat from core client for 30 sec - exiting 17:16:20 (5324): No heartbeat from core client for 30 sec - exiting 17:16:21 (5324): No heartbeat from core client for 30 sec - exiting 17:16:22 (5324): No heartbeat from core client for 30 sec - exiting 17:16:23 (5324): No heartbeat from core client for 30 sec - exiting 17:16:25 (5324): No heartbeat from core client for 30 sec - exiting 17:16:26 (5324): No heartbeat from core client for 30 sec - exiting 17:16:27 (5324): No heartbeat from core client for 30 sec - exiting 17:16:28 (5324): No heartbeat from core client for 30 sec - exiting 17:16:29 (5324): No heartbeat from core client for 30 sec - exiting 17:16:30 (5324): No heartbeat from core client for 30 sec - exiting 17:16:31 (5324): No heartbeat from core client for 30 sec - exiting 17:16:32 (5324): No heartbeat from core client for 30 sec - exiting 17:16:33 (5324): No heartbeat from core client for 30 sec - exiting 17:16:34 (5324): No heartbeat from core client for 30 sec - exiting 17:16:36 (5324): No heartbeat from core client for 30 sec - exiting 17:16:37 (5324): No heartbeat from core client for 30 sec - exiting 17:16:38 (5324): No heartbeat from core client for 30 sec - exiting 17:16:39 (5324): No heartbeat from core client for 30 sec - exiting 17:16:40 (5324): No heartbeat from core client for 30 sec - exiting 17:16:41 (5324): No heartbeat from core client for 30 sec - exiting 17:16:42 (5324): No heartbeat from core client for 30 sec - exiting 17:16:43 (5324): No heartbeat from core client for 30 sec - exiting 17:16:44 (5324): No heartbeat from core client for 30 sec - exiting 17:16:45 (5324): No heartbeat from core client for 30 sec - exiting 17:16:46 (5324): No heartbeat from core client for 30 sec - exiting 17:16:48 (5324): No heartbeat from core client for 30 sec - exiting 17:16:49 (5324): No heartbeat from core client for 30 sec - exiting 17:16:50 (5324): No heartbeat from core client for 30 sec - exiting 17:16:51 (5324): No heartbeat from core client for 30 sec - exiting 17:16:52 (5324): No heartbeat from core client for 30 sec - exiting 17:16:53 (5324): No heartbeat from core client for 30 sec - exiting 17:16:54 (5324): No heartbeat from core client for 30 sec - exiting 17:16:55 (5324): No heartbeat from core client for 30 sec - exiting 17:16:56 (5324): No heartbeat from core client for 30 sec - exiting 17:16:57 (5324): No heartbeat from core client for 30 sec - exiting 17:16:58 (5324): No heartbeat from core client for 30 sec - exiting 17:17:00 (5324): No heartbeat from core client for 30 sec - exiting 17:17:01 (5324): No heartbeat from core client for 30 sec - exiting 17:17:02 (5324): No heartbeat from core client for 30 sec - exiting 17:17:03 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3084, selfPID=5304, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5804, selfPID=5168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5436, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5992, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=5492, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 23:26:39 (5172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5728, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3620, selfPID=5196, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1536, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2068, selfPID=5712, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5588, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5864, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:57:35 (5020): No heartbeat from core client for 30 sec - exiting 22:57:36 (5020): No heartbeat from core client for 30 sec - exiting 22:57:37 (5020): No heartbeat from core client for 30 sec - exiting 22:57:38 (5020): No heartbeat from core client for 30 sec - exiting 22:57:39 (5020): No heartbeat from core client for 30 sec - exiting 22:57:40 (5020): No heartbeat from core client for 30 sec - exiting 22:57:41 (5020): No heartbeat from core client for 30 sec - exiting 22:57:42 (5020): No heartbeat from core client for 30 sec - exiting 22:57:43 (5020): No heartbeat from core client for 30 sec - exiting 22:57:45 (5020): No heartbeat from core client for 30 sec - exiting 22:57:46 (5020): No heartbeat from core client for 30 sec - exiting 22:57:47 (5020): No heartbeat from core client for 30 sec - exiting 22:57:48 (5020): No heartbeat from core client for 30 sec - exiting 22:57:49 (5020): No heartbeat from core client for 30 sec - exiting 22:57:50 (5020): No heartbeat from core client for 30 sec - exiting 22:57:51 (5020): No heartbeat from core client for 30 sec - exiting 22:57:52 (5020): No heartbeat from core client for 30 sec - exiting 22:57:53 (5020): No heartbeat from core client for 30 sec - exiting 22:57:54 (5020): No heartbeat from core client for 30 sec - exiting 22:57:56 (5020): No heartbeat from core client for 30 sec - exiting 22:57:57 (5020): No heartbeat from core client for 30 sec - exiting 22:57:58 (5020): No heartbeat from core client for 30 sec - exiting 22:57:59 (5020): No heartbeat from core client for 30 sec - exiting 22:58:00 (5020): No heartbeat from core client for 30 sec - exiting 22:58:01 (5020): No heartbeat from core client for 30 sec - exiting 22:58:02 (5020): No heartbeat from core client for 30 sec - exiting 22:58:03 (5020): No heartbeat from core client for 30 sec - exiting 22:58:04 (5020): No heartbeat from core client for 30 sec - exiting 22:58:06 (5020): No heartbeat from core client for 30 sec - exiting 22:58:07 (5020): No heartbeat from core client for 30 sec - exiting 22:58:08 (5020): No heartbeat from core client for 30 sec - exiting 22:58:09 (5020): No heartbeat from core client for 30 sec - exiting 22:58:10 (5020): No heartbeat from core client for 30 sec - exiting 22:58:11 (5020): No heartbeat from core client for 30 sec - exiting 22:58:12 (5020): No heartbeat from core client for 30 sec - exiting 22:58:13 (5020): No heartbeat from core client for 30 sec - exiting 22:58:14 (5020): No heartbeat from core client for 30 sec - exiting 22:58:15 (5020): No heartbeat from core client for 30 sec - exiting 22:58:16 (5020): No heartbeat from core client for 30 sec - exiting 22:58:18 (5020): No heartbeat from core client for 30 sec - exiting 22:58:19 (5020): No heartbeat from core client for 30 sec - exiting 22:58:20 (5020): No heartbeat from core client for 30 sec - exiting 22:58:21 (5020): No heartbeat from core client for 30 sec - exiting 22:58:22 (5020): No heartbeat from core client for 30 sec - exiting 22:58:23 (5020): No heartbeat from core client for 30 sec - exiting 22:58:24 (5020): No heartbeat from core client for 30 sec - exiting 22:58:25 (5020): No heartbeat from core client for 30 sec - exiting 22:58:26 (5020): No heartbeat from core client for 30 sec - exiting 22:58:28 (5020): No heartbeat from core client for 30 sec - exiting 22:58:29 (5020): No heartbeat from core client for 30 sec - exiting 22:58:30 (5020): No heartbeat from core client for 30 sec - exiting 22:58:31 (5020): No heartbeat from core client for 30 sec - exiting 22:58:32 (5020): No heartbeat from core client for 30 sec - exiting 22:58:33 (5020): No heartbeat from core client for 30 sec - exiting 22:58:34 (5020): No heartbeat from core client for 30 sec - exiting 22:58:35 (5020): No heartbeat from core client for 30 sec - exiting 22:58:36 (5020): No heartbeat from core client for 30 sec - exiting 22:58:37 (5020): No heartbeat from core client for 30 sec - exiting 22:58:39 (5020): No heartbeat from core client for 30 sec - exiting 22:58:40 (5020): No heartbeat from core client for 30 sec - exiting 22:58:41 (5020): No heartbeat from core client for 30 sec - exiting 22:58:42 (5020): No heartbeat from core client for 30 sec - exiting 22:58:43 (5020): No heartbeat from core client for 30 sec - exiting 22:58:44 (5020): No heartbeat from core client for 30 sec - exiting 22:58:45 (5020): No heartbeat from core client for 30 sec - exiting 22:58:46 (5020): No heartbeat from core client for 30 sec - exiting 22:58:47 (5020): No heartbeat from core client for 30 sec - exiting 22:58:48 (5020): No heartbeat from core client for 30 sec - exiting 22:58:49 (5020): No heartbeat from core client for 30 sec - exiting 22:58:51 (5020): No heartbeat from core client for 30 sec - exiting 22:58:52 (5020): No heartbeat from core client for 30 sec - exiting 22:58:53 (5020): No heartbeat from core client for 30 sec - exiting 22:58:54 (5020): No heartbeat from core client for 30 sec - exiting 22:58:55 (5020): No heartbeat from core client for 30 sec - exiting 22:58:56 (5020): No heartbeat from core client for 30 sec - exiting 22:58:57 (5020): No heartbeat from core client for 30 sec - exiting 22:58:58 (5020): No heartbeat from core client for 30 sec - exiting 22:58:59 (5020): No heartbeat from core client for 30 sec - exiting 22:59:01 (5020): No heartbeat from core client for 30 sec - exiting 22:59:02 (5020): No heartbeat from core client for 30 sec - exiting 22:59:03 (5020): No heartbeat from core client for 30 sec - exiting 22:59:04 (5020): No heartbeat from core client for 30 sec - exiting 22:59:05 (5020): No heartbeat from core client for 30 sec - exiting 22:59:06 (5020): No heartbeat from core client for 30 sec - exiting 22:59:07 (5020): No heartbeat from core client for 30 sec - exiting 22:59:08 (5020): No heartbeat from core client for 30 sec - exiting 22:59:09 (5020): No heartbeat from core client for 30 sec - exiting 22:59:10 (5020): No heartbeat from core client for 30 sec - exiting 22:59:12 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5712, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6096, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 06:50:34 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:50:35 (5100): No heartbeat from core client for 30 sec - exiting 06:50:36 (5100): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5468, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6140, selfPID=6084, iMonCtr=1 Model crash detected, will try to restart... 05:58:58 (5584): No heartbeat from core client for 30 sec - exiting 05:58:59 (5584): No heartbeat from core client for 30 sec - exiting 05:59:00 (5584): No heartbeat from core client for 30 sec - exiting 05:59:01 (5584): No heartbeat from core client for 30 sec - exiting 05:59:02 (5584): No heartbeat from core client for 30 sec - exiting 05:59:03 (5584): No heartbeat from core client for 30 sec - exiting 05:59:05 (5584): No heartbeat from core client for 30 sec - exiting 05:59:06 (5584): No heartbeat from core client for 30 sec - exiting 05:59:07 (5584): No heartbeat from core client for 30 sec - exiting 05:59:08 (5584): No heartbeat from core client for 30 sec - exiting 05:59:09 (5584): No heartbeat from core client for 30 sec - exiting 05:59:10 (5584): No heartbeat from core client for 30 sec - exiting 05:59:11 (5584): No heartbeat from core client for 30 sec - exiting 05:59:12 (5584): No heartbeat from core client for 30 sec - exiting 05:59:13 (5584): No heartbeat from core client for 30 sec - exiting 05:59:14 (5584): No heartbeat from core client for 30 sec - exiting 05:59:15 (5584): No heartbeat from core client for 30 sec - exiting 05:59:17 (5584): No heartbeat from core client for 30 sec - exiting 05:59:18 (5584): No heartbeat from core client for 30 sec - exiting 05:59:19 (5584): No heartbeat from core client for 30 sec - exiting 05:59:20 (5584): No heartbeat from core client for 30 sec - exiting 05:59:21 (5584): No heartbeat from core client for 30 sec - exiting 05:59:22 (5584): No heartbeat from core client for 30 sec - exiting 05:59:23 (5584): No heartbeat from core client for 30 sec - exiting 05:59:24 (5584): No heartbeat from core client for 30 sec - exiting 05:59:25 (5584): No heartbeat from core client for 30 sec - exiting 05:59:26 (5584): No heartbeat from core client for 30 sec - exiting 05:59:28 (5584): No heartbeat from core client for 30 sec - exiting 05:59:29 (5584): No heartbeat from core client for 30 sec - exiting 05:59:30 (5584): No heartbeat from core client for 30 sec - exiting 05:59:31 (5584): No heartbeat from core client for 30 sec - exiting 05:59:32 (5584): No heartbeat from core client for 30 sec - exiting 05:59:33 (5584): No heartbeat from core client for 30 sec - exiting 05:59:34 (5584): No heartbeat from core client for 30 sec - exiting 05:59:35 (5584): No heartbeat from core client for 30 sec - exiting 05:59:36 (5584): No heartbeat from core client for 30 sec - exiting 05:59:37 (5584): No heartbeat from core client for 30 sec - exiting 05:59:38 (5584): No heartbeat from core client for 30 sec - exiting 05:59:40 (5584): No heartbeat from core client for 30 sec - exiting 05:59:41 (5584): No heartbeat from core client for 30 sec - exiting 05:59:42 (5584): No heartbeat from core client for 30 sec - exiting 05:59:43 (5584): No heartbeat from core client for 30 sec - exiting 05:59:44 (5584): No heartbeat from core client for 30 sec - exiting 05:59:45 (5584): No heartbeat from core client for 30 sec - exiting 05:59:46 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4192, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2980, selfPID=3504, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3492, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3840, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5908, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5532, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5284, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5096, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5996, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5008, selfPID=5976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5908, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5324, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3436, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3412, selfPID=5156, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not ruCningo exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=2 1, checkPID=0, selfPID=6084, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5312, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3976, selfPID=5916, iMonCtr=1 Model crash detected, will try to restart... 06:07:45 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:46 (5236): No heartbeat from core client for 30 sec - exiting 06:07:47 (5236): No heartbeat from core client for 30 sec - exiting 06:07:48 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5728, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5900, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5952, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5992, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3780, selfPID=5172, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3604, selfPID=5992, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5388, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6004, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4616, iMonCtr=2 Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5240, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3876, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5988, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5376, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5912, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5140, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6024, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4544, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5956, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5712, selfPID=3800, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4188, selfPID=5972, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:44:05 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:06 (5996): No heartbeat from core client for 30 sec - exiting 17:44:07 (5996): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5088, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1016, selfPID=5880, iMonCtr=1 Model crash detected, will try to restart... 06:57:36 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:37 (5160): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3248, selfPID=5120, iMonCtr=1 Model crash detected, will try to restart... 18:17:45 (5504): No heartbeat from core client for 30 sec - exiting 18:17:46 (5504): No heartbeat from core client for 30 sec - exiting 18:17:47 (5504): No heartbeat from core client for 30 sec - exiting 18:17:48 (5504): No heartbeat from core client for 30 sec - exiting 18:17:49 (5504): No heartbeat from core client for 30 sec - exiting 18:17:50 (5504): No heartbeat from core client for 30 sec - exiting 18:17:51 (5504): No heartbeat from core client for 30 sec - exiting 18:17:52 (5504): No heartbeat from core client for 30 sec - exiting 18:17:53 (5504): No heartbeat from core client for 30 sec - exiting 18:17:55 (5504): No heartbeat from core client for 30 sec - exiting 18:17:56 (5504): No heartbeat from core client for 30 sec - exiting 18:17:57 (5504): No heartbeat from core client for 30 sec - exiting 18:17:58 (5504): No heartbeat from core client for 30 sec - exiting 18:17:59 (5504): No heartbeat from core client for 30 sec - exiting 18:18:00 (5504): No heartbeat from core client for 30 sec - exiting 18:18:01 (5504): No heartbeat from core client for 30 sec - exiting 18:18:02 (5504): No heartbeat from core client for 30 sec - exiting 18:18:03 (5504): No heartbeat from core client for 30 sec - exiting 18:18:04 (5504): No heartbeat from core client for 30 sec - exiting 18:18:05 (5504): No heartbeat from core client for 30 sec - exiting 18:18:07 (5504): No heartbeat from core client for 30 sec - exiting 18:18:08 (5504): No heartbeat from core client for 30 sec - exiting 18:18:09 (5504): No heartbeat from core client for 30 sec - exiting 18:18:10 (5504): No heartbeat from core client for 30 sec - exiting 18:18:11 (5504): No heartbeat from core client for 30 sec - exiting 18:18:12 (5504): No heartbeat from core client for 30 sec - exiting 18:18:13 (5504): No heartbeat from core client for 30 sec - exiting 18:18:14 (5504): No heartbeat from core client for 30 sec - exiting 18:18:15 (5504): No heartbeat from core client for 30 sec - exiting 18:18:16 (5504): No heartbeat from core client for 30 sec - exiting 18:18:17 (5504): No heartbeat from core client for 30 sec - exiting 18:18:19 (5504): No heartbeat from core client for 30 sec - exiting 18:18:20 (5504): No heartbeat from core client for 30 sec - exiting 18:18:21 (5504): No heartbeat from core client for 30 sec - exiting 18:18:22 (5504): No heartbeat from core client for 30 sec - exiting 18:18:23 (5504): No heartbeat from core client for 30 sec - exiting 18:18:24 (5504): No heartbeat from core client for 30 sec - exiting 18:18:25 (5504): No heartbeat from core client for 30 sec - exiting 18:18:26 (5504): No heartbeat from core client for 30 sec - exiting 18:18:27 (5504): No heartbeat from core client for 30 sec - exiting 18:18:28 (5504): No heartbeat from core client for 30 sec - exiting 18:18:29 (5504): No heartbeat from core client for 30 sec - exiting 18:18:31 (5504): No heartbeat from core client for 30 sec - exiting 18:18:32 (5504): No heartbeat from core client for 30 sec - exiting 18:18:33 (5504): No heartbeat from core client for 30 sec - exiting 18:18:34 (5504): No heartbeat from core client for 30 sec - exiting 18:18:35 (5504): No heartbeat from core client for 30 sec - exiting 18:18:36 (5504): No heartbeat from core client for 30 sec - exiting 18:18:37 (5504): No heartbeat from core client for 30 sec - exiting 18:18:38 (5504): No heartbeat from core client for 30 sec - exiting 18:18:39 (5504): No heartbeat from core client for 30 sec - exiting 18:18:40 (5504): No heartbeat from core client for 30 sec - exiting 18:18:42 (5504): No heartbeat from core client for 30 sec - exiting 18:18:43 (5504): No heartbeat from core client for 30 sec - exiting 18:18:44 (5504): No heartbeat from core client for 30 sec - exiting 18:18:45 (5504): No heartbeat from core client for 30 sec - exiting 18:18:46 (5504): No heartbeat from core client for 30 sec - exiting 18:18:47 (5504): No heartbeat from core client for 30 sec - exiting 18:18:48 (5504): No heartbeat from core client for 30 sec - exiting 18:18:49 (5504): No heartbeat from core client for 30 sec - exiting 18:18:50 (5504): No heartbeat from core client for 30 sec - exiting 18:18:51 (5504): No heartbeat from core client for 30 sec - exiting 18:18:52 (5504): No heartbeat from core client for 30 sec - exiting 18:18:54 (5504): No heartbeat from core client for 30 sec - exiting 18:18:55 (5504): No heartbeat from core client for 30 sec - exiting 18:18:56 (5504): No heartbeat from core client for 30 sec - exiting 18:18:57 (5504): No heartbeat from core client for 30 sec - exiting 18:18:58 (5504): No heartbeat from core client for 30 sec - exiting 18:18:59 (5504): No heartbeat from core client for 30 sec - exiting 18:19:00 (5504): No heartbeat from core client for 30 sec - exiting 18:19:01 (5504): No heartbeat from core client for 30 sec - exiting 18:19:02 (5504): No heartbeat from core client for 30 sec - exiting 18:19:03 (5504): No heartbeat from core client for 30 sec - exiting 18:19:04 (5504): No heartbeat from core client for 30 sec - exiting 18:19:06 (5504): No heartbeat from core client for 30 sec - exiting 18:19:07 (5504): No heartbeat from core client for 30 sec - exiting 18:19:08 (5504): No heartbeat from core client for 30 sec - exiting 18:19:09 (5504): No heartbeat from core client for 30 sec - exiting 18:19:10 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Sep 2011 06:11:53	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	138,336	548,444	3.9646
04 Sep 2011 22:33:11	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	126,816	499,176	3.9362
01 Sep 2011 17:39:52	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	115,301	449,795	3.9011
01 Sep 2011 16:22:57	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	115,296	449,070	3.8949
30 Aug 2011 20:07:55	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	103,776	399,794	3.8525
27 Aug 2011 18:35:34	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	92,256	351,189	3.8067
24 Aug 2011 12:45:45	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	80,736	301,001	3.7282
22 Aug 2011 08:54:37	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	69,216	252,261	3.6445
19 Aug 2011 07:26:32	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	57,700	202,907	3.5166
19 Aug 2011 06:22:27	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	57,696	202,177	3.5042
15 Aug 2011 16:26:49	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	46,176	152,612	3.3050
12 Aug 2011 05:50:18	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	34,656	102,723	2.9641
09 Aug 2011 04:57:29	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	23,146	53,792	2.3240
08 Aug 2011 17:36:41	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	23,136	53,064	2.2936
04 Aug 2011 17:51:04	1016212	13189316	hadam3p_eu_2iqj_1966_1_007386907_0	11,616	3,997	0.3441