Task 13029442

Name	hadam3p_eu_2rlj_1965_1_007283611_1
Workunit	7480815
Created	29 Jun 2011, 13:16:52 UTC
Sent	29 Jun 2011, 13:17:35 UTC
Report deadline	10 Jun 2012, 18:37:35 UTC
Received	15 Aug 2011, 7:17:35 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1016212
Run time	11 days 22 hours 9 min 58 sec
CPU time	6 days 8 hours 37 min 5 sec
Validate state	Workunit error - check skipped
Credit	2,386.39
Device peak FLOPS	1.72 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.6.38</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6756, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7056, selfPID=2688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5880, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=2 Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4440, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1048, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4556, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2076, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5576, selfPID=5556, iMonCtr=1 Model crash detected, will try to restart... 06:27:55 (4480): No heartbeat from core client for 30 sec - exiting 06:27:57 (4480): No heartbeat from core client for 30 sec - exiting 06:27:58 (4480): No heartbeat from core client for 30 sec - exiting 06:27:59 (4480): No heartbeat from core client for 30 sec - exiting 06:28:00 (4480): No heartbeat from core client for 30 sec - exiting 06:28:01 (4480): No heartbeat from core client for 30 sec - exiting 06:28:02 (4480): No heartbeat from core client for 30 sec - exiting 06:28:03 (4480): No heartbeat from core client for 30 sec - exiting 06:28:04 (4480): No heartbeat from core client for 30 sec - exiting 06:28:05 (4480): No heartbeat from core client for 30 sec - exiting 06:28:06 (4480): No heartbeat from core client for 30 sec - exiting 06:28:08 (4480): No heartbeat from core client for 30 sec - exiting 06:28:09 (4480): No heartbeat from core client for 30 sec - exiting 06:28:10 (4480): No heartbeat from core client for 30 sec - exiting 06:28:11 (4480): No heartbeat from core client for 30 sec - exiting 06:28:12 (4480): No heartbeat from core client for 30 sec - exiting 06:28:13 (4480): No heartbeat from core client for 30 sec - exiting 06:28:14 (4480): No heartbeat from core client for 30 sec - exiting 06:28:15 (4480): No heartbeat from core client for 30 sec - exiting 06:28:16 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=684, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2132, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6092, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3296, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4228, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5488, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 05:28:23 (3484): No heartbeat from core client for 30 sec - exiting 05:28:24 (3484): No heartbeat from core client for 30 sec - exiting 05:28:25 (3484): No heartbeat from core client for 30 sec - exiting 05:28:26 (3484): No heartbeat from core client for 30 sec - exiting 05:28:27 (3484): No heartbeat from core client for 30 sec - exiting 05:28:28 (3484): No heartbeat from core client for 30 sec - exiting 05:28:29 (3484): No heartbeat from core client for 30 sec - exiting 05:28:30 (3484): No heartbeat from core client for 30 sec - exiting 05:28:31 (3484): No heartbeat from core client for 30 sec - exiting 05:28:32 (3484): No heartbeat from core client for 30 sec - exiting 05:28:33 (3484): No heartbeat from core client for 30 sec - exiting 05:28:34 (3484): No heartbeat from core client for 30 sec - exiting 05:28:35 (3484): No heartbeat from core client for 30 sec - exiting 05:28:36 (3484): No heartbeat from core client for 30 sec - exiting 05:28:37 (3484): No heartbeat from core client for 30 sec - exiting 05:28:38 (3484): No heartbeat from core client for 30 sec - exiting 05:28:39 (3484): No heartbeat from core client for 30 sec - exiting 05:28:40 (3484): No heartbeat from core client for 30 sec - exiting 05:28:41 (3484): No heartbeat from core client for 30 sec - exiting 05:28:42 (3484): No heartbeat from core client for 30 sec - exiting 05:28:43 (3484): No heartbeat from core client for 30 sec - exiting 05:28:44 (3484): No heartbeat from core client for 30 sec - exiting 05:28:45 (3484): No heartbeat from core client for 30 sec - exiting 05:28:46 (3484): No heartbeat from core client for 30 sec - exiting 05:28:47 (3484): No heartbeat from core client for 30 sec - exiting 05:28:48 (3484): No heartbeat from core client for 30 sec - exiting 05:28:49 (3484): No heartbeat from core client for 30 sec - exiting 05:28:50 (3484): No heartbeat from core client for 30 sec - exiting 05:28:51 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6428, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8008, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2368, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5396, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1832, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GCobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4284, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4452, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:22:41 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:22:42 (4220): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4564, selfPID=1740, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5068, selfPID=2648, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2480, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1932, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4280, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5652, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4404, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 05:51:27 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:51:29 (5268): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5736, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2708, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6056, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2800, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6048, selfPID=4404, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2308, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=716, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2904, selfPID=4396, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr= 2 del crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4904, selfPID=4384, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5456, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5328, selfPID=5184, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1484, selfPID=3188, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7348, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5640, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5436, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5548, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 07:06:11 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:12 (1468): No heartbeat from core client for 30 sec - exiting 07:06:13 (1468): No heartbeat from core client for 30 sec - exiting 07:06:14 (1468): No heartbeat from core client for 30 sec - exiting 07:06:15 (1468): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7428, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3520, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6120, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3856, selfPID=3856, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3572, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5880, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4136, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5760, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6052, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5312, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4588, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5348, selfPID=5404, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=868, selfPID=5140, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5188, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4456, selfPID=5108, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:26:36 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:37 (5136): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6568, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3240, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5060, selfPID=5280, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6012, iMonCtr= 2 del crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2720, selfPID=3852, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5656, selfPID=5080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5508, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4424, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1456, selfPID=5776, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4188, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5940, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3496, selfPID=5512, iMonCtr=1 Model crash detected, will try to restart... 05:21:57 (5668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:58 (5668): No heartbeat from core client for 30 sec - exiting 05:21:59 (5668): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=180, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4444, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6052, selfPID=6024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3968, selfPID=6084, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3980, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6044, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5524, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5904, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5416, iMonCtr=2 Model crash detected, will try to restart... 18:51:18 (5744): No heartbeat from core client for 30 sec - exiting 18:51:19 (5744): No heartbeat from core client for 30 sec - exiting 18:51:20 (5744): No heartbeat from core client for 30 sec - exiting 18:51:21 (5744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3680, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5604, selfPID=5060, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5176, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4952, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5240, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2992, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5568, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5836, selfPID=5648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5084, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5716, iMonCtr=2 Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1480, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5308, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4972, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5180, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3148, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5108, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5896, selfPID=5172, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5364, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2164, selfPID=3376, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5864, selfPID=5324, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6000, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_MainController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4968, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6032, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6088, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6048, selfPID=5940, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3704, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3412, selfPID=5352, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 05:31:46 (5216): No heartbeat from core client for 30 sec - exiting 05:31:47 (5216): No heartbeat from core client for 30 sec - exiting 05:31:49 (5216): No heartbeat from core client for 30 sec - exiting 05:31:50 (5216): No heartbeat from core client for 30 sec - exiting 05:31:51 (5216): No heartbeat from core client for 30 sec - exiting 05:31:52 (5216): No heartbeat from core client for 30 sec - exiting 05:31:53 (5216): No heartbeat from core client for 30 sec - exiting 05:31:54 (5216): No heartbeat from core client for 30 sec - exiting 05:31:55 (5216): No heartbeat from core client for 30 sec - exiting 05:31:56 (5216): No heartbeat from core client for 30 sec - exiting 05:31:57 (5216): No heartbeat from core client for 30 sec - exiting 05:31:58 (5216): No heartbeat from core client for 30 sec - exiting 05:31:59 (5216): No heartbeat from core client for 30 sec - exiting 05:32:00 (5216): No heartbeat from core client for 30 sec - exiting 05:32:01 (5216): No heartbeat from core client for 30 sec - exiting 05:32:02 (5216): No heartbeat from core client for 30 sec - exiting 05:32:03 (5216): No heartbeat from core client for 30 sec - exiting 05:32:04 (5216): No heartbeat from core client for 30 sec - exiting 05:32:05 (5216): No heartbeat from core client for 30 sec - exiting 05:32:06 (5216): No heartbeat from core client for 30 sec - exiting 05:32:07 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3680, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5280, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5944, selfPID=5736, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2740, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5752, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5428, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=1500, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5276, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2252, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4944, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5980, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2636, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4600, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Aug 2011 06:56:04	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	138,336	548,467	3.9647
10 Aug 2011 09:01:30	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	126,816	499,397	3.9380
06 Aug 2011 06:46:21	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	115,296	449,819	3.9014
03 Aug 2011 05:37:47	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	103,776	400,127	3.8557
01 Aug 2011 06:16:43	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	92,256	350,901	3.8036
29 Jul 2011 16:32:09	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	80,736	300,710	3.7246
27 Jul 2011 07:24:54	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	69,216	251,420	3.6324
25 Jul 2011 21:53:37	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	57,696	202,192	3.5044
25 Jul 2011 19:40:01	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	46,176	153,579	3.3259
25 Jul 2011 16:28:22	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	34,656	106,910	3.0849
08 Jul 2011 04:07:02	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	23,136	59,198	2.5587
04 Jul 2011 08:48:27	1016212	13029442	hadam3p_eu_2rlj_1965_1_007283611_1	11,616	11,383	0.9799