Task 12934390

Name	hadam3p_eu_2tyb_1970_1_007271549_0
Workunit	7469384
Created	4 Jun 2011, 15:46:34 UTC
Sent	4 Jun 2011, 15:46:35 UTC
Report deadline	16 May 2012, 21:06:35 UTC
Received	17 Nov 2011, 8:53:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1073441
Run time	12 days 12 hours 54 min 44 sec
CPU time	3 days 22 hours 22 min 8 sec
Validate state	Invalid
Credit	995.40
Device peak FLOPS	1.51 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4240, selfPID=4240, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1000, selfPID=1000, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=152, selfPID=152, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4480, selfPID=4480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3124, iMonCtr=2 Model crash detected, will try to restart... GCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3996, selfPID=3996, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=804, selfPID=804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=904, selfPID=904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2264, selfPID=2264, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2288, selfPID=2288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2892, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2504, selfPID=2504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4408, selfPID=4408, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=764, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4640, selfPID=4640, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4784, selfPID=4784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4024, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4648, selfPID=4648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5684, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4888, selfPID=4888, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3748, selfPID=3748, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3592, selfPID=3592, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4260, selfPID=4260, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3860, selfPID=3860, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5584, selfPID=5584, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5584, selfPID=3960, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5520, selfPID=5520, iMonCtr=2 CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=920, selfPID=3844, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4572, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3392, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2560, selfPID=2560, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4568, selfPID=4084, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4140, selfPID=1136, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:38 (3152): No heartbeat from core client for 30 sec - exiting 22:00:39 (3152): No heartbeat from core client for 30 sec - exiting 22:00:40 (3152): No heartbeat from core client for 30 sec - exiting 22:00:41 (3152): No heartbeat from core client for 30 sec - exiting 22:00:42 (3152): No heartbeat from core client for 30 sec - exiting 22:00:43 (3152): No heartbeat from core client for 30 sec - exiting 22:00:44 (3152): No heartbeat from core client for 30 sec - exiting 22:00:45 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4516, selfPID=4516, iMonCtr=2 18:14:52 (588): No heartbeat from core client for 30 sec - exiting 18:14:53 (588): No heartbeat from core client for 30 sec - exiting 18:14:54 (588): No heartbeat from core client for 30 sec - exiting 18:14:55 (588): No heartbeat from core client for 30 sec - exiting 18:14:56 (588): No heartbeat from core client for 30 sec - exiting 18:14:57 (588): No heartbeat from core client for 30 sec - exiting 18:14:59 (588): No heartbeat from core client for 30 sec - exiting 18:15:00 (588): No heartbeat from core client for 30 sec - exiting 18:15:01 (588): No heartbeat from core client for 30 sec - exiting 18:15:02 (588): No heartbeat from core client for 30 sec - exiting 18:15:03 (588): No heartbeat from core client for 30 sec - exiting 18:15:04 (588): No heartbeat from core client for 30 sec - exiting 18:15:05 (588): No heartbeat from core client for 30 sec - exiting 18:15:06 (588): No heartbeat from core client for 30 sec - exiting 18:15:07 (588): No heartbeat from core client for 30 sec - exiting 18:15:08 (588): No heartbeat from core client for 30 sec - exiting 18:15:09 (588): No heartbeat from core client for 30 sec - exiting 18:15:11 (588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5532, selfPID=5532, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4700, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6052, selfPID=6052, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3448, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5364, selfPID=5364, iMonCtr=2 CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1940, sCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1336, selfPID=1336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5084, selfPID=5084, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:13:04 (3964): No heartbeat from core client for 30 sec - exiting 11:13:07 (3964): No heartbeat from core client for 30 sec - exiting 11:13:08 (3964): No heartbeat from core client for 30 sec - exiting 11:13:09 (3964): No heartbeat from core client for 30 sec - exiting 11:13:10 (3964): No heartbeat from core client for 30 sec - exiting 11:13:11 (3964): No heartbeat from core client for 30 sec - exiting 11:13:13 (3964): No heartbeat from core client for 30 sec - exiting 11:13:14 (3964): No heartbeat from core client for 30 sec - exiting 11:13:15 (3964): No heartbeat from core client for 30 sec - exiting 11:13:16 (3964): No heartbeat from core client for 30 sec - exiting 11:13:17 (3964): No heartbeat from core client for 30 sec - exiting 11:13:18 (3964): No heartbeat from core client for 30 sec - exiting 11:13:19 (3964): No heartbeat from core client for 30 sec - exiting 11:13:20 (3964): No heartbeat from core client for 30 sec - exiting 11:13:21 (3964): No heartbeat from core client for 30 sec - exiting 11:13:22 (3964): No heartbeat from core client for 30 sec - exiting 11:13:23 (3964): No heartbeat from core client for 30 sec - exiting 11:13:25 (3964): No heartbeat from core client for 30 sec - exiting 11:13:26 (3964): No heartbeat from core client for 30 sec - exiting 11:13:27 (3964): No heartbeat from core client for 30 sec - exiting 11:13:28 (3964): No heartbeat from core client for 30 sec - exiting 11:13:29 (3964): No heartbeat from core client for 30 sec - exiting 11:13:30 (3964): No heartbeat from core client for 30 sec - exiting 11:13:31 (3964): No heartbeat from core client for 30 sec - exiting 11:13:32 (3964): No heartbeat from core client for 30 sec - exiting 11:13:33 (3964): No heartbeat from core client for 30 sec - exiting 11:13:35 (3964): No heartbeat from core client for 30 sec - exiting 11:13:36 (3964): No heartbeat from core client for 30 sec - exiting 11:13:37 (3964): No heartbeat from core client for 30 sec - exiting 11:13:38 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5028, selfPID=5028, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4420, selfPID=4420, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4468, selfPID=4468, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4672, selfPID=4672, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2036, selfPID=2036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5800, selfPID=5800, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:41:59 (2284): No heartbeat from core client for 30 sec - exiting 19:42:00 (2284): No heartbeat from core client for 30 sec - exiting 19:42:01 (2284): No heartbeat from core client for 30 sec - exiting 19:42:02 (2284): No heartbeat from core client for 30 sec - exiting 19:42:03 (2284): No heartbeat from core client for 30 sec - exiting 19:42:04 (2284): No heartbeat from core client for 30 sec - exiting 19:42:05 (2284): No heartbeat from core client for 30 sec - exiting 19:42:06 (2284): No heartbeat from core client for 30 sec - exiting 19:42:07 (2284): No heartbeat from core client for 30 sec - exiting 19:42:08 (2284): No heartbeat from core client for 30 sec - exiting 19:42:09 (2284): No heartbeat from core client for 30 sec - exiting 19:42:10 (2284): No heartbeat from core client for 30 sec - exiting 19:42:11 (2284): No heartbeat from core client for 30 sec - exiting 19:42:12 (2284): No heartbeat from core client for 30 sec - exiting 19:42:13 (2284): No heartbeat from core client for 30 sec - exiting 19:42:14 (2284): No heartbeat from core client for 30 sec - exiting 19:42:15 (2284): No heartbeat from core client for 30 sec - exiting 19:42:16 (2284): No heartbeat from core client for 30 sec - exiting 19:42:17 (2284): No heartbeat from core client for 30 sec - exiting 19:42:18 (2284): No heartbeat from core client for 30 sec - exiting 19:42:19 (2284): No heartbeat from core client for 30 sec - exiting 19:42:20 (2284): No heartbeat from core client for 30 sec - exiting 19:42:21 (2284): No heartbeat from core client for 30 sec - exiting 19:42:22 (2284): No heartbeat from core client for 30 sec - exiting 19:42:23 (2284): No heartbeat from core client for 30 sec - exiting 19:42:24 (2284): No heartbeat from core client for 30 sec - exiting 19:42:25 (2284): No heartbeat from core client for 30 sec - exiting 19:42:26 (2284): No heartbeat from core client for 30 sec - exiting 19:42:27 (2284): No heartbeat from core client for 30 sec - exiting 19:42:28 (2284): No heartbeat from core client for 30 sec - exiting 19:42:29 (2284): No heartbeat from core client for 30 sec - exiting 19:42:30 (2284): No heartbeat from core client for 30 sec - exiting 19:42:31 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:02 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:09:24 (3348): No heartbeat from core client for 30 sec - exiting 20:09:25 (3348): No heartbeat from core client for 30 sec - exiting 20:09:26 (3348): No heartbeat from core client for 30 sec - exiting 20:09:28 (3348): No heartbeat from core client for 30 sec - exiting 20:09:29 (3348): No heartbeat from core client for 30 sec - exiting 20:09:30 (3348): No heartbeat from core client for 30 sec - exiting 20:09:31 (3348): No heartbeat from core client for 30 sec - exiting 20:09:32 (3348): No heartbeat from core client for 30 sec - exiting 20:09:33 (3348): No heartbeat from core client for 30 sec - exiting 20:09:34 (3348): No heartbeat from core client for 30 sec - exiting 20:09:35 (3348): No heartbeat from core client for 30 sec - exiting 20:09:37 (3348): No heartbeat from core client for 30 sec - exiting 20:09:42 (3348): No heartbeat from core client for 30 sec - exiting 20:09:43 (3348): No heartbeat from core client for 30 sec - exiting 20:09:44 (3348): No heartbeat from core client for 30 sec - exiting 20:09:45 (3348): No heartbeat from core client for 30 sec - exiting 20:09:46 (3348): No heartbeat from core client for 30 sec - exiting 20:09:47 (3348): No heartbeat from core client for 30 sec - exiting 20:09:48 (3348): No heartbeat from core client for 30 sec - exiting 20:09:49 (3348): No heartbeat from core client for 30 sec - exiting 20:09:51 (3348): No heartbeat from core client for 30 sec - exiting 20:09:52 (3348): No heartbeat from core client for 30 sec - exiting 20:09:53 (3348): No heartbeat from core client for 30 sec - exiting 20:09:54 (3348): No heartbeat from core client for 30 sec - exiting 20:09:55 (3348): No heartbeat from core client for 30 sec - exiting 20:09:56 (3348): No heartbeat from core client for 30 sec - exiting 20:09:57 (3348): No heartbeat from core client for 30 sec - exiting 20:09:58 (3348): No heartbeat from core client for 30 sec - exiting 20:09:59 (3348): No heartbeat from core client for 30 sec - exiting 20:10:00 (3348): No heartbeat from core client for 30 sec - exiting 20:10:02 (3348): No heartbeat from core client for 30 sec - exiting 20:10:03 (3348): No heartbeat from core client for 30 sec - exiting 20:10:04 (3348): No heartbeat from core client for 30 sec - exiting 20:10:05 (3348): No heartbeat from core client for 30 sec - exiting 20:10:06 (3348): No heartbeat from core client for 30 sec - exiting 20:10:07 (3348): No heartbeat from core client for 30 sec - exiting 20:10:08 (3348): No heartbeat from core client for 30 sec - exiting 20:10:09 (3348): No heartbeat from core client for 30 sec - exiting 20:10:10 (3348): No heartbeat from core client for 30 sec - exiting 20:10:12 (3348): No heartbeat from core client for 30 sec - exiting 20:10:13 (3348): No heartbeat from core client for 30 sec - exiting 20:10:14 (3348): No heartbeat from core client for 30 sec - exiting 20:10:15 (3348): No heartbeat from core client for 30 sec - exiting 20:10:16 (3348): No heartbeat from core client for 30 sec - exiting 20:10:17 (3348): No heartbeat from core client for 30 sec - exiting 20:10:18 (3348): No heartbeat from core client for 30 sec - exiting 20:10:19 (3348): No heartbeat from core client for 30 sec - exiting 20:10:20 (3348): No heartbeat from core client for 30 sec - exiting 20:10:21 (3348): No heartbeat from core client for 30 sec - exiting 20:10:22 (3348): No heartbeat from core client for 30 sec - exiting 20:10:24 (3348): No heartbeat from core client for 30 sec - exiting 20:10:25 (3348): No heartbeat from core client for 30 sec - exiting 20:10:26 (3348): No heartbeat from core client for 30 sec - exiting 20:10:27 (3348): No heartbeat from core client for 30 sec - exiting 20:10:28 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:29 (3348): No heartbeat from core client for 30 sec - exiting 20:10:30 (3348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=152, selfPID=3168, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3044, selfPID=3044, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2424, selfPID=2424, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:30:11 (3556): No heartbeat from core client for 30 sec - exiting 08:30:15 (3556): No heartbeat from core client for 30 sec - exiting 08:30:16 (3556): No heartbeat from core client for 30 sec - exiting 08:30:18 (3556): No heartbeat from core client for 30 sec - exiting 08:30:19 (3556): No heartbeat from core client for 30 sec - exiting 08:30:20 (3556): No heartbeat from core client for 30 sec - exiting 08:30:21 (3556): No heartbeat from core client for 30 sec - exiting 08:30:22 (3556): No heartbeat from core client for 30 sec - exiting 08:30:23 (3556): No heartbeat from core client for 30 sec - exiting 08:30:24 (3556): No heartbeat from core client for 30 sec - exiting 08:30:25 (3556): No heartbeat from core client for 30 sec - exiting 08:30:26 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5244, selfPID=1412, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3816, selfPID=3816, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5168, selfPID=892, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5736, selfPID=5736, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5016, selfPID=5016, iMonCtr=2 23:15:14 (4076): No heartbeat from core client for 30 sec - exiting 23:15:15 (4076): No heartbeat from core client for 30 sec - exiting 23:15:17 (4076): No heartbeat from core client for 30 sec - exiting 23:15:18 (4076): No heartbeat from core client for 30 sec - exiting 23:15:19 (4076): No heartbeat from core client for 30 sec - exiting 23:15:20 (4076): No heartbeat from core client for 30 sec - exiting 23:15:21 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3944, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4584, selfPID=4584, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4956, selfPID=4956, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2700, selfPID=2700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:54:59 (2328): Can't set up shared mem: -1. Will run in standalone mode. 23:56:15 (2584): Can't set up shared mem: -1. Will run in standalone mode. 23:56:16 (3548): Can't set up shared mem: -1. Will run in standalone mode. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3064, selfPID=3064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... ContCPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2236, selfPID=2236, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5136, selfPID=5144, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_2tyb_1970_1_007271549_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tyb_1970_1_007271549_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tyb_1970_1_007271549_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tyb_1970_1_007271549_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tyb_1970_1_007271549_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tyb_1970_1_007271549_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tyb_1970_1_007271549_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Nov 2011 23:10:27	1073441	12934390	hadam3p_eu_2tyb_1970_1_007271549_0	57,702	338,375	5.8642
15 Nov 2011 23:10:27	1073441	12934390	hadam3p_eu_2tyb_1970_1_007271549_0	57,697	337,787	5.8545
15 Nov 2011 23:10:27	1073441	12934390	hadam3p_eu_2tyb_1970_1_007271549_0	57,696	337,131	5.8432
31 Jul 2011 11:05:32	1073441	12934390	hadam3p_eu_2tyb_1970_1_007271549_0	46,176	257,362	5.5735
28 Jun 2011 18:44:57	1073441	12934390	hadam3p_eu_2tyb_1970_1_007271549_0	34,656	189,114	5.4569
19 Jun 2011 22:04:16	1073441	12934390	hadam3p_eu_2tyb_1970_1_007271549_0	23,136	128,685	5.5621
12 Jun 2011 14:20:10	1073441	12934390	hadam3p_eu_2tyb_1970_1_007271549_0	11,616	65,541	5.6423