Task 12782542

Name	hadam3p_saf_0f3l_1993_1_007212112_1
Workunit	7410392
Created	7 Apr 2011, 17:23:34 UTC
Sent	8 Apr 2011, 0:32:14 UTC
Report deadline	20 Mar 2012, 5:52:14 UTC
Received	12 Mar 2013, 23:45:04 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1128122
Run time	3 days 17 hours 42 min 47 sec
CPU time	3 days 16 hours 32 min 25 sec
Validate state	Workunit error - check skipped
Credit	2,244.09
Device peak FLOPS	2.82 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2480, selfPID=2480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4420, selfPID=4420, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4328, selfPID=4328, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6428, selfPID=6428, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2744, selfPID=2744, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7288, selfPID=7288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8048, selfPID=8048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2428, selfPID=2428, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4448, selfPID=3412, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6376, selfPID=6376, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4116, selfPID=4116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4632, selfPID=4632, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5244, selfPID=5244, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4756, selfPID=4756, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3100, selfPID=3100, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1792, selfPID=1792, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5600, selfPID=5600, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=968, selfPID=968, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4828, selfPID=4828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5336, selfPID=5336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7988, selfPID=7988, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5392, selfPID=5392, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6264, selfPID=6264, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6376, selfPID=6376, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7304, selfPID=7304, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1344, selfPID=1344, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3204, selfPID=3204, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6636, selfPID=6636, iMonCtr=2 CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6380, selfPID=6380, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1660, selfPID=1660, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4792, selfPID=4792, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1196, selfPID=1196, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1768, selfPID=1768, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7440, selfPID=7440, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3160, selfPID=3160, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8868, selfPID=8868, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4576, selfPID=4576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9884, selfPID=9884, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9304, selfPID=9304, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=876, selfPID=876, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3676, selfPID=3676, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5520, selfPID=5520, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5396, selfPID=5396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:26:01 (4880): No heartbeat from core client for 30 sec - exiting 16:26:02 (4880): No heartbeat from core client for 30 sec - exiting 16:26:03 (4880): No heartbeat from core client for 30 sec - exiting 16:26:04 (4880): No heartbeat from core client for 30 sec - exiting 16:26:05 (4880): No heartbeat from core client for 30 sec - exiting 16:26:06 (4880): No heartbeat from core client for 30 sec - exiting 16:26:07 (4880): No heartbeat from core client for 30 sec - exiting 16:26:08 (4880): No heartbeat from core client for 30 sec - exiting 16:26:09 (4880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3924, selfPID=3924, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:49 (1276): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:15:18 (4956): No heartbeat from core client for 30 sec - exiting 18:15:20 (4956): No heartbeat from core client for 30 sec - exiting 18:15:21 (4956): No heartbeat from core client for 30 sec - exiting 18:15:22 (4956): No heartbeat from core client for 30 sec - exiting 18:15:23 (4956): No heartbeat from core client for 30 sec - exiting 18:15:24 (4956): No heartbeat from core client for 30 sec - exiting 18:15:25 (4956): No heartbeat from core client for 30 sec - exiting 18:15:26 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:38:21 (4232): No heartbeat from core client for 30 sec - exiting 19:38:22 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:49:45 (4456): No heartbeat from core client for 30 sec - exiting 20:49:46 (4456): No heartbeat from core client for 30 sec - exiting 20:49:47 (4456): No heartbeat from core client for 30 sec - exiting 20:49:48 (4456): No heartbeat from core client for 30 sec - exiting 20:49:49 (4456): No heartbeat from core client for 30 sec - exiting 20:49:50 (4456): No heartbeat from core client for 30 sec - exiting 20:49:51 (4456): No heartbeat from core client for 30 sec - exiting 20:49:52 (4456): No heartbeat from core client for 30 sec - exiting 20:49:53 (4456): No heartbeat from core client for 30 sec - exiting 20:49:54 (4456): No heartbeat from core client for 30 sec - exiting 20:49:55 (4456): No heartbeat from core client for 30 sec - exiting 20:49:56 (4456): No heartbeat from core client for 30 sec - exiting 20:49:57 (4456): No heartbeat from core client for 30 sec - exiting 20:49:58 (4456): No heartbeat from core client for 30 sec - exiting 20:49:59 (4456): No heartbeat from core client for 30 sec - exiting 20:50:00 (4456): No heartbeat from core client for 30 sec - exiting 20:50:01 (4456): No heartbeat from core client for 30 sec - exiting 20:50:02 (4456): No heartbeat from core client for 30 sec - exiting 20:50:03 (4456): No heartbeat from core client for 30 sec - exiting 20:50:04 (4456): No heartbeat from core client for 30 sec - exiting 20:50:05 (4456): No heartbeat from core client for 30 sec - exiting 20:50:06 (4456): No heartbeat from core client for 30 sec - exiting 20:50:07 (4456): No heartbeat from core client for 30 sec - exiting 20:50:08 (4456): No heartbeat from core client for 30 sec - exiting 20:50:09 (4456): No heartbeat from core client for 30 sec - exiting 20:50:10 (4456): No heartbeat from core client for 30 sec - exiting 20:50:11 (4456): No heartbeat from core client for 30 sec - exiting 20:50:12 (4456): No heartbeat from core client for 30 sec - exiting 20:50:13 (4456): No heartbeat from core client for 30 sec - exiting 20:50:14 (4456): No heartbeat from core client for 30 sec - exiting 20:50:15 (4456): No heartbeat from core client for 30 sec - exiting 20:50:16 (4456): No heartbeat from core client for 30 sec - exiting 20:50:17 (4456): No heartbeat from core client for 30 sec - exiting 20:50:18 (4456): No heartbeat from core client for 30 sec - exiting 20:50:19 (4456): No heartbeat from core client for 30 sec - exiting 20:50:20 (4456): No heartbeat from core client for 30 sec - exiting 20:50:21 (4456): No heartbeat from core client for 30 sec - exiting 20:50:22 (4456): No heartbeat from core client for 30 sec - exiting 20:50:23 (4456): No heartbeat from core client for 30 sec - exiting 20:50:24 (4456): No heartbeat from core client for 30 sec - exiting 20:50:25 (4456): No heartbeat from core client for 30 sec - exiting 20:50:26 (4456): No heartbeat from core client for 30 sec - exiting 20:50:27 (4456): No heartbeat from core client for 30 sec - exiting 20:50:28 (4456): No heartbeat from core client for 30 sec - exiting 20:50:29 (4456): No heartbeat from core client for 30 sec - exiting 20:50:30 (4456): No heartbeat from core client for 30 sec - exiting 20:50:31 (4456): No heartbeat from core client for 30 sec - exiting 20:50:32 (4456): No heartbeat from core client for 30 sec - exiting 20:50:33 (4456): No heartbeat from core client for 30 sec - exiting 20:50:34 (4456): No heartbeat from core client for 30 sec - exiting 20:50:35 (4456): No heartbeat from core client for 30 sec - exiting 20:50:36 (4456): No heartbeat from core client for 30 sec - exiting 20:50:37 (4456): No heartbeat from core client for 30 sec - exiting 20:50:38 (4456): No heartbeat from core client for 30 sec - exiting 20:50:39 (4456): No heartbeat from core client for 30 sec - exiting 20:50:40 (4456): No heartbeat from core client for 30 sec - exiting 20:50:41 (4456): No heartbeat from core client for 30 sec - exiting 20:50:42 (4456): No heartbeat from core client for 30 sec - exiting 20:50:43 (4456): No heartbeat from core client for 30 sec - exiting 20:50:44 (4456): No heartbeat from core client for 30 sec - exiting 20:50:45 (4456): No heartbeat from core client for 30 sec - exiting 20:50:46 (4456): No heartbeat from core client for 30 sec - exiting 20:50:47 (4456): No heartbeat from core client for 30 sec - exiting 20:50:48 (4456): No heartbeat from core client for 30 sec - exiting 20:50:49 (4456): No heartbeat from core client for 30 sec - exiting 20:50:50 (4456): No heartbeat from core client for 30 sec - exiting 20:50:51 (4456): No heartbeat from core client for 30 sec - exiting 20:50:52 (4456): No heartbeat from core client for 30 sec - exiting 20:50:53 (4456): No heartbeat from core client for 30 sec - exiting 20:50:54 (4456): No heartbeat from core client for 30 sec - exiting 20:50:55 (4456): No heartbeat from core client for 30 sec - exiting 20:50:56 (4456): No heartbeat from core client for 30 sec - exiting 20:50:57 (4456): No heartbeat from core client for 30 sec - exiting 20:50:58 (4456): No heartbeat from core client for 30 sec - exiting 20:50:59 (4456): No heartbeat from core client for 30 sec - exiting 20:51:00 (4456): No heartbeat from core client for 30 sec - exiting 20:51:01 (4456): No heartbeat from core client for 30 sec - exiting 20:51:02 (4456): No heartbeat from core client for 30 sec - exiting 20:51:03 (4456): No heartbeat from core client for 30 sec - exiting 20:51:04 (4456): No heartbeat from core client for 30 sec - exiting 20:51:05 (4456): No heartbeat from core client for 30 sec - exiting 20:51:06 (4456): No heartbeat from core client for 30 sec - exiting 20:51:07 (4456): No heartbeat from core client for 30 sec - exiting 20:51:08 (4456): No heartbeat from core client for 30 sec - exiting 20:51:09 (4456): No heartbeat from core client for 30 sec - exiting 20:51:10 (4456): No heartbeat from core client for 30 sec - exiting 20:51:11 (4456): No heartbeat from core client for 30 sec - exiting 20:51:12 (4456): No heartbeat from core client for 30 sec - exiting 20:51:13 (4456): No heartbeat from core client for 30 sec - exiting 20:51:14 (4456): No heartbeat from core client for 30 sec - exiting 20:51:15 (4456): No heartbeat from core client for 30 sec - exiting 20:51:16 (4456): No heartbeat from core client for 30 sec - exiting 20:51:17 (4456): No heartbeat from core client for 30 sec - exiting 20:51:18 (4456): No heartbeat from core client for 30 sec - exiting 20:51:19 (4456): No heartbeat from core client for 30 sec - exiting 20:51:20 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:49:00 (5340): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:33:54 (6596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:16:53 (4208): Can't set up shared mem: -1. Will run in standalone mode. 15:17:00 (4352): Can't set up shared mem: -1. Will run in standalone mode. 15:17:00 (4368): Can't set up shared mem: -1. Will run in standalone mode. 17:41:28 (4380): No heartbeat from core client for 30 sec - exiting 17:41:29 (4380): No heartbeat from core client for 30 sec - exiting 17:41:30 (4380): No heartbeat from core client for 30 sec - exiting 17:41:31 (4380): No heartbeat from core client for 30 sec - exiting 17:41:32 (4380): No heartbeat from core client for 30 sec - exiting 17:41:33 (4380): No heartbeat from core client for 30 sec - exiting 17:41:35 (4380): No heartbeat from core client for 30 sec - exiting 17:41:36 (4380): No heartbeat from core client for 30 sec - exiting 17:41:37 (4380): No heartbeat from core client for 30 sec - exiting 17:41:38 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6396, selfPID=5740, iMonCtr=1 Model crash detected, will try to restart... 17:59:55 (6892): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6736, selfPID=6736, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4808, selfPID=4808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6952, selfPID=6952, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5956, selfPID=5956, iMonCtr=2 12:06:41 (4624): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6656, selfPID=6656, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5100, selfPID=5100, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4564, selfPID=5964, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:12:38 (4804): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5060, selfPID=5060, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6972, selfPID=6972, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4860, selfPID=4860, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6752, selfPID=6752, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6052, selfPID=6052, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Dec 2012 15:38:56	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	138,336	318,215	2.3003
14 Dec 2012 15:38:55	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	126,816	290,921	2.2940
14 Dec 2012 15:38:55	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	115,296	264,035	2.2901
01 Aug 2011 16:22:00	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	103,776	237,981	2.2932
21 May 2011 19:50:12	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	92,256	211,516	2.2927
15 May 2011 12:59:47	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	80,736	185,350	2.2958
13 May 2011 14:02:31	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	69,216	159,329	2.3019
08 May 2011 19:10:13	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	57,696	133,024	2.3056
02 May 2011 19:00:06	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	46,176	106,269	2.3014
30 Apr 2011 07:08:02	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	34,656	79,925	2.3062
29 Apr 2011 15:07:26	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	23,136	53,552	2.3147
29 Apr 2011 01:29:02	1128122	12782542	hadam3p_saf_0f3l_1993_1_007212112_1	11,616	27,174	2.3394