Task 13542277

Name	hadcm3n_ydzq_1900_40_007518298_1
Workunit	7715773
Created	28 Oct 2011, 12:57:03 UTC
Sent	21 Nov 2011, 0:06:54 UTC
Report deadline	20 Feb 2012, 7:34:05 UTC
Received	6 Dec 2011, 21:53:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	989980
Run time	2 days 3 hours 0 min 20 sec
CPU time	1 days 18 hours 23 min 36 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> ler:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 08:58:36 (97346): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:58:37 (97346): No heartbeat from core client for 30 sec - exiting 08:58:38 (97346): No heartbeat from core client for 30 sec - exiting 08:58:39 (97346): No heartbeat from core client for 30 sec - exiting 08:58:40 (97346): No heartbeat from core client for 30 sec - exiting 08:58:41 (97346): No heartbeat from core client for 30 sec - exiting 08:58:42 (97346): No heartbeat from core client for 30 sec - exiting 08:58:43 (97346): No heartbeat from core client for 30 sec - exiting 09:00:20 (97416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:21 (97416): No heartbeat from core client for 30 sec - exiting 09:00:22 (97416): No heartbeat from core client for 30 sec - exiting 09:00:23 (97416): No heartbeat from core client for 30 sec - exiting 09:00:24 (97416): No heartbeat from core client for 30 sec - exiting 09:00:25 (97416): No heartbeat from core client for 30 sec - exiting 09:00:26 (97416): No heartbeat from core client for 30 sec - exiting 09:00:27 (97416): No heartbeat from core client for 30 sec - exiting 09:00:28 (97416): No heartbeat from core client for 30 sec - exiting 09:00:29 (97416): No heartbeat from core client for 30 sec - exiting 09:00:30 (97416): No heartbeat from core client for 30 sec - exiting 09:00:31 (97416): No heartbeat from core client for 30 sec - exiting 09:00:32 (97416): No heartbeat from core client for 30 sec - exiting 09:00:33 (97416): No heartbeat from core client for 30 sec - exiting 09:00:34 (97416): No heartbeat from core client for 30 sec - exiting 09:00:35 (97416): No heartbeat from core client for 30 sec - exiting 09:00:36 (97416): No heartbeat from core client for 30 sec - exiting 09:00:37 (97416): No heartbeat from core client for 30 sec - exiting 09:00:38 (97416): No heartbeat from core client for 30 sec - exiting 09:00:39 (97416): No heartbeat from core client for 30 sec - exiting 09:00:40 (97416): No heartbeat from core client for 30 sec - exiting 09:00:41 (97416): No heartbeat from core client for 30 sec - exiting 09:00:42 (97416): No heartbeat from core client for 30 sec - exiting 09:00:43 (97416): No heartbeat from core client for 30 sec - exiting 09:08:37 (97436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:31 (97486): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:38 (97511): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:42 (97545): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:45 (97545): No heartbeat from core client for 30 sec - exiting 16:59:46 (97545): No heartbeat from core client for 30 sec - exiting 16:59:47 (97545): No heartbeat from core client for 30 sec - exiting 16:59:48 (97545): No heartbeat from core client for 30 sec - exiting 16:59:49 (97545): No heartbeat from core client for 30 sec - exiting 16:59:50 (97545): No heartbeat from core client for 30 sec - exiting 16:59:51 (97545): No heartbeat from core client for 30 sec - exiting 16:59:52 (97545): No heartbeat from core client for 30 sec - exiting 16:59:53 (97545): No heartbeat from core client for 30 sec - exiting 16:59:54 (97545): No heartbeat from core client for 30 sec - exiting 16:59:55 (97545): No heartbeat from core client for 30 sec - exiting 16:59:56 (97545): No heartbeat from core client for 30 sec - exiting 16:59:57 (97545): No heartbeat from core client for 30 sec - exiting 16:59:58 (97545): No heartbeat from core client for 30 sec - exiting 16:59:59 (97545): No heartbeat from core client for 30 sec - exiting 17:00:00 (97545): No heartbeat from core client for 30 sec - exiting 17:00:01 (97545): No heartbeat from core client for 30 sec - exiting 17:00:02 (97545): No heartbeat from core client for 30 sec - exiting 17:00:03 (97545): No heartbeat from core client for 30 sec - exiting 17:00:04 (97545): No heartbeat from core client for 30 sec - exiting 17:00:05 (97545): No heartbeat from core client for 30 sec - exiting 17:00:06 (97545): No heartbeat from core client for 30 sec - exiting 17:00:07 (97545): No heartbeat from core client for 30 sec - exiting 17:00:08 (97545): No heartbeat from core client for 30 sec - exiting 17:00:09 (97545): No heartbeat from core client for 30 sec - exiting 17:00:10 (97545): No heartbeat from core client for 30 sec - exiting 17:00:11 (97545): No heartbeat from core client for 30 sec - exiting 17:00:12 (97545): No heartbeat from core client for 30 sec - exiting 17:00:13 (97545): No heartbeat from core client for 30 sec - exiting 17:00:14 (97545): No heartbeat from core client for 30 sec - exiting 17:00:15 (97545): No heartbeat from core client for 30 sec - exiting 17:00:16 (97545): No heartbeat from core client for 30 sec - exiting 17:00:17 (97545): No heartbeat from core client for 30 sec - exiting 17:00:18 (97545): No heartbeat from core client for 30 sec - exiting 17:00:19 (97545): No heartbeat from core client for 30 sec - exiting 17:00:20 (97545): No heartbeat from core client for 30 sec - exiting 17:00:21 (97545): No heartbeat from core client for 30 sec - exiting 17:00:22 (97545): No heartbeat from core client for 30 sec - exiting 17:00:23 (97545): No heartbeat from core client for 30 sec - exiting 17:00:24 (97545): No heartbeat from core client for 30 sec - exiting 17:00:25 (97545): No heartbeat from core client for 30 sec - exiting 17:00:26 (97545): No heartbeat from core client for 30 sec - exiting 17:00:27 (97545): No heartbeat from core client for 30 sec - exiting 17:00:28 (97545): No heartbeat from core client for 30 sec - exiting 17:00:29 (97545): No heartbeat from core client for 30 sec - exiting 17:00:30 (97545): No heartbeat from core client for 30 sec - exiting 17:00:31 (97545): No heartbeat from core client for 30 sec - exiting 17:00:32 (97545): No heartbeat from core client for 30 sec - exiting 17:00:33 (97545): No heartbeat from core client for 30 sec - exiting 17:00:34 (97545): No heartbeat from core client for 30 sec - exiting 17:00:35 (97545): No heartbeat from core client for 30 sec - exiting 17:00:36 (97545): No heartbeat from core client for 30 sec - exiting 20:19:09 (956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:47 (2229): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:48 (2229): No heartbeat from core client for 30 sec - exiting 20:19:49 (2229): No heartbeat from core client for 30 sec - exiting 20:19:50 (2229): No heartbeat from core client for 30 sec - exiting 20:19:51 (2229): No heartbeat from core client for 30 sec - exiting 20:19:52 (2229): No heartbeat from core client for 30 sec - exiting 20:19:53 (2229): No heartbeat from core client for 30 sec - exiting 20:19:54 (2229): No heartbeat from core client for 30 sec - exiting 20:19:55 (2229): No heartbeat from core client for 30 sec - exiting 20:19:56 (2229): No heartbeat from core client for 30 sec - exiting 20:19:57 (2229): No heartbeat from core client for 30 sec - exiting 20:19:58 (2229): No heartbeat from core client for 30 sec - exiting 20:19:59 (2229): No heartbeat from core client for 30 sec - exiting 20:20:00 (2229): No heartbeat from core client for 30 sec - exiting 20:20:01 (2229): No heartbeat from core client for 30 sec - exiting 20:20:02 (2229): No heartbeat from core client for 30 sec - exiting 20:20:03 (2229): No heartbeat from core client for 30 sec - exiting 20:20:04 (2229): No heartbeat from core client for 30 sec - exiting 20:20:05 (2229): No heartbeat from core client for 30 sec - exiting 20:20:06 (2229): No heartbeat from core client for 30 sec - exiting 20:20:07 (2229): No heartbeat from core client for 30 sec - exiting 20:20:08 (2229): No heartbeat from core client for 30 sec - exiting 20:20:09 (2229): No heartbeat from core client for 30 sec - exiting 20:20:10 (2229): No heartbeat from core client for 30 sec - exiting 20:22:04 (2234): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:20 (2234): No heartbeat from core client for 30 sec - exiting 20:22:21 (2234): No heartbeat from core client for 30 sec - exiting 20:22:22 (2234): No heartbeat from core client for 30 sec - exiting 20:22:23 (2234): No heartbeat from core client for 30 sec - exiting 20:22:24 (2234): No heartbeat from core client for 30 sec - exiting 20:22:25 (2234): No heartbeat from core client for 30 sec - exiting 20:22:26 (2234): No heartbeat from core client for 30 sec - exiting 21:02:07 (2258): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:56:42 (2510): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:12 (2510): No heartbeat from core client for 30 sec - exiting 04:58:13 (2510): No heartbeat from core client for 30 sec - exiting 04:58:14 (2510): No heartbeat from core client for 30 sec - exiting 04:58:15 (2510): No heartbeat from core client for 30 sec - exiting 04:58:16 (2510): No heartbeat from core client for 30 sec - exiting 04:58:17 (2510): No heartbeat from core client for 30 sec - exiting 04:58:18 (2510): No heartbeat from core client for 30 sec - exiting 04:58:19 (2510): No heartbeat from core client for 30 sec - exiting 04:58:20 (2510): No heartbeat from core client for 30 sec - exiting 04:58:21 (2510): No heartbeat from core client for 30 sec - exiting 04:58:22 (2510): No heartbeat from core client for 30 sec - exiting 04:58:23 (2510): No heartbeat from core client for 30 sec - exiting 04:58:24 (2510): No heartbeat from core client for 30 sec - exiting 04:58:25 (2510): No heartbeat from core client for 30 sec - exiting 04:58:26 (2510): No heartbeat from core client for 30 sec - exiting 04:58:27 (2510): No heartbeat from core client for 30 sec - exiting 04:58:28 (2510): No heartbeat from core client for 30 sec - exiting 04:58:29 (2510): No heartbeat from core client for 30 sec - exiting 04:58:30 (2510): No heartbeat from core client for 30 sec - exiting 04:58:31 (2510): No heartbeat from core client for 30 sec - exiting 04:58:32 (2510): No heartbeat from core client for 30 sec - exiting 04:58:33 (2510): No heartbeat from core client for 30 sec - exiting 04:59:40 (5635): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:59:41 (5635): No heartbeat from core client for 30 sec - exiting 04:59:42 (5635): No heartbeat from core client for 30 sec - exiting 04:59:43 (5635): No heartbeat from core client for 30 sec - exiting 04:59:44 (5635): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:14:58 (5643): No heartbeat from core client for 30 sec - exiting 08:15:08 (5643): No heartbeat from core client for 30 sec - exiting 08:15:09 (5643): No heartbeat from core client for 30 sec - exiting 08:15:10 (5643): No heartbeat from core client for 30 sec - exiting 08:15:11 (5643): No heartbeat from core client for 30 sec - exiting 08:15:12 (5643): No heartbeat from core client for 30 sec - exiting 08:15:13 (5643): No heartbeat from core client for 30 sec - exiting 08:15:14 (5643): No heartbeat from core client for 30 sec - exiting 08:15:15 (5643): No heartbeat from core client for 30 sec - exiting 08:15:16 (5643): No heartbeat from core client for 30 sec - exiting 08:15:17 (5643): No heartbeat from core client for 30 sec - exiting 08:15:18 (5643): No heartbeat from core client for 30 sec - exiting 08:15:19 (5643): No heartbeat from core client for 30 sec - exiting 08:15:20 (5643): No heartbeat from core client for 30 sec - exiting 08:15:21 (5643): No heartbeat from core client for 30 sec - exiting 08:15:22 (5643): No heartbeat from core client for 30 sec - exiting 08:15:23 (5643): No heartbeat from core client for 30 sec - exiting 08:15:24 (5643): No heartbeat from core client for 30 sec - exiting 08:15:25 (5643): No heartbeat from core client for 30 sec - exiting 08:15:26 (5643): No heartbeat from core client for 30 sec - exiting 08:15:27 (5643): No heartbeat from core client for 30 sec - exiting 08:15:28 (5643): No heartbeat from core client for 30 sec - exiting 08:15:29 (5643): No heartbeat from core client for 30 sec - exiting 08:15:30 (5643): No heartbeat from core client for 30 sec - exiting 08:15:31 (5643): No heartbeat from core client for 30 sec - exiting 08:15:32 (5643): No heartbeat from core client for 30 sec - exiting 08:15:33 (5643): No heartbeat from core client for 30 sec - exiting 08:15:34 (5643): No heartbeat from core client for 30 sec - exiting 08:15:35 (5643): No heartbeat from core client for 30 sec - exiting 08:15:36 (5643): No heartbeat from core client for 30 sec - exiting 08:15:37 (5643): No heartbeat from core client for 30 sec - exiting 08:15:38 (5643): No heartbeat from core client for 30 sec - exiting 08:15:39 (5643): No heartbeat from core client for 30 sec - exiting 08:15:40 (5643): No heartbeat from core client for 30 sec - exiting 08:15:41 (5643): No heartbeat from core client for 30 sec - exiting 08:15:42 (5643): No heartbeat from core client for 30 sec - exiting 08:15:43 (5643): No heartbeat from core client for 30 sec - exiting 08:15:44 (5643): No heartbeat from core client for 30 sec - exiting 08:15:45 (5643): No heartbeat from core client for 30 sec - exiting 08:15:46 (5643): No heartbeat from core client for 30 sec - exiting 08:15:47 (5643): No heartbeat from core client for 30 sec - exiting 08:15:48 (5643): No heartbeat from core client for 30 sec - exiting 08:15:49 (5643): No heartbeat from core client for 30 sec - exiting 08:15:50 (5643): No heartbeat from core client for 30 sec - exiting 08:15:51 (5643): No heartbeat from core client for 30 sec - exiting 08:15:52 (5643): No heartbeat from core client for 30 sec - exiting 08:15:53 (5643): No heartbeat from core client for 30 sec - exiting 08:15:54 (5643): No heartbeat from core client for 30 sec - exiting 08:15:55 (5643): No heartbeat from core client for 30 sec - exiting 08:15:56 (5643): No heartbeat from core client for 30 sec - exiting 08:15:57 (5643): No heartbeat from core client for 30 sec - exiting 08:15:58 (5643): No heartbeat from core client for 30 sec - exiting 08:15:59 (5643): No heartbeat from core client for 30 sec - exiting 08:16:00 (5643): No heartbeat from core client for 30 sec - exiting 08:16:02 (5643): No heartbeat from core client for 30 sec - exiting 08:16:03 (5643): No heartbeat from core client for 30 sec - exiting 08:16:04 (5643): No heartbeat from core client for 30 sec - exiting 08:16:05 (5643): No heartbeat from core client for 30 sec - exiting 08:16:06 (5643): No heartbeat from core client for 30 sec - exiting 08:16:07 (5643): No heartbeat from core client for 30 sec - exiting 08:16:49 (5643): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ydzqko.pja3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqko.pja3c10 Error: Input file: dataout/ydzqko.pia3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqko.pia3c10 Error: Input file: dataout/ydzqko.pfa3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqko.pfa3c10 Error: Input file: dataout/ydzqka.pha3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pha3c10 Error: Input file: dataout/ydzqka.pga3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pga3c10 Error: Input file: dataout/ydzqka.pea3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pea3c10 Error: Input file: dataout/ydzqka.pda3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pda3c10 08:19:58 (7024): No heartbeat from core client for 30 sec - exiting 08:20:14 (7024): No heartbeat from core client for 30 sec - exiting 08:20:15 (7024): No heartbeat from core client for 30 sec - exiting 08:20:16 (7024): No heartbeat from core client for 30 sec - exiting 08:20:17 (7024): No heartbeat from core client for 30 sec - exiting 08:20:18 (7024): No heartbeat from core client for 30 sec - exiting 08:20:19 (7024): No heartbeat from core client for 30 sec - exiting 08:20:20 (7024): No heartbeat from core client for 30 sec - exiting 08:20:21 (7024): No heartbeat from core client for 30 sec - exiting 08:20:22 (7024): No heartbeat from core client for 30 sec - exiting 08:20:23 (7024): No heartbeat from core client for 30 sec - exiting 08:20:24 (7024): No heartbeat from core client for 30 sec - exiting 08:20:25 (7024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ydzqko.pja3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqko.pja3c10 Error: Input file: dataout/ydzqko.pia3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqko.pia3c10 Error: Input file: dataout/ydzqko.pfa3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqko.pfa3c10 Error: Input file: dataout/ydzqka.pha3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pha3c10 Error: Input file: dataout/ydzqka.pga3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pga3c10 Error: Input file: dataout/ydzqka.pea3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pea3c10 Error: Input file: dataout/ydzqka.pda3c10 is not a valid UM file. Error converting file to netcdf: dataout/ydzqka.pda3c10 09:00:01 (7060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:02 (7060): No heartbeat from core client for 30 sec - exiting 09:00:03 (7060): No heartbeat from core client for 30 sec - exiting 09:00:04 (7060): No heartbeat from core client for 30 sec - exiting 09:00:05 (7060): No heartbeat from core client for 30 sec - exiting 09:00:06 (7060): No heartbeat from core client for 30 sec - exiting 09:00:07 (7060): No heartbeat from core client for 30 sec - exiting 09:00:08 (7060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:00:30 (7347): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:08 (15577): No heartbeat from core client for 30 sec - exiting 21:26:17 (15577): No heartbeat from core client for 30 sec - exiting 21:26:18 (15577): No heartbeat from core client for 30 sec - exiting 21:26:19 (15577): No heartbeat from core client for 30 sec - exiting 21:26:20 (15577): No heartbeat from core client for 30 sec - exiting 21:26:21 (15577): No heartbeat from core client for 30 sec - exiting 21:26:22 (15577): No heartbeat from core client for 30 sec - exiting 21:26:23 (15577): No heartbeat from core client for 30 sec - exiting 21:26:24 (15577): No heartbeat from core client for 30 sec - exiting 21:26:25 (15577): No heartbeat from core client for 30 sec - exiting 21:26:26 (15577): No heartbeat from core client for 30 sec - exiting 21:26:27 (15577): No heartbeat from core client for 30 sec - exiting 21:26:28 (15577): No heartbeat from core client for 30 sec - exiting 21:26:29 (15577): No heartbeat from core client for 30 sec - exiting 21:26:30 (15577): No heartbeat from core client for 30 sec - exiting 21:26:50 (15577): No heartbeat from core client for 30 sec - exiting 21:26:51 (15577): No heartbeat from core client for 30 sec - exiting 21:26:52 (15577): No heartbeat from core client for 30 sec - exiting 21:26:53 (15577): No heartbeat from core client for 30 sec - exiting 21:26:54 (15577): No heartbeat from core client for 30 sec - exiting 21:26:55 (15577): No heartbeat from core client for 30 sec - exiting 21:26:56 (15577): No heartbeat from core client for 30 sec - exiting 21:26:57 (15577): No heartbeat from core client for 30 sec - exiting 21:26:58 (15577): No heartbeat from core client for 30 sec - exiting 21:26:59 (15577): No heartbeat from core client for 30 sec - exiting 21:27:00 (15577): No heartbeat from core client for 30 sec - exiting 21:27:01 (15577): No heartbeat from core client for 30 sec - exiting 21:27:02 (15577): No heartbeat from core client for 30 sec - exiting 21:27:33 (15577): No heartbeat from core client for 30 sec - exiting 21:27:34 (15577): No heartbeat from core client for 30 sec - exiting 21:27:35 (15577): No heartbeat from core client for 30 sec - exiting 21:27:36 (15577): No heartbeat from core client for 30 sec - exiting 21:27:37 (15577): No heartbeat from core client for 30 sec - exiting 21:27:38 (15577): No heartbeat from core client for 30 sec - exiting 21:27:39 (15577): No heartbeat from core client for 30 sec - exiting 21:27:40 (15577): No heartbeat from core client for 30 sec - exiting 21:27:41 (15577): No heartbeat from core client for 30 sec - exiting 21:27:42 (15577): No heartbeat from core client for 30 sec - exiting 21:27:59 (15577): No heartbeat from core client for 30 sec - exiting 21:28:00 (15577): No heartbeat from core client for 30 sec - exiting 21:28:01 (15577): No heartbeat from core client for 30 sec - exiting 21:28:02 (15577): No heartbeat from core client for 30 sec - exiting 21:28:03 (15577): No heartbeat from core client for 30 sec - exiting 21:28:04 (15577): No heartbeat from core client for 30 sec - exiting 21:28:05 (15577): No heartbeat from core client for 30 sec - exiting 21:28:06 (15577): No heartbeat from core client for 30 sec - exiting 21:28:07 (15577): No heartbeat from core client for 30 sec - exiting 21:28:08 (15577): No heartbeat from core client for 30 sec - exiting 21:28:09 (15577): No heartbeat from core client for 30 sec - exiting 21:28:10 (15577): No heartbeat from core client for 30 sec - exiting 21:28:11 (15577): No heartbeat from core client for 30 sec - exiting 21:28:12 (15577): No heartbeat from core client for 30 sec - exiting 21:28:13 (15577): No heartbeat from core client for 30 sec - exiting 21:28:14 (15577): No heartbeat from core client for 30 sec - exiting 21:28:15 (15577): No heartbeat from core client for 30 sec - exiting 21:28:16 (15577): No heartbeat from core client for 30 sec - exiting 21:28:17 (15577): No heartbeat from core client for 30 sec - exiting 21:28:18 (15577): No heartbeat from core client for 30 sec - exiting 21:28:19 (15577): No heartbeat from core client for 30 sec - exiting 21:28:20 (15577): No heartbeat from core client for 30 sec - exiting 21:28:21 (15577): No heartbeat from core client for 30 sec - exiting 21:28:22 (15577): No heartbeat from core client for 30 sec - exiting 21:28:23 (15577): No heartbeat from core client for 30 sec - exiting 21:28:24 (15577): No heartbeat from core client for 30 sec - exiting 21:28:25 (15577): No heartbeat from core client for 30 sec - exiting 21:28:26 (15577): No heartbeat from core client for 30 sec - exiting 21:28:27 (15577): No heartbeat from core client for 30 sec - exiting 21:28:28 (15577): No heartbeat from core client for 30 sec - exiting 21:28:29 (15577): No heartbeat from core client for 30 sec - exiting 21:28:30 (15577): No heartbeat from core client for 30 sec - exiting 21:28:31 (15577): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Dec 2011 08:14:46	989980	13542277	hadcm3n_ydzq_1900_40_007518298_1	77,760	110,312	1.4186
05 Dec 2011 20:45:19	989980	13542277	hadcm3n_ydzq_1900_40_007518298_1	51,840	72,241	1.3935
05 Dec 2011 09:00:59	989980	13542277	hadcm3n_ydzq_1900_40_007518298_1	25,920	35,608	1.3738