Task 14671382

Name	hadam3p_pnw_8kvm_2002_1_007700014_2
Workunit	7855122
Created	15 May 2012, 22:27:59 UTC
Sent	15 May 2012, 22:31:24 UTC
Report deadline	28 Apr 2013, 3:51:24 UTC
Received	15 May 2013, 18:41:13 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1038803
Run time	17 days 18 hours 7 min 18 sec
CPU time	10 days 0 hours 41 min 59 sec
Validate state	Workunit error - check skipped
Credit	3,006.44
Device peak FLOPS	2.18 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> exiting, bRetVal = 1, checkPID=0, selfPID=4296, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 16:08:56 (2488): No heartbeat from core client for 30 sec - exiting 16:08:57 (2488): No heartbeat from core client for 30 sec - exiting 16:08:58 (2488): No heartbeat from core client for 30 sec - exiting 16:08:59 (2488): No heartbeat from core client for 30 sec - exiting 16:09:00 (2488): No heartbeat from core client for 30 sec - exiting 16:09:01 (2488): No heartbeat from core client for 30 sec - exiting 16:09:02 (2488): No heartbeat from core client for 30 sec - exiting 16:09:03 (2488): No heartbeat from core client for 30 sec - exiting 16:09:04 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4888, selfPID=4888, iMonCtr=2 19:56:57 (3124): No heartbeat from core client for 30 sec - exiting 19:56:58 (3124): No heartbeat from core client for 30 sec - exiting 19:56:59 (3124): No heartbeat from core client for 30 sec - exiting 19:57:00 (3124): No heartbeat from core client for 30 sec - exiting 19:57:01 (3124): No heartbeat from core client for 30 sec - exiting 19:57:02 (3124): No heartbeat from core client for 30 sec - exiting 19:57:03 (3124): No heartbeat from core client for 30 sec - exiting 19:57:04 (3124): No heartbeat from core client for 30 sec - exiting 19:57:05 (3124): No heartbeat from core client for 30 sec - exiting 19:57:06 (3124): No heartbeat from core client for 30 sec - exiting 19:57:07 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4972, iMonCtr=2 16:15:01 (3840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN processCPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3908, selfPID=3024, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:58:18 (2688): No heartbeat from core client for 30 sec - exiting 19:58:19 (2688): No heartbeat from core client for 30 sec - exiting 19:58:20 (2688): No heartbeat from core client for 30 sec - exiting 19:58:21 (2688): No heartbeat from core client for 30 sec - exiting 19:58:22 (2688): No heartbeat from core client for 30 sec - exiting 19:58:23 (2688): No heartbeat from core client for 30 sec - exiting 19:58:24 (2688): No heartbeat from core client for 30 sec - exiting 19:58:25 (2688): No heartbeat from core client for 30 sec - exiting 19:58:26 (2688): No heartbeat from core client for 30 sec - exiting 19:58:27 (2688): No heartbeat from core client for 30 sec - exiting 19:58:28 (2688): No heartbeat from core client for 30 sec - exiting 19:58:29 (2688): No heartbeat from core client for 30 sec - exiting 19:58:30 (2688): No heartbeat from core client for 30 sec - exiting 19:58:31 (2688): No heartbeat from core client for 30 sec - exiting 19:58:32 (2688): No heartbeat from core client for 30 sec - exiting 19:58:33 (2688): No heartbeat from core client for 30 sec - exiting 19:58:34 (2688): No heartbeat from core client for 30 sec - exiting 19:58:35 (2688): No heartbeat from core client for 30 sec - exiting 19:58:36 (2688): No heartbeat from core client for 30 sec - exiting 19:58:37 (2688): No heartbeat from core client for 30 sec - exiting 19:58:38 (2688): No heartbeat from core client for 30 sec - exiting 19:58:39 (2688): No heartbeat from core client for 30 sec - exiting 19:58:40 (2688): No heartbeat from core client for 30 sec - exiting 19:58:41 (2688): No heartbeat from core client for 30 sec - exiting 19:58:42 (2688): No heartbeat from core client for 30 sec - exiting 19:58:43 (2688): No heartbeat from core client for 30 sec - exiting 19:58:44 (2688): No heartbeat from core client for 30 sec - exiting 19:58:45 (2688): No heartbeat from core client for 30 sec - exiting 19:58:46 (2688): No heartbeat from core client for 30 sec - exiting 19:58:47 (2688): No heartbeat from core client for 30 sec - exiting 19:58:48 (2688): No heartbeat from core client for 30 sec - exiting 19:58:49 (2688): No heartbeat from core client for 30 sec - exiting 19:58:50 (2688): No heartbeat from core client for 30 sec - exiting 19:58:51 (2688): No heartbeat from core client for 30 sec - exiting 19:58:52 (2688): No heartbeat from core client for 30 sec - exiting 19:58:53 (2688): No heartbeat from core client for 30 sec - exiting 19:58:54 (2688): No heartbeat from core client for 30 sec - exiting 19:58:55 (2688): No heartbeat from core client for 30 sec - exiting 19:58:56 (2688): No heartbeat from core client for 30 sec - exiting 19:58:57 (2688): No heartbeat from core client for 30 sec - exiting 19:58:58 (2688): No heartbeat from core client for 30 sec - exiting 19:58:59 (2688): No heartbeat from core client for 30 sec - exiting 19:59:00 (2688): No heartbeat from core client for 30 sec - exiting 19:59:01 (2688): No heartbeat from core client for 30 sec - exiting 19:59:02 (2688): No heartbeat from core client for 30 sec - exiting 19:59:04 (2688): No heartbeat from core client for 30 sec - exiting 19:59:05 (2688): No heartbeat from core client for 30 sec - exiting 19:59:06 (2688): No heartbeat from core client for 30 sec - exiting 19:59:07 (2688): No heartbeat from core client for 30 sec - exiting 19:59:08 (2688): No heartbeat from core client for 30 sec - exiting 19:59:09 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=808, iMonCtr=2 Model crash detected, will try to restart... 16:01:23 (1204): No heartbeat from core client for 30 sec - exiting 16:01:24 (1204): No heartbeat from core client for 30 sec - exiting 16:01:25 (1204): No heartbeat from core client for 30 sec - exiting 16:01:26 (1204): No heartbeat from core client for 30 sec - exiting 16:01:27 (1204): No heartbeat from core client for 30 sec - exiting 16:01:28 (1204): No heartbeat from core client for 30 sec - exiting 16:01:29 (1204): No heartbeat from core client for 30 sec - exiting 16:01:30 (1204): No heartbeat from core client for 30 sec - exiting 16:01:31 (1204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process 21:11:19 (1284): No heartbeat from core client for 30 sec - exiting 21:11:21 (1284): No heartbeat from core client for 30 sec - exiting 21:11:22 (1284): No heartbeat from core client for 30 sec - exiting 21:11:23 (1284): No heartbeat from core client for 30 sec - exiting 21:11:24 (1284): No heartbeat from core client for 30 sec - exiting 21:11:25 (1284): No heartbeat from core client for 30 sec - exiting 21:11:26 (1284): No heartbeat from core client for 30 sec - exiting 21:11:27 (1284): No heartbeat from core client for 30 sec - exiting 21:11:28 (1284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:42:26 (3440): No heartbeat from core client for 30 sec - exiting 22:42:27 (3440): No heartbeat from core client for 30 sec - exiting 22:42:28 (3440): No heartbeat from core client for 30 sec - exiting 22:42:29 (3440): No heartbeat from core client for 30 sec - exiting 22:42:30 (3440): No heartbeat from core client for 30 sec - exiting 22:42:31 (3440): No heartbeat from core client for 30 sec - exiting 22:42:33 (3440): No heartbeat from core client for 30 sec - exiting 22:42:34 (3440): No heartbeat from core client for 30 sec - exiting 22:42:35 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5828, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:48:05 (4476): No heartbeat from core client for 30 sec - exiting 17:48:06 (4476): No heartbeat from core client for 30 sec - exiting 17:48:07 (4476): No heartbeat from core client for 30 sec - exiting 17:48:08 (4476): No heartbeat from core client for 30 sec - exiting 17:48:09 (4476): No heartbeat from core client for 30 sec - exiting 17:48:10 (4476): No heartbeat from core client for 30 sec - exiting 17:48:11 (4476): No heartbeat from core client for 30 sec - exiting 17:48:12 (4476): No heartbeat from core client for 30 sec - exiting 17:48:13 (4476): No heartbeat from core client for 30 sec - exiting 17:48:14 (4476): No heartbeat from core client for 30 sec - exiting 17:48:16 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6128, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4616, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5364, selfPID=1932, iMonCtr=1 Model crash detected, will try to restart... 22:53:36 (2712): No heartbeat from core client for 30 sec - exiting 22:53:37 (2712): No heartbeat from core client for 30 sec - exiting 22:53:38 (2712): No heartbeat from core client for 30 sec - exiting 22:53:39 (2712): No heartbeat from core client for 30 sec - exiting 22:53:40 (2712): No heartbeat from core client for 30 sec - exiting 22:53:41 (2712): No heartbeat from core client for 30 sec - exiting 22:53:42 (2712): No heartbeat from core client for 30 sec - exiting 22:53:43 (2712): No heartbeat from core client for 30 sec - exiting 22:53:44 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4996, selfPID=4768, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5512, selfPID=5512, iMonCtr=2 18:12:46 (1724): No heartbeat from core client for 30 sec - exiting 18:12:47 (1724): No heartbeat from core client for 30 sec - exiting 18:12:48 (1724): No heartbeat from core client for 30 sec - exiting 18:12:49 (1724): No heartbeat from core client for 30 sec - exiting 18:12:50 (1724): No heartbeat from core client for 30 sec - exiting 18:12:51 (1724): No heartbeat from core client for 30 sec - exiting 18:12:52 (1724): No heartbeat from core client for 30 sec - exiting 18:12:53 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5516, selfPID=5516, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1288, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2952, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:31:28 (1132): No heartbeat from core client for 30 sec - exiting 21:31:30 (1132): No heartbeat from core client for 30 sec - exiting 21:31:31 (1132): No heartbeat from core client for 30 sec - exiting 21:31:32 (1132): No heartbeat from core client for 30 sec - exiting 21:31:33 (1132): No heartbeat from core client for 30 sec - exiting 21:31:34 (1132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:19 (1040): No heartbeat from core client for 30 sec - exiting 21:43:21 (1040): No heartbeat from core client for 30 sec - exiting 21:43:22 (1040): No heartbeat from core client for 30 sec - exiting 21:43:23 (1040): No heartbeat from core client for 30 sec - exiting 21:43:24 (1040): No heartbeat from core client for 30 sec - exiting 21:43:25 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5164, selfPID=5164, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4660, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5316, selfPID=2960, iMonCtr=1 Model crash detected, will try to restart... 17:29:36 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2776, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:07:39 (3292): No heartbeat from core client for 30 sec - exiting 14:07:40 (3292): No heartbeat from core client for 30 sec - exiting 14:07:41 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4632, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4668, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5596, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4320, selfPID=2624, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 23:33:20 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5372, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... 19:01:48 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5636, selfPID=5636, iMonCtr=2 19:18:06 (3652): No heartbeat from core client for 30 sec - exiting 19:18:07 (3652): No heartbeat from core client for 30 sec - exiting 19:18:08 (3652): No heartbeat from core client for 30 sec - exiting 19:18:09 (3652): No heartbeat from core client for 30 sec - exiting 19:18:11 (3652): No heartbeat from core client for 30 sec - exiting 19:18:12 (3652): No heartbeat from core client for 30 sec - exiting 19:18:13 (3652): No heartbeat from core client for 30 sec - exiting 19:18:14 (3652): No heartbeat from core client for 30 sec - exiting 19:18:15 (3652): No heartbeat from core client for 30 sec - exiting 19:18:16 (3652): No heartbeat from core client for 30 sec - exiting 19:18:17 (3652): No heartbeat from core client for 30 sec - exiting 19:18:18 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5168, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5176, selfPID=5140, iMonGGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 15:59:43 (2800): No heartbeat from core client for 30 sec - exiting 15:59:44 (2800): No heartbeat from core client for 30 sec - exiting 15:59:45 (2800): No heartbeat from core client for 30 sec - exiting 15:59:46 (2800): No heartbeat from core client for 30 sec - exiting 15:59:47 (2800): No heartbeat from core client for 30 sec - exiting 15:59:48 (2800): No heartbeat from core client for 30 sec - exiting 15:59:49 (2800): No heartbeat from core client for 30 sec - exiting 15:59:50 (2800): No heartbeat from core client for 30 sec - exiting 15:59:51 (2800): No heartbeat from core client for 30 sec - exiting 15:59:52 (2800): No heartbeat from core client for 30 sec - exiting 15:59:53 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:35:23 (3536): No heartbeat from core client for 30 sec - exiting 21:35:24 (3536): No heartbeat from core client for 30 sec - exiting 21:35:25 (3536): No heartbeat from core client for 30 sec - exiting 21:35:26 (3536): No heartbeat from core client for 30 sec - exiting 21:35:28 (3536): No heartbeat from core client for 30 sec - exiting 21:35:29 (3536): No heartbeat from core client for 30 sec - exiting 21:35:30 (3536): No heartbeat from core client for 30 sec - exiting 21:35:31 (3536): No heartbeat from core client for 30 sec - exiting 21:35:32 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5836, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5740, iMonCtr=2 Model crash detected, will try to restart... 14:39:17 (3232): No heartbeat from core client for 30 sec - exiting 14:39:18 (3232): No heartbeat from core client for 30 sec - exiting 14:39:19 (3232): No heartbeat from core client for 30 sec - exiting 14:39:20 (3232): No heartbeat from core client for 30 sec - exiting 14:39:21 (3232): No heartbeat from core client for 30 sec - exiting 14:39:22 (3232): No heartbeat from core client for 30 sec - exiting 14:39:23 (3232): No heartbeat from core client for 30 sec - exiting 14:39:24 (3232): No heartbeat from core client for 30 sec - exiting 14:39:25 (3232): No heartbeat from core client for 30 sec - exiting 14:39:26 (3232): No heartbeat from core client for 30 sec - exiting 14:39:27 (3232): No heartbeat from core client for 30 sec - exiting 14:39:28 (3232): No heartbeat from core client for 30 sec - exiting 14:39:30 (3232): No heartbeat from core client for 30 sec - exiting 14:39:31 (3232): No heartbeat from core client for 30 sec - exiting 14:39:32 (3232): No heartbeat from core client for 30 sec - exiting 14:39:33 (3232): No heartbeat from core client for 30 sec - exiting 14:39:34 (3232): No heartbeat from core client for 30 sec - exiting 14:39:35 (3232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6120, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6040, selfPID=4320, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5680, selfPID=4720, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 13:07:01 (5180): No heartbeat from core client for 30 sec - exiting 13:07:02 (5180): No heartbeat from core client for 30 sec - exiting 13:07:03 (5180): No heartbeat from core client for 30 sec - exiting 13:07:04 (5180): No heartbeat from core client for 30 sec - exiting 13:07:05 (5180): No heartbeat from core client for 30 sec - exiting 13:07:06 (5180): No heartbeat from core client for 30 sec - exiting 13:07:07 (5180): No heartbeat from core client for 30 sec - exiting 13:07:08 (5180): No heartbeat from core client for 30 sec - exiting 13:07:09 (5180): No heartbeat from core client for 30 sec - exiting 13:07:10 (5180): No heartbeat from core client for 30 sec - exiting 13:07:11 (5180): No heartbeat from core client for 30 sec - exiting 13:07:12 (5180): No heartbeat from core client for 30 sec - exiting 13:07:13 (5180): No heartbeat from core client for 30 sec - exiting 13:07:14 (5180): No heartbeat from core client for 30 sec - exiting 13:07:15 (5180): No heartbeat from core client for 30 sec - exiting 13:07:16 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5084, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5092, selfPID=168, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1652, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2084, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5500, selfPID=3404, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 15:28:59 (1320): No heartbeat from core client for 30 sec - exiting 15:29:00 (1320): No heartbeat from core client for 30 sec - exiting 15:29:01 (1320): No heartbeat from core client for 30 sec - exiting 15:29:02 (1320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3368, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 19:48:45 (2288): No heartbeat from core client for 30 sec - exiting 19:48:46 (2288): No heartbeat from core client for 30 sec - exiting 19:48:47 (2288): No heartbeat from core client for 30 sec - exiting 19:48:48 (2288): No heartbeat from core client for 30 sec - exiting 19:48:49 (2288): No heartbeat from core client for 30 sec - exiting 19:48:50 (2288): No heartbeat from core client for 30 sec - exiting 19:48:51 (2288): No heartbeat from core client for 30 sec - exiting 19:48:52 (2288): No heartbeat from core client for 30 sec - exiting 19:48:53 (2288): No heartbeat from core client for 30 sec - exiting 19:48:54 (2288): No heartbeat from core client for 30 sec - exiting 19:48:55 (2288): No heartbeat from core client for 30 sec - exiting 19:48:56 (2288): No heartbeat from core client for 30 sec - exiting 19:48:57 (2288): No heartbeat from core client for 30 sec - exiting 19:48:58 (2288): No heartbeat from core client for 30 sec - exiting 19:48:59 (2288): No heartbeat from core client for 30 sec - exiting 19:49:00 (2288): No heartbeat from core client for 30 sec - exiting 19:49:01 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4480, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4292, iMonCtr=2 Model crash detected, will try to restart... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5868, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4352, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4232, selfPID=4136, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4204, iMonCtr=2 Model crash detected, will try to restart... 17:51:52 (2376): No heartbeat from core client for 30 sec - exiting 17:51:54 (2376): No heartbeat from core client for 30 sec - exiting 17:51:55 (2376): No heartbeat from core client for 30 sec - exiting 17:51:56 (2376): No heartbeat from core client for 30 sec - exiting 17:51:57 (2376): No heartbeat from core client for 30 sec - exiting 17:51:58 (2376): No heartbeat from core client for 30 sec - exiting 17:51:59 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5772, selfPID=2904, iMonCtr=1 Model crash detected, will try to restart... CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4508, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6080, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4592, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4232, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5816, selfPID=581Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3960, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5680, iMonCtr= 2 del crash detected, will try to restart... 16:52:58 (2980): No heartbeat from core client for 30 sec - exiting 16:52:59 (2980): No heartbeat from core client for 30 sec - exiting 16:53:00 (2980): No heartbeat from core client for 30 sec - exiting 16:53:01 (2980): No heartbeat from core client for 30 sec - exiting 16:53:02 (2980): No heartbeat from core client for 30 sec - exiting 16:53:03 (2980): No heartbeat from core client for 30 sec - exiting 16:53:04 (2980): No heartbeat from core client for 30 sec - exiting 16:53:05 (2980): No heartbeat from core client for 30 sec - exiting 16:53:06 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6112, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4460, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5480, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 16:08:59 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4420, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process iController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2672, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3452, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6108, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5520, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... 20:02:11 (2480): No heartbeat from core client for 30 sec - exiting 20:02:12 (2480): No heartbeat from core client for 30 sec - exiting 20:02:13 (2480): No heartbeat from core client for 30 sec - exiting 20:02:14 (2480): No heartbeat from core client for 30 sec - exiting 20:02:15 (2480): No heartbeat from core client for 30 sec - exiting 20:02:16 (2480): No heartbeat from core client for 30 sec - exiting 20:02:17 (2480): No heartbeat from core client for 30 sec - exiting 20:02:18 (2480): No heartbeat from core client for 30 sec - exiting 20:02:19 (2480): No heartbeat from core client for 30 sec - exiting 20:02:20 (2480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:18 (3264): No heartbeat from core client for 30 sec - exiting 00:23:20 (3264): No heartbeat from core client for 30 sec - exiting 00:23:21 (3264): No heartbeat from core client for 30 sec - exiting 00:23:22 (3264): No heartbeat from core client for 30 sec - exiting 00:23:23 (3264): No heartbeat from core client for 30 sec - exiting 00:23:24 (3264): No heartbeat from core client for 30 sec - exiting 00:23:25 (3264): No heartbeat from core client for 30 sec - exiting 00:23:26 (3264): No heartbeat from core client for 30 sec - exiting 00:23:27 (3264): No heartbeat from core client for 30 sec - exiting 00:23:28 (3264): No heartbeat from core client for 30 sec - exiting 00:23:29 (3264): No heartbeat from core client for 30 sec - exiting 00:23:30 (3264): No heartbeat from core client for 30 sec - exiting 00:23:31 (3264): No heartbeat from core client for 30 sec - exiting 00:23:32 (3264): No heartbeat from core client for 30 sec - exiting 00:23:33 (3264): No heartbeat from core client for 30 sec - exiting 00:23:35 (3264): No heartbeat from core client for 30 sec - exiting 00:23:36 (3264): No heartbeat from core client for 30 sec - exiting 00:23:37 (3264): No heartbeat from core client for 30 sec - exiting 00:23:38 (3264): No heartbeat from core client for 30 sec - exiting 00:23:39 (3264): No heartbeat from core client for 30 sec - exiting 00:23:40 (3264): No heartbeat from core client for 30 sec - exiting 00:23:41 (3264): No heartbeat from core client for 30 sec - exiting 00:23:42 (3264): No heartbeat from core client for 30 sec - exiting 00:23:43 (3264): No heartbeat from core client for 30 sec - exiting 00:23:44 (3264): No heartbeat from core client for 30 sec - exiting 00:23:45 (3264): No heartbeat from core client for 30 sec - exiting 00:23:46 (3264): No heartbeat from core client for 30 sec - exiting 00:23:47 (3264): No heartbeat from core client for 30 sec - exiting 00:23:48 (3264): No heartbeat from core client for 30 sec - exiting 00:23:49 (3264): No heartbeat from core client for 30 sec - exiting 00:23:50 (3264): No heartbeat from core client for 30 sec - exiting 00:23:51 (3264): No heartbeat from core client for 30 sec - exiting 00:23:52 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:40 (1256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4808, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3608, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6004, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4552, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 12:33:46 (4032): No heartbeat from core client for 30 sec - exiting 12:33:47 (4032): No heartbeat from core client for 30 sec - exiting 12:33:48 (4032): No heartbeat from core client for 30 sec - exiting 12:33:49 (4032): No heartbeat from core client for 30 sec - exiting 12:33:50 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5608, iMonCtr=2 Model crash detected, will try to restart... 17:03:55 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5988, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4204, selfPID=4224, iMonCtr=1 Model crash detected, will try to restart... 15:11:45 (3872): No heartbeat from core client for 30 sec - exiting 15:11:46 (3872): No heartbeat from core client for 30 sec - exiting 15:11:47 (3872): No heartbeat from core client for 30 sec - exiting 15:11:48 (3872): No heartbeat from core client for 30 sec - exiting 15:11:49 (3872): No heartbeat from core client for 30 sec - exiting 15:11:50 (3872): No heartbeat from core client for 30 sec - exiting 15:11:51 (3872): No heartbeat from core client for 30 sec - exiting 15:11:52 (3872): No heartbeat from core client for 30 sec - exiting 15:11:53 (3872): No heartbeat from core client for 30 sec - exiting 15:11:54 (3872): No heartbeat from core client for 30 sec - exiting 15:11:56 (3872): No heartbeat from core client for 30 sec - exiting 15:11:57 (3872): No heartbeat from core client for 30 sec - exiting 15:11:58 (3872): No heartbeat from core client for 30 sec - exiting 15:11:59 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:16 (2896): No heartbeat from core client for 30 sec - exiting 18:25:17 (2896): No heartbeat from core client for 30 sec - exiting 18:25:18 (2896): No heartbeat from core client for 30 sec - exiting 18:25:19 (2896): No heartbeat from core client for 30 sec - exiting 18:25:20 (2896): No heartbeat from core client for 30 sec - exiting 18:25:21 (2896): No heartbeat from core client for 30 sec - exiting 18:25:22 (2896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5320, selfPID=3684, iMonCtr=1 Model crash detected, will try to restart... 16:15:00 (2084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3180, iMonCtr=2 Model crash detected, will try to restart... 18:57:13 (2244): No heartbeat from core client for 30 sec - exiting 18:57:14 (2244): No heartbeat from core client for 30 sec - exiting 18:57:15 (2244): No heartbeat from core client for 30 sec - exiting 18:57:16 (2244): No heartbeat from core client for 30 sec - exiting 18:57:17 (2244): No heartbeat from core client for 30 sec - exiting 18:57:18 (2244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:10 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4788, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3636, iMonCtr=2 Model crash detected, will try to restart... 15:23:59 (3312): No heartbeat from core client for 30 sec - exiting 15:24:00 (3312): No heartbeat from core client for 30 sec - exiting 15:24:01 (3312): No heartbeat from core client for 30 sec - exiting 15:24:02 (3312): No heartbeat from core client for 30 sec - exiting 15:24:03 (3312): No heartbeat from core client for 30 sec - exiting 15:24:04 (3312): No heartbeat from core client for 30 sec - exiting 15:24:06 (3312): No heartbeat from core client for 30 sec - exiting 15:24:07 (3312): No heartbeat from core client for 30 sec - exiting 15:24:08 (3312): No heartbeat from core client for 30 sec - exiting 15:24:09 (3312): No heartbeat from core client for 30 sec - exiting 15:24:10 (3312): No heartbeat from core client for 30 sec - exiting 15:24:11 (3312): No heartbeat from core client for 30 sec - exiting 15:24:12 (3312): No heartbeat from core client for 30 sec - exiting 15:24:13 (3312): No heartbeat from core client for 30 sec - exiting 15:24:14 (3312): No heartbeat from core client for 30 sec - exiting 15:24:15 (3312): No heartbeat from core client for 30 sec - exiting 15:24:16 (3312): No heartbeat from core client for 30 sec - exiting 15:24:17 (3312): No heartbeat from core client for 30 sec - exiting 15:24:18 (3312): No heartbeat from core client for 30 sec - exiting 15:24:19 (3312): No heartbeat from core client for 30 sec - exiting 15:24:20 (3312): No heartbeat from core client for 30 sec - exiting 15:24:21 (3312): No heartbeat from core client for 30 sec - exiting 15:24:22 (3312): No heartbeat from core client for 30 sec - exiting 15:24:23 (3312): No heartbeat from core client for 30 sec - exiting 15:24:24 (3312): No heartbeat from core client for 30 sec - exiting 15:24:25 (3312): No heartbeat from core client for 30 sec - exiting 15:24:26 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:03 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:48 (3096): No heartbeat from core client for 30 sec - exiting 15:56:49 (3096): No heartbeat from core client for 30 sec - exiting 15:56:50 (3096): No heartbeat from core client for 30 sec - exiting 15:56:51 (3096): No heartbeat from core client for 30 sec - exiting 15:56:53 (3096): No heartbeat from core client for 30 sec - exiting 15:56:54 (3096): No heartbeat from core client for 30 sec - exiting 15:56:55 (3096): No heartbeat from core client for 30 sec - exiting 15:56:56 (3096): No heartbeat from core client for 30 sec - exiting 15:56:57 (3096): No heartbeat from core client for 30 sec - exiting 15:56:58 (3096): No heartbeat from core client for 30 sec - exiting 15:56:59 (3096): No heartbeat from core client for 30 sec - exiting 15:57:00 (3096): No heartbeat from core client for 30 sec - exiting 15:57:01 (3096): No heartbeat from core client for 30 sec - exiting 15:57:02 (3096): No heartbeat from core client for 30 sec - exiting 15:57:03 (3096): No heartbeat from core client for 30 sec - exiting 15:57:04 (3096): No heartbeat from core client for 30 sec - exiting 15:57:05 (3096): No heartbeat from core client for 30 sec - exiting 15:57:06 (3096): No heartbeat from core client for 30 sec - exiting 15:57:07 (3096): No heartbeat from core client for 30 sec - exiting 15:57:08 (3096): No heartbeat from core client for 30 sec - exiting 15:57:09 (3096): No heartbeat from core client for 30 sec - exiting 15:57:10 (3096): No heartbeat from core client for 30 sec - exiting 15:57:11 (3096): No heartbeat from core client for 30 sec - exiting 15:57:12 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:19:13 (5064): No heartbeat from core client for 30 sec - exiting 16:19:14 (5064): No heartbeat from core client for 30 sec - exiting 16:19:15 (5064): No heartbeat from core client for 30 sec - exiting 16:19:16 (5064): No heartbeat from core client for 30 sec - exiting 16:19:17 (5064): No heartbeat from core client for 30 sec - exiting 16:19:18 (5064): No heartbeat from core client for 30 sec - exiting 16:19:19 (5064): No heartbeat from core client for 30 sec - exiting 16:19:20 (5064): No heartbeat from core client for 30 sec - exiting 16:19:22 (5064): No heartbeat from core client for 30 sec - exiting 16:19:23 (5064): No heartbeat from core client for 30 sec - exiting 16:19:24 (5064): No heartbeat from core client for 30 sec - exiting 16:19:25 (5064): No heartbeat from core client for 30 sec - exiting 16:19:26 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:05 (4152): No heartbeat from core client for 30 sec - exiting 19:39:07 (4152): No heartbeat from core client for 30 sec - exiting 19:39:08 (4152): No heartbeat from core client for 30 sec - exiting 19:39:09 (4152): No heartbeat from core client for 30 sec - exiting 19:39:10 (4152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2004, iMonCtr=2 Mode l crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5100, selfPID=3204, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3940, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 22:57:30 (2556): No heartbeat from core client for 30 sec - exiting 22:57:31 (2556): No heartbeat from core client for 30 sec - exiting 22:57:32 (2556): No heartbeat from core client for 30 sec - exiting 22:57:33 (2556): No heartbeat from core client for 30 sec - exiting 22:57:34 (2556): No heartbeat from core client for 30 sec - exiting 22:57:35 (2556): No heartbeat from core client for 30 sec - exiting 22:57:36 (2556): No heartbeat from core client for 30 sec - exiting 22:57:38 (2556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:35 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:55 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:16:33 (3060): No heartbeat from core client for 30 sec - exiting 00:16:35 (3060): No heartbeat from core client for 30 sec - exiting 00:16:36 (3060): No heartbeat from core client for 30 sec - exiting 00:16:37 (3060): No heartbeat from core client for 30 sec - exiting 00:16:38 (3060): No heartbeat from core client for 30 sec - exiting 00:16:39 (3060): No heartbeat from core client for 30 sec - exiting 00:16:40 (3060): No heartbeat from core client for 30 sec - exiting 00:16:41 (3060): No heartbeat from core client for 30 sec - exiting 00:16:42 (3060): No heartbeat from core client for 30 sec - exiting 00:16:43 (3060): No heartbeat from core client for 30 sec - exiting 00:16:44 (3060): No heartbeat from core client for 30 sec - exiting 00:16:45 (3060): No heartbeat from core client for 30 sec - exiting 00:16:46 (3060): No heartbeat from core client for 30 sec - exiting 00:16:47 (3060): No heartbeat from core client for 30 sec - exiting 00:16:48 (3060): No heartbeat from core client for 30 sec - exiting 00:16:49 (3060): No heartbeat from core client for 30 sec - exiting 00:16:50 (3060): No heartbeat from core client for 30 sec - exiting 00:16:51 (3060): No heartbeat from core client for 30 sec - exiting 00:16:52 (3060): No heartbeat from core client for 30 sec - exiting 00:16:53 (3060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5500, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5560, selfPID=4112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3272, selfPID=3880, iMonCtr=1 Model crash detected, will try to restart... 18:18:22 (2120): No heartbeat from core client for 30 sec - exiting 18:18:23 (2120): No heartbeat from core client for 30 sec - exiting 18:18:24 (2120): No heartbeat from core client for 30 sec - exiting 18:18:25 (2120): No heartbeat from core client for 30 sec - exiting 18:18:26 (2120): No heartbeat from core client for 30 sec - exiting 18:18:27 (2120): No heartbeat from core client for 30 sec - exiting 18:18:28 (2120): No heartbeat from core client for 30 sec - exiting 18:18:29 (2120): No heartbeat from core client for 30 sec - exiting 18:18:30 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=688, iMonCtr=2 odel crash detected, will try to restart... Leaving CPDN_Main::Monitor... 19:49:17 (1948): No heartbeat from core client for 30 sec - exiting 19:49:18 (1948): No heartbeat from core client for 30 sec - exiting 19:49:19 (1948): No heartbeat from core client for 30 sec - exiting 19:49:20 (1948): No heartbeat from core client for 30 sec - exiting 19:49:21 (1948): No heartbeat from core client for 30 sec - exiting 19:49:22 (1948): No heartbeat from core client for 30 sec - exiting 19:49:23 (1948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5048, iMonCtr=2 20:14:23 (920): No heartbeat from core client for 30 sec - exiting 20:14:25 (920): No heartbeat from core client for 30 sec - exiting 20:14:26 (920): No heartbeat from core client for 30 sec - exiting 20:14:27 (920): No heartbeat from core client for 30 sec - exiting 20:14:28 (920): No heartbeat from core client for 30 sec - exiting 20:14:29 (920): No heartbeat from core client for 30 sec - exiting 20:14:30 (920): No heartbeat from core client for 30 sec - exiting 20:14:31 (920): No heartbeat from core client for 30 sec - exiting 20:14:32 (920): No heartbeat from core client for 30 sec - exiting 20:14:33 (920): No heartbeat from core client for 30 sec - exiting 20:14:34 (920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:42 (4092): No heartbeat from core client for 30 sec - exiting 20:56:43 (4092): No heartbeat from core client for 30 sec - exiting 20:56:44 (4092): No heartbeat from core client for 30 sec - exiting 20:56:45 (4092): No heartbeat from core client for 30 sec - exiting 20:56:46 (4092): No heartbeat from core client for 30 sec - exiting 20:56:47 (4092): No heartbeat from core client for 30 sec - exiting 20:56:48 (4092): No heartbeat from core client for 30 sec - exiting 20:56:49 (4092): No heartbeat from core client for 30 sec - exiting 20:56:50 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=2 Model crash detected, will try to restart... 21:40:52 (3152): No heartbeat from core client for 30 sec - exiting 21:40:54 (3152): No heartbeat from core client for 30 sec - exiting 21:40:55 (3152): No heartbeat from core client for 30 sec - exiting 21:40:56 (3152): No heartbeat from core client for 30 sec - exiting 21:40:57 (3152): No heartbeat from core client for 30 sec - exiting 21:40:58 (3152): No heartbeat from core client for 30 sec - exiting 21:40:59 (3152): No heartbeat from core client for 30 sec - exiting 21:41:00 (3152): No heartbeat from core client for 30 sec - exiting 21:41:01 (3152): No heartbeat from core client for 30 sec - exiting 21:41:02 (3152): No heartbeat from core client for 30 sec - exiting 21:41:03 (3152): No heartbeat from core client for 30 sec - exiting 21:41:04 (3152): No heartbeat from core client for 30 sec - exiting 21:41:05 (3152): No heartbeat from core client for 30 sec - exiting 21:41:06 (3152): No heartbeat from core client for 30 sec - exiting 21:41:07 (3152): No heartbeat from core client for 30 sec - exiting 21:41:08 (3152): No heartbeat from core client for 30 sec - exiting 21:41:09 (3152): No heartbeat from core client for 30 sec - exiting 21:41:10 (3152): No heartbeat from core client for 30 sec - exiting 21:41:11 (3152): No heartbeat from core client for 30 sec - exiting 21:41:12 (3152): No heartbeat from core client for 30 sec - exiting 21:41:13 (3152): No heartbeat from core client for 30 sec - exiting 21:41:14 (3152): No heartbeat from core client for 30 sec - exiting 21:41:15 (3152): No heartbeat from core client for 30 sec - exiting 21:41:16 (3152): No heartbeat from core client for 30 sec - exiting 21:41:17 (3152): No heartbeat from core client for 30 sec - exiting 21:41:18 (3152): No heartbeat from core client for 30 sec - exiting 21:41:19 (3152): No heartbeat from core client for 30 sec - exiting 21:41:20 (3152): No heartbeat from core client for 30 sec - exiting 21:41:21 (3152): No heartbeat from core client for 30 sec - exiting 21:41:22 (3152): No heartbeat from core client for 30 sec - exiting 21:41:23 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:21 (1804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4100, selfPID=5020, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3312, selfPID=1052, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3592, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3160, iMonCtr=2 Model crash detected, will try to restart... 20:20:36 (1052): No heartbeat from core client for 30 sec - exiting 20:20:37 (1052): No heartbeat from core client for 30 sec - exiting 20:20:38 (1052): No heartbeat from core client for 30 sec - exiting 20:20:39 (1052): No heartbeat from core client for 30 sec - exiting 20:20:40 (1052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:41 (1052): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2904, iMonCtr=2 Model crash detected, will try to restart... 23:56:57 (2652): No heartbeat from core client for 30 sec - exiting 23:56:58 (2652): No heartbeat from core client for 30 sec - exiting 23:56:59 (2652): No heartbeat from core client for 30 sec - exiting 23:57:00 (2652): No heartbeat from core client for 30 sec - exiting 23:57:01 (2652): No heartbeat from core client for 30 sec - exiting 23:57:02 (2652): No heartbeat from core client for 30 sec - exiting 23:57:03 (2652): No heartbeat from core client for 30 sec - exiting 23:57:04 (2652): No heartbeat from core client for 30 sec - exiting 23:57:05 (2652): No heartbeat from core client for 30 sec - exiting 23:57:06 (2652): No heartbeat from core client for 30 sec - exiting 23:57:07 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:18 (2160): Can't acquire lockfile (32) - waiting 35s 17:05:01 (3880): No heartbeat from core client for 30 sec - exiting 17:05:02 (3880): No heartbeat from core client for 30 sec - exiting 17:05:03 (3880): No heartbeat from core client for 30 sec - exiting 17:05:04 (3880): No heartbeat from core client for 30 sec - exiting 17:05:05 (3880): No heartbeat from core client for 30 sec - exiting 17:05:06 (3880): No heartbeat from core client for 30 sec - exiting 17:05:07 (3880): No heartbeat from core client for 30 sec - exiting 17:05:08 (3880): No heartbeat from core client for 30 sec - exiting 17:05:09 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:44 (1536): No heartbeat from core client for 30 sec - exiting 18:58:45 (1536): No heartbeat from core client for 30 sec - exiting 18:58:46 (1536): No heartbeat from core client for 30 sec - exiting 18:58:47 (1536): No heartbeat from core client for 30 sec - exiting 18:58:48 (1536): No heartbeat from core client for 30 sec - exiting 18:58:49 (1536): No heartbeat from core client for 30 sec - exiting 18:58:50 (1536): No heartbeat from core client for 30 sec - exiting 18:58:51 (1536): No heartbeat from core client for 30 sec - exiting 18:58:52 (1536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2288, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1396, iMonCtr=2 Model crash detected, will try to restart... 19:32:08 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2700, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3376, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3388, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5468, iMonCtr=2 20:12:37 (6064): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4996, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 00:37:19 (5392): start_timer_thread(): CreateThread() failed, errno 0 01:00:03 (4956): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4956, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3508, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3764, selfPID=2412, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 01:01:50 (2412): No heartbeat from core client for 30 sec - exiting 01:01:52 (2412): No heartbeat from core client for 30 sec - exiting 01:01:53 (2412): No heartbeat from core client for 30 sec - exiting 01:01:54 (2412): No heartbeat from core client for 30 sec - exiting 01:01:55 (2412): No heartbeat from core client for 30 sec - exiting 01:01:56 (2412): No heartbeat from core client for 30 sec - exiting 01:01:57 (2412): No heartbeat from core client for 30 sec - exiting 17:55:01 (5440): No heartbeat from core client for 30 sec - exiting 17:55:02 (5440): No heartbeat from core client for 30 sec - exiting 17:55:03 (5440): No heartbeat from core client for 30 sec - exiting 17:55:04 (5440): No heartbeat from core client for 30 sec - exiting 17:55:05 (5440): No heartbeat from core client for 30 sec - exiting 17:55:06 (5440): No heartbeat from core client for 30 sec - exiting 17:55:07 (5440): No heartbeat from core client for 30 sec - exiting 17:55:08 (5440): No heartbeat from core client for 30 sec - exiting 17:55:09 (5440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:56:31 (5320): Can't acquire lockfile (32) - waiting 35s 18:06:57 (4160): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5156, selfPID=4552, iMonCtr=1 Model crash detected, will try to restart... 18:03:54 (4944): No heartbeat from core client for 30 sec - exiting 18:03:55 (4944): No heartbeat from core client for 30 sec - exiting 18:03:56 (4944): No heartbeat from core client for 30 sec - exiting 18:03:57 (4944): No heartbeat from core client for 30 sec - exiting 18:03:58 (4944): No heartbeat from core client for 30 sec - exiting 18:03:59 (4944): No heartbeat from core client for 30 sec - exiting 18:04:00 (4944): No heartbeat from core client for 30 sec - exiting 18:04:01 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=2 118:20:28 (4220): start_timer_thread(): CreateThread() failed, errno 0 8:20:28 (2972): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4220, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4592, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 21:14:16 (4904): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:47:32 (1724): start_timer_thread(): CreateThread() failed, errno 0 CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1724, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4716, iMonCtr=2 Model crash detected, will try to restart... 23:13:48 (4716):Leaving CPDN_Main::Monitor... No heartbeat from core client for 30 sec - exiting 23:13:49 (4716): No heartbeat from core client for 30 sec - exiting 20:52:31 (5056): No heartbeat from core client for 30 sec - exiting 20:52:32 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:08 (2652): Can't acquire lockfile (32) - waiting 35s 20:53:46 (5656): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4020, selfPID=5216, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 21:15:04 (4824): No heartbeat from core client for 30 sec - exiting 21:15:05 (4824): No heartbeat from core client for 30 sec - exiting 21:15:06 (4824): No heartbeat from core client for 30 sec - exiting 21:15:07 (4824): No heartbeat from core client for 30 sec - exiting 21:15:08 (4824): No heartbeat from core client for 30 sec - exiting 21:15:09 (4824): No heartbeat from core client for 30 sec - exiting 21:15:10 (4824): No heartbeat from core client for 30 sec - exiting 21:15:11 (4824): No heartbeat from core client for 30 sec - exiting 21:15:12 (4824): No heartbeat from core client for 30 sec - exiting 21:15:13 (4824): No heartbeat from core client for 30 sec - exiting 21:15:14 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:05 (5016): Can't acquire lockfile (32) - waiting 35s GCobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=2 ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5016, iMonCtr=2 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4552, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... 19:04:58 (5152): No heartbeat from core client for 30 sec - exiting 19:04:59 (5152): No heartbeat from core client for 30 sec - exiting 19:05:00 (5152): No heartbeat from core client for 30 sec - exiting 19:05:01 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:14 (520): start_timer_thread(): CreateThread() failed, errno 0 19:05:14 (5016): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:41:09 (892): start_timer_thread(): CreateThread() failed, errno 0 22:41:09 (5208): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:53:08 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3448, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4344, selfPID=5744, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 15:25:09 (4844): No heartbeat from core client for 30 sec - exiting 15:25:10 (4844): No heartbeat from core client for 30 sec - exiting 15:25:11 (4844): No heartbeat from core client for 30 sec - exiting 15:25:12 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:56:55 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:07 (5492): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5600, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 21:14:26 (5268): start_timer_thread(): CreateThread() failed, errno 0 21:34:38 (5424): start_timer_thread(): CreateThread() failed, errno 0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5428, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... 15:14:18 (5656): start_timer_thread(): CreateThread() failed, errno 0 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 May 2013 17:33:54	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	138,362	865,134	6.2527
14 May 2013 14:35:46	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	138,349	864,477	6.2485
13 May 2013 21:23:23	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	138,345	863,841	6.2441
12 May 2013 18:06:32	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	138,336	862,881	6.2376
13 Apr 2013 22:32:39	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	126,889	791,497	6.2377
11 Apr 2013 21:19:54	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	126,883	790,582	6.2308
11 Apr 2013 15:20:32	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	126,817	788,853	6.2204
10 Apr 2013 20:39:11	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	126,816	788,136	6.2148
21 Mar 2013 15:30:34	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	115,323	712,540	6.1786
20 Mar 2013 20:39:45	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	115,312	711,878	6.1735
19 Mar 2013 20:42:06	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	115,296	711,210	6.1686
15 Feb 2013 15:05:33	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	103,776	644,052	6.2062
13 Jan 2013 21:44:27	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	92,266	579,067	6.2761
12 Jan 2013 23:58:01	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	92,256	578,440	6.2699
20 Dec 2012 16:47:44	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	80,737	509,839	6.3148
19 Dec 2012 22:59:09	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	80,736	509,278	6.3079
18 Nov 2012 23:57:31	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	69,223	439,492	6.3489
18 Nov 2012 15:00:40	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	69,216	438,924	6.3414
20 Oct 2012 21:33:12	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	57,705	371,415	6.4364
20 Oct 2012 17:23:03	1038803	14671382	hadam3p_pnw_8kvm_2002_1_007700014_2	57,696	370,417	6.4202