Task 16365361

Name	hadam3p_eu_a3hw_2013_1_008520873_1
Workunit	8668385
Created	11 Mar 2014, 8:31:10 UTC
Sent	11 Mar 2014, 8:31:47 UTC
Report deadline	21 Feb 2015, 13:51:47 UTC
Received	23 Mar 2014, 17:22:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1229790
Run time	4 days 14 hours 50 min 37 sec
CPU time	3 days 5 hours 9 min 33 sec
Validate state	Invalid
Credit	1,790.21
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 05:35:16 (11808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:00 (8408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12728, iMonCtr=2 11:45:24 (6088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:45:25 (6088): No heartbeat from core client for 30 sec - exiting 12:19:43 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=968, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4600, selfPID=8380, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 13:25:59 (11920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:24:49 (11324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:44 (4312): No heartbeat from core client for 30 sec - exiting 00:18:45 (4312): No heartbeat from core client for 30 sec - exiting 00:18:46 (4312): No heartbeat from core client for 30 sec - exiting 00:18:47 (4312): No heartbeat from core client for 30 sec - exiting 00:18:48 (4312): No heartbeat from core client for 30 sec - exiting 00:18:49 (4312): No heartbeat from core client for 30 sec - exiting 00:18:51 (4312): No heartbeat from core client for 30 sec - exiting 00:18:52 (4312): No heartbeat from core client for 30 sec - exiting 00:18:53 (4312): No heartbeat from core client for 30 sec - exiting 00:18:54 (4312): No heartbeat from core client for 30 sec - exiting 00:18:55 (4312): No heartbeat from core client for 30 sec - exiting 00:18:56 (4312): No heartbeat from core client for 30 sec - exiting 00:18:57 (4312): No heartbeat from core client for 30 sec - exiting 00:18:58 (4312): No heartbeat from core client for 30 sec - exiting 00:18:59 (4312): No heartbeat from core client for 30 sec - exiting 00:19:00 (4312): No heartbeat from core client for 30 sec - exiting 00:19:01 (4312): No heartbeat from core client for 30 sec - exiting 00:19:03 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:53:09 (3256): No heartbeat from core client for 30 sec - exiting 01:53:10 (3256): No heartbeat from core client for 30 sec - exiting 01:53:11 (3256): No heartbeat from core client for 30 sec - exiting 01:53:12 (3256): No heartbeat from core client for 30 sec - exiting 01:53:13 (3256): No heartbeat from core client for 30 sec - exiting 01:53:14 (3256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:32:33 (8044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9276, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3928, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7508, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... 09:27:07 (9128): No heartbeat from core client for 30 sec - exiting 09:27:08 (9128): No heartbeat from core client for 30 sec - exiting 09:27:09 (9128): No heartbeat from core client for 30 sec - exiting 09:27:10 (9128): No heartbeat from core client for 30 sec - exiting 09:27:11 (9128): No heartbeat from core client for 30 sec - exiting 09:27:12 (9128): No heartbeat from core client for 30 sec - exiting 09:27:14 (9128): No heartbeat from core client for 30 sec - exiting 09:27:15 (9128): No heartbeat from core client for 30 sec - exiting 09:27:16 (9128): No heartbeat from core client for 30 sec - exiting 09:27:50 (9128): No heartbeat from core client for 30 sec - exiting 09:27:51 (9128): No heartbeat from core client for 30 sec - exiting 09:27:52 (9128): No heartbeat from core client for 30 sec - exiting 09:27:53 (9128): No heartbeat from core client for 30 sec - exiting 09:27:54 (9128): No heartbeat from core client for 30 sec - exiting 09:27:55 (9128): No heartbeat from core client for 30 sec - exiting 09:27:56 (9128): No heartbeat from core client for 30 sec - exiting 09:27:57 (9128): No heartbeat from core client for 30 sec - exiting 09:27:58 (9128): No heartbeat from core client for 30 sec - exiting 09:27:59 (9128): No heartbeat from core client for 30 sec - exiting 09:28:00 (9128): No heartbeat from core client for 30 sec - exiting 09:28:02 (9128): No heartbeat from core client for 30 sec - exiting 09:28:03 (9128): No heartbeat from core client for 30 sec - exiting 09:28:04 (9128): No heartbeat from core client for 30 sec - exiting 09:28:05 (9128): No heartbeat from core client for 30 sec - exiting 09:28:06 (9128): No heartbeat from core client for 30 sec - exiting 09:28:07 (9128): No heartbeat from core client for 30 sec - exiting 09:28:08 (9128): No heartbeat from core client for 30 sec - exiting 09:28:09 (9128): No heartbeat from core client for 30 sec - exiting 09:28:10 (9128): No heartbeat from core client for 30 sec - exiting 09:28:11 (9128): No heartbeat from core client for 30 sec - exiting 09:28:12 (9128): No heartbeat from core client for 30 sec - exiting 09:28:13 (9128): No heartbeat from core client for 30 sec - exiting 09:28:14 (9128): No heartbeat from core client for 30 sec - exiting 09:28:15 (9128): No heartbeat from core client for 30 sec - exiting 09:28:16 (9128): No heartbeat from core client for 30 sec - exiting 09:28:17 (9128): No heartbeat from core client for 30 sec - exiting 09:28:18 (9128): No heartbeat from core client for 30 sec - exiting 09:28:19 (9128): No heartbeat from core client for 30 sec - exiting 09:28:21 (9128): No heartbeat from core client for 30 sec - exiting 09:28:22 (9128): No heartbeat from core client for 30 sec - exiting 09:28:23 (9128): No heartbeat from core client for 30 sec - exiting 09:28:24 (9128): No heartbeat from core client for 30 sec - exiting 09:28:25 (9128): No heartbeat from core client for 30 sec - exiting 09:28:26 (9128): No heartbeat from core client for 30 sec - exiting 09:28:27 (9128): No heartbeat from core client for 30 sec - exiting 09:28:28 (9128): No heartbeat from core client for 30 sec - exiting 09:28:29 (9128): No heartbeat from core client for 30 sec - exiting 09:28:30 (9128): No heartbeat from core client for 30 sec - exiting 09:28:31 (9128): No heartbeat from core client for 30 sec - exiting 09:28:32 (9128): No heartbeat from core client for 30 sec - exiting 09:28:33 (9128): No heartbeat from core client for 30 sec - exiting 09:28:34 (9128): No heartbeat from core client for 30 sec - exiting 09:28:35 (9128): No heartbeat from core client for 30 sec - exiting 09:28:36 (9128): No heartbeat from core client for 30 sec - exiting 09:28:37 (9128): No heartbeat from core client for 30 sec - exiting 09:28:38 (9128): No heartbeat from core client for 30 sec - exiting 09:28:39 (9128): No heartbeat from core client for 30 sec - exiting 09:28:40 (9128): No heartbeat from core client for 30 sec - exiting 09:28:42 (9128): No heartbeat from core client for 30 sec - exiting 09:28:43 (9128): No heartbeat from core client for 30 sec - exiting 09:28:44 (9128): No heartbeat from core client for 30 sec - exiting 09:28:45 (9128): No heartbeat from core client for 30 sec - exiting 09:28:46 (9128): No heartbeat from core client for 30 sec - exiting 09:28:47 (9128): No heartbeat from core client for 30 sec - exiting 09:28:48 (9128): No heartbeat from core client for 30 sec - exiting 09:28:49 (9128): No heartbeat from core client for 30 sec - exiting 09:28:50 (9128): No heartbeat from core client for 30 sec - exiting 09:28:51 (9128): No heartbeat from core client for 30 sec - exiting 09:28:53 (9128): No heartbeat from core client for 30 sec - exiting 09:28:54 (9128): No heartbeat from core client for 30 sec - exiting 09:28:55 (9128): No heartbeat from core client for 30 sec - exiting 09:28:56 (9128): No heartbeat from core client for 30 sec - exiting 09:28:57 (9128): No heartbeat from core client for 30 sec - exiting 09:28:58 (9128): No heartbeat from core client for 30 sec - exiting 09:28:59 (9128): No heartbeat from core client for 30 sec - exiting 09:29:00 (9128): No heartbeat from core client for 30 sec - exiting 09:29:01 (9128): No heartbeat from core client for 30 sec - exiting 09:29:03 (9128): No heartbeat from core client for 30 sec - exiting 09:29:04 (9128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1112, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7528, selfPID=4228, iMonCtr=1 Model crash detected, will try to restart... 09:56:50 (5756): No heartbeat from core client for 30 sec - exiting 09:56:52 (5756): No heartbeat from core client for 30 sec - exiting 09:56:53 (5756): No heartbeat from core client for 30 sec - exiting 09:56:54 (5756): No heartbeat from core client for 30 sec - exiting 09:56:55 (5756): No heartbeat from core client for 30 sec - exiting 09:56:56 (5756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:40 (8660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4016, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9000, selfPID=6456, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6524, selfPID=8524, iMonCtr=1 Model crash detected, will try to restart... 14:17:12 (2900): No heartbeat from core client for 30 sec - exiting 14:17:13 (2900): No heartbeat from core client for 30 sec - exiting 14:17:14 (2900): No heartbeat from core client for 30 sec - exiting 14:17:15 (2900): No heartbeat from core client for 30 sec - exiting 14:17:17 (2900): No heartbeat from core client for 30 sec - exiting 14:17:18 (2900): No heartbeat from core client for 30 sec - exiting 14:17:19 (2900): No heartbeat from core client for 30 sec - exiting 14:17:20 (2900): No heartbeat from core client for 30 sec - exiting 14:17:21 (2900): No heartbeat from core client for 30 sec - exiting 14:17:22 (2900): No heartbeat from core client for 30 sec - exiting 14:17:23 (2900): No heartbeat from core client for 30 sec - exiting 14:17:24 (2900): No heartbeat from core client for 30 sec - exiting 14:17:25 (2900): No heartbeat from core client for 30 sec - exiting 14:17:26 (2900): No heartbeat from core client for 30 sec - exiting 14:17:27 (2900): No heartbeat from core client for 30 sec - exiting 14:17:28 (2900): No heartbeat from core client for 30 sec - exiting 14:17:29 (2900): No heartbeat from core client for 30 sec - exiting 14:17:30 (2900): No heartbeat from core client for 30 sec - exiting 14:17:31 (2900): No heartbeat from core client for 30 sec - exiting 14:17:32 (2900): No heartbeat from core client for 30 sec - exiting 14:17:34 (2900): No heartbeat from core client for 30 sec - exiting 14:17:35 (2900): No heartbeat from core client for 30 sec - exiting 14:17:36 (2900): No heartbeat from core client for 30 sec - exiting 14:17:37 (2900): No heartbeat from core client for 30 sec - exiting 14:17:38 (2900): No heartbeat from core client for 30 sec - exiting 14:17:39 (2900): No heartbeat from core client for 30 sec - exiting 14:17:40 (2900): No heartbeat from core client for 30 sec - exiting 14:17:41 (2900): No heartbeat from core client for 30 sec - exiting 14:17:42 (2900): No heartbeat from core client for 30 sec - exiting 14:17:43 (2900): No heartbeat from core client for 30 sec - exiting 14:17:44 (2900): No heartbeat from core client for 30 sec - exiting 14:17:45 (2900): No heartbeat from core client for 30 sec - exiting 14:17:46 (2900): No heartbeat from core client for 30 sec - exiting 14:17:47 (2900): No heartbeat from core client for 30 sec - exiting 14:17:48 (2900): No heartbeat from core client for 30 sec - exiting 14:17:50 (2900): No heartbeat from core client for 30 sec - exiting 14:17:51 (2900): No heartbeat from core client for 30 sec - exiting 14:17:52 (2900): No heartbeat from core client for 30 sec - exiting 14:17:53 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:01 (4528): No heartbeat from core client for 30 sec - exiting 07:26:02 (4528): No heartbeat from core client for 30 sec - exiting 07:26:03 (4528): No heartbeat from core client for 30 sec - exiting 07:26:04 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:34 (412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9072, iMonCtr=2 Model crash detected, will try to restart... 09:28:27 (8364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12592, selfPID=12592, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8488, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9060, selfPID=6336, iMonCtr=1 Model crash detected, will try to restart... 03:59:38 (7256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:13 (8704): No heartbeat from core client for 30 sec - exiting 10:04:14 (8704): No heartbeat from core client for 30 sec - exiting 10:04:15 (8704): No heartbeat from core client for 30 sec - exiting 10:04:16 (8704): No heartbeat from core client for 30 sec - exiting 10:04:17 (8704): No heartbeat from core client for 30 sec - exiting 10:04:19 (8704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6000, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6892, selfPID=6428, iMonCtr=1 Model crash detected, will try to restart... 11:38:02 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:37 (7492): No heartbeat from core client for 30 sec - exiting 11:57:38 (7492): No heartbeat from core client for 30 sec - exiting 11:57:39 (7492): No heartbeat from core client for 30 sec - exiting 11:57:40 (7492): No heartbeat from core client for 30 sec - exiting 11:57:41 (7492): No heartbeat from core client for 30 sec - exiting 11:57:42 (7492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:36:22 (7628): No heartbeat from core client for 30 sec - exiting 00:36:23 (7628): No heartbeat from core client for 30 sec - exiting 00:36:24 (7628): No heartbeat from core client for 30 sec - exiting 00:36:25 (7628): No heartbeat from core client for 30 sec - exiting 00:36:26 (7628): No heartbeat from core client for 30 sec - exiting 00:36:27 (7628): No heartbeat from core client for 30 sec - exiting 00:36:28 (7628): No heartbeat from core client for 30 sec - exiting 00:36:29 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:43 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:39 (11416): No heartbeat from core client for 30 sec - exiting 03:34:40 (11416): No heartbeat from core client for 30 sec - exiting 03:34:41 (11416): No heartbeat from core client for 30 sec - exiting 03:34:43 (11416): No heartbeat from core client for 30 sec - exiting 03:34:44 (11416): No heartbeat from core client for 30 sec - exiting 03:34:45 (11416): No heartbeat from core client for 30 sec - exiting 03:34:46 (11416): No heartbeat from core client for 30 sec - exiting 03:34:47 (11416): No heartbeat from core client for 30 sec - exiting 03:34:48 (11416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:37 (10860): Can't acquire lockfile (32) - waiting 35s 04:57:09 (10860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:51 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10604, selfPID=4904, iMonCtr=1 Model crash detected, will try to restart... 09:34:59 (4368): No heartbeat from core client for 30 sec - exiting 09:35:00 (4368): No heartbeat from core client for 30 sec - exiting 09:35:01 (4368): No heartbeat from core client for 30 sec - exiting 09:35:02 (4368): No heartbeat from core client for 30 sec - exiting 09:35:04 (4368): No heartbeat from core client for 30 sec - exiting 09:35:05 (4368): No heartbeat from core client for 30 sec - exiting 09:35:06 (4368): No heartbeat from core client for 30 sec - exiting 09:35:07 (4368): No heartbeat from core client for 30 sec - exiting 09:35:08 (4368): No heartbeat from core client for 30 sec - exiting 09:35:09 (4368): No heartbeat from core client for 30 sec - exiting 09:35:10 (4368): No heartbeat from core client for 30 sec - exiting 09:35:11 (4368): No heartbeat from core client for 30 sec - exiting 09:35:12 (4368): No heartbeat from core client for 30 sec - exiting 09:35:14 (4368): No heartbeat from core client for 30 sec - exiting 09:35:15 (4368): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=12284, iMonCtr=1 CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12240, iMonCtr=2 Model crash detected, will try to restart... 00:37:52 (7244): No heartbeat from core client for 30 sec - exiting 00:37:53 (7244): No heartbeat from core client for 30 sec - exiting 00:37:54 (7244): No heartbeat from core client for 30 sec - exiting 00:37:55 (7244): No heartbeat from core client for 30 sec - exiting 00:37:56 (7244): No heartbeat from core client for 30 sec - exiting 00:37:57 (7244): No heartbeat from core client for 30 sec - exiting 00:37:58 (7244): No heartbeat from core client for 30 sec - exiting 00:37:59 (7244): No heartbeat from core client for 30 sec - exiting 00:38:00 (7244): No heartbeat from core client for 30 sec - exiting 00:38:01 (7244): No heartbeat from core client for 30 sec - exiting 00:38:02 (7244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:22 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running,01:11:20 (5260): No heartbeat from core client for 30 sec - exiting 01:11:21 (5260): No heartbeat from core client for 30 sec - exiting 01:11:22 (5260): No heartbeat from core client for 30 sec - exiting 01:11:23 (5260): No heartbeat from core client for 30 sec - exiting 01:11:24 (5260): No heartbeat from core client for 30 sec - exiting 01:11:25 (5260): No heartbeat from core client for 30 sec - exiting 01:11:26 (5260): No heartbeat from core client for 30 sec - exiting 01:11:27 (5260): No heartbeat from core client for 30 sec - exiting 01:11:28 (5260): No heartbeat from core client for 30 sec - exiting 01:11:29 (5260): No heartbeat from core client for 30 sec - exiting 01:11:30 (5260): No heartbeat from core client for 30 sec - exiting 01:11:32 (5260): No heartbeat from core client for 30 sec - exiting 01:11:33 (5260): No heartbeat from core client for 30 sec - exiting 01:11:36 (5260): No heartbeat from core client for 30 sec - exiting 01:11:37 (5260): No heartbeat from core client for 30 sec - exiting 01:11:38 (5260): No heartbeat from core client for 30 sec - exiting 01:11:39 (5260): No heartbeat from core client for 30 sec - exiting 01:11:40 (5260): No heartbeat from core client for 30 sec - exiting 01:11:41 (5260): No heartbeat from core client for 30 sec - exiting 01:11:42 (5260): No heartbeat from core client for 30 sec - exiting 01:11:43 (5260): No heartbeat from core client for 30 sec - exiting 01:11:44 (5260): No heartbeat from core client for 30 sec - exiting 01:11:46 (5260): No heartbeat from core client for 30 sec - exiting 01:11:47 (5260): No heartbeat from core client for 30 sec - exiting 01:11:48 (5260): No heartbeat from core client for 30 sec - exiting 01:11:49 (5260): No heartbeat from core client for 30 sec - exiting 01:11:50 (5260): No heartbeat from core client for 30 sec - exiting 01:11:51 (5260): No heartbeat from core client for 30 sec - exiting 01:11:52 (5260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:24 (1192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:30 (10828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:41 (9964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12576, iMonCtr=2 Model crash detected, will try to restart... 10:22:28 (7800): No heartbeat from core client for 30 sec - exiting 10:22:29 (7800): No heartbeat from core client for 30 sec - exiting 10:22:30 (7800): No heartbeat from core client for 30 sec - exiting 10:22:31 (7800): No heartbeat from core client for 30 sec - exiting 10:22:32 (7800): No heartbeat from core client for 30 sec - exiting 10:22:33 (7800): No heartbeat from core client for 30 sec - exiting 10:22:34 (7800): No heartbeat from core client for 30 sec - exiting 10:22:35 (7800): No heartbeat from core client for 30 sec - exiting 10:22:37 (7800): No heartbeat from core client for 30 sec - exiting 10:22:38 (7800): No heartbeat from core client for 30 sec - exiting 10:22:39 (7800): No heartbeat from core client for 30 sec - exiting 10:22:40 (7800): No heartbeat from core client for 30 sec - exiting 10:22:41 (7800): No heartbeat from core client for 30 sec - exiting 10:22:42 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:21 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3832, selfPID=3832, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 11:06:42 (8092): No heartbeat from core client for 30 sec - exiting 11:06:43 (8092): No heartbeat from core client for 30 sec - exiting 11:06:44 (8092): No heartbeat from core client for 30 sec - exiting 11:06:45 (8092): No heartbeat from core client for 30 sec - exiting 11:06:46 (8092): No heartbeat from core client for 30 sec - exiting 11:06:47 (8092): No heartbeat from core client for 30 sec - exiting 11:06:48 (8092): No heartbeat from core client for 30 sec - exiting 11:06:49 (8092): No heartbeat from core client for 30 sec - exiting 11:06:50 (8092): No heartbeat from core client for 30 sec - exiting 11:06:51 (8092): No heartbeat from core client for 30 sec - exiting 11:06:52 (8092): No heartbeat from core client for 30 sec - exiting 11:06:53 (8092): No heartbeat from core client for 30 sec - exiting 11:06:54 (8092): No heartbeat from core client for 30 sec - exiting 11:06:55 (8092): No heartbeat from core client for 30 sec - exiting 11:06:56 (8092): No heartbeat from core client for 30 sec - exiting 11:06:57 (8092): No heartbeat from core client for 30 sec - exiting 11:06:58 (8092): No heartbeat from core client for 30 sec - exiting 11:06:59 (8092): No heartbeat from core client for 30 sec - exiting 11:07:00 (8092): No heartbeat from core client for 30 sec - exiting 11:07:01 (8092): No heartbeat from core client for 30 sec - exiting 11:07:03 (8092): No heartbeat from core client for 30 sec - exiting 11:07:04 (8092): No heartbeat from core client for 30 sec - exiting 11:07:05 (8092): No heartbeat from core client for 30 sec - exiting 11:07:06 (8092): No heartbeat from core client for 30 sec - exiting 11:07:07 (8092): No heartbeat from core client for 30 sec - exiting 11:07:08 (8092): No heartbeat from core client for 30 sec - exiting 11:07:09 (8092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8508, iMonCtr=2 12:45:57 (7688): No heartbeat from core client for 30 sec - exiting 12:45:58 (7688): No heartbeat from core client for 30 sec - exiting 12:45:59 (7688): No heartbeat from core client for 30 sec - exiting 12:46:00 (7688): No heartbeat from core client for 30 sec - exiting 12:46:01 (7688): No heartbeat from core client for 30 sec - exiting 12:46:02 (7688): No heartbeat from core client for 30 sec - exiting 12:46:03 (7688): No heartbeat from core client for 30 sec - exiting 12:46:04 (7688): No heartbeat from core client for 30 sec - exiting 12:46:05 (7688): No heartbeat from core client for 30 sec - exiting 12:46:06 (7688): No heartbeat from core client for 30 sec - exiting 12:46:07 (7688): No heartbeat from core client for 30 sec - exiting 12:46:08 (7688): No heartbeat from core client for 30 sec - exiting 12:46:09 (7688): No heartbeat from core client for 30 sec - exiting 12:46:10 (7688): No heartbeat from core client for 30 sec - exiting 12:46:12 (7688): No heartbeat from core client for 30 sec - exiting 12:46:13 (7688): No heartbeat from core client for 30 sec - exiting 12:46:14 (7688): No heartbeat from core client for 30 sec - exiting 12:46:15 (7688): No heartbeat from core client for 30 sec - exiting 12:46:16 (7688): No heartbeat from core client for 30 sec - exiting 12:46:17 (7688): No heartbeat from core client for 30 sec - exiting 12:46:18 (7688): No heartbeat from core client for 30 sec - exiting 12:46:19 (7688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8408, iMonCtr=2 Model crash detected, will try to restart... 13:07:46 (8580): No heartbeat from core client for 30 sec - exiting 13:07:47 (8580): No heartbeat from core client for 30 sec - exiting 13:07:48 (8580): No heartbeat from core client for 30 sec - exiting 13:07:49 (8580): No heartbeat from core client for 30 sec - exiting 13:07:50 (8580): No heartbeat from core client for 30 sec - exiting 13:07:51 (8580): No heartbeat from core client for 30 sec - exiting 13:07:52 (8580): No heartbeat from core client for 30 sec - exiting 13:07:53 (8580): No heartbeat from core client for 30 sec - exiting 13:07:54 (8580): No heartbeat from core client for 30 sec - exiting 13:07:55 (8580): No heartbeat from core client for 30 sec - exiting 13:07:56 (8580): No heartbeat from core client for 30 sec - exiting 13:07:57 (8580): No heartbeat from core client for 30 sec - exiting 13:07:58 (8580): No heartbeat from core client for 30 sec - exiting 13:07:59 (8580): No heartbeat from core client for 30 sec - exiting 13:08:00 (8580): No heartbeat from core client for 30 sec - exiting 13:08:01 (8580): No heartbeat from core client for 30 sec - exiting 13:08:02 (8580): No heartbeat from core client for 30 sec - exiting 13:08:03 (8580): No heartbeat from core client for 30 sec - exiting 13:08:04 (8580): No heartbeat from core client for 30 sec - exiting 13:08:05 (8580): No heartbeat from core client for 30 sec - exiting 13:08:06 (8580): No heartbeat from core client for 30 sec - exiting 13:08:08 (8580): No heartbeat from core client for 30 sec - exiting 13:08:09 (8580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:06 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:49 (6376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:11 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6052, selfPID=6052, iMonCtr=2 14:12:59 (1492): No heartbeat from core client for 30 sec - exiting 14:13:00 (1492): No heartbeat from core client for 30 sec - exiting 14:13:01 (1492): No heartbeat from core client for 30 sec - exiting 14:13:02 (1492): No heartbeat from core client for 30 sec - exiting 14:13:03 (1492): No heartbeat from core client for 30 sec - exiting 14:13:04 (1492): No heartbeat from core client for 30 sec - exiting 14:13:06 (1492): No heartbeat from core client for 30 sec - exiting 14:13:07 (1492): No heartbeat from core client for 30 sec - exiting 14:13:08 (1492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:13 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6728, selfPID=6728, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6128, selfPID=4676, iMonCtr=1 Model crash detected, will try to restart... 00:29:46 (3944): No heartbeat from core client for 30 sec - exiting 00:29:47 (3944): No heartbeat from core client for 30 sec - exiting 00:29:48 (3944): No heartbeat from core client for 30 sec - exiting 00:29:50 (3944): No heartbeat from core client for 30 sec - exiting 00:29:51 (3944): No heartbeat from core client for 30 sec - exiting 00:29:52 (3944): No heartbeat from core client for 30 sec - exiting 00:29:53 (3944): No heartbeat from core client for 30 sec - exiting 00:29:54 (3944): No heartbeat from core client for 30 sec - exiting 00:29:55 (3944): No heartbeat from core client for 30 sec - exiting 00:29:56 (3944): No heartbeat from core client for 30 sec - exiting 00:29:57 (3944): No heartbeat from core client for 30 sec - exiting 00:29:58 (3944): No heartbeat from core client for 30 sec - exiting 00:29:59 (3944): No heartbeat from core client for 30 sec - exiting 00:30:00 (3944): No heartbeat from core client for 30 sec - exiting 00:30:02 (3944): No heartbeat from core client for 30 sec - exiting 00:30:03 (3944): No heartbeat from core client for 30 sec - exiting 00:30:04 (3944): No heartbeat from core client for 30 sec - exiting 00:30:05 (3944): No heartbeat from core client for 30 sec - exiting 00:30:06 (3944): No heartbeat from core client for 30 sec - exiting 00:30:07 (3944): No heartbeat from core client for 30 sec - exiting 00:30:08 (3944): No heartbeat from core client for 30 sec - exiting 00:30:09 (3944): No heartbeat from core client for 30 sec - exiting 00:30:10 (3944): No heartbeat from core client for 30 sec - exiting 00:30:11 (3944): No heartbeat from core client for 30 sec - exiting 00:30:12 (3944): No heartbeat from core client for 30 sec - exiting 00:30:13 (3944): No heartbeat from core client for 30 sec - exiting 00:30:14 (3944): No heartbeat from core client for 30 sec - exiting 00:30:15 (3944): No heartbeat from core client for 30 sec - exiting 00:30:16 (3944): No heartbeat from core client for 30 sec - exiting 00:30:17 (3944): No heartbeat from core client for 30 sec - exiting 00:30:19 (3944): No heartbeat from core client for 30 sec - exiting 00:30:20 (3944): No heartbeat from core client for 30 sec - exiting 00:30:21 (3944): No heartbeat from core client for 30 sec - exiting 00:30:22 (3944): No heartbeat from core client for 30 sec - exiting 00:30:23 (3944): No heartbeat from core client for 30 sec - exiting 00:30:24 (3944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:37 (4856): No heartbeat from core client for 30 sec - exiting 01:00:39 (4856): No heartbeat from core client for 30 sec - exiting 01:00:40 (4856): No heartbeat from core client for 30 sec - exiting 01:00:41 (4856): No heartbeat from core client for 30 sec - exiting 01:00:42 (4856): No heartbeat from core client for 30 sec - exiting 01:00:43 (4856): No heartbeat from core client for 30 sec - exiting 01:00:44 (4856): No heartbeat from core client for 30 sec - exiting 01:00:46 (4856): No heartbeat from core client for 30 sec - exiting 01:00:47 (4856): No heartbeat from core client for 30 sec - exiting 01:00:48 (4856): No heartbeat from core client for 30 sec - exiting 01:00:49 (4856): No heartbeat from core client for 30 sec - exiting 01:00:50 (4856): No heartbeat from core client for 30 sec - exiting 01:00:51 (4856): No heartbeat from core client for 30 sec - exiting 01:00:52 (4856): No heartbeat from core client for 30 sec - exiting 01:00:53 (4856): No heartbeat from core client for 30 sec - exiting 01:00:54 (4856): No heartbeat from core client for 30 sec - exiting 01:00:55 (4856): No heartbeat from core client for 30 sec - exiting 01:00:56 (4856): No heartbeat from core client for 30 sec - exiting 01:00:57 (4856): No heartbeat from core client for 30 sec - exiting 01:00:58 (4856): No heartbeat from core client for 30 sec - exiting 01:00:59 (4856): No heartbeat from core client for 30 sec - exiting 01:01:00 (4856): No heartbeat from core client for 30 sec - exiting 01:01:01 (4856): No heartbeat from core client for 30 sec - exiting 01:01:02 (4856): No heartbeat from core client for 30 sec - exiting 01:01:03 (4856): No heartbeat from core client for 30 sec - exiting 01:01:04 (4856): No heartbeat from core client for 30 sec - exiting 01:01:05 (4856): No heartbeat from core client for 30 sec - exiting 01:01:06 (4856): No heartbeat from core client for 30 sec - exiting 01:01:07 (4856): No heartbeat from core client for 30 sec - exiting 01:01:08 (4856): No heartbeat from core client for 30 sec - exiting 01:01:09 (4856): No heartbeat from core client for 30 sec - exiting 01:01:10 (4856): No heartbeat from core client for 30 sec - exiting 01:01:11 (4856): No heartbeat from core client for 30 sec - exiting 01:01:12 (4856): No heartbeat from core client for 30 sec - exiting 01:01:13 (4856): No heartbeat from core client for 30 sec - exiting 01:01:14 (4856): No heartbeat from core client for 30 sec - exiting 01:01:15 (4856): No heartbeat from core client for 30 sec - exiting 01:01:16 (4856): No heartbeat from core client for 30 sec - exiting 01:01:17 (4856): No heartbeat from core client for 30 sec - exiting 01:01:18 (4856): No heartbeat from core client for 30 sec - exiting 01:01:19 (4856): No heartbeat from core client for 30 sec - exiting 01:01:20 (4856): No heartbeat from core client for 30 sec - exiting 01:01:21 (4856): No heartbeat from core client for 30 sec - exiting 01:01:23 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:13 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3408, selfPID=3408, iMonCtr=2 05:16:18 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:20:27 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12480, selfPID=12480, iMonCtr=2 06:32:17 (2816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:16 (8476): No heartbeat from core client for 30 sec - exiting 09:21:17 (8476): No heartbeat from core client for 30 sec - exiting 09:21:18 (8476): No heartbeat from core client for 30 sec - exiting 09:21:19 (8476): No heartbeat from core client for 30 sec - exiting 09:21:20 (8476): No heartbeat from core client for 30 sec - exiting 09:21:21 (8476): No heartbeat from core client for 30 sec - exiting 09:21:22 (8476): No heartbeat from core client for 30 sec - exiting 09:21:23 (8476): No heartbeat from core client for 30 sec - exiting 09:21:24 (8476): No heartbeat from core client for 30 sec - exiting 09:21:25 (8476): No heartbeat from core client for 30 sec - exiting 09:21:26 (8476): No heartbeat from core client for 30 sec - exiting 09:21:27 (8476): No heartbeat from core client for 30 sec - exiting 09:21:28 (8476): No heartbeat from core client for 30 sec - exiting 09:21:29 (8476): No heartbeat from core client for 30 sec - exiting 09:21:30 (8476): No heartbeat from core client for 30 sec - exiting 09:21:31 (8476): No heartbeat from core client for 30 sec - exiting 09:21:32 (8476): No heartbeat from core client for 30 sec - exiting 09:21:33 (8476): No heartbeat from core client for 30 sec - exiting 09:21:34 (8476): No heartbeat from core client for 30 sec - exiting 09:21:35 (8476): No heartbeat from core client for 30 sec - exiting 09:21:36 (8476): No heartbeat from core client for 30 sec - exiting 09:21:37 (8476): No heartbeat from core client for 30 sec - exiting 09:21:38 (8476): No heartbeat from core client for 30 sec - exiting 09:21:39 (8476): No heartbeat from core client for 30 sec - exiting 09:21:40 (8476): No heartbeat from core client for 30 sec - exiting 09:21:41 (8476): No heartbeat from core client for 30 sec - exiting 09:21:42 (8476): No heartbeat from core client for 30 sec - exiting 09:21:43 (8476): No heartbeat from core client for 30 sec - exiting 09:21:44 (8476): No heartbeat from core client for 30 sec - exiting 09:21:45 (8476): No heartbeat from core client for 30 sec - exiting 09:21:46 (8476): No heartbeat from core client for 30 sec - exiting 09:21:48 (8476): No heartbeat from core client for 30 sec - exiting 09:21:49 (8476): No heartbeat from core client for 30 sec - exiting 09:21:50 (8476): No heartbeat from core client for 30 sec - exiting 09:21:51 (8476): No heartbeat from core client for 30 sec - exiting 09:21:52 (8476): No heartbeat from core client for 30 sec - exiting 09:21:53 (8476): No heartbeat from core client for 30 sec - exiting 09:21:54 (8476): No heartbeat from core client for 30 sec - exiting 09:21:55 (8476): No heartbeat from core client for 30 sec - exiting 09:21:56 (8476): No heartbeat from core client for 30 sec - exiting 09:21:57 (8476): No heartbeat from core client for 30 sec - exiting 09:21:58 (8476): No heartbeat from core client for 30 sec - exiting 09:22:40 (8476): No heartbeat from core client for 30 sec - exiting 09:22:41 (8476): No heartbeat from core client for 30 sec - exiting 09:22:42 (8476): No heartbeat from core client for 30 sec - exiting 09:22:43 (8476): No heartbeat from core client for 30 sec - exiting 09:22:44 (8476): No heartbeat from core client for 30 sec - exiting 09:22:45 (8476): No heartbeat from core client for 30 sec - exiting 09:22:46 (8476): No heartbeat from core client for 30 sec - exiting 09:22:47 (8476): No heartbeat from core client for 30 sec - exiting 09:22:48 (8476): No heartbeat from core client for 30 sec - exiting 09:22:49 (8476): No heartbeat from core client for 30 sec - exiting 09:22:50 (8476): No heartbeat from core client for 30 sec - exiting 09:22:51 (8476): No heartbeat from core client for 30 sec - exiting 09:22:52 (8476): No heartbeat from core client for 30 sec - exiting 09:22:53 (8476): No heartbeat from core client for 30 sec - exiting 09:22:54 (8476): No heartbeat from core client for 30 sec - exiting 09:22:55 (8476): No heartbeat from core client for 30 sec - exiting 09:22:56 (8476): No heartbeat from core client for 30 sec - exiting 09:22:57 (8476): No heartbeat from core client for 30 sec - exiting 09:22:58 (8476): No heartbeat from core client for 30 sec - exiting 09:22:59 (8476): No heartbeat from core client for 30 sec - exiting 09:23:00 (8476): No heartbeat from core client for 30 sec - exiting 09:23:01 (8476): No heartbeat from core client for 30 sec - exiting 09:23:02 (8476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:46:47 (8428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:18 (10844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10400, selfPID=11668, iMonCtr=1 Model crash detected, will try to restart... 13:58:35 (7164): No heartbeat from core client for 30 sec - exiting 13:58:36 (7164): No heartbeat from core client for 30 sec - exiting 13:58:37 (7164): No heartbeat from core client for 30 sec - exiting 13:58:38 (7164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:47:06 (1588): No heartbeat from core client for 30 sec - exiting 00:47:08 (1588): No heartbeat from core client for 30 sec - exiting 00:47:09 (1588): No heartbeat from core client for 30 sec - exiting 00:47:10 (1588): No heartbeat from core client for 30 sec - exiting 00:47:11 (1588): No heartbeat from core client for 30 sec - exiting 00:47:12 (1588): No heartbeat from core client for 30 sec - exiting 00:47:13 (1588): No heartbeat from core client for 30 sec - exiting 00:47:14 (1588): No heartbeat from core client for 30 sec - exiting 00:47:15 (1588): No heartbeat from core client for 30 sec - exiting 00:47:16 (1588): No heartbeat from core client for 30 sec - exiting 00:47:17 (1588): No heartbeat from core client for 30 sec - exiting 00:47:18 (1588): No heartbeat from core client for 30 sec - exiting 00:47:19 (1588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:24 (9568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:24:12 (11816): No heartbeat from core client for 30 sec - exiting 02:24:13 (11816): No heartbeat from core client for 30 sec - exiting 02:24:14 (11816): No heartbeat from core client for 30 sec - exiting 02:24:15 (11816): No heartbeat from core client for 30 sec - exiting 02:24:16 (11816): No heartbeat from core client for 30 sec - exiting 02:24:17 (11816): No heartbeat from core client for 30 sec - exiting 02:24:18 (11816): No heartbeat from core client for 30 sec - exiting 02:24:19 (11816): No heartbeat from core client for 30 sec - exiting 02:24:20 (11816): No heartbeat from core client for 30 sec - exiting 02:24:21 (11816): No heartbeat from core client for 30 sec - exiting 02:24:22 (11816): No heartbeat from core client for 30 sec - exiting 02:24:24 (11816): No heartbeat from core client for 30 sec - exiting 02:24:25 (11816): No heartbeat from core client for 30 sec - exiting 02:24:26 (11816): No heartbeat from core client for 30 sec - exiting 02:24:27 (11816): No heartbeat from core client for 30 sec - exiting 02:24:28 (11816): No heartbeat from core client for 30 sec - exiting 02:24:29 (11816): No heartbeat from core client for 30 sec - exiting 02:24:30 (11816): No heartbeat from core client for 30 sec - exiting 02:24:31 (11816): No heartbeat from core client for 30 sec - exiting 02:24:32 (11816): No heartbeat from core client for 30 sec - exiting 02:24:33 (11816): No heartbeat from core client for 30 sec - exiting 02:24:34 (11816): No heartbeat from core client for 30 sec - exiting 02:24:35 (11816): No heartbeat from core client for 30 sec - exiting 02:24:36 (11816): No heartbeat from core client for 30 sec - exiting 02:24:37 (11816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:00:11 (7548): No heartbeat from core client for 30 sec - exiting 05:00:12 (7548): No heartbeat from core client for 30 sec - exiting 05:00:13 (7548): No heartbeat from core client for 30 sec - exiting 05:00:14 (7548): No heartbeat from core client for 30 sec - exiting 05:00:15 (7548): No heartbeat from core client for 30 sec - exiting 05:00:16 (7548): No heartbeat from core client for 30 sec - exiting 05:00:17 (7548): No heartbeat from core client for 30 sec - exiting 05:00:18 (7548): No heartbeat from core client for 30 sec - exiting 05:00:19 (7548): No heartbeat from core client for 30 sec - exiting 05:00:20 (7548): No heartbeat from core client for 30 sec - exiting 05:00:21 (7548): No heartbeat from core client for 30 sec - exiting 05:00:22 (7548): No heartbeat from core client for 30 sec - exiting 05:00:23 (7548): No heartbeat from core client for 30 sec - exiting 05:00:24 (7548): No heartbeat from core client for 30 sec - exiting 05:00:25 (7548): No heartbeat from core client for 30 sec - exiting 05:00:26 (7548): No heartbeat from core client for 30 sec - exiting 05:00:27 (7548): No heartbeat from core client for 30 sec - exiting 05:00:28 (7548): No heartbeat from core client for 30 sec - exiting 05:00:29 (7548): No heartbeat from core client for 30 sec - exiting 05:00:30 (7548): No heartbeat from core client for 30 sec - exiting 05:00:31 (7548): No heartbeat from core client for 30 sec - exiting 05:00:32 (7548): No heartbeat from core client for 30 sec - exiting 05:00:33 (7548): No heartbeat from core client for 30 sec - exiting 05:00:34 (7548): No heartbeat from core client for 30 sec - exiting 05:00:35 (7548): No heartbeat from core client for 30 sec - exiting 05:00:36 (7548): No heartbeat from core client for 30 sec - exiting 05:00:37 (7548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1344, selfPID=9404, iMonCtr=1 Model crash detected, will try to restart... 10:46:26 (4288): No heartbeat from core client for 30 sec - exiting 10:46:28 (4288): No heartbeat from core client for 30 sec - exiting 10:46:29 (4288): No heartbeat from core client for 30 sec - exiting 10:46:30 (4288): No heartbeat from core client for 30 sec - exiting 10:46:31 (4288): No heartbeat from core client for 30 sec - exiting 10:46:32 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8936, selfPID=8852, iMonCtr=1 Model crash detected, will try to restart... 10:56:11 (5908): No heartbeat from core client for 30 sec - exiting 10:56:13 (5908): No heartbeat from core client for 30 sec - exiting 10:56:14 (5908): No heartbeat from core client for 30 sec - exiting 10:56:15 (5908): No heartbeat from core client for 30 sec - exiting 10:56:16 (5908): No heartbeat from core client for 30 sec - exiting 10:56:17 (5908): No heartbeat from core client for 30 sec - exiting 10:56:18 (5908): No heartbeat from core client for 30 sec - exiting 10:56:19 (5908): No heartbeat from core client for 30 sec - exiting 10:56:21 (5908): No heartbeat from core client for 30 sec - exiting 10:56:22 (5908): No heartbeat from core client for 30 sec - exiting 10:56:23 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7480, selfPID=7480, iMonCtr=2 11:49:22 (6896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6868, selfPID=8768, iMonCtr=1 Model crash detected, will try to restart... 12:38:12 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:00 (10132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:11:12 (7864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:47 (9724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:56 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:38:52 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:27:40 (8476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:49 (5184): No heartbeat from core client for 30 sec - exiting 01:07:50 (5184): No heartbeat from core client for 30 sec - exiting 01:07:51 (5184): No heartbeat from core client for 30 sec - exiting 01:07:52 (5184): No heartbeat from core client for 30 sec - exiting 01:07:53 (5184): No heartbeat from core client for 30 sec - exiting 01:07:54 (5184): No heartbeat from core client for 30 sec - exiting 01:07:55 (5184): No heartbeat from core client for 30 sec - exiting 01:07:56 (5184): No heartbeat from core client for 30 sec - exiting 01:07:57 (5184): No heartbeat from core client for 30 sec - exiting 01:07:58 (5184): No heartbeat from core client for 30 sec - exiting 01:07:59 (5184): No heartbeat from core client for 30 sec - exiting 01:08:00 (5184): No heartbeat from core client for 30 sec - exiting 01:08:01 (5184): No heartbeat from core client for 30 sec - exiting 01:08:02 (5184): No heartbeat from core client for 30 sec - exiting 01:08:03 (5184): No heartbeat from core client for 30 sec - exiting 01:08:04 (5184): No heartbeat from core client for 30 sec - exiting 01:08:05 (5184): No heartbeat from core client for 30 sec - exiting 01:08:06 (5184): No heartbeat from core client for 30 sec - exiting 01:08:07 (5184): No heartbeat from core client for 30 sec - exiting 01:08:08 (5184): No heartbeat from core client for 30 sec - exiting 01:08:09 (5184): No heartbeat from core client for 30 sec - exiting 01:08:10 (5184): No heartbeat from core client for 30 sec - exiting 01:08:11 (5184): No heartbeat from core client for 30 sec - exiting 01:08:12 (5184): No heartbeat from core client for 30 sec - exiting 01:08:13 (5184): No heartbeat from core client for 30 sec - exiting 01:08:14 (5184): No heartbeat from core client for 30 sec - exiting 01:08:15 (5184): No heartbeat from core client for 30 sec - exiting 01:08:16 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:47 (8072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6588, selfPID=6588, iMonCtr=2 07:00:40 (12164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3568, selfPID=3568, iMonCtr=2 07:00:41 (12164): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15016, selfPID=13784, iMonCtr=1 Model crash detected, will try to restart... 10:04:08 (6308): No heartbeat from core client for 30 sec - exiting 10:04:09 (6308): No heartbeat from core client for 30 sec - exiting 10:04:11 (6308): No heartbeat from core client for 30 sec - exiting 10:04:12 (6308): No heartbeat from core client for 30 sec - exiting 10:04:13 (6308): No heartbeat from core client for 30 sec - exiting 10:04:14 (6308): No heartbeat from core client for 30 sec - exiting 10:04:15 (6308): No heartbeat from core client for 30 sec - exiting 10:04:16 (6308): No heartbeat from core client for 30 sec - exiting 10:04:17 (6308): No heartbeat from core client for 30 sec - exiting 10:04:18 (6308): No heartbeat from core client for 30 sec - exiting 10:04:19 (6308): No heartbeat from core client for 30 sec - exiting 10:04:20 (6308): No heartbeat from core client for 30 sec - exiting 10:04:22 (6308): No heartbeat from core client for 30 sec - exiting 10:04:23 (6308): No heartbeat from core client for 30 sec - exiting 10:04:24 (6308): No heartbeat from core client for 30 sec - exiting 10:04:25 (6308): No heartbeat from core client for 30 sec - exiting 10:04:26 (6308): No heartbeat from core client for 30 sec - exiting 10:04:27 (6308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7848, selfPID=6644, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7436, selfPID=9900, iMonCtr=1 Model crash detected, will try to restart... 10:34:37 (6852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10212, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7592, selfPID=8080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 02:16:31 (3088): No heartbeat from core client for 30 sec - exiting 02:16:32 (3088): No heartbeat from core client for 30 sec - exiting 02:16:33 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:18:48 (8116): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8376, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11436, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 14:16:41 (6080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:42 (6080): No heartbeat from core client for 30 sec - exiting 14:16:43 (6080): No heartbeat from core client for 30 sec - exiting 14:16:44 (6080): No heartbeat from core client for 30 sec - exiting 14:16:45 (6080): No heartbeat from core client for 30 sec - exiting 14:16:46 (6080): No heartbeat from core client for 30 sec - exiting 14:16:47 (6080): No heartbeat from core client for 30 sec - exiting 14:26:27 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:03 (1772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:04 (1772): No heartbeat from core client for 30 sec - exiting 16:48:08 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:48:09 (3088): No heartbeat from core client for 30 sec - exiting 16:48:10 (3088): No heartbeat from core client for 30 sec - exiting 16:48:11 (3088): No heartbeat from core client for 30 sec - exiting 16:48:12 (3088): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13200, selfPID=8944, iMonCtr=1 Model crash detected, will try to restart... 01:12:08 (7360): No heartbeat from core client for 30 sec - exiting 01:12:10 (7360): No heartbeat from core client for 30 sec - exiting 01:12:11 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:23 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:24 (4556): No heartbeat from core client for 30 sec - exiting 04:24:44 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:15 (9500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:56:12 (8584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:56:13 (8584): No heartbeat from core client for 30 sec - exiting 06:56:14 (8584): No heartbeat from core client for 30 sec - exiting 06:56:15 (8584): No heartbeat from core client for 30 sec - exiting 06:56:16 (8584): No heartbeat from core client for 30 sec - exiting 06:56:17 (8584): No heartbeat from core client for 30 sec - exiting 06:56:18 (8584): No heartbeat from core client for 30 sec - exiting 07:44:36 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5392, selfPID=5720, iMonCtr=1 Model crash detected, will try to restart... 11:59:17 (7700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:18 (7700): No heartbeat from core client for 30 sec - exiting 11:59:19 (7700): No heartbeat from core client for 30 sec - exiting 11:59:20 (7700): No heartbeat from core client for 30 sec - exiting 11:59:21 (7700): No heartbeat from core client for 30 sec - exiting 11:59:22 (7700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:59:08 (2064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:16 (11940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:11:22 (12120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:23 (12120): No heartbeat from core client for 30 sec - exiting 20:09:31 (15320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:44 (5608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:04 (10116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6532, selfPID=6532, iMonCtr=2 20:16:05 (10116): No heartbeat from core client for 30 sec - exiting 20:17:38 (13768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:24 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:25 (5420): No heartbeat from core client for 30 sec - exiting 20:35:26 (5420): No heartbeat from core client for 30 sec - exiting 20:35:27 (5420): No heartbeat from core client for 30 sec - exiting 20:35:28 (5420): No heartbeat from core client for 30 sec - exiting 20:35:29 (5420): No heartbeat from core client for 30 sec - exiting 20:35:30 (5420): No heartbeat from core client for 30 sec - exiting 20:35:31 (5420): No heartbeat from core client for 30 sec - exiting 20:37:06 (15768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14464, iMonCtr=2 </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_a3hw_2013_1_008520873_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_a3hw_2013_1_008520873_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_a3hw_2013_1_008520873_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Mar 2014 07:09:46	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	103,776	251,682	2.4252
20 Mar 2014 18:47:49	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	92,256	223,173	2.4191
19 Mar 2014 10:21:49	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	80,736	194,757	2.4123
18 Mar 2014 07:03:06	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	69,216	166,708	2.4085
17 Mar 2014 07:55:17	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	57,696	139,759	2.4223
16 Mar 2014 04:41:27	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	46,176	111,959	2.4246
15 Mar 2014 04:40:05	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	34,656	85,405	2.4644
13 Mar 2014 17:54:40	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	23,136	57,946	2.5046
12 Mar 2014 08:52:49	1229790	16365361	hadam3p_eu_a3hw_2013_1_008520873_1	11,616	29,718	2.5584