Task 17585119

Name	hadam3p_anz_f5x8_2012_1_009298920_0
Workunit	9383108
Created	17 Dec 2014, 18:46:56 UTC
Sent	31 Dec 2014, 18:43:15 UTC
Report deadline	14 Dec 2015, 0:03:15 UTC
Received	26 Feb 2015, 16:58:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1159643
Run time	4 days 22 hours 41 min 7 sec
CPU time	4 days 19 hours 18 min 6 sec
Validate state	Invalid
Credit	5,477.92
Device peak FLOPS	4.75 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:55:11 (5340): No heartbeat from core client for 30 sec - exiting 10:55:12 (5340): No heartbeat from core client for 30 sec - exiting 10:55:13 (5340): No heartbeat from core client for 30 sec - exiting 10:55:14 (5340): No heartbeat from core client for 30 sec - exiting 10:55:15 (5340): No heartbeat from core client for 30 sec - exiting 10:55:16 (5340): No heartbeat from core client for 30 sec - exiting 10:55:17 (5340): No heartbeat from core client for 30 sec - exiting 10:55:18 (5340): No heartbeat from core client for 30 sec - exiting 10:55:19 (5340): No heartbeat from core client for 30 sec - exiting 10:55:20 (5340): No heartbeat from core client for 30 sec - exiting 10:55:21 (5340): No heartbeat from core client for 30 sec - exiting 10:55:22 (5340): No heartbeat from core client for 30 sec - exiting 10:55:23 (5340): No heartbeat from core client for 30 sec - exiting 10:55:24 (5340): No heartbeat from core client for 30 sec - exiting 10:55:25 (5340): No heartbeat from core client for 30 sec - exiting 10:55:26 (5340): No heartbeat from core client for 30 sec - exiting 10:55:27 (5340): No heartbeat from core client for 30 sec - exiting 10:55:28 (5340): No heartbeat from core client for 30 sec - exiting 10:55:29 (5340): No heartbeat from core client for 30 sec - exiting 10:55:30 (5340): No heartbeat from core client for 30 sec - exiting 10:55:31 (5340): No heartbeat from core client for 30 sec - exiting 10:55:32 (5340): No heartbeat from core client for 30 sec - exiting 10:55:33 (5340): No heartbeat from core client for 30 sec - exiting 10:55:34 (5340): No heartbeat from core client for 30 sec - exiting 10:55:35 (5340): No heartbeat from core client for 30 sec - exiting 10:55:36 (5340): No heartbeat from core client for 30 sec - exiting 10:55:37 (5340): No heartbeat from core client for 30 sec - exiting 10:55:38 (5340): No heartbeat from core client for 30 sec - exiting 10:55:39 (5340): No heartbeat from core client for 30 sec - exiting 10:55:40 (5340): No heartbeat from core client for 30 sec - exiting 10:55:41 (5340): No heartbeat from core client for 30 sec - exiting 10:55:42 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:01:12 (5892): No heartbeat from core client for 30 sec - exiting 09:01:13 (5892): No heartbeat from core client for 30 sec - exiting 09:01:14 (5892): No heartbeat from core client for 30 sec - exiting 09:01:16 (5892): No heartbeat from core client for 30 sec - exiting 09:01:17 (5892): No heartbeat from core client for 30 sec - exiting 09:01:18 (5892): No heartbeat from core client for 30 sec - exiting 09:01:19 (5892): No heartbeat from core client for 30 sec - exiting 09:01:20 (5892): No heartbeat from core client for 30 sec - exiting 09:01:21 (5892): No heartbeat from core client for 30 sec - exiting 09:01:22 (5892): No heartbeat from core client for 30 sec - exiting 09:01:23 (5892): No heartbeat from core client for 30 sec - exiting 09:01:24 (5892): No heartbeat from core client for 30 sec - exiting 09:01:25 (5892): No heartbeat from core client for 30 sec - exiting 09:01:26 (5892): No heartbeat from core client for 30 sec - exiting 09:01:28 (5892): No heartbeat from core client for 30 sec - exiting 09:01:29 (5892): No heartbeat from core client for 30 sec - exiting 09:01:30 (5892): No heartbeat from core client for 30 sec - exiting 09:01:31 (5892): No heartbeat from core client for 30 sec - exiting 09:01:32 (5892): No heartbeat from core client for 30 sec - exiting 09:01:33 (5892): No heartbeat from core client for 30 sec - exiting 09:01:34 (5892): No heartbeat from core client for 30 sec - exiting 09:01:35 (5892): No heartbeat from core client for 30 sec - exiting 09:01:36 (5892): No heartbeat from core client for 30 sec - exiting 09:01:37 (5892): No heartbeat from core client for 30 sec - exiting 09:01:38 (5892): No heartbeat from core client for 30 sec - exiting 09:01:40 (5892): No heartbeat from core client for 30 sec - exiting 09:01:41 (5892): No heartbeat from core client for 30 sec - exiting 09:01:42 (5892): No heartbeat from core client for 30 sec - exiting 09:01:43 (5892): No heartbeat from core client for 30 sec - exiting 09:01:44 (5892): No heartbeat from core client for 30 sec - exiting 09:01:45 (5892): No heartbeat from core client for 30 sec - exiting 09:01:46 (5892): No heartbeat from core client for 30 sec - exiting 09:01:47 (5892): No heartbeat from core client for 30 sec - exiting 09:01:48 (5892): No heartbeat from core client for 30 sec - exiting 09:01:49 (5892): No heartbeat from core client for 30 sec - exiting 09:01:50 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4628, selfPID=4628, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 08:24:00 (5372): No heartbeat from core client for 30 sec - exiting 08:24:01 (5372): No heartbeat from core client for 30 sec - exiting 08:24:02 (5372): No heartbeat from core client for 30 sec - exiting 08:24:03 (5372): No heartbeat from core client for 30 sec - exiting 08:24:04 (5372): No heartbeat from core client for 30 sec - exiting 08:24:05 (5372): No heartbeat from core client for 30 sec - exiting 08:24:06 (5372): No heartbeat from core client for 30 sec - exiting 08:24:07 (5372): No heartbeat from core client for 30 sec - exiting 08:24:09 (5372): No heartbeat from core client for 30 sec - exiting 08:24:10 (5372): No heartbeat from core client for 30 sec - exiting 08:24:11 (5372): No heartbeat from core client for 30 sec - exiting 08:24:12 (5372): No heartbeat from core client for 30 sec - exiting 08:24:13 (5372): No heartbeat from core client for 30 sec - exiting 08:24:14 (5372): No heartbeat from core client for 30 sec - exiting 08:24:15 (5372): No heartbeat from core client for 30 sec - exiting 08:24:16 (5372): No heartbeat from core client for 30 sec - exiting 08:24:17 (5372): No heartbeat from core client for 30 sec - exiting 08:24:18 (5372): No heartbeat from core client for 30 sec - exiting 08:24:19 (5372): No heartbeat from core client for 30 sec - exiting 08:24:21 (5372): No heartbeat from core client for 30 sec - exiting 08:24:22 (5372): No heartbeat from core client for 30 sec - exiting 08:24:23 (5372): No heartbeat from core client for 30 sec - exiting 08:24:24 (5372): No heartbeat from core client for 30 sec - exiting 08:24:25 (5372): No heartbeat from core client for 30 sec - exiting 08:24:26 (5372): No heartbeat from core client for 30 sec - exiting 08:24:27 (5372): No heartbeat from core client for 30 sec - exiting 08:24:28 (5372): No heartbeat from core client for 30 sec - exiting 08:25:40 (5372): No heartbeat from core client for 30 sec - exiting 08:25:41 (5372): No heartbeat from core client for 30 sec - exiting 08:25:42 (5372): No heartbeat from core client for 30 sec - exiting 08:25:43 (5372): No heartbeat from core client for 30 sec - exiting 08:25:44 (5372): No heartbeat from core client for 30 sec - exiting 08:25:45 (5372): No heartbeat from core client for 30 sec - exiting 08:25:46 (5372): No heartbeat from core client for 30 sec - exiting 08:25:47 (5372): No heartbeat from core client for 30 sec - exiting 08:25:48 (5372): No heartbeat from core client for 30 sec - exiting 08:25:49 (5372): No heartbeat from core client for 30 sec - exiting 08:25:50 (5372): No heartbeat from core client for 30 sec - exiting 08:25:51 (5372): No heartbeat from core client for 30 sec - exiting 08:25:52 (5372): No heartbeat from core client for 30 sec - exiting 08:25:53 (5372): No heartbeat from core client for 30 sec - exiting 08:25:54 (5372): No heartbeat from core client for 30 sec - exiting 08:25:55 (5372): No heartbeat from core client for 30 sec - exiting 08:25:56 (5372): No heartbeat from core client for 30 sec - exiting 08:25:57 (5372): No heartbeat from core client for 30 sec - exiting 08:25:58 (5372): No heartbeat from core client for 30 sec - exiting 08:25:59 (5372): No heartbeat from core client for 30 sec - exiting 08:26:00 (5372): No heartbeat from core client for 30 sec - exiting 08:26:01 (5372): No heartbeat from core client for 30 sec - exiting 08:26:02 (5372): No heartbeat from core client for 30 sec - exiting 08:26:03 (5372): No heartbeat from core client for 30 sec - exiting 08:26:04 (5372): No heartbeat from core client for 30 sec - exiting 08:26:05 (5372): No heartbeat from core client for 30 sec - exiting 10:37:49 (7008): No heartbeat from core client for 30 sec - exiting 10:37:50 (7008): No heartbeat from core client for 30 sec - exiting 10:37:51 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6120, selfPID=6120, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4616, selfPID=2104, iMonCtr=1 Model crash detected, will try to restart... 21:34:04 (6228): No heartbeat from core client for 30 sec - exiting 21:34:07 (6228): No heartbeat from core client for 30 sec - exiting 21:34:08 (6228): No heartbeat from core client for 30 sec - exiting 21:34:09 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:27 (5268): No heartbeat from core client for 30 sec - exiting 08:54:28 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7048, selfPID=1712, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 08:52:10 (6240): No heartbeat from core client for 30 sec - exiting 08:52:11 (6240): No heartbeat from core client for 30 sec - exiting 08:52:12 (6240): No heartbeat from core client for 30 sec - exiting 08:52:13 (6240): No heartbeat from core client for 30 sec - exiting 08:52:14 (6240): No heartbeat from core client for 30 sec - exiting 08:52:15 (6240): No heartbeat from core client for 30 sec - exiting 08:52:16 (6240): No heartbeat from core client for 30 sec - exiting 08:52:17 (6240): No heartbeat from core client for 30 sec - exiting 08:52:18 (6240): No heartbeat from core client for 30 sec - exiting 08:52:19 (6240): No heartbeat from core client for 30 sec - exiting 08:52:20 (6240): No heartbeat from core client for 30 sec - exiting 08:52:21 (6240): No heartbeat from core client for 30 sec - exiting 08:52:22 (6240): No heartbeat from core client for 30 sec - exiting 08:52:23 (6240): No heartbeat from core client for 30 sec - exiting 08:52:24 (6240): No heartbeat from core client for 30 sec - exiting 08:52:25 (6240): No heartbeat from core client for 30 sec - exiting 08:52:26 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1332, selfPID=1332, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:34 (2888): No heartbeat from core client for 30 sec - exiting 08:15:36 (2888): No heartbeat from core client for 30 sec - exiting 08:15:37 (2888): No heartbeat from core client for 30 sec - exiting 08:15:38 (2888): No heartbeat from core client for 30 sec - exiting 08:15:39 (2888): No heartbeat from core client for 30 sec - exiting 08:15:40 (2888): No heartbeat from core client for 30 sec - exiting 08:15:41 (2888): No heartbeat from core client for 30 sec - exiting 08:15:42 (2888): No heartbeat from core client for 30 sec - exiting 08:16:13 (2888): No heartbeat from core client for 30 sec - exiting 08:16:14 (2888): No heartbeat from core client for 30 sec - exiting 08:16:15 (2888): No heartbeat from core client for 30 sec - exiting 08:16:16 (2888): No heartbeat from core client for 30 sec - exiting 08:16:17 (2888): No heartbeat from core client for 30 sec - exiting 08:16:18 (2888): No heartbeat from core client for 30 sec - exiting 08:16:19 (2888): No heartbeat from core client for 30 sec - exiting 08:16:20 (2888): No heartbeat from core client for 30 sec - exiting 08:16:21 (2888): No heartbeat from core client for 30 sec - exiting 08:16:22 (2888): No heartbeat from core client for 30 sec - exiting 08:16:23 (2888): No heartbeat from core client for 30 sec - exiting 08:16:24 (2888): No heartbeat from core client for 30 sec - exiting 08:16:25 (2888): No heartbeat from core client for 30 sec - exiting 08:16:26 (2888): No heartbeat from core client for 30 sec - exiting 08:16:27 (2888): No heartbeat from core client for 30 sec - exiting 08:16:28 (2888): No heartbeat from core client for 30 sec - exiting 08:16:29 (2888): No heartbeat from core client for 30 sec - exiting 08:16:30 (2888): No heartbeat from core client for 30 sec - exiting 08:16:31 (2888): No heartbeat from core client for 30 sec - exiting 08:16:32 (2888): No heartbeat from core client for 30 sec - exiting 08:16:33 (2888): No heartbeat from core client for 30 sec - exiting 08:16:34 (2888): No heartbeat from core client for 30 sec - exiting 08:16:35 (2888): No heartbeat from core client for 30 sec - exiting 08:16:36 (2888): No heartbeat from core client for 30 sec - exiting 08:16:37 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:44 (5856): No heartbeat from core client for 30 sec - exiting 20:36:45 (5856): No heartbeat from core client for 30 sec - exiting 20:36:46 (5856): No heartbeat from core client for 30 sec - exiting 20:36:47 (5856): No heartbeat from core client for 30 sec - exiting 20:36:48 (5856): No heartbeat from core client for 30 sec - exiting 20:36:49 (5856): No heartbeat from core client for 30 sec - exiting 20:36:50 (5856): No heartbeat from core client for 30 sec - exiting 20:36:51 (5856): No heartbeat from core client for 30 sec - exiting 20:36:52 (5856): No heartbeat from core client for 30 sec - exiting 20:37:27 (5856): No heartbeat from core client for 30 sec - exiting 20:37:28 (5856): No heartbeat from core client for 30 sec - exiting 20:37:29 (5856): No heartbeat from core client for 30 sec - exiting 20:37:31 (5856): No heartbeat from core client for 30 sec - exiting 20:37:32 (5856): No heartbeat from core client for 30 sec - exiting 20:37:33 (5856): No heartbeat from core client for 30 sec - exiting 20:37:34 (5856): No heartbeat from core client for 30 sec - exiting 20:37:35 (5856): No heartbeat from core client for 30 sec - exiting 20:37:36 (5856): No heartbeat from core client for 30 sec - exiting 20:37:37 (5856): No heartbeat from core client for 30 sec - exiting 20:37:38 (5856): No heartbeat from core client for 30 sec - exiting 20:37:39 (5856): No heartbeat from core client for 30 sec - exiting 20:37:40 (5856): No heartbeat from core client for 30 sec - exiting 20:37:41 (5856): No heartbeat from core client for 30 sec - exiting 20:37:43 (5856): No heartbeat from core client for 30 sec - exiting 20:37:44 (5856): No heartbeat from core client for 30 sec - exiting 20:37:45 (5856): No heartbeat from core client for 30 sec - exiting 20:37:46 (5856): No heartbeat from core client for 30 sec - exiting 20:37:47 (5856): No heartbeat from core client for 30 sec - exiting 20:37:48 (5856): No heartbeat from core client for 30 sec - exiting 20:37:49 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1152, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3476, selfPID=6656, iMonCtr=1 Model crash detected, will try to restart... 08:45:28 (7076): No heartbeat from core client for 30 sec - exiting 08:45:29 (7076): No heartbeat from core client for 30 sec - exiting 08:45:30 (7076): No heartbeat from core client for 30 sec - exiting 08:45:31 (7076): No heartbeat from core client for 30 sec - exiting 08:45:32 (7076): No heartbeat from core client for 30 sec - exiting 08:45:33 (7076): No heartbeat from core client for 30 sec - exiting 08:45:34 (7076): No heartbeat from core client for 30 sec - exiting 08:45:35 (7076): No heartbeat from core client for 30 sec - exiting 08:45:36 (7076): No heartbeat from core client for 30 sec - exiting 08:46:07 (7076): No heartbeat from core client for 30 sec - exiting 08:46:08 (7076): No heartbeat from core client for 30 sec - exiting 08:46:09 (7076): No heartbeat from core client for 30 sec - exiting 08:46:10 (7076): No heartbeat from core client for 30 sec - exiting 08:46:11 (7076): No heartbeat from core client for 30 sec - exiting 08:46:12 (7076): No heartbeat from core client for 30 sec - exiting 08:46:13 (7076): No heartbeat from core client for 30 sec - exiting 08:46:14 (7076): No heartbeat from core client for 30 sec - exiting 08:46:15 (7076): No heartbeat from core client for 30 sec - exiting 08:46:16 (7076): No heartbeat from core client for 30 sec - exiting 08:46:17 (7076): No heartbeat from core client for 30 sec - exiting 08:46:18 (7076): No heartbeat from core client for 30 sec - exiting 08:46:19 (7076): No heartbeat from core client for 30 sec - exiting 08:46:20 (7076): No heartbeat from core client for 30 sec - exiting 08:46:21 (7076): No heartbeat from core client for 30 sec - exiting 08:46:22 (7076): No heartbeat from core client for 30 sec - exiting 08:46:23 (7076): No heartbeat from core client for 30 sec - exiting 08:46:24 (7076): No heartbeat from core client for 30 sec - exiting 08:46:25 (7076): No heartbeat from core client for 30 sec - exiting 08:46:26 (7076): No heartbeat from core client for 30 sec - exiting 08:46:27 (7076): No heartbeat from core client for 30 sec - exiting 08:46:28 (7076): No heartbeat from core client for 30 sec - exiting 08:46:29 (7076): No heartbeat from core client for 30 sec - exiting 08:46:30 (7076): No heartbeat from core client for 30 sec - exiting 08:46:31 (7076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:44 (7080): No heartbeat from core client for 30 sec - exiting 21:25:45 (7080): No heartbeat from core client for 30 sec - exiting 21:25:46 (7080): No heartbeat from core client for 30 sec - exiting 21:25:47 (7080): No heartbeat from core client for 30 sec - exiting 21:25:48 (7080): No heartbeat from core client for 30 sec - exiting 21:25:49 (7080): No heartbeat from core client for 30 sec - exiting 21:25:50 (7080): No heartbeat from core client for 30 sec - exiting 21:25:51 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:24:47 (5340): No heartbeat from core client for 30 sec - exiting 11:24:49 (5340): No heartbeat from core client for 30 sec - exiting 11:24:50 (5340): No heartbeat from core client for 30 sec - exiting 11:24:51 (5340): No heartbeat from core client for 30 sec - exiting 11:24:52 (5340): No heartbeat from core client for 30 sec - exiting 11:24:53 (5340): No heartbeat from core client for 30 sec - exiting 11:24:54 (5340): No heartbeat from core client for 30 sec - exiting 11:24:55 (5340): No heartbeat from core client for 30 sec - exiting 11:24:56 (5340): No heartbeat from core client for 30 sec - exiting 11:24:58 (5340): No heartbeat from core client for 30 sec - exiting 11:24:59 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4428, selfPID=3112, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2216, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... 10:46:07 (7104): No heartbeat from core client for 30 sec - exiting 10:46:08 (7104): No heartbeat from core client for 30 sec - exiting 10:46:09 (7104): No heartbeat from core client for 30 sec - exiting 10:46:10 (7104): No heartbeat from core client for 30 sec - exiting 10:46:11 (7104): No heartbeat from core client for 30 sec - exiting 10:46:12 (7104): No heartbeat from core client for 30 sec - exiting 10:46:13 (7104): No heartbeat from core client for 30 sec - exiting 10:46:14 (7104): No heartbeat from core client for 30 sec - exiting 10:46:15 (7104): No heartbeat from core client for 30 sec - exiting 10:46:16 (7104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:34:06 (3004): No heartbeat from core client for 30 sec - exiting 08:34:07 (3004): No heartbeat from core client for 30 sec - exiting 08:34:08 (3004): No heartbeat from core client for 30 sec - exiting 08:34:10 (3004): No heartbeat from core client for 30 sec - exiting 08:34:11 (3004): No heartbeat from core client for 30 sec - exiting 08:34:12 (3004): No heartbeat from core client for 30 sec - exiting 08:34:13 (3004): No heartbeat from core client for 30 sec - exiting 08:34:14 (3004): No heartbeat from core client for 30 sec - exiting 08:34:15 (3004): No heartbeat from core client for 30 sec - exiting 08:34:16 (3004): No heartbeat from core client for 30 sec - exiting 08:34:17 (3004): No heartbeat from core client for 30 sec - exiting 08:34:18 (3004): No heartbeat from core client for 30 sec - exiting 08:34:19 (3004): No heartbeat from core client for 30 sec - exiting 08:34:20 (3004): No heartbeat from core client for 30 sec - exiting 08:34:22 (3004): No heartbeat from core client for 30 sec - exiting 08:34:23 (3004): No heartbeat from core client for 30 sec - exiting 08:34:24 (3004): No heartbeat from core client for 30 sec - exiting 08:34:25 (3004): No heartbeat from core client for 30 sec - exiting 08:34:26 (3004): No heartbeat from core client for 30 sec - exiting 08:34:27 (3004): No heartbeat from core client for 30 sec - exiting 08:34:28 (3004): No heartbeat from core client for 30 sec - exiting 08:34:29 (3004): No heartbeat from core client for 30 sec - exiting 08:34:30 (3004): No heartbeat from core client for 30 sec - exiting 08:34:31 (3004): No heartbeat from core client for 30 sec - exiting 08:34:32 (3004): No heartbeat from core client for 30 sec - exiting 08:34:34 (3004): No heartbeat from core client for 30 sec - exiting 08:34:35 (3004): No heartbeat from core client for 30 sec - exiting 08:34:36 (3004): No heartbeat from core client for 30 sec - exiting 08:34:37 (3004): No heartbeat from core client for 30 sec - exiting 08:34:38 (3004): No heartbeat from core client for 30 sec - exiting 08:34:39 (3004): No heartbeat from core client for 30 sec - exiting 08:34:40 (3004): No heartbeat from core client for 30 sec - exiting 08:34:41 (3004): No heartbeat from core client for 30 sec - exiting 08:34:42 (3004): No heartbeat from core client for 30 sec - exiting 08:34:43 (3004): No heartbeat from core client for 30 sec - exiting 08:34:44 (3004): No heartbeat from core client for 30 sec - exiting 08:34:46 (3004): No heartbeat from core client for 30 sec - exiting 08:34:47 (3004): No heartbeat from core client for 30 sec - exiting 08:34:48 (3004): No heartbeat from core client for 30 sec - exiting 08:34:49 (3004): No heartbeat from core client for 30 sec - exiting 08:34:50 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:05 (3796): No heartbeat from core client for 30 sec - exiting 18:20:07 (3796): No heartbeat from core client for 30 sec - exiting 18:20:08 (3796): No heartbeat from core client for 30 sec - exiting 18:20:09 (3796): No heartbeat from core client for 30 sec - exiting 18:20:10 (3796): No heartbeat from core client for 30 sec - exiting 18:20:11 (3796): No heartbeat from core client for 30 sec - exiting 18:20:12 (3796): No heartbeat from core client for 30 sec - exiting 18:20:13 (3796): No heartbeat from core client for 30 sec - exiting 18:20:14 (3796): No heartbeat from core client for 30 sec - exiting 18:20:15 (3796): No heartbeat from core client for 30 sec - exiting 18:20:16 (3796): No heartbeat from core client for 30 sec - exiting 18:20:17 (3796): No heartbeat from core client for 30 sec - exiting 18:20:18 (3796): No heartbeat from core client for 30 sec - exiting 18:20:19 (3796): No heartbeat from core client for 30 sec - exiting 18:20:20 (3796): No heartbeat from core client for 30 sec - exiting 18:20:21 (3796): No heartbeat from core client for 30 sec - exiting 18:20:22 (3796): No heartbeat from core client for 30 sec - exiting 18:20:23 (3796): No heartbeat from core client for 30 sec - exiting 18:20:24 (3796): No heartbeat from core client for 30 sec - exiting 18:20:25 (3796): No heartbeat from core client for 30 sec - exiting 18:20:26 (3796): No heartbeat from core client for 30 sec - exiting 18:20:27 (3796): No heartbeat from core client for 30 sec - exiting 18:20:28 (3796): No heartbeat from core client for 30 sec - exiting 18:20:29 (3796): No heartbeat from core client for 30 sec - exiting 18:20:30 (3796): No heartbeat from core client for 30 sec - exiting 18:20:31 (3796): No heartbeat from core client for 30 sec - exiting 18:20:32 (3796): No heartbeat from core client for 30 sec - exiting 18:20:33 (3796): No heartbeat from core client for 30 sec - exiting 18:20:34 (3796): No heartbeat from core client for 30 sec - exiting 18:20:35 (3796): No heartbeat from core client for 30 sec - exiting 18:20:36 (3796): No heartbeat from core client for 30 sec - exiting 18:20:37 (3796): No heartbeat from core client for 30 sec - exiting 18:20:38 (3796): No heartbeat from core client for 30 sec - exiting 18:20:39 (3796): No heartbeat from core client for 30 sec - exiting 18:20:40 (3796): No heartbeat from core client for 30 sec - exiting 18:20:41 (3796): No heartbeat from core client for 30 sec - exiting 18:20:42 (3796): No heartbeat from core client for 30 sec - exiting 18:20:43 (3796): No heartbeat from core client for 30 sec - exiting 18:20:44 (3796): No heartbeat from core client for 30 sec - exiting 18:20:45 (3796): No heartbeat from core client for 30 sec - exiting 18:20:46 (3796): No heartbeat from core client for 30 sec - exiting 18:20:47 (3796): No heartbeat from core client for 30 sec - exiting 18:20:48 (3796): No heartbeat from core client for 30 sec - exiting 18:20:49 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:09 (6220): No heartbeat from core client for 30 sec - exiting 22:36:12 (6220): No heartbeat from core client for 30 sec - exiting 22:36:13 (6220): No heartbeat from core client for 30 sec - exiting 22:36:14 (6220): No heartbeat from core client for 30 sec - exiting 22:36:15 (6220): No heartbeat from core client for 30 sec - exiting 22:36:16 (6220): No heartbeat from core client for 30 sec - exiting 22:36:17 (6220): No heartbeat from core client for 30 sec - exiting 22:36:18 (6220): No heartbeat from core client for 30 sec - exiting 22:36:19 (6220): No heartbeat from core client for 30 sec - exiting 22:36:20 (6220): No heartbeat from core client for 30 sec - exiting 22:36:21 (6220): No heartbeat from core client for 30 sec - exiting 22:36:22 (6220): No heartbeat from core client for 30 sec - exiting 22:36:23 (6220): No heartbeat from core client for 30 sec - exiting 22:36:24 (6220): No heartbeat from core client for 30 sec - exiting 22:36:25 (6220): No heartbeat from core client for 30 sec - exiting 22:36:26 (6220): No heartbeat from core client for 30 sec - exiting 22:36:27 (6220): No heartbeat from core client for 30 sec - exiting 22:36:28 (6220): No heartbeat from core client for 30 sec - exiting 22:36:29 (6220): No heartbeat from core client for 30 sec - exiting 22:36:30 (6220): No heartbeat from core client for 30 sec - exiting 22:36:31 (6220): No heartbeat from core client for 30 sec - exiting 22:36:32 (6220): No heartbeat from core client for 30 sec - exiting 22:36:33 (6220): No heartbeat from core client for 30 sec - exiting 22:36:34 (6220): No heartbeat from core client for 30 sec - exiting 22:36:35 (6220): No heartbeat from core client for 30 sec - exiting 22:36:36 (6220): No heartbeat from core client for 30 sec - exiting 22:36:37 (6220): No heartbeat from core client for 30 sec - exiting 22:36:38 (6220): No heartbeat from core client for 30 sec - exiting 22:36:39 (6220): No heartbeat from core client for 30 sec - exiting 22:36:40 (6220): No heartbeat from core client for 30 sec - exiting 22:36:41 (6220): No heartbeat from core client for 30 sec - exiting 22:36:42 (6220): No heartbeat from core client for 30 sec - exiting 22:36:43 (6220): No heartbeat from core client for 30 sec - exiting 22:36:44 (6220): No heartbeat from core client for 30 sec - exiting 22:36:45 (6220): No heartbeat from core client for 30 sec - exiting 22:36:46 (6220): No heartbeat from core client for 30 sec - exiting 22:36:47 (6220): No heartbeat from core client for 30 sec - exiting 22:36:48 (6220): No heartbeat from core client for 30 sec - exiting 22:36:49 (6220): No heartbeat from core client for 30 sec - exiting 22:36:50 (6220): No heartbeat from core client for 30 sec - exiting 22:36:51 (6220): No heartbeat from core client for 30 sec - exiting 22:36:52 (6220): No heartbeat from core client for 30 sec - exiting 22:36:53 (6220): No heartbeat from core client for 30 sec - exiting 22:36:54 (6220): No heartbeat from core client for 30 sec - exiting 22:36:55 (6220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3668, selfPID=6188, iMonCtr=1 Model crash detected, will try to restart... C16:54:51 (6268): No heartbeat from core client for 30 sec - exiting 16:54:55 (6268): No heartbeat from core client for 30 sec - exiting 16:54:56 (6268): No heartbeat from core client for 30 sec - exiting 16:54:57 (6268): No heartbeat from core client for 30 sec - exiting 16:54:58 (6268): No heartbeat from core client for 30 sec - exiting 16:54:59 (6268): No heartbeat from core client for 30 sec - exiting 16:55:00 (6268): No heartbeat from core client for 30 sec - exiting 16:55:01 (6268): No heartbeat from core client for 30 sec - exiting 16:55:02 (6268): No heartbeat from core client for 30 sec - exiting 16:55:03 (6268): No heartbeat from core client for 30 sec - exiting 16:55:04 (6268): No heartbeat from core client for 30 sec - exiting 16:55:05 (6268): No heartbeat from core client for 30 sec - exiting 16:55:06 (6268): No heartbeat from core client for 30 sec - exiting 16:55:07 (6268): No heartbeat from core client for 30 sec - exiting 16:55:08 (6268): No heartbeat from core client for 30 sec - exiting 16:55:09 (6268): No heartbeat from core client for 30 sec - exiting 16:55:10 (6268): No heartbeat from core client for 30 sec - exiting 16:55:11 (6268): No heartbeat from core client for 30 sec - exiting 16:55:12 (6268): No heartbeat from core client for 30 sec - exiting 16:55:13 (6268): No heartbeat from core client for 30 sec - exiting 16:55:14 (6268): No heartbeat from core client for 30 sec - exiting 16:55:15 (6268): No heartbeat from core client for 30 sec - exiting 16:55:16 (6268): No heartbeat from core client for 30 sec - exiting 16:55:17 (6268): No heartbeat from core client for 30 sec - exiting 16:55:18 (6268): No heartbeat from core client for 30 sec - exiting 16:55:19 (6268): No heartbeat from core client for 30 sec - exiting 16:55:20 (6268): No heartbeat from core client for 30 sec - exiting 16:55:21 (6268): No heartbeat from core client for 30 sec - exiting 16:55:22 (6268): No heartbeat from core client for 30 sec - exiting 16:55:23 (6268): No heartbeat from core client for 30 sec - exiting 16:55:24 (6268): No heartbeat from core client for 30 sec - exiting 16:55:25 (6268): No heartbeat from core client for 30 sec - exiting 16:55:26 (6268): No heartbeat from core client for 30 sec - exiting 16:55:27 (6268): No heartbeat from core client for 30 sec - exiting 16:55:28 (6268): No heartbeat from core client for 30 sec - exiting 16:55:29 (6268): No heartbeat from core client for 30 sec - exiting 16:55:30 (6268): No heartbeat from core client for 30 sec - exiting 16:55:31 (6268): No heartbeat from core client for 30 sec - exiting 16:55:32 (6268): No heartbeat from core client for 30 sec - exiting 16:55:33 (6268): No heartbeat from core client for 30 sec - exiting 16:55:34 (6268): No heartbeat from core client for 30 sec - exiting 16:55:35 (6268): No heartbeat from core client for 30 sec - exiting 16:55:36 (6268): No heartbeat from core client for 30 sec - exiting 16:55:37 (6268): No heartbeat from core client for 30 sec - exiting 16:55:38 (6268): No heartbeat from core client for 30 sec - exiting 16:55:39 (6268): No heartbeat from core client for 30 sec - exiting 16:55:40 (6268): No heartbeat from core client for 30 sec - exiting 16:55:41 (6268): No heartbeat from core client for 30 sec - exiting 16:55:42 (6268): No heartbeat from core client for 30 sec - exiting 16:55:43 (6268): No heartbeat from core client for 30 sec - exiting 16:55:44 (6268): No heartbeat from core client for 30 sec - exiting 16:55:45 (6268): No heartbeat from core client for 30 sec - exiting 16:55:46 (6268): No heartbeat from core client for 30 sec - exiting 16:55:47 (6268): No heartbeat from core client for 30 sec - exiting 16:55:48 (6268): No heartbeat from core client for 30 sec - exiting 16:55:49 (6268): No heartbeat from core client for 30 sec - exiting 16:55:50 (6268): No heartbeat from core client for 30 sec - exiting 16:55:51 (6268): No heartbeat from core client for 30 sec - exiting 16:55:52 (6268): No heartbeat from core client for 30 sec - exiting 16:55:53 (6268): No heartbeat from core client for 30 sec - exiting 16:55:54 (6268): No heartbeat from core client for 30 sec - exiting 16:55:55 (6268): No heartbeat from core client for 30 sec - exiting 16:55:56 (6268): No heartbeat from core client for 30 sec - exiting 16:55:57 (6268): No heartbeat from core client for 30 sec - exiting 16:55:58 (6268): No heartbeat from core client for 30 sec - exiting 16:55:59 (6268): No heartbeat from core client for 30 sec - exiting 16:56:00 (6268): No heartbeat from core client for 30 sec - exiting 16:56:01 (6268): No heartbeat from core client for 30 sec - exiting 16:56:02 (6268): No heartbeat from core client for 30 sec - exiting 16:56:03 (6268): No heartbeat from core client for 30 sec - exiting 16:56:04 (6268): No heartbeat from core client for 30 sec - exiting 16:56:05 (6268): No heartbeat from core client for 30 sec - exiting 16:56:06 (6268): No heartbeat from core client for 30 sec - exiting 16:56:07 (6268): No heartbeat from core client for 30 sec - exiting 16:56:08 (6268): No heartbeat from core client for 30 sec - exiting 16:56:09 (6268): No heartbeat from core client for 30 sec - exiting 16:56:10 (6268): No heartbeat from core client for 30 sec - exiting 16:56:11 (6268): No heartbeat from core client for 30 sec - exiting 16:56:12 (6268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7792, selfPID=7792, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7872, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7888, selfPID=7856, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f5x8_2012_1_009298920_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Feb 2015 21:33:36	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	127,019	394,928	3.1092
22 Feb 2015 12:51:29	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	115,499	366,272	3.1712
17 Feb 2015 18:11:11	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	103,979	335,009	3.2219
15 Feb 2015 13:43:56	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	92,459	304,327	3.2915
14 Feb 2015 16:20:07	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	80,939	272,700	3.3692
11 Feb 2015 21:05:55	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	69,419	242,372	3.4914
08 Feb 2015 19:41:33	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	57,899	211,389	3.6510
08 Feb 2015 09:59:17	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	46,379	180,783	3.8979
06 Feb 2015 17:55:34	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	34,859	146,468	4.2017
11 Jan 2015 19:20:23	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	23,339	100,397	4.3017
08 Jan 2015 16:21:16	1159643	17585119	hadam3p_anz_f5x8_2012_1_009298920_0	11,819	49,918	4.2235