Task 18616790

Name	hadam3p_anz_f051_2013_1_009942163_0
Workunit	9969525
Created	23 Jun 2015, 19:26:00 UTC
Sent	23 Jun 2015, 19:29:09 UTC
Report deadline	5 Jun 2016, 0:49:09 UTC
Received	6 Dec 2018, 23:10:41 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1366448
Run time	12 days 9 hours 55 min 10 sec
CPU time	10 days 19 hours 43 min 42 sec
Validate state	Workunit error - check skipped
Credit	5,974.74
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Peak working set size	185.78 MB
Peak swap size	184.28 MB
Peak disk usage	41.10 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1024, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3852, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1884, selfPID=3824, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3576, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1060, iMonCtr=2 Model crash detected, will try to restart... 07:21:47 (3744): No heartbeat from core client for 30 sec - exiting 07:21:48 (3744): No heartbeat from core client for 30 sec - exiting 07:21:50 (3744): No heartbeat from core client for 30 sec - exiting 07:21:51 (3744): No heartbeat from core client for 30 sec - exiting 07:21:52 (3744): No heartbeat from core client for 30 sec - exiting 07:21:53 (3744): No heartbeat from core client for 30 sec - exiting 07:21:54 (3744): No heartbeat from core client for 30 sec - exiting 07:21:55 (3744): No heartbeat from core client for 30 sec - exiting 07:21:56 (3744): No heartbeat from core client for 30 sec - exiting 07:21:57 (3744): No heartbeat from core client for 30 sec - exiting 07:21:58 (3744): No heartbeat from core client for 30 sec - exiting 07:21:59 (3744): No heartbeat from core client for 30 sec - exiting 07:22:00 (3744): No heartbeat from core client for 30 sec - exiting 07:22:01 (3744): No heartbeat from core client for 30 sec - exiting 07:22:02 (3744): No heartbeat from core client for 30 sec - exiting 07:22:04 (3744): No heartbeat from core client for 30 sec - exiting 07:22:05 (3744): No heartbeat from core client for 30 sec - exiting 07:22:06 (3744): No heartbeat from core client for 30 sec - exiting 07:22:07 (3744): No heartbeat from core client for 30 sec - exiting 07:22:08 (3744): No heartbeat from core client for 30 sec - exiting 07:22:10 (3744): No heartbeat from core client for 30 sec - exiting 07:22:11 (3744): No heartbeat from core client for 30 sec - exiting 07:22:12 (3744): No heartbeat from core client for 30 sec - exiting 07:22:13 (3744): No heartbeat from core client for 30 sec - exiting 07:22:14 (3744): No heartbeat from core client for 30 sec - exiting 07:22:15 (3744): No heartbeat from core client for 30 sec - exiting 07:22:16 (3744): No heartbeat from core client for 30 sec - exiting 07:22:17 (3744): No heartbeat from core client for 30 sec - exiting 07:22:18 (3744): No heartbeat from core client for 30 sec - exiting 07:22:19 (3744): No heartbeat from core client for 30 sec - exiting 07:22:20 (3744): No heartbeat from core client for 30 sec - exiting 07:22:22 (3744): No heartbeat from core client for 30 sec - exiting 07:22:23 (3744): No heartbeat from core client for 30 sec - exiting 07:22:24 (3744): No heartbeat from core client for 30 sec - exiting 07:22:25 (3744): No heartbeat from core client for 30 sec - exiting 07:22:26 (3744): No heartbeat from core client for 30 sec - exiting 07:22:27 (3744): No heartbeat from core client for 30 sec - exiting 07:22:28 (3744): No heartbeat from core client for 30 sec - exiting 07:22:29 (3744): No heartbeat from core client for 30 sec - exiting 07:22:30 (3744): No heartbeat from core client for 30 sec - exiting 07:22:31 (3744): No heartbeat from core client for 30 sec - exiting 07:22:32 (3744): No heartbeat from core client for 30 sec - exiting 07:22:33 (3744): No heartbeat from core client for 30 sec - exiting 07:22:34 (3744): No heartbeat from core client for 30 sec - exiting 07:22:35 (3744): No heartbeat from core client for 30 sec - exiting 07:22:36 (3744): No heartbeat from core client for 30 sec - exiting 07:22:37 (3744): No heartbeat from core client for 30 sec - exiting 07:22:38 (3744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1264, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... 18:51:19 (3700): No heartbeat from core client for 30 sec - exiting 18:51:20 (3700): No heartbeat from core client for 30 sec - exiting 18:51:21 (3700): No heartbeat from core client for 30 sec - exiting 18:51:22 (3700): No heartbeat from core client for 30 sec - exiting 18:51:23 (3700): No heartbeat from core client for 30 sec - exiting 18:51:24 (3700): No heartbeat from core client for 30 sec - exiting 18:51:25 (3700): No heartbeat from core client for 30 sec - exiting 18:51:27 (3700): No heartbeat from core client for 30 sec - exiting 18:51:28 (3700): No heartbeat from core client for 30 sec - exiting 18:51:29 (3700): No heartbeat from core client for 30 sec - exiting 18:51:30 (3700): No heartbeat from core client for 30 sec - exiting 18:51:31 (3700): No heartbeat from core client for 30 sec - exiting 18:51:32 (3700): No heartbeat from core client for 30 sec - exiting 18:51:33 (3700): No heartbeat from core client for 30 sec - exiting 18:51:34 (3700): No heartbeat from core client for 30 sec - exiting 18:51:35 (3700): No heartbeat from core client for 30 sec - exiting 18:51:36 (3700): No heartbeat from core client for 30 sec - exiting 18:51:38 (3700): No heartbeat from core client for 30 sec - exiting 18:51:39 (3700): No heartbeat from core client for 30 sec - exiting 18:51:40 (3700): No heartbeat from core client for 30 sec - exiting 18:51:41 (3700): No heartbeat from core client for 30 sec - exiting 18:51:42 (3700): No heartbeat from core client for 30 sec - exiting 18:51:43 (3700): No heartbeat from core client for 30 sec - exiting 18:51:44 (3700): No heartbeat from core client for 30 sec - exiting 18:51:45 (3700): No heartbeat from core client for 30 sec - exiting 18:51:46 (3700): No heartbeat from core client for 30 sec - exiting 18:51:48 (3700): No heartbeat from core client for 30 sec - exiting 18:51:49 (3700): No heartbeat from core client for 30 sec - exiting 18:51:50 (3700): No heartbeat from core client for 30 sec - exiting 18:51:51 (3700): No heartbeat from core client for 30 sec - exiting 18:51:52 (3700): No heartbeat from core client for 30 sec - exiting 18:51:53 (3700): No heartbeat from core client for 30 sec - exiting 18:51:54 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2840, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2964, selfPID=2556, iMonCtr=1 Model crash detected, will try to restart... 07:38:51 (3488): No heartbeat from core client for 30 sec - exiting 07:38:53 (3488): No heartbeat from core client for 30 sec - exiting 07:38:54 (3488): No heartbeat from core client for 30 sec - exiting 07:38:55 (3488): No heartbeat from core client for 30 sec - exiting 07:38:56 (3488): No heartbeat from core client for 30 sec - exiting 07:38:57 (3488): No heartbeat from core client for 30 sec - exiting 07:38:58 (3488): No heartbeat from core client for 30 sec - exiting 07:38:59 (3488): No heartbeat from core client for 30 sec - exiting 07:39:00 (3488): No heartbeat from core client for 30 sec - exiting 07:39:01 (3488): No heartbeat from core client for 30 sec - exiting 07:39:02 (3488): No heartbeat from core client for 30 sec - exiting 07:39:03 (3488): No heartbeat from core client for 30 sec - exiting 07:39:05 (3488): No heartbeat from core client for 30 sec - exiting 07:39:06 (3488): No heartbeat from core client for 30 sec - exiting 07:39:07 (3488): No heartbeat from core client for 30 sec - exiting 07:39:08 (3488): No heartbeat from core client for 30 sec - exiting 07:39:09 (3488): No heartbeat from core client for 30 sec - exiting 07:39:10 (3488): No heartbeat from core client for 30 sec - exiting 07:39:11 (3488): No heartbeat from core client for 30 sec - exiting 07:39:12 (3488): No heartbeat from core client for 30 sec - exiting 07:39:13 (3488): No heartbeat from core client for 30 sec - exiting 07:39:14 (3488): No heartbeat from core client for 30 sec - exiting 07:39:16 (3488): No heartbeat from core client for 30 sec - exiting 07:39:17 (3488): No heartbeat from core client for 30 sec - exiting 07:39:18 (3488): No heartbeat from core client for 30 sec - exiting 07:39:19 (3488): No heartbeat from core client for 30 sec - exiting 07:39:20 (3488): No heartbeat from core client for 30 sec - exiting 07:39:21 (3488): No heartbeat from core client for 30 sec - exiting 07:39:22 (3488): No heartbeat from core client for 30 sec - exiting 07:39:23 (3488): No heartbeat from core client for 30 sec - exiting 07:39:24 (3488): No heartbeat from core client for 30 sec - exiting 07:39:26 (3488): No heartbeat from core client for 30 sec - exiting 07:39:27 (3488): No heartbeat from core client for 30 sec - exiting 07:39:28 (3488): No heartbeat from core client for 30 sec - exiting 07:39:29 (3488): No heartbeat from core client for 30 sec - exiting 07:39:30 (3488): No heartbeat from core client for 30 sec - exiting 07:39:31 (3488): No heartbeat from core client for 30 sec - exiting 07:39:32 (3488): No heartbeat from core client for 30 sec - exiting 07:39:33 (3488): No heartbeat from core client for 30 sec - exiting 07:39:34 (3488): No heartbeat from core client for 30 sec - exiting 07:39:35 (3488): No heartbeat from core client for 30 sec - exiting 07:39:37 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=488, selfPID=488, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 09:12:14 (3300): No heartbeat from core client for 30 sec - exiting 09:12:15 (3300): No heartbeat from core client for 30 sec - exiting 09:12:16 (3300): No heartbeat from core client for 30 sec - exiting 09:12:17 (3300): No heartbeat from core client for 30 sec - exiting 09:12:18 (3300): No heartbeat from core client for 30 sec - exiting 09:12:19 (3300): No heartbeat from core client for 30 sec - exiting 09:12:20 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3596, selfPID=3596, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:18:57 (3048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:10:49 (3484): No heartbeat from core client for 30 sec - exiting 08:10:50 (3484): No heartbeat from core client for 30 sec - exiting 08:10:51 (3484): No heartbeat from core client for 30 sec - exiting 08:10:52 (3484): No heartbeat from core client for 30 sec - exiting 08:10:53 (3484): No heartbeat from core client for 30 sec - exiting 08:10:54 (3484): No heartbeat from core client for 30 sec - exiting 08:10:55 (3484): No heartbeat from core client for 30 sec - exiting 08:10:56 (3484): No heartbeat from core client for 30 sec - exiting 08:10:57 (3484): No heartbeat from core client for 30 sec - exiting 08:10:58 (3484): No heartbeat from core client for 30 sec - exiting 08:11:00 (3484): No heartbeat from core client for 30 sec - exiting 08:11:01 (3484): No heartbeat from core client for 30 sec - exiting 08:11:02 (3484): No heartbeat from core client for 30 sec - exiting 08:11:03 (3484): No heartbeat from core client for 30 sec - exiting 08:11:04 (3484): No heartbeat from core client for 30 sec - exiting 08:11:05 (3484): No heartbeat from core client for 30 sec - exiting 08:11:06 (3484): No heartbeat from core client for 30 sec - exiting 08:11:07 (3484): No heartbeat from core client for 30 sec - exiting 08:11:08 (3484): No heartbeat from core client for 30 sec - exiting 08:11:09 (3484): No heartbeat from core client for 30 sec - exiting 08:11:10 (3484): No heartbeat from core client for 30 sec - exiting 08:11:12 (3484): No heartbeat from core client for 30 sec - exiting 08:11:13 (3484): No heartbeat from core client for 30 sec - exiting 08:11:14 (3484): No heartbeat from core client for 30 sec - exiting 08:11:15 (3484): No heartbeat from core client for 30 sec - exiting 08:11:16 (3484): No heartbeat from core client for 30 sec - exiting 08:11:17 (3484): No heartbeat from core client for 30 sec - exiting 08:11:18 (3484): No heartbeat from core client for 30 sec - exiting 08:11:19 (3484): No heartbeat from core client for 30 sec - exiting 08:11:20 (3484): No heartbeat from core client for 30 sec - exiting 08:11:21 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2100, selfPID=2464, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3184, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2900, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2960, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3060, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3512, selfPID=2876, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3556, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3768, selfPID=3400, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3504, selfPID=2944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3452, selfPID=3052, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3028, iMonCtr=2 Model crash detected, will try to restart... 13:59:35 (2956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:36 (2956): No heartbeat from core client for 30 sec - exiting 13:59:37 (2956): No heartbeat from core client for 30 sec - exiting 13:59:38 (2956): No heartbeat from core client for 30 sec - exiting 13:59:39 (2956): No heartbeat from core client for 30 sec - exiting 13:59:40 (2956): No heartbeat from core client for 30 sec - exiting 13:59:41 (2956): No heartbeat from core client for 30 sec - exiting 13:59:42 (2956): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3636, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3528, selfPID=3756, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 22:43:45 (3192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:43:46 (3192): No heartbeat from core client for 30 sec - exiting 22:43:47 (3192): No heartbeat from core client for 30 sec - exiting 22:43:48 (3192): No heartbeat from core client for 30 sec - exiting 22:43:49 (3192): No heartbeat from core client for 30 sec - exiting 19:59:50 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:51 (2748): No heartbeat from core client for 30 sec - exiting 19:59:52 (2748): No heartbeat from core client for 30 sec - exiting 19:59:53 (2748): No heartbeat from core client for 30 sec - exiting 19:59:54 (2748): No heartbeat from core client for 30 sec - exiting 19:59:55 (2748): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:51:01 (1580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:02 (1580): No heartbeat from core client for 30 sec - exiting 21:51:03 (1580): No heartbeat from core client for 30 sec - exiting 21:51:04 (1580): No heartbeat from core client for 30 sec - exiting 21:51:05 (1580): No heartbeat from core client for 30 sec - exiting 21:51:06 (1580): No heartbeat from core client for 30 sec - exiting 21:51:07 (1580): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:26:21 (1832): No heartbeat from core client for 30 sec - exiting 19:26:22 (1832): No heartbeat from core client for 30 sec - exiting 19:26:23 (1832): No heartbeat from core client for 30 sec - exiting 19:26:24 (1832): No heartbeat from core client for 30 sec - exiting 19:26:25 (1832): No heartbeat from core client for 30 sec - exiting 19:26:27 (1832): No heartbeat from core client for 30 sec - exiting 19:26:28 (1832): No heartbeat from core client for 30 sec - exiting 19:26:29 (1832): No heartbeat from core client for 30 sec - exiting 19:26:30 (1832): No heartbeat from core client for 30 sec - exiting 19:26:31 (1832): No heartbeat from core client for 30 sec - exiting 19:26:32 (1832): No heartbeat from core client for 30 sec - exiting 19:26:33 (1832): No heartbeat from core client for 30 sec - exiting 19:26:34 (1832): No heartbeat from core client for 30 sec - exiting 19:26:35 (1832): No heartbeat from core client for 30 sec - exiting 19:26:36 (1832): No heartbeat from core client for 30 sec - exiting 19:26:38 (1832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:44 (3072): No heartbeat from core client for 30 sec - exiting 00:57:45 (3072): No heartbeat from core client for 30 sec - exiting 00:57:46 (3072): No heartbeat from core client for 30 sec - exiting 00:57:47 (3072): No heartbeat from core client for 30 sec - exiting 00:57:48 (3072): No heartbeat from core client for 30 sec - exiting 00:57:49 (3072): No heartbeat from core client for 30 sec - exiting 00:57:50 (3072): No heartbeat from core client for 30 sec - exiting 00:57:51 (3072): No heartbeat from core client for 30 sec - exiting 00:57:52 (3072): No heartbeat from core client for 30 sec - exiting 00:57:54 (3072): No heartbeat from core client for 30 sec - exiting 00:57:55 (3072): No heartbeat from core client for 30 sec - exiting 00:57:56 (3072): No heartbeat from core client for 30 sec - exiting 00:57:57 (3072): No heartbeat from core client for 30 sec - exiting 00:57:58 (3072): No heartbeat from core client for 30 sec - exiting 00:57:59 (3072): No heartbeat from core client for 30 sec - exiting 00:58:00 (3072): No heartbeat from core client for 30 sec - exiting 00:58:01 (3072): No heartbeat from core client for 30 sec - exiting 00:58:02 (3072): No heartbeat from core client for 30 sec - exiting 00:58:03 (3072): No heartbeat from core client for 30 sec - exiting 00:58:05 (3072): No heartbeat from core client for 30 sec - exiting 00:58:06 (3072): No heartbeat from core client for 30 sec - exiting 00:58:07 (3072): No heartbeat from core client for 30 sec - exiting 00:58:08 (3072): No heartbeat from core client for 30 sec - exiting 00:58:09 (3072): No heartbeat from core client for 30 sec - exiting 00:58:10 (3072): No heartbeat from core client for 30 sec - exiting 00:58:11 (3072): No heartbeat from core client for 30 sec - exiting 00:58:12 (3072): No heartbeat from core client for 30 sec - exiting 00:58:13 (3072): No heartbeat from core client for 30 sec - exiting 00:58:14 (3072): No heartbeat from core client for 30 sec - exiting 00:58:15 (3072): No heartbeat from core client for 30 sec - exiting 00:58:17 (3072): No heartbeat from core client for 30 sec - exiting 00:58:18 (3072): No heartbeat from core client for 30 sec - exiting 00:58:19 (3072): No heartbeat from core client for 30 sec - exiting 00:58:20 (3072): No heartbeat from core client for 30 sec - exiting 00:58:21 (3072): No heartbeat from core client for 30 sec - exiting 00:58:22 (3072): No heartbeat from core client for 30 sec - exiting 00:58:23 (3072): No heartbeat from core client for 30 sec - exiting 00:58:24 (3072): No heartbeat from core client for 30 sec - exiting 00:58:25 (3072): No heartbeat from core client for 30 sec - exiting 00:58:26 (3072): No heartbeat from core client for 30 sec - exiting 00:58:28 (3072): No heartbeat from core client for 30 sec - exiting 00:58:29 (3072): No heartbeat from core client for 30 sec - exiting 00:58:30 (3072): No heartbeat from core client for 30 sec - exiting 00:58:31 (3072): No heartbeat from core client for 30 sec - exiting 00:58:32 (3072): No heartbeat from core client for 30 sec - exiting 00:58:33 (3072): No heartbeat from core client for 30 sec - exiting 00:58:34 (3072): No heartbeat from core client for 30 sec - exiting 00:58:35 (3072): No heartbeat from core client for 30 sec - exiting 00:58:37 (3072): No heartbeat from core client for 30 sec - exiting 00:58:38 (3072): No heartbeat from core client for 30 sec - exiting 00:58:39 (3072): No heartbeat from core client for 30 sec - exiting 00:58:40 (3072): No heartbeat from core client for 30 sec - exiting 00:58:41 (3072): No heartbeat from core client for 30 sec - exiting 00:58:42 (3072): No heartbeat from core client for 30 sec - exiting 00:58:43 (3072): No heartbeat from core client for 30 sec - exiting 00:58:44 (3072): No heartbeat from core client for 30 sec - exiting 00:58:45 (3072): No heartbeat from core client for 30 sec - exiting 00:58:46 (3072): No heartbeat from core client for 30 sec - exiting 00:58:48 (3072): No heartbeat from core client for 30 sec - exiting 00:58:49 (3072): No heartbeat from core client for 30 sec - exiting 00:58:50 (3072): No heartbeat from core client for 30 sec - exiting 00:58:51 (3072): No heartbeat from core client for 30 sec - exiting 00:58:52 (3072): No heartbeat from core client for 30 sec - exiting 00:58:53 (3072): No heartbeat from core client for 30 sec - exiting 00:58:54 (3072): No heartbeat from core client for 30 sec - exiting 00:58:56 (3072): No heartbeat from core client for 30 sec - exiting 00:58:57 (3072): No heartbeat from core client for 30 sec - exiting 00:58:58 (3072): No heartbeat from core client for 30 sec - exiting 00:58:59 (3072): No heartbeat from core client for 30 sec - exiting 00:59:00 (3072): No heartbeat from core client for 30 sec - exiting 00:59:01 (3072): No heartbeat from core client for 30 sec - exiting 00:59:02 (3072): No heartbeat from core client for 30 sec - exiting 00:59:03 (3072): No heartbeat from core client for 30 sec - exiting 00:59:04 (3072): No heartbeat from core client for 30 sec - exiting 00:59:06 (3072): No heartbeat from core client for 30 sec - exiting 00:59:07 (3072): No heartbeat from core client for 30 sec - exiting 00:59:08 (3072): No heartbeat from core client for 30 sec - exiting 00:59:09 (3072): No heartbeat from core client for 30 sec - exiting 00:59:10 (3072): No heartbeat from core client for 30 sec - exiting 00:59:11 (3072): No heartbeat from core client for 30 sec - exiting 00:59:12 (3072): No heartbeat from core client for 30 sec - exiting 00:59:13 (3072): No heartbeat from core client for 30 sec - exiting 00:59:14 (3072): No heartbeat from core client for 30 sec - exiting 00:59:15 (3072): No heartbeat from core client for 30 sec - exiting 00:59:17 (3072): No heartbeat from core client for 30 sec - exiting 00:59:18 (3072): No heartbeat from core client for 30 sec - exiting 00:59:19 (3072): No heartbeat from core client for 30 sec - exiting 00:59:20 (3072): No heartbeat from core client for 30 sec - exiting 00:59:21 (3072): No heartbeat from core client for 30 sec - exiting 00:59:22 (3072): No heartbeat from core client for 30 sec - exiting 00:59:23 (3072): No heartbeat from core client for 30 sec - exiting 00:59:24 (3072): No heartbeat from core client for 30 sec - exiting 00:59:25 (3072): No heartbeat from core client for 30 sec - exiting 00:59:27 (3072): No heartbeat from core client for 30 sec - exiting 00:59:28 (3072): No heartbeat from core client for 30 sec - exiting 00:59:29 (3072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3368, iMonCtr=2 11:22:31 (2908): No heartbeat from core client for 30 sec - exiting 11:22:32 (2908): No heartbeat from core client for 30 sec - exiting 11:22:33 (2908): No heartbeat from core client for 30 sec - exiting 11:22:34 (2908): No heartbeat from core client for 30 sec - exiting 11:22:35 (2908): No heartbeat from core client for 30 sec - exiting 11:22:36 (2908): No heartbeat from core client for 30 sec - exiting 11:22:37 (2908): No heartbeat from core client for 30 sec - exiting 11:22:38 (2908): No heartbeat from core client for 30 sec - exiting 11:22:40 (2908): No heartbeat from core client for 30 sec - exiting 11:22:41 (2908): No heartbeat from core client for 30 sec - exiting 11:22:42 (2908): No heartbeat from core client for 30 sec - exiting 11:22:43 (2908): No heartbeat from core client for 30 sec - exiting 11:22:44 (2908): No heartbeat from core client for 30 sec - exiting 11:22:45 (2908): No heartbeat from core client for 30 sec - exiting 11:22:46 (2908): No heartbeat from core client for 30 sec - exiting 11:22:47 (2908): No heartbeat from core client for 30 sec - exiting 11:22:48 (2908): No heartbeat from core client for 30 sec - exiting 11:22:49 (2908): No heartbeat from core client for 30 sec - exiting 11:22:50 (2908): No heartbeat from core client for 30 sec - exiting 11:22:52 (2908): No heartbeat from core client for 30 sec - exiting 11:22:53 (2908): No heartbeat from core client for 30 sec - exiting 11:22:54 (2908): No heartbeat from core client for 30 sec - exiting 11:22:55 (2908): No heartbeat from core client for 30 sec - exiting 11:22:56 (2908): No heartbeat from core client for 30 sec - exiting 11:22:57 (2908): No heartbeat from core client for 30 sec - exiting 11:22:58 (2908): No heartbeat from core client for 30 sec - exiting 11:22:59 (2908): No heartbeat from core client for 30 sec - exiting 11:23:00 (2908): No heartbeat from core client for 30 sec - exiting 11:23:01 (2908): No heartbeat from core client for 30 sec - exiting 11:23:02 (2908): No heartbeat from core client for 30 sec - exiting 11:23:04 (2908): No heartbeat from core client for 30 sec - exiting 11:23:05 (2908): No heartbeat from core client for 30 sec - exiting 11:23:06 (2908): No heartbeat from core client for 30 sec - exiting 11:23:07 (2908): No heartbeat from core client for 30 sec - exiting 11:23:08 (2908): No heartbeat from core client for 30 sec - exiting 11:23:09 (2908): No heartbeat from core client for 30 sec - exiting 11:23:10 (2908): No heartbeat from core client for 30 sec - exiting 11:23:11 (2908): No heartbeat from core client for 30 sec - exiting 11:23:12 (2908): No heartbeat from core client for 30 sec - exiting 11:23:13 (2908): No heartbeat from core client for 30 sec - exiting 11:23:15 (2908): No heartbeat from core client for 30 sec - exiting 11:23:16 (2908): No heartbeat from core client for 30 sec - exiting 11:23:17 (2908): No heartbeat from core client for 30 sec - exiting 11:23:18 (2908): No heartbeat from core client for 30 sec - exiting 11:23:19 (2908): No heartbeat from core client for 30 sec - exiting 11:23:20 (2908): No heartbeat from core client for 30 sec - exiting 11:23:21 (2908): No heartbeat from core client for 30 sec - exiting 11:23:22 (2908): No heartbeat from core client for 30 sec - exiting 11:23:23 (2908): No heartbeat from core client for 30 sec - exiting 11:23:24 (2908): No heartbeat from core client for 30 sec - exiting 11:23:25 (2908): No heartbeat from core client for 30 sec - exiting 11:23:27 (2908): No heartbeat from core client for 30 sec - exiting 11:23:28 (2908): No heartbeat from core client for 30 sec - exiting 11:23:29 (2908): No heartbeat from core client for 30 sec - exiting 11:23:30 (2908): No heartbeat from core client for 30 sec - exiting 11:23:31 (2908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:05 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... G23:25:49 (3216): No heartbeat from core client for 30 sec - exiting 23:25:51 (3216): No heartbeat from core client for 30 sec - exiting 23:25:52 (3216): No heartbeat from core client for 30 sec - exiting 23:25:53 (3216): No heartbeat from core client for 30 sec - exiting 23:25:54 (3216): No heartbeat from core client for 30 sec - exiting 23:25:55 (3216): No heartbeat from core client for 30 sec - exiting 23:25:56 (3216): No heartbeat from core client for 30 sec - exiting 23:25:57 (3216): No heartbeat from core client for 30 sec - exiting 23:25:58 (3216): No heartbeat from core client for 30 sec - exiting 23:25:59 (3216): No heartbeat from core client for 30 sec - exiting 23:26:00 (3216): No heartbeat from core client for 30 sec - exiting 23:26:01 (3216): No heartbeat from core client for 30 sec - exiting 23:26:03 (3216): No heartbeat from core client for 30 sec - exiting 23:26:04 (3216): No heartbeat from core client for 30 sec - exiting 23:26:05 (3216): No heartbeat from core client for 30 sec - exiting 23:26:06 (3216): No heartbeat from core client for 30 sec - exiting 23:26:07 (3216): No heartbeat from core client for 30 sec - exiting 23:26:08 (3216): No heartbeat from core client for 30 sec - exiting 23:26:09 (3216): No heartbeat from core client for 30 sec - exiting 23:26:10 (3216): No heartbeat from core client for 30 sec - exiting 23:26:11 (3216): No heartbeat from core client for 30 sec - exiting 23:26:12 (3216): No heartbeat from core client for 30 sec - exiting 23:26:13 (3216): No heartbeat from core client for 30 sec - exiting 23:26:15 (3216): No heartbeat from core client for 30 sec - exiting 23:26:16 (3216): No heartbeat from core client for 30 sec - exiting 23:26:17 (3216): No heartbeat from core client for 30 sec - exiting 23:26:18 (3216): No heartbeat from core client for 30 sec - exiting 23:26:19 (3216): No heartbeat from core client for 30 sec - exiting 23:26:20 (3216): No heartbeat from core client for 30 sec - exiting 23:26:21 (3216): No heartbeat from core client for 30 sec - exiting 23:26:22 (3216): No heartbeat from core client for 30 sec - exiting 23:26:23 (3216): No heartbeat from core client for 30 sec - exiting 23:26:24 (3216): No heartbeat from core client for 30 sec - exiting 23:26:25 (3216): No heartbeat from core client for 30 sec - exiting 23:26:27 (3216): No heartbeat from core client for 30 sec - exiting 23:26:28 (3216): No heartbeat from core client for 30 sec - exiting 23:26:29 (3216): No heartbeat from core client for 30 sec - exiting 23:26:30 (3216): No heartbeat from core client for 30 sec - exiting 23:26:31 (3216): No heartbeat from core client for 30 sec - exiting 23:26:32 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:33 (3804): No heartbeat from core client for 30 sec - exiting 10:57:34 (3804): No heartbeat from core client for 30 sec - exiting 10:57:35 (3804): No heartbeat from core client for 30 sec - exiting 10:57:36 (3804): No heartbeat from core client for 30 sec - exiting 10:57:37 (3804): No heartbeat from core client for 30 sec - exiting 10:57:38 (3804): No heartbeat from core client for 30 sec - exiting 10:57:40 (3804): No heartbeat from core client for 30 sec - exiting 10:57:41 (3804): No heartbeat from core client for 30 sec - exiting 10:57:42 (3804): No heartbeat from core client for 30 sec - exiting 10:57:43 (3804): No heartbeat from core client for 30 sec - exiting 10:57:44 (3804): No heartbeat from core client for 30 sec - exiting 10:57:45 (3804): No heartbeat from core client for 30 sec - exiting 10:57:46 (3804): No heartbeat from core client for 30 sec - exiting 10:57:47 (3804): No heartbeat from core client for 30 sec - exiting 10:57:48 (3804): No heartbeat from core client for 30 sec - exiting 10:57:49 (3804): No heartbeat from core client for 30 sec - exiting 10:57:50 (3804): No heartbeat from core client for 30 sec - exiting 10:57:52 (3804): No heartbeat from core client for 30 sec - exiting 10:57:53 (3804): No heartbeat from core client for 30 sec - exiting 10:57:54 (3804): No heartbeat from core client for 30 sec - exiting 10:57:55 (3804): No heartbeat from core client for 30 sec - exiting 10:57:56 (3804): No heartbeat from core client for 30 sec - exiting 10:57:57 (3804): No heartbeat from core client for 30 sec - exiting 10:57:58 (3804): No heartbeat from core client for 30 sec - exiting 10:57:59 (3804): No heartbeat from core client for 30 sec - exiting 10:58:00 (3804): No heartbeat from core client for 30 sec - exiting 10:58:01 (3804): No heartbeat from core client for 30 sec - exiting 10:58:02 (3804): No heartbeat from core client for 30 sec - exiting 10:58:04 (3804): No heartbeat from core client for 30 sec - exiting 10:58:05 (3804): No heartbeat from core client for 30 sec - exiting 10:58:06 (3804): No heartbeat from core client for 30 sec - exiting 10:58:07 (3804): No heartbeat from core client for 30 sec - exiting 10:58:08 (3804): No heartbeat from core client for 30 sec - exiting 10:58:09 (3804): No heartbeat from core client for 30 sec - exiting 10:58:10 (3804): No heartbeat from core client for 30 sec - exiting 10:58:11 (3804): No heartbeat from core client for 30 sec - exiting 10:58:12 (3804): No heartbeat from core client for 30 sec - exiting 10:58:13 (3804): No heartbeat from core client for 30 sec - exiting 10:58:15 (3804): No heartbeat from core client for 30 sec - exiting 10:58:16 (3804): No heartbeat from core client for 30 sec - exiting 10:58:17 (3804): No heartbeat from core client for 30 sec - exiting 10:58:18 (3804): No heartbeat from core client for 30 sec - exiting 10:58:19 (3804): No heartbeat from core client for 30 sec - exiting 10:58:20 (3804): No heartbeat from core client for 30 sec - exiting 10:58:21 (3804): No heartbeat from core client for 30 sec - exiting 10:58:22 (3804): No heartbeat from core client for 30 sec - exiting 10:58:24 (3804): No heartbeat from core client for 30 sec - exiting 10:58:25 (3804): No heartbeat from core client for 30 sec - exiting 10:58:26 (3804): No heartbeat from core client for 30 sec - exiting 10:58:28 (3804): No heartbeat from core client for 30 sec - exiting 10:58:29 (3804): No heartbeat from core client for 30 sec - exiting 10:58:30 (3804): No heartbeat from core client for 30 sec - exiting 10:58:31 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3048, selfPID=2980, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=876, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=852, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:47:51 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:19 (2160): No heartbeat from core client for 30 sec - exiting 08:53:20 (2160): No heartbeat from core client for 30 sec - exiting 08:53:21 (2160): No heartbeat from core client for 30 sec - exiting 08:53:23 (2160): No heartbeat from core client for 30 sec - exiting 08:53:24 (2160): No heartbeat from core client for 30 sec - exiting 08:53:25 (2160): No heartbeat from core client for 30 sec - exiting 08:53:26 (2160): No heartbeat from core client for 30 sec - exiting 08:53:27 (2160): No heartbeat from core client for 30 sec - exiting 08:53:28 (2160): No heartbeat from core client for 30 sec - exiting 08:53:29 (2160): No heartbeat from core client for 30 sec - exiting 08:53:30 (2160): No heartbeat from core client for 30 sec - exiting 08:53:31 (2160): No heartbeat from core client for 30 sec - exiting 08:53:32 (2160): No heartbeat from core client for 30 sec - exiting 08:53:33 (2160): No heartbeat from core client for 30 sec - exiting 08:53:35 (2160): No heartbeat from core client for 30 sec - exiting 08:53:36 (2160): No heartbeat from core client for 30 sec - exiting 08:53:37 (2160): No heartbeat from core client for 30 sec - exiting 08:53:38 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:03:12 (740): No heartbeat from core client for 30 sec - exiting 12:03:13 (740): No heartbeat from core client for 30 sec - exiting 12:03:14 (740): No heartbeat from core client for 30 sec - exiting 12:03:15 (740): No heartbeat from core client for 30 sec - exiting 12:03:17 (740): No heartbeat from core client for 30 sec - exiting 12:03:18 (740): No heartbeat from core client for 30 sec - exiting 12:03:19 (740): No heartbeat from core client for 30 sec - exiting 12:03:20 (740): No heartbeat from core client for 30 sec - exiting 12:03:21 (740): No heartbeat from core client for 30 sec - exiting 12:03:22 (740): No heartbeat from core client for 30 sec - exiting 12:03:23 (740): No heartbeat from core client for 30 sec - exiting 12:03:24 (740): No heartbeat from core client for 30 sec - exiting 12:03:25 (740): No heartbeat from core client for 30 sec - exiting 12:03:26 (740): No heartbeat from core client for 30 sec - exiting 12:03:28 (740): No heartbeat from core client for 30 sec - exiting 12:03:29 (740): No heartbeat from core client for 30 sec - exiting 12:03:30 (740): No heartbeat from core client for 30 sec - exiting 12:03:31 (740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:48:06 (2664): No heartbeat from core client for 30 sec - exiting 21:48:07 (2664): No heartbeat from core client for 30 sec - exiting 21:48:08 (2664): No heartbeat from core client for 30 sec - exiting 21:48:09 (2664): No heartbeat from core client for 30 sec - exiting 21:48:10 (2664): No heartbeat from core client for 30 sec - exiting 21:48:11 (2664): No heartbeat from core client for 30 sec - exiting 21:48:12 (2664): No heartbeat from core client for 30 sec - exiting 21:48:13 (2664): No heartbeat from core client for 30 sec - exiting 21:48:15 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Dec 2018 22:14:50	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	138,539	934,508	6.7455
05 Dec 2018 16:50:41	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	127,019	869,213	6.8432
05 Dec 2018 16:50:41	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	115,499	804,540	6.9658
03 Dec 2018 17:07:09	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	103,979	740,180	7.1186
01 Dec 2018 22:46:15	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	92,459	676,054	7.3119
29 Nov 2018 23:44:08	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	80,939	611,552	7.5557
28 Nov 2018 09:09:57	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	69,419	546,955	7.8790
25 Nov 2018 16:58:53	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	57,899	474,061	8.1877
24 Jul 2015 04:58:01	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	46,379	281,520	6.0700
10 Jul 2015 19:57:14	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	34,859	195,949	5.6212
08 Jul 2015 19:25:53	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	23,339	135,791	5.8182
03 Jul 2015 16:17:10	1366448	18616790	hadam3p_anz_f051_2013_1_009942163_0	11,819	67,576	5.7176