Task 15846069

Name	hadcm3n_4g60_1980_40_008389905_1
Workunit	8540764
Created	17 Jun 2013, 8:27:09 UTC
Sent	17 Jun 2013, 8:38:41 UTC
Report deadline	16 Sep 2013, 16:05:52 UTC
Received	15 Sep 2013, 11:57:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1158872
Run time	34 days 15 hours 31 min 41 sec
CPU time	34 days 1 hours 26 min 28 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	1.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 23:27:50 (12020): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:27:52 (12020): No heartbeat from core client for 30 sec - exiting 11:53:29 (9052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:30 (9052): No heartbeat from core client for 30 sec - exiting 11:54:21 (10376): No heartbeat from core client for 30 sec - exiting 11:54:22 (10376): No heartbeat from core client for 30 sec - exiting 11:54:23 (10376): No heartbeat from core client for 30 sec - exiting 11:54:24 (10376): No heartbeat from core client for 30 sec - exiting 11:54:25 (10376): No heartbeat from core client for 30 sec - exiting 11:54:26 (10376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:39:11 (7504): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:39:12 (7504): No heartbeat from core client for 30 sec - exiting 21:39:13 (7504): No heartbeat from core client for 30 sec - exiting 21:39:15 (7504): No heartbeat from core client for 30 sec - exiting 12:25:36 (14232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:38 (14232): No heartbeat from core client for 30 sec - exiting 13:29:14 (9300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:27:10 (7936): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:27:11 (7936): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:52:53 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:12:00 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:43 (7212): No heartbeat from core client for 30 sec - exiting 10:12:44 (7212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 22:06:53 (11536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:54 (11536): No heartbeat from core client for 30 sec - exiting 22:11:51 (8960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:31 (16472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:32 (16472): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:20:40 (13824): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:19:47 (13864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:00:53 (7388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:36 (12924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:51 (11920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:52 (11920): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:22:26 (8804): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:22:27 (8804): No heartbeat from core client for 30 sec - exiting 13:44:01 (7388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:44:03 (7388): No heartbeat from core client for 30 sec - exiting 13:44:04 (7388): No heartbeat from core client for 30 sec - exiting 13:45:06 (17120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:02 (11536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:24:07 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:05:48 (284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:42 (14372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:43 (14372): No heartbeat from core client for 30 sec - exiting 13:23:44 (14372): No heartbeat from core client for 30 sec - exiting 13:23:45 (14372): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 02:22:13 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:22:14 (4536): No heartbeat from core client for 30 sec - exiting 02:22:15 (4536): No heartbeat from core client for 30 sec - exiting 14:10:03 (1272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:04 (1272): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on 4g60ko.daj0c20 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6996, iMonCtr=1 Model crash detected, will try to restart... 04:19:06 (5544): No heartbeat from core client for 30 sec - exiting 04:19:07 (5544): No heartbeat from core client for 30 sec - exiting 04:19:08 (5544): No heartbeat from core client for 30 sec - exiting 04:19:09 (5544): No heartbeat from core client for 30 sec - exiting 04:19:10 (5544): No heartbeat from core client for 30 sec - exiting 04:19:11 (5544): No heartbeat from core client for 30 sec - exiting 04:19:12 (5544): No heartbeat from core client for 30 sec - exiting 04:19:13 (5544): No heartbeat from core client for 30 sec - exiting 04:19:14 (5544): No heartbeat from core client for 30 sec - exiting 04:19:15 (5544): No heartbeat from core client for 30 sec - exiting 04:19:17 (5544): No heartbeat from core client for 30 sec - exiting 04:19:18 (5544): No heartbeat from core client for 30 sec - exiting 04:19:19 (5544): No heartbeat from core client for 30 sec - exiting 04:19:20 (5544): No heartbeat from core client for 30 sec - exiting 04:19:21 (5544): No heartbeat from core client for 30 sec - exiting 04:19:22 (5544): No heartbeat from core client for 30 sec - exiting 04:19:23 (5544): No heartbeat from core client for 30 sec - exiting 04:19:24 (5544): No heartbeat from core client for 30 sec - exiting 04:19:25 (5544): No heartbeat from core client for 30 sec - exiting 04:19:26 (5544): No heartbeat from core client for 30 sec - exiting 04:19:27 (5544): No heartbeat from core client for 30 sec - exiting 04:19:29 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:19 (1752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:21 (1752): No heartbeat from core client for 30 sec - exiting 02:55:27 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:53 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:08:53 (11544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:27 (12164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:31 (11136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:37:08 (8112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:38:55 (11288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:58:57 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:29 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:29:14 (9892): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:28:39 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:40 (4568): No heartbeat from core client for 30 sec - exiting 11:16:31 (7160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:17:04 (2320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:05:41 (11008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:42 (11008): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:11:55 (10696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:57 (10696): No heartbeat from core client for 30 sec - exiting 11:11:58 (10696): No heartbeat from core client for 30 sec - exiting 11:11:59 (10696): No heartbeat from core client for 30 sec - exiting 13:27:30 (10316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:27:31 (10316): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:12:43 (9820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:44 (9820): No heartbeat from core client for 30 sec - exiting 08:12:45 (9820): No heartbeat from core client for 30 sec - exiting 08:32:44 (13972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:33:06 (3104): No heartbeat from core client for 30 sec - exiting 14:33:07 (3104): No heartbeat from core client for 30 sec - exiting 14:33:08 (3104): No heartbeat from core client for 30 sec - exiting 14:33:09 (3104): No heartbeat from core client for 30 sec - exiting 14:33:10 (3104): No heartbeat from core client for 30 sec - exiting 14:33:11 (3104): No heartbeat from core client for 30 sec - exiting 14:33:12 (3104): No heartbeat from core client for 30 sec - exiting 14:33:13 (3104): No heartbeat from core client for 30 sec - exiting 14:33:14 (3104): No heartbeat from core client for 30 sec - exiting 14:33:15 (3104): No heartbeat from core client for 30 sec - exiting 14:33:16 (3104): No heartbeat from core client for 30 sec - exiting 14:33:17 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:51 (1640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:52 (1640): No heartbeat from core client for 30 sec - exiting 02:21:53 (1640): No heartbeat from core client for 30 sec - exiting 02:23:44 (12276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:41:42 (7968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:49:33 (10336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:53:43 (3580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:43 (12308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:13:43 (10968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:31 (11784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:16 (11716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:13 (8932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:55 (8596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:09 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:01 (11388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:41 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:00 (14116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:08 (3752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:11 (13532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:12 (13532): No heartbeat from core client for 30 sec - exiting 08:32:05 (10580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:12:13 (12292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:26 (13184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:49 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:11 (9612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:37 (11072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:34 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:48:31 (8624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:03 (9040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:05 (9040): No heartbeat from core client for 30 sec - exiting 13:54:06 (9040): No heartbeat from core client for 30 sec - exiting 13:54:07 (9040): No heartbeat from core client for 30 sec - exiting 13:54:08 (9040): No heartbeat from core client for 30 sec - exiting 13:54:09 (9040): No heartbeat from core client for 30 sec - exiting 13:54:10 (9040): No heartbeat from core client for 30 sec - exiting 13:54:11 (9040): No heartbeat from core client for 30 sec - exiting 13:54:12 (9040): No heartbeat from core client for 30 sec - exiting 13:54:13 (9040): No heartbeat from core client for 30 sec - exiting 13:54:14 (9040): No heartbeat from core client for 30 sec - exiting 13:54:15 (9040): No heartbeat from core client for 30 sec - exiting 01:38:10 (12360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:11 (12360): No heartbeat from core client for 30 sec - exiting 13:05:27 (10432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:00:17 (10272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:00 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:46 (14892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:47 (14892): No heartbeat from core client for 30 sec - exiting 23:15:40 (11356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:33:18 (6616): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:19:02 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:28:34 (17832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:34:43 (17856): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:05:10 (5404): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:05:12 (5404): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:28:03 (11044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:04 (11044): No heartbeat from core client for 30 sec - exiting 14:28:05 (11044): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 15:01:41 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:05:55 (1484): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 23:05:59 (1484): No heartbeat from core client for 30 sec - exiting 23:06:00 (1484): No heartbeat from core client for 30 sec - exiting 23:06:01 (1484): No heartbeat from core client for 30 sec - exiting 23:06:02 (1484): No heartbeat from core client for 30 sec - exiting 23:06:03 (1484): No heartbeat from core client for 30 sec - exiting 23:06:04 (1484): No heartbeat from core client for 30 sec - exiting 23:06:05 (1484): No heartbeat from core client for 30 sec - exiting 23:06:06 (1484): No heartbeat from core client for 30 sec - exiting 23:06:07 (1484): No heartbeat from core client for 30 sec - exiting 23:06:08 (1484): No heartbeat from core client for 30 sec - exiting 23:06:09 (1484): No heartbeat from core client for 30 sec - exiting 23:06:10 (1484): No heartbeat from core client for 30 sec - exiting 23:18:37 (8020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:59 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:13:00 (8212): No heartbeat from core client for 30 sec - exiting 01:29:24 (1516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:34:35 (9524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:38:14 (9856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:19 (7272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:50:42 (1744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:03 (7408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:04:32 (5568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:42 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:20:42 (9316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:27 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:42:45 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:46 (4228): No heartbeat from core client for 30 sec - exiting 09:42:47 (4228): No heartbeat from core client for 30 sec - exiting 10:12:46 (9724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:52:21 (9156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:22 (9952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:23 (9952): No heartbeat from core client for 30 sec - exiting 01:33:37 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:00 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:26 (9180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:14 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:14 (11980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:15 (10544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:14:16 (10544): No heartbeat from core client for 30 sec - exiting 13:24:15 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:39 (11716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:40 (11716): No heartbeat from core client for 30 sec - exiting 20:44:41 (11716): No heartbeat from core client for 30 sec - exiting 01:24:53 (10964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:15:07 (11512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:12 (8432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:16 (7700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:17 (7700): No heartbeat from core client for 30 sec - exiting 19:54:52 (10348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:54 (10348): No heartbeat from core client for 30 sec - exiting 20:06:10 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:45 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:46 (3008): No heartbeat from core client for 30 sec - exiting 07:47:47 (3008): No heartbeat from core client for 30 sec - exiting 10:33:37 (10796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:48:43 (2824): No heartbeat from core client for 30 sec - exiting 17:48:45 (2824): No heartbeat from core client for 30 sec - exiting 17:48:46 (2824): No heartbeat from core client for 30 sec - exiting 17:48:47 (2824): No heartbeat from core client for 30 sec - exiting 17:48:48 (2824): No heartbeat from core client for 30 sec - exiting 17:48:49 (2824): No heartbeat from core client for 30 sec - exiting 17:48:50 (2824): No heartbeat from core client for 30 sec - exiting 17:48:51 (2824): No heartbeat from core client for 30 sec - exiting 17:48:52 (2824): No heartbeat from core client for 30 sec - exiting 17:48:53 (2824): No heartbeat from core client for 30 sec - exiting 17:48:54 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) Suspended CPDN Monitor - Suspend request from BOINC... 05:16:12 (1552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:37 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:59 (12860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:39:52 (6164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:55 (6272): No heartbeat from core client for 30 sec - exiting 16:21:56 (6272): No heartbeat from core client for 30 sec - exiting 16:21:57 (6272): No heartbeat from core client for 30 sec - exiting 16:21:58 (6272): No heartbeat from core client for 30 sec - exiting 16:21:59 (6272): No heartbeat from core client for 30 sec - exiting 16:22:00 (6272): No heartbeat from core client for 30 sec - exiting 16:22:01 (6272): No heartbeat from core client for 30 sec - exiting 16:22:02 (6272): No heartbeat from core client for 30 sec - exiting 16:22:03 (6272): No heartbeat from core client for 30 sec - exiting 16:22:04 (6272): No heartbeat from core client for 30 sec - exiting 16:22:05 (6272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4g60ko.pjl1c10 Error converting file to netcdf: dataout/4g60ko.pil1c10 Error converting file to netcdf: dataout/4g60ko.pfl1c10 Error converting file to netcdf: dataout/4g60ka.phl1c10 Error converting file to netcdf: dataout/4g60ka.pgl1c10 Error converting file to netcdf: dataout/4g60ka.pel1c10 Error converting file to netcdf: dataout/4g60ka.pdl1c10 16:26:11 (13152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4g60ko.pjl1c10 Error converting file to netcdf: dataout/4g60ko.pil1c10 Error converting file to netcdf: dataout/4g60ko.pfl1c10 Error converting file to netcdf: dataout/4g60ka.phl1c10 Error converting file to netcdf: dataout/4g60ka.pgl1c10 Error converting file to netcdf: dataout/4g60ka.pel1c10 Error converting file to netcdf: dataout/4g60ka.pdl1c10 23:12:17 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:24 (12912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:11 (9776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:05 (6864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:55:42 (8960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:37 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:33 (7400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:55:47 (8808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:37 (12740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:05:41 (11092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:31 (13120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:49 (11376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:50 (11376): No heartbeat from core client for 30 sec - exiting 08:13:51 (11376): No heartbeat from core client for 30 sec - exiting 08:13:52 (11376): No heartbeat from core client for 30 sec - exiting 08:13:53 (11376): No heartbeat from core client for 30 sec - exiting 08:13:54 (11376): No heartbeat from core client for 30 sec - exiting 08:13:55 (11376): No heartbeat from core client for 30 sec - exiting 08:13:56 (11376): No heartbeat from core client for 30 sec - exiting 08:13:57 (11376): No heartbeat from core client for 30 sec - exiting 08:13:58 (11376): No heartbeat from core client for 30 sec - exiting 08:13:59 (11376): No heartbeat from core client for 30 sec - exiting 08:20:07 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:05 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 17:35:29 (13936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:32 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:41 (10488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:15:48 (5560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:06:00 (10156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:16:01 (6764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:01 (1732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:01 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:04 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:36:06 (13512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:06:07 (13796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:20 (13516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:27 (10108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:41 (9824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:18 (9824): No heartbeat from core client for 30 sec - exiting 22:28:19 (9824): No heartbeat from core client for 30 sec - exiting 22:28:20 (9824): No heartbeat from core client for 30 sec - exiting 22:28:21 (9824): No heartbeat from core client for 30 sec - exiting 22:28:22 (9824): No heartbeat from core client for 30 sec - exiting 22:28:23 (9824): No heartbeat from core client for 30 sec - exiting 22:28:24 (9824): No heartbeat from core client for 30 sec - exiting 22:28:25 (9824): No heartbeat from core client for 30 sec - exiting 22:31:12 (1148): No heartbeat from core client for 30 sec - exiting 22:31:29 (1148): No heartbeat from core client for 30 sec - exiting 22:31:30 (1148): No heartbeat from core client for 30 sec - exiting 22:31:31 (1148): No heartbeat from core client for 30 sec - exiting 22:31:32 (1148): No heartbeat from core client for 30 sec - exiting 22:31:33 (1148): No heartbeat from core client for 30 sec - exiting 22:31:34 (1148): No heartbeat from core client for 30 sec - exiting 22:31:35 (1148): No heartbeat from core client for 30 sec - exiting 22:31:36 (1148): No heartbeat from core client for 30 sec - exiting 22:31:37 (1148): No heartbeat from core client for 30 sec - exiting 22:31:38 (1148): No heartbeat from core client for 30 sec - exiting 22:31:39 (1148): No heartbeat from core client for 30 sec - exiting 22:31:40 (1148): No heartbeat from core client for 30 sec - exiting 22:31:41 (1148): No heartbeat from core client for 30 sec - exiting 22:31:42 (1148): No heartbeat from core client for 30 sec - exiting 22:31:43 (1148): No heartbeat from core client for 30 sec - exiting 22:31:44 (1148): No heartbeat from core client for 30 sec - exiting 22:31:45 (1148): No heartbeat from core client for 30 sec - exiting 22:31:46 (1148): No heartbeat from core client for 30 sec - exiting 22:31:47 (1148): No heartbeat from core client for 30 sec - exiting 22:31:48 (1148): No heartbeat from core client for 30 sec - exiting 22:31:49 (1148): No heartbeat from core client for 30 sec - exiting 22:31:50 (1148): No heartbeat from core client for 30 sec - exiting 22:31:51 (1148): No heartbeat from core client for 30 sec - exiting 22:31:52 (1148): No heartbeat from core client for 30 sec - exiting 22:31:53 (1148): No heartbeat from core client for 30 sec - exiting 22:31:54 (1148): No heartbeat from core client for 30 sec - exiting 22:31:55 (1148): No heartbeat from core client for 30 sec - exiting 22:31:56 (1148): No heartbeat from core client for 30 sec - exiting 22:31:57 (1148): No heartbeat from core client for 30 sec - exiting 22:31:58 (1148): No heartbeat from core client for 30 sec - exiting 22:31:59 (1148): No heartbeat from core client for 30 sec - exiting 22:32:00 (1148): No heartbeat from core client for 30 sec - exiting 22:32:01 (1148): No heartbeat from core client for 30 sec - exiting 22:32:02 (1148): No heartbeat from core client for 30 sec - exiting 22:32:03 (1148): No heartbeat from core client for 30 sec - exiting 22:32:04 (1148): No heartbeat from core client for 30 sec - exiting 22:32:05 (1148): No heartbeat from core client for 30 sec - exiting 22:32:06 (1148): No heartbeat from core client for 30 sec - exiting 22:32:07 (1148): No heartbeat from core client for 30 sec - exiting 22:32:08 (1148): No heartbeat from core client for 30 sec - exiting 22:32:09 (1148): No heartbeat from core client for 30 sec - exiting 22:32:10 (1148): No heartbeat from core client for 30 sec - exiting 22:32:11 (1148): No heartbeat from core client for 30 sec - exiting 22:32:12 (1148): No heartbeat from core client for 30 sec - exiting 22:32:13 (1148): No heartbeat from core client for 30 sec - exiting 22:32:14 (1148): No heartbeat from core client for 30 sec - exiting 22:32:15 (1148): No heartbeat from core client for 30 sec - exiting 22:32:16 (1148): No heartbeat from core client for 30 sec - exiting 22:32:17 (1148): No heartbeat from core client for 30 sec - exiting 22:32:18 (1148): No heartbeat from core client for 30 sec - exiting 22:32:19 (1148): No heartbeat from core client for 30 sec - exiting 22:32:20 (1148): No heartbeat from core client for 30 sec - exiting 22:32:21 (1148): No heartbeat from core client for 30 sec - exiting 22:32:22 (1148): No heartbeat from core client for 30 sec - exiting 22:32:23 (1148): No heartbeat from core client for 30 sec - exiting 22:32:24 (1148): No heartbeat from core client for 30 sec - exiting 22:32:25 (1148): No heartbeat from core client for 30 sec - exiting 22:32:26 (1148): No heartbeat from core client for 30 sec - exiting 22:32:27 (1148): No heartbeat from core client for 30 sec - exiting 22:32:28 (1148): No heartbeat from core client for 30 sec - exiting 22:32:29 (1148): No heartbeat from core client for 30 sec - exiting 22:32:30 (1148): No heartbeat from core client for 30 sec - exiting 22:32:31 (1148): No heartbeat from core client for 30 sec - exiting 22:32:32 (1148): No heartbeat from core client for 30 sec - exiting 22:32:33 (1148): No heartbeat from core client for 30 sec - exiting 22:32:34 (1148): No heartbeat from core client for 30 sec - exiting 22:32:35 (1148): No heartbeat from core client for 30 sec - exiting 22:32:36 (1148): No heartbeat from core client for 30 sec - exiting 22:32:37 (1148): No heartbeat from core client for 30 sec - exiting 22:32:38 (1148): No heartbeat from core client for 30 sec - exiting 22:32:39 (1148): No heartbeat from core client for 30 sec - exiting 22:33:10 (1148): No heartbeat from core client for 30 sec - exiting 22:33:11 (1148): No heartbeat from core client for 30 sec - exiting 22:33:12 (1148): No heartbeat from core client for 30 sec - exiting 22:33:13 (1148): No heartbeat from core client for 30 sec - exiting 22:33:14 (1148): No heartbeat from core client for 30 sec - exiting 22:33:15 (1148): No heartbeat from core client for 30 sec - exiting 22:33:16 (1148): No heartbeat from core client for 30 sec - exiting 22:33:17 (1148): No heartbeat from core client for 30 sec - exiting 22:33:18 (1148): No heartbeat from core client for 30 sec - exiting 22:33:19 (1148): No heartbeat from core client for 30 sec - exiting 22:33:20 (1148): No heartbeat from core client for 30 sec - exiting 22:33:21 (1148): No heartbeat from core client for 30 sec - exiting 22:33:22 (1148): No heartbeat from core client for 30 sec - exiting 22:33:23 (1148): No heartbeat from core client for 30 sec - exiting 22:33:24 (1148): No heartbeat from core client for 30 sec - exiting 22:33:25 (1148): No heartbeat from core client for 30 sec - exiting 22:33:26 (1148): No heartbeat from core client for 30 sec - exiting 22:33:27 (1148): No heartbeat from core client for 30 sec - exiting 22:33:28 (1148): No heartbeat from core client for 30 sec - exiting 22:33:29 (1148): No heartbeat from core client for 30 sec - exiting 22:33:30 (1148): No heartbeat from core client for 30 sec - exiting 22:33:31 (1148): No heartbeat from core client for 30 sec - exiting 22:33:32 (1148): No heartbeat from core client for 30 sec - exiting 22:33:33 (1148): No heartbeat from core client for 30 sec - exiting 22:33:34 (1148): No heartbeat from core client for 30 sec - exiting 22:33:35 (1148): No heartbeat from core client for 30 sec - exiting 22:33:36 (1148): No heartbeat from core client for 30 sec - exiting 22:33:37 (1148): No heartbeat from core client for 30 sec - exiting 22:33:38 (1148): No heartbeat from core client for 30 sec - exiting 22:33:39 (1148): No heartbeat from core client for 30 sec - exiting 22:33:40 (1148): No heartbeat from core client for 30 sec - exiting 22:33:41 (1148): No heartbeat from core client for 30 sec - exiting 22:33:42 (1148): No heartbeat from core client for 30 sec - exiting 22:33:43 (1148): No heartbeat from core client for 30 sec - exiting 22:33:44 (1148): No heartbeat from core client for 30 sec - exiting 22:33:45 (1148): No heartbeat from core client for 30 sec - exiting 22:33:46 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:50 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:07 (10060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:08 (10060): No heartbeat from core client for 30 sec - exiting 03:09:09 (10060): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8520, iMonCtr=1 Model crash detected, will try to restart... 04:14:01 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:02 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:29 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:12 (1032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:47 (8376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:49 (8376): No heartbeat from core client for 30 sec - exiting 21:04:50 (8376): No heartbeat from core client for 30 sec - exiting 21:04:51 (8376): No heartbeat from core client for 30 sec - exiting 21:04:52 (8376): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:41:08 (9768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:49 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:50 (4008): No heartbeat from core client for 30 sec - exiting 20:23:09 (10872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:19 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:57 (7520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:02 (7792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:11 (10660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Sep 2013 08:08:39	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	959,040	2,937,265	3.0627
14 Sep 2013 09:43:18	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	933,120	2,857,905	3.0627
13 Sep 2013 11:16:39	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	907,200	2,778,849	3.0631
12 Sep 2013 12:05:24	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	881,280	2,700,043	3.0638
11 Sep 2013 13:12:11	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	855,360	2,621,414	3.0647
10 Sep 2013 14:16:00	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	829,440	2,542,029	3.0648
09 Sep 2013 15:27:05	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	803,520	2,462,046	3.0641
08 Sep 2013 16:54:21	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	777,600	2,382,903	3.0644
07 Sep 2013 20:52:49	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	751,680	2,304,436	3.0657
06 Sep 2013 20:00:46	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	725,760	2,225,369	3.0663
05 Sep 2013 21:12:31	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	699,840	2,147,562	3.0686
04 Sep 2013 21:30:30	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	673,920	2,068,836	3.0699
24 Aug 2013 11:48:52	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	648,000	1,996,572	3.0811
14 Aug 2013 15:37:37	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	622,080	1,926,790	3.0973
23 Jul 2013 21:37:55	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	596,160	1,851,450	3.1056
23 Jul 2013 20:58:19	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	570,240	1,771,100	3.1059
23 Jul 2013 20:25:11	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	544,320	1,690,695	3.1061
23 Jul 2013 19:46:58	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	518,400	1,609,275	3.1043
23 Jul 2013 16:13:16	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	492,480	1,528,837	3.1044
23 Jul 2013 15:19:28	1158872	15846069	hadcm3n_4g60_1980_40_008389905_1	466,560	1,448,191	3.1040