Task 15950543

Name	hadcm3n_75c4_1980_40_008418199_0
Workunit	8569055
Created	29 Aug 2013, 20:00:41 UTC
Sent	29 Aug 2013, 20:05:45 UTC
Report deadline	29 Nov 2013, 3:32:56 UTC
Received	15 Nov 2013, 1:38:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1277339
Run time	34 days 4 hours 19 min 15 sec
CPU time	1 days 16 hours 17 min 24 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 15:58:17 (125344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:59:53 (132092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:11 (151120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:55:55 (153108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:18:40 (147928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:54 (215672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:42 (281348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:38:09 (286868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:11 (286868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:54:58 (416372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:59 (416372): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:40:40 (417740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:32:12 (481984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:13 (481984): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:11:04 (491512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:05 (491512): No heartbeat from core client for 30 sec - exiting 23:11:06 (491512): No heartbeat from core client for 30 sec - exiting 23:11:07 (491512): No heartbeat from core client for 30 sec - exiting 23:11:08 (491512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:23:07 (496236): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:25:48 (450952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:50 (450952): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:30:10 (498748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:11 (498748): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:45:59 (16844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:02:16 (62024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:17 (62024): No heartbeat from core client for 30 sec - exiting 07:02:18 (62024): No heartbeat from core client for 30 sec - exiting 07:02:19 (62024): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:33:54 (59452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:33:57 (59452): No heartbeat from core client for 30 sec - exiting 14:33:58 (59452): No heartbeat from core client for 30 sec - exiting 14:33:59 (59452): No heartbeat from core client for 30 sec - exiting 14:34:00 (59452): No heartbeat from core client for 30 sec - exiting 14:34:01 (59452): No heartbeat from core client for 30 sec - exiting 14:34:02 (59452): No heartbeat from core client for 30 sec - exiting 14:34:03 (59452): No heartbeat from core client for 30 sec - exiting 14:34:04 (59452): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:23:46 (67284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:47 (67284): No heartbeat from core client for 30 sec - exiting 19:23:48 (67284): No heartbeat from core client for 30 sec - exiting 19:23:49 (67284): No heartbeat from core client for 30 sec - exiting 19:23:50 (67284): No heartbeat from core client for 30 sec - exiting 19:23:51 (67284): No heartbeat from core client for 30 sec - exiting 19:23:52 (67284): No heartbeat from core client for 30 sec - exiting 19:23:53 (67284): No heartbeat from core client for 30 sec - exiting 19:23:54 (67284): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:09:17 (77088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:18 (77088): No heartbeat from core client for 30 sec - exiting 08:09:19 (77088): No heartbeat from core client for 30 sec - exiting 08:09:20 (77088): No heartbeat from core client for 30 sec - exiting 08:09:21 (77088): No heartbeat from core client for 30 sec - exiting 08:09:22 (77088): No heartbeat from core client for 30 sec - exiting 08:09:23 (77088): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:22:28 (91536): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 05:22:30 (91536): No heartbeat from core client for 30 sec - exiting 05:22:31 (91536): No heartbeat from core client for 30 sec - exiting 05:22:32 (91536): No heartbeat from core client for 30 sec - exiting 05:22:33 (91536): No heartbeat from core client for 30 sec - exiting 05:22:34 (91536): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:35:49 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:35:52 (6724): No heartbeat from core client for 30 sec - exiting 13:35:53 (6724): No heartbeat from core client for 30 sec - exiting 13:35:54 (6724): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:53:53 (8084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:23:53 (51880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:54 (51880): No heartbeat from core client for 30 sec - exiting 16:23:55 (51880): No heartbeat from core client for 30 sec - exiting 16:23:56 (51880): No heartbeat from core client for 30 sec - exiting 16:23:58 (51880): No heartbeat from core client for 30 sec - exiting 16:23:59 (51880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:25:11 (154652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:15 (154652): No heartbeat from core client for 30 sec - exiting 19:25:16 (154652): No heartbeat from core client for 30 sec - exiting 19:25:17 (154652): No heartbeat from core client for 30 sec - exiting 19:25:18 (154652): No heartbeat from core client for 30 sec - exiting 19:25:19 (154652): No heartbeat from core client for 30 sec - exiting 19:25:20 (154652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:52:40 (163456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:53:41 (172308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:53:42 (172308): No heartbeat from core client for 30 sec - exiting 00:53:43 (172308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:41:50 (163724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:41:52 (163724): No heartbeat from core client for 30 sec - exiting 18:41:53 (163724): No heartbeat from core client for 30 sec - exiting 18:41:54 (163724): No heartbeat from core client for 30 sec - exiting 18:41:55 (163724): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:44:49 (1592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:51 (1592): No heartbeat from core client for 30 sec - exiting 00:44:52 (1592): No heartbeat from core client for 30 sec - exiting 00:44:53 (1592): No heartbeat from core client for 30 sec - exiting 00:44:54 (1592): No heartbeat from core client for 30 sec - exiting 00:44:55 (1592): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:20:19 (60212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:21 (60212): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:40:46 (93340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:40:48 (93340): No heartbeat from core client for 30 sec - exiting 13:40:49 (93340): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:02:14 (3908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:15 (3908): No heartbeat from core client for 30 sec - exiting 08:02:16 (3908): No heartbeat from core client for 30 sec - exiting 08:02:17 (3908): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:35:06 (5672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:35:08 (5672): No heartbeat from core client for 30 sec - exiting 16:35:09 (5672): No heartbeat from core client for 30 sec - exiting 16:35:10 (5672): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:28:55 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:58 (6176): No heartbeat from core client for 30 sec - exiting 18:28:59 (6176): No heartbeat from core client for 30 sec - exiting 18:29:00 (6176): No heartbeat from core client for 30 sec - exiting 18:29:01 (6176): No heartbeat from core client for 30 sec - exiting 18:29:02 (6176): No heartbeat from core client for 30 sec - exiting 18:29:03 (6176): No heartbeat from core client for 30 sec - exiting 18:29:04 (6176): No heartbeat from core client for 30 sec - exiting 18:29:05 (6176): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:06:53 (119768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:54 (119768): No heartbeat from core client for 30 sec - exiting 08:06:55 (119768): No heartbeat from core client for 30 sec - exiting 08:06:56 (119768): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:24:00 (161136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:03 (161136): No heartbeat from core client for 30 sec - exiting 09:24:04 (161136): No heartbeat from core client for 30 sec - exiting 09:24:05 (161136): No heartbeat from core client for 30 sec - exiting 09:24:06 (161136): No heartbeat from core client for 30 sec - exiting 09:24:07 (161136): No heartbeat from core client for 30 sec - exiting 09:24:08 (161136): No heartbeat from core client for 30 sec - exiting 09:24:09 (161136): No heartbeat from core client for 30 sec - exiting 09:24:11 (161136): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:56:29 (160960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:33 (160960): No heartbeat from core client for 30 sec - exiting 15:56:34 (160960): No heartbeat from core client for 30 sec - exiting 15:56:35 (160960): No heartbeat from core client for 30 sec - exiting 15:56:36 (160960): No heartbeat from core client for 30 sec - exiting 15:56:37 (160960): No heartbeat from core client for 30 sec - exiting 15:56:38 (160960): No heartbeat from core client for 30 sec - exiting 15:56:39 (160960): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:17:46 (318136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:48 (318136): No heartbeat from core client for 30 sec - exiting 10:17:49 (318136): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:04:08 (318132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:04:10 (318132): No heartbeat from core client for 30 sec - exiting 14:04:12 (318132): No heartbeat from core client for 30 sec - exiting 14:04:13 (318132): No heartbeat from core client for 30 sec - exiting 14:04:14 (318132): No heartbeat from core client for 30 sec - exiting 14:04:15 (318132): No heartbeat from core client for 30 sec - exiting 14:04:16 (318132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:54:36 (359940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:38 (359940): No heartbeat from core client for 30 sec - exiting 17:54:39 (359940): No heartbeat from core client for 30 sec - exiting 17:54:40 (359940): No heartbeat from core client for 30 sec - exiting 17:54:41 (359940): No heartbeat from core client for 30 sec - exiting 17:54:42 (359940): No heartbeat from core client for 30 sec - exiting 17:54:43 (359940): No heartbeat from core client for 30 sec - exiting 17:54:44 (359940): No heartbeat from core client for 30 sec - exiting 17:54:45 (359940): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:54:39 (361020): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:54:12 (359760): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 18:54:15 (359760): No heartbeat from core client for 30 sec - exiting 18:54:16 (359760): No heartbeat from core client for 30 sec - exiting 18:54:17 (359760): No heartbeat from core client for 30 sec - exiting 18:54:18 (359760): No heartbeat from core client for 30 sec - exiting 18:54:19 (359760): No heartbeat from core client for 30 sec - exiting 18:54:20 (359760): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:45:52 (344500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:45:54 (344500): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:00:33 (367744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:34 (367744): No heartbeat from core client for 30 sec - exiting 08:00:35 (367744): No heartbeat from core client for 30 sec - exiting 08:00:37 (367744): No heartbeat from core client for 30 sec - exiting 08:00:38 (367744): No heartbeat from core client for 30 sec - exiting 08:00:39 (367744): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:00:40 (369456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:42 (369456): No heartbeat from core client for 30 sec - exiting 20:00:43 (369456): No heartbeat from core client for 30 sec - exiting 20:00:44 (369456): No heartbeat from core client for 30 sec - exiting 20:00:45 (369456): No heartbeat from core client for 30 sec - exiting 20:00:46 (369456): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:06:11 (375784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:13 (375784): No heartbeat from core client for 30 sec - exiting 08:06:14 (375784): No heartbeat from core client for 30 sec - exiting 08:06:15 (375784): No heartbeat from core client for 30 sec - exiting 08:06:16 (375784): No heartbeat from core client for 30 sec - exiting 08:06:17 (375784): No heartbeat from core client for 30 sec - exiting 08:06:19 (375784): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:24:08 (5240): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:24:10 (5240): No heartbeat from core client for 30 sec - exiting 16:24:11 (5240): No heartbeat from core client for 30 sec - exiting 16:24:12 (5240): No heartbeat from core client for 30 sec - exiting 16:24:13 (5240): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:21:08 (18380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:10 (18380): No heartbeat from core client for 30 sec - exiting 16:21:11 (18380): No heartbeat from core client for 30 sec - exiting 16:21:12 (18380): No heartbeat from core client for 30 sec - exiting 16:21:13 (18380): No heartbeat from core client for 30 sec - exiting 16:21:14 (18380): No heartbeat from core client for 30 sec - exiting 16:21:15 (18380): No heartbeat from core client for 30 sec - exiting 16:21:16 (18380): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:27:32 (9900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:27:33 (9900): No heartbeat from core client for 30 sec - exiting 22:27:34 (9900): No heartbeat from core client for 30 sec - exiting 22:27:35 (9900): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:36:31 (7044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:36:33 (7044): No heartbeat from core client for 30 sec - exiting 09:36:35 (7044): No heartbeat from core client for 30 sec - exiting 09:36:36 (7044): No heartbeat from core client for 30 sec - exiting 09:36:37 (7044): No heartbeat from core client for 30 sec - exiting 09:36:38 (7044): No heartbeat from core client for 30 sec - exiting 09:36:39 (7044): No heartbeat from core client for 30 sec - exiting 09:36:40 (7044): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:09:08 (28636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:09:11 (28636): No heartbeat from core client for 30 sec - exiting 00:09:12 (28636): No heartbeat from core client for 30 sec - exiting 00:09:13 (28636): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:26:23 (246664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:24 (246664): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:00:10 (243512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:13 (243512): No heartbeat from core client for 30 sec - exiting 16:00:14 (243512): No heartbeat from core client for 30 sec - exiting 16:00:15 (243512): No heartbeat from core client for 30 sec - exiting 16:00:16 (243512): No heartbeat from core client for 30 sec - exiting 16:00:17 (243512): No heartbeat from core client for 30 sec - exiting 16:00:18 (243512): No heartbeat from core client for 30 sec - exiting 16:00:19 (243512): No heartbeat from core client for 30 sec - exiting 16:00:20 (243512): No heartbeat from core client for 30 sec - exiting 16:00:21 (243512): No heartbeat from core client for 30 sec - exiting 16:00:22 (243512): No heartbeat from core client for 30 sec - exiting 16:00:23 (243512): No heartbeat from core client for 30 sec - exiting 16:00:24 (243512): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:04:01 (244608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:03 (244608): No heartbeat from core client for 30 sec - exiting 21:04:05 (244608): No heartbeat from core client for 30 sec - exiting 21:04:06 (244608): No heartbeat from core client for 30 sec - exiting 21:04:07 (244608): No heartbeat from core client for 30 sec - exiting 21:04:08 (244608): No heartbeat from core client for 30 sec - exiting 21:04:09 (244608): No heartbeat from core client for 30 sec - exiting 21:04:10 (244608): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:57:13 (227072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:16 (227072): No heartbeat from core client for 30 sec - exiting 08:57:17 (227072): No heartbeat from core client for 30 sec - exiting 08:57:18 (227072): No heartbeat from core client for 30 sec - exiting 08:57:19 (227072): No heartbeat from core client for 30 sec - exiting 08:57:20 (227072): No heartbeat from core client for 30 sec - exiting 08:57:21 (227072): No heartbeat from core client for 30 sec - exiting 08:57:22 (227072): No heartbeat from core client for 30 sec - exiting 08:57:23 (227072): No heartbeat from core client for 30 sec - exiting 08:57:24 (227072): No heartbeat from core client for 30 sec - exiting 08:57:25 (227072): No heartbeat from core client for 30 sec - exiting 08:57:26 (227072): No heartbeat from core client for 30 sec - exiting 08:57:27 (227072): No heartbeat from core client for 30 sec - exiting 08:57:28 (227072): No heartbeat from core client for 30 sec - exiting 08:57:29 (227072): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:23:13 (1068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:23:15 (1068): No heartbeat from core client for 30 sec - exiting 18:23:16 (1068): No heartbeat from core client for 30 sec - exiting 18:23:17 (1068): No heartbeat from core client for 30 sec - exiting 18:23:18 (1068): No heartbeat from core client for 30 sec - exiting 18:23:19 (1068): No heartbeat from core client for 30 sec - exiting 18:23:20 (1068): No heartbeat from core client for 30 sec - exiting 18:23:21 (1068): No heartbeat from core client for 30 sec - exiting 18:23:22 (1068): No heartbeat from core client for 30 sec - exiting 18:23:23 (1068): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:04:22 (24308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:26 (24308): No heartbeat from core client for 30 sec - exiting 09:04:27 (24308): No heartbeat from core client for 30 sec - exiting 09:04:28 (24308): No heartbeat from core client for 30 sec - exiting 09:04:29 (24308): No heartbeat from core client for 30 sec - exiting 09:04:30 (24308): No heartbeat from core client for 30 sec - exiting 09:04:31 (24308): No heartbeat from core client for 30 sec - exiting 09:04:32 (24308): No heartbeat from core client for 30 sec - exiting 09:04:33 (24308): No heartbeat from core client for 30 sec - exiting 09:04:34 (24308): No heartbeat from core client for 30 sec - exiting 09:04:35 (24308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:55:10 (56648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:12 (56648): No heartbeat from core client for 30 sec - exiting 08:55:13 (56648): No heartbeat from core client for 30 sec - exiting 08:55:14 (56648): No heartbeat from core client for 30 sec - exiting 08:55:15 (56648): No heartbeat from core client for 30 sec - exiting 08:55:16 (56648): No heartbeat from core client for 30 sec - exiting 08:55:17 (56648): No heartbeat from core client for 30 sec - exiting 08:55:18 (56648): No heartbeat from core client for 30 sec - exiting 08:55:19 (56648): No heartbeat from core client for 30 sec - exiting 08:55:20 (56648): No heartbeat from core client for 30 sec - exiting 08:55:21 (56648): No heartbeat from core client for 30 sec - exiting 08:55:22 (56648): No heartbeat from core client for 30 sec - exiting 08:55:23 (56648): No heartbeat from core client for 30 sec - exiting 08:55:24 (56648): No heartbeat from core client for 30 sec - exiting 08:55:25 (56648): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:16:50 (6300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:51 (6300): No heartbeat from core client for 30 sec - exiting 16:16:52 (6300): No heartbeat from core client for 30 sec - exiting 16:16:53 (6300): No heartbeat from core client for 30 sec - exiting 16:16:54 (6300): No heartbeat from core client for 30 sec - exiting 16:16:55 (6300): No heartbeat from core client for 30 sec - exiting 16:16:56 (6300): No heartbeat from core client for 30 sec - exiting 16:16:57 (6300): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7092, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6612, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6612, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Nov 2013 07:37:49	1277339	15950543	hadcm3n_75c4_1980_40_008418199_0	77,760	115,711	1.4881
04 Oct 2013 23:44:56	1277339	15950543	hadcm3n_75c4_1980_40_008418199_0	51,840	81,194	1.5662
25 Sep 2013 20:22:18	1277339	15950543	hadcm3n_75c4_1980_40_008418199_0	25,920	40,451	1.5606