Task 13585372

Name	hadcm3n_yi24_1900_40_007526175_3
Workunit	7723650
Created	2 Nov 2011, 12:02:05 UTC
Sent	2 Nov 2011, 12:12:23 UTC
Report deadline	1 Feb 2012, 19:39:34 UTC
Received	15 Nov 2011, 16:42:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	172560
Run time	8 days 17 hours 1 min 2 sec
CPU time	6 days 15 hours 58 min 25 sec
Validate state	Invalid
Credit	1,866.24
Device peak FLOPS	1.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 08:35:39 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:47 (6400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:02 (7772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:54 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:25 (3888): No heartbeat from core client for 30 sec - exiting 22:40:26 (3888): No heartbeat from core client for 30 sec - exiting 22:40:27 (3888): No heartbeat from core client for 30 sec - exiting 22:40:28 (3888): No heartbeat from core client for 30 sec - exiting 22:40:29 (3888): No heartbeat from core client for 30 sec - exiting 22:40:30 (3888): No heartbeat from core client for 30 sec - exiting 22:40:31 (3888): No heartbeat from core client for 30 sec - exiting 22:40:32 (3888): No heartbeat from core client for 30 sec - exiting 22:40:33 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:34 (3888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:39:55 (3120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:54 (7996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:55 (7048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:23 (6160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:41 (7488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:35 (5036): No heartbeat from core client for 30 sec - exiting 23:14:36 (5036): No heartbeat from core client for 30 sec - exiting 23:14:37 (5036): No heartbeat from core client for 30 sec - exiting 23:14:38 (5036): No heartbeat from core client for 30 sec - exiting 23:14:39 (5036): No heartbeat from core client for 30 sec - exiting 23:14:40 (5036): No heartbeat from core client for 30 sec - exiting 23:14:41 (5036): No heartbeat from core client for 30 sec - exiting 23:14:42 (5036): No heartbeat from core client for 30 sec - exiting 23:14:43 (5036): No heartbeat from core client for 30 sec - exiting 23:14:44 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:14:45 (5036): No heartbeat from core client for 30 sec - exiting 02:53:44 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:57:09 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:58:19 (8140): No heartbeat from core client for 30 sec - exiting 03:58:20 (8140): No heartbeat from core client for 30 sec - exiting 03:58:21 (8140): No heartbeat from core client for 30 sec - exiting 03:58:22 (8140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:08 (6300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:47 (6924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:43:09 (7336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:35 (5912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:40:58 (7956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:30:50 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:41:09 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:00 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:48 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:41:08 (6588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:42:11 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:18 (6832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:41:20 (8036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:47 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:26 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:35 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:20 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:26 (1468): No heartbeat from core client for 30 sec - exiting 22:40:27 (1468): No heartbeat from core client for 30 sec - exiting 22:40:28 (1468): No heartbeat from core client for 30 sec - exiting 22:40:29 (1468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:30 (1468): No heartbeat from core client for 30 sec - exiting 22:40:31 (1468): No heartbeat from core client for 30 sec - exiting 22:40:32 (1468): No heartbeat from core client for 30 sec - exiting 22:40:33 (1468): No heartbeat from core client for 30 sec - exiting 22:40:34 (1468): No heartbeat from core client for 30 sec - exiting 22:52:59 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:50 (6176): No heartbeat from core client for 30 sec - exiting 22:53:51 (6176): No heartbeat from core client for 30 sec - exiting 22:53:52 (6176): No heartbeat from core client for 30 sec - exiting 22:53:53 (6176): No heartbeat from core client for 30 sec - exiting 22:53:54 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:43:03 (4672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:24 (7792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:26 (7792): No heartbeat from core client for 30 sec - exiting 18:21:27 (7792): No heartbeat from core client for 30 sec - exiting 19:41:27 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:28 (4348): No heartbeat from core client for 30 sec - exiting 19:41:29 (4348): No heartbeat from core client for 30 sec - exiting 19:41:30 (4348): No heartbeat from core client for 30 sec - exiting 19:41:31 (4348): No heartbeat from core client for 30 sec - exiting 19:41:32 (4348): No heartbeat from core client for 30 sec - exiting 19:41:33 (4348): No heartbeat from core client for 30 sec - exiting 19:41:34 (4348): No heartbeat from core client for 30 sec - exiting 19:43:48 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:00 (5704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:06 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:44:14 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:30 (2400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:44:59 (9252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:13 (14168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:14 (14168): No heartbeat from core client for 30 sec - exiting 22:03:15 (14168): No heartbeat from core client for 30 sec - exiting 22:03:16 (14168): No heartbeat from core client for 30 sec - exiting 22:03:17 (14168): No heartbeat from core client for 30 sec - exiting 22:03:18 (14168): No heartbeat from core client for 30 sec - exiting 22:03:19 (14168): No heartbeat from core client for 30 sec - exiting 22:03:20 (14168): No heartbeat from core client for 30 sec - exiting 22:03:21 (14168): No heartbeat from core client for 30 sec - exiting 22:03:22 (14168): No heartbeat from core client for 30 sec - exiting 22:03:23 (14168): No heartbeat from core client for 30 sec - exiting 22:44:58 (14008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:31 (13784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:54 (12068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:16:42 (16408): No heartbeat from core client for 30 sec - exiting 00:16:43 (16408): No heartbeat from core client for 30 sec - exiting 00:16:44 (16408): No heartbeat from core client for 30 sec - exiting 00:16:45 (16408): No heartbeat from core client for 30 sec - exiting 00:16:46 (16408): No heartbeat from core client for 30 sec - exiting 00:16:47 (16408): No heartbeat from core client for 30 sec - exiting 00:16:48 (16408): No heartbeat from core client for 30 sec - exiting 00:16:49 (16408): No heartbeat from core client for 30 sec - exiting 00:16:50 (16408): No heartbeat from core client for 30 sec - exiting 00:16:51 (16408): No heartbeat from core client for 30 sec - exiting 00:16:52 (16408): No heartbeat from core client for 30 sec - exiting 00:16:53 (16408): No heartbeat from core client for 30 sec - exiting 00:16:54 (16408): No heartbeat from core client for 30 sec - exiting 00:16:55 (16408): No heartbeat from core client for 30 sec - exiting 00:16:56 (16408): No heartbeat from core client for 30 sec - exiting 00:16:57 (16408): No heartbeat from core client for 30 sec - exiting 00:16:58 (16408): No heartbeat from core client for 30 sec - exiting 00:16:59 (16408): No heartbeat from core client for 30 sec - exiting 00:17:00 (16408): No heartbeat from core client for 30 sec - exiting 00:17:01 (16408): No heartbeat from core client for 30 sec - exiting 00:17:02 (16408): No heartbeat from core client for 30 sec - exiting 00:17:03 (16408): No heartbeat from core client for 30 sec - exiting 00:17:04 (16408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:29 (18320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:30 (18320): No heartbeat from core client for 30 sec - exiting 00:25:31 (18320): No heartbeat from core client for 30 sec - exiting 00:25:32 (18320): No heartbeat from core client for 30 sec - exiting 00:25:33 (18320): No heartbeat from core client for 30 sec - exiting 00:25:34 (18320): No heartbeat from core client for 30 sec - exiting 00:25:35 (18320): No heartbeat from core client for 30 sec - exiting 00:45:03 (17332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:08 (11692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:43:19 (18020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:30 (10792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:29 (19972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:54:31 (20936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:13 (21388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:02:12 (12032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:31 (21560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:46:56 (22604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:44:43 (18156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:41 (24044): No heartbeat from core client for 30 sec - exiting 05:46:42 (24044): No heartbeat from core client for 30 sec - exiting 05:46:43 (24044): No heartbeat from core client for 30 sec - exiting 05:46:44 (24044): No heartbeat from core client for 30 sec - exiting 05:46:45 (24044): No heartbeat from core client for 30 sec - exiting 05:46:46 (24044): No heartbeat from core client for 30 sec - exiting 05:46:47 (24044): No heartbeat from core client for 30 sec - exiting 05:46:48 (24044): No heartbeat from core client for 30 sec - exiting 05:46:49 (24044): No heartbeat from core client for 30 sec - exiting 05:46:51 (24044): No heartbeat from core client for 30 sec - exiting 05:46:52 (24044): No heartbeat from core client for 30 sec - exiting 05:46:53 (24044): No heartbeat from core client for 30 sec - exiting 05:46:54 (24044): No heartbeat from core client for 30 sec - exiting 05:46:55 (24044): No heartbeat from core client for 30 sec - exiting 05:46:56 (24044): No heartbeat from core client for 30 sec - exiting 05:46:57 (24044): No heartbeat from core client for 30 sec - exiting 05:46:58 (24044): No heartbeat from core client for 30 sec - exiting 05:46:59 (24044): No heartbeat from core client for 30 sec - exiting 05:47:00 (24044): No heartbeat from core client for 30 sec - exiting 05:47:01 (24044): No heartbeat from core client for 30 sec - exiting 05:47:02 (24044): No heartbeat from core client for 30 sec - exiting 05:47:03 (24044): No heartbeat from core client for 30 sec - exiting 05:47:04 (24044): No heartbeat from core client for 30 sec - exiting 05:47:05 (24044): No heartbeat from core client for 30 sec - exiting 05:47:06 (24044): No heartbeat from core client for 30 sec - exiting 05:47:07 (24044): No heartbeat from core client for 30 sec - exiting 05:47:08 (24044): No heartbeat from core client for 30 sec - exiting 05:47:09 (24044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:07 (23080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:32:42 (24332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:02 (26732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:19 (38216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:25 (43984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:19 (44760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:34 (46888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:46 (44336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:35 (45088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:50 (59268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:25 (12840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:21:06 (12908): No heartbeat from core client for 30 sec - exiting 20:21:07 (12908): No heartbeat from core client for 30 sec - exiting 20:21:08 (12908): No heartbeat from core client for 30 sec - exiting 20:21:09 (12908): No heartbeat from core client for 30 sec - exiting 20:21:10 (12908): No heartbeat from core client for 30 sec - exiting 20:21:11 (12908): No heartbeat from core client for 30 sec - exiting 20:21:12 (12908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:29:25 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:06 (38160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:09:02 (7976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:11:06 (2044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:34:57 (7728): No heartbeat from core client for 30 sec - exiting 03:34:58 (7728): No heartbeat from core client for 30 sec - exiting 03:34:59 (7728): No heartbeat from core client for 30 sec - exiting 03:35:00 (7728): No heartbeat from core client for 30 sec - exiting 03:35:01 (7728): No heartbeat from core client for 30 sec - exiting 03:35:02 (7728): No heartbeat from core client for 30 sec - exiting 03:35:03 (7728): No heartbeat from core client for 30 sec - exiting 03:35:04 (7728): No heartbeat from core client for 30 sec - exiting 03:35:05 (7728): No heartbeat from core client for 30 sec - exiting 03:35:07 (7728): No heartbeat from core client for 30 sec - exiting 03:35:13 (7728): No heartbeat from core client for 30 sec - exiting 03:35:14 (7728):CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting 03:35:16 (7728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:53:30 (6284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:37 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:00 (6744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:41 (7492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:01:13 (6780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:33 (320): No heartbeat from core client for 30 sec - exiting 19:54:34 (320): No heartbeat from core client for 30 sec - exiting 19:54:35 (320): No heartbeat from core client for 30 sec - exiting 19:54:36 (320): No heartbeat from core client for 30 sec - exiting 19:54:37 (320): No heartbeat from core client for 30 sec - exiting 19:54:38 (320): No heartbeat from core client for 30 sec - exiting 19:54:39 (320): No heartbeat from core client for 30 sec - exiting 19:54:40 (320): No heartbeat from core client for 30 sec - exiting 20:28:29 (7940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:30 (7940): No heartbeat from core client for 30 sec - exiting 20:28:31 (7940): No heartbeat from core client for 30 sec - exiting 20:28:32 (7940): No heartbeat from core client for 30 sec - exiting 20:28:33 (7940): No heartbeat from core client for 30 sec - exiting 20:28:34 (7940): No heartbeat from core client for 30 sec - exiting 20:30:14 (6188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:10 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:36 (7308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:06 (3408): No heartbeat from core client for 30 sec - exiting 21:53:07 (3408): No heartbeat from core client for 30 sec - exiting 21:53:08 (3408): No heartbeat from core client for 30 sec - exiting 21:53:09 (3408): No heartbeat from core client for 30 sec - exiting 21:53:10 (3408): No heartbeat from core client for 30 sec - exiting 21:53:11 (3408): No heartbeat from core client for 30 sec - exiting 21:53:12 (3408): No heartbeat from core client for 30 sec - exiting 21:53:13 (3408): No heartbeat from core client for 30 sec - exiting 21:53:14 (3408): No heartbeat from core client for 30 sec - exiting 21:53:15 (3408): No heartbeat from core client for 30 sec - exiting 21:53:16 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:17 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 22:51:29 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:27 (6832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:37 (7188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:46:29 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:52:43 (6608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:54:45 (7400): No heartbeat from core client for 30 sec - exiting 00:54:46 (7400): No heartbeat from core client for 30 sec - exiting 00:54:47 (7400): No heartbeat from core client for 30 sec - exiting 00:54:48 (7400): No heartbeat from core client for 30 sec - exiting 00:54:49 (7400): No heartbeat from core client for 30 sec - exiting 00:54:50 (7400): No heartbeat from core client for 30 sec - exiting 00:54:51 (7400): No heartbeat from core client for 30 sec - exiting 00:54:52 (7400): No heartbeat from core client for 30 sec - exiting 00:54:53 (7400): No heartbeat from core client for 30 sec - exiting 00:54:54 (7400): No heartbeat from core client for 30 sec - exiting 00:54:55 (7400): No heartbeat from core client for 30 sec - exiting 00:54:56 (7400): No heartbeat from core client for 30 sec - exiting 00:54:57 (7400): No heartbeat from core client for 30 sec - exiting 00:54:59 (7400): No heartbeat from core client for 30 sec - exiting 00:55:00 (7400): No heartbeat from core client for 30 sec - exiting 00:55:02 (7400): No heartbeat from core client for 30 sec - exiting 00:55:03 (7400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:01:34 (6632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:09:56 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:11:32 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:34 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:40 (7852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:09 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:50 (6948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:52 (8076): No heartbeat from core client for 30 sec - exiting 03:20:53 (8076): No heartbeat from core client for 30 sec - exiting 03:20:54 (8076): No heartbeat from core client for 30 sec - exiting 03:20:55 (8076): No heartbeat from core client for 30 sec - exiting 03:20:56 (8076): No heartbeat from core client for 30 sec - exiting 03:20:57 (8076): No heartbeat from core client for 30 sec - exiting 03:20:58 (8076): No heartbeat from core client for 30 sec - exiting 03:20:59 (8076): No heartbeat from core client for 30 sec - exiting 03:21:01 (8076): No heartbeat from core client for 30 sec - exiting 03:21:02 (8076): No heartbeat from core client for 30 sec - exiting 03:21:03 (8076): No heartbeat from core client for 30 sec - exiting 03:21:04 (8076): No heartbeat from core client for 30 sec - exiting 03:21:05 (8076): No heartbeat from core client for 30 sec - exiting 03:21:06 (8076): No heartbeat from core client for 30 sec - exiting 03:21:07 (8076): No heartbeat from core client for 30 sec - exiting 03:21:08 (8076): No heartbeat from core client for 30 sec - exiting 03:21:09 (8076): No heartbeat from core client for 30 sec - exiting 03:21:10 (8076): No heartbeat from core client for 30 sec - exiting 03:21:11 (8076): No heartbeat from core client for 30 sec - exiting 03:21:12 (8076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yi24ko.pja6c10 Error converting file to netcdf: dataout/yi24ko.pia6c10 Error converting file to netcdf: dataout/yi24ko.pfa6c10 Error converting file to netcdf: dataout/yi24ka.pha6c10 Error converting file to netcdf: dataout/yi24ka.pga6c10 Error converting file to netcdf: dataout/yi24ka.pea6c10 Error converting file to netcdf: dataout/yi24ka.pda6c10 03:32:45 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:37 (4940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:05:08 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:07:49 (6184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:32 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:31:56 (6472): No heartbeat from core client for 30 sec - exiting 05:31:57 (6472): No heartbeat from core client for 30 sec - exiting 05:31:58 (6472): No heartbeat from core client for 30 sec - exiting 05:31:59 (6472): No heartbeat from core client for 30 sec - exiting 05:32:00 (6472): No heartbeat from core client for 30 sec - exiting 05:32:01 (6472): No heartbeat from core client for 30 sec - exiting 05:32:02 (6472): No heartbeat from core client for 30 sec - exiting 05:32:03 (6472): No heartbeat from core client for 30 sec - exiting 05:32:04 (6472): No heartbeat from core client for 30 sec - exiting 05:32:05 (6472): No heartbeat from core client for 30 sec - exiting 05:32:06 (6472): No heartbeat from core client for 30 sec - exiting 05:32:07 (6472): No heartbeat from core client for 30 sec - exiting 05:32:08 (6472): No heartbeat from core client for 30 sec - exiting 05:32:09 (6472): No heartbeat from core client for 30 sec - exiting 05:32:10 (6472): No heartbeat from core client for 30 sec - exiting 05:32:11 (6472): No heartbeat from core client for 30 sec - exiting 05:32:12 (6472): No heartbeat from core client for 30 sec - exiting 05:32:13 (6472): No heartbeat from core client for 30 sec - exiting 05:32:14 (6472): No heartbeat from core client for 30 sec - exiting 05:32:15 (6472): No heartbeat from core client for 30 sec - exiting 05:32:16 (6472): No heartbeat from core client for 30 sec - exiting 05:32:17 (6472): No heartbeat from core client for 30 sec - exiting 05:32:18 (6472): No heartbeat from core client for 30 sec - exiting 05:32:19 (6472): No heartbeat from core client for 30 sec - exiting 05:32:20 (6472): No heartbeat from core client for 30 sec - exiting 05:32:21 (6472): No heartbeat from core client for 30 sec - exiting 05:32:22 (6472): No heartbeat from core client for 30 sec - exiting 05:32:23 (6472): No heartbeat from core client for 30 sec - exiting 05:32:24 (6472): No heartbeat from core client for 30 sec - exiting 05:32:25 (6472): No heartbeat from core client for 30 sec - exiting 05:32:26 (6472): No heartbeat from core client for 30 sec - exiting 05:32:27 (6472): No heartbeat from core client for 30 sec - exiting 05:32:28 (6472): No heartbeat from core client for 30 sec - exiting 05:32:29 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:30 (6472): No heartbeat from core client for 30 sec - exiting 05:32:31 (6472): No heartbeat from core client for 30 sec - exiting 05:32:32 (6472): No heartbeat from core client for 30 sec - exiting 06:05:14 (7680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:13 (7116): No heartbeat from core client for 30 sec - exiting 06:07:14 (7116): No heartbeat from core client for 30 sec - exiting 06:07:15 (7116): No heartbeat from core client for 30 sec - exiting 06:07:16 (7116): No heartbeat from core client for 30 sec - exiting 06:07:17 (7116): No heartbeat from core client for 30 sec - exiting 06:07:18 (7116): No heartbeat from core client for 30 sec - exiting 06:07:19 (7116): No heartbeat from core client for 30 sec - exiting 06:07:20 (7116): No heartbeat from core client for 30 sec - exiting 06:07:21 (7116): No heartbeat from core client for 30 sec - exiting 06:07:22 (7116): No heartbeat from core client for 30 sec - exiting 06:07:23 (7116): No heartbeat from core client for 30 sec - exiting 06:07:24 (7116): No heartbeat from core client for 30 sec - exiting 06:07:25 (7116): No heartbeat from core client for 30 sec - exiting 06:07:26 (7116): No heartbeat from core client for 30 sec - exiting 06:07:27 (7116): No heartbeat from core client for 30 sec - exiting 06:07:28 (7116): No heartbeat from core client for 30 sec - exiting 06:07:29 (7116): No heartbeat from core client for 30 sec - exiting 06:07:30 (7116): No heartbeat from core client for 30 sec - exiting 06:07:31 (7116): No heartbeat from core client for 30 sec - exiting 06:07:32 (7116): No heartbeat from core client for 30 sec - exiting 06:07:33 (7116): No heartbeat from core client for 30 sec - exiting 06:07:34 (7116): No heartbeat from core client for 30 sec - exiting 06:07:35 (7116): No heartbeat from core client for 30 sec - exiting 06:07:36 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:37 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6100, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6100, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5964, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5964, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Nov 2011 17:01:19	172560	13585372	hadcm3n_yi24_1900_40_007526175_3	155,520	575,370	3.6997
10 Nov 2011 03:20:08	172560	13585372	hadcm3n_yi24_1900_40_007526175_3	129,600	478,896	3.6952
08 Nov 2011 16:31:08	172560	13585372	hadcm3n_yi24_1900_40_007526175_3	103,680	382,357	3.6879
06 Nov 2011 16:59:47	172560	13585372	hadcm3n_yi24_1900_40_007526175_3	77,760	282,568	3.6338
05 Nov 2011 04:26:36	172560	13585372	hadcm3n_yi24_1900_40_007526175_3	51,840	187,024	3.6077
03 Nov 2011 19:15:19	172560	13585372	hadcm3n_yi24_1900_40_007526175_3	25,920	92,545	3.5704