Task 15844823

Name	hadcm3n_o6dd_1940_40_008380655_1
Workunit	8531514
Created	16 Jun 2013, 11:06:20 UTC
Sent	16 Jun 2013, 11:19:29 UTC
Report deadline	15 Sep 2013, 18:46:40 UTC
Received	5 Jul 2013, 19:26:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1048681
Run time	3 days 22 hours 42 min 2 sec
CPU time	3 days 16 hours 33 min 46 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.88 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 07:50:34 (4292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:56:22 (8052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:58:16 (8040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:58 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:25:13 (7476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:02 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:50:41 (8092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:20:21 (784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:22 (784): No heartbeat from core client for 30 sec - exiting 20:20:23 (784): No heartbeat from core client for 30 sec - exiting 20:20:24 (784): No heartbeat from core client for 30 sec - exiting 20:20:25 (784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:48:25 (3428): No heartbeat from core client for 30 sec - exiting 05:48:26 (3428): No heartbeat from core client for 30 sec - exiting 05:48:27 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:52:19 (7712): No heartbeat from core client for 30 sec - exiting 18:52:20 (7712): No heartbeat from core client for 30 sec - exiting 18:52:21 (7712): No heartbeat from core client for 30 sec - exiting 18:52:22 (7712): No heartbeat from core client for 30 sec - exiting 18:52:23 (7712): No heartbeat from core client for 30 sec - exiting 18:52:24 (7712): No heartbeat from core client for 30 sec - exiting 18:52:25 (7712): No heartbeat from core client for 30 sec - exiting 18:52:26 (7712): No heartbeat from core client for 30 sec - exiting 18:52:27 (7712): No heartbeat from core client for 30 sec - exiting 18:52:28 (7712): No heartbeat from core client for 30 sec - exiting 18:52:29 (7712): No heartbeat from core client for 30 sec - exiting 18:52:30 (7712): No heartbeat from core client for 30 sec - exiting 18:52:31 (7712): No heartbeat from core client for 30 sec - exiting 18:52:32 (7712): No heartbeat from core client for 30 sec - exiting 18:52:33 (7712): No heartbeat from core client for 30 sec - exiting 18:52:34 (7712): No heartbeat from core client for 30 sec - exiting 18:52:35 (7712): No heartbeat from core client for 30 sec - exiting 18:52:36 (7712): No heartbeat from core client for 30 sec - exiting 18:52:37 (7712): No heartbeat from core client for 30 sec - exiting 18:52:38 (7712): No heartbeat from core client for 30 sec - exiting 18:52:39 (7712): No heartbeat from core client for 30 sec - exiting 18:52:40 (7712): No heartbeat from core client for 30 sec - exiting 18:52:41 (7712): No heartbeat from core client for 30 sec - exiting 18:52:42 (7712): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:26:36 (1276): No heartbeat from core client for 30 sec - exiting 19:26:37 (1276): No heartbeat from core client for 30 sec - exiting 19:26:38 (1276): No heartbeat from core client for 30 sec - exiting 19:26:39 (1276): No heartbeat from core client for 30 sec - exiting 19:26:40 (1276): No heartbeat from core client for 30 sec - exiting 19:26:41 (1276): No heartbeat from core client for 30 sec - exiting 19:26:42 (1276): No heartbeat from core client for 30 sec - exiting 19:26:43 (1276): No heartbeat from core client for 30 sec - exiting 19:26:44 (1276): No heartbeat from core client for 30 sec - exiting 19:26:45 (1276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:57:02 (7080): No heartbeat from core client for 30 sec - exiting 10:57:03 (7080): No heartbeat from core client for 30 sec - exiting 10:57:04 (7080): No heartbeat from core client for 30 sec - exiting 10:57:05 (7080): No heartbeat from core client for 30 sec - exiting 10:57:06 (7080): No heartbeat from core client for 30 sec - exiting 10:57:07 (7080): No heartbeat from core client for 30 sec - exiting 10:57:08 (7080): No heartbeat from core client for 30 sec - exiting 10:57:09 (7080): No heartbeat from core client for 30 sec - exiting 10:57:10 (7080): No heartbeat from core client for 30 sec - exiting 10:57:11 (7080): No heartbeat from core client for 30 sec - exiting 10:57:12 (7080): No heartbeat from core client for 30 sec - exiting 10:57:13 (7080): No heartbeat from core client for 30 sec - exiting 10:57:14 (7080): No heartbeat from core client for 30 sec - exiting 10:57:15 (7080): No heartbeat from core client for 30 sec - exiting 10:57:16 (7080): No heartbeat from core client for 30 sec - exiting 10:57:17 (7080): No heartbeat from core client for 30 sec - exiting 10:57:18 (7080): No heartbeat from core client for 30 sec - exiting 10:57:19 (7080): No heartbeat from core client for 30 sec - exiting 10:57:20 (7080): No heartbeat from core client for 30 sec - exiting 10:57:21 (7080): No heartbeat from core client for 30 sec - exiting 10:57:22 (7080): No heartbeat from core client for 30 sec - exiting 10:57:23 (7080): No heartbeat from core client for 30 sec - exiting 10:57:24 (7080): No heartbeat from core client for 30 sec - exiting 10:57:25 (7080): No heartbeat from core client for 30 sec - exiting 10:57:26 (7080): No heartbeat from core client for 30 sec - exiting 10:57:27 (7080): No heartbeat from core client for 30 sec - exiting 10:57:28 (7080): No heartbeat from core client for 30 sec - exiting 10:57:29 (7080): No heartbeat from core client for 30 sec - exiting 10:57:30 (7080): No heartbeat from core client for 30 sec - exiting 10:57:31 (7080): No heartbeat from core client for 30 sec - exiting 10:57:32 (7080): No heartbeat from core client for 30 sec - exiting 10:57:33 (7080): No heartbeat from core client for 30 sec - exiting 10:57:34 (7080): No heartbeat from core client for 30 sec - exiting 10:57:35 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:36 (7080): No heartbeat from core client for 30 sec - exiting 10:57:37 (7080): No heartbeat from core client for 30 sec - exiting 10:57:38 (7080): No heartbeat from core client for 30 sec - exiting 10:57:39 (7080): No heartbeat from core client for 30 sec - exiting 10:57:40 (7080): No heartbeat from core client for 30 sec - exiting 10:57:41 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:33:41 (8400): No heartbeat from core client for 30 sec - exiting 17:33:42 (8400): No heartbeat from core client for 30 sec - exiting 17:33:43 (8400): No heartbeat from core client for 30 sec - exiting 17:33:44 (8400): No heartbeat from core client for 30 sec - exiting 17:33:45 (8400): No heartbeat from core client for 30 sec - exiting 17:33:46 (8400): No heartbeat from core client for 30 sec - exiting 17:33:47 (8400): No heartbeat from core client for 30 sec - exiting 17:33:48 (8400): No heartbeat from core client for 30 sec - exiting 17:33:49 (8400): No heartbeat from core client for 30 sec - exiting 17:33:50 (8400): No heartbeat from core client for 30 sec - exiting 17:33:51 (8400): No heartbeat from core client for 30 sec - exiting 17:33:52 (8400): No heartbeat from core client for 30 sec - exiting 17:33:53 (8400): No heartbeat from core client for 30 sec - exiting 17:33:54 (8400): No heartbeat from core client for 30 sec - exiting 17:33:55 (8400): No heartbeat from core client for 30 sec - exiting 17:33:56 (8400): No heartbeat from core client for 30 sec - exiting 17:33:57 (8400): No heartbeat from core client for 30 sec - exiting 17:33:58 (8400): No heartbeat from core client for 30 sec - exiting 17:33:59 (8400): No heartbeat from core client for 30 sec - exiting 17:34:00 (8400): No heartbeat from core client for 30 sec - exiting 17:34:01 (8400): No heartbeat from core client for 30 sec - exiting 17:34:02 (8400): No heartbeat from core client for 30 sec - exiting 17:34:03 (8400): No heartbeat from core client for 30 sec - exiting 17:34:04 (8400): No heartbeat from core client for 30 sec - exiting 17:34:06 (8400): No heartbeat from core client for 30 sec - exiting 17:34:07 (8400): No heartbeat from core client for 30 sec - exiting 17:34:08 (8400): No heartbeat from core client for 30 sec - exiting 17:34:09 (8400): No heartbeat from core client for 30 sec - exiting 17:34:10 (8400): No heartbeat from core client for 30 sec - exiting 17:34:11 (8400): No heartbeat from core client for 30 sec - exiting 17:34:12 (8400): No heartbeat from core client for 30 sec - exiting 17:34:13 (8400): No heartbeat from core client for 30 sec - exiting 17:34:14 (8400): No heartbeat from core client for 30 sec - exiting 17:34:15 (8400): No heartbeat from core client for 30 sec - exiting 17:34:16 (8400): No heartbeat from core client for 30 sec - exiting 17:34:17 (8400): No heartbeat from core client for 30 sec - exiting 17:34:18 (8400): No heartbeat from core client for 30 sec - exiting 17:34:19 (8400): No heartbeat from core client for 30 sec - exiting 17:34:20 (8400): No heartbeat from core client for 30 sec - exiting 17:34:21 (8400): No heartbeat from core client for 30 sec - exiting 17:34:22 (8400): No heartbeat from core client for 30 sec - exiting 17:34:23 (8400): No heartbeat from core client for 30 sec - exiting 17:34:24 (8400): No heartbeat from core client for 30 sec - exiting 17:34:25 (8400): No heartbeat from core client for 30 sec - exiting 17:34:26 (8400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:27 (8400): No heartbeat from core client for 30 sec - exiting 17:34:28 (8400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:58:14 (8256): No heartbeat from core client for 30 sec - exiting 06:58:15 (8256): No heartbeat from core client for 30 sec - exiting 06:58:16 (8256): No heartbeat from core client for 30 sec - exiting 06:58:17 (8256): No heartbeat from core client for 30 sec - exiting 06:58:18 (8256): No heartbeat from core client for 30 sec - exiting 06:58:19 (8256): No heartbeat from core client for 30 sec - exiting 06:58:20 (8256): No heartbeat from core client for 30 sec - exiting 06:58:22 (8256): No heartbeat from core client for 30 sec - exiting 06:58:23 (8256): No heartbeat from core client for 30 sec - exiting 06:58:24 (8256): No heartbeat from core client for 30 sec - exiting 06:58:25 (8256): No heartbeat from core client for 30 sec - exiting 06:58:26 (8256): No heartbeat from core client for 30 sec - exiting 06:58:27 (8256): No heartbeat from core client for 30 sec - exiting 06:58:28 (8256): No heartbeat from core client for 30 sec - exiting 06:58:29 (8256): No heartbeat from core client for 30 sec - exiting 06:58:30 (8256): No heartbeat from core client for 30 sec - exiting 06:58:31 (8256): No heartbeat from core client for 30 sec - exiting 06:58:32 (8256): No heartbeat from core client for 30 sec - exiting 06:58:33 (8256): No heartbeat from core client for 30 sec - exiting 06:58:34 (8256): No heartbeat from core client for 30 sec - exiting 06:58:35 (8256): No heartbeat from core client for 30 sec - exiting 06:58:36 (8256): No heartbeat from core client for 30 sec - exiting 06:58:37 (8256): No heartbeat from core client for 30 sec - exiting 06:58:38 (8256): No heartbeat from core client for 30 sec - exiting 06:58:39 (8256): No heartbeat from core client for 30 sec - exiting 06:58:40 (8256): No heartbeat from core client for 30 sec - exiting 06:58:41 (8256): No heartbeat from core client for 30 sec - exiting 06:58:42 (8256): No heartbeat from core client for 30 sec - exiting 06:58:43 (8256): No heartbeat from core client for 30 sec - exiting 06:58:44 (8256): No heartbeat from core client for 30 sec - exiting 06:58:45 (8256): No heartbeat from core client for 30 sec - exiting 06:58:46 (8256): No heartbeat from core client for 30 sec - exiting 06:58:47 (8256): No heartbeat from core client for 30 sec - exiting 06:58:48 (8256): No heartbeat from core client for 30 sec - exiting 06:58:49 (8256): No heartbeat from core client for 30 sec - exiting 06:58:50 (8256): No heartbeat from core client for 30 sec - exiting 06:58:51 (8256): No heartbeat from core client for 30 sec - exiting 06:58:52 (8256): No heartbeat from core client for 30 sec - exiting 06:58:53 (8256): No heartbeat from core client for 30 sec - exiting 06:58:54 (8256): No heartbeat from core client for 30 sec - exiting 06:58:55 (8256): No heartbeat from core client for 30 sec - exiting 06:58:56 (8256): No heartbeat from core client for 30 sec - exiting 06:58:57 (8256): No heartbeat from core client for 30 sec - exiting 06:58:58 (8256): No heartbeat from core client for 30 sec - exiting 06:58:59 (8256): No heartbeat from core client for 30 sec - exiting 06:59:00 (8256): No heartbeat from core client for 30 sec - exiting 06:59:01 (8256): No heartbeat from core client for 30 sec - exiting 06:59:02 (8256): No heartbeat from core client for 30 sec - exiting 06:59:03 (8256): No heartbeat from core client for 30 sec - exiting 06:59:04 (8256): No heartbeat from core client for 30 sec - exiting 06:59:05 (8256): No heartbeat from core client for 30 sec - exiting 06:59:06 (8256): No heartbeat from core client for 30 sec - exiting 06:59:07 (8256): No heartbeat from core client for 30 sec - exiting 06:59:08 (8256): No heartbeat from core client for 30 sec - exiting 06:59:09 (8256): No heartbeat from core client for 30 sec - exiting 06:59:10 (8256): No heartbeat from core client for 30 sec - exiting 06:59:11 (8256): No heartbeat from core client for 30 sec - exiting 06:59:12 (8256): No heartbeat from core client for 30 sec - exiting 06:59:13 (8256): No heartbeat from core client for 30 sec - exiting 06:59:14 (8256): No heartbeat from core client for 30 sec - exiting 06:59:15 (8256): No heartbeat from core client for 30 sec - exiting 06:59:16 (8256): No heartbeat from core client for 30 sec - exiting 06:59:17 (8256): No heartbeat from core client for 30 sec - exiting 06:59:18 (8256): No heartbeat from core client for 30 sec - exiting 06:59:19 (8256): No heartbeat from core client for 30 sec - exiting 06:59:20 (8256): No heartbeat from core client for 30 sec - exiting 06:59:21 (8256): No heartbeat from core client for 30 sec - exiting 06:59:22 (8256): No heartbeat from core client for 30 sec - exiting 06:59:23 (8256): No heartbeat from core client for 30 sec - exiting 06:59:24 (8256): No heartbeat from core client for 30 sec - exiting 06:59:25 (8256): No heartbeat from core client for 30 sec - exiting 06:59:26 (8256): No heartbeat from core client for 30 sec - exiting 06:59:27 (8256): No heartbeat from core client for 30 sec - exiting 06:59:28 (8256): No heartbeat from core client for 30 sec - exiting 06:59:29 (8256): No heartbeat from core client for 30 sec - exiting 06:59:30 (8256): No heartbeat from core client for 30 sec - exiting 06:59:31 (8256): No heartbeat from core client for 30 sec - exiting 06:59:32 (8256): No heartbeat from core client for 30 sec - exiting 06:59:33 (8256): No heartbeat from core client for 30 sec - exiting 06:59:34 (8256): No heartbeat from core client for 30 sec - exiting 06:59:35 (8256): No heartbeat from core client for 30 sec - exiting 06:59:36 (8256): No heartbeat from core client for 30 sec - exiting 06:59:37 (8256): No heartbeat from core client for 30 sec - exiting 06:59:38 (8256): No heartbeat from core client for 30 sec - exiting 06:59:39 (8256): No heartbeat from core client for 30 sec - exiting 06:59:40 (8256): No heartbeat from core client for 30 sec - exiting 06:59:41 (8256): No heartbeat from core client for 30 sec - exiting 06:59:42 (8256): No heartbeat from core client for 30 sec - exiting 06:59:43 (8256): No heartbeat from core client for 30 sec - exiting 06:59:44 (8256): No heartbeat from core client for 30 sec - exiting 06:59:45 (8256): No heartbeat from core client for 30 sec - exiting 06:59:46 (8256): No heartbeat from core client for 30 sec - exiting 06:59:47 (8256): No heartbeat from core client for 30 sec - exiting 06:59:48 (8256): No heartbeat from core client for 30 sec - exiting 06:59:49 (8256): No heartbeat from core client for 30 sec - exiting 06:59:50 (8256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:51 (8256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2013 05:09:50	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	259,200	321,021	1.2385
02 Jul 2013 11:10:07	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	233,280	281,167	1.2053
02 Jul 2013 10:23:30	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	207,360	247,875	1.1954
02 Jul 2013 10:12:31	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	181,440	220,714	1.2165
02 Jul 2013 09:49:27	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	155,520	193,333	1.2431
28 Jun 2013 12:10:02	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	129,600	166,612	1.2856
27 Jun 2013 01:51:04	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	103,680	139,955	1.3499
21 Jun 2013 22:08:09	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	77,760	110,820	1.4252
21 Jun 2013 04:06:19	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	51,840	78,628	1.5167
20 Jun 2013 12:19:32	1048681	15844823	hadcm3n_o6dd_1940_40_008380655_1	25,920	43,220	1.6674