Task 15281677

Name	hadcm3n_z8js_1880_40_008201262_0
Workunit	8356386
Created	13 Sep 2012, 12:07:46 UTC
Sent	13 Sep 2012, 16:58:57 UTC
Report deadline	14 Dec 2012, 0:26:08 UTC
Received	16 Dec 2012, 5:33:29 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1035913
Run time	35 days 1 hours 19 min 44 sec
CPU time	26 days 23 hours 51 min 38 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> 21:26:16 (10672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold 03:40:11 (11416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:12 (11416): No heartbeat from core client for 30 sec - exiting 03:40:13 (11416): No heartbeat from core client for 30 sec - exiting 03:40:14 (11416): No heartbeat from core client for 30 sec - exiting 03:40:16 (11416): No heartbeat from core client for 30 sec - exiting 03:40:17 (11416): No heartbeat from core client for 30 sec - exiting 03:40:18 (11416): No heartbeat from core client for 30 sec - exiting 03:41:29 (8480): No heartbeat from core client for 30 sec - exiting 03:41:31 (8480): No heartbeat from core client for 30 sec - exiting 03:41:32 (8480): No heartbeat from core client for 30 sec - exiting 03:41:33 (8480): No heartbeat from core client for 30 sec - exiting 03:41:34 (8480): No heartbeat from core client for 30 sec - exiting 03:41:35 (8480): No heartbeat from core client for 30 sec - exiting 03:41:36 (8480): No heartbeat from core client for 30 sec - exiting 03:41:37 (8480): No heartbeat from core client for 30 sec - exiting 03:41:38 (8480): No heartbeat from core client for 30 sec - exiting 03:41:39 (8480): No heartbeat from core client for 30 sec - exiting 03:41:40 (8480): No heartbeat from core client for 30 sec - exiting 03:41:41 (8480): No heartbeat from core client for 30 sec - exiting 03:41:43 (8480): No heartbeat from core client for 30 sec - exiting 03:41:44 (8480): No heartbeat from core client for 30 sec - exiting 03:41:45 (8480): No heartbeat from core client for 30 sec - exiting 03:41:46 (8480): No heartbeat from core client for 30 sec - exiting 03:41:47 (8480): No heartbeat from core client for 30 sec - exiting 03:41:48 (8480): No heartbeat from core client for 30 sec - exiting 03:41:49 (8480): No heartbeat from core client for 30 sec - exiting 03:41:50 (8480): No heartbeat from core client for 30 sec - exiting 03:41:51 (8480): No heartbeat from core client for 30 sec - exiting 03:41:52 (8480): No heartbeat from core client for 30 sec - exiting 03:41:53 (8480): No heartbeat from core client for 30 sec - exiting 03:41:55 (8480): No heartbeat from core client for 30 sec - exiting 03:41:56 (8480): No heartbeat from core client for 30 sec - exiting 03:41:57 (8480): No heartbeat from core client for 30 sec - exiting 03:41:58 (8480): No heartbeat from core client for 30 sec - exiting 03:41:59 (8480): No heartbeat from core client for 30 sec - exiting 03:42:00 (8480): No heartbeat from core client for 30 sec - exiting 03:42:01 (8480): No heartbeat from core client for 30 sec - exiting 03:42:02 (8480): No heartbeat from core client for 30 sec - exiting 03:42:03 (8480): No heartbeat from core client for 30 sec - exiting 03:42:04 (8480): No heartbeat from core client for 30 sec - exiting 03:42:06 (8480): No heartbeat from core client for 30 sec - exiting 03:42:07 (8480): No heartbeat from core client for 30 sec - exiting 03:42:08 (8480): No heartbeat from core client for 30 sec - exiting 03:42:09 (8480): No heartbeat from core client for 30 sec - exiting 03:42:10 (8480): No heartbeat from core client for 30 sec - exiting 03:42:11 (8480): No heartbeat from core client for 30 sec - exiting 03:42:13 (8480): No heartbeat from core client for 30 sec - exiting 03:42:14 (8480): No heartbeat from core client for 30 sec - exiting 03:42:15 (8480): No heartbeat from core client for 30 sec - exiting 03:42:16 (8480): No heartbeat from core client for 30 sec - exiting 03:42:17 (8480): No heartbeat from core client for 30 sec - exiting 03:42:18 (8480): No heartbeat from core client for 30 sec - exiting 03:42:19 (8480): No heartbeat from core client for 30 sec - exiting 03:42:20 (8480): No heartbeat from core client for 30 sec - exiting 03:42:21 (8480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:55:45 (2812): No heartbeat from core client for 30 sec - exiting 03:55:46 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:00:09 (7772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:36 (9172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:14 (11180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:22 (6360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:26:24 (6360): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on z8jska.da84c60 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on z8jska.da84c70 01:57:03 (8248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on z8jska.da86130 Atmos Hold Restart file rename failed on atmos_restart.hold 01:52:09 (7604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:49:49 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on z8jska.da897q0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on z8jska.da897r0 Atmos Hold Restart file rename failed on atmos_restart.hold 01:57:21 (1940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:20:29 (6060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:51:19 (7492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:59:08 (6228): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 01:59:09 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:02:48 (5240): No heartbeat from core client for 30 sec - exiting 20:02:49 (5240): No heartbeat from core client for 30 sec - exiting 20:02:50 (5240): No heartbeat from core client for 30 sec - exiting 20:02:51 (5240): No heartbeat from core client for 30 sec - exiting 20:02:52 (5240): No heartbeat from core client for 30 sec - exiting 20:02:53 (5240): No heartbeat from core client for 30 sec - exiting 20:02:55 (5240): No heartbeat from core client for 30 sec - exiting 20:02:56 (5240): No heartbeat from core client for 30 sec - exiting 20:02:57 (5240): No heartbeat from core client for 30 sec - exiting 20:02:58 (5240): No heartbeat from core client for 30 sec - exiting 20:02:59 (5240): No heartbeat from core client for 30 sec - exiting 20:03:00 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:01 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 04:07:16 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied 07:05:26 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:12 (4140): No heartbeat from core client for 30 sec - exiting 07:07:13 (4140): No heartbeat from core client for 30 sec - exiting 07:07:14 (4140): No heartbeat from core client for 30 sec - exiting 07:07:15 (4140): No heartbeat from core client for 30 sec - exiting 07:07:16 (4140): No heartbeat from core client for 30 sec - exiting 07:07:17 (4140): No heartbeat from core client for 30 sec - exiting 07:07:18 (4140): No heartbeat from core client for 30 sec - exiting 07:07:19 (4140): No heartbeat from core client for 30 sec - exiting 07:07:20 (4140): No heartbeat from core client for 30 sec - exiting 07:07:21 (4140): No heartbeat from core client for 30 sec - exiting 07:07:22 (4140): No heartbeat from core client for 30 sec - exiting 07:07:23 (4140): No heartbeat from core client for 30 sec - exiting 07:07:24 (4140): No heartbeat from core client for 30 sec - exiting 07:07:25 (4140): No heartbeat from core client for 30 sec - exiting 07:07:26 (4140): No heartbeat from core client for 30 sec - exiting 07:07:27 (4140): No heartbeat from core client for 30 sec - exiting 07:07:28 (4140): No heartbeat from core client for 30 sec - exiting 07:07:29 (4140): No heartbeat from core client for 30 sec - exiting 07:07:30 (4140): No heartbeat from core client for 30 sec - exiting 07:07:31 (4140): No heartbeat from core client for 30 sec - exiting 07:07:32 (4140): No heartbeat from core client for 30 sec - exiting 07:07:33 (4140): No heartbeat from core client for 30 sec - exiting 07:07:34 (4140): No heartbeat from core client for 30 sec - exiting 07:07:35 (4140): No heartbeat from core client for 30 sec - exiting 07:07:36 (4140): No heartbeat from core client for 30 sec - exiting 07:07:37 (4140): No heartbeat from core client for 30 sec - exiting 07:07:38 (4140): No heartbeat from core client for 30 sec - exiting 07:07:39 (4140): No heartbeat from core client for 30 sec - exiting 07:07:40 (4140): No heartbeat from core client for 30 sec - exiting 07:07:41 (4140): No heartbeat from core client for 30 sec - exiting 07:07:42 (4140): No heartbeat from core client for 30 sec - exiting 07:07:43 (4140): No heartbeat from core client for 30 sec - exiting 07:07:44 (4140): No heartbeat from core client for 30 sec - exiting 07:07:45 (4140): No heartbeat from core client for 30 sec - exiting 07:07:46 (4140): No heartbeat from core client for 30 sec - exiting 07:07:47 (4140): No heartbeat from core client for 30 sec - exiting 07:07:48 (4140): No heartbeat from core client for 30 sec - exiting 07:07:49 (4140): No heartbeat from core client for 30 sec - exiting 07:07:50 (4140): No heartbeat from core client for 30 sec - exiting 07:07:51 (4140): No heartbeat from core client for 30 sec - exiting 07:07:52 (4140): No heartbeat from core client for 30 sec - exiting 07:07:53 (4140): No heartbeat from core client for 30 sec - exiting 07:07:54 (4140): No heartbeat from core client for 30 sec - exiting 07:07:55 (4140): No heartbeat from core client for 30 sec - exiting 07:07:56 (4140): No heartbeat from core client for 30 sec - exiting 07:07:57 (4140): No heartbeat from core client for 30 sec - exiting 07:07:58 (4140): No heartbeat from core client for 30 sec - exiting 07:07:59 (4140): No heartbeat from core client for 30 sec - exiting 07:08:00 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:08:01 (4140): No heartbeat from core client for 30 sec - exiting 07:08:02 (4140): No heartbeat from core client for 30 sec - exiting 07:08:03 (4140): No heartbeat from core client for 30 sec - exiting 07:08:04 (4140): No heartbeat from core client for 30 sec - exiting 07:08:05 (4140): No heartbeat from core client for 30 sec - exiting 07:08:06 (4140): No heartbeat from core client for 30 sec - exiting 07:09:57 (8564): No heartbeat from core client for 30 sec - exiting 07:09:59 (8564): No heartbeat from core client for 30 sec - exiting 07:10:00 (8564): No heartbeat from core client for 30 sec - exiting 07:10:01 (8564): No heartbeat from core client for 30 sec - exiting 07:10:02 (8564): No heartbeat from core client for 30 sec - exiting 07:10:03 (8564): No heartbeat from core client for 30 sec - exiting 07:10:04 (8564): No heartbeat from core client for 30 sec - exiting 07:10:05 (8564): No heartbeat from core client for 30 sec - exiting 07:10:06 (8564): No heartbeat from core client for 30 sec - exiting 07:10:07 (8564): No heartbeat from core client for 30 sec - exiting 07:10:08 (8564): No heartbeat from core client for 30 sec - exiting 07:10:09 (8564): No heartbeat from core client for 30 sec - exiting 07:10:10 (8564): No heartbeat from core client for 30 sec - exiting 07:10:11 (8564): No heartbeat from core client for 30 sec - exiting 07:10:12 (8564): No heartbeat from core client for 30 sec - exiting 07:10:13 (8564): No heartbeat from core client for 30 sec - exiting 07:10:14 (8564): No heartbeat from core client for 30 sec - exiting 07:10:15 (8564): No heartbeat from core client for 30 sec - exiting 07:10:16 (8564): No heartbeat from core client for 30 sec - exiting 07:10:17 (8564): No heartbeat from core client for 30 sec - exiting 07:10:18 (8564): No heartbeat from core client for 30 sec - exiting 07:10:19 (8564): No heartbeat from core client for 30 sec - exiting 07:10:20 (8564): No heartbeat from core client for 30 sec - exiting 07:10:21 (8564): No heartbeat from core client for 30 sec - exiting 07:10:22 (8564): No heartbeat from core client for 30 sec - exiting 07:10:23 (8564): No heartbeat from core client for 30 sec - exiting 07:10:24 (8564): No heartbeat from core client for 30 sec - exiting 07:10:25 (8564): No heartbeat from core client for 30 sec - exiting 07:10:26 (8564): No heartbeat from core client for 30 sec - exiting 07:10:27 (8564): No heartbeat from core client for 30 sec - exiting 07:10:28 (8564): No heartbeat from core client for 30 sec - exiting 07:10:29 (8564): No heartbeat from core client for 30 sec - exiting 07:10:30 (8564): No heartbeat from core client for 30 sec - exiting 07:10:31 (8564): No heartbeat from core client for 30 sec - exiting 07:10:32 (8564): No heartbeat from core client for 30 sec - exiting 07:10:33 (8564): No heartbeat from core client for 30 sec - exiting 07:10:34 (8564): No heartbeat from core client for 30 sec - exiting 07:10:35 (8564): No heartbeat from core client for 30 sec - exiting 07:10:36 (8564): No heartbeat from core client for 30 sec - exiting 07:10:37 (8564): No heartbeat from core client for 30 sec - exiting 07:10:38 (8564): No heartbeat from core client for 30 sec - exiting 07:10:39 (8564): No heartbeat from core client for 30 sec - exiting 07:10:40 (8564): No heartbeat from core client for 30 sec - exiting 07:10:41 (8564): No heartbeat from core client for 30 sec - exiting 07:11:12 (8564): No heartbeat from core client for 30 sec - exiting 07:11:13 (8564): No heartbeat from core client for 30 sec - exiting 07:11:14 (8564): No heartbeat from core client for 30 sec - exiting 07:11:15 (8564): No heartbeat from core client for 30 sec - exiting 07:11:16 (8564): No heartbeat from core client for 30 sec - exiting 07:11:17 (8564): No heartbeat from core client for 30 sec - exiting 07:11:18 (8564): No heartbeat from core client for 30 sec - exiting 07:11:19 (8564): No heartbeat from core client for 30 sec - exiting 07:11:20 (8564): No heartbeat from core client for 30 sec - exiting 07:11:21 (8564): No heartbeat from core client for 30 sec - exiting 07:11:22 (8564): No heartbeat from core client for 30 sec - exiting 07:11:23 (8564): No heartbeat from core client for 30 sec - exiting 07:11:24 (8564): No heartbeat from core client for 30 sec - exiting 07:11:25 (8564): No heartbeat from core client for 30 sec - exiting 07:11:26 (8564): No heartbeat from core client for 30 sec - exiting 07:11:27 (8564): No heartbeat from core client for 30 sec - exiting 07:11:28 (8564): No heartbeat from core client for 30 sec - exiting 07:11:29 (8564): No heartbeat from core client for 30 sec - exiting 07:11:30 (8564): No heartbeat from core client for 30 sec - exiting 07:11:31 (8564): No heartbeat from core client for 30 sec - exiting 07:11:32 (8564): No heartbeat from core client for 30 sec - exiting 07:11:33 (8564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:34 (8564): No heartbeat from core client for 30 sec - exiting 07:11:35 (8564): No heartbeat from core client for 30 sec - exiting 07:11:36 (8564): No heartbeat from core client for 30 sec - exiting 07:11:37 (8564): No heartbeat from core client for 30 sec - exiting 07:11:38 (8564): No heartbeat from core client for 30 sec - exiting 07:11:39 (8564): No heartbeat from core client for 30 sec - exiting 07:11:40 (8564): No heartbeat from core client for 30 sec - exiting 07:11:41 (8564): No heartbeat from core client for 30 sec - exiting 07:11:42 (8564): No heartbeat from core client for 30 sec - exiting 07:11:43 (8564): No heartbeat from core client for 30 sec - exiting 07:14:06 (9328): No heartbeat from core client for 30 sec - exiting 07:14:07 (9328): No heartbeat from core client for 30 sec - exiting 07:14:08 (9328): No heartbeat from core client for 30 sec - exiting 07:14:09 (9328): No heartbeat from core client for 30 sec - exiting 07:14:10 (9328): No heartbeat from core client for 30 sec - exiting 07:14:11 (9328): No heartbeat from core client for 30 sec - exiting 07:14:12 (9328): No heartbeat from core client for 30 sec - exiting 07:14:13 (9328): No heartbeat from core client for 30 sec - exiting 07:14:14 (9328): No heartbeat from core client for 30 sec - exiting 07:14:15 (9328): No heartbeat from core client for 30 sec - exiting 07:14:16 (9328): No heartbeat from core client for 30 sec - exiting 07:14:17 (9328): No heartbeat from core client for 30 sec - exiting 07:14:18 (9328): No heartbeat from core client for 30 sec - exiting 07:14:19 (9328): No heartbeat from core client for 30 sec - exiting 07:14:50 (9328): No heartbeat from core client for 30 sec - exiting 07:14:51 (9328): No heartbeat from core client for 30 sec - exiting 07:14:52 (9328): No heartbeat from core client for 30 sec - exiting 07:14:53 (9328): No heartbeat from core client for 30 sec - exiting 07:14:54 (9328): No heartbeat from core client for 30 sec - exiting 07:14:55 (9328): No heartbeat from core client for 30 sec - exiting 07:14:56 (9328): No heartbeat from core client for 30 sec - exiting 07:14:57 (9328): No heartbeat from core client for 30 sec - exiting 07:14:58 (9328): No heartbeat from core client for 30 sec - exiting 07:14:59 (9328): No heartbeat from core client for 30 sec - exiting 07:15:00 (9328): No heartbeat from core client for 30 sec - exiting 07:15:01 (9328): No heartbeat from core client for 30 sec - exiting 07:15:02 (9328): No heartbeat from core client for 30 sec - exiting 07:15:03 (9328): No heartbeat from core client for 30 sec - exiting 07:15:04 (9328): No heartbeat from core client for 30 sec - exiting 07:15:05 (9328): No heartbeat from core client for 30 sec - exiting 07:15:06 (9328): No heartbeat from core client for 30 sec - exiting 07:15:07 (9328): No heartbeat from core client for 30 sec - exiting 07:15:08 (9328): No heartbeat from core client for 30 sec - exiting 07:15:09 (9328): No heartbeat from core client for 30 sec - exiting 07:15:11 (9328): No heartbeat from core client for 30 sec - exiting 07:15:12 (9328): No heartbeat from core client for 30 sec - exiting 07:15:13 (9328): No heartbeat from core client for 30 sec - exiting 07:15:14 (9328): No heartbeat from core client for 30 sec - exiting 07:15:15 (9328): No heartbeat from core client for 30 sec - exiting 07:15:16 (9328): No heartbeat from core client for 30 sec - exiting 07:15:17 (9328): No heartbeat from core client for 30 sec - exiting 07:15:18 (9328): No heartbeat from core client for 30 sec - exiting 07:15:19 (9328): No heartbeat from core client for 30 sec - exiting 07:15:20 (9328): No heartbeat from core client for 30 sec - exiting 07:15:21 (9328): No heartbeat from core client for 30 sec - exiting 07:15:22 (9328): No heartbeat from core client for 30 sec - exiting 07:15:23 (9328): No heartbeat from core client for 30 sec - exiting 07:15:24 (9328): No heartbeat from core client for 30 sec - exiting 07:15:25 (9328): No heartbeat from core client for 30 sec - exiting 07:15:26 (9328): No heartbeat from core client for 30 sec - exiting 07:15:28 (9328): No heartbeat from core client for 30 sec - exiting 07:15:29 (9328): No heartbeat from core client for 30 sec - exiting 07:15:30 (9328): No heartbeat from core client for 30 sec - exiting 07:15:31 (9328): No heartbeat from core client for 30 sec - exiting 07:15:32 (9328): No heartbeat from core client for 30 sec - exiting 07:15:33 (9328): No heartbeat from core client for 30 sec - exiting 07:15:34 (9328): No heartbeat from core client for 30 sec - exiting 07:15:35 (9328): No heartbeat from core client for 30 sec - exiting 07:15:36 (9328): No heartbeat from core client for 30 sec - exiting 07:15:37 (9328): No heartbeat from core client for 30 sec - exiting 07:15:38 (9328): No heartbeat from core client for 30 sec - exiting 07:15:39 (9328): No heartbeat from core client for 30 sec - exiting 07:15:40 (9328): No heartbeat from core client for 30 sec - exiting 07:15:41 (9328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:15:42 (9328): No heartbeat from core client for 30 sec - exiting 07:15:43 (9328): No heartbeat from core client for 30 sec - exiting 07:15:44 (9328): No heartbeat from core client for 30 sec - exiting 07:15:45 (9328): No heartbeat from core client for 30 sec - exiting 07:15:46 (9328): No heartbeat from core client for 30 sec - exiting 07:15:47 (9328): No heartbeat from core client for 30 sec - exiting 07:15:48 (9328): No heartbeat from core client for 30 sec - exiting 07:15:49 (9328): No heartbeat from core client for 30 sec - exiting 07:15:50 (9328): No heartbeat from core client for 30 sec - exiting 07:15:51 (9328): No heartbeat from core client for 30 sec - exiting 07:15:52 (9328): No heartbeat from core client for 30 sec - exiting 07:17:47 (4776): No heartbeat from core client for 30 sec - exiting 07:17:48 (4776): No heartbeat from core client for 30 sec - exiting 07:17:49 (4776): No heartbeat from core client for 30 sec - exiting 07:17:50 (4776): No heartbeat from core client for 30 sec - exiting 07:17:51 (4776): No heartbeat from core client for 30 sec - exiting 07:17:52 (4776): No heartbeat from core client for 30 sec - exiting 07:17:53 (4776): No heartbeat from core client for 30 sec - exiting 07:17:54 (4776): No heartbeat from core client for 30 sec - exiting 07:17:55 (4776): No heartbeat from core client for 30 sec - exiting 07:17:56 (4776): No heartbeat from core client for 30 sec - exiting 07:17:57 (4776): No heartbeat from core client for 30 sec - exiting 07:17:59 (4776): No heartbeat from core client for 30 sec - exiting 07:18:30 (4776): No heartbeat from core client for 30 sec - exiting 07:18:31 (4776): No heartbeat from core client for 30 sec - exiting 07:18:32 (4776): No heartbeat from core client for 30 sec - exiting 07:18:33 (4776): No heartbeat from core client for 30 sec - exiting 07:18:34 (4776): No heartbeat from core client for 30 sec - exiting 07:18:35 (4776): No heartbeat from core client for 30 sec - exiting 07:18:36 (4776): No heartbeat from core client for 30 sec - exiting 07:18:37 (4776): No heartbeat from core client for 30 sec - exiting 07:18:38 (4776): No heartbeat from core client for 30 sec - exiting 07:18:39 (4776): No heartbeat from core client for 30 sec - exiting 07:18:40 (4776): No heartbeat from core client for 30 sec - exiting 07:18:41 (4776): No heartbeat from core client for 30 sec - exiting 07:18:42 (4776): No heartbeat from core client for 30 sec - exiting 07:18:43 (4776): No heartbeat from core client for 30 sec - exiting 07:18:44 (4776): No heartbeat from core client for 30 sec - exiting 07:18:45 (4776): No heartbeat from core client for 30 sec - exiting 07:18:46 (4776): No heartbeat from core client for 30 sec - exiting 07:18:47 (4776): No heartbeat from core client for 30 sec - exiting 07:18:48 (4776): No heartbeat from core client for 30 sec - exiting 07:18:49 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:18:50 (4776): No heartbeat from core client for 30 sec - exiting 07:18:51 (4776): No heartbeat from core client for 30 sec - exiting 07:18:52 (4776): No heartbeat from core client for 30 sec - exiting 07:18:53 (4776): No heartbeat from core client for 30 sec - exiting 07:18:54 (4776): No heartbeat from core client for 30 sec - exiting 07:18:55 (4776): No heartbeat from core client for 30 sec - exiting 07:18:56 (4776): No heartbeat from core client for 30 sec - exiting 07:18:57 (4776): No heartbeat from core client for 30 sec - exiting 07:18:58 (4776): No heartbeat from core client for 30 sec - exiting 07:18:59 (4776): No heartbeat from core client for 30 sec - exiting 14:00:10 (8776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:21 (7264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:14 (7632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:13 (11472): No heartbeat from core client for 30 sec - exiting 02:23:14 (11472): No heartbeat from core client for 30 sec - exiting 02:23:15 (11472): No heartbeat from core client for 30 sec - exiting 02:23:16 (11472): No heartbeat from core client for 30 sec - exiting 02:23:17 (11472): No heartbeat from core client for 30 sec - exiting 02:23:18 (11472): No heartbeat from core client for 30 sec - exiting 02:23:19 (11472): No heartbeat from core client for 30 sec - exiting 02:23:59 (11472): No heartbeat from core client for 30 sec - exiting 02:24:00 (11472): No heartbeat from core client for 30 sec - exiting 02:24:02 (11472): No heartbeat from core client for 30 sec - exiting 02:24:03 (11472): No heartbeat from core client for 30 sec - exiting 02:24:04 (11472): No heartbeat from core client for 30 sec - exiting 02:24:05 (11472): No heartbeat from core client for 30 sec - exiting 02:24:06 (11472): No heartbeat from core client for 30 sec - exiting 02:24:07 (11472): No heartbeat from core client for 30 sec - exiting 02:24:09 (11472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/z8jsko.pj96c10 Error converting file to netcdf: dataout/z8jsko.pi96c10 Error converting file to netcdf: dataout/z8jsko.pf96c10 Error converting file to netcdf: dataout/z8jska.ph96c10 Error converting file to netcdf: dataout/z8jska.pg96c10 Error converting file to netcdf: dataout/z8jska.pe96c10 Error converting file to netcdf: dataout/z8jska.pd96c10 04:27:58 (13084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:58:46 (12592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=1 Model crash detected, will try to restart... Skipping gmts_generator due to netcdf error 13 - Permission denied Suspended CPDN Monitor - Suspend request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7136, iMonCtr=1 Model crash detected, will try to restart... 03:26:03 (1340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:04:46 (4104): No heartbeat from core client for 30 sec - exiting 23:04:47 (4104): No heartbeat from core client for 30 sec - exiting 23:04:48 (4104): No heartbeat from core client for 30 sec - exiting 23:04:49 (4104): No heartbeat from core client for 30 sec - exiting 23:04:50 (4104): No heartbeat from core client for 30 sec - exiting 23:04:51 (4104): No heartbeat from core client for 30 sec - exiting 23:04:52 (4104): No heartbeat from core client for 30 sec - exiting 23:04:53 (4104): No heartbeat from core client for 30 sec - exiting 23:04:54 (4104): No heartbeat from core client for 30 sec - exiting 23:04:56 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:51:03 (5360): No heartbeat from core client for 30 sec - exiting 11:51:05 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... C03:28:04 (5808): No heartbeat from core client for 30 sec - exiting 03:28:05 (5808): No heartbeat from core client for 30 sec - exiting 03:28:06 (5808): No heartbeat from core client for 30 sec - exiting 03:28:07 (5808): No heartbeat from core client for 30 sec - exiting 03:28:08 (5808): No heartbeat from core client for 30 sec - exiting 03:28:09 (5808): No heartbeat from core client for 30 sec - exiting 03:28:10 (5808): No heartbeat from core client for 30 sec - exiting 03:28:11 (5808): No heartbeat from core client for 30 sec - exiting 03:28:12 (5808): No heartbeat from core client for 30 sec - exiting 03:28:13 (5808): No heartbeat from core client for 30 sec - exiting 03:28:15 (5808): No heartbeat from core client for 30 sec - exiting 03:28:16 (5808): No heartbeat from core client for 30 sec - exiting 03:28:17 (5808): No heartbeat from core client for 30 sec - exiting 03:28:18 (5808): No heartbeat from core client for 30 sec - exiting 03:28:19 (5808): No heartbeat from core client for 30 sec - exiting 03:28:20 (5808): No heartbeat from core client for 30 sec - exiting 03:28:21 (5808): No heartbeat from core client for 30 sec - exiting 03:28:22 (5808): No heartbeat from core client for 30 sec - exiting 03:28:23 (5808): No heartbeat from core client for 30 sec - exiting 03:28:24 (5808): No heartbeat from core client for 30 sec - exiting 03:28:25 (5808): No heartbeat from core client for 30 sec - exiting 03:28:27 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error 13 - Permission denied 02:44:18 (1996): No heartbeat from core client for 30 sec - exiting 02:44:19 (1996): No heartbeat from core client for 30 sec - exiting 02:44:20 (1996): No heartbeat from core client for 30 sec - exiting 02:44:21 (1996): No heartbeat from core client for 30 sec - exiting 02:44:22 (1996): No heartbeat from core client for 30 sec - exiting 02:44:23 (1996): No heartbeat from core client for 30 sec - exiting 02:44:24 (1996): No heartbeat from core client for 30 sec - exiting 02:44:25 (1996): No heartbeat from core client for 30 sec - exiting 02:44:26 (1996): No heartbeat from core client for 30 sec - exiting 02:44:28 (1996): No heartbeat from core client for 30 sec - exiting 02:44:29 (1996): No heartbeat from core client for 30 sec - exiting 02:44:30 (1996): No heartbeat from core client for 30 sec - exiting 02:44:31 (1996): No heartbeat from core client for 30 sec - exiting 02:44:32 (1996): No heartbeat from core client for 30 sec - exiting 02:44:33 (1996): No heartbeat from core client for 30 sec - exiting 02:44:34 (1996): No heartbeat from core client for 30 sec - exiting 02:44:35 (1996): No heartbeat from core client for 30 sec - exiting 02:44:36 (1996): No heartbeat from core client for 30 sec - exiting 02:44:37 (1996): No heartbeat from core client for 30 sec - exiting 02:44:38 (1996): No heartbeat from core client for 30 sec - exiting 02:44:40 (1996): No heartbeat from core client for 30 sec - exiting 02:44:41 (1996): No heartbeat from core client for 30 sec - exiting 02:44:42 (1996): No heartbeat from core client for 30 sec - exiting 02:44:43 (1996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Skipping gmts_generator due to netcdf error -49 - Variable not found Skipping gmts_generator due to netcdf error -49 - Variable not found Skipping gmts_generator due to netcdf error -49 - Variable not found Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Dec 2012 04:33:46	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	1,036,800	2,331,620	2.2489
15 Dec 2012 04:07:41	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	1,010,880	2,272,723	2.2483
14 Dec 2012 04:41:16	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	984,960	2,213,832	2.2476
13 Dec 2012 23:28:07	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	959,040	2,156,515	2.2486
13 Dec 2012 23:28:07	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	933,120	2,100,322	2.2509
13 Dec 2012 23:28:07	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	907,200	2,044,910	2.2541
13 Dec 2012 23:28:07	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	881,280	1,989,227	2.2572
13 Dec 2012 23:28:07	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	855,360	1,932,869	2.2597
13 Dec 2012 23:28:07	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	829,440	1,877,505	2.2636
07 Dec 2012 17:13:32	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	803,520	1,818,550	2.2632
06 Dec 2012 16:20:31	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	777,600	1,754,374	2.2561
05 Dec 2012 18:55:13	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	751,680	1,691,561	2.2504
04 Dec 2012 17:39:24	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	725,760	1,634,214	2.2517
04 Dec 2012 01:25:34	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	699,840	1,580,503	2.2584
03 Dec 2012 09:44:33	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	673,920	1,525,920	2.2642
02 Dec 2012 17:25:26	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	648,000	1,469,311	2.2675
01 Dec 2012 23:36:46	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	622,080	1,409,836	2.2663
01 Dec 2012 04:20:20	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	596,160	1,342,844	2.2525
30 Nov 2012 09:06:52	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	570,240	1,278,951	2.2428
29 Nov 2012 15:08:28	1035913	15281677	hadcm3n_z8js_1880_40_008201262_0	544,320	1,219,025	2.2395