Task 15778913

Name	hadcm3n_o1g3_2140_40_008269824_4
Workunit	8424948
Created	12 May 2013, 8:52:13 UTC
Sent	12 May 2013, 8:52:29 UTC
Report deadline	11 Aug 2013, 16:19:40 UTC
Received	4 Jun 2013, 5:38:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1282401
Run time	22 days 0 hours 20 min 48 sec
CPU time	21 days 4 hours 7 min 12 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 15:42:45 (20528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:25:14 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:20 (2909): No heartbeat from core client for 30 sec - exiting 09:35:21 (2909): No heartbeat from core client for 30 sec - exiting 09:35:22 (2909): No heartbeat from core client for 30 sec - exiting 09:35:23 (2909): No heartbeat from core client for 30 sec - exiting 09:35:24 (2909): No heartbeat from core client for 30 sec - exiting 09:35:25 (2909): No heartbeat from core client for 30 sec - exiting 09:35:26 (2909): No heartbeat from core client for 30 sec - exiting 09:35:27 (2909): No heartbeat from core client for 30 sec - exiting 09:35:28 (2909): No heartbeat from core client for 30 sec - exiting 09:35:29 (2909): No heartbeat from core client for 30 sec - exiting 09:35:30 (2909): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:02:27 (13070): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:29 (9875): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 03:56:18 PM No files match the supplied pattern. MainError: 03:56:18 PM No files match the supplied pattern. 06:40:34 (10429): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:35 (10429): No heartbeat from core client for 30 sec - exiting 06:40:36 (10429): No heartbeat from core client for 30 sec - exiting 06:40:37 (10429): No heartbeat from core client for 30 sec - exiting 06:40:38 (10429): No heartbeat from core client for 30 sec - exiting 06:40:39 (10429): No heartbeat from core client for 30 sec - exiting 06:40:40 (10429): No heartbeat from core client for 30 sec - exiting 06:40:41 (10429): No heartbeat from core client for 30 sec - exiting 06:40:42 (10429): No heartbeat from core client for 30 sec - exiting 06:40:43 (10429): No heartbeat from core client for 30 sec - exiting 06:40:44 (10429): No heartbeat from core client for 30 sec - exiting 06:40:45 (10429): No heartbeat from core client for 30 sec - exiting 06:40:46 (10429): No heartbeat from core client for 30 sec - exiting 06:40:47 (10429): No heartbeat from core client for 30 sec - exiting 06:40:48 (10429): No heartbeat from core client for 30 sec - exiting 06:40:49 (10429): No heartbeat from core client for 30 sec - exiting 06:40:50 (10429): No heartbeat from core client for 30 sec - exiting 06:40:51 (10429): No heartbeat from core client for 30 sec - exiting 06:40:52 (10429): No heartbeat from core client for 30 sec - exiting 06:40:53 (10429): No heartbeat from core client for 30 sec - exiting 06:40:54 (10429): No heartbeat from core client for 30 sec - exiting 06:40:55 (10429): No heartbeat from core client for 30 sec - exiting 06:40:56 (10429): No heartbeat from core client for 30 sec - exiting 10:36:02 (38891): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:03 (38891): No heartbeat from core client for 30 sec - exiting 10:40:27 (41675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:47 (41890): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:25 (43964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:26 (43964): No heartbeat from core client for 30 sec - exiting 14:13:27 (43964): No heartbeat from core client for 30 sec - exiting 14:13:28 (43964): No heartbeat from core client for 30 sec - exiting 14:13:29 (43964): No heartbeat from core client for 30 sec - exiting 14:51:27 (44340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:47 (44850): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:42:26 (45264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:25 (45717): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:26 (45717): No heartbeat from core client for 30 sec - exiting 16:26:39 (45929): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:37 (46406): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:38 (46406): No heartbeat from core client for 30 sec - exiting 16:31:39 (46406): No heartbeat from core client for 30 sec - exiting MainError: 03:40:39 PM No files match the supplied pattern. MainError: 03:40:39 PM No files match the supplied pattern. 17:38:37 (46618): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:38:38 (46618): No heartbeat from core client for 30 sec - exiting 17:38:39 (46618): No heartbeat from core client for 30 sec - exiting 17:38:40 (46618): No heartbeat from core client for 30 sec - exiting 17:38:41 (46618): No heartbeat from core client for 30 sec - exiting 17:38:42 (46618): No heartbeat from core client for 30 sec - exiting 17:38:43 (46618): No heartbeat from core client for 30 sec - exiting 18:23:56 (47654): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:22 (48384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:23 (48384): No heartbeat from core client for 30 sec - exiting 18:28:24 (48384): No heartbeat from core client for 30 sec - exiting 19:51:14 (48571): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:00 (49536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:01 (49536): No heartbeat from core client for 30 sec - exiting 19:56:02 (49536): No heartbeat from core client for 30 sec - exiting 19:56:03 (49536): No heartbeat from core client for 30 sec - exiting 19:56:04 (49536): No heartbeat from core client for 30 sec - exiting 20:00:34 (49728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:14 (49918): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:02 (50693): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:14:03 (50881): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:26 (54309): No heartbeat from core client for 30 sec - exiting 03:18:27 (54309): No heartbeat from core client for 30 sec - exiting 03:18:28 (54309): No heartbeat from core client for 30 sec - exiting 03:18:29 (54309): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:58:24 (54492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:03:00 (55269): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:07:30 (55456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:40 (55636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:41 (55636): No heartbeat from core client for 30 sec - exiting 04:11:42 (55636): No heartbeat from core client for 30 sec - exiting 04:11:43 (55636): No heartbeat from core client for 30 sec - exiting 06:42:20 (55815): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:58 (57291): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:59 (57291): No heartbeat from core client for 30 sec - exiting 09:12:06 (57459): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:14 (59243): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:43 (60646): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:10 (60811): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 12:37:46 AM No files match the supplied pattern. MainError: 12:37:46 AM No files match the supplied pattern. 15:37:05 (60985): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:20:28 (63373): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:54 (64497): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:34 (64646): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:35 (64646): No heartbeat from core client for 30 sec - exiting 20:09:36 (64646): No heartbeat from core client for 30 sec - exiting 20:09:37 (64646): No heartbeat from core client for 30 sec - exiting 20:09:38 (64646): No heartbeat from core client for 30 sec - exiting 20:09:39 (64646): No heartbeat from core client for 30 sec - exiting 20:09:40 (64646): No heartbeat from core client for 30 sec - exiting 20:09:41 (64646): No heartbeat from core client for 30 sec - exiting 20:09:42 (64646): No heartbeat from core client for 30 sec - exiting 20:14:05 (1109): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:06 (1109): No heartbeat from core client for 30 sec - exiting 20:14:07 (1109): No heartbeat from core client for 30 sec - exiting 20:14:08 (1109): No heartbeat from core client for 30 sec - exiting 20:14:09 (1109): No heartbeat from core client for 30 sec - exiting 20:14:10 (1109): No heartbeat from core client for 30 sec - exiting 20:14:11 (1109): No heartbeat from core client for 30 sec - exiting 20:14:12 (1109): No heartbeat from core client for 30 sec - exiting 20:31:18 (1290): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:21 (1596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:22 (1596): No heartbeat from core client for 30 sec - exiting 20:35:23 (1596): No heartbeat from core client for 30 sec - exiting 20:35:24 (1596): No heartbeat from core client for 30 sec - exiting 20:35:25 (1596): No heartbeat from core client for 30 sec - exiting 20:35:26 (1596): No heartbeat from core client for 30 sec - exiting 20:35:27 (1596): No heartbeat from core client for 30 sec - exiting 20:35:28 (1596): No heartbeat from core client for 30 sec - exiting 20:35:29 (1596): No heartbeat from core client for 30 sec - exiting 20:35:30 (1596): No heartbeat from core client for 30 sec - exiting 20:35:31 (1596): No heartbeat from core client for 30 sec - exiting 20:35:32 (1596): No heartbeat from core client for 30 sec - exiting 21:10:09 (1761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:04 (2341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:50 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:12:08 (6311): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:07 (7454): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:08 (7454): No heartbeat from core client for 30 sec - exiting 05:16:09 (7454): No heartbeat from core client for 30 sec - exiting 05:45:28 (7619): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:25 (8076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:26 (8076): No heartbeat from core client for 30 sec - exiting 05:50:27 (8076): No heartbeat from core client for 30 sec - exiting 05:50:28 (8076): No heartbeat from core client for 30 sec - exiting 05:50:29 (8076): No heartbeat from core client for 30 sec - exiting 05:50:30 (8076): No heartbeat from core client for 30 sec - exiting MainError: 09:45:24 AM No files match the supplied pattern. MainError: 09:45:24 AM No files match the supplied pattern. 11:42:55 (8244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:55 (11948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:44 (12106): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:45 (12106): No heartbeat from core client for 30 sec - exiting 12:24:46 (12106): No heartbeat from core client for 30 sec - exiting 12:24:47 (12106): No heartbeat from core client for 30 sec - exiting 12:24:48 (12106): No heartbeat from core client for 30 sec - exiting 12:24:49 (12106): No heartbeat from core client for 30 sec - exiting 12:24:50 (12106): No heartbeat from core client for 30 sec - exiting 12:24:51 (12106): No heartbeat from core client for 30 sec - exiting 12:24:52 (12106): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 12:38:45 (12629): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:15 (12973): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:57:16 (12973): No heartbeat from core client for 30 sec - exiting 12:57:17 (12973): No heartbeat from core client for 30 sec - exiting 13:02:20 (13439): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:21 (13439): No heartbeat from core client for 30 sec - exiting 13:02:22 (13439): No heartbeat from core client for 30 sec - exiting 13:02:23 (13439): No heartbeat from core client for 30 sec - exiting 13:02:24 (13439): No heartbeat from core client for 30 sec - exiting 13:02:25 (13439): No heartbeat from core client for 30 sec - exiting 13:02:26 (13439): No heartbeat from core client for 30 sec - exiting 14:12:41 (13597): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:05 (14553): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:06 (14553): No heartbeat from core client for 30 sec - exiting 19:38:07 (14553): No heartbeat from core client for 30 sec - exiting 19:38:08 (14553): No heartbeat from core client for 30 sec - exiting 19:38:09 (14553): No heartbeat from core client for 30 sec - exiting 19:38:10 (14553): No heartbeat from core client for 30 sec - exiting 19:38:11 (14553): No heartbeat from core client for 30 sec - exiting 19:38:12 (14553): No heartbeat from core client for 30 sec - exiting 19:38:13 (14553): No heartbeat from core client for 30 sec - exiting 19:38:14 (14553): No heartbeat from core client for 30 sec - exiting 19:38:15 (14553): No heartbeat from core client for 30 sec - exiting 19:38:16 (14553): No heartbeat from core client for 30 sec - exiting 19:38:17 (14553): No heartbeat from core client for 30 sec - exiting 19:38:18 (14553): No heartbeat from core client for 30 sec - exiting 19:42:27 (17724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:58 (17724): No heartbeat from core client for 30 sec - exiting 19:42:59 (17724): No heartbeat from core client for 30 sec - exiting 19:47:02 (17897): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:03 (17897): No heartbeat from core client for 30 sec - exiting 19:47:04 (17897): No heartbeat from core client for 30 sec - exiting 19:47:05 (17897): No heartbeat from core client for 30 sec - exiting 19:47:06 (17897): No heartbeat from core client for 30 sec - exiting 19:47:07 (17897): No heartbeat from core client for 30 sec - exiting 19:47:08 (17897): No heartbeat from core client for 30 sec - exiting 19:47:09 (17897): No heartbeat from core client for 30 sec - exiting 19:47:10 (17897): No heartbeat from core client for 30 sec - exiting 19:47:11 (17897): No heartbeat from core client for 30 sec - exiting 19:47:12 (17897): No heartbeat from core client for 30 sec - exiting 19:47:13 (17897): No heartbeat from core client for 30 sec - exiting 19:47:14 (17897): No heartbeat from core client for 30 sec - exiting 19:47:15 (17897): No heartbeat from core client for 30 sec - exiting 19:47:16 (17897): No heartbeat from core client for 30 sec - exiting 19:47:17 (17897): No heartbeat from core client for 30 sec - exiting 19:47:18 (17897): No heartbeat from core client for 30 sec - exiting 19:47:19 (17897): No heartbeat from core client for 30 sec - exiting 19:47:20 (17897): No heartbeat from core client for 30 sec - exiting 19:47:21 (17897): No heartbeat from core client for 30 sec - exiting 19:47:22 (17897): No heartbeat from core client for 30 sec - exiting 19:47:23 (17897): No heartbeat from core client for 30 sec - exiting 19:47:24 (17897): No heartbeat from core client for 30 sec - exiting 20:31:54 (18066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:55 (18066): No heartbeat from core client for 30 sec - exiting 20:37:02 (18564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:10 (18737): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:11 (18737): No heartbeat from core client for 30 sec - exiting 20:41:12 (18737): No heartbeat from core client for 30 sec - exiting 20:41:13 (18737): No heartbeat from core client for 30 sec - exiting 20:41:14 (18737): No heartbeat from core client for 30 sec - exiting 20:41:15 (18737): No heartbeat from core client for 30 sec - exiting 22:09:32 (18915): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:06 (19799): No heartbeat from core client for 30 sec - exiting 22:14:07 (19799): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:11 (19953): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:26 (20330): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:27 (20330): No heartbeat from core client for 30 sec - exiting 22:48:28 (20330): No heartbeat from core client for 30 sec - exiting 22:48:29 (20330): No heartbeat from core client for 30 sec - exiting 22:48:30 (20330): No heartbeat from core client for 30 sec - exiting 22:48:31 (20330): No heartbeat from core client for 30 sec - exiting 22:48:32 (20330): No heartbeat from core client for 30 sec - exiting 22:48:33 (20330): No heartbeat from core client for 30 sec - exiting 22:48:34 (20330): No heartbeat from core client for 30 sec - exiting 22:56:49 (20487): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:35 (20661): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:36 (20661): No heartbeat from core client for 30 sec - exiting 23:17:37 (20661): No heartbeat from core client for 30 sec - exiting 23:17:38 (20661): No heartbeat from core client for 30 sec - exiting 23:17:39 (20661): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 23:34:06 (21011): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:07 (21011): No heartbeat from core client for 30 sec - exiting 23:34:08 (21011): No heartbeat from core client for 30 sec - exiting 23:42:56 (21274): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:57 (21274): No heartbeat from core client for 30 sec - exiting 23:47:36 (21469): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:19 (21632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:20 (21632): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 02:44:14 (21976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:48:22 (23530): No heartbeat from core client for 30 sec - exiting 02:48:23 (23530): No heartbeat from core client for 30 sec - exiting 02:48:24 (23530): No heartbeat from core client for 30 sec - exiting 02:48:25 (23530): No heartbeat from core client for 30 sec - exiting 02:48:26 (23530): No heartbeat from core client for 30 sec - exiting 02:48:27 (23530): No heartbeat from core client for 30 sec - exiting 02:48:28 (23530): No heartbeat from core client for 30 sec - exiting 02:48:29 (23530): No heartbeat from core client for 30 sec - exiting 02:48:30 (23530): No heartbeat from core client for 30 sec - exiting 02:48:31 (23530): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:53:19 (23681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:53:20 (23681): No heartbeat from core client for 30 sec - exiting 02:53:21 (23681): No heartbeat from core client for 30 sec - exiting 02:53:22 (23681): No heartbeat from core client for 30 sec - exiting 03:01:41 (23854): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:42 (23854): No heartbeat from core client for 30 sec - exiting 03:01:43 (23854): No heartbeat from core client for 30 sec - exiting 03:01:44 (23854): No heartbeat from core client for 30 sec - exiting 03:01:45 (23854): No heartbeat from core client for 30 sec - exiting 04:13:15 (24084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:13:16 (24084): No heartbeat from core client for 30 sec - exiting 04:13:17 (24084): No heartbeat from core client for 30 sec - exiting 04:13:18 (24084): No heartbeat from core client for 30 sec - exiting 04:13:19 (24084): No heartbeat from core client for 30 sec - exiting 04:13:20 (24084): No heartbeat from core client for 30 sec - exiting 04:13:21 (24084): No heartbeat from core client for 30 sec - exiting 04:13:22 (24084): No heartbeat from core client for 30 sec - exiting 04:13:23 (24084): No heartbeat from core client for 30 sec - exiting 04:13:24 (24084): No heartbeat from core client for 30 sec - exiting 04:13:25 (24084): No heartbeat from core client for 30 sec - exiting 05:49:04 (24831): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:49:05 (24831): No heartbeat from core client for 30 sec - exiting 05:49:06 (24831): No heartbeat from core client for 30 sec - exiting 05:49:07 (24831): No heartbeat from core client for 30 sec - exiting 05:49:08 (24831): No heartbeat from core client for 30 sec - exiting 05:49:09 (24831): No heartbeat from core client for 30 sec - exiting 05:53:33 (25849): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:34 (25849): No heartbeat from core client for 30 sec - exiting 05:53:35 (25849): No heartbeat from core client for 30 sec - exiting 05:53:36 (25849): No heartbeat from core client for 30 sec - exiting 05:53:37 (25849): No heartbeat from core client for 30 sec - exiting 05:53:38 (25849): No heartbeat from core client for 30 sec - exiting 05:53:39 (25849): No heartbeat from core client for 30 sec - exiting 05:53:40 (25849): No heartbeat from core client for 30 sec - exiting 05:53:41 (25849): No heartbeat from core client for 30 sec - exiting 05:53:42 (25849): No heartbeat from core client for 30 sec - exiting 05:53:43 (25849): No heartbeat from core client for 30 sec - exiting 05:53:44 (25849): No heartbeat from core client for 30 sec - exiting 05:53:45 (25849): No heartbeat from core client for 30 sec - exiting 05:53:46 (25849): No heartbeat from core client for 30 sec - exiting 05:57:56 (26012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 06:40:35 AM No files match the supplied pattern. MainError: 06:40:35 AM No files match the supplied pattern. 08:25:20 (26167): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:31 (26167): No heartbeat from core client for 30 sec - exiting 08:33:59 (28012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:15 (28316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:16 (28316): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 12:04:50 (28862): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:51 (28862): No heartbeat from core client for 30 sec - exiting 12:04:52 (28862): No heartbeat from core client for 30 sec - exiting 12:04:53 (28862): No heartbeat from core client for 30 sec - exiting 12:04:54 (28862): No heartbeat from core client for 30 sec - exiting 12:04:55 (28862): No heartbeat from core client for 30 sec - exiting 12:04:56 (28862): No heartbeat from core client for 30 sec - exiting 12:04:57 (28862): No heartbeat from core client for 30 sec - exiting 12:04:58 (28862): No heartbeat from core client for 30 sec - exiting 13:51:17 (30710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:00:03 (31826): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:39:20 (32063): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:39:21 (32063): No heartbeat from core client for 30 sec - exiting 17:39:22 (32063): No heartbeat from core client for 30 sec - exiting 17:39:23 (32063): No heartbeat from core client for 30 sec - exiting 17:39:24 (32063): No heartbeat from core client for 30 sec - exiting 17:39:25 (32063): No heartbeat from core client for 30 sec - exiting 17:39:26 (32063): No heartbeat from core client for 30 sec - exiting 17:39:27 (32063): No heartbeat from core client for 30 sec - exiting 17:39:28 (32063): No heartbeat from core client for 30 sec - exiting 17:39:29 (32063): No heartbeat from core client for 30 sec - exiting 17:39:30 (32063): No heartbeat from core client for 30 sec - exiting 17:39:31 (32063): No heartbeat from core client for 30 sec - exiting 17:39:32 (32063): No heartbeat from core client for 30 sec - exiting 17:39:33 (32063): No heartbeat from core client for 30 sec - exiting 17:39:34 (32063): No heartbeat from core client for 30 sec - exiting 17:39:35 (32063): No heartbeat from core client for 30 sec - exiting 17:39:36 (32063): No heartbeat from core client for 30 sec - exiting 17:39:37 (32063): No heartbeat from core client for 30 sec - exiting 17:39:38 (32063): No heartbeat from core client for 30 sec - exiting 17:39:39 (32063): No heartbeat from core client for 30 sec - exiting 17:39:40 (32063): No heartbeat from core client for 30 sec - exiting 17:39:41 (32063): No heartbeat from core client for 30 sec - exiting 17:39:42 (32063): No heartbeat from core client for 30 sec - exiting 17:39:43 (32063): No heartbeat from core client for 30 sec - exiting 17:39:44 (32063): No heartbeat from core client for 30 sec - exiting 17:39:45 (32063): No heartbeat from core client for 30 sec - exiting 17:39:46 (32063): No heartbeat from core client for 30 sec - exiting 17:39:47 (32063): No heartbeat from core client for 30 sec - exiting 17:39:48 (32063): No heartbeat from core client for 30 sec - exiting 17:39:49 (32063): No heartbeat from core client for 30 sec - exiting 17:39:50 (32063): No heartbeat from core client for 30 sec - exiting 17:39:51 (32063): No heartbeat from core client for 30 sec - exiting 17:39:52 (32063): No heartbeat from core client for 30 sec - exiting 17:39:53 (32063): No heartbeat from core client for 30 sec - exiting 17:39:54 (32063): No heartbeat from core client for 30 sec - exiting 17:39:55 (32063): No heartbeat from core client for 30 sec - exiting 17:39:56 (32063): No heartbeat from core client for 30 sec - exiting 17:39:57 (32063): No heartbeat from core client for 30 sec - exiting 17:39:58 (32063): No heartbeat from core client for 30 sec - exiting 17:39:59 (32063): No heartbeat from core client for 30 sec - exiting 17:40:00 (32063): No heartbeat from core client for 30 sec - exiting 17:40:01 (32063): No heartbeat from core client for 30 sec - exiting 17:40:02 (32063): No heartbeat from core client for 30 sec - exiting 17:40:03 (32063): No heartbeat from core client for 30 sec - exiting 19:44:57 (34075): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:58 (34075): No heartbeat from core client for 30 sec - exiting 19:44:59 (34075): No heartbeat from core client for 30 sec - exiting 19:45:00 (34075): No heartbeat from core client for 30 sec - exiting 19:45:01 (34075): No heartbeat from core client for 30 sec - exiting 19:45:02 (34075): No heartbeat from core client for 30 sec - exiting 19:45:03 (34075): No heartbeat from core client for 30 sec - exiting 19:45:04 (34075): No heartbeat from core client for 30 sec - exiting 19:49:16 (35667): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:17 (35667): No heartbeat from core client for 30 sec - exiting 19:49:18 (35667): No heartbeat from core client for 30 sec - exiting 19:49:19 (35667): No heartbeat from core client for 30 sec - exiting 19:49:20 (35667): No heartbeat from core client for 30 sec - exiting 19:49:21 (35667): No heartbeat from core client for 30 sec - exiting 19:49:22 (35667): No heartbeat from core client for 30 sec - exiting 19:49:23 (35667): No heartbeat from core client for 30 sec - exiting 19:49:24 (35667): No heartbeat from core client for 30 sec - exiting 19:49:25 (35667): No heartbeat from core client for 30 sec - exiting 19:49:26 (35667): No heartbeat from core client for 30 sec - exiting 19:53:51 (35823): No heartbeat from core client for 30 sec - exiting 19:53:52 (35823): No heartbeat from core client for 30 sec - exiting 19:53:53 (35823): No heartbeat from core client for 30 sec - exiting 19:53:54 (35823): No heartbeat from core client for 30 sec - exiting 19:53:55 (35823): No heartbeat from core client for 30 sec - exiting 19:53:56 (35823): No heartbeat from core client for 30 sec - exiting 19:53:57 (35823): No heartbeat from core client for 30 sec - exiting 19:53:58 (35823): No heartbeat from core client for 30 sec - exiting 19:53:59 (35823): No heartbeat from core client for 30 sec - exiting 19:54:00 (35823): No heartbeat from core client for 30 sec - exiting 19:54:01 (35823): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:27 (35994): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:28 (35994): No heartbeat from core client for 30 sec - exiting 20:40:29 (35994): No heartbeat from core client for 30 sec - exiting 20:40:30 (35994): No heartbeat from core client for 30 sec - exiting 20:40:31 (35994): No heartbeat from core client for 30 sec - exiting 20:40:32 (35994): No heartbeat from core client for 30 sec - exiting 20:40:33 (35994): No heartbeat from core client for 30 sec - exiting 20:40:34 (35994): No heartbeat from core client for 30 sec - exiting 20:40:35 (35994): No heartbeat from core client for 30 sec - exiting 20:40:36 (35994): No heartbeat from core client for 30 sec - exiting 20:40:37 (35994): No heartbeat from core client for 30 sec - exiting 20:40:38 (35994): No heartbeat from core client for 30 sec - exiting 20:40:39 (35994): No heartbeat from core client for 30 sec - exiting 01:56:55 (36535): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:56 (36535): No heartbeat from core client for 30 sec - exiting 03:10:39 (39509): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:10:40 (39509): No heartbeat from core client for 30 sec - exiting 03:10:41 (39509): No heartbeat from core client for 30 sec - exiting 03:10:42 (39509): No heartbeat from core client for 30 sec - exiting 03:10:43 (39509): No heartbeat from core client for 30 sec - exiting 03:10:44 (39509): No heartbeat from core client for 30 sec - exiting 03:10:45 (39509): No heartbeat from core client for 30 sec - exiting 03:10:46 (39509): No heartbeat from core client for 30 sec - exiting 03:10:47 (39509): No heartbeat from core client for 30 sec - exiting 03:10:48 (39509): No heartbeat from core client for 30 sec - exiting 03:10:49 (39509): No heartbeat from core client for 30 sec - exiting 03:10:50 (39509): No heartbeat from core client for 30 sec - exiting 03:10:51 (39509): No heartbeat from core client for 30 sec - exiting 03:15:28 (40528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:29 (40528): No heartbeat from core client for 30 sec - exiting MainError: 02:51:41 AM No files match the supplied pattern. MainError: 02:51:41 AM No files match the supplied pattern. 04:00:38 (40713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:29 (41353): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:53 (41713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:54 (41713): No heartbeat from core client for 30 sec - exiting 11:59:55 (41713): No heartbeat from core client for 30 sec - exiting 11:59:56 (41713): No heartbeat from core client for 30 sec - exiting 11:59:57 (41713): No heartbeat from core client for 30 sec - exiting 12:04:17 (46322): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:19 (46511): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:45 (46703): No heartbeat from core client for 30 sec - exiting 12:13:46 (46703): No heartbeat from core client for 30 sec - exiting 12:13:47 (46703): No heartbeat from core client for 30 sec - exiting 12:13:48 (46703): No heartbeat from core client for 30 sec - exiting 12:13:49 (46703): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:50 (46703): No heartbeat from core client for 30 sec - exiting 13:45:45 (46888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:46 (46888): No heartbeat from core client for 30 sec - exiting 13:45:47 (46888): No heartbeat from core client for 30 sec - exiting 13:45:48 (46888): No heartbeat from core client for 30 sec - exiting 13:45:49 (46888): No heartbeat from core client for 30 sec - exiting 13:55:22 (47827): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:23 (47827): No heartbeat from core client for 30 sec - exiting 13:55:24 (47827): No heartbeat from core client for 30 sec - exiting 13:55:25 (47827): No heartbeat from core client for 30 sec - exiting 13:55:26 (47827): No heartbeat from core client for 30 sec - exiting 13:55:27 (47827): No heartbeat from core client for 30 sec - exiting 17:56:51 (48077): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:45 (50669): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:37 (51002): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:28 (53260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 22:39:44 (54013): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... MainError: 12:10:35 AM No files match the supplied pattern. MainError: 12:10:35 AM No files match the supplied pattern. 02:10:38 (54184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:33 (56249): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:34 (56249): No heartbeat from core client for 30 sec - exiting 02:19:35 (56249): No heartbeat from core client for 30 sec - exiting 02:19:36 (56249): No heartbeat from core client for 30 sec - exiting 02:19:37 (56249): No heartbeat from core client for 30 sec - exiting 02:19:38 (56249): No heartbeat from core client for 30 sec - exiting 02:19:39 (56249): No heartbeat from core client for 30 sec - exiting 02:19:40 (56249): No heartbeat from core client for 30 sec - exiting 02:19:41 (56249): No heartbeat from core client for 30 sec - exiting 02:19:42 (56249): No heartbeat from core client for 30 sec - exiting 02:19:43 (56249): No heartbeat from core client for 30 sec - exiting 02:19:44 (56249): No heartbeat from core client for 30 sec - exiting 02:19:45 (56249): No heartbeat from core client for 30 sec - exiting 02:19:46 (56249): No heartbeat from core client for 30 sec - exiting 02:19:47 (56249): No heartbeat from core client for 30 sec - exiting 02:24:17 (56543): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:28 (56713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:29 (56713): No heartbeat from core client for 30 sec - exiting 04:06:30 (56713): No heartbeat from core client for 30 sec - exiting 04:06:31 (56713): No heartbeat from core client for 30 sec - exiting 04:06:32 (56713): No heartbeat from core client for 30 sec - exiting 04:06:33 (56713): No heartbeat from core client for 30 sec - exiting 04:11:23 (58102): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:45 (58275): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:46 (58275): No heartbeat from core client for 30 sec - exiting 05:59:47 (58275): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77c6400] [0xf77c6425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75e31df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75e6825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75ce4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59348, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf76f0400] [0xf76f0425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf750d1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7510825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74f84d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59348, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7732400] [0xf7732425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf754f1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7552825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf753a4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59348, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf76f0400] [0xf76f0425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf750d1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7510825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74f84d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59348, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77ba400] [0xf77ba425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75d71df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75da825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75c24d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59348, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf777c400] [0xf777c425] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75991df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf759c825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75844d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59348, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jun 2013 00:29:56	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	673,920	1,814,642	2.6927
03 Jun 2013 02:53:53	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	648,000	1,747,666	2.6970
02 Jun 2013 06:43:00	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	622,080	1,683,092	2.7056
01 Jun 2013 09:49:38	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	596,160	1,620,621	2.7184
31 May 2013 12:37:46	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	570,240	1,554,972	2.7269
30 May 2013 15:53:26	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	544,320	1,489,448	2.7363
29 May 2013 16:53:56	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	518,400	1,413,245	2.7262
28 May 2013 17:47:32	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	492,480	1,335,868	2.7125
27 May 2013 20:27:42	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	466,560	1,262,706	2.7064
26 May 2013 22:55:32	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	440,640	1,185,603	2.6906
26 May 2013 00:42:49	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	414,720	1,108,561	2.6730
25 May 2013 03:20:24	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	388,800	1,036,210	2.6651
24 May 2013 06:52:14	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	362,880	963,747	2.6558
23 May 2013 10:38:43	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	336,960	892,974	2.6501
22 May 2013 14:10:24	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	311,040	824,679	2.6514
21 May 2013 17:52:55	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	285,120	754,171	2.6451
20 May 2013 21:33:24	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	259,200	682,694	2.6339
20 May 2013 01:48:29	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	233,280	609,965	2.6147
19 May 2013 06:16:20	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	207,360	540,470	2.6064
18 May 2013 08:53:39	1282401	15778913	hadcm3n_o1g3_2140_40_008269824_4	181,440	470,032	2.5906