Task 13105542

Name	hadcm3n_ydve_1900_40_007350836_1
Workunit	7548266
Created	6 Jul 2011, 14:09:17 UTC
Sent	16 Jul 2011, 17:45:54 UTC
Report deadline	16 Oct 2011, 1:13:05 UTC
Received	22 Sep 2011, 3:02:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1063824
Run time	15 days 20 hours 41 min 11 sec
CPU time	15 days 7 hours 18 min 58 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 21:51:07 (4660): No heartbeat from core client for 30 sec - exiting 21:51:08 (4660): No heartbeat from core client for 30 sec - exiting 21:51:10 (4660): No heartbeat from core client for 30 sec - exiting 21:51:11 (4660): No heartbeat from core client for 30 sec - exiting 21:51:12 (4660): No heartbeat from core client for 30 sec - exiting 21:51:13 (4660): No heartbeat from core client for 30 sec - exiting 21:51:14 (4660): No heartbeat from core client for 30 sec - exiting 21:51:15 (4660): No heartbeat from core client for 30 sec - exiting 21:51:16 (4660): No heartbeat from core client for 30 sec - exiting 21:51:17 (4660): No heartbeat from core client for 30 sec - exiting 21:51:18 (4660): No heartbeat from core client for 30 sec - exiting 21:51:19 (4660): No heartbeat from core client for 30 sec - exiting 21:51:20 (4660): No heartbeat from core client for 30 sec - exiting 21:51:22 (4660): No heartbeat from core client for 30 sec - exiting 21:51:23 (4660): No heartbeat from core client for 30 sec - exiting 21:51:24 (4660): No heartbeat from core client for 30 sec - exiting 21:51:25 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:40:24 (3040): No heartbeat from core client for 30 sec - exiting 21:40:25 (3040): No heartbeat from core client for 30 sec - exiting 21:40:26 (3040): No heartbeat from core client for 30 sec - exiting 21:40:27 (3040): No heartbeat from core client for 30 sec - exiting 21:40:28 (3040): No heartbeat from core client for 30 sec - exiting 21:40:29 (3040): No heartbeat from core client for 30 sec - exiting 21:40:31 (3040): No heartbeat from core client for 30 sec - exiting 21:40:32 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:51 (2352): No heartbeat from core client for 30 sec - exiting 13:16:52 (2352): No heartbeat from core client for 30 sec - exiting 13:16:53 (2352): No heartbeat from core client for 30 sec - exiting 13:16:54 (2352): No heartbeat from core client for 30 sec - exiting 13:16:55 (2352): No heartbeat from core client for 30 sec - exiting 13:16:56 (2352): No heartbeat from core client for 30 sec - exiting 13:16:58 (2352): No heartbeat from core client for 30 sec - exiting 13:16:59 (2352): No heartbeat from core client for 30 sec - exiting 13:17:00 (2352): No heartbeat from core client for 30 sec - exiting 13:17:01 (2352): No heartbeat from core client for 30 sec - exiting 13:17:02 (2352): No heartbeat from core client for 30 sec - exiting 13:17:03 (2352): No heartbeat from core client for 30 sec - exiting 13:17:04 (2352): No heartbeat from core client for 30 sec - exiting 13:17:05 (2352): No heartbeat from core client for 30 sec - exiting 13:17:06 (2352): No heartbeat from core client for 30 sec - exiting 13:17:07 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:08 (2352): No heartbeat from core client for 30 sec - exiting 13:17:10 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:28:10 (3724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:27:17 (2528): No heartbeat from core client for 30 sec - exiting 20:27:18 (2528): No heartbeat from core client for 30 sec - exiting 20:27:19 (2528): No heartbeat from core client for 30 sec - exiting 20:27:20 (2528): No heartbeat from core client for 30 sec - exiting 20:27:21 (2528): No heartbeat from core client for 30 sec - exiting 20:27:22 (2528): No heartbeat from core client for 30 sec - exiting 20:27:23 (2528): No heartbeat from core client for 30 sec - exiting 20:27:24 (2528): No heartbeat from core client for 30 sec - exiting 20:27:26 (2528): No heartbeat from core client for 30 sec - exiting 20:27:27 (2528): No heartbeat from core client for 30 sec - exiting 20:27:28 (2528): No heartbeat from core client for 30 sec - exiting 20:27:29 (2528): No heartbeat from core client for 30 sec - exiting 20:27:30 (2528): No heartbeat from core client for 30 sec - exiting 20:27:31 (2528): No heartbeat from core client for 30 sec - exiting 20:27:32 (2528): No heartbeat from core client for 30 sec - exiting 20:27:33 (2528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:10 (2504): No heartbeat from core client for 30 sec - exiting 19:13:11 (2504): No heartbeat from core client for 30 sec - exiting 19:13:12 (2504): No heartbeat from core client for 30 sec - exiting 19:13:13 (2504): No heartbeat from core client for 30 sec - exiting 19:13:14 (2504): No heartbeat from core client for 30 sec - exiting 19:13:16 (2504): No heartbeat from core client for 30 sec - exiting 19:13:17 (2504): No heartbeat from core client for 30 sec - exiting 19:13:18 (2504): No heartbeat from core client for 30 sec - exiting 19:13:19 (2504): No heartbeat from core client for 30 sec - exiting 19:13:20 (2504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:21 (2504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:50:15 (2876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:20:56 (2936): No heartbeat from core client for 30 sec - exiting 01:20:57 (2936): No heartbeat from core client for 30 sec - exiting 01:20:58 (2936): No heartbeat from core client for 30 sec - exiting 01:20:59 (2936): No heartbeat from core client for 30 sec - exiting 01:21:00 (2936): No heartbeat from core client for 30 sec - exiting 01:21:01 (2936): No heartbeat from core client for 30 sec - exiting 01:21:02 (2936): No heartbeat from core client for 30 sec - exiting 01:21:03 (2936): No heartbeat from core client for 30 sec - exiting 01:21:04 (2936): No heartbeat from core client for 30 sec - exiting 01:21:05 (2936): No heartbeat from core client for 30 sec - exiting 01:21:07 (2936): No heartbeat from core client for 30 sec - exiting 01:21:08 (2936): No heartbeat from core client for 30 sec - exiting 01:21:09 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:47:10 (2232): No heartbeat from core client for 30 sec - exiting 19:47:11 (2232): No heartbeat from core client for 30 sec - exiting 19:47:13 (2232): No heartbeat from core client for 30 sec - exiting 19:47:14 (2232): No heartbeat from core client for 30 sec - exiting 19:47:15 (2232): No heartbeat from core client for 30 sec - exiting 19:47:16 (2232): No heartbeat from core client for 30 sec - exiting 19:47:17 (2232): No heartbeat from core client for 30 sec - exiting 19:47:18 (2232): No heartbeat from core client for 30 sec - exiting 19:47:19 (2232): No heartbeat from core client for 30 sec - exiting 19:47:20 (2232): No heartbeat from core client for 30 sec - exiting 19:47:21 (2232): No heartbeat from core client for 30 sec - exiting 19:47:22 (2232): No heartbeat from core client for 30 sec - exiting 19:47:24 (2232): No heartbeat from core client for 30 sec - exiting 19:47:25 (2232): No heartbeat from core client for 30 sec - exiting 19:47:26 (2232): No heartbeat from core client for 30 sec - exiting 19:47:27 (2232): No heartbeat from core client for 30 sec - exiting 19:47:28 (2232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:45:00 (5156): No heartbeat from core client for 30 sec - exiting 00:45:01 (5156): No heartbeat from core client for 30 sec - exiting 00:45:02 (5156): No heartbeat from core client for 30 sec - exiting 00:45:03 (5156): No heartbeat from core client for 30 sec - exiting 00:45:04 (5156): No heartbeat from core client for 30 sec - exiting 00:45:05 (5156): No heartbeat from core client for 30 sec - exiting 00:45:06 (5156): No heartbeat from core client for 30 sec - exiting 00:45:07 (5156): No heartbeat from core client for 30 sec - exiting 00:45:08 (5156): No heartbeat from core client for 30 sec - exiting 00:45:09 (5156): No heartbeat from core client for 30 sec - exiting 00:45:10 (5156): No heartbeat from core client for 30 sec - exiting 00:45:11 (5156): No heartbeat from core client for 30 sec - exiting 00:45:12 (5156): No heartbeat from core client for 30 sec - exiting 00:45:13 (5156): No heartbeat from core client for 30 sec - exiting 00:45:14 (5156): No heartbeat from core client for 30 sec - exiting 00:45:15 (5156): No heartbeat from core client for 30 sec - exiting 00:45:16 (5156): No heartbeat from core client for 30 sec - exiting 00:45:17 (5156): No heartbeat from core client for 30 sec - exiting 00:45:18 (5156): No heartbeat from core client for 30 sec - exiting 00:45:19 (5156): No heartbeat from core client for 30 sec - exiting 00:45:20 (5156): No heartbeat from core client for 30 sec - exiting 00:45:21 (5156): No heartbeat from core client for 30 sec - exiting 00:45:22 (5156): No heartbeat from core client for 30 sec - exiting 00:45:23 (5156): No heartbeat from core client for 30 sec - exiting 00:45:24 (5156): No heartbeat from core client for 30 sec - exiting 00:45:25 (5156): No heartbeat from core client for 30 sec - exiting 00:45:26 (5156): No heartbeat from core client for 30 sec - exiting 00:45:27 (5156): No heartbeat from core client for 30 sec - exiting 00:45:28 (5156): No heartbeat from core client for 30 sec - exiting 00:45:29 (5156): No heartbeat from core client for 30 sec - exiting 00:45:30 (5156): No heartbeat from core client for 30 sec - exiting 00:45:31 (5156): No heartbeat from core client for 30 sec - exiting 00:45:32 (5156): No heartbeat from core client for 30 sec - exiting 00:45:33 (5156): No heartbeat from core client for 30 sec - exiting 00:45:34 (5156): No heartbeat from core client for 30 sec - exiting 00:45:35 (5156): No heartbeat from core client for 30 sec - exiting 00:45:36 (5156): No heartbeat from core client for 30 sec - exiting 00:45:37 (5156): No heartbeat from core client for 30 sec - exiting 00:45:38 (5156): No heartbeat from core client for 30 sec - exiting 00:45:39 (5156): No heartbeat from core client for 30 sec - exiting 00:45:40 (5156): No heartbeat from core client for 30 sec - exiting 00:45:41 (5156): No heartbeat from core client for 30 sec - exiting 00:45:42 (5156): No heartbeat from core client for 30 sec - exiting 00:45:43 (5156): No heartbeat from core client for 30 sec - exiting 00:45:44 (5156): No heartbeat from core client for 30 sec - exiting 00:45:45 (5156): No heartbeat from core client for 30 sec - exiting 00:45:46 (5156): No heartbeat from core client for 30 sec - exiting 00:45:47 (5156): No heartbeat from core client for 30 sec - exiting 00:45:48 (5156): No heartbeat from core client for 30 sec - exiting 00:45:49 (5156): No heartbeat from core client for 30 sec - exiting 00:45:50 (5156): No heartbeat from core client for 30 sec - exiting 00:45:51 (5156): No heartbeat from core client for 30 sec - exiting 00:45:52 (5156): No heartbeat from core client for 30 sec - exiting 00:45:53 (5156): No heartbeat from core client for 30 sec - exiting 00:45:54 (5156): No heartbeat from core client for 30 sec - exiting 00:45:55 (5156): No heartbeat from core client for 30 sec - exiting 00:45:56 (5156): No heartbeat from core client for 30 sec - exiting 00:45:57 (5156): No heartbeat from core client for 30 sec - exiting 00:45:58 (5156): No heartbeat from core client for 30 sec - exiting 00:45:59 (5156): No heartbeat from core client for 30 sec - exiting 00:46:00 (5156): No heartbeat from core client for 30 sec - exiting 00:46:01 (5156): No heartbeat from core client for 30 sec - exiting 00:46:02 (5156): No heartbeat from core client for 30 sec - exiting 00:46:03 (5156): No heartbeat from core client for 30 sec - exiting 00:46:04 (5156): No heartbeat from core client for 30 sec - exiting 00:46:05 (5156): No heartbeat from core client for 30 sec - exiting 00:46:06 (5156): No heartbeat from core client for 30 sec - exiting 00:46:07 (5156): No heartbeat from core client for 30 sec - exiting 00:46:08 (5156): No heartbeat from core client for 30 sec - exiting 00:46:09 (5156): No heartbeat from core client for 30 sec - exiting 00:46:10 (5156): No heartbeat from core client for 30 sec - exiting 00:46:11 (5156): No heartbeat from core client for 30 sec - exiting 00:46:12 (5156): No heartbeat from core client for 30 sec - exiting 00:46:13 (5156): No heartbeat from core client for 30 sec - exiting 00:46:14 (5156): No heartbeat from core client for 30 sec - exiting 00:46:15 (5156): No heartbeat from core client for 30 sec - exiting 00:46:16 (5156): No heartbeat from core client for 30 sec - exiting 00:46:17 (5156): No heartbeat from core client for 30 sec - exiting 00:46:18 (5156): No heartbeat from core client for 30 sec - exiting 00:46:19 (5156): No heartbeat from core client for 30 sec - exiting 00:46:20 (5156): No heartbeat from core client for 30 sec - exiting 00:46:21 (5156): No heartbeat from core client for 30 sec - exiting 00:46:22 (5156): No heartbeat from core client for 30 sec - exiting 00:46:23 (5156): No heartbeat from core client for 30 sec - exiting 00:46:24 (5156): No heartbeat from core client for 30 sec - exiting 00:46:25 (5156): No heartbeat from core client for 30 sec - exiting 00:46:26 (5156): No heartbeat from core client for 30 sec - exiting 00:46:27 (5156): No heartbeat from core client for 30 sec - exiting 00:46:28 (5156): No heartbeat from core client for 30 sec - exiting 00:46:29 (5156): No heartbeat from core client for 30 sec - exiting 00:46:30 (5156): No heartbeat from core client for 30 sec - exiting 00:46:31 (5156): No heartbeat from core client for 30 sec - exiting 00:46:32 (5156): No heartbeat from core client for 30 sec - exiting 00:46:33 (5156): No heartbeat from core client for 30 sec - exiting 00:46:34 (5156): No heartbeat from core client for 30 sec - exiting 00:46:35 (5156): No heartbeat from core client for 30 sec - exiting 00:46:36 (5156): No heartbeat from core client for 30 sec - exiting 00:46:37 (5156): No heartbeat from core client for 30 sec - exiting 00:46:38 (5156): No heartbeat from core client for 30 sec - exiting 00:46:39 (5156): No heartbeat from core client for 30 sec - exiting 00:46:40 (5156): No heartbeat from core client for 30 sec - exiting 00:46:41 (5156): No heartbeat from core client for 30 sec - exiting 00:46:42 (5156): No heartbeat from core client for 30 sec - exiting 00:46:43 (5156): No heartbeat from core client for 30 sec - exiting 00:46:44 (5156): No heartbeat from core client for 30 sec - exiting 00:46:45 (5156): No heartbeat from core client for 30 sec - exiting 00:46:46 (5156): No heartbeat from core client for 30 sec - exiting 00:46:47 (5156): No heartbeat from core client for 30 sec - exiting 00:46:48 (5156): No heartbeat from core client for 30 sec - exiting 00:46:49 (5156): No heartbeat from core client for 30 sec - exiting 00:46:50 (5156): No heartbeat from core client for 30 sec - exiting 00:46:51 (5156): No heartbeat from core client for 30 sec - exiting 00:46:52 (5156): No heartbeat from core client for 30 sec - exiting 00:46:53 (5156): No heartbeat from core client for 30 sec - exiting 00:46:54 (5156): No heartbeat from core client for 30 sec - exiting 00:46:55 (5156): No heartbeat from core client for 30 sec - exiting 00:46:56 (5156): No heartbeat from core client for 30 sec - exiting 00:46:57 (5156): No heartbeat from core client for 30 sec - exiting 00:46:58 (5156): No heartbeat from core client for 30 sec - exiting 00:46:59 (5156): No heartbeat from core client for 30 sec - exiting 00:47:00 (5156): No heartbeat from core client for 30 sec - exiting 00:47:01 (5156): No heartbeat from core client for 30 sec - exiting 00:47:02 (5156): No heartbeat from core client for 30 sec - exiting 00:47:03 (5156): No heartbeat from core client for 30 sec - exiting 00:47:04 (5156): No heartbeat from core client for 30 sec - exiting 00:47:05 (5156): No heartbeat from core client for 30 sec - exiting 00:47:06 (5156): No heartbeat from core client for 30 sec - exiting 00:47:07 (5156): No heartbeat from core client for 30 sec - exiting 00:47:08 (5156): No heartbeat from core client for 30 sec - exiting 00:47:09 (5156): No heartbeat from core client for 30 sec - exiting 00:47:10 (5156): No heartbeat from core client for 30 sec - exiting 00:47:11 (5156): No heartbeat from core client for 30 sec - exiting 00:47:12 (5156): No heartbeat from core client for 30 sec - exiting 00:47:13 (5156): No heartbeat from core client for 30 sec - exiting 00:47:14 (5156): No heartbeat from core client for 30 sec - exiting 00:47:15 (5156): No heartbeat from core client for 30 sec - exiting 00:47:16 (5156): No heartbeat from core client for 30 sec - exiting 00:47:17 (5156): No heartbeat from core client for 30 sec - exiting 00:47:18 (5156): No heartbeat from core client for 30 sec - exiting 00:47:19 (5156): No heartbeat from core client for 30 sec - exiting 00:47:20 (5156): No heartbeat from core client for 30 sec - exiting 00:47:21 (5156): No heartbeat from core client for 30 sec - exiting 00:47:22 (5156): No heartbeat from core client for 30 sec - exiting 00:47:23 (5156): No heartbeat from core client for 30 sec - exiting 00:47:24 (5156): No heartbeat from core client for 30 sec - exiting 00:47:25 (5156): No heartbeat from core client for 30 sec - exiting 00:47:26 (5156): No heartbeat from core client for 30 sec - exiting 00:47:27 (5156): No heartbeat from core client for 30 sec - exiting 00:47:28 (5156): No heartbeat from core client for 30 sec - exiting 00:47:29 (5156): No heartbeat from core client for 30 sec - exiting 00:47:30 (5156): No heartbeat from core client for 30 sec - exiting 00:47:31 (5156): No heartbeat from core client for 30 sec - exiting 00:47:32 (5156): No heartbeat from core client for 30 sec - exiting 00:47:33 (5156): No heartbeat from core client for 30 sec - exiting 00:47:34 (5156): No heartbeat from core client for 30 sec - exiting 00:47:35 (5156): No heartbeat from core client for 30 sec - exiting 00:47:36 (5156): No heartbeat from core client for 30 sec - exiting 00:47:37 (5156): No heartbeat from core client for 30 sec - exiting 00:47:38 (5156): No heartbeat from core client for 30 sec - exiting 00:47:39 (5156): No heartbeat from core client for 30 sec - exiting 00:47:40 (5156): No heartbeat from core client for 30 sec - exiting 00:47:41 (5156): No heartbeat from core client for 30 sec - exiting 00:47:42 (5156): No heartbeat from core client for 30 sec - exiting 00:47:43 (5156): No heartbeat from core client for 30 sec - exiting 00:47:44 (5156): No heartbeat from core client for 30 sec - exiting 00:47:45 (5156): No heartbeat from core client for 30 sec - exiting 00:47:46 (5156): No heartbeat from core client for 30 sec - exiting 00:47:47 (5156): No heartbeat from core client for 30 sec - exiting 00:47:48 (5156): No heartbeat from core client for 30 sec - exiting 00:47:49 (5156): No heartbeat from core client for 30 sec - exiting 00:47:50 (5156): No heartbeat from core client for 30 sec - exiting 00:47:51 (5156): No heartbeat from core client for 30 sec - exiting 00:47:52 (5156): No heartbeat from core client for 30 sec - exiting 00:47:53 (5156): No heartbeat from core client for 30 sec - exiting 00:47:54 (5156): No heartbeat from core client for 30 sec - exiting 00:47:55 (5156): No heartbeat from core client for 30 sec - exiting 00:47:56 (5156): No heartbeat from core client for 30 sec - exiting 00:47:57 (5156): No heartbeat from core client for 30 sec - exiting 00:47:58 (5156): No heartbeat from core client for 30 sec - exiting 00:47:59 (5156): No heartbeat from core client for 30 sec - exiting 00:48:00 (5156): No heartbeat from core client for 30 sec - exiting 00:48:01 (5156): No heartbeat from core client for 30 sec - exiting 00:48:02 (5156): No heartbeat from core client for 30 sec - exiting 00:48:03 (5156): No heartbeat from core client for 30 sec - exiting 00:48:04 (5156): No heartbeat from core client for 30 sec - exiting 00:48:05 (5156): No heartbeat from core client for 30 sec - exiting 00:48:06 (5156): No heartbeat from core client for 30 sec - exiting 00:48:07 (5156): No heartbeat from core client for 30 sec - exiting 00:48:08 (5156): No heartbeat from core client for 30 sec - exiting 00:48:09 (5156): No heartbeat from core client for 30 sec - exiting 00:48:10 (5156): No heartbeat from core client for 30 sec - exiting 00:48:11 (5156): No heartbeat from core client for 30 sec - exiting 00:48:12 (5156): No heartbeat from core client for 30 sec - exiting 00:48:13 (5156): No heartbeat from core client for 30 sec - exiting 00:48:14 (5156): No heartbeat from core client for 30 sec - exiting 00:48:15 (5156): No heartbeat from core client for 30 sec - exiting 00:48:16 (5156): No heartbeat from core client for 30 sec - exiting 00:48:17 (5156): No heartbeat from core client for 30 sec - exiting 00:48:18 (5156): No heartbeat from core client for 30 sec - exiting 00:48:19 (5156): No heartbeat from core client for 30 sec - exiting 00:48:20 (5156): No heartbeat from core client for 30 sec - exiting 00:48:21 (5156): No heartbeat from core client for 30 sec - exiting 00:48:22 (5156): No heartbeat from core client for 30 sec - exiting 00:48:23 (5156): No heartbeat from core client for 30 sec - exiting 00:48:24 (5156): No heartbeat from core client for 30 sec - exiting 00:48:25 (5156): No heartbeat from core client for 30 sec - exiting 00:48:26 (5156): No heartbeat from core client for 30 sec - exiting 00:48:27 (5156): No heartbeat from core client for 30 sec - exiting 00:48:28 (5156): No heartbeat from core client for 30 sec - exiting 00:48:29 (5156): No heartbeat from core client for 30 sec - exiting 00:48:30 (5156): No heartbeat from core client for 30 sec - exiting 00:48:31 (5156): No heartbeat from core client for 30 sec - exiting 00:48:32 (5156): No heartbeat from core client for 30 sec - exiting 00:48:33 (5156): No heartbeat from core client for 30 sec - exiting No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3116, selfPID=3116, iMonCtr=1 CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 12:33:58 (2464): No heartbeat from core client for 30 sec - exiting 12:33:59 (2464): No heartbeat from core client for 30 sec - exiting 12:34:00 (2464): No heartbeat from core client for 30 sec - exiting 12:34:01 (2464): No heartbeat from core client for 30 sec - exiting 12:34:02 (2464): No heartbeat from core client for 30 sec - exiting 12:34:03 (2464): No heartbeat from core client for 30 sec - exiting 12:34:04 (2464): No heartbeat from core client for 30 sec - exiting 12:34:06 (2464): No heartbeat from core client for 30 sec - exiting 12:34:07 (2464): No heartbeat from core client for 30 sec - exiting 12:34:08 (2464): No heartbeat from core client for 30 sec - exiting 12:34:09 (2464): No heartbeat from core client for 30 sec - exiting 12:34:10 (2464): No heartbeat from core client for 30 sec - exiting 12:34:11 (2464): No heartbeat from core client for 30 sec - exiting 12:34:12 (2464): No heartbeat from core client for 30 sec - exiting 12:34:13 (2464): No heartbeat from core client for 30 sec - exiting 12:34:14 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:13:03 (2716): No heartbeat from core client for 30 sec - exiting 13:13:04 (2716): No heartbeat from core client for 30 sec - exiting 13:13:05 (2716): No heartbeat from core client for 30 sec - exiting 13:13:07 (2716): No heartbeat from core client for 30 sec - exiting 13:13:08 (2716): No heartbeat from core client for 30 sec - exiting 13:13:09 (2716): No heartbeat from core client for 30 sec - exiting 13:13:10 (2716): No heartbeat from core client for 30 sec - exiting 13:13:11 (2716): No heartbeat from core client for 30 sec - exiting 13:13:12 (2716): No heartbeat from core client for 30 sec - exiting 13:13:13 (2716): No heartbeat from core client for 30 sec - exiting 13:13:14 (2716): No heartbeat from core client for 30 sec - exiting 13:13:15 (2716): No heartbeat from core client for 30 sec - exiting 13:13:16 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2624, iMonCtr=1 Model crash detected, will try to restart... 15:14:28 (916): No heartbeat from core client for 30 sec - exiting 15:14:29 (916): No heartbeat from core client for 30 sec - exiting 15:14:30 (916): No heartbeat from core client for 30 sec - exiting 15:14:31 (916): No heartbeat from core client for 30 sec - exiting 15:14:32 (916): No heartbeat from core client for 30 sec - exiting 15:14:33 (916): No heartbeat from core client for 30 sec - exiting 15:14:34 (916): No heartbeat from core client for 30 sec - exiting 15:14:35 (916): No heartbeat from core client for 30 sec - exiting 15:14:36 (916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:44:02 (3276): No heartbeat from core client for 30 sec - exiting 13:44:03 (3276): No heartbeat from core client for 30 sec - exiting 13:44:04 (3276): No heartbeat from core client for 30 sec - exiting 13:44:05 (3276): No heartbeat from core client for 30 sec - exiting 13:44:06 (3276): No heartbeat from core client for 30 sec - exiting 13:44:07 (3276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2888, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:30:29 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:30:51 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:31:00 (4072): Can't acquire lockfile (32) - waiting 35s Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ydveko.dad48n0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:58:42 (8996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:43 (8996): No heartbeat from core client for 30 sec - exiting 22:58:44 (8996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:43:17 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Sep 2011 01:58:20	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	1,036,800	1,322,334	1.2754
21 Sep 2011 14:56:31	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	1,010,880	1,288,359	1.2745
20 Sep 2011 17:56:27	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	984,960	1,254,781	1.2739
20 Sep 2011 03:49:20	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	959,040	1,221,095	1.2732
19 Sep 2011 14:06:42	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	933,120	1,187,514	1.2726
18 Sep 2011 15:12:58	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	907,200	1,153,761	1.2718
05 Sep 2011 21:47:06	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	881,280	1,120,228	1.2711
02 Sep 2011 12:56:43	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	855,360	1,087,374	1.2712
29 Aug 2011 09:45:16	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	829,440	1,053,687	1.2704
28 Aug 2011 22:51:18	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	803,520	1,019,915	1.2693
28 Aug 2011 15:44:03	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	777,600	986,703	1.2689
28 Aug 2011 15:44:03	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	751,680	954,251	1.2695
28 Aug 2011 15:44:03	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	725,760	921,738	1.2700
28 Aug 2011 15:44:02	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	699,840	889,238	1.2706
28 Aug 2011 15:44:02	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	673,920	856,756	1.2713
28 Aug 2011 15:44:02	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	648,000	824,233	1.2720
28 Aug 2011 15:44:02	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	622,080	791,720	1.2727
28 Aug 2011 15:44:02	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	596,160	759,197	1.2735
28 Aug 2011 15:44:02	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	570,240	726,626	1.2742
28 Aug 2011 15:44:02	1063824	13105542	hadcm3n_ydve_1900_40_007350836_1	544,320	694,092	1.2752