Task 13347785

Name	hadcm3n_o1zg_1940_40_007442993_0
Workunit	7640496
Created	8 Sep 2011, 22:42:07 UTC
Sent	8 Sep 2011, 22:45:33 UTC
Report deadline	9 Dec 2011, 6:12:44 UTC
Received	24 Nov 2011, 6:00:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1153712
Run time	11 days 12 hours 58 min 35 sec
CPU time	3 days 23 hours 58 min 9 sec
Validate state	Invalid
Credit	622.08
Device peak FLOPS	0.76 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> om core client for 30 sec - exiting 20:05:55 (2168): No heartbeat from core client for 30 sec - exiting 20:05:56 (2168): No heartbeat from core client for 30 sec - exiting 20:05:57 (2168): No heartbeat from core client for 30 sec - exiting 20:05:58 (2168): No heartbeat from core client for 30 sec - exiting 20:05:59 (2168): No heartbeat from core client for 30 sec - exiting 20:06:00 (2168): No heartbeat from core client for 30 sec - exiting 20:06:01 (2168): No heartbeat from core client for 30 sec - exiting 20:06:02 (2168): No heartbeat from core client for 30 sec - exiting 20:06:03 (2168): No heartbeat from core client for 30 sec - exiting 20:06:04 (2168): No heartbeat from core client for 30 sec - exiting 20:06:05 (2168): No heartbeat from core client for 30 sec - exiting 20:06:06 (2168): No heartbeat from core client for 30 sec - exiting 20:06:07 (2168): No heartbeat from core client for 30 sec - exiting 20:06:08 (2168): No heartbeat from core client for 30 sec - exiting 20:24:08 (1463): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:15 (1463): No heartbeat from core client for 30 sec - exiting 20:24:16 (1463): No heartbeat from core client for 30 sec - exiting 20:24:17 (1463): No heartbeat from core client for 30 sec - exiting 20:24:18 (1463): No heartbeat from core client for 30 sec - exiting 20:24:19 (1463): No heartbeat from core client for 30 sec - exiting 21:37:14 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:13 (2457): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:06 (2457): No heartbeat from core client for 30 sec - exiting 21:43:07 (2457): No heartbeat from core client for 30 sec - exiting 21:43:08 (2457): No heartbeat from core client for 30 sec - exiting 21:43:09 (2457): No heartbeat from core client for 30 sec - exiting 21:43:10 (2457): No heartbeat from core client for 30 sec - exiting 21:43:11 (2457): No heartbeat from core client for 30 sec - exiting 21:43:13 (2457): No heartbeat from core client for 30 sec - exiting 21:43:14 (2457): No heartbeat from core client for 30 sec - exiting 21:43:15 (2457): No heartbeat from core client for 30 sec - exiting 21:43:16 (2457): No heartbeat from core client for 30 sec - exiting 21:43:17 (2457): No heartbeat from core client for 30 sec - exiting 21:43:18 (2457): No heartbeat from core client for 30 sec - exiting 21:43:46 (2457): No heartbeat from core client for 30 sec - exiting 21:53:56 (2478): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:56 (2506): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:14 (2518): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:28 (2569): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:21:19 (2582): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:22:22 (2582): No heartbeat from core client for 30 sec - exiting 22:22:23 (2582): No heartbeat from core client for 30 sec - exiting 22:22:24 (2582): No heartbeat from core client for 30 sec - exiting 22:22:25 (2582): No heartbeat from core client for 30 sec - exiting 22:22:26 (2582): No heartbeat from core client for 30 sec - exiting 22:22:27 (2582): No heartbeat from core client for 30 sec - exiting 22:22:28 (2582): No heartbeat from core client for 30 sec - exiting 22:22:29 (2582): No heartbeat from core client for 30 sec - exiting 22:22:30 (2582): No heartbeat from core client for 30 sec - exiting 22:22:31 (2582): No heartbeat from core client for 30 sec - exiting 22:22:32 (2582): No heartbeat from core client for 30 sec - exiting 22:22:33 (2582): No heartbeat from core client for 30 sec - exiting 22:22:34 (2582): No heartbeat from core client for 30 sec - exiting 22:22:35 (2582): No heartbeat from core client for 30 sec - exiting 22:22:36 (2582): No heartbeat from core client for 30 sec - exiting 22:22:37 (2582): No heartbeat from core client for 30 sec - exiting 22:22:38 (2582): No heartbeat from core client for 30 sec - exiting 22:22:39 (2582): No heartbeat from core client for 30 sec - exiting 22:22:40 (2582): No heartbeat from core client for 30 sec - exiting 22:24:40 (2612): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (11 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xb9f400] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x82fa40a] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x80596c7] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x8073e24] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x837738c] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839982e] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f8b7] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x126bd6] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1498, iMonCtr=1 Model crash detected, will try to restart... 19:16:40 (1366): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:57 (2719): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:53 (7984): No heartbeat from core client for 30 sec - exiting 19:39:28 (7984): No heartbeat from core client for 30 sec - exiting 19:39:44 (7984): No heartbeat from core client for 30 sec - exiting 19:39:46 (7984): No heartbeat from core client for 30 sec - exiting 19:39:47 (7984): No heartbeat from core client for 30 sec - exiting 19:39:48 (7984): No heartbeat from core client for 30 sec - exiting 19:39:49 (7984): No heartbeat from core client for 30 sec - exiting 19:39:50 (7984): No heartbeat from core client for 30 sec - exiting 19:39:51 (7984): No heartbeat from core client for 30 sec - exiting 19:39:56 (7984): No heartbeat from core client for 30 sec - exiting 19:44:30 (7984): No heartbeat from core client for 30 sec - exiting 19:54:01 (7984): No heartbeat from core client for 30 sec - exiting 19:54:02 (7984): No heartbeat from core client for 30 sec - exiting 19:54:03 (7984): No heartbeat from core client for 30 sec - exiting 19:54:04 (7984): No heartbeat from core client for 30 sec - exiting 19:54:05 (7984): No heartbeat from core client for 30 sec - exiting 19:54:06 (7984): No heartbeat from core client for 30 sec - exiting 19:54:07 (7984): No heartbeat from core client for 30 sec - exiting 19:54:08 (7984): No heartbeat from core client for 30 sec - exiting 19:54:09 (7984): No heartbeat from core client for 30 sec - exiting 19:54:10 (7984): No heartbeat from core client for 30 sec - exiting 19:54:11 (7984): No heartbeat from core client for 30 sec - exiting 19:54:12 (7984): No heartbeat from core client for 30 sec - exiting 19:54:13 (7984): No heartbeat from core client for 30 sec - exiting 19:54:14 (7984): No heartbeat from core client for 30 sec - exiting 19:54:15 (7984): No heartbeat from core client for 30 sec - exiting 19:54:16 (7984): No heartbeat from core client for 30 sec - exiting 19:54:17 (7984): No heartbeat from core client for 30 sec - exiting 19:54:18 (7984): No heartbeat from core client for 30 sec - exiting 19:54:19 (7984): No heartbeat from core client for 30 sec - exiting 19:54:20 (7984): No heartbeat from core client for 30 sec - exiting 19:54:21 (7984): No heartbeat from core client for 30 sec - exiting 19:54:22 (7984): No heartbeat from core client for 30 sec - exiting 19:54:25 (7984): No heartbeat from core client for 30 sec - exiting 19:54:26 (7984): No heartbeat from core client for 30 sec - exiting 19:54:27 (7984): No heartbeat from core client for 30 sec - exiting 19:54:28 (7984): No heartbeat from core client for 30 sec - exiting 19:54:29 (7984): No heartbeat from core client for 30 sec - exiting 19:54:31 (7984): No heartbeat from core client for 30 sec - exiting 19:54:32 (7984): No heartbeat from core client for 30 sec - exiting 19:54:33 (7984): No heartbeat from core client for 30 sec - exiting 19:54:34 (7984): No heartbeat from core client for 30 sec - exiting 19:54:35 (7984): No heartbeat from core client for 30 sec - exiting 19:54:42 (7984): No heartbeat from core client for 30 sec - exiting 19:54:43 (7984): No heartbeat from core client for 30 sec - exiting 19:54:44 (7984): No heartbeat from core client for 30 sec - exiting 19:54:45 (7984): No heartbeat from core client for 30 sec - exiting 19:54:46 (7984): No heartbeat from core client for 30 sec - exiting 19:54:47 (7984): No heartbeat from core client for 30 sec - exiting 19:54:48 (7984): No heartbeat from core client for 30 sec - exiting 19:54:49 (7984): No heartbeat from core client for 30 sec - exiting 19:54:51 (7984): No heartbeat from core client for 30 sec - exiting 19:54:52 (7984): No heartbeat from core client for 30 sec - exiting 19:54:53 (7984): No heartbeat from core client for 30 sec - exiting 19:54:54 (7984): No heartbeat from core client for 30 sec - exiting 19:55:02 (7984): No heartbeat from core client for 30 sec - exiting 19:55:03 (7984): No heartbeat from core client for 30 sec - exiting 19:55:04 (7984): No heartbeat from core client for 30 sec - exiting 19:55:05 (7984): No heartbeat from core client for 30 sec - exiting 19:55:08 (7984): No heartbeat from core client for 30 sec - exiting 19:55:09 (7984): No heartbeat from core client for 30 sec - exiting 19:55:10 (7984): No heartbeat from core client for 30 sec - exiting 19:55:14 (7984): No heartbeat from core client for 30 sec - exiting 19:55:15 (7984): No heartbeat from core client for 30 sec - exiting 19:55:16 (7984): No heartbeat from core client for 30 sec - exiting 19:55:17 (7984): No heartbeat from core client for 30 sec - exiting 19:55:18 (7984): No heartbeat from core client for 30 sec - exiting 19:55:19 (7984): No heartbeat from core client for 30 sec - exiting 19:55:20 (7984): No heartbeat from core client for 30 sec - exiting 19:55:21 (7984): No heartbeat from core client for 30 sec - exiting 19:55:27 (7984): No heartbeat from core client for 30 sec - exiting 19:55:29 (7984): No heartbeat from core client for 30 sec - exiting 19:55:30 (7984): No heartbeat from core client for 30 sec - exiting 19:55:31 (7984): No heartbeat from core client for 30 sec - exiting 19:55:32 (7984): No heartbeat from core client for 30 sec - exiting 19:55:40 (7984): No heartbeat from core client for 30 sec - exiting 19:55:42 (7984): No heartbeat from core client for 30 sec - exiting 19:55:43 (7984): No heartbeat from core client for 30 sec - exiting 19:55:44 (7984): No heartbeat from core client for 30 sec - exiting 19:55:45 (7984): No heartbeat from core client for 30 sec - exiting 19:55:46 (7984): No heartbeat from core client for 30 sec - exiting 19:55:47 (7984): No heartbeat from core client for 30 sec - exiting 19:55:49 (7984): No heartbeat from core client for 30 sec - exiting 19:55:50 (7984): No heartbeat from core client for 30 sec - exiting 19:55:51 (7984): No heartbeat from core client for 30 sec - exiting 19:55:52 (7984): No heartbeat from core client for 30 sec - exiting 19:55:53 (7984): No heartbeat from core client for 30 sec - exiting 19:55:54 (7984): No heartbeat from core client for 30 sec - exiting 19:55:55 (7984): No heartbeat from core client for 30 sec - exiting 19:55:56 (7984): No heartbeat from core client for 30 sec - exiting 19:55:57 (7984): No heartbeat from core client for 30 sec - exiting 19:55:58 (7984): No heartbeat from core client for 30 sec - exiting 19:56:00 (7984): No heartbeat from core client for 30 sec - exiting 19:56:01 (7984): No heartbeat from core client for 30 sec - exiting 19:56:02 (7984): No heartbeat from core client for 30 sec - exiting 19:56:03 (7984): No heartbeat from core client for 30 sec - exiting 19:56:04 (7984): No heartbeat from core client for 30 sec - exiting 19:56:05 (7984): No heartbeat from core client for 30 sec - exiting 19:56:06 (7984): No heartbeat from core client for 30 sec - exiting 19:56:07 (7984): No heartbeat from core client for 30 sec - exiting 19:56:08 (7984): No heartbeat from core client for 30 sec - exiting 19:56:10 (7984): No heartbeat from core client for 30 sec - exiting 19:56:11 (7984): No heartbeat from core client for 30 sec - exiting 19:56:12 (7984): No heartbeat from core client for 30 sec - exiting 19:56:13 (7984): No heartbeat from core client for 30 sec - exiting 19:56:14 (7984): No heartbeat from core client for 30 sec - exiting 19:56:15 (7984): No heartbeat from core client for 30 sec - exiting 19:56:16 (7984): No heartbeat from core client for 30 sec - exiting 19:56:17 (7984): No heartbeat from core client for 30 sec - exiting 19:56:18 (7984): No heartbeat from core client for 30 sec - exiting 19:56:19 (7984): No heartbeat from core client for 30 sec - exiting 19:56:20 (7984): No heartbeat from core client for 30 sec - exiting 19:56:21 (7984): No heartbeat from core client for 30 sec - exiting 19:56:22 (7984): No heartbeat from core client for 30 sec - exiting 19:56:23 (7984): No heartbeat from core client for 30 sec - exiting 19:56:24 (7984): No heartbeat from core client for 30 sec - exiting 19:56:25 (7984): No heartbeat from core client for 30 sec - exiting 19:56:26 (7984): No heartbeat from core client for 30 sec - exiting 19:56:27 (7984): No heartbeat from core client for 30 sec - exiting 19:56:28 (7984): No heartbeat from core client for 30 sec - exiting 19:56:29 (7984): No heartbeat from core client for 30 sec - exiting 19:56:30 (7984): No heartbeat from core client for 30 sec - exiting 19:56:31 (7984): No heartbeat from core client for 30 sec - exiting 19:56:32 (7984): No heartbeat from core client for 30 sec - exiting 19:56:33 (7984): No heartbeat from core client for 30 sec - exiting 19:56:34 (7984): No heartbeat from core client for 30 sec - exiting 19:56:35 (7984): No heartbeat from core client for 30 sec - exiting 19:56:36 (7984): No heartbeat from core client for 30 sec - exiting 19:56:37 (7984): No heartbeat from core client for 30 sec - exiting 19:56:38 (7984): No heartbeat from core client for 30 sec - exiting 19:56:39 (7984): No heartbeat from core client for 30 sec - exiting 19:56:40 (7984): No heartbeat from core client for 30 sec - exiting 19:56:42 (7984): No heartbeat from core client for 30 sec - exiting 19:56:43 (7984): No heartbeat from core client for 30 sec - exiting 19:56:44 (7984): No heartbeat from core client for 30 sec - exiting 19:56:45 (7984): No heartbeat from core client for 30 sec - exiting 19:56:46 (7984): No heartbeat from core client for 30 sec - exiting 19:56:47 (7984): No heartbeat from core client for 30 sec - exiting 19:56:48 (7984): No heartbeat from core client for 30 sec - exiting 19:56:49 (7984): No heartbeat from core client for 30 sec - exiting 19:56:50 (7984): No heartbeat from core client for 30 sec - exiting 19:56:51 (7984): No heartbeat from core client for 30 sec - exiting 19:56:52 (7984): No heartbeat from core client for 30 sec - exiting 19:56:53 (7984): No heartbeat from core client for 30 sec - exiting 19:56:54 (7984): No heartbeat from core client for 30 sec - exiting 19:56:55 (7984): No heartbeat from core client for 30 sec - exiting 19:56:56 (7984): No heartbeat from core client for 30 sec - exiting 19:56:57 (7984): No heartbeat from core client for 30 sec - exiting 19:56:58 (7984): No heartbeat from core client for 30 sec - exiting 19:56:59 (7984): No heartbeat from core client for 30 sec - exiting 19:57:00 (7984): No heartbeat from core client for 30 sec - exiting 19:57:01 (7984): No heartbeat from core client for 30 sec - exiting 19:57:02 (7984): No heartbeat from core client for 30 sec - exiting 19:57:05 (7984): No heartbeat from core client for 30 sec - exiting 19:57:06 (7984): No heartbeat from core client for 30 sec - exiting 19:57:07 (7984): No heartbeat from core client for 30 sec - exiting 19:57:08 (7984): No heartbeat from core client for 30 sec - exiting 19:57:10 (7984): No heartbeat from core client for 30 sec - exiting 19:57:11 (7984): No heartbeat from core client for 30 sec - exiting 19:57:12 (7984): No heartbeat from core client for 30 sec - exiting 19:57:13 (7984): No heartbeat from core client for 30 sec - exiting 19:57:14 (7984): No heartbeat from core client for 30 sec - exiting 19:57:15 (7984): No heartbeat from core client for 30 sec - exiting 19:57:16 (7984): No heartbeat from core client for 30 sec - exiting 19:57:17 (7984): No heartbeat from core client for 30 sec - exiting 19:57:18 (7984): No heartbeat from core client for 30 sec - exiting 19:57:19 (7984): No heartbeat from core client for 30 sec - exiting 19:57:20 (7984): No heartbeat from core client for 30 sec - exiting 19:57:21 (7984): No heartbeat from core client for 30 sec - exiting 19:57:22 (7984): No heartbeat from core client for 30 sec - exiting 19:57:23 (7984): No heartbeat from core client for 30 sec - exiting 19:57:24 (7984): No heartbeat from core client for 30 sec - exiting 19:57:26 (7984): No heartbeat from core client for 30 sec - exiting 19:57:27 (7984): No heartbeat from core client for 30 sec - exiting 19:57:28 (7984): No heartbeat from core client for 30 sec - exiting 19:57:29 (7984): No heartbeat from core client for 30 sec - exiting 19:57:30 (7984): No heartbeat from core client for 30 sec - exiting 19:57:31 (7984): No heartbeat from core client for 30 sec - exiting 19:57:32 (7984): No heartbeat from core client for 30 sec - exiting 19:57:33 (7984): No heartbeat from core client for 30 sec - exiting 19:57:34 (7984): No heartbeat from core client for 30 sec - exiting 19:57:35 (7984): No heartbeat from core client for 30 sec - exiting 19:57:40 (7984): No heartbeat from core client for 30 sec - exiting 19:57:41 (7984): No heartbeat from core client for 30 sec - exiting 19:57:42 (7984): No heartbeat from core client for 30 sec - exiting 19:57:43 (7984): No heartbeat from core client for 30 sec - exiting 19:57:44 (7984): No heartbeat from core client for 30 sec - exiting 19:57:45 (7984): No heartbeat from core client for 30 sec - exiting 19:57:46 (7984): No heartbeat from core client for 30 sec - exiting 19:57:47 (7984): No heartbeat from core client for 30 sec - exiting 19:57:48 (7984): No heartbeat from core client for 30 sec - exiting 19:57:49 (7984): No heartbeat from core client for 30 sec - exiting 19:57:50 (7984): No heartbeat from core client for 30 sec - exiting 19:57:51 (7984): No heartbeat from core client for 30 sec - exiting 19:57:52 (7984): No heartbeat from core client for 30 sec - exiting 19:57:53 (7984): No heartbeat from core client for 30 sec - exiting 19:57:54 (7984): No heartbeat from core client for 30 sec - exiting 19:57:55 (7984): No heartbeat from core client for 30 sec - exiting 19:57:56 (7984): No heartbeat from core client for 30 sec - exiting 19:57:57 (7984): No heartbeat from core client for 30 sec - exiting 19:57:58 (7984): No heartbeat from core client for 30 sec - exiting 19:57:59 (7984): No heartbeat from core client for 30 sec - exiting 19:58:00 (7984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:21 (8047): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:40:20 (8075): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:08:43 (9956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:26:12 (10528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:40 (10763): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:33:27 (10773): No heartbeat from core client for 30 sec - exiting 23:35:04 (10773): No heartbeat from core client for 30 sec - exiting 23:35:06 (10773): No heartbeat from core client for 30 sec - exiting 23:35:07 (10773): No heartbeat from core client for 30 sec - exiting 23:35:08 (10773): No heartbeat from core client for 30 sec - exiting 23:35:09 (10773): No heartbeat from core client for 30 sec - exiting 23:35:10 (10773): No heartbeat from core client for 30 sec - exiting 23:35:47 (10773): No heartbeat from core client for 30 sec - exiting 23:35:50 (10773): No heartbeat from core client for 30 sec - exiting 23:35:51 (10773): No heartbeat from core client for 30 sec - exiting 23:35:52 (10773): No heartbeat from core client for 30 sec - exiting 23:35:54 (10773): No heartbeat from core client for 30 sec - exiting 23:35:55 (10773): No heartbeat from core client for 30 sec - exiting 23:35:56 (10773): No heartbeat from core client for 30 sec - exiting 23:35:57 (10773): No heartbeat from core client for 30 sec - exiting 23:35:58 (10773): No heartbeat from core client for 30 sec - exiting 23:38:33 (10773): No heartbeat from core client for 30 sec - exiting 23:41:17 (10773): No heartbeat from core client for 30 sec - exiting 23:41:27 (10773): No heartbeat from core client for 30 sec - exiting 23:41:28 (10773): No heartbeat from core client for 30 sec - exiting 23:41:29 (10773): No heartbeat from core client for 30 sec - exiting 23:41:30 (10773): No heartbeat from core client for 30 sec - exiting 23:41:31 (10773): No heartbeat from core client for 30 sec - exiting 23:41:32 (10773): No heartbeat from core client for 30 sec - exiting 23:41:33 (10773): No heartbeat from core client for 30 sec - exiting 23:41:35 (10773): No heartbeat from core client for 30 sec - exiting 23:41:36 (10773): No heartbeat from core client for 30 sec - exiting 23:41:37 (10773): No heartbeat from core client for 30 sec - exiting 23:41:38 (10773): No heartbeat from core client for 30 sec - exiting 23:41:39 (10773): No heartbeat from core client for 30 sec - exiting 23:41:40 (10773): No heartbeat from core client for 30 sec - exiting 23:41:41 (10773): No heartbeat from core client for 30 sec - exiting 23:41:42 (10773): No heartbeat from core client for 30 sec - exiting 23:41:43 (10773): No heartbeat from core client for 30 sec - exiting 23:41:44 (10773): No heartbeat from core client for 30 sec - exiting 23:41:45 (10773): No heartbeat from core client for 30 sec - exiting 23:41:46 (10773): No heartbeat from core client for 30 sec - exiting 23:41:48 (10773): No heartbeat from core client for 30 sec - exiting 23:43:11 (10773): No heartbeat from core client for 30 sec - exiting 23:43:12 (10773): No heartbeat from core client for 30 sec - exiting 23:43:13 (10773): No heartbeat from core client for 30 sec - exiting 23:43:14 (10773): No heartbeat from core client for 30 sec - exiting 23:43:15 (10773): No heartbeat from core client for 30 sec - exiting 23:43:16 (10773): No heartbeat from core client for 30 sec - exiting 23:43:17 (10773): No heartbeat from core client for 30 sec - exiting 23:43:18 (10773): No heartbeat from core client for 30 sec - exiting 23:43:19 (10773): No heartbeat from core client for 30 sec - exiting 23:43:20 (10773): No heartbeat from core client for 30 sec - exiting 23:43:21 (10773): No heartbeat from core client for 30 sec - exiting 23:43:22 (10773): No heartbeat from core client for 30 sec - exiting 23:43:23 (10773): No heartbeat from core client for 30 sec - exiting 23:43:24 (10773): No heartbeat from core client for 30 sec - exiting 23:43:25 (10773): No heartbeat from core client for 30 sec - exiting 23:43:26 (10773): No heartbeat from core client for 30 sec - exiting 23:43:27 (10773): No heartbeat from core client for 30 sec - exiting 23:43:28 (10773): No heartbeat from core client for 30 sec - exiting 23:43:36 (10773): No heartbeat from core client for 30 sec - exiting 23:43:37 (10773): No heartbeat from core client for 30 sec - exiting 23:43:45 (10773): No heartbeat from core client for 30 sec - exiting 23:43:46 (10773): No heartbeat from core client for 30 sec - exiting 23:43:47 (10773): No heartbeat from core client for 30 sec - exiting 23:43:48 (10773): No heartbeat from core client for 30 sec - exiting 23:43:49 (10773): No heartbeat from core client for 30 sec - exiting 23:43:50 (10773): No heartbeat from core client for 30 sec - exiting 23:43:52 (10773): No heartbeat from core client for 30 sec - exiting 23:43:53 (10773): No heartbeat from core client for 30 sec - exiting 23:43:54 (10773): No heartbeat from core client for 30 sec - exiting 23:43:55 (10773): No heartbeat from core client for 30 sec - exiting 23:43:56 (10773): No heartbeat from core client for 30 sec - exiting 23:43:57 (10773): No heartbeat from core client for 30 sec - exiting 23:43:58 (10773): No heartbeat from core client for 30 sec - exiting 23:43:59 (10773): No heartbeat from core client for 30 sec - exiting 23:44:00 (10773): No heartbeat from core client for 30 sec - exiting 23:44:01 (10773): No heartbeat from core client for 30 sec - exiting 23:44:02 (10773): No heartbeat from core client for 30 sec - exiting 23:44:03 (10773): No heartbeat from core client for 30 sec - exiting 23:44:04 (10773): No heartbeat from core client for 30 sec - exiting 23:44:05 (10773): No heartbeat from core client for 30 sec - exiting 23:44:06 (10773): No heartbeat from core client for 30 sec - exiting 23:44:07 (10773): No heartbeat from core client for 30 sec - exiting 23:44:08 (10773): No heartbeat from core client for 30 sec - exiting 23:44:09 (10773): No heartbeat from core client for 30 sec - exiting 23:44:10 (10773): No heartbeat from core client for 30 sec - exiting 23:44:11 (10773): No heartbeat from core client for 30 sec - exiting 23:44:12 (10773): No heartbeat from core client for 30 sec - exiting 23:44:14 (10773): No heartbeat from core client for 30 sec - exiting 23:44:15 (10773): No heartbeat from core client for 30 sec - exiting 23:44:16 (10773): No heartbeat from core client for 30 sec - exiting 23:44:17 (10773): No heartbeat from core client for 30 sec - exiting 23:44:18 (10773): No heartbeat from core client for 30 sec - exiting 23:44:21 (10773): No heartbeat from core client for 30 sec - exiting 23:44:22 (10773): No heartbeat from core client for 30 sec - exiting 23:44:23 (10773): No heartbeat from core client for 30 sec - exiting 23:44:24 (10773): No heartbeat from core client for 30 sec - exiting 23:44:25 (10773): No heartbeat from core client for 30 sec - exiting 23:44:26 (10773): No heartbeat from core client for 30 sec - exiting 23:44:27 (10773): No heartbeat from core client for 30 sec - exiting 23:44:28 (10773): No heartbeat from core client for 30 sec - exiting 23:44:29 (10773): No heartbeat from core client for 30 sec - exiting 23:44:30 (10773): No heartbeat from core client for 30 sec - exiting 23:44:31 (10773): No heartbeat from core client for 30 sec - exiting 23:44:32 (10773): No heartbeat from core client for 30 sec - exiting 23:44:33 (10773): No heartbeat from core client for 30 sec - exiting 23:44:34 (10773): No heartbeat from core client for 30 sec - exiting 23:44:36 (10773): No heartbeat from core client for 30 sec - exiting 23:44:37 (10773): No heartbeat from core client for 30 sec - exiting 23:44:38 (10773): No heartbeat from core client for 30 sec - exiting 23:44:39 (10773): No heartbeat from core client for 30 sec - exiting 23:44:40 (10773): No heartbeat from core client for 30 sec - exiting 23:44:41 (10773): No heartbeat from core client for 30 sec - exiting 23:44:42 (10773): No heartbeat from core client for 30 sec - exiting 23:44:43 (10773): No heartbeat from core client for 30 sec - exiting 23:44:44 (10773): No heartbeat from core client for 30 sec - exiting 23:44:45 (10773): No heartbeat from core client for 30 sec - exiting 23:44:52 (10773): No heartbeat from core client for 30 sec - exiting 23:44:53 (10773): No heartbeat from core client for 30 sec - exiting 23:44:54 (10773): No heartbeat from core client for 30 sec - exiting 23:44:55 (10773): No heartbeat from core client for 30 sec - exiting 23:44:56 (10773): No heartbeat from core client for 30 sec - exiting 23:47:16 (10773): No heartbeat from core client for 30 sec - exiting 23:47:28 (10773): No heartbeat from core client for 30 sec - exiting 23:47:29 (10773): No heartbeat from core client for 30 sec - exiting 23:47:30 (10773): No heartbeat from core client for 30 sec - exiting 23:47:31 (10773): No heartbeat from core client for 30 sec - exiting 23:47:32 (10773): No heartbeat from core client for 30 sec - exiting 23:47:33 (10773): No heartbeat from core client for 30 sec - exiting 23:47:34 (10773): No heartbeat from core client for 30 sec - exiting 23:47:35 (10773): No heartbeat from core client for 30 sec - exiting 23:47:36 (10773): No heartbeat from core client for 30 sec - exiting 23:47:37 (10773): No heartbeat from core client for 30 sec - exiting 23:47:38 (10773): No heartbeat from core client for 30 sec - exiting 23:47:39 (10773): No heartbeat from core client for 30 sec - exiting 23:47:40 (10773): No heartbeat from core client for 30 sec - exiting 23:47:41 (10773): No heartbeat from core client for 30 sec - exiting 23:47:42 (10773): No heartbeat from core client for 30 sec - exiting 23:47:43 (10773): No heartbeat from core client for 30 sec - exiting 23:47:44 (10773): No heartbeat from core client for 30 sec - exiting 23:47:46 (10773): No heartbeat from core client for 30 sec - exiting 23:47:47 (10773): No heartbeat from core client for 30 sec - exiting 23:47:48 (10773): No heartbeat from core client for 30 sec - exiting 23:47:49 (10773): No heartbeat from core client for 30 sec - exiting 23:47:51 (10773): No heartbeat from core client for 30 sec - exiting 23:47:52 (10773): No heartbeat from core client for 30 sec - exiting 23:47:53 (10773): No heartbeat from core client for 30 sec - exiting 23:47:54 (10773): No heartbeat from core client for 30 sec - exiting 23:47:55 (10773): No heartbeat from core client for 30 sec - exiting 23:47:59 (10773): No heartbeat from core client for 30 sec - exiting 23:48:00 (10773): No heartbeat from core client for 30 sec - exiting 23:48:01 (10773): No heartbeat from core client for 30 sec - exiting 23:48:02 (10773): No heartbeat from core client for 30 sec - exiting 23:48:03 (10773): No heartbeat from core client for 30 sec - exiting 23:48:04 (10773): No heartbeat from core client for 30 sec - exiting 23:48:05 (10773): No heartbeat from core client for 30 sec - exiting 23:48:06 (10773): No heartbeat from core client for 30 sec - exiting 23:48:07 (10773): No heartbeat from core client for 30 sec - exiting 23:48:08 (10773): No heartbeat from core client for 30 sec - exiting 23:48:11 (10773): No heartbeat from core client for 30 sec - exiting 23:49:25 (10773): No heartbeat from core client for 30 sec - exiting 23:49:26 (10773): No heartbeat from core client for 30 sec - exiting 23:49:27 (10773): No heartbeat from core client for 30 sec - exiting 23:49:28 (10773): No heartbeat from core client for 30 sec - exiting 23:49:29 (10773): No heartbeat from core client for 30 sec - exiting 23:49:30 (10773): No heartbeat from core client for 30 sec - exiting 23:49:31 (10773): No heartbeat from core client for 30 sec - exiting 23:49:32 (10773): No heartbeat from core client for 30 sec - exiting 23:49:35 (10773): No heartbeat from core client for 30 sec - exiting 23:49:36 (10773): No heartbeat from core client for 30 sec - exiting 23:49:37 (10773): No heartbeat from core client for 30 sec - exiting 23:49:38 (10773): No heartbeat from core client for 30 sec - exiting 23:49:39 (10773): No heartbeat from core client for 30 sec - exiting 23:49:40 (10773): No heartbeat from core client for 30 sec - exiting 23:49:41 (10773): No heartbeat from core client for 30 sec - exiting 23:49:42 (10773): No heartbeat from core client for 30 sec - exiting 23:49:43 (10773): No heartbeat from core client for 30 sec - exiting 23:49:44 (10773): No heartbeat from core client for 30 sec - exiting 23:49:45 (10773): No heartbeat from core client for 30 sec - exiting 23:49:46 (10773): No heartbeat from core client for 30 sec - exiting 23:49:47 (10773): No heartbeat from core client for 30 sec - exiting 23:49:48 (10773): No heartbeat from core client for 30 sec - exiting 23:49:49 (10773): No heartbeat from core client for 30 sec - exiting 23:49:50 (10773): No heartbeat from core client for 30 sec - exiting 23:49:51 (10773): No heartbeat from core client for 30 sec - exiting 23:49:52 (10773): No heartbeat from core client for 30 sec - exiting 23:49:53 (10773): No heartbeat from core client for 30 sec - exiting 23:49:54 (10773): No heartbeat from core client for 30 sec - exiting 23:49:55 (10773): No heartbeat from core client for 30 sec - exiting 23:49:56 (10773): No heartbeat from core client for 30 sec - exiting 23:49:57 (10773): No heartbeat from core client for 30 sec - exiting 23:49:58 (10773): No heartbeat from core client for 30 sec - exiting 23:50:25 (10773): No heartbeat from core client for 30 sec - exiting 23:51:07 (10773): No heartbeat from core client for 30 sec - exiting 23:51:08 (10773): No heartbeat from core client for 30 sec - exiting 23:51:09 (10773): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:59:23 (10794): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:09 (10794): No heartbeat from core client for 30 sec - exiting 00:01:10 (10794): No heartbeat from core client for 30 sec - exiting 00:01:11 (10794): No heartbeat from core client for 30 sec - exiting 00:01:12 (10794): No heartbeat from core client for 30 sec - exiting 00:01:13 (10794): No heartbeat from core client for 30 sec - exiting 00:01:14 (10794): No heartbeat from core client for 30 sec - exiting 00:01:22 (10794): No heartbeat from core client for 30 sec - exiting 00:01:24 (10794): No heartbeat from core client for 30 sec - exiting 00:01:25 (10794): No heartbeat from core client for 30 sec - exiting 00:01:26 (10794): No heartbeat from core client for 30 sec - exiting 00:01:27 (10794): No heartbeat from core client for 30 sec - exiting 00:01:28 (10794): No heartbeat from core client for 30 sec - exiting 00:01:29 (10794): No heartbeat from core client for 30 sec - exiting 00:01:30 (10794): No heartbeat from core client for 30 sec - exiting 00:01:31 (10794): No heartbeat from core client for 30 sec - exiting 00:01:32 (10794): No heartbeat from core client for 30 sec - exiting 00:01:33 (10794): No heartbeat from core client for 30 sec - exiting 00:01:34 (10794): No heartbeat from core client for 30 sec - exiting 00:01:35 (10794): No heartbeat from core client for 30 sec - exiting 00:01:36 (10794): No heartbeat from core client for 30 sec - exiting 00:01:37 (10794): No heartbeat from core client for 30 sec - exiting 00:01:39 (10794): No heartbeat from core client for 30 sec - exiting 00:01:40 (10794): No heartbeat from core client for 30 sec - exiting 00:01:41 (10794): No heartbeat from core client for 30 sec - exiting 00:01:42 (10794): No heartbeat from core client for 30 sec - exiting 00:01:43 (10794): No heartbeat from core client for 30 sec - exiting 00:01:44 (10794): No heartbeat from core client for 30 sec - exiting 00:01:45 (10794): No heartbeat from core client for 30 sec - exiting 00:01:46 (10794): No heartbeat from core client for 30 sec - exiting 00:01:47 (10794): No heartbeat from core client for 30 sec - exiting 00:01:48 (10794): No heartbeat from core client for 30 sec - exiting 00:01:49 (10794): No heartbeat from core client for 30 sec - exiting 00:01:50 (10794): No heartbeat from core client for 30 sec - exiting 00:01:51 (10794): No heartbeat from core client for 30 sec - exiting 00:01:52 (10794): No heartbeat from core client for 30 sec - exiting 00:01:53 (10794): No heartbeat from core client for 30 sec - exiting 00:01:54 (10794): No heartbeat from core client for 30 sec - exiting 00:01:55 (10794): No heartbeat from core client for 30 sec - exiting 00:01:56 (10794): No heartbeat from core client for 30 sec - exiting 00:01:57 (10794): No heartbeat from core client for 30 sec - exiting 00:01:58 (10794): No heartbeat from core client for 30 sec - exiting 00:01:59 (10794): No heartbeat from core client for 30 sec - exiting 00:02:00 (10794): No heartbeat from core client for 30 sec - exiting 00:02:01 (10794): No heartbeat from core client for 30 sec - exiting 00:02:02 (10794): No heartbeat from core client for 30 sec - exiting 19:15:40 (1504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:41 (1504): No heartbeat from core client for 30 sec - exiting 19:17:13 (2299): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:25 (2314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:32 (2314): No heartbeat from core client for 30 sec - exiting 20:15:33 (2314): No heartbeat from core client for 30 sec - exiting 20:15:34 (2314): No heartbeat from core client for 30 sec - exiting 20:15:35 (2314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 22:48:08 (1521): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:25 (3127): No heartbeat from core client for 30 sec - exiting 22:53:47 (3127): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:48 (3127): No heartbeat from core client for 30 sec - exiting 22:53:49 (3127): No heartbeat from core client for 30 sec - exiting 22:53:50 (3127): No heartbeat from core client for 30 sec - exiting 23:01:55 (3217): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish 19:48:50 (1260): No heartbeat from core client for 30 sec - exiting 19:49:20 (1260): No heartbeat from core client for 30 sec - exiting 19:49:21 (1260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:27 (1260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 12:00:50 (1261): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:34 (2118): No heartbeat from core client for 30 sec - exiting 12:03:40 (2118): No heartbeat from core client for 30 sec - exiting 12:03:41 (2118): No heartbeat from core client for 30 sec - exiting 12:03:42 (2118): No heartbeat from core client for 30 sec - exiting 12:03:43 (2118): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:35 (2129): No heartbeat from core client for 30 sec - exiting 12:09:02 (2129): No heartbeat from core client for 30 sec - exiting 12:09:03 (2129): No heartbeat from core client for 30 sec - exiting 12:09:04 (2129): No heartbeat from core client for 30 sec - exiting 12:09:05 (2129): No heartbeat from core client for 30 sec - exiting 12:09:06 (2129): No heartbeat from core client for 30 sec - exiting 12:09:07 (2129): No heartbeat from core client for 30 sec - exiting 12:09:08 (2129): No heartbeat from core client for 30 sec - exiting 12:09:10 (2129): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:11 (2129): No heartbeat from core client for 30 sec - exiting 12:09:12 (2129): No heartbeat from core client for 30 sec - exiting 12:09:13 (2129): No heartbeat from core client for 30 sec - exiting 12:09:14 (2129): No heartbeat from core client for 30 sec - exiting 12:09:15 (2129): No heartbeat from core client for 30 sec - exiting 12:09:16 (2129): No heartbeat from core client for 30 sec - exiting 12:09:17 (2129): No heartbeat from core client for 30 sec - exiting 12:09:18 (2129): No heartbeat from core client for 30 sec - exiting 12:09:19 (2129): No heartbeat from core client for 30 sec - exiting 12:09:20 (2129): No heartbeat from core client for 30 sec - exiting 12:09:21 (2129): No heartbeat from core client for 30 sec - exiting 12:09:22 (2129): No heartbeat from core client for 30 sec - exiting 12:09:23 (2129): No heartbeat from core client for 30 sec - exiting 12:09:24 (2129): No heartbeat from core client for 30 sec - exiting 12:09:25 (2129): No heartbeat from core client for 30 sec - exiting 12:09:26 (2129): No heartbeat from core client for 30 sec - exiting 12:09:27 (2129): No heartbeat from core client for 30 sec - exiting 12:09:28 (2129): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish 15:42:46 (1424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:07 (1451): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:37 (1942): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:44 (2675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:05 (2695): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:12 (2695): No heartbeat from core client for 30 sec - exiting 08:40:28 (5218): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:35 (5218): No heartbeat from core client for 30 sec - exiting 08:40:36 (5218): No heartbeat from core client for 30 sec - exiting 08:40:37 (5218): No heartbeat from core client for 30 sec - exiting 08:40:38 (5218): No heartbeat from core client for 30 sec - exiting 08:40:39 (5218): No heartbeat from core client for 30 sec - exiting 08:42:58 (5310): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:58 (5326): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:25 (1769): No heartbeat from core client for 30 sec - exiting 02:31:49 (1769): No heartbeat from core client for 30 sec - exiting 02:31:50 (1769): No heartbeat from core client for 30 sec - exiting 02:31:51 (1769): No heartbeat from core client for 30 sec - exiting 02:31:52 (1769): No heartbeat from core client for 30 sec - exiting 02:31:53 (1769): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:31:54 (1769): No heartbeat from core client for 30 sec - exiting 02:32:07 (1769): No heartbeat from core client for 30 sec - exiting 02:32:09 (1769): No heartbeat from core client for 30 sec - exiting 02:32:10 (1769): No heartbeat from core client for 30 sec - exiting 02:32:11 (1769): No heartbeat from core client for 30 sec - exiting 02:32:12 (1769): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2108, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xc7b400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805067e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x2c2bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... 17:58:43 (1501): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:08 (1794): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:18 (2031): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:16:45 (2079): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:51 (2079): No heartbeat from core client for 30 sec - exiting 18:17:52 (2079): No heartbeat from core client for 30 sec - exiting 18:17:53 (2079): No heartbeat from core client for 30 sec - exiting 18:17:55 (2079): No heartbeat from core client for 30 sec - exiting 18:17:56 (2079): No heartbeat from core client for 30 sec - exiting 18:26:27 (2144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:44 (2260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:51 (2260): No heartbeat from core client for 30 sec - exiting 20:07:13 (2436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:22 (2436): No heartbeat from core client for 30 sec - exiting 20:07:23 (2436): No heartbeat from core client for 30 sec - exiting 21:19:34 (2585): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:36 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:19 (2742): No heartbeat from core client for 30 sec - exiting 21:30:34 (2742): No heartbeat from core client for 30 sec - exiting 21:30:45 (2742): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:51 (2742): No heartbeat from core client for 30 sec - exiting 21:30:52 (2742): No heartbeat from core client for 30 sec - exiting 21:57:30 (2759): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:34 (2759): No heartbeat from core client for 30 sec - exiting 08:10:21 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:09 (4096): No heartbeat from core client for 30 sec - exiting 08:35:11 (4096): No heartbeat from core client for 30 sec - exiting 08:35:12 (4096): No heartbeat from core client for 30 sec - exiting 08:35:13 (4096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:14 (4096): No heartbeat from core client for 30 sec - exiting 08:51:51 (4357): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:05 (4431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:36:51 (5470): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:03 (5478): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:34 (5492): No heartbeat from core client for 30 sec - exiting 13:59:49 (5492): No heartbeat from core client for 30 sec - exiting 13:59:50 (5492): No heartbeat from core client for 30 sec - exiting 13:59:51 (5492): No heartbeat from core client for 30 sec - exiting 13:59:52 (5492): No heartbeat from core client for 30 sec - exiting 13:59:53 (5492): No heartbeat from core client for 30 sec - exiting 13:59:54 (5492): No heartbeat from core client for 30 sec - exiting 13:59:55 (5492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:56 (5492): No heartbeat from core client for 30 sec - exiting 13:59:57 (5492): No heartbeat from core client for 30 sec - exiting 14:04:18 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:26 (6066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:23 (6278): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:48 (6398): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:28 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:57:33 (6568): No heartbeat from core client for 30 sec - exiting 14:57:34 (6568): No heartbeat from core client for 30 sec - exiting 14:57:35 (6568): No heartbeat from core client for 30 sec - exiting 14:57:36 (6568): No heartbeat from core client for 30 sec - exiting 14:57:37 (6568): No heartbeat from core client for 30 sec - exiting 14:57:38 (6568): No heartbeat from core client for 30 sec - exiting 14:57:39 (6568): No heartbeat from core client for 30 sec - exiting 14:57:40 (6568): No heartbeat from core client for 30 sec - exiting 14:57:41 (6568): No heartbeat from core client for 30 sec - exiting 14:57:43 (6568): No heartbeat from core client for 30 sec - exiting 14:57:44 (6568): No heartbeat from core client for 30 sec - exiting 14:57:45 (6568): No heartbeat from core client for 30 sec - exiting 14:57:46 (6568): No heartbeat from core client for 30 sec - exiting 14:57:53 (6568): No heartbeat from core client for 30 sec - exiting 14:57:54 (6568): No heartbeat from core client for 30 sec - exiting 14:57:55 (6568): No heartbeat from core client for 30 sec - exiting 14:57:56 (6568): No heartbeat from core client for 30 sec - exiting 15:04:48 (6625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:04 (6649): No heartbeat from core client for 30 sec - exiting 15:11:35 (6649): No heartbeat from core client for 30 sec - exiting 15:11:36 (6649): No heartbeat from core client for 30 sec - exiting 15:11:37 (6649): No heartbeat from core client for 30 sec - exiting 15:11:38 (6649): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:39 (6649): No heartbeat from core client for 30 sec - exiting 15:15:50 (6697): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:15:53 (6697): No heartbeat from core client for 30 sec - exiting 15:15:54 (6697): No heartbeat from core client for 30 sec - exiting 15:15:55 (6697): No heartbeat from core client for 30 sec - exiting 15:15:56 (6697): No heartbeat from core client for 30 sec - exiting 15:15:57 (6697): No heartbeat from core client for 30 sec - exiting 15:15:59 (6697): No heartbeat from core client for 30 sec - exiting 15:16:00 (6697): No heartbeat from core client for 30 sec - exiting 15:16:01 (6697): No heartbeat from core client for 30 sec - exiting 15:16:08 (6697): No heartbeat from core client for 30 sec - exiting 15:16:09 (6697): No heartbeat from core client for 30 sec - exiting 15:16:10 (6697): No heartbeat from core client for 30 sec - exiting 15:16:11 (6697): No heartbeat from core client for 30 sec - exiting 15:16:12 (6697): No heartbeat from core client for 30 sec - exiting 15:16:14 (6697): No heartbeat from core client for 30 sec - exiting 15:16:15 (6697): No heartbeat from core client for 30 sec - exiting 15:16:16 (6697): No heartbeat from core client for 30 sec - exiting 15:21:29 (6746): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:22:53 (6746): No heartbeat from core client for 30 sec - exiting 15:22:54 (6746): No heartbeat from core client for 30 sec - exiting 15:24:00 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:25 (6801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:50:31 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:50:33 (7112): No heartbeat from core client for 30 sec - exiting 21:56:09 (7169): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:27 (7169): No heartbeat from core client for 30 sec - exiting 21:56:41 (7169): No heartbeat from core client for 30 sec - exiting 21:56:43 (7169): No heartbeat from core client for 30 sec - exiting 21:56:44 (7169): No heartbeat from core client for 30 sec - exiting 21:56:45 (7169): No heartbeat from core client for 30 sec - exiting 21:56:46 (7169): No heartbeat from core client for 30 sec - exiting 21:56:47 (7169): No heartbeat from core client for 30 sec - exiting 22:16:14 (7222): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:16 (7222): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:17:13 (7591): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:59 (8109): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:38 (8198): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:19:55 (8474): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:09 (8488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:37 (8505): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:25 (8571): No heartbeat from core client for 30 sec - exiting 21:25:26 (8571): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:30 (8571): No heartbeat from core client for 30 sec - exiting 21:25:31 (8571): No heartbeat from core client for 30 sec - exiting 21:25:32 (8571): No heartbeat from core client for 30 sec - exiting 21:25:33 (8571): No heartbeat from core client for 30 sec - exiting 21:25:34 (8571): No heartbeat from core client for 30 sec - exiting 21:25:35 (8571): No heartbeat from core client for 30 sec - exiting 21:28:37 (8634): No heartbeat from core client for 30 sec - exiting 21:29:29 (8634): No heartbeat from core client for 30 sec - exiting 21:29:44 (8634): No heartbeat from core client for 30 sec - exiting 21:29:45 (8634): No heartbeat from core client for 30 sec - exiting 21:29:46 (8634): No heartbeat from core client for 30 sec - exiting 21:29:47 (8634): No heartbeat from core client for 30 sec - exiting 21:29:48 (8634): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:02 (8634): No heartbeat from core client for 30 sec - exiting 21:30:03 (8634): No heartbeat from core client for 30 sec - exiting 21:30:04 (8634): No heartbeat from core client for 30 sec - exiting 21:30:05 (8634): No heartbeat from core client for 30 sec - exiting 21:30:07 (8634): No heartbeat from core client for 30 sec - exiting 21:30:08 (8634): No heartbeat from core client for 30 sec - exiting 21:30:09 (8634): No heartbeat from core client for 30 sec - exiting 21:30:10 (8634): No heartbeat from core client for 30 sec - exiting 21:30:11 (8634): No heartbeat from core client for 30 sec - exiting 21:30:13 (8634): No heartbeat from core client for 30 sec - exiting 21:30:14 (8634): No heartbeat from core client for 30 sec - exiting 21:30:15 (8634): No heartbeat from core client for 30 sec - exiting 21:30:16 (8634): No heartbeat from core client for 30 sec - exiting 21:30:17 (8634): No heartbeat from core client for 30 sec - exiting 21:30:18 (8634): No heartbeat from core client for 30 sec - exiting 21:35:19 (8680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:03 (8727): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:39:03 (8727): No heartbeat from core client for 30 sec - exiting 21:39:04 (8727): No heartbeat from core client for 30 sec - exiting 21:39:05 (8727): No heartbeat from core client for 30 sec - exiting 21:42:10 (8741): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:12 (8757): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:15 (8757): No heartbeat from core client for 30 sec - exiting 21:52:49 (8788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:04 (8799): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:09 (8810): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:26 (8822): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:52 (8833): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:44 (8845): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:27 (8859): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:12:11 (8870): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:16:35 (8882): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:47 (8898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:08 (8914): No heartbeat from core client for 30 sec - exiting 22:23:10 (8914): No heartbeat from core client for 30 sec - exiting 22:23:11 (8914): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:12 (8914): No heartbeat from core client for 30 sec - exiting 22:27:34 (8926): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:27:39 (8926): No heartbeat from core client for 30 sec - exiting 22:30:13 (8941): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:29 (8955): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:33 (9912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:37 (9912): No heartbeat from core client for 30 sec - exiting 16:32:03 (10075): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:32:06 (10075): No heartbeat from core client for 30 sec - exiting 21:07:25 (10104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:33 (10462): No heartbeat from core client for 30 sec - exiting 21:08:34 (10462): No heartbeat from core client for 30 sec - exiting 21:08:35 (10462): No heartbeat from core client for 30 sec - exiting 21:08:37 (10462): No heartbeat from core client for 30 sec - exiting 21:08:38 (10462): No heartbeat from core client for 30 sec - exiting 21:08:44 (10462): No heartbeat from core client for 30 sec - exiting 21:08:45 (10462): No heartbeat from core client for 30 sec - exiting 21:08:47 (10462): No heartbeat from core client for 30 sec - exiting 21:08:48 (10462): No heartbeat from core client for 30 sec - exiting 21:08:49 (10462): No heartbeat from core client for 30 sec - exiting 21:08:50 (10462): No heartbeat from core client for 30 sec - exiting 21:08:51 (10462): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:04 (10481): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:05 (10481): No heartbeat from core client for 30 sec - exiting 07:48:39 (10586): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:59 (10586): No heartbeat from core client for 30 sec - exiting 19:21:09 (11221): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:02 (11526): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:58 (11640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:00 (11640): No heartbeat from core client for 30 sec - exiting 21:13:58 (12032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:29 (12061): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:51:32 (1684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:18 (4146): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:12 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:32 (4199): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:14 (4219): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:33 (5157): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:17:59 (5986): No heartbeat from core client for 30 sec - exiting 23:18:03 (5986): No heartbeat from core client for 30 sec - exiting 23:18:04 (5986): No heartbeat from core client for 30 sec - exiting 23:18:05 (5986): No heartbeat from core client for 30 sec - exiting 23:18:06 (5986): No heartbeat from core client for 30 sec - exiting 23:18:07 (5986): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5986, iMonCtr=1 23:21:01 (5986): No heartbeat from core client for 30 sec - exiting 23:21:02 (5986): No heartbeat from core client for 30 sec - exiting 23:21:03 (5986): No heartbeat from core client for 30 sec - exiting 23:21:04 (5986): No heartbeat from core client for 30 sec - exiting 23:21:05 (5986):18:13:31 (1125): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:36 (1125): No heartbeat from core client for 30 sec - exiting 18:13:37 (1125): No heartbeat from core client for 30 sec - exiting 18:15:13 (2811): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:09 (1712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:40 (2050): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:02 (2657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:27 (2751): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0x9e3400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804cedf] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050a03] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x182bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Nov 2011 02:11:41	1153712	13347785	hadcm3n_o1zg_1940_40_007442993_0	51,840	309,056	5.9617
10 Oct 2011 09:04:39	1153712	13347785	hadcm3n_o1zg_1940_40_007442993_0	25,920	142,537	5.4991