Task 15999487

Name	hadcm3n_7wcy_1980_40_008453221_1
Workunit	8604077
Created	1 Sep 2013, 19:15:00 UTC
Sent	1 Sep 2013, 20:17:24 UTC
Report deadline	2 Dec 2013, 3:44:35 UTC
Received	16 Oct 2013, 23:18:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1290168
Run time	6 days 5 hours 9 min 50 sec
CPU time	5 days 20 hours 22 min 55 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:44:35 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:56:35 (152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:05:43 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:21 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=1 Model crash detected, will try to restart... 22:35:55 (4184): No heartbeat from core client for 30 sec - exiting 22:35:56 (4184): No heartbeat from core client for 30 sec - exiting 22:35:57 (4184): No heartbeat from core client for 30 sec - exiting 22:35:58 (4184): No heartbeat from core client for 30 sec - exiting 22:35:59 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:00 (4184): No heartbeat from core client for 30 sec - exiting 22:36:02 (4184): No heartbeat from core client for 30 sec - exiting 22:36:03 (4184): No heartbeat from core client for 30 sec - exiting 22:36:04 (4184): No heartbeat from core client for 30 sec - exiting 22:36:05 (4184): No heartbeat from core client for 30 sec - exiting 22:36:06 (4184): No heartbeat from core client for 30 sec - exiting 22:36:07 (4184): No heartbeat from core client for 30 sec - exiting 22:36:08 (4184): No heartbeat from core client for 30 sec - exiting 22:36:09 (4184): No heartbeat from core client for 30 sec - exiting 22:36:10 (4184): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:32:06 (956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:07 (956): No heartbeat from core client for 30 sec - exiting 06:32:08 (956): No heartbeat from core client for 30 sec - exiting 06:32:10 (956): No heartbeat from core client for 30 sec - exiting 06:32:11 (956): No heartbeat from core client for 30 sec - exiting 06:32:12 (956): No heartbeat from core client for 30 sec - exiting 06:32:13 (956): No heartbeat from core client for 30 sec - exiting 06:32:14 (956): No heartbeat from core client for 30 sec - exiting 06:32:15 (956): No heartbeat from core client for 30 sec - exiting 06:32:16 (956): No heartbeat from core client for 30 sec - exiting 06:32:17 (956): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:46:04 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:05 (4688): No heartbeat from core client for 30 sec - exiting 08:46:06 (4688): No heartbeat from core client for 30 sec - exiting 08:46:07 (4688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:13:49 (3260): No heartbeat from core client for 30 sec - exiting 18:13:50 (3260): No heartbeat from core client for 30 sec - exiting 18:13:51 (3260): No heartbeat from core client for 30 sec - exiting 18:13:52 (3260): No heartbeat from core client for 30 sec - exiting 18:13:53 (3260): No heartbeat from core client for 30 sec - exiting 18:13:54 (3260): No heartbeat from core client for 30 sec - exiting 18:13:55 (3260): No heartbeat from core client for 30 sec - exiting 18:13:56 (3260): No heartbeat from core client for 30 sec - exiting 18:13:57 (3260): No heartbeat from core client for 30 sec - exiting 18:13:59 (3260): No heartbeat from core client for 30 sec - exiting 18:14:00 (3260): No heartbeat from core client for 30 sec - exiting 18:14:01 (3260): No heartbeat from core client for 30 sec - exiting 18:14:02 (3260): No heartbeat from core client for 30 sec - exiting 18:14:03 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:04 (3260): No heartbeat from core client for 30 sec - exiting 18:14:05 (3260): No heartbeat from core client for 30 sec - exiting 18:14:06 (3260): No heartbeat from core client for 30 sec - exiting 18:14:07 (3260): No heartbeat from core client for 30 sec - exiting 18:14:08 (3260): No heartbeat from core client for 30 sec - exiting 18:14:09 (3260): No heartbeat from core client for 30 sec - exiting 18:14:11 (3260): No heartbeat from core client for 30 sec - exiting 18:14:12 (3260): No heartbeat from core client for 30 sec - exiting 18:14:13 (3260): No heartbeat from core client for 30 sec - exiting 18:14:14 (3260): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:46:02 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:03 (4168): No heartbeat from core client for 30 sec - exiting 06:46:04 (4168): No heartbeat from core client for 30 sec - exiting 06:46:05 (4168): No heartbeat from core client for 30 sec - exiting 06:46:06 (4168): No heartbeat from core client for 30 sec - exiting 06:46:07 (4168): No heartbeat from core client for 30 sec - exiting 06:46:09 (4168): No heartbeat from core client for 30 sec - exiting 06:46:10 (4168): No heartbeat from core client for 30 sec - exiting 06:46:11 (4168): No heartbeat from core client for 30 sec - exiting 06:46:12 (4168): No heartbeat from core client for 30 sec - exiting 06:46:13 (4168): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:29:46 (4032): No heartbeat from core client for 30 sec - exiting 16:29:47 (4032): No heartbeat from core client for 30 sec - exiting 16:29:48 (4032): No heartbeat from core client for 30 sec - exiting 16:29:49 (4032): No heartbeat from core client for 30 sec - exiting 16:29:50 (4032): No heartbeat from core client for 30 sec - exiting 16:29:51 (4032): No heartbeat from core client for 30 sec - exiting 16:29:52 (4032): No heartbeat from core client for 30 sec - exiting 16:29:53 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:54 (4032): No heartbeat from core client for 30 sec - exiting 16:29:55 (4032): No heartbeat from core client for 30 sec - exiting 16:29:56 (4032): No heartbeat from core client for 30 sec - exiting 16:29:58 (4032): No heartbeat from core client for 30 sec - exiting 16:29:59 (4032): No heartbeat from core client for 30 sec - exiting 16:30:00 (4032): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:09:11 (3512): No heartbeat from core client for 30 sec - exiting 21:09:13 (3512): No heartbeat from core client for 30 sec - exiting 21:09:14 (3512): No heartbeat from core client for 30 sec - exiting 21:09:15 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:04:18 (3912): No heartbeat from core client for 30 sec - exiting 07:04:19 (3912): No heartbeat from core client for 30 sec - exiting 07:04:21 (3912): No heartbeat from core client for 30 sec - exiting 07:04:22 (3912): No heartbeat from core client for 30 sec - exiting 07:04:23 (3912): No heartbeat from core client for 30 sec - exiting 07:04:24 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:26:43 (1708): No heartbeat from core client for 30 sec - exiting 14:26:44 (1708): No heartbeat from core client for 30 sec - exiting 14:26:45 (1708): No heartbeat from core client for 30 sec - exiting 14:26:46 (1708): No heartbeat from core client for 30 sec - exiting 14:26:48 (1708): No heartbeat from core client for 30 sec - exiting 14:26:49 (1708): No heartbeat from core client for 30 sec - exiting 14:26:50 (1708): No heartbeat from core client for 30 sec - exiting 14:26:51 (1708): No heartbeat from core client for 30 sec - exiting 14:26:52 (1708): No heartbeat from core client for 30 sec - exiting 14:26:53 (1708): No heartbeat from core client for 30 sec - exiting 14:26:54 (1708): No heartbeat from core client for 30 sec - exiting 14:26:55 (1708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:17:45 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:12:44 (676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:04:11 (4060): No heartbeat from core client for 30 sec - exiting 07:04:12 (4060): No heartbeat from core client for 30 sec - exiting 07:04:13 (4060): No heartbeat from core client for 30 sec - exiting 07:04:14 (4060): No heartbeat from core client for 30 sec - exiting 07:04:16 (4060): No heartbeat from core client for 30 sec - exiting 07:04:17 (4060): No heartbeat from core client for 30 sec - exiting 07:04:18 (4060): No heartbeat from core client for 30 sec - exiting 07:04:19 (4060): No heartbeat from core client for 30 sec - exiting 07:04:20 (4060): No heartbeat from core client for 30 sec - exiting 07:04:21 (4060): No heartbeat from core client for 30 sec - exiting 07:04:22 (4060): No heartbeat from core client for 30 sec - exiting 07:04:23 (4060): No heartbeat from core client for 30 sec - exiting 07:04:24 (4060): No heartbeat from core client for 30 sec - exiting 07:04:25 (4060): No heartbeat from core client for 30 sec - exiting 07:04:26 (4060): No heartbeat from core client for 30 sec - exiting 07:04:28 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:04:29 (4060): No heartbeat from core client for 30 sec - exiting 07:04:30 (4060): No heartbeat from core client for 30 sec - exiting 07:04:31 (4060): No heartbeat from core client for 30 sec - exiting 07:04:32 (4060): No heartbeat from core client for 30 sec - exiting 07:04:33 (4060): No heartbeat from core client for 30 sec - exiting 07:04:34 (4060): No heartbeat from core client for 30 sec - exiting 07:04:35 (4060): No heartbeat from core client for 30 sec - exiting 07:04:36 (4060): No heartbeat from core client for 30 sec - exiting 07:04:37 (4060): No heartbeat from core client for 30 sec - exiting 07:04:38 (4060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:27:46 (4824): No heartbeat from core client for 30 sec - exiting 14:27:47 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:24:42 (3244): No heartbeat from core client for 30 sec - exiting 21:24:43 (3244): No heartbeat from core client for 30 sec - exiting 21:24:44 (3244): No heartbeat from core client for 30 sec - exiting 21:24:45 (3244): No heartbeat from core client for 30 sec - exiting 21:24:46 (3244): No heartbeat from core client for 30 sec - exiting 21:24:47 (3244): No heartbeat from core client for 30 sec - exiting 21:24:48 (3244): No heartbeat from core client for 30 sec - exiting 21:24:49 (3244): No heartbeat from core client for 30 sec - exiting 21:24:50 (3244): No heartbeat from core client for 30 sec - exiting 21:24:52 (3244): No heartbeat from core client for 30 sec - exiting 21:24:53 (3244): No heartbeat from core client for 30 sec - exiting 21:24:54 (3244): No heartbeat from core client for 30 sec - exiting 21:24:55 (3244): No heartbeat from core client for 30 sec - exiting 21:24:56 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:57 (3244): No heartbeat from core client for 30 sec - exiting 21:24:58 (3244): No heartbeat from core client for 30 sec - exiting 21:24:59 (3244): No heartbeat from core client for 30 sec - exiting 21:25:00 (3244): No heartbeat from core client for 30 sec - exiting 21:25:01 (3244): No heartbeat from core client for 30 sec - exiting 21:25:02 (3244): No heartbeat from core client for 30 sec - exiting 21:25:04 (3244): No heartbeat from core client for 30 sec - exiting 21:25:05 (3244): No heartbeat from core client for 30 sec - exiting 21:25:06 (3244): No heartbeat from core client for 30 sec - exiting 21:25:07 (3244): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 15:30:41 (3700): No heartbeat from core client for 30 sec - exiting 15:30:42 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:10:20 (4012): No heartbeat from core client for 30 sec - exiting 07:10:22 (4012): No heartbeat from core client for 30 sec - exiting 07:10:23 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:24 (4012): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:30:57 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:02:53 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:03:58 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:59 (3828): No heartbeat from core client for 30 sec - exiting 18:04:00 (3828): No heartbeat from core client for 30 sec - exiting 18:04:01 (3828): No heartbeat from core client for 30 sec - exiting 18:04:02 (3828): No heartbeat from core client for 30 sec - exiting 18:04:03 (3828): No heartbeat from core client for 30 sec - exiting 18:04:05 (3828): No heartbeat from core client for 30 sec - exiting 18:04:06 (3828): No heartbeat from core client for 30 sec - exiting 18:04:07 (3828): No heartbeat from core client for 30 sec - exiting 18:04:08 (3828): No heartbeat from core client for 30 sec - exiting 18:04:09 (3828): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:13:41 (3764): No heartbeat from core client for 30 sec - exiting 06:13:42 (3764): No heartbeat from core client for 30 sec - exiting 06:13:43 (3764): No heartbeat from core client for 30 sec - exiting 06:13:44 (3764): No heartbeat from core client for 30 sec - exiting 06:13:45 (3764): No heartbeat from core client for 30 sec - exiting 06:13:46 (3764): No heartbeat from core client for 30 sec - exiting 06:13:48 (3764): No heartbeat from core client for 30 sec - exiting 06:13:49 (3764): No heartbeat from core client for 30 sec - exiting 06:13:50 (3764): No heartbeat from core client for 30 sec - exiting 06:13:51 (3764): No heartbeat from core client for 30 sec - exiting 06:13:52 (3764): No heartbeat from core client for 30 sec - exiting 06:13:53 (3764): No heartbeat from core client for 30 sec - exiting 06:13:54 (3764): No heartbeat from core client for 30 sec - exiting 06:13:55 (3764): No heartbeat from core client for 30 sec - exiting 06:13:56 (3764): No heartbeat from core client for 30 sec - exiting 06:13:57 (3764): No heartbeat from core client for 30 sec - exiting 06:13:58 (3764): No heartbeat from core client for 30 sec - exiting 06:14:00 (3764): No heartbeat from core client for 30 sec - exiting 06:14:01 (3764): No heartbeat from core client for 30 sec - exiting 06:14:02 (3764): No heartbeat from core client for 30 sec - exiting 06:14:03 (3764): No heartbeat from core client for 30 sec - exiting 06:14:04 (3764): No heartbeat from core client for 30 sec - exiting 06:14:05 (3764): No heartbeat from core client for 30 sec - exiting 06:14:06 (3764): No heartbeat from core client for 30 sec - exiting 06:14:07 (3764): No heartbeat from core client for 30 sec - exiting 06:14:08 (3764): No heartbeat from core client for 30 sec - exiting 06:14:09 (3764): No heartbeat from core client for 30 sec - exiting 06:14:10 (3764): No heartbeat from core client for 30 sec - exiting 06:14:12 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:13 (3764): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:34:03 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:15:28 (516): No heartbeat from core client for 30 sec - exiting 06:15:29 (516): No heartbeat from core client for 30 sec - exiting 06:15:31 (516): No heartbeat from core client for 30 sec - exiting 06:15:32 (516): No heartbeat from core client for 30 sec - exiting 06:15:33 (516): No heartbeat from core client for 30 sec - exiting 06:15:34 (516): No heartbeat from core client for 30 sec - exiting 06:15:35 (516): No heartbeat from core client for 30 sec - exiting 06:15:36 (516): No heartbeat from core client for 30 sec - exiting 06:15:37 (516): No heartbeat from core client for 30 sec - exiting 06:15:38 (516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:34:33 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:52:38 (4028): No heartbeat from core client for 30 sec - exiting 04:52:39 (4028): No heartbeat from core client for 30 sec - exiting 04:52:40 (4028): No heartbeat from core client for 30 sec - exiting 04:52:41 (4028): No heartbeat from core client for 30 sec - exiting 04:52:42 (4028): No heartbeat from core client for 30 sec - exiting 04:52:43 (4028): No heartbeat from core client for 30 sec - exiting 04:52:45 (4028): No heartbeat from core client for 30 sec - exiting 04:52:46 (4028): No heartbeat from core client for 30 sec - exiting 04:52:47 (4028): No heartbeat from core client for 30 sec - exiting 04:52:48 (4028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:49 (4028): No heartbeat from core client for 30 sec - exiting 04:52:50 (4028): No heartbeat from core client for 30 sec - exiting 04:52:51 (4028): No heartbeat from core client for 30 sec - exiting 04:52:52 (4028): No heartbeat from core client for 30 sec - exiting 04:52:53 (4028): No heartbeat from core client for 30 sec - exiting 04:52:54 (4028): No heartbeat from core client for 30 sec - exiting 04:52:55 (4028): No heartbeat from core client for 30 sec - exiting 04:52:57 (4028): No heartbeat from core client for 30 sec - exiting 04:52:58 (4028): No heartbeat from core client for 30 sec - exiting 04:52:59 (4028): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:34:24 (4072): No heartbeat from core client for 30 sec - exiting 12:34:25 (4072): No heartbeat from core client for 30 sec - exiting 12:34:26 (4072): No heartbeat from core client for 30 sec - exiting 12:34:27 (4072): No heartbeat from core client for 30 sec - exiting 12:34:28 (4072): No heartbeat from core client for 30 sec - exiting 12:34:29 (4072): No heartbeat from core client for 30 sec - exiting 12:34:30 (4072): No heartbeat from core client for 30 sec - exiting 12:34:31 (4072): No heartbeat from core client for 30 sec - exiting 12:34:32 (4072): No heartbeat from core client for 30 sec - exiting 12:34:33 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3964, iMonCtr=1 Model crash detected, will try to restart... 19:33:18 (2992): No heartbeat from core client for 30 sec - exiting 19:33:19 (2992): No heartbeat from core client for 30 sec - exiting 19:33:20 (2992): No heartbeat from core client for 30 sec - exiting 19:33:21 (2992): No heartbeat from core client for 30 sec - exiting 19:33:22 (2992): No heartbeat from core client for 30 sec - exiting 19:33:23 (2992): No heartbeat from core client for 30 sec - exiting 19:33:24 (2992): No heartbeat from core client for 30 sec - exiting 19:33:26 (2992): No heartbeat from core client for 30 sec - exiting 19:33:27 (2992): No heartbeat from core client for 30 sec - exiting 19:33:28 (2992): No heartbeat from core client for 30 sec - exiting 19:33:29 (2992): No heartbeat from core client for 30 sec - exiting 19:33:30 (2992): No heartbeat from core client for 30 sec - exiting 19:33:31 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:32 (2992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:04:11 (3728): No heartbeat from core client for 30 sec - exiting 19:04:13 (3728): No heartbeat from core client for 30 sec - exiting 19:04:14 (3728): No heartbeat from core client for 30 sec - exiting 19:04:15 (3728): No heartbeat from core client for 30 sec - exiting 19:04:16 (3728): No heartbeat from core client for 30 sec - exiting 19:04:17 (3728): No heartbeat from core client for 30 sec - exiting 19:04:18 (3728): No heartbeat from core client for 30 sec - exiting 19:04:19 (3728): No heartbeat from core client for 30 sec - exiting 19:04:20 (3728): No heartbeat from core client for 30 sec - exiting 19:04:21 (3728): No heartbeat from core client for 30 sec - exiting 19:04:22 (3728): No heartbeat from core client for 30 sec - exiting 19:04:23 (3728): No heartbeat from core client for 30 sec - exiting 19:04:25 (3728): No heartbeat from core client for 30 sec - exiting 19:04:26 (3728): No heartbeat from core client for 30 sec - exiting 19:04:27 (3728): No heartbeat from core client for 30 sec - exiting 19:04:28 (3728): No heartbeat from core client for 30 sec - exiting 19:04:29 (3728): No heartbeat from core client for 30 sec - exiting 19:04:30 (3728): No heartbeat from core client for 30 sec - exiting 19:04:31 (3728): No heartbeat from core client for 30 sec - exiting 19:04:32 (3728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=424, iMonCtr=1 Model crash detected, will try to restart... 07:54:23 (3904): No heartbeat from core client for 30 sec - exiting 07:54:24 (3904): No heartbeat from core client for 30 sec - exiting 07:54:25 (3904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:26 (3904): No heartbeat from core client for 30 sec - exiting 07:54:27 (3904): No heartbeat from core client for 30 sec - exiting 07:54:29 (3904): No heartbeat from core client for 30 sec - exiting 07:54:30 (3904): No heartbeat from core client for 30 sec - exiting 07:54:31 (3904): No heartbeat from core client for 30 sec - exiting 07:54:32 (3904): No heartbeat from core client for 30 sec - exiting 07:54:33 (3904): No heartbeat from core client for 30 sec - exiting 07:54:34 (3904): No heartbeat from core client for 30 sec - exiting 07:54:35 (3904): No heartbeat from core client for 30 sec - exiting 07:54:36 (3904): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:18:50 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:24:41 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:27:21 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:00 (4060): No heartbeat from core client for 30 sec - exiting 17:54:01 (4060): No heartbeat from core client for 30 sec - exiting 17:54:02 (4060): No heartbeat from core client for 30 sec - exiting 17:54:03 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:31:21 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:42:14 (3972): No heartbeat from core client for 30 sec - exiting 20:42:15 (3972): No heartbeat from core client for 30 sec - exiting 20:42:16 (3972): No heartbeat from core client for 30 sec - exiting 20:42:18 (3972): No heartbeat from core client for 30 sec - exiting 20:42:19 (3972): No heartbeat from core client for 30 sec - exiting 20:42:20 (3972): No heartbeat from core client for 30 sec - exiting 20:42:21 (3972): No heartbeat from core client for 30 sec - exiting 20:42:22 (3972): No heartbeat from core client for 30 sec - exiting 20:42:23 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:34:01 (3096): No heartbeat from core client for 30 sec - exiting 07:34:02 (3096): No heartbeat from core client for 30 sec - exiting 07:34:03 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:34:04 (3096): No heartbeat from core client for 30 sec - exiting 07:34:05 (3096): No heartbeat from core client for 30 sec - exiting 07:34:06 (3096): No heartbeat from core client for 30 sec - exiting 07:34:07 (3096): No heartbeat from core client for 30 sec - exiting 07:34:09 (3096): No heartbeat from core client for 30 sec - exiting 07:34:10 (3096): No heartbeat from core client for 30 sec - exiting 07:34:11 (3096): No heartbeat from core client for 30 sec - exiting 07:34:12 (3096): No heartbeat from core client for 30 sec - exiting 07:34:13 (3096): No heartbeat from core client for 30 sec - exiting 07:34:14 (3096): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:06:39 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:07:04 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:05 (4300): No heartbeat from core client for 30 sec - exiting 07:07:06 (4300): No heartbeat from core client for 30 sec - exiting 07:07:07 (4300): No heartbeat from core client for 30 sec - exiting 07:07:08 (4300): No heartbeat from core client for 30 sec - exiting 07:07:09 (4300): No heartbeat from core client for 30 sec - exiting 07:07:11 (4300): No heartbeat from core client for 30 sec - exiting 07:07:12 (4300): No heartbeat from core client for 30 sec - exiting 07:07:13 (4300): No heartbeat from core client for 30 sec - exiting 07:07:14 (4300): No heartbeat from core client for 30 sec - exiting 07:07:15 (4300): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:53:40 (1936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:58:46 (4104): No heartbeat from core client for 30 sec - exiting 08:58:47 (4104): No heartbeat from core client for 30 sec - exiting 08:58:48 (4104): No heartbeat from core client for 30 sec - exiting 08:58:49 (4104): No heartbeat from core client for 30 sec - exiting 08:58:50 (4104): No heartbeat from core client for 30 sec - exiting 08:58:52 (4104): No heartbeat from core client for 30 sec - exiting 08:58:53 (4104): No heartbeat from core client for 30 sec - exiting 08:58:54 (4104): No heartbeat from core client for 30 sec - exiting 08:58:55 (4104): No heartbeat from core client for 30 sec - exiting 08:58:56 (4104): No heartbeat from core client for 30 sec - exiting 08:58:57 (4104): No heartbeat from core client for 30 sec - exiting 08:58:58 (4104): No heartbeat from core client for 30 sec - exiting 08:58:59 (4104): No heartbeat from core client for 30 sec - exiting 08:59:00 (4104): No heartbeat from core client for 30 sec - exiting 08:59:01 (4104): No heartbeat from core client for 30 sec - exiting 08:59:02 (4104): No heartbeat from core client for 30 sec - exiting 08:59:04 (4104): No heartbeat from core client for 30 sec - exiting 08:59:05 (4104): No heartbeat from core client for 30 sec - exiting 08:59:06 (4104): No heartbeat from core client for 30 sec - exiting 08:59:07 (4104): No heartbeat from core client for 30 sec - exiting 08:59:08 (4104): No heartbeat from core client for 30 sec - exiting 08:59:09 (4104): No heartbeat from core client for 30 sec - exiting 08:59:10 (4104): No heartbeat from core client for 30 sec - exiting 08:59:11 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2096, iMonCtr=1 Model crash detected, will try to restart... 14:47:02 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:30:53 (4460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:54 (4460): No heartbeat from core client for 30 sec - exiting 19:30:55 (4460): No heartbeat from core client for 30 sec - exiting 19:30:57 (4460): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 05:40:50 (4596): No heartbeat from core client for 30 sec - exiting 05:40:51 (4596): No heartbeat from core client for 30 sec - exiting 05:40:52 (4596): No heartbeat from core client for 30 sec - exiting 05:40:53 (4596): No heartbeat from core client for 30 sec - exiting 05:40:54 (4596): No heartbeat from core client for 30 sec - exiting 05:40:55 (4596): No heartbeat from core client for 30 sec - exiting 05:40:56 (4596): No heartbeat from core client for 30 sec - exiting 05:40:58 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:59 (4596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:41:59 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:56:58 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77023AC3 read attempt to address 0x409DF420 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77103AC3 read attempt to address 0x409DF420 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_7wcy_1980_40_008453221/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Oct 2013 18:36:31	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	259,200	494,639	1.9083
08 Oct 2013 20:06:26	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	233,280	446,401	1.9136
06 Oct 2013 07:29:08	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	207,360	397,322	1.9161
05 Oct 2013 17:01:05	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	181,440	347,379	1.9146
30 Sep 2013 17:32:49	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	155,520	299,939	1.9286
28 Sep 2013 17:07:35	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	129,600	248,678	1.9188
25 Sep 2013 09:22:27	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	103,680	197,948	1.9092
21 Sep 2013 05:39:35	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	77,760	149,934	1.9282
17 Sep 2013 07:37:41	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	51,840	100,565	1.9399
14 Sep 2013 20:10:54	1290168	15999487	hadcm3n_7wcy_1980_40_008453221_1	25,920	50,743	1.9577