Task 16017385

Name	hadcm3n_800q_1980_40_008457965_2
Workunit	8608821
Created	15 Sep 2013, 6:45:33 UTC
Sent	15 Sep 2013, 7:21:38 UTC
Report deadline	15 Dec 2013, 14:48:49 UTC
Received	15 Oct 2013, 9:44:45 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1277596
Run time	25 days 10 hours 14 min 39 sec
CPU time	24 days 16 hours 16 min 9 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.32 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:57:58 (4404): No heartbeat from core client for 30 sec - exiting 14:57:59 (4404): No heartbeat from core client for 30 sec - exiting 14:58:00 (4404): No heartbeat from core client for 30 sec - exiting 14:58:01 (4404): No heartbeat from core client for 30 sec - exiting 14:58:02 (4404): No heartbeat from core client for 30 sec - exiting 14:58:03 (4404): No heartbeat from core client for 30 sec - exiting 14:58:04 (4404): No heartbeat from core client for 30 sec - exiting 14:58:05 (4404): No heartbeat from core client for 30 sec - exiting 14:58:06 (4404): No heartbeat from core client for 30 sec - exiting 14:58:08 (4404): No heartbeat from core client for 30 sec - exiting 14:58:09 (4404): No heartbeat from core client for 30 sec - exiting 14:58:10 (4404): No heartbeat from core client for 30 sec - exiting 14:58:11 (4404): No heartbeat from core client for 30 sec - exiting 14:58:12 (4404): No heartbeat from core client for 30 sec - exiting 14:58:13 (4404): No heartbeat from core client for 30 sec - exiting 14:58:14 (4404): No heartbeat from core client for 30 sec - exiting 14:58:15 (4404): No heartbeat from core client for 30 sec - exiting 14:58:16 (4404): No heartbeat from core client for 30 sec - exiting 14:58:17 (4404): No heartbeat from core client for 30 sec - exiting 14:58:18 (4404): No heartbeat from core client for 30 sec - exiting 14:58:20 (4404): No heartbeat from core client for 30 sec - exiting 14:58:21 (4404): No heartbeat from core client for 30 sec - exiting 14:58:22 (4404): No heartbeat from core client for 30 sec - exiting 14:58:23 (4404): No heartbeat from core client for 30 sec - exiting 14:58:24 (4404): No heartbeat from core client for 30 sec - exiting 14:58:25 (4404): No heartbeat from core client for 30 sec - exiting 14:58:26 (4404): No heartbeat from core client for 30 sec - exiting 14:58:27 (4404): No heartbeat from core client for 30 sec - exiting 14:58:28 (4404): No heartbeat from core client for 30 sec - exiting 14:58:29 (4404): No heartbeat from core client for 30 sec - exiting 14:58:30 (4404): No heartbeat from core client for 30 sec - exiting 14:58:32 (4404): No heartbeat from core client for 30 sec - exiting 14:58:33 (4404): No heartbeat from core client for 30 sec - exiting 14:58:34 (4404): No heartbeat from core client for 30 sec - exiting 14:58:35 (4404): No heartbeat from core client for 30 sec - exiting 14:58:36 (4404): No heartbeat from core client for 30 sec - exiting 14:58:37 (4404): No heartbeat from core client for 30 sec - exiting 14:58:38 (4404): No heartbeat from core client for 30 sec - exiting 14:58:39 (4404): No heartbeat from core client for 30 sec - exiting 14:58:40 (4404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2020, iMonCtr=1 Model crash detected, will try to restart... 02:53:05 (1968): No heartbeat from core client for 30 sec - exiting 02:53:07 (1968): No heartbeat from core client for 30 sec - exiting 02:53:08 (1968): No heartbeat from core client for 30 sec - exiting 02:53:09 (1968): No heartbeat from core client for 30 sec - exiting 02:53:10 (1968): No heartbeat from core client for 30 sec - exiting 02:53:11 (1968): No heartbeat from core client for 30 sec - exiting 02:53:12 (1968): No heartbeat from core client for 30 sec - exiting 02:53:13 (1968): No heartbeat from core client for 30 sec - exiting 02:53:14 (1968): No heartbeat from core client for 30 sec - exiting 02:53:15 (1968): No heartbeat from core client for 30 sec - exiting 02:53:16 (1968): No heartbeat from core client for 30 sec - exiting 02:53:17 (1968): No heartbeat from core client for 30 sec - exiting 02:53:18 (1968): No heartbeat from core client for 30 sec - exiting 02:53:19 (1968): No heartbeat from core client for 30 sec - exiting 02:53:20 (1968): No heartbeat from core client for 30 sec - exiting 02:53:21 (1968): No heartbeat from core client for 30 sec - exiting 02:53:22 (1968): No heartbeat from core client for 30 sec - exiting 02:53:23 (1968): No heartbeat from core client for 30 sec - exiting 02:53:25 (1968): No heartbeat from core client for 30 sec - exiting 02:53:26 (1968): No heartbeat from core client for 30 sec - exiting 02:53:27 (1968): No heartbeat from core client for 30 sec - exiting 02:53:28 (1968): No heartbeat from core client for 30 sec - exiting 02:53:29 (1968): No heartbeat from core client for 30 sec - exiting 02:53:30 (1968): No heartbeat from core client for 30 sec - exiting 02:53:31 (1968): No heartbeat from core client for 30 sec - exiting 02:53:32 (1968): No heartbeat from core client for 30 sec - exiting 02:53:33 (1968): No heartbeat from core client for 30 sec - exiting 02:53:34 (1968): No heartbeat from core client for 30 sec - exiting 02:53:36 (1968): No heartbeat from core client for 30 sec - exiting 02:53:37 (1968): No heartbeat from core client for 30 sec - exiting 02:53:38 (1968): No heartbeat from core client for 30 sec - exiting 02:53:39 (1968): No heartbeat from core client for 30 sec - exiting 02:53:40 (1968): No heartbeat from core client for 30 sec - exiting 02:53:41 (1968): No heartbeat from core client for 30 sec - exiting 02:53:42 (1968): No heartbeat from core client for 30 sec - exiting 02:53:43 (1968): No heartbeat from core client for 30 sec - exiting 02:53:44 (1968): No heartbeat from core client for 30 sec - exiting 02:53:45 (1968): No heartbeat from core client for 30 sec - exiting 02:53:46 (1968): No heartbeat from core client for 30 sec - exiting 02:53:48 (1968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3276, iMonCtr=1 Model crash detected, will try to restart... 03:01:33 (5008): No heartbeat from core client for 30 sec - exiting 03:01:35 (5008): No heartbeat from core client for 30 sec - exiting 03:01:36 (5008): No heartbeat from core client for 30 sec - exiting 03:01:37 (5008): No heartbeat from core client for 30 sec - exiting 03:01:38 (5008): No heartbeat from core client for 30 sec - exiting 03:01:39 (5008): No heartbeat from core client for 30 sec - exiting 03:01:40 (5008): No heartbeat from core client for 30 sec - exiting 03:01:41 (5008): No heartbeat from core client for 30 sec - exiting 03:01:43 (5008): No heartbeat from core client for 30 sec - exiting 03:01:44 (5008): No heartbeat from core client for 30 sec - exiting 03:01:45 (5008): No heartbeat from core client for 30 sec - exiting 03:01:46 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:01:47 (5008): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:18:47 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=1 Model crash detected, will try to restart... 12:47:12 (5420): No heartbeat from core client for 30 sec - exiting 12:47:13 (5420): No heartbeat from core client for 30 sec - exiting 12:47:14 (5420): No heartbeat from core client for 30 sec - exiting 12:47:15 (5420): No heartbeat from core client for 30 sec - exiting 12:47:17 (5420): No heartbeat from core client for 30 sec - exiting 12:47:18 (5420): No heartbeat from core client for 30 sec - exiting 12:47:19 (5420): No heartbeat from core client for 30 sec - exiting 12:47:20 (5420): No heartbeat from core client for 30 sec - exiting 12:47:21 (5420): No heartbeat from core client for 30 sec - exiting 12:47:22 (5420): No heartbeat from core client for 30 sec - exiting 12:47:23 (5420): No heartbeat from core client for 30 sec - exiting 12:47:24 (5420): No heartbeat from core client for 30 sec - exiting 12:47:25 (5420): No heartbeat from core client for 30 sec - exiting 12:47:26 (5420): No heartbeat from core client for 30 sec - exiting 12:47:27 (5420): No heartbeat from core client for 30 sec - exiting 12:47:29 (5420): No heartbeat from core client for 30 sec - exiting 12:47:30 (5420): No heartbeat from core client for 30 sec - exiting 12:47:31 (5420): No heartbeat from core client for 30 sec - exiting 12:47:32 (5420): No heartbeat from core client for 30 sec - exiting 12:47:33 (5420): No heartbeat from core client for 30 sec - exiting 12:47:34 (5420): No heartbeat from core client for 30 sec - exiting 12:47:35 (5420): No heartbeat from core client for 30 sec - exiting 12:47:36 (5420): No heartbeat from core client for 30 sec - exiting 12:47:37 (5420): No heartbeat from core client for 30 sec - exiting 12:47:38 (5420): No heartbeat from core client for 30 sec - exiting 12:47:39 (5420): No heartbeat from core client for 30 sec - exiting 12:47:41 (5420): No heartbeat from core client for 30 sec - exiting 12:47:42 (5420): No heartbeat from core client for 30 sec - exiting 12:47:43 (5420): No heartbeat from core client for 30 sec - exiting 12:47:44 (5420): No heartbeat from core client for 30 sec - exiting 12:47:45 (5420): No heartbeat from core client for 30 sec - exiting 12:47:46 (5420): No heartbeat from core client for 30 sec - exiting 12:47:47 (5420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:41 (2204): No heartbeat from core client for 30 sec - exiting 12:53:42 (2204): No heartbeat from core client for 30 sec - exiting 12:53:43 (2204): No heartbeat from core client for 30 sec - exiting 12:53:44 (2204): No heartbeat from core client for 30 sec - exiting 12:53:45 (2204): No heartbeat from core client for 30 sec - exiting 12:53:46 (2204): No heartbeat from core client for 30 sec - exiting 12:53:47 (2204): No heartbeat from core client for 30 sec - exiting 12:53:48 (2204): No heartbeat from core client for 30 sec - exiting 12:53:49 (2204): No heartbeat from core client for 30 sec - exiting 12:53:50 (2204): No heartbeat from core client for 30 sec - exiting 12:53:51 (2204): No heartbeat from core client for 30 sec - exiting 12:53:52 (2204): No heartbeat from core client for 30 sec - exiting 12:53:53 (2204): No heartbeat from core client for 30 sec - exiting 12:53:54 (2204): No heartbeat from core client for 30 sec - exiting 12:53:55 (2204): No heartbeat from core client for 30 sec - exiting 12:53:56 (2204): No heartbeat from core client for 30 sec - exiting 12:53:57 (2204): No heartbeat from core client for 30 sec - exiting 12:53:58 (2204): No heartbeat from core client for 30 sec - exiting 12:53:59 (2204): No heartbeat from core client for 30 sec - exiting 12:54:00 (2204): No heartbeat from core client for 30 sec - exiting 12:54:01 (2204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:55:41 (5104): No heartbeat from core client for 30 sec - exiting 17:55:42 (5104): No heartbeat from core client for 30 sec - exiting 17:55:44 (5104): No heartbeat from core client for 30 sec - exiting 17:55:45 (5104): No heartbeat from core client for 30 sec - exiting 17:55:46 (5104): No heartbeat from core client for 30 sec - exiting 17:55:47 (5104): No heartbeat from core client for 30 sec - exiting 17:55:48 (5104): No heartbeat from core client for 30 sec - exiting 17:55:49 (5104): No heartbeat from core client for 30 sec - exiting 17:55:50 (5104): No heartbeat from core client for 30 sec - exiting 17:55:51 (5104): No heartbeat from core client for 30 sec - exiting 17:55:52 (5104): No heartbeat from core client for 30 sec - exiting 17:55:53 (5104): No heartbeat from core client for 30 sec - exiting 17:55:54 (5104): No heartbeat from core client for 30 sec - exiting 17:55:56 (5104): No heartbeat from core client for 30 sec - exiting 17:55:57 (5104): No heartbeat from core client for 30 sec - exiting 17:55:58 (5104): No heartbeat from core client for 30 sec - exiting 17:55:59 (5104): No heartbeat from core client for 30 sec - exiting 17:56:00 (5104): No heartbeat from core client for 30 sec - exiting 17:56:01 (5104): No heartbeat from core client for 30 sec - exiting 17:56:02 (5104): No heartbeat from core client for 30 sec - exiting 17:56:03 (5104): No heartbeat from core client for 30 sec - exiting 17:56:04 (5104): No heartbeat from core client for 30 sec - exiting 17:56:05 (5104): No heartbeat from core client for 30 sec - exiting 17:56:07 (5104): No heartbeat from core client for 30 sec - exiting 17:56:08 (5104): No heartbeat from core client for 30 sec - exiting 17:56:09 (5104): No heartbeat from core client for 30 sec - exiting 17:56:10 (5104): No heartbeat from core client for 30 sec - exiting 17:56:11 (5104): No heartbeat from core client for 30 sec - exiting 17:56:12 (5104): No heartbeat from core client for 30 sec - exiting 17:56:13 (5104): No heartbeat from core client for 30 sec - exiting 17:56:14 (5104): No heartbeat from core client for 30 sec - exiting 17:56:15 (5104): No heartbeat from core client for 30 sec - exiting 17:56:16 (5104): No heartbeat from core client for 30 sec - exiting 17:56:17 (5104): No heartbeat from core client for 30 sec - exiting 17:56:19 (5104): No heartbeat from core client for 30 sec - exiting 17:56:20 (5104): No heartbeat from core client for 30 sec - exiting 17:56:21 (5104): No heartbeat from core client for 30 sec - exiting 17:56:22 (5104): No heartbeat from core client for 30 sec - exiting 17:56:23 (5104): No heartbeat from core client for 30 sec - exiting 17:56:24 (5104): No heartbeat from core client for 30 sec - exiting 17:56:25 (5104): No heartbeat from core client for 30 sec - exiting 17:56:26 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:16 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:13 (5380): No heartbeat from core client for 30 sec - exiting 12:28:15 (5380): No heartbeat from core client for 30 sec - exiting 12:28:16 (5380): No heartbeat from core client for 30 sec - exiting 12:28:17 (5380): No heartbeat from core client for 30 sec - exiting 12:28:18 (5380): No heartbeat from core client for 30 sec - exiting 12:28:19 (5380): No heartbeat from core client for 30 sec - exiting 12:28:20 (5380): No heartbeat from core client for 30 sec - exiting 12:28:22 (5380): No heartbeat from core client for 30 sec - exiting 12:28:23 (5380): No heartbeat from core client for 30 sec - exiting 12:28:24 (5380): No heartbeat from core client for 30 sec - exiting 12:28:25 (5380): No heartbeat from core client for 30 sec - exiting 12:28:26 (5380): No heartbeat from core client for 30 sec - exiting 12:28:27 (5380): No heartbeat from core client for 30 sec - exiting 12:28:28 (5380): No heartbeat from core client for 30 sec - exiting 12:28:29 (5380): No heartbeat from core client for 30 sec - exiting 12:28:30 (5380): No heartbeat from core client for 30 sec - exiting 12:28:31 (5380): No heartbeat from core client for 30 sec - exiting 12:28:32 (5380): No heartbeat from core client for 30 sec - exiting 12:28:34 (5380): No heartbeat from core client for 30 sec - exiting 12:28:35 (5380): No heartbeat from core client for 30 sec - exiting 12:28:36 (5380): No heartbeat from core client for 30 sec - exiting 12:28:37 (5380): No heartbeat from core client for 30 sec - exiting 12:28:38 (5380): No heartbeat from core client for 30 sec - exiting 12:28:39 (5380): No heartbeat from core client for 30 sec - exiting 12:28:40 (5380): No heartbeat from core client for 30 sec - exiting 12:28:41 (5380): No heartbeat from core client for 30 sec - exiting 12:28:42 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:43 (5380): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... 13:08:02 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:06 (5876): No heartbeat from core client for 30 sec - exiting 16:05:08 (5876): No heartbeat from core client for 30 sec - exiting 16:05:09 (5876): No heartbeat from core client for 30 sec - exiting 16:05:10 (5876): No heartbeat from core client for 30 sec - exiting 16:05:11 (5876): No heartbeat from core client for 30 sec - exiting 16:05:12 (5876): No heartbeat from core client for 30 sec - exiting 16:05:13 (5876): No heartbeat from core client for 30 sec - exiting 16:05:14 (5876): No heartbeat from core client for 30 sec - exiting 16:05:15 (5876): No heartbeat from core client for 30 sec - exiting 16:05:16 (5876): No heartbeat from core client for 30 sec - exiting 16:05:50 (5876): No heartbeat from core client for 30 sec - exiting 16:05:51 (5876): No heartbeat from core client for 30 sec - exiting 16:05:52 (5876): No heartbeat from core client for 30 sec - exiting 16:05:54 (5876): No heartbeat from core client for 30 sec - exiting 16:05:55 (5876): No heartbeat from core client for 30 sec - exiting 16:05:56 (5876): No heartbeat from core client for 30 sec - exiting 16:05:57 (5876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:15 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1112, iMonCtr=1 Model crash detected, will try to restart... 12:22:20 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:01:32 (3636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:01 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Oct 2013 01:21:58	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	1,036,800	2,131,387	2.0557
13 Oct 2013 04:47:57	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	1,010,880	2,079,123	2.0567
12 Oct 2013 13:45:20	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	984,960	2,027,605	2.0586
12 Oct 2013 01:51:37	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	959,040	1,974,827	2.0592
10 Oct 2013 21:29:15	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	933,120	1,924,452	2.0624
09 Oct 2013 03:15:26	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	907,200	1,874,071	2.0658
08 Oct 2013 12:44:25	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	881,280	1,822,846	2.0684
07 Oct 2013 21:37:00	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	855,360	1,770,703	2.0701
06 Oct 2013 21:57:48	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	829,440	1,718,182	2.0715
06 Oct 2013 07:03:56	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	803,520	1,665,425	2.0727
05 Oct 2013 15:54:33	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	777,600	1,611,736	2.0727
05 Oct 2013 00:40:22	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	751,680	1,557,646	2.0722
04 Oct 2013 08:46:21	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	725,760	1,503,083	2.0710
03 Oct 2013 17:22:20	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	699,840	1,449,197	2.0708
03 Oct 2013 00:42:27	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	673,920	1,394,745	2.0696
02 Oct 2013 07:33:45	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	648,000	1,341,854	2.0708
01 Oct 2013 17:00:36	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	622,080	1,290,607	2.0747
01 Oct 2013 02:12:51	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	596,160	1,238,160	2.0769
30 Sep 2013 10:36:03	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	570,240	1,183,963	2.0763
29 Sep 2013 18:53:56	1277596	16017385	hadcm3n_800q_1980_40_008457965_2	544,320	1,129,202	2.0745