Task 16068715

Name	hadcm3n_o2pe_2020_40_008408355_3
Workunit	8559211
Created	17 Oct 2013, 2:32:31 UTC
Sent	17 Oct 2013, 2:32:42 UTC
Report deadline	16 Jan 2014, 9:59:53 UTC
Received	16 Dec 2013, 18:00:31 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1064622
Run time	20 days 13 hours 38 min 24 sec
CPU time	20 days 13 hours 38 min 24 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> 10:53:04 (4200): No heartbeat from core client for 30 sec - exiting 10:53:05 (4200): No heartbeat from core client for 30 sec - exiting 10:53:06 (4200): No heartbeat from core client for 30 sec - exiting 10:53:07 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:08 (4200): No heartbeat from core client for 30 sec - exiting 21:49:01 (4944): No heartbeat from core client for 30 sec - exiting 21:49:02 (4944): No heartbeat from core client for 30 sec - exiting 21:49:03 (4944): No heartbeat from core client for 30 sec - exiting 21:49:04 (4944): No heartbeat from core client for 30 sec - exiting 21:49:05 (4944): No heartbeat from core client for 30 sec - exiting 21:49:06 (4944): No heartbeat from core client for 30 sec - exiting 21:49:07 (4944): No heartbeat from core client for 30 sec - exiting 21:49:08 (4944): No heartbeat from core client for 30 sec - exiting 21:49:09 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:21 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:47 (4200): No heartbeat from core client for 30 sec - exiting 21:04:48 (4200): No heartbeat from core client for 30 sec - exiting 21:04:49 (4200): No heartbeat from core client for 30 sec - exiting 21:04:50 (4200): No heartbeat from core client for 30 sec - exiting 21:04:51 (4200): No heartbeat from core client for 30 sec - exiting 21:04:52 (4200): No heartbeat from core client for 30 sec - exiting 21:04:53 (4200): No heartbeat from core client for 30 sec - exiting 21:04:54 (4200): No heartbeat from core client for 30 sec - exiting 21:04:55 (4200): No heartbeat from core client for 30 sec - exiting 21:04:56 (4200): No heartbeat from core client for 30 sec - exiting 21:04:57 (4200): No heartbeat from core client for 30 sec - exiting 21:04:58 (4200): No heartbeat from core client for 30 sec - exiting 21:04:59 (4200): No heartbeat from core client for 30 sec - exiting 21:05:00 (4200): No heartbeat from core client for 30 sec - exiting 21:05:01 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:16 (4812): No heartbeat from core client for 30 sec - exiting 10:13:17 (4812): No heartbeat from core client for 30 sec - exiting 10:13:18 (4812): No heartbeat from core client for 30 sec - exiting 10:13:19 (4812): No heartbeat from core client for 30 sec - exiting 10:13:20 (4812): No heartbeat from core client for 30 sec - exiting 10:13:21 (4812): No heartbeat from core client for 30 sec - exiting 10:13:22 (4812): No heartbeat from core client for 30 sec - exiting 10:13:23 (4812): No heartbeat from core client for 30 sec - exiting 10:13:24 (4812): No heartbeat from core client for 30 sec - exiting 10:13:25 (4812): No heartbeat from core client for 30 sec - exiting 10:13:26 (4812): No heartbeat from core client for 30 sec - exiting 10:13:27 (4812): No heartbeat from core client for 30 sec - exiting 10:13:28 (4812): No heartbeat from core client for 30 sec - exiting 10:13:29 (4812): No heartbeat from core client for 30 sec - exiting 10:13:30 (4812): No heartbeat from core client for 30 sec - exiting 10:13:31 (4812): No heartbeat from core client for 30 sec - exiting 10:13:32 (4812): No heartbeat from core client for 30 sec - exiting 10:13:33 (4812): No heartbeat from core client for 30 sec - exiting 10:13:34 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:04 (4808): No heartbeat from core client for 30 sec - exiting 10:05:05 (4808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:56:26 (1244): No heartbeat from core client for 30 sec - exiting 21:56:27 (1244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C09:23:23 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:10 (4468): No heartbeat from core client for 30 sec - exiting 09:14:11 (4468): No heartbeat from core client for 30 sec - exiting 09:14:12 (4468): No heartbeat from core client for 30 sec - exiting 09:14:13 (4468): No heartbeat from core client for 30 sec - exiting 09:14:14 (4468): No heartbeat from core client for 30 sec - exiting 09:14:15 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4020, iMonCtr=1 Model crash detected, will try to restart... 21:42:04 (4556): No heartbeat from core client for 30 sec - exiting 21:42:05 (4556): No heartbeat from core client for 30 sec - exiting 21:42:06 (4556): No heartbeat from core client for 30 sec - exiting 21:42:07 (4556): No heartbeat from core client for 30 sec - exiting 21:42:08 (4556): No heartbeat from core client for 30 sec - exiting 21:42:09 (4556): No heartbeat from core client for 30 sec - exiting 21:42:10 (4556): No heartbeat from core client for 30 sec - exiting 21:42:11 (4556): No heartbeat from core client for 30 sec - exiting 21:42:12 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:24 (4936): No heartbeat from core client for 30 sec - exiting 00:15:25 (4936): No heartbeat from core client for 30 sec - exiting 00:15:26 (4936): No heartbeat from core client for 30 sec - exiting 00:15:27 (4936): No heartbeat from core client for 30 sec - exiting 00:15:28 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:27:25 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:59 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:42:59 (4280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5276, iMonCtr=1 Model crash detected, will try to restart... 10:26:18 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:00 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:38 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o2peko.pjn3c10 Error converting file to netcdf: dataout/o2peko.pin3c10 Error converting file to netcdf: dataout/o2peko.pfn3c10 Error converting file to netcdf: dataout/o2peka.phn3c10 Error converting file to netcdf: dataout/o2peka.pgn3c10 Error converting file to netcdf: dataout/o2peka.pen3c10 Error converting file to netcdf: dataout/o2peka.pdn3c10 12:11:53 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:15 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:56 (4736): No heartbeat from core client for 30 sec - exiting 08:53:57 (4736): No heartbeat from core client for 30 sec - exiting 08:53:58 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:08 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:11 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:06:23 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:18:46 (2764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:35 (4496): No heartbeat from core client for 30 sec - exiting 21:15:36 (4496): No heartbeat from core client for 30 sec - exiting 21:15:37 (4496): No heartbeat from core client for 30 sec - exiting 21:15:38 (4496): No heartbeat from core client for 30 sec - exiting 21:15:39 (4496): No heartbeat from core client for 30 sec - exiting 21:15:40 (4496): No heartbeat from core client for 30 sec - exiting 21:15:41 (4496): No heartbeat from core client for 30 sec - exiting 21:15:42 (4496): No heartbeat from core client for 30 sec - exiting 21:15:43 (4496): No heartbeat from core client for 30 sec - exiting 21:15:44 (4496): No heartbeat from core client for 30 sec - exiting 21:15:45 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:30 (4708): No heartbeat from core client for 30 sec - exiting 11:04:31 (4708): No heartbeat from core client for 30 sec - exiting 11:04:32 (4708): No heartbeat from core client for 30 sec - exiting 11:04:33 (4708): No heartbeat from core client for 30 sec - exiting 11:04:34 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:39 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:08 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:19:45 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5144, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:14:03 (3984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... 10:56:15 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5676, iMonCtr=1 Model crash detected, will try to restart... 14:12:31 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:04:47 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5148, iMonCtr=1 Model crash detected, will try to restart... 09:02:42 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:43 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:27 (4500): No heartbeat from core client for 30 sec - exiting 11:08:28 (4500): No heartbeat from core client for 30 sec - exiting 11:08:29 (4500): No heartbeat from core client for 30 sec - exiting 11:08:30 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:25 (248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... C12:16:13 (4852): No heartbeat from core client for 30 sec - exiting 12:16:14 (4852): No heartbeat from core client for 30 sec - exiting 12:16:16 (4852): No heartbeat from core client for 30 sec - exiting 12:16:17 (4852): No heartbeat from core client for 30 sec - exiting 12:16:18 (4852): No heartbeat from core client for 30 sec - exiting 12:16:19 (4852): No heartbeat from core client for 30 sec - exiting 12:16:20 (4852): No heartbeat from core client for 30 sec - exiting 12:16:21 (4852): No heartbeat from core client for 30 sec - exiting 12:16:22 (4852): No heartbeat from core client for 30 sec - exiting 12:16:23 (4852): No heartbeat from core client for 30 sec - exiting 12:16:24 (4852): No heartbeat from core client for 30 sec - exiting 12:16:25 (4852): No heartbeat from core client for 30 sec - exiting 12:16:26 (4852): No heartbeat from core client for 30 sec - exiting 12:16:27 (4852): No heartbeat from core client for 30 sec - exiting 12:16:28 (4852): No heartbeat from core client for 30 sec - exiting 12:16:29 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:30 (4852): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=1 Model crash detected, will try to restart... 08:44:52 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:53 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:41 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Dec 2013 17:00:03	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	1,036,800	1,776,418	1.7134
15 Dec 2013 02:34:50	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	1,010,880	1,731,567	1.7129
14 Dec 2013 03:18:58	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	984,960	1,687,085	1.7128
12 Dec 2013 17:12:36	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	959,040	1,642,159	1.7123
11 Dec 2013 16:29:52	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	933,120	1,596,953	1.7114
10 Dec 2013 18:43:09	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	907,200	1,552,922	1.7118
09 Dec 2013 19:41:48	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	881,280	1,508,176	1.7113
08 Dec 2013 20:34:02	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	855,360	1,463,645	1.7111
07 Dec 2013 17:31:57	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	829,440	1,417,881	1.7094
06 Dec 2013 19:20:25	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	803,520	1,372,852	1.7085
05 Dec 2013 20:32:14	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	777,600	1,327,062	1.7066
04 Dec 2013 18:42:21	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	751,680	1,282,639	1.7064
03 Dec 2013 20:01:04	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	725,760	1,239,160	1.7074
02 Dec 2013 16:13:33	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	699,840	1,194,760	1.7072
01 Dec 2013 02:52:25	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	673,920	1,151,263	1.7083
29 Nov 2013 04:13:12	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	648,000	1,107,837	1.7096
28 Nov 2013 01:50:32	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	622,080	1,064,287	1.7109
27 Nov 2013 03:09:21	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	596,160	1,021,117	1.7128
25 Nov 2013 22:17:47	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	570,240	977,097	1.7135
24 Nov 2013 21:00:17	1064622	16068715	hadcm3n_o2pe_2020_40_008408355_3	544,320	932,947	1.7140