Task 16653032

Name	hadam3p_eu_r53q_2013_1_008751500_0
Workunit	8897478
Created	29 May 2014, 15:58:21 UTC
Sent	30 May 2014, 2:20:32 UTC
Report deadline	12 May 2015, 7:40:32 UTC
Received	6 Dec 2014, 1:08:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1095039
Run time	9 days 0 hours 23 min 16 sec
CPU time	6 days 6 hours 45 min 12 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	0.90 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... 20:28:40 (3220): No heartbeat from core client for 30 sec - exiting 20:28:41 (3220): No heartbeat from core client for 30 sec - exiting 20:28:42 (3220): No heartbeat from core client for 30 sec - exiting 20:28:43 (3220): No heartbeat from core client for 30 sec - exiting 20:28:44 (3220): No heartbeat from core client for 30 sec - exiting 20:28:45 (3220): No heartbeat from core client for 30 sec - exiting 20:28:46 (3220): No heartbeat from core client for 30 sec - exiting 20:28:48 (3220): No heartbeat from core client for 30 sec - exiting 20:28:49 (3220): No heartbeat from core client for 30 sec - exiting 20:28:50 (3220): No heartbeat from core client for 30 sec - exiting 20:28:51 (3220): No heartbeat from core client for 30 sec - exiting 20:28:52 (3220): No heartbeat from core client for 30 sec - exiting 20:28:53 (3220): No heartbeat from core client for 30 sec - exiting 20:28:54 (3220): No heartbeat from core client for 30 sec - exiting 20:29:40 (3220): No heartbeat from core client for 30 sec - exiting 20:29:41 (3220): No heartbeat from core client for 30 sec - exiting 20:29:42 (3220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:15:07 (4776): No heartbeat from core client for 30 sec - exiting 20:15:08 (4776): No heartbeat from core client for 30 sec - exiting 20:15:09 (4776): No heartbeat from core client for 30 sec - exiting 20:15:10 (4776): No heartbeat from core client for 30 sec - exiting 20:15:11 (4776): No heartbeat from core client for 30 sec - exiting 20:15:12 (4776): No heartbeat from core client for 30 sec - exiting 20:15:13 (4776): No heartbeat from core client for 30 sec - exiting 20:15:14 (4776): No heartbeat from core client for 30 sec - exiting 20:15:15 (4776): No heartbeat from core client for 30 sec - exiting 20:15:16 (4776): No heartbeat from core client for 30 sec - exiting 20:15:17 (4776): No heartbeat from core client for 30 sec - exiting 20:15:18 (4776): No heartbeat from core client for 30 sec - exiting 20:15:19 (4776): No heartbeat from core client for 30 sec - exiting 20:15:20 (4776): No heartbeat from core client for 30 sec - exiting 20:15:21 (4776): No heartbeat from core client for 30 sec - exiting 20:15:22 (4776): No heartbeat from core client for 30 sec - exiting 20:16:05 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:06 (4776): No heartbeat from core client for 30 sec - exiting 20:16:07 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1020, selfPID=1020, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:25:59 (1392): No heartbeat from core client for 30 sec - exiting 21:26:00 (1392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4176, selfPID=4176, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:34 (5808): No heartbeat from core client for 30 sec - exiting 08:15:35 (5808): No heartbeat from core client for 30 sec - exiting 08:15:36 (5808): No heartbeat from core client for 30 sec - exiting 08:15:37 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:49:21 (5368): No heartbeat from core client for 30 sec - exiting 05:49:22 (5368): No heartbeat from core client for 30 sec - exiting 05:49:23 (5368): No heartbeat from core client for 30 sec - exiting 05:49:25 (5368): No heartbeat from core client for 30 sec - exiting 05:49:26 (5368): No heartbeat from core client for 30 sec - exiting 05:49:27 (5368): No heartbeat from core client for 30 sec - exiting 05:49:28 (5368): No heartbeat from core client for 30 sec - exiting 05:49:29 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4348, selfPID=4348, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:47:42 (1520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8184, selfPID=8184, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:20:23 (7352): No heartbeat from core client for 30 sec - exiting 07:20:24 (7352): No heartbeat from core client for 30 sec - exiting 07:20:25 (7352): No heartbeat from core client for 30 sec - exiting 07:20:26 (7352): No heartbeat from core client for 30 sec - exiting 07:20:27 (7352): No heartbeat from core client for 30 sec - exiting 07:20:28 (7352): No heartbeat from core client for 30 sec - exiting 07:20:29 (7352): No heartbeat from core client for 30 sec - exiting 07:20:30 (7352): No heartbeat from core client for 30 sec - exiting 07:20:31 (7352): No heartbeat from core client for 30 sec - exiting 07:20:32 (7352): No heartbeat from core client for 30 sec - exiting 07:20:33 (7352): No heartbeat from core client for 30 sec - exiting 07:20:34 (7352): No heartbeat from core client for 30 sec - exiting 07:20:35 (7352): No heartbeat from core client for 30 sec - exiting 07:20:36 (7352): No heartbeat from core client for 30 sec - exiting 07:20:37 (7352): No heartbeat from core client for 30 sec - exiting 07:20:38 (7352): No heartbeat from core client for 30 sec - exiting 07:20:39 (7352): No heartbeat from core client for 30 sec - exiting 07:20:40 (7352): No heartbeat from core client for 30 sec - exiting 07:20:41 (7352): No heartbeat from core client for 30 sec - exiting 07:20:42 (7352): No heartbeat from core client for 30 sec - exiting 07:20:43 (7352): No heartbeat from core client for 30 sec - exiting 07:20:44 (7352): No heartbeat from core client for 30 sec - exiting 07:20:45 (7352): No heartbeat from core client for 30 sec - exiting 07:20:46 (7352): No heartbeat from core client for 30 sec - exiting 07:20:47 (7352): No heartbeat from core client for 30 sec - exiting 07:20:48 (7352): No heartbeat from core client for 30 sec - exiting 07:20:49 (7352): No heartbeat from core client for 30 sec - exiting 07:20:51 (7352): No heartbeat from core client for 30 sec - exiting 07:20:52 (7352): No heartbeat from core client for 30 sec - exiting 07:20:53 (7352): No heartbeat from core client for 30 sec - exiting 07:20:54 (7352): No heartbeat from core client for 30 sec - exiting 07:20:55 (7352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:57:18 (5808): No heartbeat from core client for 30 sec - exiting 07:57:19 (5808): No heartbeat from core client for 30 sec - exiting 07:57:20 (5808): No heartbeat from core client for 30 sec - exiting 07:57:21 (5808): No heartbeat from core client for 30 sec - exiting 07:57:22 (5808): No heartbeat from core client for 30 sec - exiting 07:57:23 (5808): No heartbeat from core client for 30 sec - exiting 07:57:24 (5808): No heartbeat from core client for 30 sec - exiting 07:57:25 (5808): No heartbeat from core client for 30 sec - exiting 07:57:26 (5808): No heartbeat from core client for 30 sec - exiting 07:57:27 (5808): No heartbeat from core client for 30 sec - exiting 07:57:29 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4240, selfPID=4240, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4240, selfPID=2208, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3208, selfPID=3208, iMonCtr=2 07:56:46 (5164): No heartbeat from core client for 30 sec - exiting 07:56:47 (5164): No heartbeat from core client for 30 sec - exiting 07:56:48 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:55 (5188): No heartbeat from core client for 30 sec - exiting 17:19:56 (5188): No heartbeat from core client for 30 sec - exiting 17:19:57 (5188): No heartbeat from core client for 30 sec - exiting 17:19:59 (5188): No heartbeat from core client for 30 sec - exiting 17:20:00 (5188): No heartbeat from core client for 30 sec - exiting 17:20:01 (5188): No heartbeat from core client for 30 sec - exiting 17:20:02 (5188): No heartbeat from core client for 30 sec - exiting 17:20:03 (5188): No heartbeat from core client for 30 sec - exiting 17:20:04 (5188): No heartbeat from core client for 30 sec - exiting 17:20:05 (5188): No heartbeat from core client for 30 sec - exiting 17:20:06 (5188): No heartbeat from core client for 30 sec - exiting 17:20:07 (5188): No heartbeat from core client for 30 sec - exiting 17:20:08 (5188): No heartbeat from core client for 30 sec - exiting 17:20:09 (5188): No heartbeat from core client for 30 sec - exiting 17:20:10 (5188): No heartbeat from core client for 30 sec - exiting 17:20:11 (5188): No heartbeat from core client for 30 sec - exiting 17:20:12 (5188): No heartbeat from core client for 30 sec - exiting 17:20:13 (5188): No heartbeat from core client for 30 sec - exiting 17:20:14 (5188): No heartbeat from core client for 30 sec - exiting 17:20:15 (5188): No heartbeat from core client for 30 sec - exiting 17:20:16 (5188): No heartbeat from core client for 30 sec - exiting 17:20:17 (5188): No heartbeat from core client for 30 sec - exiting 17:20:18 (5188): No heartbeat from core client for 30 sec - exiting 17:20:19 (5188): No heartbeat from core client for 30 sec - exiting 17:20:20 (5188): No heartbeat from core client for 30 sec - exiting 17:20:21 (5188): No heartbeat from core client for 30 sec - exiting 17:20:22 (5188): No heartbeat from core client for 30 sec - exiting 17:20:23 (5188): No heartbeat from core client for 30 sec - exiting 17:20:24 (5188): No heartbeat from core client for 30 sec - exiting 17:20:25 (5188): No heartbeat from core client for 30 sec - exiting 17:20:26 (5188): No heartbeat from core client for 30 sec - exiting 17:20:27 (5188): No heartbeat from core client for 30 sec - exiting 17:20:28 (5188): No heartbeat from core client for 30 sec - exiting 17:20:30 (5188): No heartbeat from core client for 30 sec - exiting 17:20:31 (5188): No heartbeat from core client for 30 sec - exiting 17:20:32 (5188): No heartbeat from core client for 30 sec - exiting 17:20:33 (5188): No heartbeat from core client for 30 sec - exiting 17:20:34 (5188): No heartbeat from core client for 30 sec - exiting 17:20:35 (5188): No heartbeat from core client for 30 sec - exiting 17:20:36 (5188): No heartbeat from core client for 30 sec - exiting 17:20:37 (5188): No heartbeat from core client for 30 sec - exiting 17:20:38 (5188): No heartbeat from core client for 30 sec - exiting 17:20:39 (5188): No heartbeat from core client for 30 sec - exiting 17:20:40 (5188): No heartbeat from core client for 30 sec - exiting 17:20:41 (5188): No heartbeat from core client for 30 sec - exiting 17:20:42 (5188): No heartbeat from core client for 30 sec - exiting 17:20:43 (5188): No heartbeat from core client for 30 sec - exiting 17:21:56 (5188): No heartbeat from core client for 30 sec - exiting 17:21:57 (5188): No heartbeat from core client for 30 sec - exiting 17:21:58 (5188): No heartbeat from core client for 30 sec - exiting 17:21:59 (5188): No heartbeat from core client for 30 sec - exiting 17:22:00 (5188): No heartbeat from core client for 30 sec - exiting 17:22:01 (5188): No heartbeat from core client for 30 sec - exiting 17:22:02 (5188): No heartbeat from core client for 30 sec - exiting 17:22:03 (5188): No heartbeat from core client for 30 sec - exiting 17:22:04 (5188): No heartbeat from core client for 30 sec - exiting 17:22:05 (5188): No heartbeat from core client for 30 sec - exiting 17:22:06 (5188): No heartbeat from core client for 30 sec - exiting 17:22:07 (5188): No heartbeat from core client for 30 sec - exiting 17:22:08 (5188): No heartbeat from core client for 30 sec - exiting 17:22:09 (5188): No heartbeat from core client for 30 sec - exiting 17:22:10 (5188): No heartbeat from core client for 30 sec - exiting 17:22:11 (5188): No heartbeat from core client for 30 sec - exiting 17:22:12 (5188): No heartbeat from core client for 30 sec - exiting 17:22:13 (5188): No heartbeat from core client for 30 sec - exiting 17:22:14 (5188): No heartbeat from core client for 30 sec - exiting 17:22:15 (5188): No heartbeat from core client for 30 sec - exiting 17:22:16 (5188): No heartbeat from core client for 30 sec - exiting 17:22:17 (5188): No heartbeat from core client for 30 sec - exiting 17:22:18 (5188): No heartbeat from core client for 30 sec - exiting 17:22:19 (5188): No heartbeat from core client for 30 sec - exiting 17:22:20 (5188): No heartbeat from core client for 30 sec - exiting 17:22:21 (5188): No heartbeat from core client for 30 sec - exiting 17:22:22 (5188): No heartbeat from core client for 30 sec - exiting 17:22:23 (5188): No heartbeat from core client for 30 sec - exiting 17:22:24 (5188): No heartbeat from core client for 30 sec - exiting 17:22:25 (5188): No heartbeat from core client for 30 sec - exiting 17:22:26 (5188): No heartbeat from core client for 30 sec - exiting 17:22:27 (5188): No heartbeat from core client for 30 sec - exiting 17:22:28 (5188): No heartbeat from core client for 30 sec - exiting 17:22:29 (5188): No heartbeat from core client for 30 sec - exiting 17:22:30 (5188): No heartbeat from core client for 30 sec - exiting 17:22:31 (5188): No heartbeat from core client for 30 sec - exiting 17:22:32 (5188): No heartbeat from core client for 30 sec - exiting 17:22:33 (5188): No heartbeat from core client for 30 sec - exiting 17:22:34 (5188): No heartbeat from core client for 30 sec - exiting 17:22:35 (5188): No heartbeat from core client for 30 sec - exiting 17:22:36 (5188): No heartbeat from core client for 30 sec - exiting 17:22:37 (5188): No heartbeat from core client for 30 sec - exiting 17:22:38 (5188): No heartbeat from core client for 30 sec - exiting 17:22:39 (5188): No heartbeat from core client for 30 sec - exiting 17:22:40 (5188): No heartbeat from core client for 30 sec - exiting 17:22:41 (5188): No heartbeat from core client for 30 sec - exiting 17:23:13 (5188): No heartbeat from core client for 30 sec - exiting 17:23:14 (5188): No heartbeat from core client for 30 sec - exiting 17:23:15 (5188): No heartbeat from core client for 30 sec - exiting 17:23:16 (5188): No heartbeat from core client for 30 sec - exiting 17:23:17 (5188): No heartbeat from core client for 30 sec - exiting 17:23:18 (5188): No heartbeat from core client for 30 sec - exiting 17:23:19 (5188): No heartbeat from core client for 30 sec - exiting 17:23:20 (5188): No heartbeat from core client for 30 sec - exiting 17:23:21 (5188): No heartbeat from core client for 30 sec - exiting 17:23:22 (5188): No heartbeat from core client for 30 sec - exiting 17:23:23 (5188): No heartbeat from core client for 30 sec - exiting 17:23:24 (5188): No heartbeat from core client for 30 sec - exiting 17:23:25 (5188): No heartbeat from core client for 30 sec - exiting 17:23:26 (5188): No heartbeat from core client for 30 sec - exiting 17:23:27 (5188): No heartbeat from core client for 30 sec - exiting 17:23:28 (5188): No heartbeat from core client for 30 sec - exiting 17:23:29 (5188): No heartbeat from core client for 30 sec - exiting 17:23:30 (5188): No heartbeat from core client for 30 sec - exiting 17:23:31 (5188): No heartbeat from core client for 30 sec - exiting 17:23:32 (5188): No heartbeat from core client for 30 sec - exiting 17:23:33 (5188): No heartbeat from core client for 30 sec - exiting 17:23:34 (5188): No heartbeat from core client for 30 sec - exiting 17:23:35 (5188): No heartbeat from core client for 30 sec - exiting 17:23:36 (5188): No heartbeat from core client for 30 sec - exiting 17:23:37 (5188): No heartbeat from core client for 30 sec - exiting 17:23:38 (5188): No heartbeat from core client for 30 sec - exiting 17:23:39 (5188): No heartbeat from core client for 30 sec - exiting 17:23:40 (5188): No heartbeat from core client for 30 sec - exiting 17:23:41 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3516, selfPID=3516, iMonCtr=2 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_r53q_2013_1_008751500_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_r53q_2013_1_008751500_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_r53q_2013_1_008751500_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_r53q_2013_1_008751500_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_r53q_2013_1_008751500_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_r53q_2013_1_008751500_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Nov 2014 05:54:44	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	80,736	543,705	6.7344
07 Oct 2014 13:53:31	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	69,216	466,797	6.7441
04 Oct 2014 01:38:45	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	57,696	390,000	6.7596
30 Sep 2014 22:07:35	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	46,176	306,166	6.6304
29 Sep 2014 06:44:52	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	34,656	229,191	6.6133
11 Jun 2014 07:46:51	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	23,146	152,745	6.5992
11 Jun 2014 06:41:45	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	23,136	151,708	6.5572
04 Jun 2014 23:28:27	1095039	16653032	hadam3p_eu_r53q_2013_1_008751500_0	11,616	75,018	6.4582