Task 18285036

Name	hadam3p_anz_f5v1_2013_1_009731437_0
Workunit	9803282
Created	8 Apr 2015, 20:31:53 UTC
Sent	10 Apr 2015, 22:02:26 UTC
Report deadline	23 Mar 2016, 3:22:26 UTC
Received	26 May 2015, 23:47:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1350723
Run time	5 days 22 hours 29 min 27 sec
CPU time	5 days 16 hours 13 min 57 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	3.59 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:48:21 (4932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 03:48:23 (4932): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 09:36:36 (4556): No heartbeat from core client for 30 sec - exiting 09:36:37 (4556): No heartbeat from core client for 30 sec - exiting 09:36:38 (4556): No heartbeat from core client for 30 sec - exiting 09:36:39 (4556): No heartbeat from core client for 30 sec - exiting 09:36:40 (4556): No heartbeat from core client for 30 sec - exiting 09:36:41 (4556): No heartbeat from core client for 30 sec - exiting 09:36:42 (4556): No heartbeat from core client for 30 sec - exiting 09:36:43 (4556): No heartbeat from core client for 30 sec - exiting 09:36:44 (4556): No heartbeat from core client for 30 sec - exiting 09:36:46 (4556): No heartbeat from core client for 30 sec - exiting 09:36:47 (4556): No heartbeat from core client for 30 sec - exiting 09:36:48 (4556): No heartbeat from core client for 30 sec - exiting 09:36:49 (4556): No heartbeat from core client for 30 sec - exiting 09:36:50 (4556): No heartbeat from core client for 30 sec - exiting 09:36:51 (4556): No heartbeat from core client for 30 sec - exiting 09:36:52 (4556): No heartbeat from core client for 30 sec - exiting 09:36:53 (4556): No heartbeat from core client for 30 sec - exiting 09:36:54 (4556): No heartbeat from core client for 30 sec - exiting 09:36:55 (4556): No heartbeat from core client for 30 sec - exiting 09:36:57 (4556): No heartbeat from core client for 30 sec - exiting 09:36:58 (4556): No heartbeat from core client for 30 sec - exiting 09:36:59 (4556): No heartbeat from core client for 30 sec - exiting 09:37:00 (4556): No heartbeat from core client for 30 sec - exiting 09:37:01 (4556): No heartbeat from core client for 30 sec - exiting 09:37:02 (4556): No heartbeat from core client for 30 sec - exiting 09:37:03 (4556): No heartbeat from core client for 30 sec - exiting 09:37:04 (4556): No heartbeat from core client for 30 sec - exiting 09:37:05 (4556): No heartbeat from core client for 30 sec - exiting 09:37:06 (4556): No heartbeat from core client for 30 sec - exiting 09:37:07 (4556): No heartbeat from core client for 30 sec - exiting 09:37:09 (4556): No heartbeat from core client for 30 sec - exiting 09:37:10 (4556): No heartbeat from core client for 30 sec - exiting 09:37:11 (4556): No heartbeat from core client for 30 sec - exiting 09:37:12 (4556): No heartbeat from core client for 30 sec - exiting 09:37:13 (4556): No heartbeat from core client for 30 sec - exiting 09:37:14 (4556): No heartbeat from core client for 30 sec - exiting 09:37:15 (4556): No heartbeat from core client for 30 sec - exiting 09:37:16 (4556): No heartbeat from core client for 30 sec - exiting 09:37:17 (4556): No heartbeat from core client for 30 sec - exiting 09:37:18 (4556): No heartbeat from core client for 30 sec - exiting 09:37:20 (4556): No heartbeat from core client for 30 sec - exiting 09:37:21 (4556): No heartbeat from core client for 30 sec - exiting 09:37:22 (4556): No heartbeat from core client for 30 sec - exiting 09:37:23 (4556): No heartbeat from core client for 30 sec - exiting 09:37:24 (4556): No heartbeat from core client for 30 sec - exiting 09:37:25 (4556): No heartbeat from core client for 30 sec - exiting 09:37:26 (4556): No heartbeat from core client for 30 sec - exiting 09:37:27 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:55:21 (4236): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:24:59 (2800): No heartbeat from core client for 30 sec - exiting 22:25:00 (2800): No heartbeat from core client for 30 sec - exiting 22:25:01 (2800): No heartbeat from core client for 30 sec - exiting 22:25:02 (2800): No heartbeat from core client for 30 sec - exiting 22:25:04 (2800): No heartbeat from core client for 30 sec - exiting 22:25:05 (2800): No heartbeat from core client for 30 sec - exiting 22:25:06 (2800): No heartbeat from core client for 30 sec - exiting 22:25:07 (2800): No heartbeat from core client for 30 sec - exiting 22:25:08 (2800): No heartbeat from core client for 30 sec - exiting 22:25:09 (2800): No heartbeat from core client for 30 sec - exiting 22:25:10 (2800): No heartbeat from core client for 30 sec - exiting 22:25:11 (2800): No heartbeat from core client for 30 sec - exiting 22:25:12 (2800): No heartbeat from core client for 30 sec - exiting 22:25:14 (2800): No heartbeat from core client for 30 sec - exiting 22:25:15 (2800): No heartbeat from core client for 30 sec - exiting 22:25:16 (2800): No heartbeat from core client for 30 sec - exiting 22:25:17 (2800): No heartbeat from core client for 30 sec - exiting 22:25:18 (2800): No heartbeat from core client for 30 sec - exiting 22:25:19 (2800): No heartbeat from core client for 30 sec - exiting 22:25:20 (2800): No heartbeat from core client for 30 sec - exiting 22:25:21 (2800): No heartbeat from core client for 30 sec - exiting 22:25:22 (2800): No heartbeat from core client for 30 sec - exiting 22:25:23 (2800): No heartbeat from core client for 30 sec - exiting 22:25:25 (2800): No heartbeat from core client for 30 sec - exiting 22:25:26 (2800): No heartbeat from core client for 30 sec - exiting 22:25:27 (2800): No heartbeat from core client for 30 sec - exiting 22:25:28 (2800): No heartbeat from core client for 30 sec - exiting 22:25:29 (2800): No heartbeat from core client for 30 sec - exiting 22:25:30 (2800): No heartbeat from core client for 30 sec - exiting 22:25:31 (2800): No heartbeat from core client for 30 sec - exiting 22:25:32 (2800): No heartbeat from core client for 30 sec - exiting 22:25:33 (2800): No heartbeat from core client for 30 sec - exiting 22:25:34 (2800): No heartbeat from core client for 30 sec - exiting 22:25:35 (2800): No heartbeat from core client for 30 sec - exiting 22:25:36 (2800): No heartbeat from core client for 30 sec - exiting 22:25:37 (2800): No heartbeat from core client for 30 sec - exiting 22:25:38 (2800): No heartbeat from core client for 30 sec - exiting 22:25:39 (2800): No heartbeat from core client for 30 sec - exiting 22:25:40 (2800): No heartbeat from core client for 30 sec - exiting 22:25:41 (2800): No heartbeat from core client for 30 sec - exiting 22:25:42 (2800): No heartbeat from core client for 30 sec - exiting 22:25:43 (2800): No heartbeat from core client for 30 sec - exiting 22:25:44 (2800): No heartbeat from core client for 30 sec - exiting 22:25:45 (2800): No heartbeat from core client for 30 sec - exiting 22:25:46 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:53:21 (2140): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:09:09 (6280): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:28:01 (4236): No heartbeat from core client for 30 sec - exiting 13:28:02 (4236): No heartbeat from core client for 30 sec - exiting 13:28:03 (4236): No heartbeat from core client for 30 sec - exiting 13:28:04 (4236): No heartbeat from core client for 30 sec - exiting 13:28:05 (4236): No heartbeat from core client for 30 sec - exiting 13:28:06 (4236): No heartbeat from core client for 30 sec - exiting 13:28:07 (4236): No heartbeat from core client for 30 sec - exiting 13:28:09 (4236): No heartbeat from core client for 30 sec - exiting 13:28:10 (4236): No heartbeat from core client for 30 sec - exiting 13:28:11 (4236): No heartbeat from core client for 30 sec - exiting 13:28:12 (4236): No heartbeat from core client for 30 sec - exiting 13:28:13 (4236): No heartbeat from core client for 30 sec - exiting 13:28:14 (4236): No heartbeat from core client for 30 sec - exiting 13:28:15 (4236): No heartbeat from core client for 30 sec - exiting 13:28:16 (4236): No heartbeat from core client for 30 sec - exiting 13:28:17 (4236): No heartbeat from core client for 30 sec - exiting 13:28:18 (4236): No heartbeat from core client for 30 sec - exiting 13:28:19 (4236): No heartbeat from core client for 30 sec - exiting 13:28:21 (4236): No heartbeat from core client for 30 sec - exiting 13:28:22 (4236): No heartbeat from core client for 30 sec - exiting 13:28:23 (4236): No heartbeat from core client for 30 sec - exiting 13:28:24 (4236): No heartbeat from core client for 30 sec - exiting 13:28:25 (4236): No heartbeat from core client for 30 sec - exiting 13:28:26 (4236): No heartbeat from core client for 30 sec - exiting 13:28:27 (4236): No heartbeat from core client for 30 sec - exiting 13:28:28 (4236): No heartbeat from core client for 30 sec - exiting 13:28:29 (4236): No heartbeat from core client for 30 sec - exiting 13:28:30 (4236): No heartbeat from core client for 30 sec - exiting 13:28:31 (4236): No heartbeat from core client for 30 sec - exiting 13:28:33 (4236): No heartbeat from core client for 30 sec - exiting 13:28:34 (4236): No heartbeat from core client for 30 sec - exiting 13:28:35 (4236): No heartbeat from core client for 30 sec - exiting 13:28:36 (4236): No heartbeat from core client for 30 sec - exiting 13:28:37 (4236): No heartbeat from core client for 30 sec - exiting 13:28:38 (4236): No heartbeat from core client for 30 sec - exiting 13:28:39 (4236): No heartbeat from core client for 30 sec - exiting 13:28:40 (4236): No heartbeat from core client for 30 sec - exiting 13:28:41 (4236): No heartbeat from core client for 30 sec - exiting 13:28:42 (4236): No heartbeat from core client for 30 sec - exiting 13:28:43 (4236): No heartbeat from core client for 30 sec - exiting 13:28:45 (4236): No heartbeat from core client for 30 sec - exiting 13:28:46 (4236): No heartbeat from core client for 30 sec - exiting 13:28:47 (4236): No heartbeat from core client for 30 sec - exiting 13:28:48 (4236): No heartbeat from core client for 30 sec - exiting 13:28:49 (4236): No heartbeat from core client for 30 sec - exiting 13:28:50 (4236): No heartbeat from core client for 30 sec - exiting 13:28:51 (4236): No heartbeat from core client for 30 sec - exiting 13:28:52 (4236): No heartbeat from core client for 30 sec - exiting 13:28:53 (4236): No heartbeat from core client for 30 sec - exiting 13:28:54 (4236): No heartbeat from core client for 30 sec - exiting 13:28:56 (4236): No heartbeat from core client for 30 sec - exiting 13:28:57 (4236): No heartbeat from core client for 30 sec - exiting 13:28:58 (4236): No heartbeat from core client for 30 sec - exiting 13:28:59 (4236): No heartbeat from core client for 30 sec - exiting 13:29:00 (4236): No heartbeat from core client for 30 sec - exiting 13:29:01 (4236): No heartbeat from core client for 30 sec - exiting 13:29:02 (4236): No heartbeat from core client for 30 sec - exiting 13:29:03 (4236): No heartbeat from core client for 30 sec - exiting 13:29:04 (4236): No heartbeat from core client for 30 sec - exiting 13:29:05 (4236): No heartbeat from core client for 30 sec - exiting 13:29:06 (4236): No heartbeat from core client for 30 sec - exiting 13:29:08 (4236): No heartbeat from core client for 30 sec - exiting 13:29:09 (4236): No heartbeat from core client for 30 sec - exiting 13:29:10 (4236): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 13:29:11 (4236): No heartbeat from core client for 30 sec - exiting 13:29:12 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5176, selfPID=4240, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f5v1_2013_1_009731437_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f5v1_2013_1_009731437_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f5v1_2013_1_009731437_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 May 2015 19:35:16	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	103,979	465,048	4.4725
20 May 2015 01:43:37	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	92,459	414,057	4.4783
18 May 2015 23:40:47	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	80,939	362,341	4.4767
18 May 2015 23:40:46	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	69,419	311,123	4.4818
18 May 2015 11:24:41	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	57,899	259,521	4.4823
18 May 2015 11:24:41	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	46,379	207,807	4.4806
14 May 2015 22:04:25	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	34,859	155,920	4.4729
13 May 2015 22:05:12	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	23,339	104,590	4.4813
10 May 2015 22:06:16	1350723	18285036	hadam3p_anz_f5v1_2013_1_009731437_0	11,819	52,946	4.4797