Task 18284088

Name	hadam3p_anz_f3ui_2013_1_009730519_0
Workunit	9802364
Created	8 Apr 2015, 20:14:30 UTC
Sent	9 Apr 2015, 16:57:03 UTC
Report deadline	21 Mar 2016, 22:17:03 UTC
Received	19 Apr 2015, 1:31:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1332216
Run time	7 days 1 hours 51 min 26 sec
CPU time	6 days 8 hours 48 min 21 sec
Validate state	Invalid
Credit	3,987.46
Device peak FLOPS	2.37 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5672, selfPID=6108, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:28:32 (5168): No heartbeat from core client for 30 sec - exiting 20:28:33 (5168): No heartbeat from core client for 30 sec - exiting 20:28:34 (5168): No heartbeat from core client for 30 sec - exiting 20:28:35 (5168): No heartbeat from core client for 30 sec - exiting 20:28:36 (5168): No heartbeat from core client for 30 sec - exiting 20:28:37 (5168): No heartbeat from core client for 30 sec - exiting 20:28:38 (5168): No heartbeat from core client for 30 sec - exiting 20:28:39 (5168): No heartbeat from core client for 30 sec - exiting 20:28:41 (5168): No heartbeat from core client for 30 sec - exiting 20:28:42 (5168): No heartbeat from core client for 30 sec - exiting 20:28:43 (5168): No heartbeat from core client for 30 sec - exiting 20:28:44 (5168): No heartbeat from core client for 30 sec - exiting 20:28:45 (5168): No heartbeat from core client for 30 sec - exiting 20:28:46 (5168): No heartbeat from core client for 30 sec - exiting 20:28:47 (5168): No heartbeat from core client for 30 sec - exiting 20:28:48 (5168): No heartbeat from core client for 30 sec - exiting 20:28:49 (5168): No heartbeat from core client for 30 sec - exiting 20:28:50 (5168): No heartbeat from core client for 30 sec - exiting 20:28:51 (5168): No heartbeat from core client for 30 sec - exiting 20:28:52 (5168): No heartbeat from core client for 30 sec - exiting 20:28:53 (5168): No heartbeat from core client for 30 sec - exiting 20:28:54 (5168): No heartbeat from core client for 30 sec - exiting 20:28:55 (5168): No heartbeat from core client for 30 sec - exiting 20:28:56 (5168): No heartbeat from core client for 30 sec - exiting 20:28:57 (5168): No heartbeat from core client for 30 sec - exiting 20:28:58 (5168): No heartbeat from core client for 30 sec - exiting 20:28:59 (5168): No heartbeat from core client for 30 sec - exiting 20:29:00 (5168): No heartbeat from core client for 30 sec - exiting 20:29:01 (5168): No heartbeat from core client for 30 sec - exiting 20:29:02 (5168): No heartbeat from core client for 30 sec - exiting 20:29:03 (5168): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 20:29:04 (5168): No heartbeat from core client for 30 sec - exiting 20:29:05 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5220, selfPID=3332, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_f3ui_2013_1_009730519_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f3ui_2013_1_009730519_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f3ui_2013_1_009730519_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_f3ui_2013_1_009730519_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Apr 2015 16:38:18	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	92,459	536,371	5.8012
15 Apr 2015 20:14:00	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	80,939	470,701	5.8155
14 Apr 2015 23:16:21	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	69,419	404,575	5.8280
14 Apr 2015 02:47:21	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	57,899	337,855	5.8352
13 Apr 2015 05:28:28	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	46,379	270,044	5.8225
12 Apr 2015 08:09:27	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	34,859	201,471	5.7796
11 Apr 2015 10:59:27	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	23,339	133,759	5.7311
10 Apr 2015 14:40:45	1332216	18284088	hadam3p_anz_f3ui_2013_1_009730519_0	11,819	67,395	5.7023