Task 18810649

Name	hadam3p_anz_n0pm_2008_1_010100103_0
Workunit	10079693
Created	12 Aug 2015, 18:15:30 UTC
Sent	13 Aug 2015, 2:27:20 UTC
Report deadline	25 Jul 2016, 7:47:20 UTC
Received	22 Aug 2015, 16:11:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1372300
Run time	7 days 5 hours 59 min 27 sec
CPU time	1 days 16 hours 43 min 5 sec
Validate state	Invalid
Credit	3,987.46
Device peak FLOPS	3.45 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:36:15 (5476): No heartbeat from core client for 30 sec - exiting 16:36:16 (5476): No heartbeat from core client for 30 sec - exiting 16:36:17 (5476): No heartbeat from core client for 30 sec - exiting 16:36:18 (5476): No heartbeat from core client for 30 sec - exiting 16:36:19 (5476): No heartbeat from core client for 30 sec - exiting 16:36:20 (5476): No heartbeat from core client for 30 sec - exiting 16:36:21 (5476): No heartbeat from core client for 30 sec - exiting 16:36:22 (5476): No heartbeat from core client for 30 sec - exiting 16:36:23 (5476): No heartbeat from core client for 30 sec - exiting 16:36:24 (5476): No heartbeat from core client for 30 sec - exiting 16:36:25 (5476): No heartbeat from core client for 30 sec - exiting 16:36:26 (5476): No heartbeat from core client for 30 sec - exiting 16:36:27 (5476): No heartbeat from core client for 30 sec - exiting 16:36:28 (5476): No heartbeat from core client for 30 sec - exiting 16:36:29 (5476): No heartbeat from core client for 30 sec - exiting 16:36:30 (5476): No heartbeat from core client for 30 sec - exiting 16:36:31 (5476): No heartbeat from core client for 30 sec - exiting 16:36:32 (5476): No heartbeat from core client for 30 sec - exiting 16:36:33 (5476): No heartbeat from core client for 30 sec - exiting 16:36:34 (5476): No heartbeat from core client for 30 sec - exiting 16:36:35 (5476): No heartbeat from core client for 30 sec - exiting 16:36:36 (5476): No heartbeat from core client for 30 sec - exiting 16:36:37 (5476): No heartbeat from core client for 30 sec - exiting 16:36:38 (5476): No heartbeat from core client for 30 sec - exiting 16:36:39 (5476): No heartbeat from core client for 30 sec - exiting 16:36:40 (5476): No heartbeat from core client for 30 sec - exiting 16:36:41 (5476): No heartbeat from core client for 30 sec - exiting 16:36:42 (5476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:49 (6336): No heartbeat from core client for 30 sec - exiting 16:45:51 (6336): No heartbeat from core client for 30 sec - exiting 16:45:52 (6336): No heartbeat from core client for 30 sec - exiting 16:45:53 (6336): No heartbeat from core client for 30 sec - exiting 16:45:54 (6336): No heartbeat from core client for 30 sec - exiting 16:45:55 (6336): No heartbeat from core client for 30 sec - exiting 16:45:56 (6336): No heartbeat from core client for 30 sec - exiting 16:45:57 (6336): No heartbeat from core client for 30 sec - exiting 16:45:58 (6336): No heartbeat from core client for 30 sec - exiting 16:45:59 (6336): No heartbeat from core client for 30 sec - exiting 16:46:00 (6336): No heartbeat from core client for 30 sec - exiting 16:46:01 (6336): No heartbeat from core client for 30 sec - exiting 16:46:03 (6336): No heartbeat from core client for 30 sec - exiting 16:46:04 (6336): No heartbeat from core client for 30 sec - exiting 16:46:05 (6336): No heartbeat from core client for 30 sec - exiting 16:46:06 (6336): No heartbeat from core client for 30 sec - exiting 16:46:07 (6336): No heartbeat from core client for 30 sec - exiting 16:46:08 (6336): No heartbeat from core client for 30 sec - exiting 16:46:09 (6336): No heartbeat from core client for 30 sec - exiting 16:46:10 (6336): No heartbeat from core client for 30 sec - exiting 16:46:11 (6336): No heartbeat from core client for 30 sec - exiting 16:46:12 (6336): No heartbeat from core client for 30 sec - exiting 16:46:13 (6336): No heartbeat from core client for 30 sec - exiting 16:46:15 (6336): No heartbeat from core client for 30 sec - exiting 16:46:16 (6336): No heartbeat from core client for 30 sec - exiting 16:46:17 (6336): No heartbeat from core client for 30 sec - exiting 16:46:18 (6336): No heartbeat from core client for 30 sec - exiting 16:46:19 (6336): No heartbeat from core client for 30 sec - exiting 16:46:20 (6336): No heartbeat from core client for 30 sec - exiting 16:46:21 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:02 (8428): No heartbeat from core client for 30 sec - exiting 08:13:03 (8428): No heartbeat from core client for 30 sec - exiting 08:13:04 (8428): No heartbeat from core client for 30 sec - exiting 08:13:05 (8428): No heartbeat from core client for 30 sec - exiting 08:13:06 (8428): No heartbeat from core client for 30 sec - exiting 08:13:07 (8428): No heartbeat from core client for 30 sec - exiting 08:13:08 (8428): No heartbeat from core client for 30 sec - exiting 08:13:09 (8428): No heartbeat from core client for 30 sec - exiting 08:13:10 (8428): No heartbeat from core client for 30 sec - exiting 08:13:11 (8428): No heartbeat from core client for 30 sec - exiting 08:13:12 (8428): No heartbeat from core client for 30 sec - exiting 08:13:13 (8428): No heartbeat from core client for 30 sec - exiting 08:13:14 (8428): No heartbeat from core client for 30 sec - exiting 08:13:15 (8428): No heartbeat from core client for 30 sec - exiting 08:13:16 (8428): No heartbeat from core client for 30 sec - exiting 08:13:17 (8428): No heartbeat from core client for 30 sec - exiting 08:13:18 (8428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:12:49 (8084): No heartbeat from core client for 30 sec - exiting 08:12:51 (8084): No heartbeat from core client for 30 sec - exiting 08:12:52 (8084): No heartbeat from core client for 30 sec - exiting 08:12:53 (8084): No heartbeat from core client for 30 sec - exiting 08:12:54 (8084): No heartbeat from core client for 30 sec - exiting 08:12:55 (8084): No heartbeat from core client for 30 sec - exiting 08:12:56 (8084): No heartbeat from core client for 30 sec - exiting 08:12:57 (8084): No heartbeat from core client for 30 sec - exiting 08:12:58 (8084): No heartbeat from core client for 30 sec - exiting 08:12:59 (8084): No heartbeat from core client for 30 sec - exiting 08:13:00 (8084): No heartbeat from core client for 30 sec - exiting 08:13:01 (8084): No heartbeat from core client for 30 sec - exiting 08:13:02 (8084): No heartbeat from core client for 30 sec - exiting 08:13:03 (8084): No heartbeat from core client for 30 sec - exiting 08:13:04 (8084): No heartbeat from core client for 30 sec - exiting 08:13:05 (8084): No heartbeat from core client for 30 sec - exiting 08:13:06 (8084): No heartbeat from core client for 30 sec - exiting 08:13:07 (8084): No heartbeat from core client for 30 sec - exiting 08:13:08 (8084): No heartbeat from core client for 30 sec - exiting 08:13:09 (8084): No heartbeat from core client for 30 sec - exiting 08:13:10 (8084): No heartbeat from core client for 30 sec - exiting 08:13:11 (8084): No heartbeat from core client for 30 sec - exiting 08:13:12 (8084): No heartbeat from core client for 30 sec - exiting 08:13:13 (8084): No heartbeat from core client for 30 sec - exiting 08:13:14 (8084): No heartbeat from core client for 30 sec - exiting 08:13:15 (8084): No heartbeat from core client for 30 sec - exiting 08:13:16 (8084): No heartbeat from core client for 30 sec - exiting 08:13:17 (8084): No heartbeat from core client for 30 sec - exiting 08:13:18 (8084): No heartbeat from core client for 30 sec - exiting 08:13:19 (8084): No heartbeat from core client for 30 sec - exiting 08:13:20 (8084): No heartbeat from core client for 30 sec - exiting 08:13:21 (8084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:39:51 (7056): No heartbeat from core client for 30 sec - exiting 16:39:52 (7056): No heartbeat from core client for 30 sec - exiting 16:39:53 (7056): No heartbeat from core client for 30 sec - exiting 16:39:54 (7056): No heartbeat from core client for 30 sec - exiting 16:39:55 (7056): No heartbeat from core client for 30 sec - exiting 16:39:56 (7056): No heartbeat from core client for 30 sec - exiting 16:39:57 (7056): No heartbeat from core client for 30 sec - exiting 16:39:58 (7056): No heartbeat from core client for 30 sec - exiting 16:39:59 (7056): No heartbeat from core client for 30 sec - exiting 16:40:01 (7056): No heartbeat from core client for 30 sec - exiting 16:40:02 (7056): No heartbeat from core client for 30 sec - exiting 16:40:03 (7056): No heartbeat from core client for 30 sec - exiting 16:40:04 (7056): No heartbeat from core client for 30 sec - exiting 16:40:05 (7056): No heartbeat from core client for 30 sec - exiting 16:40:06 (7056): No heartbeat from core client for 30 sec - exiting 16:40:07 (7056): No heartbeat from core client for 30 sec - exiting 16:40:08 (7056): No heartbeat from core client for 30 sec - exiting 16:40:09 (7056): No heartbeat from core client for 30 sec - exiting 16:40:10 (7056): No heartbeat from core client for 30 sec - exiting 16:40:12 (7056): No heartbeat from core client for 30 sec - exiting 16:40:13 (7056): No heartbeat from core client for 30 sec - exiting 16:40:14 (7056): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5092, selfPID=4148, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:17:17 (3344): No heartbeat from core client for 30 sec - exiting 11:17:19 (3344): No heartbeat from core client for 30 sec - exiting 11:17:20 (3344): No heartbeat from core client for 30 sec - exiting 11:17:21 (3344): No heartbeat from core client for 30 sec - exiting 11:17:22 (3344): No heartbeat from core client for 30 sec - exiting 11:17:23 (3344): No heartbeat from core client for 30 sec - exiting 11:17:24 (3344): No heartbeat from core client for 30 sec - exiting 11:17:25 (3344): No heartbeat from core client for 30 sec - exiting 11:17:26 (3344): No heartbeat from core client for 30 sec - exiting 11:17:27 (3344): No heartbeat from core client for 30 sec - exiting 11:17:28 (3344): No heartbeat from core client for 30 sec - exiting 11:17:29 (3344): No heartbeat from core client for 30 sec - exiting 11:17:31 (3344): No heartbeat from core client for 30 sec - exiting 11:17:32 (3344): No heartbeat from core client for 30 sec - exiting 11:17:33 (3344): No heartbeat from core client for 30 sec - exiting 11:17:34 (3344): No heartbeat from core client for 30 sec - exiting 11:17:35 (3344): No heartbeat from core client for 30 sec - exiting 11:17:36 (3344): No heartbeat from core client for 30 sec - exiting 11:17:37 (3344): No heartbeat from core client for 30 sec - exiting 11:17:38 (3344): No heartbeat from core client for 30 sec - exiting 11:17:39 (3344): No heartbeat from core client for 30 sec - exiting 11:17:40 (3344): No heartbeat from core client for 30 sec - exiting 11:17:41 (3344): No heartbeat from core client for 30 sec - exiting 11:17:43 (3344): No heartbeat from core client for 30 sec - exiting 11:17:44 (3344): No heartbeat from core client for 30 sec - exiting 11:17:45 (3344): No heartbeat from core client for 30 sec - exiting 11:17:46 (3344): No heartbeat from core client for 30 sec - exiting 11:17:47 (3344): No heartbeat from core client for 30 sec - exiting 11:17:48 (3344): No heartbeat from core client for 30 sec - exiting 11:17:49 (3344): No heartbeat from core client for 30 sec - exiting 11:17:50 (3344): No heartbeat from core client for 30 sec - exiting 11:17:51 (3344): No heartbeat from core client for 30 sec - exiting 11:17:52 (3344): No heartbeat from core client for 30 sec - exiting 11:17:53 (3344): No heartbeat from core client for 30 sec - exiting 11:17:55 (3344): No heartbeat from core client for 30 sec - exiting 11:17:56 (3344): No heartbeat from core client for 30 sec - exiting 11:17:57 (3344): No heartbeat from core client for 30 sec - exiting 11:17:58 (3344): No heartbeat from core client for 30 sec - exiting 11:17:59 (3344): No heartbeat from core client for 30 sec - exiting 11:18:00 (3344): No heartbeat from core client for 30 sec - exiting 11:18:01 (3344): No heartbeat from core client for 30 sec - exiting 11:18:02 (3344): No heartbeat from core client for 30 sec - exiting 11:18:03 (3344): No heartbeat from core client for 30 sec - exiting 11:18:04 (3344): No heartbeat from core client for 30 sec - exiting 11:18:06 (3344): No heartbeat from core client for 30 sec - exiting 11:18:07 (3344): No heartbeat from core client for 30 sec - exiting 11:18:08 (3344): No heartbeat from core client for 30 sec - exiting 11:18:09 (3344): No heartbeat from core client for 30 sec - exiting 11:18:10 (3344): No heartbeat from core client for 30 sec - exiting 11:18:11 (3344): No heartbeat from core client for 30 sec - exiting 11:18:12 (3344): No heartbeat from core client for 30 sec - exiting 11:18:13 (3344): No heartbeat from core client for 30 sec - exiting 11:18:14 (3344): No heartbeat from core client for 30 sec - exiting 11:18:15 (3344): No heartbeat from core client for 30 sec - exiting 11:18:16 (3344): No heartbeat from core client for 30 sec - exiting 11:18:18 (3344): No heartbeat from core client for 30 sec - exiting 11:18:19 (3344): No heartbeat from core client for 30 sec - exiting 11:18:52 (3344): No heartbeat from core client for 30 sec - exiting 11:18:54 (3344): No heartbeat from core client for 30 sec - exiting 11:18:55 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n0pm_2008_1_010100103_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n0pm_2008_1_010100103_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n0pm_2008_1_010100103_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n0pm_2008_1_010100103_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Aug 2015 16:17:20	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	92,459	440,849	4.7680
20 Aug 2015 00:36:08	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	80,939	386,206	4.7716
19 Aug 2015 03:38:33	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	69,419	331,043	4.7688
18 Aug 2015 11:36:37	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	57,899	275,084	4.7511
17 Aug 2015 20:08:20	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	46,379	220,595	4.7564
15 Aug 2015 07:35:02	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	34,859	165,468	4.7468
14 Aug 2015 16:10:24	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	23,339	111,467	4.7760
14 Aug 2015 00:28:06	1372300	18810649	hadam3p_anz_n0pm_2008_1_010100103_0	11,819	57,032	4.8255