Task 16396562

Name	hadam3p_anz_n61u_2012_1_008581530_0
Workunit	8728042
Created	25 Mar 2014, 19:08:35 UTC
Sent	26 Mar 2014, 11:31:55 UTC
Report deadline	8 Mar 2015, 16:51:55 UTC
Received	25 Apr 2014, 14:05:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1209220
Run time	14 days 20 hours 40 min 9 sec
CPU time	10 days 21 hours 56 min 44 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	1.73 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 07:30:29 (5788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:30 (5788): No heartbeat from core client for 30 sec - exiting 03:29:36 (2956): No heartbeat from core client for 30 sec - exiting 03:29:37 (2956): No heartbeat from core client for 30 sec - exiting 03:29:38 (2956): No heartbeat from core client for 30 sec - exiting 03:29:39 (2956): No heartbeat from core client for 30 sec - exiting 03:29:40 (2956): No heartbeat from core client for 30 sec - exiting 03:29:41 (2956): No heartbeat from core client for 30 sec - exiting 03:29:42 (2956): No heartbeat from core client for 30 sec - exiting 03:29:43 (2956): No heartbeat from core client for 30 sec - exiting 03:29:44 (2956): No heartbeat from core client for 30 sec - exiting 03:29:45 (2956): No heartbeat from core client for 30 sec - exiting 03:29:46 (2956): No heartbeat from core client for 30 sec - exiting 03:29:47 (2956): No heartbeat from core client for 30 sec - exiting 03:29:49 (2956): No heartbeat from core client for 30 sec - exiting 03:29:50 (2956): No heartbeat from core client for 30 sec - exiting 03:29:51 (2956): No heartbeat from core client for 30 sec - exiting 03:29:52 (2956): No heartbeat from core client for 30 sec - exiting 03:29:53 (2956): No heartbeat from core client for 30 sec - exiting 03:29:54 (2956): No heartbeat from core client for 30 sec - exiting 03:29:55 (2956): No heartbeat from core client for 30 sec - exiting 03:29:56 (2956): No heartbeat from core client for 30 sec - exiting 03:29:57 (2956): No heartbeat from core client for 30 sec - exiting 03:29:58 (2956): No heartbeat from core client for 30 sec - exiting 03:29:59 (2956): No heartbeat from core client for 30 sec - exiting 03:30:00 (2956): No heartbeat from core client for 30 sec - exiting 03:30:01 (2956): No heartbeat from core client for 30 sec - exiting 03:30:02 (2956): No heartbeat from core client for 30 sec - exiting 03:30:03 (2956): No heartbeat from core client for 30 sec - exiting 03:30:04 (2956): No heartbeat from core client for 30 sec - exiting 03:30:05 (2956): No heartbeat from core client for 30 sec - exiting 03:30:06 (2956): No heartbeat from core client for 30 sec - exiting 03:30:07 (2956): No heartbeat from core client for 30 sec - exiting 03:30:08 (2956): No heartbeat from core client for 30 sec - exiting 03:30:09 (2956): No heartbeat from core client for 30 sec - exiting 03:30:10 (2956): No heartbeat from core client for 30 sec - exiting 03:30:11 (2956): No heartbeat from core client for 30 sec - exiting 03:30:12 (2956): No heartbeat from core client for 30 sec - exiting 03:30:13 (2956): No heartbeat from core client for 30 sec - exiting 03:30:14 (2956): No heartbeat from core client for 30 sec - exiting 03:30:15 (2956): No heartbeat from core client for 30 sec - exiting 03:30:16 (2956): No heartbeat from core client for 30 sec - exiting 03:30:17 (2956): No heartbeat from core client for 30 sec - exiting 03:30:18 (2956): No heartbeat from core client for 30 sec - exiting 03:30:19 (2956): No heartbeat from core client for 30 sec - exiting 03:30:20 (2956): No heartbeat from core client for 30 sec - exiting 03:30:21 (2956): No heartbeat from core client for 30 sec - exiting 03:30:22 (2956): No heartbeat from core client for 30 sec - exiting 03:30:23 (2956): No heartbeat from core client for 30 sec - exiting 03:30:24 (2956): No heartbeat from core client for 30 sec - exiting 03:30:25 (2956): No heartbeat from core client for 30 sec - exiting 03:30:26 (2956): No heartbeat from core client for 30 sec - exiting 03:30:27 (2956): No heartbeat from core client for 30 sec - exiting 03:30:28 (2956): No heartbeat from core client for 30 sec - exiting 03:30:29 (2956): No heartbeat from core client for 30 sec - exiting 03:30:30 (2956): No heartbeat from core client for 30 sec - exiting 03:30:31 (2956): No heartbeat from core client for 30 sec - exiting 03:30:32 (2956): No heartbeat from core client for 30 sec - exiting 03:30:33 (2956): No heartbeat from core client for 30 sec - exiting 03:30:34 (2956): No heartbeat from core client for 30 sec - exiting 03:30:35 (2956): No heartbeat from core client for 30 sec - exiting 03:30:36 (2956): No heartbeat from core client for 30 sec - exiting 03:30:37 (2956): No heartbeat from core client for 30 sec - exiting 03:30:38 (2956): No heartbeat from core client for 30 sec - exiting 03:30:39 (2956): No heartbeat from core client for 30 sec - exiting 03:30:40 (2956): No heartbeat from core client for 30 sec - exiting 03:30:41 (2956): No heartbeat from core client for 30 sec - exiting 03:30:42 (2956): No heartbeat from core client for 30 sec - exiting 03:30:43 (2956): No heartbeat from core client for 30 sec - exiting 03:30:44 (2956): No heartbeat from core client for 30 sec - exiting 03:30:45 (2956): No heartbeat from core client for 30 sec - exiting 03:30:46 (2956): No heartbeat from core client for 30 sec - exiting 03:30:47 (2956): No heartbeat from core client for 30 sec - exiting 03:30:48 (2956): No heartbeat from core client for 30 sec - exiting 03:30:49 (2956): No heartbeat from core client for 30 sec - exiting 03:30:50 (2956): No heartbeat from core client for 30 sec - exiting 03:30:51 (2956): No heartbeat from core client for 30 sec - exiting 03:30:52 (2956): No heartbeat from core client for 30 sec - exiting 03:30:53 (2956): No heartbeat from core client for 30 sec - exiting 03:30:54 (2956): No heartbeat from core client for 30 sec - exiting 03:30:55 (2956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:41:07 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:26 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:47 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:58 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:24:21 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:34:42 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:55 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:55:36 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:48 (1476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:00 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:21 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:36:30 (2764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:46:40 (2852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:51 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5032, selfPID=5032, iMonCtr=2 06:07:02 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:18 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:43:08 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:48 (7216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:33 (1996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:36 (5288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:45 (7348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:52:55 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6876, selfPID=6876, iMonCtr=2 10:04:39 (6416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:46 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:04 (5356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:39 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:23 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:25 (5836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:26 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:47 (6704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5084, selfPID=5084, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:32:52 (7872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4156, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6340, selfPID=5828, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n61u_2012_1_008581530_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n61u_2012_1_008581530_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n61u_2012_1_008581530_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n61u_2012_1_008581530_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n61u_2012_1_008581530_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n61u_2012_1_008581530_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Apr 2014 07:24:39	1209220	16396562	hadam3p_anz_n61u_2012_1_008581530_0	69,419	916,967	13.2092
20 Apr 2014 15:24:10	1209220	16396562	hadam3p_anz_n61u_2012_1_008581530_0	57,899	787,020	13.5930
18 Apr 2014 10:12:16	1209220	16396562	hadam3p_anz_n61u_2012_1_008581530_0	46,379	659,422	14.2181
14 Apr 2014 19:44:52	1209220	16396562	hadam3p_anz_n61u_2012_1_008581530_0	34,859	487,806	13.9937
12 Apr 2014 18:13:23	1209220	16396562	hadam3p_anz_n61u_2012_1_008581530_0	23,339	342,878	14.6912
09 Apr 2014 23:54:11	1209220	16396562	hadam3p_anz_n61u_2012_1_008581530_0	11,819	180,943	15.3095