Task 16366517

Name	hadam3p_anz_a408_2012_1_008561341_0
Workunit	8708853
Created	13 Mar 2014, 9:06:52 UTC
Sent	13 Mar 2014, 9:06:59 UTC
Report deadline	23 Feb 2015, 14:26:59 UTC
Received	15 Apr 2014, 17:14:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1105487
Run time	8 days 14 hours 18 min 10 sec
CPU time	8 days 11 hours 0 min 6 sec
Validate state	Invalid
Credit	4,981.10
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> 19:04:22 (320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:24 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:25 (3520): No heartbeat from core client for 30 sec - exiting 21:12:26 (3520): No heartbeat from core client for 30 sec - exiting 21:12:27 (3520): No heartbeat from core client for 30 sec - exiting 21:12:28 (3520): No heartbeat from core client for 30 sec - exiting 21:12:29 (3520): No heartbeat from core client for 30 sec - exiting 21:12:30 (3520): No heartbeat from core client for 30 sec - exiting 21:12:31 (3520): No heartbeat from core client for 30 sec - exiting 21:12:32 (3520): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 09:05:50 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:23:11 (5624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 18:45:35 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:56 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:57 (3008): No heartbeat from core client for 30 sec - exiting 21:12:58 (3008): No heartbeat from core client for 30 sec - exiting 21:12:59 (3008): No heartbeat from core client for 30 sec - exiting 21:13:00 (3008): No heartbeat from core client for 30 sec - exiting 21:13:01 (3008): No heartbeat from core client for 30 sec - exiting 21:13:02 (3008): No heartbeat from core client for 30 sec - exiting 21:13:03 (3008): No heartbeat from core client for 30 sec - exiting 21:13:04 (3008): No heartbeat from core client for 30 sec - exiting 21:13:05 (3008): No heartbeat from core client for 30 sec - exiting 21:13:06 (3008): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 15:38:43 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:37:02 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:24:59 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:18 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:49 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:15 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 12:26:52 (5020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:36 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:34:19 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4828, selfPID=4828, iMonCtr=2 16:35:03 (3380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:13 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 10:27:54 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 15:58:08 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional 18:18:32 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:50 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 12:45:51 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:27 (1576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:46:28 (1576): No heartbeat from core client for 30 sec - exiting 12:46:29 (1576): No heartbeat from core client for 30 sec - exiting 12:46:30 (1576): No heartbeat from core client for 30 sec - exiting 12:46:31 (1576): No heartbeat from core client for 30 sec - exiting 12:46:32 (1576): No heartbeat from core client for 30 sec - exiting 12:46:33 (1576): No heartbeat from core client for 30 sec - exiting 14:40:18 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:46 (2936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:47 (2936): No heartbeat from core client for 30 sec - exiting 16:40:48 (2936): No heartbeat from core client for 30 sec - exiting 16:40:49 (2936): No heartbeat from core client for 30 sec - exiting 16:40:50 (2936): No heartbeat from core client for 30 sec - exiting 16:40:51 (2936): No heartbeat from core client for 30 sec - exiting 16:40:52 (2936): No heartbeat from core client for 30 sec - exiting 16:40:53 (2936): No heartbeat from core client for 30 sec - exiting 16:40:54 (2936): No heartbeat from core client for 30 sec - exiting 16:40:55 (2936): No heartbeat from core client for 30 sec - exiting 16:40:56 (2936): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:31:47 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:10 (1076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:02 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:51 (3804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:27 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:28 (4548): No heartbeat from core client for 30 sec - exiting 22:05:29 (4548): No heartbeat from core client for 30 sec - exiting 22:05:30 (4548): No heartbeat from core client for 30 sec - exiting 22:05:31 (4548): No heartbeat from core client for 30 sec - exiting 22:05:32 (4548): No heartbeat from core client for 30 sec - exiting 22:05:33 (4548): No heartbeat from core client for 30 sec - exiting 23:44:06 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 09:43:52 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:03 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:04 (5880): No heartbeat from core client for 30 sec - exiting 17:38:13 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:35 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:49 (6748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:22 (1788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:17:23 (1788): No heartbeat from core client for 30 sec - exiting 21:17:24 (1788): No heartbeat from core client for 30 sec - exiting 21:17:25 (1788): No heartbeat from core client for 30 sec - exiting 21:17:26 (1788): No heartbeat from core client for 30 sec - exiting 21:17:27 (1788): No heartbeat from core client for 30 sec - exiting 21:17:28 (1788): No heartbeat from core client for 30 sec - exiting 21:17:29 (1788): No heartbeat from core client for 30 sec - exiting 21:17:30 (1788): No heartbeat from core client for 30 sec - exiting 21:17:31 (1788): No heartbeat from core client for 30 sec - exiting 21:17:32 (1788): No heartbeat from core client for 30 sec - exiting 21:17:33 (1788): No heartbeat from core client for 30 sec - exiting 21:17:34 (1788): No heartbeat from core client for 30 sec - exiting 21:17:35 (1788): No heartbeat from core client for 30 sec - exiting 21:17:36 (1788): No heartbeat from core client for 30 sec - exiting 21:17:37 (1788): No heartbeat from core client for 30 sec - exiting 21:17:38 (1788): No heartbeat from core client for 30 sec - exiting 21:18:15 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:53 (6300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:54 (6300): No heartbeat from core client for 30 sec - exiting 21:18:55 (6300): No heartbeat from core client for 30 sec - exiting 21:18:56 (6300): No heartbeat from core client for 30 sec - exiting 21:18:57 (6300): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 11:37:06 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6664, selfPID=6664, iMonCtr=2 14:50:40 (808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:48 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:51:33 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:51:34 (3536): No heartbeat from core client for 30 sec - exiting 16:51:35 (3536): No heartbeat from core client for 30 sec - exiting 16:51:36 (3536): No heartbeat from core client for 30 sec - exiting 18:53:55 (2868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:24:50 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 12:48:30 (5168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:18 (6180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:49:19 (6180): No heartbeat from core client for 30 sec - exiting 12:49:20 (6180): No heartbeat from core client for 30 sec - exiting 12:49:21 (6180): No heartbeat from core client for 30 sec - exiting 12:49:22 (6180): No heartbeat from core client for 30 sec - exiting 12:49:23 (6180): No heartbeat from core client for 30 sec - exiting 12:49:24 (6180): No heartbeat from core client for 30 sec - exiting 14:45:11 (1616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:20 (4584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:21 (4584): No heartbeat from core client for 30 sec - exiting 16:36:22 (4584): No heartbeat from core client for 30 sec - exiting 16:36:23 (4584): No heartbeat from core client for 30 sec - exiting 16:36:24 (4584): No heartbeat from core client for 30 sec - exiting 16:36:25 (4584): No heartbeat from core client for 30 sec - exiting 16:36:26 (4584): No heartbeat from core client for 30 sec - exiting 16:36:27 (4584): No heartbeat from core client for 30 sec - exiting 16:36:28 (4584): No heartbeat from core client for 30 sec - exiting 16:36:29 (4584): No heartbeat from core client for 30 sec - exiting 16:36:30 (4584): No heartbeat from core client for 30 sec - exiting 18:23:37 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:22 (6172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:46 (3176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 10:05:10 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:04 (6348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:03 (6968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2800, selfPID=2800, iMonCtr=2 16:10:28 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:17 (2420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:57 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:58 (3920): No heartbeat from core client for 30 sec - exiting 17:12:59 (3920): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:14:52 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:46:00 (6448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 09:13:53 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:55 (1436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:35:29 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:47 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:11:15 (6340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:16 (6340): No heartbeat from core client for 30 sec - exiting 17:11:17 (6340): No heartbeat from core client for 30 sec - exiting 17:11:18 (6340): No heartbeat from core client for 30 sec - exiting 17:11:19 (6340): No heartbeat from core client for 30 sec - exiting 17:11:20 (6340): No heartbeat from core client for 30 sec - exiting 17:11:21 (6340): No heartbeat from core client for 30 sec - exiting 17:11:22 (6340): No heartbeat from core client for 30 sec - exiting 17:11:23 (6340): No heartbeat from core client for 30 sec - exiting 17:11:24 (6340): No heartbeat from core client for 30 sec - exiting 17:11:25 (6340): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... 17:12:27 (6572): No heartbeat from core client for 30 sec - exiting 17:12:28 (6572): No heartbeat from core client for 30 sec - exiting 17:12:29 (6572): No heartbeat from core client for 30 sec - exiting 17:12:30 (6572): No heartbeat from core client for 30 sec - exiting Called boinc_finish 17:12:31 (6572): No heartbeat from core client for 30 sec - exiting 17:12:32 (6572): No heartbeat from core client for 30 sec - exiting </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_a408_2012_1_008561341_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_a408_2012_1_008561341_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Apr 2014 09:49:12	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	115,499	713,484	6.1774
13 Apr 2014 19:32:51	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	103,979	644,038	6.1939
12 Apr 2014 08:20:33	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	92,459	573,819	6.2062
10 Apr 2014 18:04:06	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	80,939	503,926	6.2260
09 Apr 2014 12:20:23	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	69,419	433,343	6.2424
07 Apr 2014 22:51:05	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	57,899	362,909	6.2680
06 Apr 2014 18:25:00	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	46,379	292,724	6.3116
05 Apr 2014 10:55:39	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	34,859	221,609	6.3573
03 Apr 2014 21:52:40	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	23,339	150,225	6.4367
25 Mar 2014 07:56:04	1105487	16366517	hadam3p_anz_a408_2012_1_008561341_0	11,819	76,559	6.4776