Task 16135596

Name	hadam3p_pnw_dhry_2047_1_008279402_1
Workunit	8430537
Created	6 Dec 2013, 23:26:00 UTC
Sent	6 Dec 2013, 23:26:19 UTC
Report deadline	19 Nov 2014, 4:46:19 UTC
Received	23 Dec 2013, 17:06:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1301991
Run time	3 days 8 hours 39 min 49 sec
CPU time	2 days 22 hours 30 min 55 sec
Validate state	Invalid
Credit	2,254.93
Device peak FLOPS	3.00 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.2.28</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:23:28 (3596): No heartbeat from core client for 30 sec - exiting 09:23:29 (3596): No heartbeat from core client for 30 sec - exiting 09:23:30 (3596): No heartbeat from core client for 30 sec - exiting 09:23:31 (3596): No heartbeat from core client for 30 sec - exiting 09:23:32 (3596): No heartbeat from core client for 30 sec - exiting 09:23:33 (3596): No heartbeat from core client for 30 sec - exiting 09:23:34 (3596): No heartbeat from core client for 30 sec - exiting 09:23:35 (3596): No heartbeat from core client for 30 sec - exiting 09:23:36 (3596): No heartbeat from core client for 30 sec - exiting 09:23:37 (3596): No heartbeat from core client for 30 sec - exiting 09:23:38 (3596): No heartbeat from core client for 30 sec - exiting 09:23:39 (3596): No heartbeat from core client for 30 sec - exiting 09:23:40 (3596): No heartbeat from core client for 30 sec - exiting 09:23:41 (3596): No heartbeat from core client for 30 sec - exiting 09:23:42 (3596): No heartbeat from core client for 30 sec - exiting 09:23:43 (3596): No heartbeat from core client for 30 sec - exiting 09:23:44 (3596): No heartbeat from core client for 30 sec - exiting 09:23:45 (3596): No heartbeat from core client for 30 sec - exiting 09:23:46 (3596): No heartbeat from core client for 30 sec - exiting 09:23:47 (3596): No heartbeat from core client for 30 sec - exiting 09:23:48 (3596): No heartbeat from core client for 30 sec - exiting 09:23:49 (3596): No heartbeat from core client for 30 sec - exiting 09:23:50 (3596): No heartbeat from core client for 30 sec - exiting 09:23:51 (3596): No heartbeat from core client for 30 sec - exiting 09:23:52 (3596): No heartbeat from core client for 30 sec - exiting 09:23:53 (3596): No heartbeat from core client for 30 sec - exiting 09:23:54 (3596): No heartbeat from core client for 30 sec - exiting 09:23:55 (3596): No heartbeat from core client for 30 sec - exiting 09:23:56 (3596): No heartbeat from core client for 30 sec - exiting 09:23:57 (3596): No heartbeat from core client for 30 sec - exiting 09:23:58 (3596): No heartbeat from core client for 30 sec - exiting 09:23:59 (3596): No heartbeat from core client for 30 sec - exiting 09:24:00 (3596): No heartbeat from core client for 30 sec - exiting 09:24:01 (3596): No heartbeat from core client for 30 sec - exiting 09:24:02 (3596): No heartbeat from core client for 30 sec - exiting 09:24:03 (3596): No heartbeat from core client for 30 sec - exiting 09:24:04 (3596): No heartbeat from core client for 30 sec - exiting 09:24:05 (3596): No heartbeat from core client for 30 sec - exiting 09:24:06 (3596): No heartbeat from core client for 30 sec - exiting 09:24:07 (3596): No heartbeat from core client for 30 sec - exiting 09:24:08 (3596): No heartbeat from core client for 30 sec - exiting 09:24:09 (3596): No heartbeat from core client for 30 sec - exiting 09:24:10 (3596): No heartbeat from core client for 30 sec - exiting 09:24:11 (3596): No heartbeat from core client for 30 sec - exiting 09:24:12 (3596): No heartbeat from core client for 30 sec - exiting 09:24:13 (3596): No heartbeat from core client for 30 sec - exiting 09:24:14 (3596): No heartbeat from core client for 30 sec - exiting 09:24:15 (3596): No heartbeat from core client for 30 sec - exiting 09:24:16 (3596): No heartbeat from core client for 30 sec - exiting 09:24:17 (3596): No heartbeat from core client for 30 sec - exiting 09:24:18 (3596): No heartbeat from core client for 30 sec - exiting 09:24:19 (3596): No heartbeat from core client for 30 sec - exiting 09:24:20 (3596): No heartbeat from core client for 30 sec - exiting 09:24:21 (3596): No heartbeat from core client for 30 sec - exiting 09:24:22 (3596): No heartbeat from core client for 30 sec - exiting 09:24:23 (3596): No heartbeat from core client for 30 sec - exiting 09:24:24 (3596): No heartbeat from core client for 30 sec - exiting 09:24:25 (3596): No heartbeat from core client for 30 sec - exiting 09:24:26 (3596): No heartbeat from core client for 30 sec - exiting 09:24:27 (3596): No heartbeat from core client for 30 sec - exiting 09:24:28 (3596): No heartbeat from core client for 30 sec - exiting 09:24:29 (3596): No heartbeat from core client for 30 sec - exiting 09:24:30 (3596): No heartbeat from core client for 30 sec - exiting 09:24:31 (3596): No heartbeat from core client for 30 sec - exiting 09:24:32 (3596): No heartbeat from core client for 30 sec - exiting 09:24:33 (3596): No heartbeat from core client for 30 sec - exiting 09:24:34 (3596): No heartbeat from core client for 30 sec - exiting 09:24:35 (3596): No heartbeat from core client for 30 sec - exiting 09:24:36 (3596): No heartbeat from core client for 30 sec - exiting 09:24:37 (3596): No heartbeat from core client for 30 sec - exiting 09:24:38 (3596): No heartbeat from core client for 30 sec - exiting 09:24:39 (3596): No heartbeat from core client for 30 sec - exiting 09:24:40 (3596): No heartbeat from core client for 30 sec - exiting 09:24:41 (3596): No heartbeat from core client for 30 sec - exiting 09:24:42 (3596): No heartbeat from core client for 30 sec - exiting 09:24:43 (3596): No heartbeat from core client for 30 sec - exiting 09:24:44 (3596): No heartbeat from core client for 30 sec - exiting 09:24:45 (3596): No heartbeat from core client for 30 sec - exiting 09:24:46 (3596): No heartbeat from core client for 30 sec - exiting 09:24:47 (3596): No heartbeat from core client for 30 sec - exiting 09:24:48 (3596): No heartbeat from core client for 30 sec - exiting 09:24:49 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:50 (3596): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3108, selfPID=3108, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN proceCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3736, selfPID=3736, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4568, selfPID=4568, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4944, selfPID=4944, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3636, selfPID=3636, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4396, selfPID=4396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6116, selfPID=6116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4604, selfPID=4604, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4936, selfPID=4936, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4104, selfPID=4104, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4980, selfPID=4980, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3348, selfPID=3348, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3252, selfPID=3252, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5404, selfPID=5404, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5572, selfPID=5572, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_dhry_2047_1_008279402_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_dhry_2047_1_008279402_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_dhry_2047_1_008279402_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Dec 2013 19:32:35	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	103,776	241,716	2.3292
21 Dec 2013 13:26:13	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	92,256	216,255	2.3441
20 Dec 2013 11:11:31	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	80,736	189,772	2.3505
18 Dec 2013 20:06:29	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	69,216	163,500	2.3622
16 Dec 2013 08:43:56	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	57,701	136,978	2.3739
16 Dec 2013 07:33:36	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	57,696	136,622	2.3680
13 Dec 2013 20:06:28	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	46,182	109,753	2.3765
13 Dec 2013 19:06:06	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	46,176	109,363	2.3684
12 Dec 2013 15:55:48	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	34,656	82,538	2.3816
10 Dec 2013 17:37:00	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	23,136	55,737	2.4091
08 Dec 2013 21:54:51	1301991	16135596	hadam3p_pnw_dhry_2047_1_008279402_1	11,616	28,435	2.4479