Task 12898011

Name	hadam3p_eu_447c_2001_1_007257809_2
Workunit	7456049
Created	20 May 2011, 2:05:15 UTC
Sent	20 May 2011, 2:05:27 UTC
Report deadline	1 May 2012, 7:25:27 UTC
Received	7 Jul 2011, 15:38:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1101951
Run time	15 days 11 hours 53 min 32 sec
CPU time	14 days 0 hours 0 min 57 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	0.67 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2808, selfPID=2808, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:25:26 (3612): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:53:10 (804): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:25:13 (1848): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3920, selfPID=3920, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1200, selfPID=1200, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 08:54:38 (740): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=476, seCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:02:16 (2156): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:22:03 (3160): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1668, selfPID=1668, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CNo Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=448, selfPID=3344, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=448, selfPID=448, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 07:37:40 (448): Can't acquire lockfile (32) - waiting 35s 07:38:21 (968): Can't acquire lockfile (32) - waiting 35s Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1988, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=668, selfPID=668, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=692, selfPID=692, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:14:08 (2648): No heartbeat from core client for 30 sec - exiting 19:14:09 (2648): No heartbeat from core client for 30 sec - exiting 19:14:10 (2648): No heartbeat from core client for 30 sec - exiting 19:14:12 (2648): No heartbeat from core client for 30 sec - exiting 19:14:14 (2648): No heartbeat from core client for 30 sec - exiting 19:14:15 (2648): No heartbeat from core client for 30 sec - exiting 19:14:16 (2648): No heartbeat from core client for 30 sec - exiting 19:14:18 (2648): No heartbeat from core client for 30 sec - exiting 19:14:19 (2648): No heartbeat from core client for 30 sec - exiting 19:14:20 (2648): No heartbeat from core client for 30 sec - exiting 19:14:21 (2648): No heartbeat from core client for 30 sec - exiting 19:14:23 (2648): No heartbeat from core client for 30 sec - exiting 19:14:24 (2648): No heartbeat from core client for 30 sec - exiting 19:14:25 (2648): No heartbeat from core client for 30 sec - exiting 19:14:26 (2648): No heartbeat from core client for 30 sec - exiting 19:14:27 (2648): No heartbeat from core client for 30 sec - exiting 19:14:29 (2648): No heartbeat from core client for 30 sec - exiting 19:14:30 (2648): No heartbeat from core client for 30 sec - exiting 19:14:31 (2648): No heartbeat from core client for 30 sec - exiting 19:14:32 (2648): No heartbeat from core client for 30 sec - exiting 19:14:33 (2648): No heartbeat from core client for 30 sec - exiting 19:14:34 (2648): No heartbeat from core client for 30 sec - exiting 19:14:35 (2648): No heartbeat from core client for 30 sec - exiting 19:14:36 (2648): No heartbeat from core client for 30 sec - exiting 19:14:37 (2648): No heartbeat from core client for 30 sec - exiting 19:14:38 (2648): No heartbeat from core client for 30 sec - exiting 19:14:39 (2648): No heartbeat from core client for 30 sec - exiting 19:14:40 (2648): No heartbeat from core client for 30 sec - exiting 19:14:41 (2648): No heartbeat from core client for 30 sec - exiting 19:14:43 (2648): No heartbeat from core client for 30 sec - exiting 19:14:44 (2648): No heartbeat from core client for 30 sec - exiting 19:14:45 (2648): No heartbeat from core client for 30 sec - exiting 19:14:46 (2648): No heartbeat from core client for 30 sec - exiting 19:14:47 (2648): No heartbeat from core client for 30 sec - exiting 19:14:48 (2648): No heartbeat from core client for 30 sec - exiting 19:14:49 (2648): No heartbeat from core client for 30 sec - exiting 19:14:50 (2648): No heartbeat from core client for 30 sec - exiting 19:14:51 (2648): No heartbeat from core client for 30 sec - exiting 19:14:53 (2648): No heartbeat from core client for 30 sec - exiting 19:14:54 (2648): No heartbeat from core client for 30 sec - exiting 19:14:55 (2648): No heartbeat from core client for 30 sec - exiting 19:14:56 (2648): No heartbeat from core client for 30 sec - exiting 19:14:57 (2648): No heartbeat from core client for 30 sec - exiting 19:14:58 (2648): No heartbeat from core client for 30 sec - exiting 19:14:59 (2648): No heartbeat from core client for 30 sec - exiting 19:15:00 (2648): No heartbeat from core client for 30 sec - exiting 19:15:02 (2648): No heartbeat from core client for 30 sec - exiting 19:15:03 (2648): No heartbeat from core client for 30 sec - exiting 19:15:04 (2648): No heartbeat from core client for 30 sec - exiting 19:15:05 (2648): No heartbeat from core client for 30 sec - exiting 19:15:06 (2648): No heartbeat from core client for 30 sec - exiting 19:15:07 (2648): No heartbeat from core client for 30 sec - exiting 19:15:08 (2648): No heartbeat from core client for 30 sec - exiting 19:15:09 (2648): No heartbeat from core client for 30 sec - exiting 19:15:10 (2648): No heartbeat from core client for 30 sec - exiting 19:15:11 (2648): No heartbeat from core client for 30 sec - exiting 19:15:12 (2648): No heartbeat from core client for 30 sec - exiting 19:15:14 (2648): No heartbeat from core client for 30 sec - exiting 19:15:15 (2648): No heartbeat from core client for 30 sec - exiting 19:15:16 (2648): No heartbeat from core client for 30 sec - exiting 19:15:17 (2648): No heartbeat from core client for 30 sec - exiting 19:15:18 (2648): No heartbeat from core client for 30 sec - exiting 19:15:19 (2648): No heartbeat from core client for 30 sec - exiting 19:15:20 (2648): No heartbeat from core client for 30 sec - exiting 19:15:21 (2648): No heartbeat from core client for 30 sec - exiting 19:15:23 (2648): No heartbeat from core client for 30 sec - exiting 19:15:24 (2648): No heartbeat from core client for 30 sec - exiting 19:15:25 (2648): No heartbeat from core client for 30 sec - exiting 19:15:26 (2648): No heartbeat from core client for 30 sec - exiting 19:15:27 (2648): No heartbeat from core client for 30 sec - exiting 19:15:29 (2648): No heartbeat from core client for 30 sec - exiting 19:15:30 (2648): No heartbeat from core client for 30 sec - exiting 19:15:31 (2648): No heartbeat from core client for 30 sec - exiting 19:15:32 (2648): No heartbeat from core client for 30 sec - exiting 19:15:33 (2648): No heartbeat from core client for 30 sec - exiting 19:15:34 (2648): No heartbeat from core client for 30 sec - exiting 19:15:35 (2648): No heartbeat from core client for 30 sec - exiting 19:15:36 (2648): No heartbeat from core client for 30 sec - exiting 19:15:38 (2648): No heartbeat from core client for 30 sec - exiting 19:15:39 (2648): No heartbeat from core client for 30 sec - exiting 19:15:40 (2648): No heartbeat from core client for 30 sec - exiting 19:15:41 (2648): No heartbeat from core client for 30 sec - exiting 19:15:42 (2648): No heartbeat from core client for 30 sec - exiting 19:15:43 (2648): No heartbeat from core client for 30 sec - exiting 19:15:44 (2648): No heartbeat from core client for 30 sec - exiting 19:15:45 (2648): No heartbeat from core client for 30 sec - exiting 19:15:46 (2648): No heartbeat from core client for 30 sec - exiting 19:15:47 (2648): No heartbeat from core client for 30 sec - exiting 19:15:49 (2648): No heartbeat from core client for 30 sec - exiting 19:15:50 (2648): No heartbeat from core client for 30 sec - exiting 19:15:51 (2648): No heartbeat from core client for 30 sec - exiting 19:15:52 (2648): No heartbeat from core client for 30 sec - exiting 19:15:53 (2648): No heartbeat from core client for 30 sec - exiting 19:15:54 (2648): No heartbeat from core client for 30 sec - exiting 19:15:55 (2648): No heartbeat from core client for 30 sec - exiting 19:15:56 (2648): No heartbeat from core client for 30 sec - exiting 19:15:57 (2648): No heartbeat from core client for 30 sec - exiting 19:15:58 (2648): No heartbeat from core client for 30 sec - exiting 19:16:00 (2648): No heartbeat from core client for 30 sec - exiting 19:16:01 (2648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... zip error: Could not create output file (was replacing the original zip file) Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_447c_2001_1_007257809_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_447c_2001_1_007257809_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_447c_2001_1_007257809_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_447c_2001_1_007257809_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_447c_2001_1_007257809_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jul 2011 15:58:25	1101951	12898011	hadam3p_eu_447c_2001_1_007257809_2	80,736	1,211,994	15.0118
19 Jun 2011 22:05:51	1101951	12898011	hadam3p_eu_447c_2001_1_007257809_2	69,216	1,028,125	14.8539
15 Jun 2011 20:55:49	1101951	12898011	hadam3p_eu_447c_2001_1_007257809_2	57,696	869,841	15.0763
12 Jun 2011 01:30:26	1101951	12898011	hadam3p_eu_447c_2001_1_007257809_2	46,176	683,631	14.8049
08 Jun 2011 01:29:33	1101951	12898011	hadam3p_eu_447c_2001_1_007257809_2	34,656	509,194	14.6928
03 Jun 2011 20:03:36	1101951	12898011	hadam3p_eu_447c_2001_1_007257809_2	23,136	338,514	14.6315
01 Jun 2011 08:27:43	1101951	12898011	hadam3p_eu_447c_2001_1_007257809_2	11,616	175,471	15.1060