Task 12617056

Name	hadam3p_pnw_2y4u_1974_1_007177734_0
Workunit	7376016
Created	22 Feb 2011, 11:45:16 UTC
Sent	9 Mar 2011, 1:05:31 UTC
Report deadline	19 Feb 2012, 6:25:31 UTC
Received	10 Mar 2011, 20:28:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1082558
Run time	1 days 6 hours 24 min 1 sec
CPU time	23 hours 31 min 3 sec
Validate state	Invalid
Credit	502.72
Device peak FLOPS	2.55 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.08 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3624, selfPID=3624, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4152, selfPID=4152, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1904, selfPID=1904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2684, selfPID=2684, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2144, selfPID=2144, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5088, selfPID=5088, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3564, selfPID=6008, iMonCtr=1 Model crash detected, will try to restart... 22:59:17 (4660): No heartbeat from core client for 30 sec - exiting 22:59:18 (4660): No heartbeat from core client for 30 sec - exiting 22:59:19 (4660): No heartbeat from core client for 30 sec - exiting 22:59:20 (4660): No heartbeat from core client for 30 sec - exiting 22:59:21 (4660): No heartbeat from core client for 30 sec - exiting 22:59:22 (4660): No heartbeat from core client for 30 sec - exiting 22:59:23 (4660): No heartbeat from core client for 30 sec - exiting 22:59:24 (4660): No heartbeat from core client for 30 sec - exiting 22:59:25 (4660): No heartbeat from core client for 30 sec - exiting 22:59:26 (4660): No heartbeat from core client for 30 sec - exiting 22:59:27 (4660): No heartbeat from core client for 30 sec - exiting 22:59:28 (4660): No heartbeat from core client for 30 sec - exiting 22:59:29 (4660): No heartbeat from core client for 30 sec - exiting 22:59:30 (4660): No heartbeat from core client for 30 sec - exiting 22:59:31 (4660): No heartbeat from core client for 30 sec - exiting 22:59:32 (4660): No heartbeat from core client for 30 sec - exiting 22:59:33 (4660): No heartbeat from core client for 30 sec - exiting 22:59:34 (4660): No heartbeat from core client for 30 sec - exiting 22:59:35 (4660): No heartbeat from core client for 30 sec - exiting 22:59:36 (4660): No heartbeat from core client for 30 sec - exiting 22:59:37 (4660): No heartbeat from core client for 30 sec - exiting 22:59:38 (4660): No heartbeat from core client for 30 sec - exiting 22:59:39 (4660): No heartbeat from core client for 30 sec - exiting 22:59:40 (4660): No heartbeat from core client for 30 sec - exiting 22:59:41 (4660): No heartbeat from core client for 30 sec - exiting 22:59:42 (4660): No heartbeat from core client for 30 sec - exiting 22:59:43 (4660): No heartbeat from core client for 30 sec - exiting 22:59:44 (4660): No heartbeat from core client for 30 sec - exiting 22:59:45 (4660): No heartbeat from core client for 30 sec - exiting 22:59:46 (4660): No heartbeat from core client for 30 sec - exiting 22:59:47 (4660): No heartbeat from core client for 30 sec - exiting 22:59:48 (4660): No heartbeat from core client for 30 sec - exiting 22:59:49 (4660): No heartbeat from core client for 30 sec - exiting 22:59:50 (4660): No heartbeat from core client for 30 sec - exiting 22:59:51 (4660): No heartbeat from core client for 30 sec - exiting 22:59:52 (4660): No heartbeat from core client for 30 sec - exiting 22:59:53 (4660): No heartbeat from core client for 30 sec - exiting 22:59:54 (4660): No heartbeat from core client for 30 sec - exiting 22:59:55 (4660): No heartbeat from core client for 30 sec - exiting 22:59:56 (4660): No heartbeat from core client for 30 sec - exiting 22:59:57 (4660): No heartbeat from core client for 30 sec - exiting 22:59:58 (4660): No heartbeat from core client for 30 sec - exiting 22:59:59 (4660): No heartbeat from core client for 30 sec - exiting 23:00:00 (4660): No heartbeat from core client for 30 sec - exiting 23:00:01 (4660): No heartbeat from core client for 30 sec - exiting 23:00:02 (4660): No heartbeat from core client for 30 sec - exiting 23:00:03 (4660): No heartbeat from core client for 30 sec - exiting 23:00:04 (4660): No heartbeat from core client for 30 sec - exiting 23:00:05 (4660): No heartbeat from core client for 30 sec - exiting 23:00:06 (4660): No heartbeat from core client for 30 sec - exiting 23:00:07 (4660): No heartbeat from core client for 30 sec - exiting 23:00:08 (4660): No heartbeat from core client for 30 sec - exiting 23:00:09 (4660): No heartbeat from core client for 30 sec - exiting 23:00:10 (4660): No heartbeat from core client for 30 sec - exiting 23:00:11 (4660): No heartbeat from core client for 30 sec - exiting 23:00:12 (4660): No heartbeat from core client for 30 sec - exiting 23:00:13 (4660): No heartbeat from core client for 30 sec - exiting 23:00:14 (4660): No heartbeat from core client for 30 sec - exiting 23:00:15 (4660): No heartbeat from core client for 30 sec - exiting 23:00:16 (4660): No heartbeat from core client for 30 sec - exiting 23:00:17 (4660): No heartbeat from core client for 30 sec - exiting 23:00:18 (4660): No heartbeat from core client for 30 sec - exiting 23:00:19 (4660): No heartbeat from core client for 30 sec - exiting 23:00:20 (4660): No heartbeat from core client for 30 sec - exiting 23:00:21 (4660): No heartbeat from core client for 30 sec - exiting 23:00:22 (4660): No heartbeat from core client for 30 sec - exiting 23:00:23 (4660): No heartbeat from core client for 30 sec - exiting 23:00:24 (4660): No heartbeat from core client for 30 sec - exiting 23:00:25 (4660): No heartbeat from core client for 30 sec - exiting 23:00:26 (4660): No heartbeat from core client for 30 sec - exiting 23:00:27 (4660): No heartbeat from core client for 30 sec - exiting 23:00:28 (4660): No heartbeat from core client for 30 sec - exiting 23:00:29 (4660): No heartbeat from core client for 30 sec - exiting 23:00:30 (4660): No heartbeat from core client for 30 sec - exiting 23:00:31 (4660): No heartbeat from core client for 30 sec - exiting 23:00:32 (4660): No heartbeat from core client for 30 sec - exiting 23:00:33 (4660): No heartbeat from core client for 30 sec - exiting 23:00:34 (4660): No heartbeat from core client for 30 sec - exiting 23:00:35 (4660): No heartbeat from core client for 30 sec - exiting 23:00:36 (4660): No heartbeat from core client for 30 sec - exiting 23:00:37 (4660): No heartbeat from core client for 30 sec - exiting 23:00:38 (4660): No heartbeat from core client for 30 sec - exiting 23:00:39 (4660): No heartbeat from core client for 30 sec - exiting 23:00:40 (4660): No heartbeat from core client for 30 sec - exiting 23:00:41 (4660): No heartbeat from core client for 30 sec - exiting 23:00:42 (4660): No heartbeat from core client for 30 sec - exiting 23:00:43 (4660): No heartbeat from core client for 30 sec - exiting 23:00:44 (4660): No heartbeat from core client for 30 sec - exiting 23:00:45 (4660): No heartbeat from core client for 30 sec - exiting 23:00:46 (4660): No heartbeat from core client for 30 sec - exiting 23:00:47 (4660): No heartbeat from core client for 30 sec - exiting 23:00:48 (4660): No heartbeat from core client for 30 sec - exiting 23:00:49 (4660): No heartbeat from core client for 30 sec - exiting 23:00:50 (4660): No heartbeat from core client for 30 sec - exiting 23:00:51 (4660): No heartbeat from core client for 30 sec - exiting 23:00:52 (3976): Can't acquire lockfile (32) - waiting 35s 23:00:52 (4660): No heartbeat from core client for 30 sec - exiting 23:00:53 (4660): No heartbeat from core client for 30 sec - exiting 23:00:54 (4660): No heartbeat from core client for 30 sec - exiting 23:00:55 (4660): No heartbeat from core client for 30 sec - exiting 23:00:56 (4660): No heartbeat from core client for 30 sec - exiting 23:00:57 (4660): No heartbeat from core client for 30 sec - exiting 23:00:58 (4660): No heartbeat from core client for 30 sec - exiting 23:00:59 (4660): No heartbeat from core client for 30 sec - exiting 23:01:00 (4660): No heartbeat from core client for 30 sec - exiting 23:01:01 (4660): No heartbeat from core client for 30 sec - exiting 23:01:02 (4660): No heartbeat from core client for 30 sec - exiting 23:01:03 (4660): No heartbeat from core client for 30 sec - exiting 23:01:04 (4660): No heartbeat from core client for 30 sec - exiting 23:01:05 (4660): No heartbeat from core client for 30 sec - exiting 23:01:06 (4660): No heartbeat from core client for 30 sec - exiting 23:01:07 (4660): No heartbeat from core client for 30 sec - exiting 23:01:08 (4660): No heartbeat from core client for 30 sec - exiting 23:01:09 (4660): No heartbeat from core client for 30 sec - exiting 23:01:10 (4660): No heartbeat from core client for 30 sec - exiting 23:01:11 (4660): No heartbeat from core client for 30 sec - exiting 23:01:12 (4660): No heartbeat from core client for 30 sec - exiting 23:01:13 (4660): No heartbeat from core client for 30 sec - exiting 23:01:14 (4660): No heartbeat from core client for 30 sec - exiting 23:01:15 (4660): No heartbeat from core client for 30 sec - exiting 23:01:16 (4660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=592, selfPID=592, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4904, selfPID=4904, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4448, selfPID=4448, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4372, selfPID=4372, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3012, selfPID=3012, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2852, selfPID=2852, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1376, selfPID=1376, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4956, selfPID=4956, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3576, selfPID=3576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4996, selfPID=4996, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=1688, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2392, selfPID=2336, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 15:27:02 (2336): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_2y4u_1974_1_007177734_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Mar 2011 12:24:14	1082558	12617056	hadam3p_pnw_2y4u_1974_1_007177734_0	23,136	79,745	3.4468
09 Mar 2011 23:51:03	1082558	12617056	hadam3p_pnw_2y4u_1974_1_007177734_0	11,616	39,945	3.4388