Task 13977268

Name	hadam3p_pnw_8r31_2004_1_007708057_0
Workunit	7863165
Created	25 Jan 2012, 18:46:01 UTC
Sent	7 Feb 2012, 14:40:29 UTC
Report deadline	19 Jan 2013, 20:00:29 UTC
Received	7 Apr 2012, 17:36:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1184249
Run time	4 days 4 hours 8 min 9 sec
CPU time	2 hours 8 min 52 sec
Validate state	Invalid
Credit	1,253.67
Device peak FLOPS	3.50 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=784, selfPID=4312, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=884, selfPID=4468, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=3268, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3792, selfPID=2556, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1940, selfPID=1276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4148, selfPID=3660, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5352, selfPID=3380, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5060, selfPID=4008, iMonCtr=1 Model crash detected, will try to restart... 11:29:47 (2264): No heartbeat from core client for 30 sec - exiting 11:29:48 (2264): No heartbeat from core client for 30 sec - exiting 11:29:50 (2264): No heartbeat from core client for 30 sec - exiting 11:29:51 (2264): No heartbeat from core client for 30 sec - exiting 11:29:52 (2264): No heartbeat from core client for 30 sec - exiting 11:29:53 (2264): No heartbeat from core client for 30 sec - exiting 11:29:54 (2264): No heartbeat from core client for 30 sec - exiting 11:29:55 (2264): No heartbeat from core client for 30 sec - exiting 11:29:56 (2264): No heartbeat from core client for 30 sec - exiting 11:29:57 (2264): No heartbeat from core client for 30 sec - exiting 11:29:58 (2264): No heartbeat from core client for 30 sec - exiting 11:30:00 (2264): No heartbeat from core client for 30 sec - exiting 11:30:01 (2264): No heartbeat from core client for 30 sec - exiting 11:30:02 (2264): No heartbeat from core client for 30 sec - exiting 11:30:03 (2264): No heartbeat from core client for 30 sec - exiting 11:30:04 (2264): No heartbeat from core client for 30 sec - exiting 11:30:05 (2264): No heartbeat from core client for 30 sec - exiting 11:30:06 (2264): No heartbeat from core client for 30 sec - exiting 11:30:07 (2264): No heartbeat from core client for 30 sec - exiting 11:30:08 (2264): No heartbeat from core client for 30 sec - exiting 11:30:09 (2264): No heartbeat from core client for 30 sec - exiting 11:30:10 (2264): No heartbeat from core client for 30 sec - exiting 11:30:11 (2264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5104, selfPID=3712, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4264, selfPID=2284, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Called boinc_finish 21:33:22 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:23 (3292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:13:36 (4192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:13:38 (4192): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4084, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4532, selfPID=2460, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4524, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3876, selfPID=3248, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=168, selfPID=3240, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5276, selfPID=3272, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2304, selfPID=3892, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_8r31_2004_1_007708057_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r31_2004_1_007708057_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r31_2004_1_007708057_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r31_2004_1_007708057_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r31_2004_1_007708057_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r31_2004_1_007708057_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_8r31_2004_1_007708057_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Feb 2012 10:36:58	1184249	13977268	hadam3p_pnw_8r31_2004_1_007708057_0	57,696	75,253	1.3043
22 Feb 2012 17:03:15	1184249	13977268	hadam3p_pnw_8r31_2004_1_007708057_0	46,176	59,942	1.2981
22 Feb 2012 08:53:00	1184249	13977268	hadam3p_pnw_8r31_2004_1_007708057_0	34,656	44,949	1.2970
21 Feb 2012 14:29:59	1184249	13977268	hadam3p_pnw_8r31_2004_1_007708057_0	23,136	30,144	1.3029
09 Feb 2012 16:24:14	1184249	13977268	hadam3p_pnw_8r31_2004_1_007708057_0	11,616	15,197	1.3083