Task 13377580

Name	hadam3p_eu_2sq4_1981_1_007384897_2
Workunit	7582327
Created	12 Sep 2011, 11:27:59 UTC
Sent	12 Sep 2011, 11:32:16 UTC
Report deadline	24 Aug 2012, 16:52:16 UTC
Received	13 Sep 2011, 13:08:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	962831
Run time	12 hours 44 min 43 sec
CPU time	11 hours 17 min 13 sec
Validate state	Invalid
Credit	200.38
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 16:50:13 (156540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:14 (156540): No heartbeat from core client for 30 sec - exiting 16:50:15 (156540): No heartbeat from core client for 30 sec - exiting 16:50:16 (156540): No heartbeat from core client for 30 sec - exiting 16:50:17 (156540): No heartbeat from core client for 30 sec - exiting 16:50:18 (156540): No heartbeat from core client for 30 sec - exiting 16:50:19 (156540): No heartbeat from core client for 30 sec - exiting 16:50:20 (156540): No heartbeat from core client for 30 sec - exiting 16:50:21 (156540): No heartbeat from core client for 30 sec - exiting 16:50:22 (156540): No heartbeat from core client for 30 sec - exiting 16:50:23 (156540): No heartbeat from core client for 30 sec - exiting 16:50:24 (156540): No heartbeat from core client for 30 sec - exiting 16:50:25 (156540): No heartbeat from core client for 30 sec - exiting 16:50:26 (156540): No heartbeat from core client for 30 sec - exiting 16:50:27 (156540): No heartbeat from core client for 30 sec - exiting 16:50:28 (156540): No heartbeat from core client for 30 sec - exiting 16:50:29 (156540): No heartbeat from core client for 30 sec - exiting 16:50:30 (156540): No heartbeat from core client for 30 sec - exiting 16:50:31 (156540): No heartbeat from core client for 30 sec - exiting 16:50:32 (156540): No heartbeat from core client for 30 sec - exiting 16:50:33 (156540): No heartbeat from core client for 30 sec - exiting 16:50:34 (156540): No heartbeat from core client for 30 sec - exiting 16:50:35 (156540): No heartbeat from core client for 30 sec - exiting 16:50:36 (156540): No heartbeat from core client for 30 sec - exiting 16:50:37 (156540): No heartbeat from core client for 30 sec - exiting 16:50:38 (156540): No heartbeat from core client for 30 sec - exiting 16:50:39 (156540): No heartbeat from core client for 30 sec - exiting 16:50:40 (156540): No heartbeat from core client for 30 sec - exiting 16:50:41 (156540): No heartbeat from core client for 30 sec - exiting 16:50:42 (156540): No heartbeat from core client for 30 sec - exiting 16:50:43 (156540): No heartbeat from core client for 30 sec - exiting 16:50:44 (156540): No heartbeat from core client for 30 sec - exiting 16:50:45 (156540): No heartbeat from core client for 30 sec - exiting 16:50:46 (156540): No heartbeat from core client for 30 sec - exiting 16:50:47 (156540): No heartbeat from core client for 30 sec - exiting 16:50:48 (156540): No heartbeat from core client for 30 sec - exiting 16:50:49 (156540): No heartbeat from core client for 30 sec - exiting 16:50:50 (156540): No heartbeat from core client for 30 sec - exiting 16:50:51 (156540): No heartbeat from core client for 30 sec - exiting 16:50:52 (156540): No heartbeat from core client for 30 sec - exiting 16:50:53 (156540): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=156512, selfPID=156512, iMonCtr=2 16:50:54 (156540): No heartbeat from core client for 30 sec - exiting 16:50:55 (156540): No heartbeat from core client for 30 sec - exiting 16:50:56 (156540): No heartbeat from core client for 30 sec - exiting 16:50:57 (156540): No heartbeat from core client for 30 sec - exiting 16:50:58 (156540): No heartbeat from core client for 30 sec - exiting 16:50:59 (156540): No heartbeat from core client for 30 sec - exiting 16:51:00 (156540): No heartbeat from core client for 30 sec - exiting 16:51:01 (156540): No heartbeat from core client for 30 sec - exiting 16:51:02 (156540): No heartbeat from core client for 30 sec - exiting 16:51:03 (156540): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 06:51:19 (328368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:21 (328368): No heartbeat from core client for 30 sec - exiting 06:51:22 (328368): No heartbeat from core client for 30 sec - exiting 06:51:23 (328368): No heartbeat from core client for 30 sec - exiting 06:57:16 (172844): No heartbeat from core client for 30 sec - exiting 06:57:17 (172844): No heartbeat from core client for 30 sec - exiting 06:57:18 (172844): No heartbeat from core client for 30 sec - exiting 06:57:19 (172844): No heartbeat from core client for 30 sec - exiting 06:57:20 (172844): No heartbeat from core client for 30 sec - exiting 06:58:17 (172844): No heartbeat from core client for 30 sec - exiting 06:58:18 (172844): No heartbeat from core client for 30 sec - exiting 06:58:19 (172844): No heartbeat from core client for 30 sec - exiting 06:58:20 (172844): No heartbeat from core client for 30 sec - exiting 06:58:21 (172844): No heartbeat from core client for 30 sec - exiting 06:58:22 (172844): No heartbeat from core client for 30 sec - exiting 06:58:23 (172844): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=151076, iMonCtr=1 06:58:24 (172844): No heartbeat from core client for 30 sec - exiting 06:58:25 (172844): No heartbeat from core client for 30 sec - exiting 06:58:26 (172844): No heartbeat from core client for 30 sec - exiting 06:58:27 (172844): No heartbeat from core client for 30 sec - exiting 06:58:28 (172844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:58:29 (172844): No heartbeat from core client for 30 sec - exiting 09:55:01 (327740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:55:02 (327740): No heartbeat from core client for 30 sec - exiting 09:55:03 (327740): No heartbeat from core client for 30 sec - exiting 09:57:34 (328312): No heartbeat from core client for 30 sec - exiting 09:57:35 (328312): No heartbeat from core client for 30 sec - exiting 09:57:36 (328312): No heartbeat from core client for 30 sec - exiting 09:57:37 (328312): No heartbeat from core client for 30 sec - exiting 09:57:38 (328312): No heartbeat from core client for 30 sec - exiting 09:57:39 (328312): No heartbeat from core client for 30 sec - exiting 09:57:40 (328312): No heartbeat from core client for 30 sec - exiting 09:57:41 (328312): No heartbeat from core client for 30 sec - exiting 09:57:42 (328312): No heartbeat from core client for 30 sec - exiting 09:57:43 (328312): No heartbeat from core client for 30 sec - exiting 09:57:44 (328312): No heartbeat from core client for 30 sec - exiting 09:57:45 (328312): No heartbeat from core client for 30 sec - exiting 09:57:46 (328312): No heartbeat from core client for 30 sec - exiting 09:57:47 (328312): No heartbeat from core client for 30 sec - exiting 09:57:48 (328312): No heartbeat from core client for 30 sec - exiting 09:57:49 (328312): No heartbeat from core client for 30 sec - exiting 09:57:50 (328312): No heartbeat from core client for 30 sec - exiting 09:57:51 (328312): No heartbeat from core client for 30 sec - exiting 09:57:52 (328312): No heartbeat from core client for 30 sec - exiting 09:57:53 (328312): No heartbeat from core client for 30 sec - exiting 09:57:54 (328312): No heartbeat from core client for 30 sec - exiting 09:57:55 (328312): No heartbeat from core client for 30 sec - exiting 09:57:56 (328312): No heartbeat from core client for 30 sec - exiting 09:57:57 (328312): No heartbeat from core client for 30 sec - exiting 09:57:58 (328312): No heartbeat from core client for 30 sec - exiting 09:57:59 (328312): No heartbeat from core client for 30 sec - exiting 09:58:00 (328312): No heartbeat from core client for 30 sec - exiting 09:58:01 (328312): No heartbeat from core client for 30 sec - exiting 09:58:02 (328312): No heartbeat from core client for 30 sec - exiting 09:58:03 (328312): No heartbeat from core client for 30 sec - exiting 09:58:04 (328312): No heartbeat from core client for 30 sec - exiting 09:58:05 (328312): No heartbeat from core client for 30 sec - exiting 09:58:06 (328312): No heartbeat from core client for 30 sec - exiting 09:58:07 (328312): No heartbeat from core client for 30 sec - exiting 09:58:08 (328312): No heartbeat from core client for 30 sec - exiting 09:58:09 (328312): No heartbeat from core client for 30 sec - exiting 09:58:10 (328312): No heartbeat from core client for 30 sec - exiting 09:58:11 (328312): No heartbeat from core client for 30 sec - exiting 09:58:12 (328312): No heartbeat from core client for 30 sec - exiting 09:58:13 (328312): No heartbeat from core client for 30 sec - exiting 09:58:14 (328312): No heartbeat from core client for 30 sec - exiting 09:58:15 (328312): No heartbeat from core client for 30 sec - exiting 09:58:16 (328312): No heartbeat from core client for 30 sec - exiting 09:58:17 (328312): No heartbeat from core client for 30 sec - exiting 09:58:18 (328312): No heartbeat from core client for 30 sec - exiting 09:58:19 (328312): No heartbeat from core client for 30 sec - exiting 09:58:20 (328312): No heartbeat from core client for 30 sec - exiting 09:58:21 (328312): No heartbeat from core client for 30 sec - exiting 09:58:22 (328312): No heartbeat from core client for 30 sec - exiting 09:58:23 (328312): No heartbeat from core client for 30 sec - exiting 09:58:24 (328312): No heartbeat from core client for 30 sec - exiting 09:58:25 (328312): No heartbeat from core client for 30 sec - exiting 09:58:26 (328312): No heartbeat from core client for 30 sec - exiting 09:58:27 (328312): No heartbeat from core client for 30 sec - exiting 09:58:28 (328312): No heartbeat from core client for 30 sec - exiting 09:58:29 (328312): No heartbeat from core client for 30 sec - exiting 09:58:30 (328312): No heartbeat from core client for 30 sec - exiting 09:58:31 (328312): No heartbeat from core client for 30 sec - exiting 09:58:32 (328312): No heartbeat from core client for 30 sec - exiting 09:58:33 (328312): No heartbeat from core client for 30 sec - exiting 09:58:34 (328312): No heartbeat from core client for 30 sec - exiting 09:58:35 (328312): No heartbeat from core client for 30 sec - exiting 09:58:36 (328312): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=329216, iMonCtr=1 09:58:37 (328312): No heartbeat from core client for 30 sec - exiting 09:58:38 (328312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:23:56 (329328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:57 (329328): No heartbeat from core client for 30 sec - exiting 14:23:58 (329328): No heartbeat from core client for 30 sec - exiting 14:23:59 (329328): No heartbeat from core client for 30 sec - exiting 14:24:00 (329328): No heartbeat from core client for 30 sec - exiting 14:24:01 (329328): No heartbeat from core client for 30 sec - exiting 14:24:02 (329328): No heartbeat from core client for 30 sec - exiting 14:24:03 (329328): No heartbeat from core client for 30 sec - exiting 14:24:04 (329328): No heartbeat from core client for 30 sec - exiting 14:24:05 (329328): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=329516, selfPID=329516, iMonCtr=2 14:24:06 (329328): No heartbeat from core client for 30 sec - exiting 14:24:07 (329328): No heartbeat from core client for 30 sec - exiting 14:24:08 (329328): No heartbeat from core client for 30 sec - exiting 14:24:09 (329328): No heartbeat from core client for 30 sec - exiting 14:24:10 (329328): No heartbeat from core client for 30 sec - exiting 14:24:11 (329328): No heartbeat from core client for 30 sec - exiting 14:24:58 (330520): No heartbeat from core client for 30 sec - exiting 14:24:59 (330520): No heartbeat from core client for 30 sec - exiting 14:25:00 (330520): No heartbeat from core client for 30 sec - exiting 14:25:01 (330520): No heartbeat from core client for 30 sec - exiting 14:25:02 (330520): No heartbeat from core client for 30 sec - exiting 14:25:03 (330520): No heartbeat from core client for 30 sec - exiting 14:25:04 (330520): No heartbeat from core client for 30 sec - exiting 14:25:05 (330520): No heartbeat from core client for 30 sec - exiting 14:25:06 (330520): No heartbeat from core client for 30 sec - exiting 14:25:07 (330520): No heartbeat from core client for 30 sec - exiting 14:25:08 (330520): No heartbeat from core client for 30 sec - exiting 14:25:09 (330520): No heartbeat from core client for 30 sec - exiting 14:25:10 (330520): No heartbeat from core client for 30 sec - exiting 14:25:11 (330520): No heartbeat from core client for 30 sec - exiting 14:25:12 (330520): No heartbeat from core client for 30 sec - exiting 14:25:13 (330520): No heartbeat from core client for 30 sec - exiting 14:25:14 (330520): No heartbeat from core client for 30 sec - exiting 14:25:15 (330520): No heartbeat from core client for 30 sec - exiting 14:25:16 (330520): No heartbeat from core client for 30 sec - exiting 14:25:17 (330520): No heartbeat from core client for 30 sec - exiting 14:25:18 (330520): No heartbeat from core client for 30 sec - exiting 14:25:19 (330520): No heartbeat from core client for 30 sec - exiting 14:25:20 (330520): No heartbeat from core client for 30 sec - exiting 14:25:21 (330520): No heartbeat from core client for 30 sec - exiting 14:25:22 (330520): No heartbeat from core client for 30 sec - exiting 14:25:23 (330520): No heartbeat from core client for 30 sec - exiting 14:25:24 (330520): No heartbeat from core client for 30 sec - exiting 14:25:25 (330520): No heartbeat from core client for 30 sec - exiting 14:25:26 (330520): No heartbeat from core client for 30 sec - exiting 14:25:27 (330520): No heartbeat from core client for 30 sec - exiting 14:25:28 (330520): No heartbeat from core client for 30 sec - exiting 14:25:29 (330520): No heartbeat from core client for 30 sec - exiting 14:25:30 (330520): No heartbeat from core client for 30 sec - exiting 14:25:31 (330520): No heartbeat from core client for 30 sec - exiting 14:25:32 (330520): No heartbeat from core client for 30 sec - exiting 14:25:33 (330520): No heartbeat from core client for 30 sec - exiting 14:25:34 (330520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=328572, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=330488, selfPID=330280, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2sq4_1981_1_007384897_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Sep 2011 06:11:55	962831	13377580	hadam3p_eu_2sq4_1981_1_007384897_2	11,616	25,170	2.1668