Task 11678865

Name	hadam3p_eu_vbid_1996_1_006676163_0
Workunit	6879416
Created	26 Aug 2010, 10:32:49 UTC
Sent	28 Aug 2010, 17:12:34 UTC
Report deadline	10 Aug 2011, 22:32:34 UTC
Received	22 Dec 2010, 0:16:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1096809
Run time	11 hours 12 min 48 sec
CPU time	10 hours 47 min
Validate state	Invalid
Credit	200.40
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.05 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5268, selfPID=5268, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:58:01 (3456): No heartbeat from core client for 30 sec - exiting 21:58:02 (3456): No heartbeat from core client for 30 sec - exiting 21:58:03 (3456): No heartbeat from core client for 30 sec - exiting 21:58:04 (3456): No heartbeat from core client for 30 sec - exiting 21:58:05 (3456): No heartbeat from core client for 30 sec - exiting 21:58:06 (3456): No heartbeat from core client for 30 sec - exiting 21:58:07 (3456): No heartbeat from core client for 30 sec - exiting 21:58:08 (3456): No heartbeat from core client for 30 sec - exiting 21:58:09 (3456): No heartbeat from core client for 30 sec - exiting 21:58:10 (3456): No heartbeat from core client for 30 sec - exiting 21:58:11 (3456): No heartbeat from core client for 30 sec - exiting 21:58:12 (3456): No heartbeat from core client for 30 sec - exiting 21:58:13 (3456): No heartbeat from core client for 30 sec - exiting 21:58:14 (3456): No heartbeat from core client for 30 sec - exiting 21:58:15 (3456): No heartbeat from core client for 30 sec - exiting 21:58:16 (3456): No heartbeat from core client for 30 sec - exiting 21:58:17 (3456): No heartbeat from core client for 30 sec - exiting 21:58:18 (3456): No heartbeat from core client for 30 sec - exiting 21:58:19 (3456): No heartbeat from core client for 30 sec - exiting 21:58:20 (3456): No heartbeat from core client for 30 sec - exiting 21:58:21 (3456): No heartbeat from core client for 30 sec - exiting 21:58:22 (3456): No heartbeat from core client for 30 sec - exiting 21:58:23 (3456): No heartbeat from core client for 30 sec - exiting 21:58:24 (3456): No heartbeat from core client for 30 sec - exiting 21:58:25 (3456): No heartbeat from core client for 30 sec - exiting 21:58:26 (3456): No heartbeat from core client for 30 sec - exiting 21:58:27 (3456): No heartbeat from core client for 30 sec - exiting 21:58:28 (3456): No heartbeat from core client for 30 sec - exiting 21:58:29 (3456): No heartbeat from core client for 30 sec - exiting 21:58:30 (3456): No heartbeat from core client for 30 sec - exiting 21:58:31 (3456): No heartbeat from core client for 30 sec - exiting 21:58:32 (3456): No heartbeat from core client for 30 sec - exiting 21:58:33 (3456): No heartbeat from core client for 30 sec - exiting 21:58:34 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4076, selfPID=4076, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDNSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2868, selfPID=2868, iMonCtr=2 19:40:23 (4880): No heartbeat from core client for 30 sec - exiting 19:40:24 (4880): No heartbeat from core client for 30 sec - exiting 19:40:26 (4880): No heartbeat from core client for 30 sec - exiting 19:40:27 (4880): No heartbeat from core client for 30 sec - exiting 19:40:28 (4880): No heartbeat from core client for 30 sec - exiting 19:40:29 (4880): No heartbeat from core client for 30 sec - exiting 19:40:30 (4880): No heartbeat from core client for 30 sec - exiting 19:40:31 (4880): No heartbeat from core client for 30 sec - exiting 19:40:32 (4880): No heartbeat from core client for 30 sec - exiting 19:40:33 (4880): No heartbeat from core client for 30 sec - exiting 19:40:34 (4880): No heartbeat from core client for 30 sec - exiting 19:40:35 (4880): No heartbeat from core client for 30 sec - exiting 19:40:36 (4880): No heartbeat from core client for 30 sec - exiting 19:40:38 (4880): No heartbeat from core client for 30 sec - exiting 19:40:39 (4880): No heartbeat from core client for 30 sec - exiting 19:40:40 (4880): No heartbeat from core client for 30 sec - exiting 19:40:41 (4880): No heartbeat from core client for 30 sec - exiting 19:40:42 (4880): No heartbeat from core client for 30 sec - exiting 19:40:43 (4880): No heartbeat from core client for 30 sec - exiting 19:40:44 (4880): No heartbeat from core client for 30 sec - exiting 19:40:45 (4880): No heartbeat from core client for 30 sec - exiting 19:40:46 (4880): No heartbeat from core client for 30 sec - exiting 19:40:47 (4880): No heartbeat from core client for 30 sec - exiting 19:40:49 (4880): No heartbeat from core client for 30 sec - exiting 19:40:50 (4880): No heartbeat from core client for 30 sec - exiting 19:40:51 (4880): No heartbeat from core client for 30 sec - exiting 19:40:52 (4880): No heartbeat from core client for 30 sec - exiting 19:40:53 (4880): No heartbeat from core client for 30 sec - exiting 19:40:54 (4880): No heartbeat from core client for 30 sec - exiting 19:40:55 (4880): No heartbeat from core client for 30 sec - exiting 19:40:56 (4880): No heartbeat from core client for 30 sec - exiting 19:40:57 (4880): No heartbeat from core client for 30 sec - exiting 19:40:58 (4880): No heartbeat from core client for 30 sec - exiting 19:40:59 (4880): No heartbeat from core client for 30 sec - exiting 19:41:00 (4880): No heartbeat from core client for 30 sec - exiting 19:41:01 (4880): No heartbeat from core client for 30 sec - exiting 19:41:02 (4880): No heartbeat from core client for 30 sec - exiting 19:41:03 (4880): No heartbeat from core client for 30 sec - exiting 19:41:04 (4880): No heartbeat from core client for 30 sec - exiting No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4276, selfPID=0, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4276, selfPID=4276, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:04 (4456): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... 12:56:57 (4868): No heartbeat from core client for 30 sec - exiting 12:56:58 (4868): No heartbeat from core client for 30 sec - exiting 12:56:59 (4868): No heartbeat from core client for 30 sec - exiting 12:57:00 (4868): No heartbeat from core client for 30 sec - exiting 12:57:01 (4868): No heartbeat from core client for 30 sec - exiting 12:57:02 (4868): No heartbeat from core client for 30 sec - exiting 12:57:03 (4868): No heartbeat from core client for 30 sec - exiting 12:57:04 (4868): No heartbeat from core client for 30 sec - exiting 12:57:05 (4868): No heartbeat from core client for 30 sec - exiting 12:57:06 (4868): No heartbeat from core client for 30 sec - exiting 12:57:07 (4868): No heartbeat from core client for 30 sec - exiting 12:57:08 (4868): No heartbeat from core client for 30 sec - exiting 12:57:09 (4868): No heartbeat from core client for 30 sec - exiting 12:57:10 (4868): No heartbeat from core client for 30 sec - exiting 12:57:11 (4868): No heartbeat from core client for 30 sec - exiting 12:57:12 (4868): No heartbeat from core client for 30 sec - exiting 12:57:13 (4868): No heartbeat from core client for 30 sec - exiting 12:57:14 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:38:47 (1396): No heartbeat from core client for 30 sec - exiting 13:38:48 (1396): No heartbeat from core client for 30 sec - exiting 13:38:49 (1396): No heartbeat from core client for 30 sec - exiting 13:38:50 (1396): No heartbeat from core client for 30 sec - exiting 13:38:51 (1396): No heartbeat from core client for 30 sec - exiting 13:38:52 (1396): No heartbeat from core client for 30 sec - exiting 13:38:53 (1396): No heartbeat from core client for 30 sec - exiting 13:38:54 (1396): No heartbeat from core client for 30 sec - exiting 13:38:55 (1396): No heartbeat from core client for 30 sec - exiting 13:38:56 (1396): No heartbeat from core client for 30 sec - exiting 13:38:57 (1396): No heartbeat from core client for 30 sec - exiting 13:38:58 (1396): No heartbeat from core client for 30 sec - exiting 13:38:59 (1396): No heartbeat from core client for 30 sec - exiting 13:39:00 (1396): No heartbeat from core client for 30 sec - exiting 13:39:01 (1396): No heartbeat from core client for 30 sec - exiting 13:39:02 (1396): No heartbeat from core client for 30 sec - exiting 13:39:03 (1396): No heartbeat from core client for 30 sec - exiting 13:39:04 (1396): No heartbeat from core client for 30 sec - exiting 13:39:05 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:45:34 (2188): No heartbeat from core client for 30 sec - exiting 17:45:35 (2188): No heartbeat from core client for 30 sec - exiting 17:45:36 (2188): No heartbeat from core client for 30 sec - exiting 17:45:37 (2188): No heartbeat from core client for 30 sec - exiting 17:45:38 (2188): No heartbeat from core client for 30 sec - exiting 17:45:39 (2188): No heartbeat from core client for 30 sec - exiting 17:45:40 (2188): No heartbeat from core client for 30 sec - exiting 17:45:41 (2188): No heartbeat from core client for 30 sec - exiting 17:45:42 (2188): No heartbeat from core client for 30 sec - exiting 17:45:44 (2188): No heartbeat from core client for 30 sec - exiting 17:45:45 (2188): No heartbeat from core client for 30 sec - exiting 17:45:46 (2188): No heartbeat from core client for 30 sec - exiting 17:45:47 (2188): No heartbeat from core client for 30 sec - exiting 17:45:48 (2188): No heartbeat from core client for 30 sec - exiting 17:45:49 (2188): No heartbeat from core client for 30 sec - exiting 17:45:50 (2188): No heartbeat from core client for 30 sec - exiting 17:45:51 (2188): No heartbeat from core client for 30 sec - exiting 17:45:52 (2188): No heartbeat from core client for 30 sec - exiting 17:45:53 (2188): No heartbeat from core client for 30 sec - exiting 17:45:54 (2188): No heartbeat from core client for 30 sec - exiting 17:45:56 (2188): No heartbeat from core client for 30 sec - exiting 17:45:57 (2188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1528, selfPID=1528, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5624, selfPID=5624, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 17:11:50 (5092): No heartbeat from core client for 30 sec - exiting 17:11:51 (5092): No heartbeat from core client for 30 sec - exiting 17:11:52 (5092): No heartbeat from core client for 30 sec - exiting 17:11:53 (5092): No heartbeat from core client for 30 sec - exiting 17:11:54 (5092): No heartbeat from core client for 30 sec - exiting 17:11:55 (5092): No heartbeat from core client for 30 sec - exiting 17:11:56 (5092): No heartbeat from core client for 30 sec - exiting 17:11:57 (5092): No heartbeat from core client for 30 sec - exiting 17:11:58 (5092): No heartbeat from core client for 30 sec - exiting 17:11:59 (5092): No heartbeat from core client for 30 sec - exiting 17:12:00 (5092): No heartbeat from core client for 30 sec - exiting 17:12:01 (5092): No heartbeat from core client for 30 sec - exiting 17:12:02 (5092): No heartbeat from core client for 30 sec - exiting 17:12:03 (5092): No heartbeat from core client for 30 sec - exiting 17:12:04 (5092): No heartbeat from core client for 30 sec - exiting 17:12:05 (5092): No heartbeat from core client for 30 sec - exiting 17:12:06 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4528, selfPID=4528, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4132, selfPID=4132, iMonCtr=2 17:54:04 (5444): No heartbeat from core client for 30 sec - exiting 17:54:05 (5444): No heartbeat from core client for 30 sec - exiting 17:54:06 (5444): No heartbeat from core client for 30 sec - exiting 17:54:08 (5444): No heartbeat from core client for 30 sec - exiting 17:54:09 (5444): No heartbeat from core client for 30 sec - exiting 17:54:10 (5444): No heartbeat from core client for 30 sec - exiting 17:54:11 (5444): No heartbeat from core client for 30 sec - exiting 17:54:12 (5444): No heartbeat from core client for 30 sec - exiting 17:54:13 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5548, selfPID=5548, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5128, selfPID=5128, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2156, selfPID=2156, iMonCtr=2 19:49:32 (6100): No heartbeat from core client for 30 sec - exiting 19:49:33 (6100): No heartbeat from core client for 30 sec - exiting 19:49:34 (6100): No heartbeat from core client for 30 sec - exiting 19:49:35 (6100): No heartbeat from core client for 30 sec - exiting 19:49:36 (6100): No heartbeat from core client for 30 sec - exiting 19:49:37 (6100): No heartbeat from core client for 30 sec - exiting 19:49:38 (6100): No heartbeat from core client for 30 sec - exiting 19:49:39 (6100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5564, selfPID=5564, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5392, selfPID=5392, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 22:00:22 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5472, selfPID=5472, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5472, selfPID=5444, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 21:36:09 (5444): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_vbid_1996_1_006676163_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Dec 2010 20:46:07	1096809	11678865	hadam3p_eu_vbid_1996_1_006676163_0	11,617	28,658	2.4669
12 Dec 2010 20:29:44	1096809	11678865	hadam3p_eu_vbid_1996_1_006676163_0	11,616	28,335	2.4393