Task 13713312

Name	hadam3p_pnw_6wg1_2002_1_007590633_0
Workunit	7768763
Created	5 Dec 2011, 11:02:59 UTC
Sent	24 Dec 2011, 1:42:58 UTC
Report deadline	5 Dec 2012, 7:02:58 UTC
Received	29 Dec 2011, 15:24:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1124668
Run time	1 days 7 hours 53 min 52 sec
CPU time	1 days 6 hours 13 min 29 sec
Validate state	Invalid
Credit	1,754.30
Device peak FLOPS	3.69 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=4504, iMonCtr=2 08:11:53 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1968, selfPID=1968, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7876, selfPID=7876, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6948, selfPID=6948, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5144, selfPID=5144, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3840, selfPID05:57:08 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:09 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5336, selfPID=5336, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4576, selfPID=4576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:07:23 (6916): No heartbeat from core client for 30 sec - exiting 23:07:24 (6916): No heartbeat from core client for 30 sec - exiting 23:07:25 (6916): No heartbeat from core client for 30 sec - exiting 23:07:26 (6916): No heartbeat from core client for 30 sec - exiting 23:07:27 (6916): No heartbeat from core client for 30 sec - exiting 23:07:28 (6916): No heartbeat from core client for 30 sec - exiting 23:07:29 (6916): No heartbeat from core client for 30 sec - exiting 23:07:30 (6916): No heartbeat from core client for 30 sec - exiting 23:07:31 (6916): No heartbeat from core client for 30 sec - exiting 23:07:32 (6916): No heartbeat from core client for 30 sec - exiting 23:07:33 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6504, selfPID=6504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:00:18 (5544): No heartbeat from core client for 30 sec - exiting 19:00:19 (5544): No heartbeat from core client for 30 sec - exiting 19:00:20 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:54:46 (2160): No heartbeat from core client for 30 sec - exiting 20:54:47 (2160): No heartbeat from core client for 30 sec - exiting 20:54:48 (2160): No heartbeat from core client for 30 sec - exiting 20:54:49 (2160): No heartbeat from core client for 30 sec - exiting 20:54:50 (2160): No heartbeat from core client for 30 sec - exiting 20:54:51 (2160): No heartbeat from core client for 30 sec - exiting 20:54:52 (2160): No heartbeat from core client for 30 sec - exiting 20:54:53 (2160): No heartbeat from core client for 30 sec - exiting 20:54:54 (2160): No heartbeat from core client for 30 sec - exiting 20:54:55 (2160): No heartbeat from core client for 30 sec - exiting 20:54:56 (2160): No heartbeat from core client for 30 sec - exiting 20:54:57 (2160): No heartbeat from core client for 30 sec - exiting 20:54:58 (2160): No heartbeat from core client for 30 sec - exiting 20:54:59 (2160): No heartbeat from core client for 30 sec - exiting 20:55:00 (2160): No heartbeat from core client for 30 sec - exiting 20:55:01 (2160): No heartbeat from core client for 30 sec - exiting 20:55:02 (2160): No heartbeat from core client for 30 sec - exiting 20:55:03 (2160): No heartbeat from core client for 30 sec - exiting 20:55:04 (2160): No heartbeat from core client for 30 sec - exiting 20:55:05 (2160): No heartbeat from core client for 30 sec - exiting 20:55:06 (2160): No heartbeat from core client for 30 sec - exiting 20:55:07 (2160): No heartbeat from core client for 30 sec - exiting 20:55:08 (2160): No heartbeat from core client for 30 sec - exiting 20:55:09 (2160): No heartbeat from core client for 30 sec - exiting 20:55:10 (2160): No heartbeat from core client for 30 sec - exiting 20:55:11 (2160): No heartbeat from core client for 30 sec - exiting 20:55:12 (2160): No heartbeat from core client for 30 sec - exiting 20:55:13 (2160): No heartbeat from core client for 30 sec - exiting 20:55:14 (2160): No heartbeat from core client for 30 sec - exiting 20:55:15 (2160): No heartbeat from core client for 30 sec - exiting 20:55:16 (2160): No heartbeat from core client for 30 sec - exiting 20:55:17 (2160): No heartbeat from core client for 30 sec - exiting 20:55:18 (2160): No heartbeat from core client for 30 sec - exiting 20:55:19 (2160): No heartbeat from core client for 30 sec - exiting 20:55:20 (2160): No heartbeat from core client for 30 sec - exiting 20:55:21 (2160): No heartbeat from core client for 30 sec - exiting 20:55:22 (2160): No heartbeat from core client for 30 sec - exiting 20:55:23 (2160): No heartbeat from core client for 30 sec - exiting 20:55:24 (2160): No heartbeat from core client for 30 sec - exiting 20:55:25 (2160): No heartbeat from core client for 30 sec - exiting 20:55:26 (2160): No heartbeat from core client for 30 sec - exiting 20:55:27 (2160): No heartbeat from core client for 30 sec - exiting 20:55:28 (2160): No heartbeat from core client for 30 sec - exiting 20:55:29 (2160): No heartbeat from core client for 30 sec - exiting 20:55:30 (2160): No heartbeat from core client for 30 sec - exiting 20:55:31 (2160): No heartbeat from core client for 30 sec - exiting 20:55:32 (2160): No heartbeat from core client for 30 sec - exiting 20:55:33 (2160): No heartbeat from core client for 30 sec - exiting 20:55:34 (2160): No heartbeat from core client for 30 sec - exiting 20:55:35 (2160): No heartbeat from core client for 30 sec - exiting 20:55:36 (2160): No heartbeat from core client for 30 sec - exiting 20:55:37 (2160): No heartbeat from core client for 30 sec - exiting 20:55:38 (2160): No heartbeat from core client for 30 sec - exiting 20:55:39 (2160): No heartbeat from core client for 30 sec - exiting 20:55:40 (2160): No heartbeat from core client for 30 sec - exiting 20:55:41 (2160): No heartbeat from core client for 30 sec - exiting 20:55:42 (2160): No heartbeat from core client for 30 sec - exiting 20:55:43 (2160): No heartbeat from core client for 30 sec - exiting 20:55:44 (2160): No heartbeat from core client for 30 sec - exiting 20:55:45 (2160): No heartbeat from core client for 30 sec - exiting 20:55:46 (2160): No heartbeat from core client for 30 sec - exiting 20:55:47 (2160): No heartbeat from core client for 30 sec - exiting 20:55:48 (2160): No heartbeat from core client for 30 sec - exiting 20:55:49 (2160): No heartbeat from core client for 30 sec - exiting 20:55:50 (2160): No heartbeat from core client for 30 sec - exiting 20:55:51 (2160): No heartbeat from core client for 30 sec - exiting 20:55:52 (2160): No heartbeat from core client for 30 sec - exiting 20:55:53 (2160): No heartbeat from core client for 30 sec - exiting 20:55:54 (2160): No heartbeat from core client for 30 sec - exiting 20:55:55 (2160): No heartbeat from core client for 30 sec - exiting 20:55:56 (2160): No heartbeat from core client for 30 sec - exiting 20:55:57 (2160): No heartbeat from core client for 30 sec - exiting 20:55:58 (2160): No heartbeat from core client for 30 sec - exiting 20:55:59 (2160): No heartbeat from core client for 30 sec - exiting 20:56:00 (2160): No heartbeat from core client for 30 sec - exiting 20:56:01 (2160): No heartbeat from core client for 30 sec - exiting 20:56:02 (2160): No heartbeat from core client for 30 sec - exiting 20:56:03 (2160): No heartbeat from core client for 30 sec - exiting 20:56:04 (2160): No heartbeat from core client for 30 sec - exiting 20:56:05 (2160): No heartbeat from core client for 30 sec - exiting 20:56:06 (2160): No heartbeat from core client for 30 sec - exiting 20:56:07 (2160): No heartbeat from core client for 30 sec - exiting 20:56:08 (2160): No heartbeat from core client for 30 sec - exiting 20:56:09 (2160): No heartbeat from core client for 30 sec - exiting 20:56:10 (2160): No heartbeat from core client for 30 sec - exiting 20:56:11 (2160): No heartbeat from core client for 30 sec - exiting 20:56:12 (2160): No heartbeat from core client for 30 sec - exiting 20:56:13 (2160): No heartbeat from core client for 30 sec - exiting 20:56:14 (2160): No heartbeat from core client for 30 sec - exiting 20:56:15 (2160): No heartbeat from core client for 30 sec - exiting 20:56:16 (2160): No heartbeat from core client for 30 sec - exiting 20:56:17 (2160): No heartbeat from core client for 30 sec - exiting 20:56:18 (2160): No heartbeat from core client for 30 sec - exiting 20:56:19 (2160): No heartbeat from core client for 30 sec - exiting 20:56:20 (2160): No heartbeat from core client for 30 sec - exiting 20:56:21 (2160): No heartbeat from core client for 30 sec - exiting 20:56:22 (2160): No heartbeat from core client for 30 sec - exiting 20:56:23 (2160): No heartbeat from core client for 30 sec - exiting 20:56:24 (2160): No heartbeat from core client for 30 sec - exiting 20:56:25 (2160): No heartbeat from core client for 30 sec - exiting 20:56:26 (2160): No heartbeat from core client for 30 sec - exiting 20:56:27 (2160): No heartbeat from core client for 30 sec - exiting 20:56:28 (2160): No heartbeat from core client for 30 sec - exiting 20:56:29 (2160): No heartbeat from core client for 30 sec - exiting 20:56:30 (2160): No heartbeat from core client for 30 sec - exiting 20:56:31 (2160): No heartbeat from core client for 30 sec - exiting 20:56:32 (2160): No heartbeat from core client for 30 sec - exiting 20:56:33 (2160): No heartbeat from core client for 30 sec - exiting 20:56:34 (2160): No heartbeat from core client for 30 sec - exiting 20:56:35 (2160): No heartbeat from core client for 30 sec - exiting 20:56:36 (2160): No heartbeat from core client for 30 sec - exiting 20:56:37 (2160): No heartbeat from core client for 30 sec - exiting 20:56:38 (2160): No heartbeat from core client for 30 sec - exiting 20:56:39 (2160): No heartbeat from core client for 30 sec - exiting 20:56:40 (2160): No heartbeat from core client for 30 sec - exiting 20:56:41 (2160): No heartbeat from core client for 30 sec - exiting 20:56:42 (2160): No heartbeat from core client for 30 sec - exiting 20:56:43 (2160): No heartbeat from core client for 30 sec - exiting 20:56:44 (2160): No heartbeat from core client for 30 sec - exiting 20:56:45 (2160): No heartbeat from core client for 30 sec - exiting 20:56:46 (2160): No heartbeat from core client for 30 sec - exiting 20:56:47 (2160): No heartbeat from core client for 30 sec - exiting 20:56:48 (2160): No heartbeat from core client for 30 sec - exiting 20:56:49 (2160): No heartbeat from core client for 30 sec - exiting 20:56:50 (2160): No heartbeat from core client for 30 sec - exiting 20:56:51 (2160): No heartbeat from core client for 30 sec - exiting 20:56:52 (2160): No heartbeat from core client for 30 sec - exiting 20:56:53 (2160): No heartbeat from core client for 30 sec - exiting 20:56:54 (2160): No heartbeat from core client for 30 sec - exiting 20:56:55 (2160): No heartbeat from core client for 30 sec - exiting 20:56:56 (2160): No heartbeat from core client for 30 sec - exiting 20:56:57 (2160): No heartbeat from core client for 30 sec - exiting 20:56:58 (2160): No heartbeat from core client for 30 sec - exiting 20:56:59 (2160): No heartbeat from core client for 30 sec - exiting 20:57:00 (2160): No heartbeat from core client for 30 sec - exiting 20:57:01 (2160): No heartbeat from core client for 30 sec - exiting 20:57:02 (2160): No heartbeat from core client for 30 sec - exiting 20:57:03 (2160): No heartbeat from core client for 30 sec - exiting 20:57:04 (2160): No heartbeat from core client for 30 sec - exiting 20:57:05 (2160): No heartbeat from core client for 30 sec - exiting 20:57:06 (2160): No heartbeat from core client for 30 sec - exiting 20:57:07 (2160): No heartbeat from core client for 30 sec - exiting 20:57:08 (2160): No heartbeat from core client for 30 sec - exiting 20:57:09 (2160): No heartbeat from core client for 30 sec - exiting 20:57:10 (2160): No heartbeat from core client for 30 sec - exiting 20:57:11 (2160): No heartbeat from core client for 30 sec - exiting 20:57:12 (2160): No heartbeat from core client for 30 sec - exiting 20:57:13 (2160): No heartbeat from core client for 30 sec - exiting 20:57:14 (2160): No heartbeat from core client for 30 sec - exiting 20:57:15 (2160): No heartbeat from core client for 30 sec - exiting 20:57:16 (2160): No heartbeat from core client for 30 sec - exiting 20:57:17 (2160): No heartbeat from core client for 30 sec - exiting 20:57:18 (2160): No heartbeat from core client for 30 sec - exiting 20:57:19 (2160): No heartbeat from core client for 30 sec - exiting 20:57:20 (2160): No heartbeat from core client for 30 sec - exiting 20:57:21 (2160): No heartbeat from core client for 30 sec - exiting 20:57:22 (2160): No heartbeat from core client for 30 sec - exiting 20:57:23 (2160): No heartbeat from core client for 30 sec - exiting 20:57:24 (2160): No heartbeat from core client for 30 sec - exiting 20:57:25 (2160): No heartbeat from core client for 30 sec - exiting 20:57:26 (2160): No heartbeat from core client for 30 sec - exiting 20:57:27 (2160): No heartbeat from core client for 30 sec - exiting 20:57:28 (2160): No heartbeat from core client for 30 sec - exiting 20:57:29 (2160): No heartbeat from core client for 30 sec - exiting 20:57:30 (2160): No heartbeat from core client for 30 sec - exiting 20:57:31 (2160): No heartbeat from core client for 30 sec - exiting 20:57:32 (2160): No heartbeat from core client for 30 sec - exiting 20:57:33 (2160): No heartbeat from core client for 30 sec - exiting 20:57:34 (2160): No heartbeat from core client for 30 sec - exiting 20:57:35 (2160): No heartbeat from core client for 30 sec - exiting 20:57:36 (2160): No heartbeat from core client for 30 sec - exiting 20:57:37 (2160): No heartbeat from core client for 30 sec - exiting 20:57:38 (2160): No heartbeat from core client for 30 sec - exiting 20:57:39 (2160): No heartbeat from core client for 30 sec - exiting 20:57:40 (2160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:33 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:45 (1708): No heartbeat from core client for 30 sec - exiting 21:02:46 (1708): No heartbeat from core client for 30 sec - exiting 21:02:47 (1708): No heartbeat from core client for 30 sec - exiting 21:02:48 (1708): No heartbeat from core client for 30 sec - exiting 21:02:49 (1708): No heartbeat from core client for 30 sec - exiting 21:02:50 (1708): No heartbeat from core client for 30 sec - exiting 21:02:51 (1708): No heartbeat from core client for 30 sec - exiting 21:02:52 (1708): No heartbeat from core client for 30 sec - exiting 21:02:53 (1708): No heartbeat from core client for 30 sec - exiting 21:02:54 (1708): No heartbeat from core client for 30 sec - exiting 21:02:55 (1708): No heartbeat from core client for 30 sec - exiting 21:02:56 (1708): No heartbeat from core client for 30 sec - exiting 21:02:57 (1708): No heartbeat from core client for 30 sec - exiting 21:02:58 (1708): No heartbeat from core client for 30 sec - exiting 21:02:59 (1708): No heartbeat from core client for 30 sec - exiting 21:03:00 (1708): No heartbeat from core client for 30 sec - exiting 21:03:01 (1708): No heartbeat from core client for 30 sec - exiting 21:03:02 (1708): No heartbeat from core client for 30 sec - exiting 21:03:03 (1708): No heartbeat from core client for 30 sec - exiting 21:03:04 (1708): No heartbeat from core client for 30 sec - exiting 21:03:05 (1708): No heartbeat from core client for 30 sec - exiting 21:03:06 (1708): No heartbeat from core client for 30 sec - exiting 21:03:07 (1708): No heartbeat from core client for 30 sec - exiting 21:03:08 (1708): No heartbeat from core client for 30 sec - exiting 21:03:09 (1708): No heartbeat from core client for 30 sec - exiting 21:03:10 (1708): No heartbeat from core client for 30 sec - exiting 21:03:11 (1708): No heartbeat from core client for 30 sec - exiting 21:03:12 (1708): No heartbeat from core client for 30 sec - exiting 21:03:13 (1708): No heartbeat from core client for 30 sec - exiting 21:03:14 (1708): No heartbeat from core client for 30 sec - exiting 21:03:15 (1708): No heartbeat from core client for 30 sec - exiting 21:03:16 (1708): No heartbeat from core client for 30 sec - exiting 21:03:17 (1708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5008, selfPID=5008, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5008, selfPID=2444, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_6wg1_2002_1_007590633_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6wg1_2002_1_007590633_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6wg1_2002_1_007590633_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6wg1_2002_1_007590633_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6wg1_2002_1_007590633_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Dec 2011 19:04:49	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	80,736	104,542	1.2949
26 Dec 2011 02:28:58	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	69,216	89,791	1.2973
25 Dec 2011 21:07:39	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	57,696	74,889	1.2980
25 Dec 2011 14:25:03	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	46,176	60,096	1.3015
25 Dec 2011 02:37:23	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	34,656	44,910	1.2959
24 Dec 2011 22:06:03	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	23,140	30,027	1.2976
24 Dec 2011 21:05:43	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	23,136	29,862	1.2907
24 Dec 2011 07:09:40	1124668	13713312	hadam3p_pnw_6wg1_2002_1_007590633_0	11,616	15,013	1.2924