Task 15705270

Name	hadam3p_eu_qdxp_2001_1_008343850_0
Workunit	8494711
Created	5 Apr 2013, 13:52:27 UTC
Sent	6 Apr 2013, 7:21:25 UTC
Report deadline	19 Mar 2014, 12:41:25 UTC
Received	15 May 2013, 8:35:19 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1205594
Run time	4 days 14 hours 27 min 54 sec
CPU time	3 days 8 hours 40 min 14 sec
Validate state	Invalid
Credit	1,790.21
Device peak FLOPS	3.08 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5292, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6280, iMonCtr=2 08:27:43 (4716): No heartbeat from core client for 30 sec - exiting 08:27:44 (4716): No heartbeat from core client for 30 sec - exiting 08:27:45 (4716): No heartbeat from core client for 30 sec - exiting 08:27:46 (4716): No heartbeat from core client for 30 sec - exiting 08:27:47 (4716): No heartbeat from core client for 30 sec - exiting 08:27:48 (4716): No heartbeat from core client for 30 sec - exiting 08:27:49 (4716): No heartbeat from core client for 30 sec - exiting 08:27:50 (4716): No heartbeat from core client for 30 sec - exiting 08:27:52 (4716): No heartbeat from core client for 30 sec - exiting 08:27:53 (4716): No heartbeat from core client for 30 sec - exiting 08:27:54 (4716): No heartbeat from core client for 30 sec - exiting 08:27:55 (4716): No heartbeat from core client for 30 sec - exiting 08:27:56 (4716): No heartbeat from core client for 30 sec - exiting 08:27:57 (4716): No heartbeat from core client for 30 sec - exiting 08:27:58 (4716): No heartbeat from core client for 30 sec - exiting 08:27:59 (4716): No heartbeat from core client for 30 sec - exiting 08:28:00 (4716): No heartbeat from core client for 30 sec - exiting 08:28:01 (4716): No heartbeat from core client for 30 sec - exiting 08:28:02 (4716): No heartbeat from core client for 30 sec - exiting 08:28:03 (4716): No heartbeat from core client for 30 sec - exiting 08:28:04 (4716): No heartbeat from core client for 30 sec - exiting 08:28:05 (4716): No heartbeat from core client for 30 sec - exiting 08:28:06 (4716): No heartbeat from core client for 30 sec - exiting 08:28:07 (4716): No heartbeat from core client for 30 sec - exiting 08:28:08 (4716): No heartbeat from core client for 30 sec - exiting 08:28:09 (4716): No heartbeat from core client for 30 sec - exiting 08:28:10 (4716): No heartbeat from core client for 30 sec - exiting 08:28:11 (4716): No heartbeat from core client for 30 sec - exiting 08:28:12 (4716): No heartbeat from core client for 30 sec - exiting 08:28:13 (4716): No heartbeat from core client for 30 sec - exiting 08:28:14 (4716): No heartbeat from core client for 30 sec - exiting 08:28:15 (4716): No heartbeat from core client for 30 sec - exiting 08:28:16 (4716): No heartbeat from core client for 30 sec - exiting 08:28:17 (4716): No heartbeat from core client for 30 sec - exiting 08:28:18 (4716): No heartbeat from core client for 30 sec - exiting 08:28:19 (4716): No heartbeat from core client for 30 sec - exiting 08:28:20 (4716): No heartbeat from core client for 30 sec - exiting 08:28:21 (4716): No heartbeat from core client for 30 sec - exiting 08:28:22 (4716): No heartbeat from core client for 30 sec - exiting 08:28:23 (4716): No heartbeat from core client for 30 sec - exiting 08:28:24 (4716): No heartbeat from core client for 30 sec - exiting 08:28:25 (4716): No heartbeat from core client for 30 sec - exiting 08:28:26 (4716): No heartbeat from core client for 30 sec - exiting 08:28:27 (4716): No heartbeat from core client for 30 sec - exiting 08:28:28 (4716): No heartbeat from core client for 30 sec - exiting 08:28:29 (4716): No heartbeat from core client for 30 sec - exiting 08:28:30 (4716): No heartbeat from core client for 30 sec - exiting 08:28:31 (4716): No heartbeat from core client for 30 sec - exiting 08:28:32 (4716): No heartbeat from core client for 30 sec - exiting 08:28:33 (4716): No heartbeat from core client for 30 sec - exiting 08:28:34 (4716): No heartbeat from core client for 30 sec - exiting 08:28:35 (4716): No heartbeat from core client for 30 sec - exiting 08:28:36 (4716): No heartbeat from core client for 30 sec - exiting 08:28:37 (4716): No heartbeat from core client for 30 sec - exiting 08:28:38 (4716): No heartbeat from core client for 30 sec - exiting 08:28:39 (4716): No heartbeat from core client for 30 sec - exiting 08:28:40 (4716): No heartbeat from core client for 30 sec - exiting 08:28:41 (4716): No heartbeat from core client for 30 sec - exiting 08:28:42 (4716): No heartbeat from core client for 30 sec - exiting 08:28:43 (4716): No heartbeat from core client for 30 sec - exiting 08:28:44 (4716): No heartbeat from core client for 30 sec - exiting 08:28:45 (4716): No heartbeat from core client for 30 sec - exiting 08:28:46 (4716): No heartbeat from core client for 30 sec - exiting 08:28:47 (4716): No heartbeat from core client for 30 sec - exiting 08:28:48 (4716): No heartbeat from core client for 30 sec - exiting 08:28:49 (4716): No heartbeat from core client for 30 sec - exiting 08:28:50 (4716): No heartbeat from core client for 30 sec - exiting 08:28:51 (4716): No heartbeat from core client for 30 sec - exiting 08:28:52 (4716): No heartbeat from core client for 30 sec - exiting 08:28:53 (4716): No heartbeat from core client for 30 sec - exiting 08:28:54 (4716): No heartbeat from core client for 30 sec - exiting 08:28:55 (4716): No heartbeat from core client for 30 sec - exiting 08:28:56 (4716): No heartbeat from core client for 30 sec - exiting 08:28:57 (4716): No heartbeat from core client for 30 sec - exiting 08:28:58 (4716): No heartbeat from core client for 30 sec - exiting 08:28:59 (4716): No heartbeat from core client for 30 sec - exiting 08:29:00 (4716): No heartbeat from core client for 30 sec - exiting 08:29:01 (4716): No heartbeat from core client for 30 sec - exiting 08:29:02 (4716): No heartbeat from core client for 30 sec - exiting 08:29:03 (4716): No heartbeat from core client for 30 sec - exiting 08:29:04 (4716): No heartbeat from core client for 30 sec - exiting 08:29:05 (4716): No heartbeat from core client for 30 sec - exiting 08:29:06 (4716): No heartbeat from core client for 30 sec - exiting 08:29:07 (4716): No heartbeat from core client for 30 sec - exiting 08:29:08 (4716): No heartbeat from core client for 30 sec - exiting 08:29:09 (4716): No heartbeat from core client for 30 sec - exiting 08:29:10 (4716): No heartbeat from core client for 30 sec - exiting 08:29:11 (4716): No heartbeat from core client for 30 sec - exiting 08:29:12 (4716): No heartbeat from core client for 30 sec - exiting 08:29:13 (4716): No heartbeat from core client for 30 sec - exiting 08:29:14 (4716): No heartbeat from core client for 30 sec - exiting 08:29:15 (4716): No heartbeat from core client for 30 sec - exiting 08:29:16 (4716): No heartbeat from core client for 30 sec - exiting 08:29:17 (4716): No heartbeat from core client for 30 sec - exiting 08:29:18 (4716): No heartbeat from core client for 30 sec - exiting 08:29:19 (4716): No heartbeat from core client for 30 sec - exiting 08:29:20 (4716): No heartbeat from core client for 30 sec - exiting 08:29:21 (4716): No heartbeat from core client for 30 sec - exiting 08:29:22 (4716): No heartbeat from core client for 30 sec - exiting 08:29:23 (4716): No heartbeat from core client for 30 sec - exiting 08:29:24 (4716): No heartbeat from core client for 30 sec - exiting 08:29:25 (4716): No heartbeat from core client for 30 sec - exiting 08:29:26 (4716): No heartbeat from core client for 30 sec - exiting 08:29:27 (4716): No heartbeat from core client for 30 sec - exiting 08:29:28 (4716): No heartbeat from core client for 30 sec - exiting 08:29:29 (4716): No heartbeat from core client for 30 sec - exiting 08:29:30 (4716): No heartbeat from core client for 30 sec - exiting 08:29:31 (4716): No heartbeat from core client for 30 sec - exiting 08:29:32 (4716): No heartbeat from core client for 30 sec - exiting 08:29:33 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4220, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:47:19 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5124, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 12:00:48 (3952): No heartbeat from core client for 30 sec - exiting 12:00:49 (3952): No heartbeat from core client for 30 sec - exiting 12:00:50 (3952): No heartbeat from core client for 30 sec - exiting 12:00:51 (3952): No heartbeat from core client for 30 sec - exiting 12:00:52 (3952): No heartbeat from core client for 30 sec - exiting 12:00:53 (3952): No heartbeat from core client for 30 sec - exiting 12:00:54 (3952): No heartbeat from core client for 30 sec - exiting 12:00:55 (3952): No heartbeat from core client for 30 sec - exiting 12:00:56 (3952): No heartbeat from core client for 30 sec - exiting 12:00:57 (3952): No heartbeat from core client for 30 sec - exiting 12:00:58 (3952): No heartbeat from core client for 30 sec - exiting 12:00:59 (3952): No heartbeat from core client for 30 sec - exiting 12:01:00 (3952): No heartbeat from core client for 30 sec - exiting 12:01:01 (3952): No heartbeat from core client for 30 sec - exiting 12:01:02 (3952): No heartbeat from core client for 30 sec - exiting 12:01:03 (3952): No heartbeat from core client for 30 sec - exiting 12:01:04 (3952): No heartbeat from core client for 30 sec - exiting 12:01:05 (3952): No heartbeat from core client for 30 sec - exiting 12:01:06 (3952): No heartbeat from core client for 30 sec - exiting 12:01:07 (3952): No heartbeat from core client for 30 sec - exiting 12:01:08 (3952): No heartbeat from core client for 30 sec - exiting 12:01:09 (3952): No heartbeat from core client for 30 sec - exiting 12:01:10 (3952): No heartbeat from core client for 30 sec - exiting 12:01:11 (3952): No heartbeat from core client for 30 sec - exiting 12:01:12 (3952): No heartbeat from core client for 30 sec - exiting 12:01:13 (3952): No heartbeat from core client for 30 sec - exiting 12:01:14 (3952): No heartbeat from core client for 30 sec - exiting 12:01:15 (3952): No heartbeat from core client for 30 sec - exiting 12:01:16 (3952): No heartbeat from core client for 30 sec - exiting 12:01:17 (3952): No heartbeat from core client for 30 sec - exiting 12:01:18 (3952): No heartbeat from core client for 30 sec - exiting 12:01:19 (3952): No heartbeat from core client for 30 sec - exiting 12:01:20 (3952): No heartbeat from core client for 30 sec - exiting 12:01:21 (3952): No heartbeat from core client for 30 sec - exiting 12:01:22 (3952): No heartbeat from core client for 30 sec - exiting 12:01:23 (3952): No heartbeat from core client for 30 sec - exiting 12:01:24 (3952): No heartbeat from core client for 30 sec - exiting 12:01:25 (3952): No heartbeat from core client for 30 sec - exiting 12:01:26 (3952): No heartbeat from core client for 30 sec - exiting 12:01:27 (3952): No heartbeat from core client for 30 sec - exiting 12:01:28 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1880, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3112, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 09:38:35 (2352): No heartbeat from core client for 30 sec - exiting 09:38:36 (2352): No heartbeat from core client for 30 sec - exiting 09:38:37 (2352): No heartbeat from core client for 30 sec - exiting 09:38:38 (2352): No heartbeat from core client for 30 sec - exiting 09:38:39 (2352): No heartbeat from core client for 30 sec - exiting 09:38:40 (2352): No heartbeat from core client for 30 sec - exiting 09:38:41 (2352): No heartbeat from core client for 30 sec - exiting 09:38:42 (2352): No heartbeat from core client for 30 sec - exiting 09:38:43 (2352): No heartbeat from core client for 30 sec - exiting 09:38:44 (2352): No heartbeat from core client for 30 sec - exiting 09:38:45 (2352): No heartbeat from core client for 30 sec - exiting 09:38:46 (2352): No heartbeat from core client for 30 sec - exiting 09:38:47 (2352): No heartbeat from core client for 30 sec - exiting 09:38:48 (2352): No heartbeat from core client for 30 sec - exiting 09:38:49 (2352): No heartbeat from core client for 30 sec - exiting 09:38:50 (2352): No heartbeat from core client for 30 sec - exiting 09:38:51 (2352): No heartbeat from core client for 30 sec - exiting 09:38:52 (2352): No heartbeat from core client for 30 sec - exiting 09:38:53 (2352): No heartbeat from core client for 30 sec - exiting 09:38:54 (2352): No heartbeat from core client for 30 sec - exiting 09:38:55 (2352): No heartbeat from core client for 30 sec - exiting 09:38:56 (2352): No heartbeat from core client for 30 sec - exiting 09:38:57 (2352): No heartbeat from core client for 30 sec - exiting 09:38:58 (2352): No heartbeat from core client for 30 sec - exiting 09:38:59 (2352): No heartbeat from core client for 30 sec - exiting 09:39:00 (2352): No heartbeat from core client for 30 sec - exiting 09:39:01 (2352): No heartbeat from core client for 30 sec - exiting 09:39:02 (2352): No heartbeat from core client for 30 sec - exiting 09:39:03 (2352): No heartbeat from core client for 30 sec - exiting 09:39:04 (2352): No heartbeat from core client for 30 sec - exiting 09:39:05 (2352): No heartbeat from core client for 30 sec - exiting 09:39:06 (2352): No heartbeat from core client for 30 sec - exiting 09:39:07 (2352): No heartbeat from core client for 30 sec - exiting 09:39:08 (2352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:26:41 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:42 (4032): No heartbeat from core client for 30 sec - exiting 17:26:43 (4032): No heartbeat from core client for 30 sec - exiting 17:26:44 (4032): No heartbeat from core client for 30 sec - exiting 17:26:45 (4032): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:47:55 (500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8424, selfPID=9628, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3828, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3168, iMonCtr=2 Model crash detected, will try to restart... </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_qdxp_2001_1_008343850_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_qdxp_2001_1_008343850_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_qdxp_2001_1_008343850_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2013 17:08:44	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	103,776	268,806	2.5903
04 May 2013 09:41:20	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	92,256	239,531	2.5964
03 May 2013 10:29:10	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	80,736	209,177	2.5909
25 Apr 2013 15:00:40	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	69,216	179,906	2.5992
24 Apr 2013 19:20:25	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	57,696	150,084	2.6013
24 Apr 2013 05:39:04	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	46,176	120,016	2.5991
23 Apr 2013 18:35:43	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	34,675	90,138	2.5995
18 Apr 2013 02:53:46	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	34,656	89,715	2.5887
16 Apr 2013 17:52:34	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	23,136	59,908	2.5894
16 Apr 2013 03:02:48	1205594	15705270	hadam3p_eu_qdxp_2001_1_008343850_0	11,616	30,341	2.6120