Task 15564999

Name	hadam3p_eu_ov1y_2006_1_008290194_0
Workunit	8441329
Created	31 Jan 2013, 15:18:18 UTC
Sent	1 Feb 2013, 14:47:26 UTC
Report deadline	14 Jan 2014, 20:07:26 UTC
Received	17 Jun 2013, 12:44:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1211569
Run time	3 days 22 hours 10 min 51 sec
CPU time	2 days 15 hours 39 min 50 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	2.03 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1624, selfPID=1624, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5816, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5028, selfPID=3652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5736, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4908, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4480, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7136, selfPID=7136, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2408, selfPID=3560, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... GCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:55:26 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3400, selfPID=3400, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5572, selfPID=4868, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10144, iMonCtr=2 14:28:46 (4640): No heartbeat from core client for 30 sec - exiting 14:28:47 (4640): No heartbeat from core client for 30 sec - exiting 14:28:48 (4640): No heartbeat from core client for 30 sec - exiting 14:28:49 (4640): No heartbeat from core client for 30 sec - exiting 14:28:51 (4640): No heartbeat from core client for 30 sec - exiting 14:28:52 (4640): No heartbeat from core client for 30 sec - exiting 14:28:53 (4640): No heartbeat from core client for 30 sec - exiting 14:28:54 (4640): No heartbeat from core client for 30 sec - exiting 14:28:55 (4640): No heartbeat from core client for 30 sec - exiting 14:28:56 (4640): No heartbeat from core client for 30 sec - exiting 14:28:57 (4640): No heartbeat from core client for 30 sec - exiting 14:28:58 (4640): No heartbeat from core client for 30 sec - exiting 14:28:59 (4640): No heartbeat from core client for 30 sec - exiting 14:29:00 (4640): No heartbeat from core client for 30 sec - exiting 14:29:01 (4640): No heartbeat from core client for 30 sec - exiting 14:29:02 (4640): No heartbeat from core client for 30 sec - exiting 14:29:03 (4640): No heartbeat from core client for 30 sec - exiting 14:29:04 (4640): No heartbeat from core client for 30 sec - exiting 14:29:06 (4640): No heartbeat from core client for 30 sec - exiting 14:29:07 (4640): No heartbeat from core client for 30 sec - exiting 14:29:08 (4640): No heartbeat from core client for 30 sec - exiting 14:29:09 (4640): No heartbeat from core client for 30 sec - exiting 14:29:10 (4640): No heartbeat from core client for 30 sec - exiting 14:29:11 (4640): No heartbeat from core client for 30 sec - exiting 14:29:12 (4640): No heartbeat from core client for 30 sec - exiting 14:29:13 (4640): No heartbeat from core client for 30 sec - exiting 14:29:15 (4640): No heartbeat from core client for 30 sec - exiting 14:29:16 (4640): No heartbeat from core client for 30 sec - exiting 14:29:17 (4640): No heartbeat from core client for 30 sec - exiting 14:29:18 (4640): No heartbeat from core client for 30 sec - exiting 14:29:19 (4640): No heartbeat from core client for 30 sec - exiting 14:29:20 (4640): No heartbeat from core client for 30 sec - exiting 14:29:21 (4640): No heartbeat from core client for 30 sec - exiting 14:29:22 (4640): No heartbeat from core client for 30 sec - exiting 14:29:23 (4640): No heartbeat from core client for 30 sec - exiting 14:29:24 (4640): No heartbeat from core client for 30 sec - exiting 14:29:25 (4640): No heartbeat from core client for 30 sec - exiting 14:29:26 (4640): No heartbeat from core client for 30 sec - exiting 14:29:27 (4640): No heartbeat from core client for 30 sec - exiting 14:29:28 (4640): No heartbeat from core client for 30 sec - exiting 14:29:29 (4640): No heartbeat from core client for 30 sec - exiting 14:29:30 (4640): No heartbeat from core client for 30 sec - exiting 14:29:31 (4640): No heartbeat from core client for 30 sec - exiting 14:29:32 (4640): No heartbeat from core client for 30 sec - exiting 14:29:33 (4640): No heartbeat from core client for 30 sec - exiting 14:29:34 (4640): No heartbeat from core client for 30 sec - exiting 14:29:35 (4640): No heartbeat from core client for 30 sec - exiting 14:29:37 (4640): No heartbeat from core client for 30 sec - exiting 14:29:38 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:59:46 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:35 (4400): No heartbeat from core client for 30 sec - exiting 09:21:36 (4400): No heartbeat from core client for 30 sec - exiting 09:21:37 (4400): No heartbeat from core client for 30 sec - exiting 09:21:38 (4400): No heartbeat from core client for 30 sec - exiting 09:21:39 (4400): No heartbeat from core client for 30 sec - exiting 09:21:40 (4400): No heartbeat from core client for 30 sec - exiting 09:21:41 (4400): No heartbeat from core client for 30 sec - exiting 09:21:42 (4400): No heartbeat from core client for 30 sec - exiting 09:21:43 (4400): No heartbeat from core client for 30 sec - exiting 09:21:44 (4400): No heartbeat from core client for 30 sec - exiting 09:21:45 (4400): No heartbeat from core client for 30 sec - exiting 09:21:46 (4400): No heartbeat from core client for 30 sec - exiting 09:21:47 (4400): No heartbeat from core client for 30 sec - exiting 09:21:48 (4400): No heartbeat from core client for 30 sec - exiting 09:21:49 (4400): No heartbeat from core client for 30 sec - exiting 09:21:50 (4400): No heartbeat from core client for 30 sec - exiting 09:21:51 (4400): No heartbeat from core client for 30 sec - exiting 09:21:52 (4400): No heartbeat from core client for 30 sec - exiting 09:21:53 (4400): No heartbeat from core client for 30 sec - exiting 09:21:54 (4400): No heartbeat from core client for 30 sec - exiting 09:21:55 (4400): No heartbeat from core client for 30 sec - exiting 09:21:56 (4400): No heartbeat from core client for 30 sec - exiting 09:21:57 (4400): No heartbeat from core client for 30 sec - exiting 09:21:58 (4400): No heartbeat from core client for 30 sec - exiting 09:21:59 (4400): No heartbeat from core client for 30 sec - exiting 09:22:00 (4400): No heartbeat from core client for 30 sec - exiting 09:22:01 (4400): No heartbeat from core client for 30 sec - exiting 09:22:02 (4400): No heartbeat from core client for 30 sec - exiting 09:22:03 (4400): No heartbeat from core client for 30 sec - exiting 09:22:04 (4400): No heartbeat from core client for 30 sec - exiting 09:22:05 (4400): No heartbeat from core client for 30 sec - exiting 09:22:07 (4400): No heartbeat from core client for 30 sec - exiting 09:22:08 (4400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:01 (4060): No heartbeat from core client for 30 sec - exiting 21:10:02 (4060): No heartbeat from core client for 30 sec - exiting 21:10:04 (4060): No heartbeat from core client for 30 sec - exiting 21:10:05 (4060): No heartbeat from core client for 30 sec - exiting 21:10:06 (4060): No heartbeat from core client for 30 sec - exiting 21:10:07 (4060): No heartbeat from core client for 30 sec - exiting 21:10:08 (4060): No heartbeat from core client for 30 sec - exiting 21:10:09 (4060): No heartbeat from core client for 30 sec - exiting 21:10:10 (4060): No heartbeat from core client for 30 sec - exiting 21:10:11 (4060): No heartbeat from core client for 30 sec - exiting 21:10:12 (4060): No heartbeat from core client for 30 sec - exiting 21:10:13 (4060): No heartbeat from core client for 30 sec - exiting 21:10:14 (4060): No heartbeat from core client for 30 sec - exiting 21:10:15 (4060): No heartbeat from core client for 30 sec - exiting 21:10:16 (4060): No heartbeat from core client for 30 sec - exiting 21:10:17 (4060): No heartbeat from core client for 30 sec - exiting 21:10:23 (4060): No heartbeat from core client for 30 sec - exiting 21:10:24 (4060): No heartbeat from core client for 30 sec - exiting 21:10:25 (4060): No heartbeat from core client for 30 sec - exiting 21:10:26 (4060): No heartbeat from core client for 30 sec - exiting 21:10:27 (4060): No heartbeat from core client for 30 sec - exiting 21:10:28 (4060): No heartbeat from core client for 30 sec - exiting 21:10:29 (4060): No heartbeat from core client for 30 sec - exiting 21:10:30 (4060): No heartbeat from core client for 30 sec - exiting 21:10:31 (4060): No heartbeat from core client for 30 sec - exiting 21:10:32 (4060): No heartbeat from core client for 30 sec - exiting 21:10:33 (4060): No heartbeat from core client for 30 sec - exiting 21:10:34 (4060): No heartbeat from core client for 30 sec - exiting 21:10:35 (4060): No heartbeat from core client for 30 sec - exiting 21:10:36 (4060): No heartbeat from core client for 30 sec - exiting 21:10:37 (4060): No heartbeat from core client for 30 sec - exiting 21:10:38 (4060): No heartbeat from core client for 30 sec - exiting 21:10:39 (4060): No heartbeat from core client for 30 sec - exiting 21:10:40 (4060): No heartbeat from core client for 30 sec - exiting 21:10:41 (4060): No heartbeat from core client for 30 sec - exiting 21:10:42 (4060): No heartbeat from core client for 30 sec - exiting 21:10:43 (4060): No heartbeat from core client for 30 sec - exiting 21:10:44 (4060): No heartbeat from core client for 30 sec - exiting 21:10:45 (4060): No heartbeat from core client for 30 sec - exiting 21:10:47 (4060): No heartbeat from core client for 30 sec - exiting 21:10:48 (4060): No heartbeat from core client for 30 sec - exiting 21:10:49 (4060): No heartbeat from core client for 30 sec - exiting 21:10:50 (4060): No heartbeat from core client for 30 sec - exiting 21:10:51 (4060): No heartbeat from core client for 30 sec - exiting 21:10:52 (4060): No heartbeat from core client for 30 sec - exiting 21:10:53 (4060): No heartbeat from core client for 30 sec - exiting 21:10:54 (4060): No heartbeat from core client for 30 sec - exiting 21:10:55 (4060): No heartbeat from core client for 30 sec - exiting 21:10:56 (4060): No heartbeat from core client for 30 sec - exiting 21:10:57 (4060): No heartbeat from core client for 30 sec - exiting 21:10:58 (4060): No heartbeat from core client for 30 sec - exiting 21:10:59 (4060): No heartbeat from core client for 30 sec - exiting 21:11:00 (4060): No heartbeat from core client for 30 sec - exiting 21:11:01 (4060): No heartbeat from core client for 30 sec - exiting 21:11:02 (4060): No heartbeat from core client for 30 sec - exiting 21:11:03 (4060): No heartbeat from core client for 30 sec - exiting 21:11:04 (4060): No heartbeat from core client for 30 sec - exiting 21:11:05 (4060): No heartbeat from core client for 30 sec - exiting 21:11:06 (4060): No heartbeat from core client for 30 sec - exiting 21:11:07 (4060): No heartbeat from core client for 30 sec - exiting 21:11:09 (4060): No heartbeat from core client for 30 sec - exiting 21:11:10 (4060): No heartbeat from core client for 30 sec - exiting 21:11:11 (4060): No heartbeat from core client for 30 sec - exiting 21:11:12 (4060): No heartbeat from core client for 30 sec - exiting 21:11:13 (4060): No heartbeat from core client for 30 sec - exiting 21:11:14 (4060): No heartbeat from core client for 30 sec - exiting 21:11:15 (4060): No heartbeat from core client for 30 sec - exiting 21:11:16 (4060): No heartbeat from core client for 30 sec - exiting 21:11:17 (4060): No heartbeat from core client for 30 sec - exiting 21:11:18 (4060): No heartbeat from core client for 30 sec - exiting 21:11:19 (4060): No heartbeat from core client for 30 sec - exiting 21:11:20 (4060): No heartbeat from core client for 30 sec - exiting 21:11:21 (4060): No heartbeat from core client for 30 sec - exiting 21:11:22 (4060): No heartbeat from core client for 30 sec - exiting 21:11:23 (4060): No heartbeat from core client for 30 sec - exiting 21:11:24 (4060): No heartbeat from core client for 30 sec - exiting 21:11:25 (4060): No heartbeat from core client for 30 sec - exiting 21:11:26 (4060): No heartbeat from core client for 30 sec - exiting 21:11:27 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3552, selfPID=3928, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2492, selfPID=4008, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5820, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6552, selfPID=6552, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6552, selfPID=6116, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 22:11:05 (6116): No heartbeat from core client for 30 sec - exiting 22:11:06 (6116): No heartbeat from core client for 30 sec - exiting 22:11:07 (6116): No heartbeat from core client for 30 sec - exiting 22:11:08 (6116): No heartbeat from core client for 30 sec - exiting 22:11:09 (6116): No heartbeat from core client for 30 sec - exiting 22:11:11 (6116): No heartbeat from core client for 30 sec - exiting 22:11:12 (6116): No heartbeat from core client for 30 sec - exiting Called boinc_finish 22:11:16 (6116): No heartbeat from core client for 30 sec - exiting 22:11:18 (6116): No heartbeat from core client for 30 sec - exiting 13:45:56 (3832): No heartbeat from core client for 30 sec - exiting 13:45:57 (3832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_ov1y_2006_1_008290194_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ov1y_2006_1_008290194_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ov1y_2006_1_008290194_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ov1y_2006_1_008290194_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_ov1y_2006_1_008290194_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Apr 2013 08:24:11	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	80,736	209,013	2.5888
15 Mar 2013 22:24:11	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	69,216	179,877	2.5988
27 Feb 2013 10:17:09	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	57,696	150,018	2.6001
23 Feb 2013 17:21:23	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	46,176	120,124	2.6014
22 Feb 2013 14:30:23	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	34,656	89,581	2.5849
18 Feb 2013 22:20:44	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	23,154	59,784	2.5820
18 Feb 2013 20:23:39	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	23,136	59,391	2.5670
14 Feb 2013 18:26:31	1211569	15564999	hadam3p_eu_ov1y_2006_1_008290194_0	11,616	30,002	2.5828