Task 16703153

Name	hadam3p_eu_j6p0_2013_1_008788152_0
Workunit	8934130
Created	4 Jul 2014, 19:45:24 UTC
Sent	5 Jul 2014, 15:28:46 UTC
Report deadline	17 Jun 2015, 20:48:46 UTC
Received	12 Jul 2014, 11:13:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	929161
Run time	2 days 8 hours 49 min 46 sec
CPU time	2 days 7 hours 38 min 7 sec
Validate state	Invalid
Credit	1,790.21
Device peak FLOPS	3.83 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:11:56 (5636): No heartbeat from core client for 30 sec - exiting 19:11:57 (5636): No heartbeat from core client for 30 sec - exiting 19:11:58 (5636): No heartbeat from core client for 30 sec - exiting 19:11:59 (5636): No heartbeat from core client for 30 sec - exiting 19:12:00 (5636): No heartbeat from core client for 30 sec - exiting 19:12:01 (5636): No heartbeat from core client for 30 sec - exiting 19:12:02 (5636): No heartbeat from core client for 30 sec - exiting 19:12:03 (5636): No heartbeat from core client for 30 sec - exiting 19:12:05 (5636): No heartbeat from core client for 30 sec - exiting 19:12:06 (5636): No heartbeat from core client for 30 sec - exiting 19:12:07 (5636): No heartbeat from core client for 30 sec - exiting 19:12:08 (5636): No heartbeat from core client for 30 sec - exiting 19:12:09 (5636): No heartbeat from core client for 30 sec - exiting 19:12:10 (5636): No heartbeat from core client for 30 sec - exiting 19:12:11 (5636): No heartbeat from core client for 30 sec - exiting 19:12:12 (5636): No heartbeat from core client for 30 sec - exiting 19:12:13 (5636): No heartbeat from core client for 30 sec - exiting 19:12:14 (5636): No heartbeat from core client for 30 sec - exiting 19:12:16 (5636): No heartbeat from core client for 30 sec - exiting 19:12:17 (5636): No heartbeat from core client for 30 sec - exiting 19:12:18 (5636): No heartbeat from core client for 30 sec - exiting 19:12:19 (5636): No heartbeat from core client for 30 sec - exiting 19:12:20 (5636): No heartbeat from core client for 30 sec - exiting 19:12:21 (5636): No heartbeat from core client for 30 sec - exiting 19:12:22 (5636): No heartbeat from core client for 30 sec - exiting 19:12:23 (5636): No heartbeat from core client for 30 sec - exiting 19:12:24 (5636): No heartbeat from core client for 30 sec - exiting 19:12:25 (5636): No heartbeat from core client for 30 sec - exiting 19:12:26 (5636): No heartbeat from core client for 30 sec - exiting 19:12:28 (5636): No heartbeat from core client for 30 sec - exiting 19:12:29 (5636): No heartbeat from core client for 30 sec - exiting 19:12:30 (5636): No heartbeat from core client for 30 sec - exiting 19:12:31 (5636): No heartbeat from core client for 30 sec - exiting 19:12:32 (5636): No heartbeat from core client for 30 sec - exiting 19:12:33 (5636): No heartbeat from core client for 30 sec - exiting 19:12:34 (5636): No heartbeat from core client for 30 sec - exiting 19:12:35 (5636): No heartbeat from core client for 30 sec - exiting 19:12:36 (5636): No heartbeat from core client for 30 sec - exiting 19:12:37 (5636): No heartbeat from core client for 30 sec - exiting 19:12:38 (5636): No heartbeat from core client for 30 sec - exiting 19:12:40 (5636): No heartbeat from core client for 30 sec - exiting 19:12:41 (5636): No heartbeat from core client for 30 sec - exiting 19:12:42 (5636): No heartbeat from core client for 30 sec - exiting 19:12:43 (5636): No heartbeat from core client for 30 sec - exiting 19:12:44 (5636): No heartbeat from core client for 30 sec - exiting 19:12:45 (5636): No heartbeat from core client for 30 sec - exiting 19:12:46 (5636): No heartbeat from core client for 30 sec - exiting 19:12:47 (5636): No heartbeat from core client for 30 sec - exiting 19:12:48 (5636): No heartbeat from core client for 30 sec - exiting 19:12:49 (5636): No heartbeat from core client for 30 sec - exiting 19:12:50 (5636): No heartbeat from core client for 30 sec - exiting 19:12:52 (5636): No heartbeat from core client for 30 sec - exiting 19:12:53 (5636): No heartbeat from core client for 30 sec - exiting 19:12:54 (5636): No heartbeat from core client for 30 sec - exiting 19:12:55 (5636): No heartbeat from core client for 30 sec - exiting 19:12:56 (5636): No heartbeat from core client for 30 sec - exiting 19:12:57 (5636): No heartbeat from core client for 30 sec - exiting 19:12:58 (5636): No heartbeat from core client for 30 sec - exiting 19:12:59 (5636): No heartbeat from core client for 30 sec - exiting 19:13:00 (5636): No heartbeat from core client for 30 sec - exiting 19:13:01 (5636): No heartbeat from core client for 30 sec - exiting 19:13:02 (5636): No heartbeat from core client for 30 sec - exiting 19:13:04 (5636): No heartbeat from core client for 30 sec - exiting 19:13:05 (5636): No heartbeat from core client for 30 sec - exiting 19:13:06 (5636): No heartbeat from core client for 30 sec - exiting 19:13:07 (5636): No heartbeat from core client for 30 sec - exiting 19:13:08 (5636): No heartbeat from core client for 30 sec - exiting 19:13:09 (5636): No heartbeat from core client for 30 sec - exiting 19:13:10 (5636): No heartbeat from core client for 30 sec - exiting 19:13:11 (5636): No heartbeat from core client for 30 sec - exiting 19:13:12 (5636): No heartbeat from core client for 30 sec - exiting 19:13:13 (5636): No heartbeat from core client for 30 sec - exiting 19:13:14 (5636): No heartbeat from core client for 30 sec - exiting 19:13:16 (5636): No heartbeat from core client for 30 sec - exiting 19:13:17 (5636): No heartbeat from core client for 30 sec - exiting 19:13:18 (5636): No heartbeat from core client for 30 sec - exiting 19:13:19 (5636): No heartbeat from core client for 30 sec - exiting 19:13:20 (5636): No heartbeat from core client for 30 sec - exiting 19:13:21 (5636): No heartbeat from core client for 30 sec - exiting 19:13:22 (5636): No heartbeat from core client for 30 sec - exiting 19:13:23 (5636): No heartbeat from core client for 30 sec - exiting 19:13:24 (5636): No heartbeat from core client for 30 sec - exiting 19:13:25 (5636): No heartbeat from core client for 30 sec - exiting 19:13:26 (5636): No heartbeat from core client for 30 sec - exiting 19:13:28 (5636): No heartbeat from core client for 30 sec - exiting 19:13:29 (5636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:01:02 (5648): No heartbeat from core client for 30 sec - exiting 19:01:03 (5648): No heartbeat from core client for 30 sec - exiting 19:01:04 (5648): No heartbeat from core client for 30 sec - exiting 19:01:05 (5648): No heartbeat from core client for 30 sec - exiting 19:01:06 (5648): No heartbeat from core client for 30 sec - exiting 19:01:07 (5648): No heartbeat from core client for 30 sec - exiting 19:01:08 (5648): No heartbeat from core client for 30 sec - exiting 19:01:09 (5648): No heartbeat from core client for 30 sec - exiting 19:01:11 (5648): No heartbeat from core client for 30 sec - exiting 19:01:12 (5648): No heartbeat from core client for 30 sec - exiting 19:01:13 (5648): No heartbeat from core client for 30 sec - exiting 19:01:14 (5648): No heartbeat from core client for 30 sec - exiting 19:01:15 (5648): No heartbeat from core client for 30 sec - exiting 19:01:16 (5648): No heartbeat from core client for 30 sec - exiting 19:01:17 (5648): No heartbeat from core client for 30 sec - exiting 19:01:18 (5648): No heartbeat from core client for 30 sec - exiting 19:01:19 (5648): No heartbeat from core client for 30 sec - exiting 19:01:20 (5648): No heartbeat from core client for 30 sec - exiting 19:01:21 (5648): No heartbeat from core client for 30 sec - exiting 19:01:23 (5648): No heartbeat from core client for 30 sec - exiting 19:01:24 (5648): No heartbeat from core client for 30 sec - exiting 19:01:25 (5648): No heartbeat from core client for 30 sec - exiting 19:01:26 (5648): No heartbeat from core client for 30 sec - exiting 19:01:27 (5648): No heartbeat from core client for 30 sec - exiting 19:01:28 (5648): No heartbeat from core client for 30 sec - exiting 19:01:29 (5648): No heartbeat from core client for 30 sec - exiting 19:01:30 (5648): No heartbeat from core client for 30 sec - exiting 19:01:31 (5648): No heartbeat from core client for 30 sec - exiting 19:01:32 (5648): No heartbeat from core client for 30 sec - exiting 19:01:33 (5648): No heartbeat from core client for 30 sec - exiting 19:01:35 (5648): No heartbeat from core client for 30 sec - exiting 19:01:36 (5648): No heartbeat from core client for 30 sec - exiting 19:01:37 (5648): No heartbeat from core client for 30 sec - exiting 19:01:38 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:25 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3600, selfPID=3600, iMonCtr=2 02:21:30 (5796): No heartbeat from core client for 30 sec - exiting 02:21:31 (5796): No heartbeat from core client for 30 sec - exiting 02:21:32 (5796): No heartbeat from core client for 30 sec - exiting 02:21:33 (5796): No heartbeat from core client for 30 sec - exiting 02:21:34 (5796): No heartbeat from core client for 30 sec - exiting 02:21:35 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:25:42 (5456): No heartbeat from core client for 30 sec - exiting 17:25:43 (5456): No heartbeat from core client for 30 sec - exiting 17:25:44 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2732, selfPID=2732, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2732, selfPID=5560, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_j6p0_2013_1_008788152_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j6p0_2013_1_008788152_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_j6p0_2013_1_008788152_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Jul 2014 00:39:37	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	103,776	190,490	1.8356
11 Jul 2014 19:07:53	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	92,256	169,571	1.8380
10 Jul 2014 22:15:12	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	80,736	148,241	1.8361
09 Jul 2014 23:11:49	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	69,216	127,304	1.8392
09 Jul 2014 17:09:22	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	57,696	105,717	1.8323
07 Jul 2014 17:45:51	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	46,176	84,676	1.8338
06 Jul 2014 19:41:52	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	34,656	63,649	1.8366
06 Jul 2014 12:46:26	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	23,136	42,672	1.8444
05 Jul 2014 22:29:55	929161	16703153	hadam3p_eu_j6p0_2013_1_008788152_0	11,616	21,476	1.8488