Task 14112778

Name	hadam3p_saf_1ebj_1990_1_006946391_1
Workunit	7149707
Created	19 Feb 2012, 15:11:39 UTC
Sent	19 Feb 2012, 15:12:23 UTC
Report deadline	31 Jan 2013, 20:32:23 UTC
Received	26 Apr 2012, 14:29:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1189684
Run time	1 days 8 hours 46 min 3 sec
CPU time	1 days 7 hours 2 min 52 sec
Validate state	Invalid
Credit	1,123.03
Device peak FLOPS	3.97 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4756, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4196, selfPID=4196, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4456, selfPID=4456, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6100, selfPID=6100, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4888, selfPID=4888, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 07:27:02 (3916): No heartbeat from core client for 30 sec - exiting 07:27:03 (3916): No heartbeat from core client for 30 sec - exiting 07:27:04 (3916): No heartbeat from core client for 30 sec - exiting 07:27:05 (3916): No heartbeat from core client for 30 sec - exiting 07:27:06 (3916): No heartbeat from core client for 30 sec - exiting 07:27:07 (3916): No heartbeat from core client for 30 sec - exiting 07:27:08 (3916): No heartbeat from core client for 30 sec - exiting 07:27:09 (3916): No heartbeat from core client for 30 sec - exiting 07:27:10 (3916): No heartbeat from core client for 30 sec - exiting 07:27:11 (3916): No heartbeat from core client for 30 sec - exiting 07:27:12 (3916): No heartbeat from core client for 30 sec - exiting 07:27:13 (3916): No heartbeat from core client for 30 sec - exiting 07:27:14 (3916): No heartbeat from core client for 30 sec - exiting 07:27:15 (3916): No heartbeat from core client for 30 sec - exiting 07:27:16 (3916): No heartbeat from core client for 30 sec - exiting 07:27:17 (3916): No heartbeat from core client for 30 sec - exiting 07:27:18 (3916): No heartbeat from core client for 30 sec - exiting 07:27:19 (3916): No heartbeat from core client for 30 sec - exiting 07:27:20 (3916): No heartbeat from core client for 30 sec - exiting 07:27:21 (3916): No heartbeat from core client for 30 sec - exiting 07:27:22 (3916): No heartbeat from core client for 30 sec - exiting 07:27:23 (3916): No heartbeat from core client for 30 sec - exiting 07:27:24 (3916): No heartbeat from core client for 30 sec - exiting 07:27:25 (3916): No heartbeat from core client for 30 sec - exiting 07:27:26 (3916): No heartbeat from core client for 30 sec - exiting 07:27:27 (3916): No heartbeat from core client for 30 sec - exiting 07:27:28 (3916): No heartbeat from core client for 30 sec - exiting 07:27:29 (3916): No heartbeat from core client for 30 sec - exiting 07:27:30 (3916): No heartbeat from core client for 30 sec - exiting 07:27:31 (3916): No heartbeat from core client for 30 sec - exiting 07:27:32 (3916): No heartbeat from core client for 30 sec - exiting 07:27:33 (3916): No heartbeat from core client for 30 sec - exiting 07:27:34 (3916): No heartbeat from core client for 30 sec - exiting 07:27:35 (3916): No heartbeat from core client for 30 sec - exiting 07:27:36 (3916): No heartbeat from core client for 30 sec - exiting 07:27:37 (3916): No heartbeat from core client for 30 sec - exiting 07:27:38 (3916): No heartbeat from core client for 30 sec - exiting 07:27:39 (3916): No heartbeat from core client for 30 sec - exiting 07:27:40 (3916): No heartbeat from core client for 30 sec - exiting 07:27:41 (3916): No heartbeat from core client for 30 sec - exiting 07:27:42 (3916): No heartbeat from core client for 30 sec - exiting 07:27:43 (3916): No heartbeat from core client for 30 sec - exiting 07:27:44 (3916): No heartbeat from core client for 30 sec - exiting 07:27:45 (3916): No heartbeat from core client for 30 sec - exiting 07:27:46 (3916): No heartbeat from core client for 30 sec - exiting 07:27:47 (3916): No heartbeat from core client for 30 sec - exiting 07:27:48 (3916): No heartbeat from core client for 30 sec - exiting 07:27:49 (3916): No heartbeat from core client for 30 sec - exiting 07:27:50 (3916): No heartbeat from core client for 30 sec - exiting 07:27:51 (3916): No heartbeat from core client for 30 sec - exiting 07:27:52 (3916): No heartbeat from core client for 30 sec - exiting 07:27:53 (3916): No heartbeat from core client for 30 sec - exiting 07:27:54 (3916): No heartbeat from core client for 30 sec - exiting 07:27:55 (3916): No heartbeat from core client for 30 sec - exiting 07:27:56 (3916): No heartbeat from core client for 30 sec - exiting 07:27:57 (3916): No heartbeat from core client for 30 sec - exiting 07:27:58 (3916): No heartbeat from core client for 30 sec - exiting 07:27:59 (3916): No heartbeat from core client for 30 sec - exiting 07:28:00 (3916): No heartbeat from core client for 30 sec - exiting 07:28:01 (3916): No heartbeat from core client for 30 sec - exiting 07:28:02 (3916): No heartbeat from core client for 30 sec - exiting 07:28:03 (3916): No heartbeat from core client for 30 sec - exiting 07:28:04 (3916): No heartbeat from core client for 30 sec - exiting 07:28:05 (3916): No heartbeat from core client for 30 sec - exiting 07:28:06 (3916): No heartbeat from core client for 30 sec - exiting 07:28:07 (3916): No heartbeat from core client for 30 sec - exiting 07:28:08 (3916): No heartbeat from core client for 30 sec - exiting 07:28:09 (3916): No heartbeat from core client for 30 sec - exiting 07:28:10 (3916): No heartbeat from core client for 30 sec - exiting 07:28:11 (3916): No heartbeat from core client for 30 sec - exiting 07:28:12 (3916): No heartbeat from core client for 30 sec - exiting 07:28:13 (3916): No heartbeat from core client for 30 sec - exiting 07:28:14 (3916): No heartbeat from core client for 30 sec - exiting 07:28:15 (3916): No heartbeat from core client for 30 sec - exiting 07:28:16 (3916): No heartbeat from core client for 30 sec - exiting 07:28:17 (3916): No heartbeat from core client for 30 sec - exiting 07:28:18 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2896, selfPID=2896, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 12:48:45 (3524): No heartbeat from core client for 30 sec - exiting 12:48:46 (3524): No heartbeat from core client for 30 sec - exiting 12:48:47 (3524): No heartbeat from core client for 30 sec - exiting 12:48:48 (3524): No heartbeat from core client for 30 sec - exiting 12:48:49 (3524): No heartbeat from core client for 30 sec - exiting 12:48:50 (3524): No heartbeat from core client for 30 sec - exiting 12:48:51 (3524): No heartbeat from core client for 30 sec - exiting 12:48:52 (3524): No heartbeat from core client for 30 sec - exiting 12:48:53 (3524): No heartbeat from core client for 30 sec - exiting 12:48:54 (3524): No heartbeat from core client for 30 sec - exiting 12:48:55 (3524): No heartbeat from core client for 30 sec - exiting 12:48:56 (3524): No heartbeat from core client for 30 sec - exiting 12:48:57 (3524): No heartbeat from core client for 30 sec - exiting 12:48:58 (3524): No heartbeat from core client for 30 sec - exiting 12:48:59 (3524): No heartbeat from core client for 30 sec - exiting 12:49:00 (3524): No heartbeat from core client for 30 sec - exiting 12:49:01 (3524): No heartbeat from core client for 30 sec - exiting 12:49:02 (3524): No heartbeat from core client for 30 sec - exiting 12:49:03 (3524): No heartbeat from core client for 30 sec - exiting 12:49:04 (3524): No heartbeat from core client for 30 sec - exiting 12:49:05 (3524): No heartbeat from core client for 30 sec - exiting 12:49:06 (3524): No heartbeat from core client for 30 sec - exiting 12:49:07 (3524): No heartbeat from core client for 30 sec - exiting 12:49:08 (3524): No heartbeat from core client for 30 sec - exiting 12:49:09 (3524): No heartbeat from core client for 30 sec - exiting 12:49:10 (3524): No heartbeat from core client for 30 sec - exiting 12:49:11 (3524): No heartbeat from core client for 30 sec - exiting 12:49:12 (3524): No heartbeat from core client for 30 sec - exiting 12:49:13 (3524): No heartbeat from core client for 30 sec - exiting 12:49:14 (3524): No heartbeat from core client for 30 sec - exiting 12:49:15 (3524): No heartbeat from core client for 30 sec - exiting 12:49:16 (3524): No heartbeat from core client for 30 sec - exiting 12:49:17 (3524): No heartbeat from core client for 30 sec - exiting 12:49:18 (3524): No heartbeat from core client for 30 sec - exiting 12:49:19 (3524): No heartbeat from core client for 30 sec - exiting 12:49:20 (3524): No heartbeat from core client for 30 sec - exiting 12:49:21 (3524): No heartbeat from core client for 30 sec - exiting 12:49:22 (3524): No heartbeat from core client for 30 sec - exiting 12:49:23 (3524): No heartbeat from core client for 30 sec - exiting 12:49:24 (3524): No heartbeat from core client for 30 sec - exiting 12:49:25 (3524): No heartbeat from core client for 30 sec - exiting 12:49:26 (3524): No heartbeat from core client for 30 sec - exiting 12:49:27 (3524): No heartbeat from core client for 30 sec - exiting 12:49:28 (3524): No heartbeat from core client for 30 sec - exiting 12:49:29 (3524): No heartbeat from core client for 30 sec - exiting 12:49:30 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:57:09 (4704): No heartbeat from core client for 30 sec - exiting 19:57:10 (4704): No heartbeat from core client for 30 sec - exiting 19:57:11 (4704): No heartbeat from core client for 30 sec - exiting 19:57:12 (4704): No heartbeat from core client for 30 sec - exiting 19:57:13 (4704): No heartbeat from core client for 30 sec - exiting 19:57:14 (4704): No heartbeat from core client for 30 sec - exiting 19:57:15 (4704): No heartbeat from core client for 30 sec - exiting 19:57:16 (4704): No heartbeat from core client for 30 sec - exiting 19:57:17 (4704): No heartbeat from core client for 30 sec - exiting 19:57:18 (4704): No heartbeat from core client for 30 sec - exiting 19:57:19 (4704): No heartbeat from core client for 30 sec - exiting 19:57:20 (4704): No heartbeat from core client for 30 sec - exiting 19:57:21 (4704): No heartbeat from core client for 30 sec - exiting 19:57:22 (4704): No heartbeat from core client for 30 sec - exiting 19:57:23 (4704): No heartbeat from core client for 30 sec - exiting 19:57:24 (4704): No heartbeat from core client for 30 sec - exiting 19:57:25 (4704): No heartbeat from core client for 30 sec - exiting 19:57:26 (4704): No heartbeat from core client for 30 sec - exiting 19:57:27 (4704): No heartbeat from core client for 30 sec - exiting 19:57:28 (4704): No heartbeat from core client for 30 sec - exiting 19:57:29 (4704): No heartbeat from core client for 30 sec - exiting 19:57:30 (4704): No heartbeat from core client for 30 sec - exiting 19:57:31 (4704): No heartbeat from core client for 30 sec - exiting 19:57:32 (4704): No heartbeat from core client for 30 sec - exiting 19:57:33 (4704): No heartbeat from core client for 30 sec - exiting 19:57:34 (4704): No heartbeat from core client for 30 sec - exiting 19:57:35 (4704): No heartbeat from core client for 30 sec - exiting 19:57:36 (4704): No heartbeat from core client for 30 sec - exiting 19:57:37 (4704): No heartbeat from core client for 30 sec - exiting 19:57:38 (4704): No heartbeat from core client for 30 sec - exiting 19:57:39 (4704): No heartbeat from core client for 30 sec - exiting 19:57:40 (4704): No heartbeat from core client for 30 sec - exiting 19:57:41 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3772, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... 08:37:55 (4656): No heartbeat from core client for 30 sec - exiting 08:37:56 (4656): No heartbeat from core client for 30 sec - exiting 08:37:57 (4656): No heartbeat from core client for 30 sec - exiting 08:37:58 (4656): No heartbeat from core client for 30 sec - exiting 08:37:59 (4656): No heartbeat from core client for 30 sec - exiting 08:38:00 (4656): No heartbeat from core client for 30 sec - exiting 08:38:01 (4656): No heartbeat from core client for 30 sec - exiting 08:38:02 (4656): No heartbeat from core client for 30 sec - exiting 08:38:03 (4656): No heartbeat from core client for 30 sec - exiting 08:38:04 (4656): No heartbeat from core client for 30 sec - exiting 08:38:05 (4656): No heartbeat from core client for 30 sec - exiting 08:38:06 (4656): No heartbeat from core client for 30 sec - exiting 08:38:07 (4656): No heartbeat from core client for 30 sec - exiting 08:38:08 (4656): No heartbeat from core client for 30 sec - exiting 08:38:09 (4656): No heartbeat from core client for 30 sec - exiting 08:38:10 (4656): No heartbeat from core client for 30 sec - exiting 08:38:11 (4656): No heartbeat from core client for 30 sec - exiting 08:38:12 (4656): No heartbeat from core client for 30 sec - exiting 08:38:13 (4656): No heartbeat from core client for 30 sec - exiting 08:38:14 (4656): No heartbeat from core client for 30 sec - exiting 08:38:15 (4656): No heartbeat from core client for 30 sec - exiting 08:38:16 (4656): No heartbeat from core client for 30 sec - exiting 08:38:17 (4656): No heartbeat from core client for 30 sec - exiting 08:38:18 (4656): No heartbeat from core client for 30 sec - exiting 08:38:19 (4656): No heartbeat from core client for 30 sec - exiting 08:38:20 (4656): No heartbeat from core client for 30 sec - exiting 08:38:21 (4656): No heartbeat from core client for 30 sec - exiting 08:38:22 (4656): No heartbeat from core client for 30 sec - exiting 08:38:23 (4656): No heartbeat from core client for 30 sec - exiting 08:38:24 (4656): No heartbeat from core client for 30 sec - exiting 08:38:25 (4656): No heartbeat from core client for 30 sec - exiting 08:38:26 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3324, selfPID=3324, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5048, selfPID=5048, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_1ebj_1990_1_006946391_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1ebj_1990_1_006946391_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1ebj_1990_1_006946391_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1ebj_1990_1_006946391_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1ebj_1990_1_006946391_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1ebj_1990_1_006946391_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2012 17:17:55	1189684	14112778	hadam3p_saf_1ebj_1990_1_006946391_1	69,229	100,189	1.4472
20 Apr 2012 16:02:31	1189684	14112778	hadam3p_saf_1ebj_1990_1_006946391_1	69,216	99,950	1.4440
14 Apr 2012 06:39:07	1189684	14112778	hadam3p_saf_1ebj_1990_1_006946391_1	57,696	83,978	1.4555
10 Apr 2012 17:36:30	1189684	14112778	hadam3p_saf_1ebj_1990_1_006946391_1	46,176	68,451	1.4824
08 Apr 2012 08:38:36	1189684	14112778	hadam3p_saf_1ebj_1990_1_006946391_1	34,656	51,407	1.4834
29 Mar 2012 18:36:44	1189684	14112778	hadam3p_saf_1ebj_1990_1_006946391_1	23,136	34,534	1.4927
26 Feb 2012 13:33:39	1189684	14112778	hadam3p_saf_1ebj_1990_1_006946391_1	11,616	17,212	1.4817