Task 13247099

Name	hadam3p_eu_2t91_1967_1_007401846_0
Workunit	7599276
Created	14 Aug 2011, 13:08:06 UTC
Sent	14 Aug 2011, 13:08:16 UTC
Report deadline	26 Jul 2012, 18:28:16 UTC
Received	24 Sep 2011, 5:53:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1147034
Run time	2 days 17 hours 24 min 25 sec
CPU time	2 days 10 hours 45 min 21 sec
Validate state	Invalid
Credit	1,194.02
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4720, selfPID=4720, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 18:00:15 (2220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:41 (4872): No heartbeat from core client for 30 sec - exiting 18:02:42 (4872): No heartbeat from core client for 30 sec - exiting 18:02:43 (4872): No heartbeat from core client for 30 sec - exiting 18:02:44 (4872): No heartbeat from core client for 30 sec - exiting 18:02:45 (4872): No heartbeat from core client for 30 sec - exiting 18:02:46 (4872): No heartbeat from core client for 30 sec - exiting 18:02:47 (4872): No heartbeat from core client for 30 sec - exiting 18:02:48 (4872): No heartbeat from core client for 30 sec - exiting 18:02:49 (4872): No heartbeat from core client for 30 sec - exiting 18:02:50 (4872): No heartbeat from core client for 30 sec - exiting 18:02:51 (4872): No heartbeat from core client for 30 sec - exiting 18:02:52 (4872): No heartbeat from core client for 30 sec - exiting 18:02:53 (4872): No heartbeat from core client for 30 sec - exiting 18:02:54 (4872): No heartbeat from core client for 30 sec - exiting 18:02:55 (4872): No heartbeat from core client for 30 sec - exiting 18:02:56 (4872): No heartbeat from core client for 30 sec - exiting 18:02:57 (4872): No heartbeat from core client for 30 sec - exiting 18:02:58 (4872): No heartbeat from core client for 30 sec - exiting 18:02:59 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:00 (4872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:58:49 (12608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:51 (12608): No heartbeat from core client for 30 sec - exiting 19:58:52 (12608): No heartbeat from core client for 30 sec - exiting 19:58:53 (12608): No heartbeat from core client for 30 sec - exiting 19:58:54 (12608): No heartbeat from core client for 30 sec - exiting 19:58:55 (12608): No heartbeat from core client for 30 sec - exiting 19:58:56 (12608): No heartbeat from core client for 30 sec - exiting 19:58:57 (12608): No heartbeat from core client for 30 sec - exiting 21:11:56 (12968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:58 (12968): No heartbeat from core client for 30 sec - exiting 21:11:59 (12968): No heartbeat from core client for 30 sec - exiting 21:12:00 (12968): No heartbeat from core client for 30 sec - exiting 22:14:26 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:29 (6720): No heartbeat from core client for 30 sec - exiting 22:14:30 (6720): No heartbeat from core client for 30 sec - exiting 22:14:31 (6720): No heartbeat from core client for 30 sec - exiting 22:14:32 (6720): No heartbeat from core client for 30 sec - exiting 22:14:33 (6720): No heartbeat from core client for 30 sec - exiting 22:28:30 (12436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:28:31 (12436): No heartbeat from core client for 30 sec - exiting 22:28:32 (12436): No heartbeat from core client for 30 sec - exiting 22:28:33 (12436): No heartbeat from core client for 30 sec - exiting 22:28:34 (12436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:26:53 (9384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:54 (9384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 16:53:17 (7784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:53:18 (7784): No heartbeat from core client for 30 sec - exiting 16:53:19 (7784): No heartbeat from core client for 30 sec - exiting 16:53:20 (7784): No heartbeat from core client for 30 sec - exiting 16:53:21 (7784): No heartbeat from core client for 30 sec - exiting 16:53:22 (7784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:49:36 (10104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:37 (10104): No heartbeat from core client for 30 sec - exiting 19:49:38 (10104): No heartbeat from core client for 30 sec - exiting 19:49:39 (10104): No heartbeat from core client for 30 sec - exiting 20:51:43 (9956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:45 (9956): No heartbeat from core client for 30 sec - exiting 20:51:46 (9956): No heartbeat from core client for 30 sec - exiting 20:51:47 (9956): No heartbeat from core client for 30 sec - exiting 20:51:48 (9956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 00:05:49 (8388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:50 (8388): No heartbeat from core client for 30 sec - exiting 00:05:51 (8388): No heartbeat from core client for 30 sec - exiting 00:05:52 (8388): No heartbeat from core client for 30 sec - exiting 01:07:55 (7756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:57 (7756): No heartbeat from core client for 30 sec - exiting 01:07:58 (7756): No heartbeat from core client for 30 sec - exiting 01:07:59 (7756): No heartbeat from core client for 30 sec - exiting 02:09:59 (9516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:01 (9516): No heartbeat from core client for 30 sec - exiting 02:10:02 (9516): No heartbeat from core client for 30 sec - exiting 03:11:59 (732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:00 (732): No heartbeat from core client for 30 sec - exiting 03:12:01 (732): No heartbeat from core client for 30 sec - exiting 03:12:02 (732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:35:51 (9588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:55 (9588): No heartbeat from core client for 30 sec - exiting 18:35:56 (9588): No heartbeat from core client for 30 sec - exiting 18:35:57 (9588): No heartbeat from core client for 30 sec - exiting 18:35:58 (9588): No heartbeat from core client for 30 sec - exiting 18:35:59 (9588): No heartbeat from core client for 30 sec - exiting 18:36:00 (9588): No heartbeat from core client for 30 sec - exiting 18:36:01 (9588): No heartbeat from core client for 30 sec - exiting 18:36:02 (9588): No heartbeat from core client for 30 sec - exiting 18:41:19 (9740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:50 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:03:52 (2240): No heartbeat from core client for 30 sec - exiting 19:03:53 (2240): No heartbeat from core client for 30 sec - exiting 19:03:54 (2240): No heartbeat from core client for 30 sec - exiting 19:08:12 (7496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:35 (11200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:37 (11200): No heartbeat from core client for 30 sec - exiting 19:13:38 (11200): No heartbeat from core client for 30 sec - exiting 19:13:39 (11200): No heartbeat from core client for 30 sec - exiting 19:13:40 (11200): No heartbeat from core client for 30 sec - exiting 19:20:10 (12076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:17 (6496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:19 (6496): No heartbeat from core client for 30 sec - exiting 19:26:20 (6496): No heartbeat from core client for 30 sec - exiting 19:31:18 (9576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:20 (9576): No heartbeat from core client for 30 sec - exiting 19:31:21 (9576): No heartbeat from core client for 30 sec - exiting 19:31:22 (9576): No heartbeat from core client for 30 sec - exiting 19:31:23 (9576): No heartbeat from core client for 30 sec - exiting 19:36:54 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:58 (3224): No heartbeat from core client for 30 sec - exiting 19:36:59 (3224): No heartbeat from core client for 30 sec - exiting 19:37:00 (3224): No heartbeat from core client for 30 sec - exiting 19:42:42 (10840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:43 (10840): No heartbeat from core client for 30 sec - exiting 19:42:44 (10840): No heartbeat from core client for 30 sec - exiting 19:48:50 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:54 (6468): No heartbeat from core client for 30 sec - exiting 19:55:07 (11220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:52 (1576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:53 (1576): No heartbeat from core client for 30 sec - exiting 20:07:30 (2364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:33 (2364): No heartbeat from core client for 30 sec - exiting 20:07:34 (2364): No heartbeat from core client for 30 sec - exiting 20:07:35 (2364): No heartbeat from core client for 30 sec - exiting 20:07:36 (2364): No heartbeat from core client for 30 sec - exiting 20:07:37 (2364): No heartbeat from core client for 30 sec - exiting 20:07:38 (2364): No heartbeat from core client for 30 sec - exiting 20:13:33 (9004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:05 (11288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:07 (6388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:09 (6388): No heartbeat from core client for 30 sec - exiting 20:25:10 (6388): No heartbeat from core client for 30 sec - exiting 20:25:11 (6388): No heartbeat from core client for 30 sec - exiting 20:25:12 (6388): No heartbeat from core client for 30 sec - exiting 20:30:27 (896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:29 (896): No heartbeat from core client for 30 sec - exiting 20:30:30 (896): No heartbeat from core client for 30 sec - exiting 20:35:43 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:28 (9044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:32 (11988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:34 (11988): No heartbeat from core client for 30 sec - exiting 20:45:35 (11988): No heartbeat from core client for 30 sec - exiting 20:50:15 (11928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:17 (11928): No heartbeat from core client for 30 sec - exiting 20:50:18 (11928): No heartbeat from core client for 30 sec - exiting 20:54:52 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:57 (1144): No heartbeat from core client for 30 sec - exiting 20:54:58 (1144): No heartbeat from core client for 30 sec - exiting 20:54:59 (1144): No heartbeat from core client for 30 sec - exiting 20:55:00 (1144): No heartbeat from core client for 30 sec - exiting 20:55:01 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:22:51 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:22:54 (7464): No heartbeat from core client for 30 sec - exiting 23:22:55 (7464): No heartbeat from core client for 30 sec - exiting 23:22:56 (7464): No heartbeat from core client for 30 sec - exiting 23:22:57 (7464): No heartbeat from core client for 30 sec - exiting 23:28:20 (6884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:28:22 (6884): No heartbeat from core client for 30 sec - exiting 23:34:19 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:21 (4976): No heartbeat from core client for 30 sec - exiting 23:34:22 (4976): No heartbeat from core client for 30 sec - exiting 23:34:23 (4976): No heartbeat from core client for 30 sec - exiting 23:34:24 (4976): No heartbeat from core client for 30 sec - exiting 23:34:25 (4976): No heartbeat from core client for 30 sec - exiting 23:34:26 (4976): No heartbeat from core client for 30 sec - exiting 23:34:27 (4976): No heartbeat from core client for 30 sec - exiting 23:40:23 (6976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:35 (6976): No heartbeat from core client for 30 sec - exiting 23:40:46 (6976):RNo heartbeat from core client for 30 sec - exiting egional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8252, selfPID=8252, iMonCtr=2 23:40:53 (6976): No heartbeat from core client for 30 sec - exiting 23:40:54 (6976): No heartbeat from core client for 30 sec - exiting 23:40:55 (6976): No heartbeat from core client for 30 sec - exiting 23:40:56 (6976): No heartbeat from core client for 30 sec - exiting 00:35:33 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:35:34 (4612): No heartbeat from core client for 30 sec - exiting 00:35:35 (4612): No heartbeat from core client for 30 sec - exiting 00:35:36 (4612): No heartbeat from core client for 30 sec - exiting 00:35:37 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:24:22 (3720): No heartbeat from core client for 30 sec - exiting 20:24:23 (3720): No heartbeat from core client for 30 sec - exiting 20:24:24 (3720): No heartbeat from core client for 30 sec - exiting 20:24:25 (3720): No heartbeat from core client for 30 sec - exiting 20:24:26 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2832, selfPID=2832, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11004, selfPID=11004, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12848, selfPID=12848, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:24:44 (6224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... R3:24:47 (6224): No heartbeat from core client for 30 sec - exiting 23:27:16 (11576): No heartbeat from core client for 30 sec - exiting 23:27:17 (11576): No heartbeat from core client for 30 sec - exiting 23:27:19 (11576): No heartbeat from core client for 30 sec - exiting 23:27:20 (11576): No heartbeat from core client for 30 sec - exiting 23:27:22 (11576): No heartbeat from core client for 30 sec - exiting 23:27:23 (11576): No heartbeat from core client for 30 sec - exiting 23:27:25 (11576): No heartbeat from core client for 30 sec - exiting 23:27:26 (11576): No heartbeat from core client for 30 sec - exiting 23:27:28 (11576): No heartbeat from core client for 30 sec - exiting 23:27:29 (11576): No heartbeat from core client for 30 sec - exiting 23:27:30 (11576): No heartbeat from core client for 30 sec - exiting 23:27:32 (11576): No heartbeat from core client for 30 sec - exiting 23:27:33 (11576): No heartbeat from core client for 30 sec - exiting 23:27:34 (11576): No heartbeat from core client for 30 sec - exiting 23:27:36 (11576): No heartbeat from core client for 30 sec - exiting 23:27:37 (11576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:38 (11576): No heartbeat from core client for 30 sec - exiting 23:27:41 (11576): No heartbeat from core client for 30 sec - exiting 23:27:42 (11576): No heartbeat from core client for 30 sec - exiting 23:27:43 (11576): No heartbeat from core client for 30 sec - exiting 23:34:23 (7224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:25 (7224): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_2t91_1967_1_007401846_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2t91_1967_1_007401846_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2t91_1967_1_007401846_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2t91_1967_1_007401846_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2t91_1967_1_007401846_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2t91_1967_1_007401846_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Sep 2011 07:11:07	1147034	13247099	hadam3p_eu_2t91_1967_1_007401846_0	69,216	192,160	2.7762
20 Sep 2011 08:03:09	1147034	13247099	hadam3p_eu_2t91_1967_1_007401846_0	57,696	159,973	2.7727
19 Sep 2011 17:00:37	1147034	13247099	hadam3p_eu_2t91_1967_1_007401846_0	46,176	128,937	2.7923
16 Sep 2011 08:41:43	1147034	13247099	hadam3p_eu_2t91_1967_1_007401846_0	34,656	99,344	2.8666
14 Sep 2011 19:33:04	1147034	13247099	hadam3p_eu_2t91_1967_1_007401846_0	23,136	67,450	2.9154
22 Aug 2011 12:32:46	1147034	13247099	hadam3p_eu_2t91_1967_1_007401846_0	11,616	34,506	2.9706