Task 12864031

Name	hadam3p_eu_2tsr_1960_1_007244813_0
Workunit	7443053
Created	5 May 2011, 4:03:30 UTC
Sent	9 May 2011, 14:18:03 UTC
Report deadline	20 Apr 2012, 19:38:03 UTC
Received	14 May 2011, 7:38:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1148296
Run time
CPU time	2 days 3 hours 26 min 3 sec
Validate state	Invalid
Credit	995.30
Device peak FLOPS	2.89 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <stderr_txt> 06:39:16 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) 07:06:18 (160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:19 (160): No heartbeat from core client for 30 sec - exiting 07:06:20 (160): No heartbeat from core client for 30 sec - exiting 07:06:21 (160): No heartbeat from core client for 30 sec - exiting 07:06:22 (160): No heartbeat from core client for 30 sec - exiting 07:06:23 (160): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2452, selfPID=2452, iMonCtr=2 07:06:25 (160): No heartbeat from core client for 30 sec - exiting 07:06:26 (160): No heartbeat from core client for 30 sec - exiting 07:06:27 (160): No heartbeat from core client for 30 sec - exiting 07:06:28 (160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:16:14 (792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:49 (496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:51 (496): No heartbeat from core client for 30 sec - exiting 19:27:52 (496): No heartbeat from core client for 30 sec - exiting 19:27:53 (496): No heartbeat from core client for 30 sec - exiting 20:49:27 (2628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:34 (2628): No heartbeat from core client for 30 sec - exiting 20:49:35 (2628): No heartbeat from core client for 30 sec - exiting 21:00:06 (632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:09 (632): No heartbeat from core client for 30 sec - exiting 21:00:10 (632): No heartbeat from core client for 30 sec - exiting 21:00:11 (632): No heartbeat from core client for 30 sec - exiting 21:27:08 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:37 (1096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:41 (1096): No heartbeat from core client for 30 sec - exiting 21:38:42 (1096): No heartbeat from core client for 30 sec - exiting 21:38:43 (1096): No heartbeat from core client for 30 sec - exiting 21:38:45 (1096): No heartbeat from core client for 30 sec - exiting 21:38:46 (1096): No heartbeat from core client for 30 sec - exiting 21:38:47 (1096): No heartbeat from core client for 30 sec - exiting 21:49:50 (2360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:23 (2320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=288, selfPID=288, iMonCtr=2 06:32:07 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:10 (2248): No heartbeat from core client for 30 sec - exiting 06:32:11 (2248): No heartbeat from core client for 30 sec - exiting 06:32:12 (2248): No heartbeat from core client for 30 sec - exiting 06:32:13 (2248): No heartbeat from core client for 30 sec - exiting 06:32:14 (2248): No heartbeat from core client for 30 sec - exiting 06:32:15 (2248): No heartbeat from core client for 30 sec - exiting 06:32:16 (2248): No heartbeat from core client for 30 sec - exiting 06:32:18 (2248): No heartbeat from core client for 30 sec - exiting 06:42:44 (2600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:03 (144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:06 (144): No heartbeat from core client for 30 sec - exiting 06:55:07 (144): No heartbeat from core client for 30 sec - exiting 07:07:09 (1580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:13 (1580): No heartbeat from core client for 30 sec - exiting 07:07:14 (1580): No heartbeat from core client for 30 sec - exiting 07:34:46 (2428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:34:52 (2428): No heartbeat from core client for 30 sec - exiting 07:34:53 (2428): No heartbeat from core client for 30 sec - exiting 07:34:55 (2428): No heartbeat from core client for 30 sec - exiting 07:34:56 (2428): No heartbeat from core client for 30 sec - exiting 07:34:57 (2428): No heartbeat from core client for 30 sec - exiting 07:34:58 (2428): No heartbeat from core client for 30 sec - exiting 07:34:59 (2428): No heartbeat from core client for 30 sec - exiting 07:47:10 (1736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2472, selfPID=2472, iMonCtr=2 08:00:39 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:43 (2308): No heartbeat from core client for 30 sec - exiting 08:00:44 (2308): No heartbeat from core client for 30 sec - exiting 08:00:46 (2308): No heartbeat from core client for 30 sec - exiting 08:00:47 (2308): No heartbeat from core client for 30 sec - exiting 08:00:48 (2308): No heartbeat from core client for 30 sec - exiting 08:00:49 (2308): No heartbeat from core client for 30 sec - exiting 08:00:50 (2308): No heartbeat from core client for 30 sec - exiting 08:00:51 (2308): No heartbeat from core client for 30 sec - exiting 08:00:52 (2308): No heartbeat from core client for 30 sec - exiting 08:00:53 (2308): No heartbeat from core client for 30 sec - exiting 08:00:54 (2308): No heartbeat from core client for 30 sec - exiting 08:00:55 (2308): No heartbeat from core client for 30 sec - exiting 08:00:56 (2308): No heartbeat from core client for 30 sec - exiting 08:11:41 (3036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:43 (3036): No heartbeat from core client for 30 sec - exiting 08:24:16 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:37 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:09 (248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:11 (248): No heartbeat from core client for 30 sec - exiting 09:06:13 (248): No heartbeat from core client for 30 sec - exiting 09:06:14 (248): No heartbeat from core client for 30 sec - exiting 09:06:15 (248): No heartbeat from core client for 30 sec - exiting 09:06:16 (248): No heartbeat from core client for 30 sec - exiting 09:06:17 (248): No heartbeat from core client for 30 sec - exiting 09:06:18 (248): No heartbeat from core client for 30 sec - exiting 09:06:19 (248): No heartbeat from core client for 30 sec - exiting 09:06:20 (248): No heartbeat from core client for 30 sec - exiting 09:06:21 (248): No heartbeat from core client for 30 sec - exiting 09:06:22 (248): No heartbeat from core client for 30 sec - exiting 09:06:23 (248): No heartbeat from core client for 30 sec - exiting 09:06:25 (248): No heartbeat from core client for 30 sec - exiting 09:06:26 (248): No heartbeat from core client for 30 sec - exiting 09:06:27 (248): No heartbeat from core client for 30 sec - exiting 09:06:28 (248): No heartbeat from core client for 30 sec - exiting 09:06:29 (248): No heartbeat from core client for 30 sec - exiting 09:06:30 (248): No heartbeat from core client for 30 sec - exiting 09:17:59 (264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:17 (2452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:42 (1036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:44 (1036): No heartbeat from core client for 30 sec - exiting 09:57:45 (1036): No heartbeat from core client for 30 sec - exiting 09:57:46 (1036): No heartbeat from core client for 30 sec - exiting 09:57:47 (1036): No heartbeat from core client for 30 sec - exiting 09:57:48 (1036): No heartbeat from core client for 30 sec - exiting 09:57:49 (1036): No heartbeat from core client for 30 sec - exiting 09:57:51 (1036): No heartbeat from core client for 30 sec - exiting 09:57:52 (1036): No heartbeat from core client for 30 sec - exiting 09:57:53 (1036): No heartbeat from core client for 30 sec - exiting 09:57:54 (1036): No heartbeat from core client for 30 sec - exiting 09:57:55 (1036): No heartbeat from core client for 30 sec - exiting 09:57:56 (1036): No heartbeat from core client for 30 sec - exiting 09:57:57 (1036): No heartbeat from core client for 30 sec - exiting 09:57:58 (1036): No heartbeat from core client for 30 sec - exiting 09:57:59 (1036): No heartbeat from core client for 30 sec - exiting 09:58:00 (1036): No heartbeat from core client for 30 sec - exiting 09:58:01 (1036): No heartbeat from core client for 30 sec - exiting 09:58:03 (1036): No heartbeat from core client for 30 sec - exiting 09:58:04 (1036): No heartbeat from core client for 30 sec - exiting 09:58:05 (1036): No heartbeat from core client for 30 sec - exiting 09:58:06 (1036): No heartbeat from core client for 30 sec - exiting 09:58:07 (1036): No heartbeat from core client for 30 sec - exiting 09:58:08 (1036): No heartbeat from core client for 30 sec - exiting 09:58:09 (1036): No heartbeat from core client for 30 sec - exiting 09:58:10 (1036): No heartbeat from core client for 30 sec - exiting 10:10:13 (1708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:22 (1708): No heartbeat from core client for 30 sec - exiting 10:10:24 (1708): No heartbeat from core client for 30 sec - exiting 10:21:51 (2616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:55 (2616): No heartbeat from core client for 30 sec - exiting 10:21:56 (2616): No heartbeat from core client for 30 sec - exiting 10:33:28 (324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:40 (2136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:58:12 (2336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:22 (1512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:24 (1512): No heartbeat from core client for 30 sec - exiting 11:10:25 (1512): No heartbeat from core client for 30 sec - exiting 11:22:23 (1676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:26 (1676): No heartbeat from core client for 30 sec - exiting No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2644, selfPID=2644, iMonCtr=2 11:22:27 (1676): No heartbeat from core client for 30 sec - exiting 11:22:28 (1676): No heartbeat from core client for 30 sec - exiting 11:22:29 (1676): No heartbeat from core client for 30 sec - exiting 11:22:30 (1676): No heartbeat from core client for 30 sec - exiting 11:22:31 (1676): No heartbeat from core client for 30 sec - exiting 11:33:59 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:03 (2152): No heartbeat from core client for 30 sec - exiting 11:34:04 (2152): No heartbeat from core client for 30 sec - exiting 11:34:05 (2152): No heartbeat from core client for 30 sec - exiting 11:34:06 (2152): No heartbeat from core client for 30 sec - exiting 11:45:52 (1344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:45:58 (1344): No heartbeat from core client for 30 sec - exiting 11:45:59 (1344): No heartbeat from core client for 30 sec - exiting 11:46:01 (1344): No heartbeat from core client for 30 sec - exiting 11:46:02 (1344): No heartbeat from core client for 30 sec - exiting 11:46:03 (1344): No heartbeat from core client for 30 sec - exiting 11:46:04 (1344): No heartbeat from core client for 30 sec - exiting 11:46:05 (1344): No heartbeat from core client for 30 sec - exiting 11:46:06 (1344): No heartbeat from core client for 30 sec - exiting 11:46:07 (1344): No heartbeat from core client for 30 sec - exiting 11:46:08 (1344): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2524, selfPID=2524, iMonCtr=2 11:46:09 (1344): No heartbeat from core client for 30 sec - exiting 11:46:10 (1344): No heartbeat from core client for 30 sec - exiting 11:46:11 (1344): No heartbeat from core client for 30 sec - exiting 11:46:13 (1344): No heartbeat from core client for 30 sec - exiting 11:46:14 (1344): No heartbeat from core client for 30 sec - exiting 11:46:15 (1344): No heartbeat from core client for 30 sec - exiting 11:46:16 (1344): No heartbeat from core client for 30 sec - exiting 11:46:17 (1344): No heartbeat from core client for 30 sec - exiting 11:46:18 (1344): No heartbeat from core client for 30 sec - exiting 11:46:19 (1344): No heartbeat from core client for 30 sec - exiting 11:56:55 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:00 (2728): No heartbeat from core client for 30 sec - exiting 11:57:01 (2728): No heartbeat from core client for 30 sec - exiting 11:57:02 (2728): No heartbeat from core client for 30 sec - exiting 12:08:21 (1808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:26 (1808): No heartbeat from core client for 30 sec - exiting 12:08:27 (1808): No heartbeat from core client for 30 sec - exiting 12:08:28 (1808): No heartbeat from core client for 30 sec - exiting 12:08:29 (1808): No heartbeat from core client for 30 sec - exiting 12:08:30 (1808): No heartbeat from core client for 30 sec - exiting 12:08:31 (1808): No heartbeat from core client for 30 sec - exiting 12:08:32 (1808): No heartbeat from core client for 30 sec - exiting 12:08:33 (1808): No heartbeat from core client for 30 sec - exiting 12:21:07 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:15 (2996): No heartbeat from core client for 30 sec - exiting 12:21:16 (2996): No heartbeat from core client for 30 sec - exiting 12:21:17 (2996): No heartbeat from core client for 30 sec - exiting 12:21:19 (2996): No heartbeat from core client for 30 sec - exiting 12:21:20 (2996): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=328, selfPID=328, iMonCtr=2 12:21:21 (2996): No heartbeat from core client for 30 sec - exiting 12:21:22 (2996): No heartbeat from core client for 30 sec - exiting 12:21:23 (2996): No heartbeat from core client for 30 sec - exiting 12:21:24 (2996): No heartbeat from core client for 30 sec - exiting 12:21:25 (2996): No heartbeat from core client for 30 sec - exiting 12:21:26 (2996): No heartbeat from core client for 30 sec - exiting 12:21:27 (2996): No heartbeat from core client for 30 sec - exiting 12:21:28 (2996): No heartbeat from core client for 30 sec - exiting 12:21:29 (2996): No heartbeat from core client for 30 sec - exiting 12:21:31 (2996): No heartbeat from core client for 30 sec - exiting 12:21:32 (2996): No heartbeat from core client for 30 sec - exiting 12:21:33 (2996): No heartbeat from core client for 30 sec - exiting 12:21:34 (2996): No heartbeat from core client for 30 sec - exiting 12:21:35 (2996): No heartbeat from core client for 30 sec - exiting 12:32:27 (324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:30 (324): No heartbeat from core client for 30 sec - exiting 12:32:31 (324): No heartbeat from core client for 30 sec - exiting 13:01:01 (2108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:17 (1452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:20 (1452): No heartbeat from core client for 30 sec - exiting 13:13:22 (1452): No heartbeat from core client for 30 sec - exiting 13:13:23 (1452): No heartbeat from core client for 30 sec - exiting 13:13:24 (1452): No heartbeat from core client for 30 sec - exiting 13:13:25 (1452): No heartbeat from core client for 30 sec - exiting 13:13:26 (1452): No heartbeat from core client for 30 sec - exiting 13:13:27 (1452): No heartbeat from core client for 30 sec - exiting 13:13:28 (1452): No heartbeat from core client for 30 sec - exiting 13:13:29 (1452): No heartbeat from core client for 30 sec - exiting 13:13:30 (1452): No heartbeat from core client for 30 sec - exiting 13:25:12 (2028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:13 (2028): No heartbeat from core client for 30 sec - exiting 13:25:14 (2028): No heartbeat from core client for 30 sec - exiting 13:54:12 (2220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:20 (2220): No heartbeat from core client for 30 sec - exiting 13:54:21 (2220): No heartbeat from core client for 30 sec - exiting 13:54:22 (2220): No heartbeat from core client for 30 sec - exiting 13:54:23 (2220): No heartbeat from core client for 30 sec - exiting 13:54:24 (2220): No heartbeat from core client for 30 sec - exiting 13:54:25 (2220): No heartbeat from core client for 30 sec - exiting 13:54:26 (2220): No heartbeat from core client for 30 sec - exiting 13:54:27 (2220): No heartbeat from core client for 30 sec - exiting 13:54:29 (2220): No heartbeat from core client for 30 sec - exiting 13:54:30 (2220): No heartbeat from core client for 30 sec - exiting 13:54:31 (2220): No heartbeat from core client for 30 sec - exiting 13:54:32 (2220): No heartbeat from core client for 30 sec - exiting 13:54:33 (2220): No heartbeat from core client for 30 sec - exiting 13:54:34 (2220): No heartbeat from core client for 30 sec - exiting 13:54:35 (2220): No heartbeat from core client for 30 sec - exiting 13:54:36 (2220): No heartbeat from core client for 30 sec - exiting 13:54:37 (2220): No heartbeat from core client for 30 sec - exiting Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xaakg.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_2tsr_1960_1_007244813_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tsr_1960_1_007244813_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tsr_1960_1_007244813_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tsr_1960_1_007244813_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tsr_1960_1_007244813_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tsr_1960_1_007244813_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_2tsr_1960_1_007244813_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 May 2011 07:43:33	1148296	12864031	hadam3p_eu_2tsr_1960_1_007244813_0	57,696	163,001	2.8252
12 May 2011 03:43:43	1148296	12864031	hadam3p_eu_2tsr_1960_1_007244813_0	46,176	130,055	2.8165
11 May 2011 18:29:27	1148296	12864031	hadam3p_eu_2tsr_1960_1_007244813_0	34,656	97,461	2.8122
11 May 2011 04:58:31	1148296	12864031	hadam3p_eu_2tsr_1960_1_007244813_0	23,151	65,610	2.8340
11 May 2011 04:57:16	1148296	12864031	hadam3p_eu_2tsr_1960_1_007244813_0	23,136	65,081	2.8130
10 May 2011 19:14:35	1148296	12864031	hadam3p_eu_2tsr_1960_1_007244813_0	11,616	32,950	2.8366