Task 14688524

Name	hadam3p_eu_d654_2007_1_007974170_0
Workunit	8129284
Created	16 May 2012, 17:30:48 UTC
Sent	31 May 2012, 12:20:10 UTC
Report deadline	13 May 2013, 17:40:10 UTC
Received	29 Jun 2012, 13:50:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1131285
Run time	2 days 18 hours 34 min 42 sec
CPU time	2 days 17 hours 46 min 21 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	2.57 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> 11:48:53 (2816): No heartbeat from core client for 30 sec - exiting 11:48:54 (2816): No heartbeat from core client for 30 sec - exiting 11:48:55 (2816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2528, selfPID=2528, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:04 (3780): No heartbeat from core client for 30 sec - exiting 08:15:05 (3780): No heartbeat from core client for 30 sec - exiting 08:15:07 (3780): No heartbeat from core client for 30 sec - exiting 08:15:08 (3780): No heartbeat from core client for 30 sec - exiting 08:15:09 (3780): No heartbeat from core client for 30 sec - exiting 08:15:10 (3780): No heartbeat from core client for 30 sec - exiting 08:15:11 (3780): No heartbeat from core client for 30 sec - exiting 08:15:12 (3780): No heartbeat from core client for 30 sec - exiting 08:15:13 (3780): No heartbeat from core client for 30 sec - exiting 08:15:14 (3780): No heartbeat from core client for 30 sec - exiting 08:15:16 (3780): No heartbeat from core client for 30 sec - exiting 08:15:17 (3780): No heartbeat from core client for 30 sec - exiting 08:15:18 (3780): No heartbeat from core client for 30 sec - exiting 08:15:19 (3780): No heartbeat from core client for 30 sec - exiting 08:15:20 (3780): No heartbeat from core client for 30 sec - exiting 08:15:21 (3780): No heartbeat from core client for 30 sec - exiting 08:15:22 (3780): No heartbeat from core client for 30 sec - exiting 08:15:23 (3780): No heartbeat from core client for 30 sec - exiting 08:15:24 (3780): No heartbeat from core client for 30 sec - exiting 08:15:25 (3780): No heartbeat from core client for 30 sec - exiting 08:15:26 (3780): No heartbeat from core client for 30 sec - exiting 08:15:28 (3780): No heartbeat from core client for 30 sec - exiting 08:15:29 (3780): No heartbeat from core client for 30 sec - exiting 08:15:30 (3780): No heartbeat from core client for 30 sec - exiting 08:15:31 (3780): No heartbeat from core client for 30 sec - exiting 08:15:32 (3780): No heartbeat from core client for 30 sec - exiting 08:15:33 (3780): No heartbeat from core client for 30 sec - exiting 08:15:34 (3780): No heartbeat from core client for 30 sec - exiting 08:15:35 (3780): No heartbeat from core client for 30 sec - exiting 08:15:36 (3780): No heartbeat from core client for 30 sec - exiting 08:15:38 (3780): No heartbeat from core client for 30 sec - exiting 08:15:39 (3780): No heartbeat from core client for 30 sec - exiting 08:15:40 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:45:41 (2884): No heartbeat from core client for 30 sec - exiting 11:45:43 (2884): No heartbeat from core client for 30 sec - exiting 11:45:44 (2884): No heartbeat from core client for 30 sec - exiting 11:45:46 (2884): No heartbeat from core client for 30 sec - exiting 11:45:47 (2884): No heartbeat from core client for 30 sec - exiting 11:45:49 (2884): No heartbeat from core client for 30 sec - exiting 11:45:50 (2884): No heartbeat from core client for 30 sec - exiting 11:45:52 (2884): No heartbeat from core client for 30 sec - exiting 11:45:54 (2884): No heartbeat from core client for 30 sec - exiting 11:45:55 (2884): No heartbeat from core client for 30 sec - exiting 11:45:56 (2884): No heartbeat from core client for 30 sec - exiting 11:45:57 (2884): No heartbeat from core client for 30 sec - exiting 11:45:58 (2884): No heartbeat from core client for 30 sec - exiting 11:45:59 (2884): No heartbeat from core client for 30 sec - exiting 11:46:00 (2884): No heartbeat from core client for 30 sec - exiting 11:46:01 (2884): No heartbeat from core client for 30 sec - exiting 11:46:02 (2884): No heartbeat from core client for 30 sec - exiting 11:46:03 (2884): No heartbeat from core client for 30 sec - exiting 11:46:05 (2884): No heartbeat from core client for 30 sec - exiting 11:46:06 (2884): No heartbeat from core client for 30 sec - exiting 11:46:07 (2884): No heartbeat from core client for 30 sec - exiting 11:46:08 (2884): No heartbeat from core client for 30 sec - exiting 11:46:09 (2884): No heartbeat from core client for 30 sec - exiting 11:46:10 (2884): No heartbeat from core client for 30 sec - exiting 11:46:11 (2884): No heartbeat from core client for 30 sec - exiting 11:46:12 (2884): No heartbeat from core client for 30 sec - exiting 11:46:13 (2884): No heartbeat from core client for 30 sec - exiting 11:46:14 (2884): No heartbeat from core client for 30 sec - exiting 11:46:16 (2884): No heartbeat from core client for 30 sec - exiting 11:46:17 (2884): No heartbeat from core client for 30 sec - exiting 11:46:18 (2884): No heartbeat from core client for 30 sec - exiting 11:46:19 (2884): No heartbeat from core client for 30 sec - exiting 11:46:20 (2884): No heartbeat from core client for 30 sec - exiting 11:46:21 (2884): No heartbeat from core client for 30 sec - exiting 11:46:22 (2884): No heartbeat from core client for 30 sec - exiting 11:46:23 (2884): No heartbeat from core client for 30 sec - exiting 11:46:25 (2884): No heartbeat from core client for 30 sec - exiting 11:46:26 (2884): No heartbeat from core client for 30 sec - exiting 11:46:27 (2884): No heartbeat from core client for 30 sec - exiting 11:46:28 (2884): No heartbeat from core client for 30 sec - exiting 11:46:29 (2884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=4504, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6004, selfPID=6004, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:47:22 (3084): No heartbeat from core client for 30 sec - exiting 07:47:23 (3084): No heartbeat from core client for 30 sec - exiting 07:47:25 (3084): No heartbeat from core client for 30 sec - exiting 07:47:26 (3084): No heartbeat from core client for 30 sec - exiting 07:47:27 (3084): No heartbeat from core client for 30 sec - exiting 07:47:28 (3084): No heartbeat from core client for 30 sec - exiting 07:47:29 (3084): No heartbeat from core client for 30 sec - exiting 07:47:30 (3084): No heartbeat from core client for 30 sec - exiting 07:47:31 (3084): No heartbeat from core client for 30 sec - exiting 07:47:32 (3084): No heartbeat from core client for 30 sec - exiting 07:47:33 (3084): No heartbeat from core client for 30 sec - exiting 07:47:34 (3084): No heartbeat from core client for 30 sec - exiting 07:47:36 (3084): No heartbeat from core client for 30 sec - exiting 07:47:37 (3084): No heartbeat from core client for 30 sec - exiting 07:47:38 (3084): No heartbeat from core client for 30 sec - exiting 07:47:39 (3084): No heartbeat from core client for 30 sec - exiting 07:47:40 (3084): No heartbeat from core client for 30 sec - exiting 07:47:41 (3084): No heartbeat from core client for 30 sec - exiting 07:47:42 (3084): No heartbeat from core client for 30 sec - exiting 07:47:43 (3084): No heartbeat from core client for 30 sec - exiting 07:47:44 (3084): No heartbeat from core client for 30 sec - exiting 07:47:45 (3084): No heartbeat from core client for 30 sec - exiting 07:47:46 (3084): No heartbeat from core client for 30 sec - exiting 07:47:48 (3084): No heartbeat from core client for 30 sec - exiting 07:47:49 (3084): No heartbeat from core client for 30 sec - exiting 07:47:50 (3084): No heartbeat from core client for 30 sec - exiting 07:47:51 (3084): No heartbeat from core client for 30 sec - exiting 07:47:52 (3084): No heartbeat from core client for 30 sec - exiting 07:47:53 (3084): No heartbeat from core client for 30 sec - exiting 07:47:54 (3084): No heartbeat from core client for 30 sec - exiting 07:47:56 (3084): No heartbeat from core client for 30 sec - exiting 07:47:57 (3084): No heartbeat from core client for 30 sec - exiting 07:47:58 (3084): No heartbeat from core client for 30 sec - exiting 07:47:59 (3084): No heartbeat from core client for 30 sec - exiting 07:48:00 (3084): No heartbeat from core client for 30 sec - exiting 07:48:02 (3084): No heartbeat from core client for 30 sec - exiting 07:48:03 (3084): No heartbeat from core client for 30 sec - exiting 07:48:04 (3084): No heartbeat from core client for 30 sec - exiting 07:48:05 (3084): No heartbeat from core client for 30 sec - exiting 07:48:06 (3084): No heartbeat from core client for 30 sec - exiting 07:48:07 (3084): No heartbeat from core client for 30 sec - exiting 07:48:08 (3084): No heartbeat from core client for 30 sec - exiting 07:48:09 (3084): No heartbeat from core client for 30 sec - exiting 07:48:11 (3084): No heartbeat from core client for 30 sec - exiting 07:48:12 (3084): No heartbeat from core client for 30 sec - exiting 07:48:13 (3084): No heartbeat from core client for 30 sec - exiting 07:48:14 (3084): No heartbeat from core client for 30 sec - exiting 07:48:15 (3084): No heartbeat from core client for 30 sec - exiting 07:48:16 (3084): No heartbeat from core client for 30 sec - exiting 07:48:17 (3084): No heartbeat from core client for 30 sec - exiting 07:48:18 (3084): No heartbeat from core client for 30 sec - exiting 07:48:20 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:52:44 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=960, selfPID=960, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5712, selfPID=5712, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1276, selfPID=1276, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4780, selfPID=4780, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5588, selfPID=5588, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional WorkerCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5188, selfPID=5188, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. forrtl: severe (38): error during write, unit 6, file T:\boinc\projects\climateprediction.net\hadam3p_eu_d654_2007_1_007974170\dataout\xaakg.out Image PC Routine Line Source hadrm3p_eu_um_6.0 0073C52A Unknown Unknown Unknown hadrm3p_eu_um_6.0 00739858 Unknown Unknown Unknown hadrm3p_eu_um_6.0 006E4460 Unknown Unknown Unknown hadrm3p_eu_um_6.0 006E362A Unknown Unknown Unknown hadrm3p_eu_um_6.0 006B59F1 Unknown Unknown Unknown hadrm3p_eu_um_6.0 006B28F5 Unknown Unknown Unknown hadrm3p_eu_um_6.0 00662ACE Unknown Unknown Unknown hadrm3p_eu_um_6.0 006635AF Unknown Unknown Unknown hadrm3p_eu_um_6.0 00409860 Unknown Unknown Unknown hadrm3p_eu_um_6.0 00720893 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1416, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GCM: BUFFIN : Read Failed: No such file or directory GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 16 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_eu_d654_2007_1_007974170_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_d654_2007_1_007974170_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_d654_2007_1_007974170_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_d654_2007_1_007974170_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_d654_2007_1_007974170_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Jun 2012 17:23:36	1131285	14688524	hadam3p_eu_d654_2007_1_007974170_0	80,736	221,387	2.7421
15 Jun 2012 11:37:58	1131285	14688524	hadam3p_eu_d654_2007_1_007974170_0	69,216	193,073	2.7894
15 Jun 2012 11:37:58	1131285	14688524	hadam3p_eu_d654_2007_1_007974170_0	57,696	160,901	2.7888
08 Jun 2012 17:59:26	1131285	14688524	hadam3p_eu_d654_2007_1_007974170_0	46,176	128,322	2.7790
07 Jun 2012 15:48:43	1131285	14688524	hadam3p_eu_d654_2007_1_007974170_0	34,656	95,964	2.7690
04 Jun 2012 12:19:41	1131285	14688524	hadam3p_eu_d654_2007_1_007974170_0	23,136	63,918	2.7627
01 Jun 2012 13:29:33	1131285	14688524	hadam3p_eu_d654_2007_1_007974170_0	11,616	31,648	2.7245