Task 14904316

Name	hadam3p_pnw_aza6_1990_1_008047021_1
Workunit	8202135
Created	12 Jul 2012, 3:32:23 UTC
Sent	12 Jul 2012, 3:45:08 UTC
Report deadline	24 Jun 2013, 9:05:08 UTC
Received	19 Jul 2012, 22:22:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1195165
Run time	3 days 15 hours 46 min 14 sec
CPU time	2 days 10 hours 59 min 13 sec
Validate state	Invalid
Credit	2,004.61
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4036, selfPID=4036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:23:53 (3300): No heartbeat from core client for 30 sec - exiting 15:23:54 (3300): No heartbeat from core client for 30 sec - exiting 15:23:55 (3300): No heartbeat from core client for 30 sec - exiting 15:23:56 (3300): No heartbeat from core client for 30 sec - exiting 15:23:57 (3300): No heartbeat from core client for 30 sec - exiting 15:23:58 (3300): No heartbeat from core client for 30 sec - exiting 15:23:59 (3300): No heartbeat from core client for 30 sec - exiting 15:24:00 (3300): No heartbeat from core client for 30 sec - exiting 15:24:01 (3300): No heartbeat from core client for 30 sec - exiting 15:24:02 (3300): No heartbeat from core client for 30 sec - exiting 15:24:03 (3300): No heartbeat from core client for 30 sec - exiting 15:24:04 (3300): No heartbeat from core client for 30 sec - exiting 15:24:05 (3300): No heartbeat from core client for 30 sec - exiting 15:24:06 (3300): No heartbeat from core client for 30 sec - exiting 15:24:07 (3300): No heartbeat from core client for 30 sec - exiting 15:24:08 (3300): No heartbeat from core client for 30 sec - exiting 15:24:09 (3300): No heartbeat from core client for 30 sec - exiting 15:24:10 (3300): No heartbeat from core client for 30 sec - exiting 15:24:11 (3300): No heartbeat from core client for 30 sec - exiting 15:24:12 (3300): No heartbeat from core client for 30 sec - exiting 15:24:13 (3300): No heartbeat from core client for 30 sec - exiting 15:24:14 (3300): No heartbeat from core client for 30 sec - exiting 15:24:15 (3300): No heartbeat from core client for 30 sec - exiting 15:24:16 (3300): No heartbeat from core client for 30 sec - exiting 15:24:17 (3300): No heartbeat from core client for 30 sec - exiting 15:24:18 (3300): No heartbeat from core client for 30 sec - exiting 15:24:19 (3300): No heartbeat from core client for 30 sec - exiting 15:24:20 (3300): No heartbeat from core client for 30 sec - exiting 15:24:21 (3300): No heartbeat from core client for 30 sec - exiting 15:24:22 (3300): No heartbeat from core client for 30 sec - exiting 15:24:23 (3300): No heartbeat from core client for 30 sec - exiting 15:24:24 (3300): No heartbeat from core client for 30 sec - exiting 15:24:25 (3300): No heartbeat from core client for 30 sec - exiting 15:24:26 (3300): No heartbeat from core client for 30 sec - exiting 15:24:27 (3300): No heartbeat from core client for 30 sec - exiting 15:24:28 (3300): No heartbeat from core client for 30 sec - exiting 15:24:29 (3300): No heartbeat from core client for 30 sec - exiting 15:24:30 (3300): No heartbeat from core client for 30 sec - exiting 15:24:31 (3300): No heartbeat from core client for 30 sec - exiting 15:24:32 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3784, selfPID=3784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3748, selfPID=3748, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... NCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:00:38 (412): No heartbeat from core client for 30 sec - exiting 15:00:39 (412): No heartbeat from core client for 30 sec - exiting 15:00:40 (412): No heartbeat from core client for 30 sec - exiting 15:00:41 (412): No heartbeat from core client for 30 sec - exiting 15:00:42 (412): No heartbeat from core client for 30 sec - exiting 15:00:43 (412): No heartbeat from core client for 30 sec - exiting 15:00:44 (412): No heartbeat from core client for 30 sec - exiting 15:00:45 (412): No heartbeat from core client for 30 sec - exiting 15:00:47 (412): No heartbeat from core client for 30 sec - exiting 15:00:48 (412): No heartbeat from core client for 30 sec - exiting 15:00:49 (412): No heartbeat from core client for 30 sec - exiting 15:00:50 (412): No heartbeat from core client for 30 sec - exiting 15:00:51 (412): No heartbeat from core client for 30 sec - exiting 15:00:52 (412): No heartbeat from core client for 30 sec - exiting 15:00:53 (412): No heartbeat from core client for 30 sec - exiting 15:00:54 (412): No heartbeat from core client for 30 sec - exiting 15:00:55 (412): No heartbeat from core client for 30 sec - exiting 15:00:56 (412): No heartbeat from core client for 30 sec - exiting 15:00:58 (412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:00:36 (1836): No heartbeat from core client for 30 sec - exiting 15:00:37 (1836): No heartbeat from core client for 30 sec - exiting 15:00:39 (1836): No heartbeat from core client for 30 sec - exiting 15:00:40 (1836): No heartbeat from core client for 30 sec - exiting 15:00:41 (1836): No heartbeat from core client for 30 sec - exiting 15:00:42 (1836): No heartbeat from core client for 30 sec - exiting 15:00:43 (1836): No heartbeat from core client for 30 sec - exiting 15:00:44 (1836): No heartbeat from core client for 30 sec - exiting 15:00:45 (1836): No heartbeat from core client for 30 sec - exiting 15:00:46 (1836): No heartbeat from core client for 30 sec - exiting 15:00:47 (1836): No heartbeat from core client for 30 sec - exiting 15:00:48 (1836): No heartbeat from core client for 30 sec - exiting 15:00:49 (1836): No heartbeat from core client for 30 sec - exiting 15:00:51 (1836): No heartbeat from core client for 30 sec - exiting 15:00:52 (1836): No heartbeat from core client for 30 sec - exiting 15:00:53 (1836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2668, selfPID=2668, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3040, selfPID=3040, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No ProCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. forrtl: severe (38): error during write, unit 6, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadam3p_pnw_aza6_1990_1_008047021\dataout\xaakg.out Image PC Routine Line Source hadrm3p_pnw_um_6. 0073C52A Unknown Unknown Unknown hadrm3p_pnw_um_6. 00739858 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006E4460 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006E362A Unknown Unknown Unknown hadrm3p_pnw_um_6. 006B59F1 Unknown Unknown Unknown hadrm3p_pnw_um_6. 006B28F5 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00662ACE Unknown Unknown Unknown hadrm3p_pnw_um_6. 006635AF Unknown Unknown Unknown hadrm3p_pnw_um_6. 00409860 Unknown Unknown Unknown hadrm3p_pnw_um_6. 00720893 Unknown Unknown Unknown kernel32.dll 7C817067 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1208, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_aza6_1990_1_008047021_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_aza6_1990_1_008047021_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_aza6_1990_1_008047021_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_aza6_1990_1_008047021_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Jul 2012 13:12:06	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	92,256	211,903	2.2969
18 Jul 2012 07:58:59	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	80,736	185,540	2.2981
17 Jul 2012 06:29:48	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	69,216	159,431	2.3034
16 Jul 2012 05:45:53	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	57,696	133,008	2.3053
15 Jul 2012 03:16:17	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	46,176	106,534	2.3071
14 Jul 2012 06:04:30	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	34,656	80,457	2.3216
13 Jul 2012 08:49:31	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	23,136	53,835	2.3269
12 Jul 2012 13:42:46	1195165	14904316	hadam3p_pnw_aza6_1990_1_008047021_1	11,616	26,887	2.3147