Task 16632129

Name	hadam3p_anz_re6f_2012_1_008747989_0
Workunit	8893967
Created	9 May 2014, 9:00:49 UTC
Sent	9 May 2014, 9:06:54 UTC
Report deadline	21 Apr 2015, 14:26:54 UTC
Received	31 May 2014, 11:33:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1316356
Run time	8 days 16 hours 35 min 35 sec
CPU time	3 days 20 hours 15 min 11 sec
Validate state	Invalid
Credit	2,000.18
Device peak FLOPS	1.20 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4620, selfPID=6600, iMonCtr=1 Model crash detected, will try to restart... 19:19:24 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6648, selfPID=6648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3932, selfPID=4192, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12228, selfPID=7596, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:23:55 (3416): No heartbeat from core client for 30 sec - exiting 20:23:57 (3416): No heartbeat from core client for 30 sec - exiting 20:23:58 (3416): No heartbeat from core client for 30 sec - exiting 20:23:59 (3416): No heartbeat from core client for 30 sec - exiting 20:24:00 (3416): No heartbeat from core client for 30 sec - exiting 20:24:01 (3416): No heartbeat from core client for 30 sec - exiting 20:24:02 (3416): No heartbeat from core client for 30 sec - exiting 20:24:03 (3416): No heartbeat from core client for 30 sec - exiting 20:24:04 (3416): No heartbeat from core client for 30 sec - exiting 20:24:05 (3416): No heartbeat from core client for 30 sec - exiting 20:24:06 (3416): No heartbeat from core client for 30 sec - exiting 20:24:07 (3416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:20:03 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:04 (5724): No heartbeat from core client for 30 sec - exiting C13:34:00 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7428, selfPID=5132, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5248, selfPID=8992, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Glontobal rWorkerDN process ocess is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9024, iMonC Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2860, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3384, selfPID=4208, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4412, selfPID=5208, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4492, selfPID=4492, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1264, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5216, iMonCtr=2 22:55:03 (4700): No heartbeat from core client for 30 sec - exiting 22:55:04 (4700): No heartbeat from core client for 30 sec - exiting 22:55:05 (4700): No heartbeat from core client for 30 sec - exiting 22:55:06 (4700): No heartbeat from core client for 30 sec - exiting 22:55:07 (4700): No heartbeat from core client for 30 sec - exiting 22:55:08 (4700): No heartbeat from core client for 30 sec - exiting 22:55:09 (4700): No heartbeat from core client for 30 sec - exiting 22:55:10 (4700): No heartbeat from core client for 30 sec - exiting 22:55:11 (4700): No heartbeat from core client for 30 sec - exiting 22:55:12 (4700): No heartbeat from core client for 30 sec - exiting 22:55:13 (4700): No heartbeat from core client for 30 sec - exiting 22:55:14 (4700): No heartbeat from core client for 30 sec - exiting 22:55:15 (4700): No heartbeat from core client for 30 sec - exiting 22:55:16 (4700): No heartbeat from core client for 30 sec - exiting 22:55:17 (4700): No heartbeat from core client for 30 sec - exiting 22:55:18 (4700): No heartbeat from core client for 30 sec - exiting 22:55:19 (4700): No heartbeat from core client for 30 sec - exiting 22:55:20 (4700): No heartbeat from core client for 30 sec - exiting 22:55:21 (4700): No heartbeat from core client for 30 sec - exiting 22:55:22 (4700): No heartbeat from core client for 30 sec - exiting 22:55:23 (4700): No heartbeat from core client for 30 sec - exiting 22:55:24 (4700): No heartbeat from core client for 30 sec - exiting 22:55:25 (4700): No heartbeat from core client for 30 sec - exiting 22:55:26 (4700): No heartbeat from core client for 30 sec - exiting 22:55:27 (4700): No heartbeat from core client for 30 sec - exiting 22:55:28 (4700): No heartbeat from core client for 30 sec - exiting 22:55:29 (4700): No heartbeat from core client for 30 sec - exiting 22:55:30 (4700): No heartbeat from core client for 30 sec - exiting 22:55:31 (4700): No heartbeat from core client for 30 sec - exiting 22:55:32 (4700): No heartbeat from core client for 30 sec - exiting 22:55:33 (4700): No heartbeat from core client for 30 sec - exiting 22:55:34 (4700): No heartbeat from core client for 30 sec - exiting 22:55:35 (4700): No heartbeat from core client for 30 sec - exiting 22:55:36 (4700): No heartbeat from core client for 30 sec - exiting 22:55:37 (4700): No heartbeat from core client for 30 sec - exiting 22:55:38 (4700): No heartbeat from core client for 30 sec - exiting 22:55:39 (4700): No heartbeat from core client for 30 sec - exiting 22:55:40 (4700): No heartbeat from core client for 30 sec - exiting 22:55:41 (4700): No heartbeat from core client for 30 sec - exiting 22:55:42 (4700): No heartbeat from core client for 30 sec - exiting 22:55:43 (4700): No heartbeat from core client for 30 sec - exiting 22:55:44 (4700): No heartbeat from core client for 30 sec - exiting 22:55:45 (4700): No heartbeat from core client for 30 sec - exiting 22:55:46 (4700): No heartbeat from core client for 30 sec - exiting 22:55:47 (4700): No heartbeat from core client for 30 sec - exiting 22:55:48 (4700): No heartbeat from core client for 30 sec - exiting 22:55:49 (4700): No heartbeat from core client for 30 sec - exiting 22:55:50 (4700): No heartbeat from core client for 30 sec - exiting 22:55:51 (4700): No heartbeat from core client for 30 sec - exiting 22:55:52 (4700): No heartbeat from core client for 30 sec - exiting 22:55:53 (4700): No heartbeat from core client for 30 sec - exiting 22:55:54 (4700): No heartbeat from core client for 30 sec - exiting 22:55:55 (4700): No heartbeat from core client for 30 sec - exiting 22:55:56 (4700): No heartbeat from core client for 30 sec - exiting 22:55:57 (4700): No heartbeat from core client for 30 sec - exiting 22:55:58 (4700): No heartbeat from core client for 30 sec - exiting 22:55:59 (4700): No heartbeat from core client for 30 sec - exiting 22:56:00 (4700): No heartbeat from core client for 30 sec - exiting 22:56:01 (4700): No heartbeat from core client for 30 sec - exiting 22:56:02 (4700): No heartbeat from core client for 30 sec - exiting 22:56:03 (4700): No heartbeat from core client for 30 sec - exiting 22:56:04 (4700): No heartbeat from core client for 30 sec - exiting 22:56:05 (4700): No heartbeat from core client for 30 sec - exiting 22:56:06 (4700): No heartbeat from core client for 30 sec - exiting 22:56:07 (4700): No heartbeat from core client for 30 sec - exiting 22:56:08 (4700): No heartbeat from core client for 30 sec - exiting 22:56:09 (4700): No heartbeat from core client for 30 sec - exiting 22:56:10 (4700): No heartbeat from core client for 30 sec - exiting 22:56:11 (4700): No heartbeat from core client for 30 sec - exiting 22:56:12 (4700): No heartbeat from core client for 30 sec - exiting 22:56:13 (4700): No heartbeat from core client for 30 sec - exiting 22:56:14 (4700): No heartbeat from core client for 30 sec - exiting 22:56:15 (4700): No heartbeat from core client for 30 sec - exiting 22:56:16 (4700): No heartbeat from core client for 30 sec - exiting 22:56:17 (4700): No heartbeat from core client for 30 sec - exiting 22:56:18 (4700): No heartbeat from core client for 30 sec - exiting 22:56:19 (4700): No heartbeat from core client for 30 sec - exiting 22:56:20 (4700): No heartbeat from core client for 30 sec - exiting 22:56:21 (4700): No heartbeat from core client for 30 sec - exiting 22:56:22 (4700): No heartbeat from core client for 30 sec - exiting 22:56:23 (4700): No heartbeat from core client for 30 sec - exiting 22:56:24 (4700): No heartbeat from core client for 30 sec - exiting 22:56:25 (4700): No heartbeat from core client for 30 sec - exiting 22:56:26 (4700): No heartbeat from core client for 30 sec - exiting 22:56:27 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:28 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5084, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_anz_re6f_2012_1_008747989/dataout/atmos_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5076, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_re6f_2012_1_008747989_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 May 2014 19:48:31	1316356	16632129	hadam3p_anz_re6f_2012_1_008747989_0	46,379	307,034	6.6201
27 May 2014 05:00:25	1316356	16632129	hadam3p_anz_re6f_2012_1_008747989_0	34,859	231,973	6.6546
22 May 2014 02:13:49	1316356	16632129	hadam3p_anz_re6f_2012_1_008747989_0	23,339	154,253	6.6092
14 May 2014 05:41:15	1316356	16632129	hadam3p_anz_re6f_2012_1_008747989_0	11,819	79,733	6.7462