Task 16406554

Name	hadam3p_anz_n00o_2012_1_008589381_0
Workunit	8735893
Created	26 Mar 2014, 17:37:04 UTC
Sent	31 Mar 2014, 13:27:15 UTC
Report deadline	13 Mar 2015, 18:47:15 UTC
Received	23 Jul 2014, 8:51:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1094522
Run time	5 days 6 hours 50 min 7 sec
CPU time	5 days 4 hours 10 min 47 sec
Validate state	Invalid
Credit	2,993.82
Device peak FLOPS	2.68 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:44 (1980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2272, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1784, selfPID=1784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:53 (4632): No heartbeat from core client for 30 sec - exiting 19:31:55 (4632): No heartbeat from core client for 30 sec - exiting 19:31:56 (4632): No heartbeat from core client for 30 sec - exiting 19:31:57 (4632): No heartbeat from core client for 30 sec - exiting 19:31:58 (4632): No heartbeat from core client for 30 sec - exiting 19:31:59 (4632): No heartbeat from core client for 30 sec - exiting 19:32:00 (4632): No heartbeat from core client for 30 sec - exiting 19:32:01 (4632): No heartbeat from core client for 30 sec - exiting 19:32:02 (4632): No heartbeat from core client for 30 sec - exiting 19:32:03 (4632): No heartbeat from core client for 30 sec - exiting 19:32:04 (4632): No heartbeat from core client for 30 sec - exiting 19:32:05 (4632): No heartbeat from core client for 30 sec - exiting 19:32:06 (4632): No heartbeat from core client for 30 sec - exiting 19:32:07 (4632): No heartbeat from core client for 30 sec - exiting 19:32:08 (4632): No heartbeat from core client for 30 sec - exiting 19:32:09 (4632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 21:41:33 (4576): No heartbeat from core client for 30 sec - exiting 21:41:34 (4576): No heartbeat from core client for 30 sec - exiting 21:41:35 (4576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:36:45 (1952): No heartbeat from core client for 30 sec - exiting 18:36:46 (1952): No heartbeat from core client for 30 sec - exiting 18:36:47 (1952): No heartbeat from core client for 30 sec - exiting 18:36:48 (1952): No heartbeat from core client for 30 sec - exiting 18:36:49 (1952): No heartbeat from core client for 30 sec - exiting 18:36:50 (1952): No heartbeat from core client for 30 sec - exiting 18:36:51 (1952): No heartbeat from core client for 30 sec - exiting 18:36:52 (1952): No heartbeat from core client for 30 sec - exiting 18:36:53 (1952): No heartbeat from core client for 30 sec - exiting 18:36:54 (1952): No heartbeat from core client for 30 sec - exiting 18:36:55 (1952): No heartbeat from core client for 30 sec - exiting 18:36:56 (1952): No heartbeat from core client for 30 sec - exiting 18:36:57 (1952): No heartbeat from core client for 30 sec - exiting 18:36:58 (1952): No heartbeat from core client for 30 sec - exiting 18:36:59 (1952): No heartbeat from core client for 30 sec - exiting 18:37:00 (1952): No heartbeat from core client for 30 sec - exiting 18:37:01 (1952): No heartbeat from core client for 30 sec - exiting 18:37:02 (1952): No heartbeat from core client for 30 sec - exiting 18:37:03 (1952): No heartbeat from core client for 30 sec - exiting 18:37:04 (1952): No heartbeat from core client for 30 sec - exiting 18:37:05 (1952): No heartbeat from core client for 30 sec - exiting 18:37:06 (1952): No heartbeat from core client for 30 sec - exiting 18:37:07 (1952): No heartbeat from core client for 30 sec - exiting 18:37:08 (1952): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=4232, iMonCtr=1 CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:35:33 (3648): No heartbeat from core client for 30 sec - exiting 17:35:34 (3648): No heartbeat from core client for 30 sec - exiting 17:35:35 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:09:49 (5660): No heartbeat from core client for 30 sec - exiting 19:09:50 (5660): No heartbeat from core client for 30 sec - exiting 19:09:51 (5660): No heartbeat from core client for 30 sec - exiting 19:09:52 (5660): No heartbeat from core client for 30 sec - exiting 19:09:53 (5660): No heartbeat from core client for 30 sec - exiting 19:09:54 (5660): No heartbeat from core client for 30 sec - exiting 19:09:55 (5660): No heartbeat from core client for 30 sec - exiting 19:09:56 (5660): No heartbeat from core client for 30 sec - exiting 19:09:57 (5660): No heartbeat from core client for 30 sec - exiting 19:09:58 (5660): No heartbeat from core client for 30 sec - exiting 19:09:59 (5660): No heartbeat from core client for 30 sec - exiting 19:12:30 (5660): No heartbeat from core client for 30 sec - exiting 19:12:31 (5660): No heartbeat from core client for 30 sec - exiting 19:12:32 (5660): No heartbeat from core client for 30 sec - exiting 19:12:33 (5660): No heartbeat from core client for 30 sec - exiting 19:12:34 (5660): No heartbeat from core client for 30 sec - exiting 19:12:35 (5660): No heartbeat from core client for 30 sec - exiting 19:12:36 (5660): No heartbeat from core client for 30 sec - exiting 19:12:37 (5660): No heartbeat from core client for 30 sec - exiting 19:12:38 (5660): No heartbeat from core client for 30 sec - exiting 19:12:39 (5660): No heartbeat from core client for 30 sec - exiting 19:12:40 (5660): No heartbeat from core client for 30 sec - exiting 19:12:41 (5660): No heartbeat from core client for 30 sec - exiting 19:12:42 (5660): No heartbeat from core client for 30 sec - exiting 19:12:43 (5660): No heartbeat from core client for 30 sec - exiting 19:12:44 (5660): No heartbeat from core client for 30 sec - exiting 19:12:45 (5660): No heartbeat from core client for 30 sec - exiting 19:12:46 (5660): No heartbeat from core client for 30 sec - exiting 19:12:47 (5660): No heartbeat from core client for 30 sec - exiting 19:12:48 (5660): No heartbeat from core client for 30 sec - exiting 19:12:49 (5660): No heartbeat from core client for 30 sec - exiting 19:12:50 (5660): No heartbeat from core client for 30 sec - exiting 19:12:51 (5660): No heartbeat from core client for 30 sec - exiting 19:12:52 (5660): No heartbeat from core client for 30 sec - exiting 19:12:53 (5660): No heartbeat from core client for 30 sec - exiting 19:12:54 (5660): No heartbeat from core client for 30 sec - exiting 19:12:55 (5660): No heartbeat from core client for 30 sec - exiting 19:12:56 (5660): No heartbeat from core client for 30 sec - exiting 19:12:57 (5660): No heartbeat from core client for 30 sec - exiting 19:12:58 (5660): No heartbeat from core client for 30 sec - exiting 19:12:59 (5660): No heartbeat from core client for 30 sec - exiting 19:13:00 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:16:47 (5528): No heartbeat from core client for 30 sec - exiting 19:16:48 (5528): No heartbeat from core client for 30 sec - exiting 19:16:49 (5528): No heartbeat from core client for 30 sec - exiting 19:16:50 (5528): No heartbeat from core client for 30 sec - exiting 19:16:51 (5528): No heartbeat from core client for 30 sec - exiting 19:16:52 (5528): No heartbeat from core client for 30 sec - exiting 19:16:53 (5528): No heartbeat from core client for 30 sec - exiting 19:16:54 (5528): No heartbeat from core client for 30 sec - exiting 19:16:55 (5528): No heartbeat from core client for 30 sec - exiting 19:16:57 (5528): No heartbeat from core client for 30 sec - exiting 19:16:58 (5528): No heartbeat from core client for 30 sec - exiting 19:16:59 (5528): No heartbeat from core client for 30 sec - exiting 19:17:00 (5528): No heartbeat from core client for 30 sec - exiting 19:17:01 (5528): No heartbeat from core client for 30 sec - exiting 19:17:02 (5528): No heartbeat from core client for 30 sec - exiting 19:17:03 (5528): No heartbeat from core client for 30 sec - exiting 19:17:04 (5528): No heartbeat from core client for 30 sec - exiting 19:17:05 (5528): No heartbeat from core client for 30 sec - exiting 19:17:06 (5528): No heartbeat from core client for 30 sec - exiting 19:17:07 (5528): No heartbeat from core client for 30 sec - exiting 19:17:09 (5528): No heartbeat from core client for 30 sec - exiting 19:17:10 (5528): No heartbeat from core client for 30 sec - exiting 19:17:11 (5528): No heartbeat from core client for 30 sec - exiting 19:17:12 (5528): No heartbeat from core client for 30 sec - exiting 19:17:13 (5528): No heartbeat from core client for 30 sec - exiting 19:17:14 (5528): No heartbeat from core client for 30 sec - exiting 19:17:15 (5528): No heartbeat from core client for 30 sec - exiting 19:17:16 (5528): No heartbeat from core client for 30 sec - exiting 19:17:17 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7040, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5784, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5784, selfPID=5784, iMonCtr=2 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n00o_2012_1_008589381_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n00o_2012_1_008589381_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n00o_2012_1_008589381_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n00o_2012_1_008589381_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n00o_2012_1_008589381_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n00o_2012_1_008589381_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Jul 2014 15:50:42	1094522	16406554	hadam3p_anz_n00o_2012_1_008589381_0	69,419	441,858	6.3651
20 Jul 2014 06:43:42	1094522	16406554	hadam3p_anz_n00o_2012_1_008589381_0	57,899	372,635	6.4359
14 Jul 2014 15:39:10	1094522	16406554	hadam3p_anz_n00o_2012_1_008589381_0	46,379	302,142	6.5146
12 Jul 2014 16:44:24	1094522	16406554	hadam3p_anz_n00o_2012_1_008589381_0	34,859	227,861	6.5366
08 Jul 2014 20:30:59	1094522	16406554	hadam3p_anz_n00o_2012_1_008589381_0	23,339	152,511	6.5346
06 Jul 2014 10:15:33	1094522	16406554	hadam3p_anz_n00o_2012_1_008589381_0	11,819	76,721	6.4913