Task 18334392

Name	hadam3p_anz_e3l5_2013_1_009760539_0
Workunit	9831577
Created	20 Apr 2015, 22:15:16 UTC
Sent	23 Apr 2015, 0:14:06 UTC
Report deadline	4 Apr 2016, 5:34:06 UTC
Received	14 May 2015, 23:12:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1330994
Run time	5 days 18 hours 45 min 13 sec
CPU time	5 days 17 hours 9 min 29 sec
Validate state	Invalid
Credit	4,480.14
Device peak FLOPS	3.17 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <stderr_txt> 06:41:22 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4960, selfPID=4960, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3204, selfPID=3204, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4452, selfPID=4452, iMonCtr=2 01:27:30 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:27:33 (4300): No heartbeat from core client for 30 sec - exiting 01:27:34 (4300): No heartbeat from core client for 30 sec - exiting 01:27:35 (4300): No heartbeat from core client for 30 sec - exiting 01:27:36 (4300): No heartbeat from core client for 30 sec - exiting 01:27:37 (4300): No heartbeat from core client for 30 sec - exiting 01:27:39 (4300): No heartbeat from core client for 30 sec - exiting 01:27:40 (4300): No heartbeat from core client for 30 sec - exiting 01:27:41 (4300): No heartbeat from core client for 30 sec - exiting 01:28:25 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:28:57 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:57:44 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:48 (4616): No heartbeat from core client for 30 sec - exiting 23:59:10 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:59:13 (4708): No heartbeat from core client for 30 sec - exiting 00:04:26 (2632): No heartbeat from core client for 30 sec - exiting 00:04:27 (2632): No heartbeat from core client for 30 sec - exiting 00:04:28 (2632): No heartbeat from core client for 30 sec - exiting 00:04:29 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:30 (2632): No heartbeat from core client for 30 sec - exiting 00:04:31 (2632): No heartbeat from core client for 30 sec - exiting 00:04:32 (2632): No heartbeat from core client for 30 sec - exiting 00:04:33 (2632): No heartbeat from core client for 30 sec - exiting 00:04:34 (2632): No heartbeat from core client for 30 sec - exiting 00:04:35 (2632): No heartbeat from core client for 30 sec - exiting 00:04:36 (2632): No heartbeat from core client for 30 sec - exiting 00:04:37 (2632): No heartbeat from core client for 30 sec - exiting 00:04:38 (2632): No heartbeat from core client for 30 sec - exiting 00:04:40 (2632): No heartbeat from core client for 30 sec - exiting 00:09:23 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:38 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:30 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:34 (3444): No heartbeat from core client for 30 sec - exiting 00:23:04 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:56 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:43 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:44 (4216): No heartbeat from core client for 30 sec - exiting 00:28:02 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:29:03 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3156, selfPID=3156, iMonCtr=2 00:32:51 (4100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:06 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:00:02 (5000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:14:31 (2664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:25 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:51 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:06:38 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:56:56 (3512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:50 (2496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:22 (424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:30:34 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:44 (5780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:50 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:26 (1328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:17 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:29 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:26 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:05 (5600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:51 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:29 (3860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4912, selfPID=4912, iMonCtr=2 22:40:07 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:01 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:47 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:51 (3092): No heartbeat from core client for 30 sec - exiting 23:07:52 (3092): No heartbeat from core client for 30 sec - exiting 23:07:53 (3092): No heartbeat from core client for 30 sec - exiting 23:07:54 (3092): No heartbeat from core client for 30 sec - exiting 23:07:55 (3092): No heartbeat from core client for 30 sec - exiting 23:07:56 (3092): No heartbeat from core client for 30 sec - exiting 23:07:57 (3092): No heartbeat from core client for 30 sec - exiting 23:07:58 (3092): No heartbeat from core client for 30 sec - exiting 23:07:59 (3092): No heartbeat from core client for 30 sec - exiting forrtl: Access is denied. 23:09:12 (2424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. 23:13:13 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:15:59 (2404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:00 (2404): No heartbeat from core client for 30 sec - exiting 23:16:01 (2404): No heartbeat from core client for 30 sec - exiting 23:16:02 (2404): No heartbeat from core client for 30 sec - exiting 23:16:03 (2404): No heartbeat from core client for 30 sec - exiting 23:16:04 (2404): No heartbeat from core client for 30 sec - exiting 23:16:05 (2404): No heartbeat from core client for 30 sec - exiting 23:16:06 (2404): No heartbeat from core client for 30 sec - exiting 23:16:07 (2404): No heartbeat from core client for 30 sec - exiting 23:23:22 (4664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:23:23 (4664): No heartbeat from core client for 30 sec - exiting 23:24:33 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:32 (5244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4288, selfPID=4288, iMonCtr=2 23:30:21 (3644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:38 (3644): No heartbeat from core client for 30 sec - exiting 23:34:54 (4504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:26 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4912, selfPID=4912, iMonCtr=2 23:38:16 (3788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5604, selfPID=5604, iMonCtr=2 23:39:27 (440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:34 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:06 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:43:56 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:06 (1032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:55:36 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:56:20 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:57:32 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:17:26 (3936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:17:30 (3936): No heartbeat from core client for 30 sec - exiting 00:25:22 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:35 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:42 (5336): No heartbeat from core client for 30 sec - exiting 00:30:13 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2584, selfPID=2584, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6424, selfPID=6424, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=5268, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6992, selfPID=6992, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6992, selfPID=6236, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_e3l5_2013_1_009760539_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3l5_2013_1_009760539_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_e3l5_2013_1_009760539_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 May 2015 08:02:58	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	103,883	396,646	3.8182
12 May 2015 08:02:58	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	92,363	347,777	3.7653
10 May 2015 05:58:22	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	80,843	299,558	3.7054
09 May 2015 14:07:42	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	69,323	252,112	3.6368
09 May 2015 01:20:47	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	57,803	211,293	3.6554
08 May 2015 19:08:38	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	46,283	168,570	3.6422
08 May 2015 19:06:42	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	34,763	123,291	3.5466
08 May 2015 19:05:00	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	23,339	82,269	3.5250
24 Apr 2015 03:51:02	1330994	18334392	hadam3p_anz_e3l5_2013_1_009760539_0	11,819	41,306	3.4949