Task 18275831

Name	hadam3p_anz_d1gq_2013_1_009721087_0
Workunit	9794384
Created	8 Apr 2015, 16:45:00 UTC
Sent	9 Apr 2015, 17:39:57 UTC
Report deadline	21 Mar 2016, 22:59:57 UTC
Received	19 Apr 2015, 17:14:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1113142
Run time	7 days 16 hours 31 min 9 sec
CPU time	6 days 13 hours 11 min 21 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	2.58 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:23:04 (12888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:22:08 (15732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:22:09 (15732): No heartbeat from core client for 30 sec - exiting No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11560, selfPID=11560, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 16:44:35 (6932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:30 (11136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:57 (11420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:20:00 (13928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:02 (13928): No heartbeat from core client for 30 sec - exiting 10:23:17 (16136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:55:20 (10228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17268, selfPID=15384, iMonCtr=1 03:24:07 (13116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12236, selfPID=17136, iMonCtr=1 Model crash detected, will try to restart... 11:46:11 (13108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:35:42 (12500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:33 (10080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:27 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:57 (13008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:59 (1432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:58 (7908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:26 (7908): No heartbeat from core client for 30 sec - exiting 22:39:27 (7908): No heartbeat from core client for 30 sec - exiting 22:48:02 (11780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:26 (11780): No heartbeat from core client for 30 sec - exiting 22:54:00 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:26 (4536): No heartbeat from core client for 30 sec - exiting 23:01:56 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1008, selfPID=1008, iMonCtr=2 23:05:25 (5072): No heartbeat from core client for 30 sec - exiting 23:05:26 (5072): No heartbeat from core client for 30 sec - exiting 23:05:27 (5072): No heartbeat from core client for 30 sec - exiting 23:05:28 (5072): No heartbeat from core client for 30 sec - exiting 23:05:29 (5072): No heartbeat from core client for 30 sec - exiting 23:05:30 (5072): No heartbeat from core client for 30 sec - exiting 23:05:31 (5072): No heartbeat from core client for 30 sec - exiting 23:05:32 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7120, selfPID=7120, iMonCtr=2 23:10:03 (7460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3572, selfPID=3572, iMonCtr=2 23:16:59 (12556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6320, selfPID=6320, iMonCtr=2 23:35:57 (11760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12160, selfPID=12160, iMonCtr=2 23:48:56 (10260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:18 (10092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:56 (10092): No heartbeat from core client for 30 sec - exiting 01:17:27 (12000): No heartbeat from core client for 30 sec - exiting 01:17:28 (12000): No heartbeat from core client for 30 sec - exiting 01:17:29 (12000): No heartbeat from core client for 30 sec - exiting 01:17:30 (12000): No heartbeat from core client for 30 sec - exiting 01:17:31 (12000): No heartbeat from core client for 30 sec - exiting 01:18:03 (12000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:58 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:51:06 (7044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:28 (7044): No heartbeat from core client for 30 sec - exiting 02:28:43 (12296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:47:22 (9100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:59 (11060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:32 (10508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:29 (10508): No heartbeat from core client for 30 sec - exiting 03:50:31 (10508): No heartbeat from core client for 30 sec - exiting 05:05:29 (12328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:29 (12328): No heartbeat from core client for 30 sec - exiting 06:17:57 (12840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:13 (12040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:32 (10728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:00 (12724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:05 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:05 (4164): No heartbeat from core client for 30 sec - exiting 08:10:59 (8396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:07 (8396): No heartbeat from core client for 30 sec - exiting 08:12:08 (8396): No heartbeat from core client for 30 sec - exiting 08:12:09 (8396): No heartbeat from core client for 30 sec - exiting 08:12:10 (8396): No heartbeat from core client for 30 sec - exiting 08:12:11 (8396): No heartbeat from core client for 30 sec - exiting 08:12:12 (8396): No heartbeat from core client for 30 sec - exiting 08:20:14 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1200, selfPID=1200, iMonCtr=2 08:35:51 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:02 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11776, selfPID=11776, iMonCtr=2 09:13:06 (13388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14068, selfPID=14068, iMonCtr=2 09:53:26 (8272): No heartbeat from core client for 30 sec - exiting 09:53:27 (8272): No heartbeat from core client for 30 sec - exiting 09:53:28 (8272): No heartbeat from core client for 30 sec - exiting 09:53:29 (8272): No heartbeat from core client for 30 sec - exiting 09:53:30 (8272): No heartbeat from core client for 30 sec - exiting 09:53:32 (8272): No heartbeat from core client for 30 sec - exiting 09:53:33 (8272): No heartbeat from core client for 30 sec - exiting 09:53:34 (8272): No heartbeat from core client for 30 sec - exiting 09:53:35 (8272): No heartbeat from core client for 30 sec - exiting 09:53:36 (8272): No heartbeat from core client for 30 sec - exiting 09:53:37 (8272): No heartbeat from core client for 30 sec - exiting 09:53:38 (8272): No heartbeat from core client for 30 sec - exiting 09:53:39 (8272): No heartbeat from core client for 30 sec - exiting 09:53:40 (8272): No heartbeat from core client for 30 sec - exiting 09:53:41 (8272): No heartbeat from core client for 30 sec - exiting 09:53:42 (8272): No heartbeat from core client for 30 sec - exiting 09:53:44 (8272): No heartbeat from core client for 30 sec - exiting 09:53:45 (8272): No heartbeat from core client for 30 sec - exiting 09:53:46 (8272): No heartbeat from core client for 30 sec - exiting 09:53:47 (8272): No heartbeat from core client for 30 sec - exiting 09:53:48 (8272): No heartbeat from core client for 30 sec - exiting 09:53:49 (8272): No heartbeat from core client for 30 sec - exiting 09:53:50 (8272): No heartbeat from core client for 30 sec - exiting 09:53:51 (8272): No heartbeat from core client for 30 sec - exiting 09:53:52 (8272): No heartbeat from core client for 30 sec - exiting 09:53:53 (8272): No heartbeat from core client for 30 sec - exiting 09:53:55 (8272): No heartbeat from core client for 30 sec - exiting 09:53:56 (8272): No heartbeat from core client for 30 sec - exiting 09:53:57 (8272): No heartbeat from core client for 30 sec - exiting 09:53:58 (8272): No heartbeat from core client for 30 sec - exiting 09:53:59 (8272): No heartbeat from core client for 30 sec - exiting 09:54:00 (8272): No heartbeat from core client for 30 sec - exiting 09:54:01 (8272): No heartbeat from core client for 30 sec - exiting 09:54:02 (8272): No heartbeat from core client for 30 sec - exiting 09:54:03 (8272): No heartbeat from core client for 30 sec - exiting 09:54:04 (8272): No heartbeat from core client for 30 sec - exiting 09:54:05 (8272): No heartbeat from core client for 30 sec - exiting 09:54:07 (8272): No heartbeat from core client for 30 sec - exiting 09:54:08 (8272): No heartbeat from core client for 30 sec - exiting 09:54:09 (8272): No heartbeat from core client for 30 sec - exiting 09:54:10 (8272): No heartbeat from core client for 30 sec - exiting 09:54:11 (8272): No heartbeat from core client for 30 sec - exiting 09:54:12 (8272): No heartbeat from core client for 30 sec - exiting 09:54:13 (8272): No heartbeat from core client for 30 sec - exiting 09:54:14 (8272): No heartbeat from core client for 30 sec - exiting 09:54:15 (8272): No heartbeat from core client for 30 sec - exiting 09:54:16 (8272): No heartbeat from core client for 30 sec - exiting 09:54:17 (8272): No heartbeat from core client for 30 sec - exiting 09:54:19 (8272): No heartbeat from core client for 30 sec - exiting 09:54:20 (8272): No heartbeat from core client for 30 sec - exiting 09:54:21 (8272): No heartbeat from core client for 30 sec - exiting 09:54:22 (8272): No heartbeat from core client for 30 sec - exiting 09:54:23 (8272): No heartbeat from core client for 30 sec - exiting 09:54:24 (8272): No heartbeat from core client for 30 sec - exiting 09:54:25 (8272): No heartbeat from core client for 30 sec - exiting 09:54:26 (8272): No heartbeat from core client for 30 sec - exiting 09:54:27 (8272): No heartbeat from core client for 30 sec - exiting 09:54:28 (8272): No heartbeat from core client for 30 sec - exiting 09:54:29 (8272): No heartbeat from core client for 30 sec - exiting 09:54:31 (8272): No heartbeat from core client for 30 sec - exiting 09:54:32 (8272): No heartbeat from core client for 30 sec - exiting 09:54:33 (8272): No heartbeat from core client for 30 sec - exiting 09:54:34 (8272): No heartbeat from core client for 30 sec - exiting 09:54:35 (8272): No heartbeat from core client for 30 sec - exiting 09:54:36 (8272): No heartbeat from core client for 30 sec - exiting 09:54:37 (8272): No heartbeat from core client for 30 sec - exiting 09:54:38 (8272): No heartbeat from core client for 30 sec - exiting 09:54:39 (8272): No heartbeat from core client for 30 sec - exiting 09:54:40 (8272): No heartbeat from core client for 30 sec - exiting 09:54:41 (8272): No heartbeat from core client for 30 sec - exiting 09:54:43 (8272): No heartbeat from core client for 30 sec - exiting 09:54:44 (8272): No heartbeat from core client for 30 sec - exiting 09:55:18 (8272): No heartbeat from core client for 30 sec - exiting 09:55:19 (8272): No heartbeat from core client for 30 sec - exiting 09:55:20 (8272): No heartbeat from core client for 30 sec - exiting 09:55:21 (8272): No heartbeat from core client for 30 sec - exiting 09:55:22 (8272): No heartbeat from core client for 30 sec - exiting 09:55:23 (8272): No heartbeat from core client for 30 sec - exiting 09:55:24 (8272): No heartbeat from core client for 30 sec - exiting 09:55:25 (8272): No heartbeat from core client for 30 sec - exiting 09:55:26 (8272): No heartbeat from core client for 30 sec - exiting 09:55:27 (8272): No heartbeat from core client for 30 sec - exiting 09:55:28 (8272): No heartbeat from core client for 30 sec - exiting 09:55:30 (8272): No heartbeat from core client for 30 sec - exiting 09:55:31 (8272): No heartbeat from core client for 30 sec - exiting 09:55:32 (8272): No heartbeat from core client for 30 sec - exiting 09:55:33 (8272): No heartbeat from core client for 30 sec - exiting 09:55:34 (8272): No heartbeat from core client for 30 sec - exiting 09:55:35 (8272): No heartbeat from core client for 30 sec - exiting 09:55:36 (8272): No heartbeat from core client for 30 sec - exiting 09:55:37 (8272): No heartbeat from core client for 30 sec - exiting 09:55:38 (8272): No heartbeat from core client for 30 sec - exiting 09:55:39 (8272): No heartbeat from core client for 30 sec - exiting 09:55:40 (8272): No heartbeat from core client for 30 sec - exiting 09:55:42 (8272): No heartbeat from core client for 30 sec - exiting 09:55:43 (8272): No heartbeat from core client for 30 sec - exiting 09:55:44 (8272): No heartbeat from core client for 30 sec - exiting 09:55:45 (8272): No heartbeat from core client for 30 sec - exiting 09:55:46 (8272): No heartbeat from core client for 30 sec - exiting 09:55:47 (8272): No heartbeat from core client for 30 sec - exiting 09:55:48 (8272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:17 (6600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:13 (12672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:36 (1804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:28 (6680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:57 (6680): No heartbeat from core client for 30 sec - exiting 21:33:36 (10296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:11 (10872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:19 (12804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:52 (11964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:58 (10420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:57:22 (10420): No heartbeat from core client for 30 sec - exiting 05:13:37 (7368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:36 (8760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:36 (9036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:46 (12448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13020, selfPID=13020, iMonCtr=2 06:21:31 (7360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:39 (8572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9388, selfPID=9388, iMonCtr=2 GGlobal Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=10760, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6360, selfPID=9688, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_anz_d1gq_2013_1_009721087_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d1gq_2013_1_009721087_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d1gq_2013_1_009721087_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d1gq_2013_1_009721087_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d1gq_2013_1_009721087_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Apr 2015 03:58:32	1113142	18275831	hadam3p_anz_d1gq_2013_1_009721087_0	80,939	530,466	6.5539
17 Apr 2015 22:59:14	1113142	18275831	hadam3p_anz_d1gq_2013_1_009721087_0	69,419	457,046	6.5839
15 Apr 2015 23:49:02	1113142	18275831	hadam3p_anz_d1gq_2013_1_009721087_0	57,899	383,459	6.6229
13 Apr 2015 23:21:02	1113142	18275831	hadam3p_anz_d1gq_2013_1_009721087_0	46,379	309,086	6.6644
12 Apr 2015 18:44:06	1113142	18275831	hadam3p_anz_d1gq_2013_1_009721087_0	34,859	233,435	6.6965
11 Apr 2015 18:45:20	1113142	18275831	hadam3p_anz_d1gq_2013_1_009721087_0	23,339	156,368	6.6999
10 Apr 2015 18:11:17	1113142	18275831	hadam3p_anz_d1gq_2013_1_009721087_0	11,819	78,942	6.6792