Task 18299213

Name	hadam3p_anz_d373_2013_1_009722554_1
Workunit	9795851
Created	9 Apr 2015, 16:18:17 UTC
Sent	9 Apr 2015, 17:39:57 UTC
Report deadline	21 Mar 2016, 22:59:57 UTC
Received	19 Apr 2015, 17:14:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1113142
Run time	7 days 22 hours 50 min 14 sec
CPU time	6 days 8 hours 6 min 52 sec
Validate state	Invalid
Credit	3,490.64
Device peak FLOPS	2.58 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16012, selfPID=16012, iMonCtr=2 15:22:09 (7272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:22:10 (7272): No heartbeat from core client for 30 sec - exiting 15:22:11 (7272): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 16:44:36 (8704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:30 (9660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:20:01 (14680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:03 (14680): No heartbeat from core client for 30 sec - exiting 10:23:17 (14664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:55:20 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18328, selfPID=18328, iMonCtr=2 03:24:06 (15780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:07 (15780): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16056, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7776, iMonCtr=2 Model crash detected, will try to restart... 11:46:10 (13188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6856, selfPID=6856, iMonCtr=2 15:01:36 (11708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:26 (12604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:56 (4988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:35:59 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:26 (3756): No heartbeat from core client for 30 sec - exiting 22:37:58 (4920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:26 (4920): No heartbeat from core client for 30 sec - exiting 22:39:27 (4920): No heartbeat from core client for 30 sec - exiting 22:48:02 (11328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:54:00 (10196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:26 (10196): No heartbeat from core client for 30 sec - exiting 23:01:57 (7644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10176, selfPID=10176, iMonCtr=2 23:05:25 (7228): No heartbeat from core client for 30 sec - exiting 23:05:26 (7228): No heartbeat from core client for 30 sec - exiting 23:05:27 (7228): No heartbeat from core client for 30 sec - exiting 23:05:28 (7228): No heartbeat from core client for 30 sec - exiting 23:05:29 (7228): No heartbeat from core client for 30 sec - exiting 23:05:30 (7228): No heartbeat from core client for 30 sec - exiting 23:05:31 (7228): No heartbeat from core client for 30 sec - exiting 23:05:32 (7228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:04 (11108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:59 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:58 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:56 (9128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:20:19 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:49:56 (5904): No heartbeat from core client for 30 sec - exiting 01:17:26 (2740): No heartbeat from core client for 30 sec - exiting 01:17:27 (2740): No heartbeat from core client for 30 sec - exiting 01:17:28 (2740): No heartbeat from core client for 30 sec - exiting 01:17:29 (2740): No heartbeat from core client for 30 sec - exiting 01:17:30 (2740): No heartbeat from core client for 30 sec - exiting 01:17:31 (2740): No heartbeat from core client for 30 sec - exiting 01:18:02 (2740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:59 (9144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:28 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:00:03 (4468): No heartbeat from core client for 30 sec - exiting 02:08:32 (4468): No heartbeat from core client for 30 sec - exiting 02:28:43 (8740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:47:20 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:12:59 (9112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:29 (9112): No heartbeat from core client for 30 sec - exiting 03:48:47 (12408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:31 (12408): No heartbeat from core client for 30 sec - exiting 05:10:26 (12852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:29 (12852): No heartbeat from core client for 30 sec - exiting 06:19:04 (12680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:55:13 (3660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:33 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:59 (10416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:05 (12972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:10:58 (9364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:13 (2600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:51 (5604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:02 (12368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4112, selfPID=4112, iMonCtr=2 09:13:05 (13908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:34 (8256): No heartbeat from core client for 30 sec - exiting 09:53:35 (8256): No heartbeat from core client for 30 sec - exiting 09:53:36 (8256): No heartbeat from core client for 30 sec - exiting 09:53:37 (8256): No heartbeat from core client for 30 sec - exiting 09:53:38 (8256): No heartbeat from core client for 30 sec - exiting 09:53:39 (8256): No heartbeat from core client for 30 sec - exiting 09:53:40 (8256): No heartbeat from core client for 30 sec - exiting 09:53:41 (8256): No heartbeat from core client for 30 sec - exiting 09:53:42 (8256): No heartbeat from core client for 30 sec - exiting 09:53:43 (8256): No heartbeat from core client for 30 sec - exiting 09:53:45 (8256): No heartbeat from core client for 30 sec - exiting 09:53:46 (8256): No heartbeat from core client for 30 sec - exiting 09:53:47 (8256): No heartbeat from core client for 30 sec - exiting 09:53:48 (8256): No heartbeat from core client for 30 sec - exiting 09:53:49 (8256): No heartbeat from core client for 30 sec - exiting 09:53:50 (8256): No heartbeat from core client for 30 sec - exiting 09:53:51 (8256): No heartbeat from core client for 30 sec - exiting 09:53:52 (8256): No heartbeat from core client for 30 sec - exiting 09:53:53 (8256): No heartbeat from core client for 30 sec - exiting 09:53:54 (8256): No heartbeat from core client for 30 sec - exiting 09:53:55 (8256): No heartbeat from core client for 30 sec - exiting 09:53:57 (8256): No heartbeat from core client for 30 sec - exiting 09:53:58 (8256): No heartbeat from core client for 30 sec - exiting 09:53:59 (8256): No heartbeat from core client for 30 sec - exiting 09:54:00 (8256): No heartbeat from core client for 30 sec - exiting 09:54:01 (8256): No heartbeat from core client for 30 sec - exiting 09:54:02 (8256): No heartbeat from core client for 30 sec - exiting 09:54:03 (8256): No heartbeat from core client for 30 sec - exiting 09:54:04 (8256): No heartbeat from core client for 30 sec - exiting 09:54:05 (8256): No heartbeat from core client for 30 sec - exiting 09:54:06 (8256): No heartbeat from core client for 30 sec - exiting 09:54:08 (8256): No heartbeat from core client for 30 sec - exiting 09:54:09 (8256): No heartbeat from core client for 30 sec - exiting 09:54:10 (8256): No heartbeat from core client for 30 sec - exiting 09:54:11 (8256): No heartbeat from core client for 30 sec - exiting 09:54:12 (8256): No heartbeat from core client for 30 sec - exiting 09:54:13 (8256): No heartbeat from core client for 30 sec - exiting 09:54:14 (8256): No heartbeat from core client for 30 sec - exiting 09:54:15 (8256): No heartbeat from core client for 30 sec - exiting 09:54:16 (8256): No heartbeat from core client for 30 sec - exiting 09:54:17 (8256): No heartbeat from core client for 30 sec - exiting 09:54:19 (8256): No heartbeat from core client for 30 sec - exiting 09:54:20 (8256): No heartbeat from core client for 30 sec - exiting 09:54:21 (8256): No heartbeat from core client for 30 sec - exiting 09:54:22 (8256): No heartbeat from core client for 30 sec - exiting 09:54:23 (8256): No heartbeat from core client for 30 sec - exiting 09:54:24 (8256): No heartbeat from core client for 30 sec - exiting 09:54:25 (8256): No heartbeat from core client for 30 sec - exiting 09:54:26 (8256): No heartbeat from core client for 30 sec - exiting 09:54:27 (8256): No heartbeat from core client for 30 sec - exiting 09:54:28 (8256): No heartbeat from core client for 30 sec - exiting 09:54:29 (8256): No heartbeat from core client for 30 sec - exiting 09:54:31 (8256): No heartbeat from core client for 30 sec - exiting 09:54:32 (8256): No heartbeat from core client for 30 sec - exiting 09:54:33 (8256): No heartbeat from core client for 30 sec - exiting 09:54:34 (8256): No heartbeat from core client for 30 sec - exiting 09:54:35 (8256): No heartbeat from core client for 30 sec - exiting 09:54:36 (8256): No heartbeat from core client for 30 sec - exiting 09:54:37 (8256): No heartbeat from core client for 30 sec - exiting 09:54:38 (8256): No heartbeat from core client for 30 sec - exiting 09:54:39 (8256): No heartbeat from core client for 30 sec - exiting 09:54:40 (8256): No heartbeat from core client for 30 sec - exiting 09:54:42 (8256): No heartbeat from core client for 30 sec - exiting 09:54:43 (8256): No heartbeat from core client for 30 sec - exiting 09:54:44 (8256): No heartbeat from core client for 30 sec - exiting 09:55:18 (8256): No heartbeat from core client for 30 sec - exiting 09:55:19 (8256): No heartbeat from core client for 30 sec - exiting 09:55:20 (8256): No heartbeat from core client for 30 sec - exiting 09:55:21 (8256): No heartbeat from core client for 30 sec - exiting 09:55:22 (8256): No heartbeat from core client for 30 sec - exiting 09:55:23 (8256): No heartbeat from core client for 30 sec - exiting 09:55:24 (8256): No heartbeat from core client for 30 sec - exiting 09:55:25 (8256): No heartbeat from core client for 30 sec - exiting 09:55:26 (8256): No heartbeat from core client for 30 sec - exiting 09:55:27 (8256): No heartbeat from core client for 30 sec - exiting 09:55:28 (8256): No heartbeat from core client for 30 sec - exiting 09:55:30 (8256): No heartbeat from core client for 30 sec - exiting 09:55:31 (8256): No heartbeat from core client for 30 sec - exiting 09:55:32 (8256): No heartbeat from core client for 30 sec - exiting 09:55:33 (8256): No heartbeat from core client for 30 sec - exiting 09:55:34 (8256): No heartbeat from core client for 30 sec - exiting 09:55:35 (8256): No heartbeat from core client for 30 sec - exiting 09:55:36 (8256): No heartbeat from core client for 30 sec - exiting 09:55:37 (8256): No heartbeat from core client for 30 sec - exiting 09:55:38 (8256): No heartbeat from core client for 30 sec - exiting 09:55:39 (8256): No heartbeat from core client for 30 sec - exiting 09:55:40 (8256): No heartbeat from core client for 30 sec - exiting 09:55:42 (8256): No heartbeat from core client for 30 sec - exiting 09:55:43 (8256): No heartbeat from core client for 30 sec - exiting 09:55:44 (8256): No heartbeat from core client for 30 sec - exiting 09:55:45 (8256): No heartbeat from core client for 30 sec - exiting 09:55:46 (8256): No heartbeat from core client for 30 sec - exiting 09:55:48 (8256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:19 (6400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:13 (13124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:36 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:28 (13284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:29 (13284): No heartbeat from core client for 30 sec - exiting 21:33:36 (11648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7092, selfPID=7092, iMonCtr=2 21:38:11 (10928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:19 (1436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:52 (6204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:58 (11560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:13:36 (8520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:17:37 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:45:36 (13268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:46 (7960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:21:31 (11416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:40 (11040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10024, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=10996, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8840, selfPID=7120, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_anz_d373_2013_1_009722554_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d373_2013_1_009722554_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d373_2013_1_009722554_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d373_2013_1_009722554_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_d373_2013_1_009722554_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Apr 2015 08:50:34	1113142	18299213	hadam3p_anz_d373_2013_1_009722554_1	80,939	529,624	6.5435
18 Apr 2015 05:15:26	1113142	18299213	hadam3p_anz_d373_2013_1_009722554_1	69,419	455,984	6.5686
16 Apr 2015 02:53:50	1113142	18299213	hadam3p_anz_d373_2013_1_009722554_1	57,899	382,890	6.6131
14 Apr 2015 08:36:03	1113142	18299213	hadam3p_anz_d373_2013_1_009722554_1	46,379	308,213	6.6455
13 Apr 2015 00:45:21	1113142	18299213	hadam3p_anz_d373_2013_1_009722554_1	34,859	234,351	6.7228
11 Apr 2015 22:19:05	1113142	18299213	hadam3p_anz_d373_2013_1_009722554_1	23,339	157,087	6.7307
10 Apr 2015 20:11:33	1113142	18299213	hadam3p_anz_d373_2013_1_009722554_1	11,819	79,104	6.6930