Task 16410345

Name	hadam3p_anz_n493_2012_1_008593127_0
Workunit	8739639
Created	26 Mar 2014, 18:11:01 UTC
Sent	29 Mar 2014, 18:42:51 UTC
Report deadline	12 Mar 2015, 0:02:51 UTC
Received	3 Apr 2014, 0:49:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1084069
Run time	2 days 12 hours 2 min 26 sec
CPU time	2 days 7 hours 30 min 48 sec
Validate state	Invalid
Credit	1,006.54
Device peak FLOPS	2.97 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:41:15 (3952): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:22:35 (14584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13600, selfPID=13600, iMonCtr=2 17:48:16 (4804): No heartbeat from core client for 30 sec - exiting 17:48:17 (4804): No heartbeat from core client for 30 sec - exiting 17:48:18 (4804): No heartbeat from core client for 30 sec - exiting 17:48:19 (4804): No heartbeat from core client for 30 sec - exiting 17:48:20 (4804): No heartbeat from core client for 30 sec - exiting 17:48:21 (4804): No heartbeat from core client for 30 sec - exiting 17:48:22 (4804): No heartbeat from core client for 30 sec - exiting 17:48:23 (4804): No heartbeat from core client for 30 sec - exiting 17:48:24 (4804): No heartbeat from core client for 30 sec - exiting 17:48:25 (4804): No heartbeat from core client for 30 sec - exiting 17:48:26 (4804): No heartbeat from core client for 30 sec - exiting 17:48:27 (4804): No heartbeat from core client for 30 sec - exiting 17:48:28 (4804): No heartbeat from core client for 30 sec - exiting 17:48:29 (4804): No heartbeat from core client for 30 sec - exiting 17:48:30 (4804): No heartbeat from core client for 30 sec - exiting 17:48:31 (4804): No heartbeat from core client for 30 sec - exiting 17:48:32 (4804): No heartbeat from core client for 30 sec - exiting 17:48:33 (4804): No heartbeat from core client for 30 sec - exiting 17:48:34 (4804): No heartbeat from core client for 30 sec - exiting 17:48:35 (4804): No heartbeat from core client for 30 sec - exiting 17:48:36 (4804): No heartbeat from core client for 30 sec - exiting 17:48:37 (4804): No heartbeat from core client for 30 sec - exiting 17:48:38 (4804): No heartbeat from core client for 30 sec - exiting 17:48:39 (4804): No heartbeat from core client for 30 sec - exiting 17:48:40 (4804): No heartbeat from core client for 30 sec - exiting 17:48:41 (4804): No heartbeat from core client for 30 sec - exiting 17:48:42 (4804): No heartbeat from core client for 30 sec - exiting 17:48:43 (4804): No heartbeat from core client for 30 sec - exiting 17:48:44 (4804): No heartbeat from core client for 30 sec - exiting 17:48:45 (4804): No heartbeat from core client for 30 sec - exiting 17:48:46 (4804): No heartbeat from core client for 30 sec - exiting 17:48:47 (4804): No heartbeat from core client for 30 sec - exiting 17:48:48 (4804): No heartbeat from core client for 30 sec - exiting 16:50:14 (4804): No heartbeat from core client for 30 sec - exiting 16:50:15 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:45:50 (15652): No heartbeat from core client for 30 sec - exiting 23:45:51 (15652): No heartbeat from core client for 30 sec - exiting 23:45:52 (15652): No heartbeat from core client for 30 sec - exiting 23:45:53 (15652): No heartbeat from core client for 30 sec - exiting 23:45:54 (15652): No heartbeat from core client for 30 sec - exiting 23:45:55 (15652): No heartbeat from core client for 30 sec - exiting 23:45:56 (15652): No heartbeat from core client for 30 sec - exiting 23:45:57 (15652): No heartbeat from core client for 30 sec - exiting 23:45:58 (15652): No heartbeat from core client for 30 sec - exiting 23:45:59 (15652): No heartbeat from core client for 30 sec - exiting 23:46:00 (15652): No heartbeat from core client for 30 sec - exiting 23:46:01 (15652): No heartbeat from core client for 30 sec - exiting 23:46:02 (15652): No heartbeat from core client for 30 sec - exiting 23:46:03 (15652): No heartbeat from core client for 30 sec - exiting 23:46:04 (15652): No heartbeat from core client for 30 sec - exiting 23:46:05 (15652): No heartbeat from core client for 30 sec - exiting 23:46:06 (15652): No heartbeat from core client for 30 sec - exiting 23:46:07 (15652): No heartbeat from core client for 30 sec - exiting 23:46:08 (15652): No heartbeat from core client for 30 sec - exiting 23:46:09 (15652): No heartbeat from core client for 30 sec - exiting 23:46:10 (15652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:54:18 (1724): No heartbeat from core client for 30 sec - exiting 04:54:19 (1724): No heartbeat from core client for 30 sec - exiting 04:54:20 (1724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:59:42 (8372): No heartbeat from core client for 30 sec - exiting 18:59:43 (8372): No heartbeat from core client for 30 sec - exiting 18:59:44 (8372): No heartbeat from core client for 30 sec - exiting 18:59:45 (8372): No heartbeat from core client for 30 sec - exiting 18:59:46 (8372): No heartbeat from core client for 30 sec - exiting 18:59:47 (8372): No heartbeat from core client for 30 sec - exiting 18:59:48 (8372): No heartbeat from core client for 30 sec - exiting 18:59:49 (8372): No heartbeat from core client for 30 sec - exiting 18:59:50 (8372): No heartbeat from core client for 30 sec - exiting 18:59:51 (8372): No heartbeat from core client for 30 sec - exiting 18:59:52 (8372): No heartbeat from core client for 30 sec - exiting 18:59:53 (8372): No heartbeat from core client for 30 sec - exiting 18:59:54 (8372): No heartbeat from core client for 30 sec - exiting 18:59:55 (8372): No heartbeat from core client for 30 sec - exiting 18:59:56 (8372): No heartbeat from core client for 30 sec - exiting 18:59:57 (8372): No heartbeat from core client for 30 sec - exiting 18:59:58 (8372): No heartbeat from core client for 30 sec - exiting 18:59:59 (8372): No heartbeat from core client for 30 sec - exiting 19:00:00 (8372): No heartbeat from core client for 30 sec - exiting 19:00:01 (8372): No heartbeat from core client for 30 sec - exiting 19:00:02 (8372): No heartbeat from core client for 30 sec - exiting 19:00:03 (8372): No heartbeat from core client for 30 sec - exiting 19:00:04 (8372): No heartbeat from core client for 30 sec - exiting 19:00:05 (8372): No heartbeat from core client for 30 sec - exiting 19:00:06 (8372): No heartbeat from core client for 30 sec - exiting 19:00:07 (8372): No heartbeat from core client for 30 sec - exiting 19:00:08 (8372): No heartbeat from core client for 30 sec - exiting 19:00:09 (8372): No heartbeat from core client for 30 sec - exiting 19:00:10 (8372): No heartbeat from core client for 30 sec - exiting 19:00:11 (8372): No heartbeat from core client for 30 sec - exiting 19:00:12 (8372): No heartbeat from core client for 30 sec - exiting 19:00:13 (8372): No heartbeat from core client for 30 sec - exiting 19:00:14 (8372): No heartbeat from core client for 30 sec - exiting 19:00:15 (8372): No heartbeat from core client for 30 sec - exiting 19:00:16 (8372): No heartbeat from core client for 30 sec - exiting 19:00:17 (8372): No heartbeat from core client for 30 sec - exiting 19:00:18 (8372): No heartbeat from core client for 30 sec - exiting 19:00:19 (8372): No heartbeat from core client for 30 sec - exiting 19:00:20 (8372): No heartbeat from core client for 30 sec - exiting 19:00:21 (8372): No heartbeat from core client for 30 sec - exiting 19:00:22 (8372): No heartbeat from core client for 30 sec - exiting 19:00:23 (8372): No heartbeat from core client for 30 sec - exiting 19:00:24 (8372): No heartbeat from core client for 30 sec - exiting 19:00:25 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12608, selfPID=12608, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:13:18 (8224): No heartbeat from core client for 30 sec - exiting 20:13:19 (8224): No heartbeat from core client for 30 sec - exiting 20:13:20 (8224): No heartbeat from core client for 30 sec - exiting 20:13:21 (8224): No heartbeat from core client for 30 sec - exiting 20:13:22 (8224): No heartbeat from core client for 30 sec - exiting 20:13:23 (8224): No heartbeat from core client for 30 sec - exiting 20:13:24 (8224): No heartbeat from core client for 30 sec - exiting 20:13:25 (8224): No heartbeat from core client for 30 sec - exiting 20:13:26 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:49:24 (6728): No heartbeat from core client for 30 sec - exiting 23:49:25 (6728): No heartbeat from core client for 30 sec - exiting 23:49:26 (6728): No heartbeat from core client for 30 sec - exiting 23:49:27 (6728): No heartbeat from core client for 30 sec - exiting 23:49:28 (6728): No heartbeat from core client for 30 sec - exiting 23:49:29 (6728): No heartbeat from core client for 30 sec - exiting 23:49:30 (6728): No heartbeat from core client for 30 sec - exiting 23:49:31 (6728): No heartbeat from core client for 30 sec - exiting 23:49:32 (6728): No heartbeat from core client for 30 sec - exiting 23:49:33 (6728): No heartbeat from core client for 30 sec - exiting 23:49:34 (6728): No heartbeat from core client for 30 sec - exiting 23:49:35 (6728): No heartbeat from core client for 30 sec - exiting 23:49:36 (6728): No heartbeat from core client for 30 sec - exiting 23:49:37 (6728): No heartbeat from core client for 30 sec - exiting 23:49:38 (6728): No heartbeat from core client for 30 sec - exiting 23:49:39 (6728): No heartbeat from core client for 30 sec - exiting 23:49:40 (6728): No heartbeat from core client for 30 sec - exiting 23:49:41 (6728): No heartbeat from core client for 30 sec - exiting 23:49:42 (6728): No heartbeat from core client for 30 sec - exiting 23:49:43 (6728): No heartbeat from core client for 30 sec - exiting 23:49:44 (6728): No heartbeat from core client for 30 sec - exiting 23:49:45 (6728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:00:38 (8636): No heartbeat from core client for 30 sec - exiting 00:00:39 (8636): No heartbeat from core client for 30 sec - exiting 00:00:40 (8636): No heartbeat from core client for 30 sec - exiting 00:01:23 (8636): No heartbeat from core client for 30 sec - exiting 00:01:24 (8636): No heartbeat from core client for 30 sec - exiting 00:01:25 (8636): No heartbeat from core client for 30 sec - exiting 00:01:26 (8636): No heartbeat from core client for 30 sec - exiting 00:01:27 (8636): No heartbeat from core client for 30 sec - exiting 00:01:28 (8636): No heartbeat from core client for 30 sec - exiting 00:01:29 (8636): No heartbeat from core client for 30 sec - exiting 00:01:30 (8636): No heartbeat from core client for 30 sec - exiting 00:01:31 (8636): No heartbeat from core client for 30 sec - exiting 00:01:32 (8636): No heartbeat from core client for 30 sec - exiting 00:01:33 (8636): No heartbeat from core client for 30 sec - exiting 00:01:34 (8636): No heartbeat from core client for 30 sec - exiting 00:01:35 (8636): No heartbeat from core client for 30 sec - exiting 00:01:36 (8636): No heartbeat from core client for 30 sec - exiting 00:01:37 (8636): No heartbeat from core client for 30 sec - exiting 00:01:38 (8636): No heartbeat from core client for 30 sec - exiting 00:01:39 (8636): No heartbeat from core client for 30 sec - exiting 00:01:40 (8636): No heartbeat from core client for 30 sec - exiting 00:01:41 (8636): No heartbeat from core client for 30 sec - exiting 00:01:42 (8636): No heartbeat from core client for 30 sec - exiting 00:01:43 (8636): No heartbeat from core client for 30 sec - exiting 00:01:44 (8636): No heartbeat from core client for 30 sec - exiting 00:01:45 (8636): No heartbeat from core client for 30 sec - exiting 00:01:46 (8636): No heartbeat from core client for 30 sec - exiting 00:01:47 (8636): No heartbeat from core client for 30 sec - exiting 00:01:48 (8636): No heartbeat from core client for 30 sec - exiting 00:01:49 (8636): No heartbeat from core client for 30 sec - exiting 00:01:50 (8636): No heartbeat from core client for 30 sec - exiting 00:01:51 (8636): No heartbeat from core client for 30 sec - exiting 00:01:52 (8636): No heartbeat from core client for 30 sec - exiting 00:01:53 (8636): No heartbeat from core client for 30 sec - exiting 00:01:54 (8636): No heartbeat from core client for 30 sec - exiting 00:01:55 (8636): No heartbeat from core client for 30 sec - exiting 00:01:56 (8636): No heartbeat from core client for 30 sec - exiting 00:01:57 (8636): No heartbeat from core client for 30 sec - exiting 00:01:58 (8636): No heartbeat from core client for 30 sec - exiting 00:01:59 (8636): No heartbeat from core client for 30 sec - exiting 00:02:00 (8636): No heartbeat from core client for 30 sec - exiting 00:02:01 (8636): No heartbeat from core client for 30 sec - exiting 00:02:02 (8636): No heartbeat from core client for 30 sec - exiting 00:02:03 (8636): No heartbeat from core client for 30 sec - exiting 00:02:04 (8636): No heartbeat from core client for 30 sec - exiting 00:02:05 (8636): No heartbeat from core client for 30 sec - exiting 00:02:06 (8636): No heartbeat from core client for 30 sec - exiting 00:02:07 (8636): No heartbeat from core client for 30 sec - exiting 00:02:08 (8636): No heartbeat from core client for 30 sec - exiting 00:02:09 (8636): No heartbeat from core client for 30 sec - exiting 00:02:10 (8636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n493_2012_1_008593127_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Apr 2014 00:15:22	1084069	16410345	hadam3p_anz_n493_2012_1_008593127_0	23,339	173,058	7.4150
31 Mar 2014 18:50:20	1084069	16410345	hadam3p_anz_n493_2012_1_008593127_0	11,819	87,582	7.4103