Task 18820191

Name	hadam3p_anz_n9z3_2008_1_010109107_0
Workunit	10088697
Created	12 Aug 2015, 23:52:49 UTC
Sent	17 Aug 2015, 8:29:19 UTC
Report deadline	29 Jul 2016, 13:49:19 UTC
Received	30 Aug 2015, 2:23:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1358190
Run time	7 days 9 hours 44 min 51 sec
CPU time	7 days 8 hours 28 min 58 sec
Validate state	Invalid
Credit	5,477.92
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.6.6</core_client_version> <![CDATA[ <stderr_txt> 10:29:50 (9772): start_timer_thread(): CreateThread() failed, errno 0 10:29:52 (5224): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:27:11 (9456): start_timer_thread(): CreateThread() failed, errno 0 14:27:13 (6580): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:13:24 (7304): start_timer_thread(): CreateThread() failed, errno 0 15:13:25 (8656): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:18:27 (4364): start_timer_thread(): CreateThread() failed, errno 0 15:18:28 (8076): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:26:55 (8636): start_timer_thread(): CreateThread() failed, errno 0 15:26:57 (5280): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:34:09 (9212): start_timer_thread(): CreateThread() failed, errno 0 15:34:10 (9424): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:53:41 (9304): start_timer_thread(): CreateThread() failed, errno 0 15:53:43 (7996): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:57:10 (4832): start_timer_thread(): CreateThread() failed, errno 0 15:57:12 (3160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:51:53 (5684): start_timer_thread(): CreateThread() failed, errno 0 17:51:54 (8480): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:12:08 (8308): start_timer_thread(): CreateThread() failed, errno 0 18:12:10 (9184): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:17:11 (6884): start_timer_thread(): CreateThread() failed, errno 0 18:17:13 (5320): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:31:59 (712): start_timer_thread(): CreateThread() failed, errno 0 18:32:05 (6772): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 188:36:21 (7208): strr__timer_thead():):CrreateThread() faaied, errno 0 CPDN Monitor - Quit request from BOINC... 18:42:24 (6704): start_timer_thread(): CreateThread() failed, errno 0 18:42:26 (5452): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:05:01 (5132): start_timer_thread(): CreateThread() failed, errno 0 19:05:03 (5808): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:10:25 (4988): start_timer_thread(): CreateThread() failed, errno 0 19:10:27 (6836): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:21:06 (2488): start_timer_thread(): CreateThread() failed, errno 0 19:21:08 (4160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:23:44 (8004): start_timer_thread(): CreateThread() failed, errno 0 19:23:46 (5260): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:48:10 (7736): start_timer_thread(): CreateThread() failed, errno 0 19:48:11 (6576): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:54:12 (4188): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:54:14 (7256): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:14:59 (7912): start_timer_thread(): CreateThread() failed, errno 0 11:15:00 (1980): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:16:23 (5452): start_timer_thread(): CreateThread() failed, errno 0 11:16:25 (1880): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:24:37 (5384): start_timer_thread(): CreateThread() failed, errno 0 18:24:38 (3980): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:30:35 (3968): start_timer_thread(): CreateThread() failed, errno 0 18:30:37 (2616): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:38:37 (5568): start_timer_thread(): CreateThread() failed, errno 0 18:38:39 (7356): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:59:34 (8068): start_timer_thread(): CreateThread() failed, errno 0 18:59:35 (5060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:03:18 (740): start_timer_thread(): CreateThread() failed, errno 0 19:03:19 (3016): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:07:35 (5924): start_timer_thread(): CreateThread() failed, errno 0 19:07:36 (6556): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:13:17 (7204): start_timer_thread(): CreateThread() failed, errno 0 19:13:19 (5992): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:15:27 (5420): start_timer_thread(): CreateThread() failed, errno 0 19:15:29 (6420): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:07:46 (4216): start_timer_thread(): CreateThread() failed, errno 0 20:07:48 (644): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:02:21 (3864): start_timer_thread(): CreateThread() failed, errno 0 18:02:23 (6344): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:04:28 (6696): start_timer_thread(): CreateThread() failed, errno 0 18:04:29 (2064): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:05:59 (7444): start_timer_thread(): CreateThread() failed, errno 0 18:06:00 (6876): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:11:29 (4940): start_timer_thread(): CreateThread() failed, errno 0 18:11:30 (2144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:18:24 (8648): start_timer_thread(): CreateThread() failed, errno 0 18:18:25 (4832): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:22:12 (7364): start_timer_thread(): CreateThread() failed, errno 0 18:22:13 (8312): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:24:29 (6528): start_timer_thread(): CreateThread() failed, errno 0 18:24:30 (6736): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:59:23 (7716): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:04:06 (6808): start_timer_thread(): CreateThread() failed, errno 0 19:04:07 (8860): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:08:53 (8816): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:12:10 (9136): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:26:49 (8960): start_timer_thread(): CreateThread() failed, errno 0 22:26:51 (5020): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:47:16 (6896): start_timer_thread(): CreateThread() failed, errno 0 23:47:17 (6104): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:58:50 (6124): start_timer_thread(): CreateThread() failed, errno 0 17:58:51 (8372): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:04:06 (1528): start_timer_thread(): CreateThread() failed, errno 0 18:04:07 (7508): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:19:46 (8248): start_timer_thread(): CreateThread() failed, errno 0 18:19:48 (6012): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:25:58 (6804): start_timer_thread(): CreateThread() failed, errno 0 18:26:00 (4428): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:34:25 (5608): start_timer_thread(): CreateThread() failed, errno 0 18:34:27 (1132): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:37:33 (4484): start_timer_thread(): CreateThread() failed, errno 0 18:37:35 (9044): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:46:55 (8072): start_timer_thread(): CreateThread() failed, errno 0 08:46:56 (8712): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:05:06 (4948): start_timer_thread(): CreateThread() failed, errno 0 09:05:08 (3780): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:28:16 (8240): start_timer_thread(): CreateThread() failed, errno 0 09:28:17 (1484): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:25:16 (2152): start_timer_thread(): CreateThread() failed, errno 0 10:25:17 (4604): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:35:47 (792): start_timer_thread(): CreateThread() failed, errno 0 10:35:49 (3540): start_timer_thread(): CreateThread() failed, errno 0 18:59:57 (8504): start_timer_thread(): CreateThread() failed, errno 0 18:59:59 (8584): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:45:58 (7312): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 05:14:09 (7664): start_timer_thread(): CreateThread() failed, errno 0 05:14:11 (9008): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:57:39 (3068): start_timer_thread(): CreateThread() failed, errno 0 06:57:41 (8928): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:15:45 (4224): start_timer_thread(): CreateThread() failed, errno 0 08:15:47 (5164): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:50:14 (7604): start_timer_thread(): CreateThread() failed, errno 0 10:50:16 (8764): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:16:15 (7448): start_timer_thread(): CreateThread() failed, errno 0 13:16:17 (9000): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 17:46:06 (7512): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 17:46:08 (6700): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:01:51 (7504): start_timer_thread(): CreateThread() failed, errno 0 00:01:52 (6856): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:26:36 (7592): start_timer_thread(): CreateThread() failed, errno 0 02:26:38 (4212): start_timer_thread(): CreateThread() failed, errno 0 07:19:50 (8360): start_timer_thread(): CreateThread() failed, errno 0 07:19:51 (8280): start_timer_thread(): CreateThread() failed, errno 0 07:46:30 (6688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:50 (7092): start_timer_thread(): CreateThread() failed, errno 0 07:46:51 (7088): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:35:42 (9148): start_timer_thread(): CreateThread() failed, errno 0 19:35:43 (3372): start_timer_thread(): CreateThread() failed, errno 0 08:59:46 (8936): start_timer_thread(): CreateThread() failed, errno 0 08:59:48 (8796): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:00:00 (9140): start_timer_thread(): CreateThread() failed, errno 0 10:00:01 (1936): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:25:53 (228): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 19:25:54 (8348): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 04:25:08 (7524): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 04:25:09 (8168): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:22:08 (7444): start_timer_thread(): CreateThread() failed, errno 0 17:22:10 (792): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:22:12 (7188): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 18:22:14 (7052): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 09:05:41 (6876): start_timer_thread(): CreateThread() failed, errno 0 diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12 WARNING: BOINC Windows Runtime Debugger has been disabled. 09:05:42 (4128): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:55:47 (7908): start_timer_thread(): CreateThread() failed, errno 0 11:55:48 (8064): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:55:49 (5412): start_timer_thread(): CreateThread() failed, errno 0 12:55:51 (8188): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:42:08 (3480): start_timer_thread(): CreateThread() failed, errno 0 15:42:09 (6700): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:01:33 (1812): start_timer_thread(): CreateThread() failed, errno 0 19:01:35 (7476): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:13:43 (4228): start_timer_thread(): CreateThread() failed, errno 0 19:13:45 (1740): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:02:50 (6324): start_timer_thread(): CreateThread() failed, errno 0 20:02:52 (5580): start_timer_thread(): CreateThread() failed, errno 0 20:14:59 (8132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:47:04 (2096): start_timer_thread(): CreateThread() failed, errno 0 01:47:06 (8036): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 03:22:05 (7336): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7336, iMonCtr=1 03:22:21 (1624): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1624, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n9z3_2008_1_010109107_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Aug 2015 11:20:53	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	127,019	614,982	4.8417
28 Aug 2015 17:01:29	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	115,499	558,477	4.8353
28 Aug 2015 00:55:53	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	103,979	502,138	4.8292
27 Aug 2015 08:03:15	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	92,459	446,850	4.8330
26 Aug 2015 13:57:45	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	80,939	392,424	4.8484
25 Aug 2015 21:31:54	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	69,419	338,179	4.8716
25 Aug 2015 05:41:02	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	57,899	283,216	4.8916
24 Aug 2015 05:22:15	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	46,379	227,648	4.9084
21 Aug 2015 01:49:33	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	34,859	171,573	4.9219
20 Aug 2015 02:12:36	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	23,339	114,960	4.9257
18 Aug 2015 21:44:35	1358190	18820191	hadam3p_anz_n9z3_2008_1_010109107_0	11,819	58,176	4.9222