Task 13772211

Name	hadam3p_saf_7g0r_2005_1_007577700_1
Workunit	7755830
Created	13 Dec 2011, 3:23:02 UTC
Sent	13 Dec 2011, 3:47:27 UTC
Report deadline	24 Nov 2012, 9:07:27 UTC
Received	30 Dec 2011, 22:07:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1184704
Run time	4 days 23 hours 44 min 28 sec
CPU time	4 days 20 hours 17 min 57 sec
Validate state	Invalid
Credit	1,496.58
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:40:52 (11880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13456, selfPID=7396, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 11:18:43 (6048): No heartbeat from core client for 30 sec - exiting 11:18:44 (6048): No heartbeat from core client for 30 sec - exiting 11:18:45 (6048): No heartbeat from core client for 30 sec - exiting 11:18:46 (6048): No heartbeat from core client for 30 sec - exiting 11:19:22 (6048): No heartbeat from core client for 30 sec - exiting 11:19:23 (6048): No heartbeat from core client for 30 sec - exiting 11:19:24 (6048): No heartbeat from core client for 30 sec - exiting 11:19:25 (6048): No heartbeat from core client for 30 sec - exiting 11:19:26 (6048): No heartbeat from core client for 30 sec - exiting 11:19:27 (6048): No heartbeat from core client for 30 sec - exiting 11:19:28 (6048): No heartbeat from core client for 30 sec - exiting 11:19:29 (6048): No heartbeat from core client for 30 sec - exiting 11:19:30 (6048): No heartbeat from core client for 30 sec - exiting 11:19:31 (6048): No heartbeat from core client for 30 sec - exiting 11:19:32 (6048): No heartbeat from core client for 30 sec - exiting 11:19:34 (6048): No heartbeat from core client for 30 sec - exiting 11:19:35 (6048): No heartbeat from core client for 30 sec - exiting 11:19:36 (6048): No heartbeat from core client for 30 sec - exiting 11:19:37 (6048): No heartbeat from core client for 30 sec - exiting 11:19:38 (6048): No heartbeat from core client for 30 sec - exiting 11:19:39 (6048): No heartbeat from core client for 30 sec - exiting 11:19:40 (6048): No heartbeat from core client for 30 sec - exiting 11:19:41 (6048): No heartbeat from core client for 30 sec - exiting 11:19:42 (6048): No heartbeat from core client for 30 sec - exiting 11:19:43 (6048): No heartbeat from core client for 30 sec - exiting 11:19:44 (6048): No heartbeat from core client for 30 sec - exiting 11:19:46 (6048): No heartbeat from core client for 30 sec - exiting 11:19:47 (6048): No heartbeat from core client for 30 sec - exiting 11:19:48 (6048): No heartbeat from core client for 30 sec - exiting 11:19:49 (6048): No heartbeat from core client for 30 sec - exiting 11:19:50 (6048): No heartbeat from core client for 30 sec - exiting 11:19:51 (6048): No heartbeat from core client for 30 sec - exiting 11:19:52 (6048): No heartbeat from core client for 30 sec - exiting 11:19:53 (6048): No heartbeat from core client for 30 sec - exiting 11:19:54 (6048): No heartbeat from core client for 30 sec - exiting 11:19:55 (6048): No heartbeat from core client for 30 sec - exiting 11:19:57 (6048): No heartbeat from core client for 30 sec - exiting 11:19:58 (6048): No heartbeat from core client for 30 sec - exiting 11:19:59 (6048): No heartbeat from core client for 30 sec - exiting 11:20:00 (6048): No heartbeat from core client for 30 sec - exiting 11:20:01 (6048): No heartbeat from core client for 30 sec - exiting 11:20:02 (6048): No heartbeat from core client for 30 sec - exiting 11:20:03 (6048): No heartbeat from core client for 30 sec - exiting 11:20:04 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:05 (6048): No heartbeat from core client for 30 sec - exiting 11:29:33 (5532): No heartbeat from core client for 30 sec - exiting 11:29:35 (5532): No heartbeat from core client for 30 sec - exiting 11:29:36 (5532): No heartbeat from core client for 30 sec - exiting 11:29:37 (5532): No heartbeat from core client for 30 sec - exiting 11:29:38 (5532): No heartbeat from core client for 30 sec - exiting 11:29:39 (5532): No heartbeat from core client for 30 sec - exiting 11:29:41 (5532): No heartbeat from core client for 30 sec - exiting 11:29:42 (5532): No heartbeat from core client for 30 sec - exiting 11:29:43 (5532): No heartbeat from core client for 30 sec - exiting 11:29:44 (5532): No heartbeat from core client for 30 sec - exiting 11:30:18 (5532): No heartbeat from core client for 30 sec - exiting 11:31:25 (5532): No heartbeat from core client for 30 sec - exiting 11:31:26 (5532): No heartbeat from core client for 30 sec - exiting 11:31:28 (5532): No heartbeat from core client for 30 sec - exiting 11:31:29 (5532): No heartbeat from core client for 30 sec - exiting 11:31:30 (5532): No heartbeat from core client for 30 sec - exiting 11:31:31 (5532): No heartbeat from core client for 30 sec - exiting 11:31:32 (5532): No heartbeat from core client for 30 sec - exiting 11:31:33 (5532): No heartbeat from core client for 30 sec - exiting 11:31:34 (5532): No heartbeat from core client for 30 sec - exiting 11:31:35 (5532): No heartbeat from core client for 30 sec - exiting 11:31:36 (5532): No heartbeat from core client for 30 sec - exiting 11:31:37 (5532): No heartbeat from core client for 30 sec - exiting 11:31:38 (5532): No heartbeat from core client for 30 sec - exiting 11:31:40 (5532): No heartbeat from core client for 30 sec - exiting 11:31:41 (5532): No heartbeat from core client for 30 sec - exiting 11:31:42 (5532): No heartbeat from core client for 30 sec - exiting 11:31:43 (5532): No heartbeat from core client for 30 sec - exiting 11:31:44 (5532): No heartbeat from core client for 30 sec - exiting 11:31:45 (5532): No heartbeat from core client for 30 sec - exiting 11:31:46 (5532): No heartbeat from core client for 30 sec - exiting 11:31:47 (5532): No heartbeat from core client for 30 sec - exiting 11:31:48 (5532): No heartbeat from core client for 30 sec - exiting 11:31:49 (5532): No heartbeat from core client for 30 sec - exiting 11:31:50 (5532): No heartbeat from core client for 30 sec - exiting 11:31:52 (5532): No heartbeat from core client for 30 sec - exiting 11:31:53 (5532): No heartbeat from core client for 30 sec - exiting 11:31:54 (5532): No heartbeat from core client for 30 sec - exiting 11:31:55 (5532): No heartbeat from core client for 30 sec - exiting 11:31:56 (5532): No heartbeat from core client for 30 sec - exiting 11:31:57 (5532): No heartbeat from core client for 30 sec - exiting 11:31:58 (5532): No heartbeat from core client for 30 sec - exiting 11:31:59 (5532): No heartbeat from core client for 30 sec - exiting 11:32:00 (5532): No heartbeat from core client for 30 sec - exiting 11:32:01 (5532): No heartbeat from core client for 30 sec - exiting 11:32:02 (5532): No heartbeat from core client for 30 sec - exiting 11:32:04 (5532): No heartbeat from core client for 30 sec - exiting 11:32:05 (5532): No heartbeat from core client for 30 sec - exiting 11:32:06 (5532): No heartbeat from core client for 30 sec - exiting 11:32:07 (5532): No heartbeat from core client for 30 sec - exiting 11:32:08 (5532): No heartbeat from core client for 30 sec - exiting 11:32:09 (5532): No heartbeat from core client for 30 sec - exiting 11:32:10 (5532): No heartbeat from core client for 30 sec - exiting 11:32:11 (5532): No heartbeat from core client for 30 sec - exiting 11:32:12 (5532): No heartbeat from core client for 30 sec - exiting 11:32:13 (5532): No heartbeat from core client for 30 sec - exiting 11:32:14 (5532): No heartbeat from core client for 30 sec - exiting 11:32:16 (5532): No heartbeat from core client for 30 sec - exiting 11:32:17 (5532): No heartbeat from core client for 30 sec - exiting 11:32:18 (5532): No heartbeat from core client for 30 sec - exiting 11:32:19 (5532): No heartbeat from core client for 30 sec - exiting 11:32:20 (5532): No heartbeat from core client for 30 sec - exiting 11:32:21 (5532): No heartbeat from core client for 30 sec - exiting 11:32:22 (5532): No heartbeat from core client for 30 sec - exiting 11:32:23 (5532): No heartbeat from core client for 30 sec - exiting 11:32:24 (5532): No heartbeat from core client for 30 sec - exiting 11:32:25 (5532): No heartbeat from core client for 30 sec - exiting 11:32:27 (5532): No heartbeat from core client for 30 sec - exiting 11:32:28 (5532): No heartbeat from core client for 30 sec - exiting 11:32:29 (5532): No heartbeat from core client for 30 sec - exiting 11:32:30 (5532): No heartbeat from core client for 30 sec - exiting 11:32:31 (5532): No heartbeat from core client for 30 sec - exiting 11:32:32 (5532): No heartbeat from core client for 30 sec - exiting 11:32:33 (5532): No heartbeat from core client for 30 sec - exiting 11:32:34 (5532): No heartbeat from core client for 30 sec - exiting 11:32:35 (5532): No heartbeat from core client for 30 sec - exiting 11:32:36 (5532): No heartbeat from core client for 30 sec - exiting 11:32:37 (5532): No heartbeat from core client for 30 sec - exiting 11:32:39 (5532): No heartbeat from core client for 30 sec - exiting 11:32:40 (5532): No heartbeat from core client for 30 sec - exiting 11:32:41 (5532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... forrtl: severe (24): end-of-file during read, unit 9, file D:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_saf_7g0r_2005_1_007577700\tmp\xaakm.namelists Image PC Routine Line Source hadam3p_saf_um_6. 0152A39A Unknown Unknown Unknown hadam3p_saf_um_6. 014D2CD0 Unknown Unknown Unknown hadam3p_saf_um_6. 014D1E9A Unknown Unknown Unknown hadam3p_saf_um_6. 014B2819 Unknown Unknown Unknown hadam3p_saf_um_6. 013B2287 Unknown Unknown Unknown hadam3p_saf_um_6. 0144E7B2 Unknown Unknown Unknown hadam3p_saf_um_6. 0144F2DA Unknown Unknown Unknown hadam3p_saf_um_6. 011C9BD2 Unknown Unknown Unknown hadam3p_saf_um_6. 0150E638 Unknown Unknown Unknown kernel32.dll 771F339A Unknown Unknown Unknown ntdll.dll 779F9ED2 Unknown Unknown Unknown ntdll.dll 779F9EA5 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file D:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_saf_7g0r_2005_1_007577700\tmp\xaakg.namelists Image PC Routine Line Source hadrm3p_saf_um_6. 0054C52A Unknown Unknown Unknown hadrm3p_saf_um_6. 004F4460 Unknown Unknown Unknown hadrm3p_saf_um_6. 004F362A Unknown Unknown Unknown hadrm3p_saf_um_6. 004D2469 Unknown Unknown Unknown hadrm3p_saf_um_6. 003D66EB Unknown Unknown Unknown hadrm3p_saf_um_6. 00472AE2 Unknown Unknown Unknown hadrm3p_saf_um_6. 004735AF Unknown Unknown Unknown hadrm3p_saf_um_6. 00219860 Unknown Unknown Unknown hadrm3p_saf_um_6. 00530893 Unknown Unknown Unknown kernel32.dll 771F339A Unknown Unknown Unknown ntdll.dll 779F9ED2 Unknown Unknown Unknown ntdll.dll 779F9EA5 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10988, selfPID=10496, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_7g0r_2005_1_007577700_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7g0r_2005_1_007577700_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7g0r_2005_1_007577700_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_7g0r_2005_1_007577700_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2011 07:59:33	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	92,256	373,366	4.0471
27 Dec 2011 16:49:18	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	80,736	321,845	3.9864
27 Dec 2011 01:40:47	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	69,216	266,100	3.8445
26 Dec 2011 08:25:02	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	57,696	211,330	3.6628
25 Dec 2011 17:23:26	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	46,176	155,515	3.3679
25 Dec 2011 03:07:31	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	34,656	108,948	3.1437
24 Dec 2011 08:19:52	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	23,136	66,088	2.8565
22 Dec 2011 04:37:11	1184704	13772211	hadam3p_saf_7g0r_2005_1_007577700_1	11,616	26,595	2.2895