Task 16833380

Name	hadam3p_eu_nbki_2013_1_008809490_1
Workunit	8955468
Created	1 Aug 2014, 2:51:41 UTC
Sent	1 Aug 2014, 3:59:50 UTC
Report deadline	14 Jul 2015, 9:19:50 UTC
Received	17 Aug 2014, 5:05:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1310330
Run time	4 days 16 hours 7 min 35 sec
CPU time	3 days 1 hours 28 min 46 sec
Validate state	Invalid
Credit	1,392.75
Device peak FLOPS	1.96 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.4.8</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:40 (5212): No heartbeat from core client for 30 sec - exiting 22:00:41 (5212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2464, selfPID=4144, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=14072, iMonCtr=2 16:00:19 (2200): No heartbeat from core client for 30 sec - exiting 16:00:20 (2200): No heartbeat from core client for 30 sec - exiting 16:00:21 (2200): No heartbeat from core client for 30 sec - exiting 16:00:22 (2200): No heartbeat from core client for 30 sec - exiting 16:00:23 (2200): No heartbeat from core client for 30 sec - exiting 16:00:24 (2200): No heartbeat from core client for 30 sec - exiting 16:00:25 (2200): No heartbeat from core client for 30 sec - exiting 16:00:27 (2200): No heartbeat from core client for 30 sec - exiting 16:00:28 (2200): No heartbeat from core client for 30 sec - exiting 16:00:29 (2200): No heartbeat from core client for 30 sec - exiting 16:00:30 (2200): No heartbeat from core client for 30 sec - exiting 16:00:31 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4952, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5108, selfPID=5108, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4064, selfPID=4064, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1716, selfPID=1716, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8784, selfPID=8784, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:32:07 (5144): No heartbeat from core client for 30 sec - exiting 09:32:08 (5144): No heartbeat from core client for 30 sec - exiting 09:32:09 (5144): No heartbeat from core client for 30 sec - exiting 09:32:10 (5144): No heartbeat from core client for 30 sec - exiting 09:32:11 (5144): No heartbeat from core client for 30 sec - exiting 09:32:12 (5144): No heartbeat from core client for 30 sec - exiting 09:32:14 (5144): No heartbeat from core client for 30 sec - exiting 09:32:15 (5144): No heartbeat from core client for 30 sec - exiting 09:32:16 (5144): No heartbeat from core client for 30 sec - exiting 09:32:17 (5144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:32:18 (5144): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=836, iMonCtr=2 Model crash detected, will try to restart... 15:18:25 (5588): No heartbeat from core client for 30 sec - exiting 15:18:27 (5588): No heartbeat from core client for 30 sec - exiting 15:18:28 (5588): No heartbeat from core client for 30 sec - exiting 15:18:29 (5588): No heartbeat from core client for 30 sec - exiting 15:18:30 (5588): No heartbeat from core client for 30 sec - exiting 15:18:31 (5588): No heartbeat from core client for 30 sec - exiting 15:18:32 (5588): No heartbeat from core client for 30 sec - exiting 15:18:33 (5588): No heartbeat from core client for 30 sec - exiting 15:18:34 (5588): No heartbeat from core client for 30 sec - exiting 15:18:35 (5588): No heartbeat from core client for 30 sec - exiting 15:18:36 (5588): No heartbeat from core client for 30 sec - exiting 15:18:38 (5588): No heartbeat from core client for 30 sec - exiting 15:18:39 (5588): No heartbeat from core client for 30 sec - exiting 15:18:40 (5588): No heartbeat from core client for 30 sec - exiting 15:18:41 (5588): No heartbeat from core client for 30 sec - exiting 15:18:42 (5588): No heartbeat from core client for 30 sec - exiting 15:18:43 (5588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:19 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:43 (4984): No heartbeat from core client for 30 sec - exiting 06:32:44 (4984): No heartbeat from core client for 30 sec - exiting 06:32:45 (4984): No heartbeat from core client for 30 sec - exiting 06:32:46 (4984): No heartbeat from core client for 30 sec - exiting 06:32:48 (4984): No heartbeat from core client for 30 sec - exiting 06:32:49 (4984): No heartbeat from core client for 30 sec - exiting 06:32:50 (4984): No heartbeat from core client for 30 sec - exiting 06:32:51 (4984): No heartbeat from core client for 30 sec - exiting 06:32:52 (4984): No heartbeat from core client for 30 sec - exiting 06:32:53 (4984): No heartbeat from core client for 30 sec - exiting 06:32:54 (4984): No heartbeat from core client for 30 sec - exiting 06:32:55 (4984): No heartbeat from core client for 30 sec - exiting 06:32:56 (4984): No heartbeat from core client for 30 sec - exiting 06:32:57 (4984): No heartbeat from core client for 30 sec - exiting 06:32:59 (4984): No heartbeat from core client for 30 sec - exiting 06:33:00 (4984): No heartbeat from core client for 30 sec - exiting 06:33:01 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:10 (3900): No heartbeat from core client for 30 sec - exiting 12:32:11 (3900): No heartbeat from core client for 30 sec - exiting 12:32:12 (3900): No heartbeat from core client for 30 sec - exiting 12:32:13 (3900): No heartbeat from core client for 30 sec - exiting 12:32:14 (3900): No heartbeat from core client for 30 sec - exiting 12:32:16 (3900): No heartbeat from core client for 30 sec - exiting 12:32:17 (3900): No heartbeat from core client for 30 sec - exiting 12:32:18 (3900): No heartbeat from core client for 30 sec - exiting 12:32:19 (3900): No heartbeat from core client for 30 sec - exiting 12:32:20 (3900): No heartbeat from core client for 30 sec - exiting 12:32:21 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:22 (3900): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4056, selfPID=4548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4488, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3260, selfPID=3784, iMonCtr=1 Model crash detected, will try to restart... 18:41:05 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:23 (672): No heartbeat from core client for 30 sec - exiting 22:55:24 (672): No heartbeat from core client for 30 sec - exiting 22:55:25 (672): No heartbeat from core client for 30 sec - exiting 22:55:26 (672): No heartbeat from core client for 30 sec - exiting 22:55:27 (672): No heartbeat from core client for 30 sec - exiting 22:55:29 (672): No heartbeat from core client for 30 sec - exiting 22:55:30 (672): No heartbeat from core client for 30 sec - exiting 22:55:31 (672): No heartbeat from core client for 30 sec - exiting 22:55:32 (672): No heartbeat from core client for 30 sec - exiting 22:55:33 (672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:19 (4560): No heartbeat from core client for 30 sec - exiting 12:22:20 (4560): No heartbeat from core client for 30 sec - exiting 12:22:21 (4560): No heartbeat from core client for 30 sec - exiting 12:22:22 (4560): No heartbeat from core client for 30 sec - exiting 12:22:23 (4560): No heartbeat from core client for 30 sec - exiting 12:22:24 (4560): No heartbeat from core client for 30 sec - exiting 12:22:25 (4560): No heartbeat from core client for 30 sec - exiting 12:22:27 (4560): No heartbeat from core client for 30 sec - exiting 12:22:28 (4560): No heartbeat from core client for 30 sec - exiting 12:22:29 (4560): No heartbeat from core client for 30 sec - exiting 12:22:30 (4560): No heartbeat from core client for 30 sec - exiting 12:22:31 (4560): No heartbeat from core client for 30 sec - exiting 12:22:32 (4560): No heartbeat from core client for 30 sec - exiting 12:22:33 (4560): No heartbeat from core client for 30 sec - exiting 12:22:34 (4560): No heartbeat from core client for 30 sec - exiting 12:22:35 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:37 (4560): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6048, iMonCtr=2 Model crash detected, will try to restart... 11:33:34 (4948): No heartbeat from core client for 30 sec - exiting 11:33:35 (4948): No heartbeat from core client for 30 sec - exiting 11:33:36 (4948): No heartbeat from core client for 30 sec - exiting 11:33:37 (4948): No heartbeat from core client for 30 sec - exiting 11:33:38 (4948): No heartbeat from core client for 30 sec - exiting 11:33:39 (4948): No heartbeat from core client for 30 sec - exiting 11:33:40 (4948): No heartbeat from core client for 30 sec - exiting 11:33:41 (4948): No heartbeat from core client for 30 sec - exiting 11:33:42 (4948): No heartbeat from core client for 30 sec - exiting 11:33:43 (4948): No heartbeat from core client for 30 sec - exiting 11:33:44 (4948): No heartbeat from core client for 30 sec - exiting 11:33:45 (4948): No heartbeat from core client for 30 sec - exiting 11:33:46 (4948): No heartbeat from core client for 30 sec - exiting 11:33:47 (4948): No heartbeat from core client for 30 sec - exiting 11:33:48 (4948): No heartbeat from core client for 30 sec - exiting 11:33:49 (4948): No heartbeat from core client for 30 sec - exiting 11:33:51 (4948): No heartbeat from core client for 30 sec - exiting 11:33:52 (4948): No heartbeat from core client for 30 sec - exiting 11:33:53 (4948): No heartbeat from core client for 30 sec - exiting 11:33:54 (4948): No heartbeat from core client for 30 sec - exiting 11:33:55 (4948): No heartbeat from core client for 30 sec - exiting 11:33:56 (4948): No heartbeat from core client for 30 sec - exiting 11:33:57 (4948): No heartbeat from core client for 30 sec - exiting 11:33:58 (4948): No heartbeat from core client for 30 sec - exiting 11:33:59 (4948): No heartbeat from core client for 30 sec - exiting 11:34:00 (4948): No heartbeat from core client for 30 sec - exiting 11:34:01 (4948): No heartbeat from core client for 30 sec - exiting 11:34:02 (4948): No heartbeat from core client for 30 sec - exiting 11:34:03 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1504, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5972, selfPID=5812, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 14:36:20 (5796): No heartbeat from core client for 30 sec - exiting 14:36:21 (5796): No heartbeat from core client for 30 sec - exiting 14:36:22 (5796): No heartbeat from core client for 30 sec - exiting 14:36:23 (5796): No heartbeat from core client for 30 sec - exiting 14:36:24 (5796): No heartbeat from core client for 30 sec - exiting 14:36:26 (5796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:27 (5796): No heartbeat from core client for 30 sec - exiting 19:43:02 (5104): No heartbeat from core client for 30 sec - exiting 19:43:03 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:55 (3764): No heartbeat from core client for 30 sec - exiting 12:32:57 (3764): No heartbeat from core client for 30 sec - exiting 12:32:58 (3764): No heartbeat from core client for 30 sec - exiting 12:32:59 (3764): No heartbeat from core client for 30 sec - exiting 12:33:00 (3764): No heartbeat from core client for 30 sec - exiting 12:33:01 (3764): No heartbeat from core client for 30 sec - exiting 12:33:02 (3764): No heartbeat from core client for 30 sec - exiting 12:33:03 (3764): No heartbeat from core client for 30 sec - exiting 12:33:05 (3764): No heartbeat from core client for 30 sec - exiting 12:33:06 (3764): No heartbeat from core client for 30 sec - exiting 12:33:07 (3764): No heartbeat from core client for 30 sec - exiting 12:33:08 (3764): No heartbeat from core client for 30 sec - exiting 12:33:09 (3764): No heartbeat from core client for 30 sec - exiting 12:33:10 (3764): No heartbeat from core client for 30 sec - exiting 12:33:11 (3764): No heartbeat from core client for 30 sec - exiting 12:33:12 (3764): No heartbeat from core client for 30 sec - exiting 12:33:13 (3764): No heartbeat from core client for 30 sec - exiting 12:33:14 (3764): No heartbeat from core client for 30 sec - exiting 12:33:15 (3764): No heartbeat from core client for 30 sec - exiting 12:33:17 (3764): No heartbeat from core client for 30 sec - exiting 12:33:18 (3764): No heartbeat from core client for 30 sec - exiting 12:33:19 (3764): No heartbeat from core client for 30 sec - exiting 12:33:20 (3764): No heartbeat from core client for 30 sec - exiting 12:33:21 (3764): No heartbeat from core client for 30 sec - exiting 12:33:22 (3764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Colobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3044, iMonCtr=2 ntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=972, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3704, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5172, selfPID=4416, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 17:17:33 (5008): No heartbeat from core client for 30 sec - exiting 17:17:34 (5008): No heartbeat from core client for 30 sec - exiting 17:17:35 (5008): No heartbeat from core client for 30 sec - exiting 17:17:36 (5008): No heartbeat from core client for 30 sec - exiting 17:17:37 (5008): No heartbeat from core client for 30 sec - exiting 17:17:39 (5008): No heartbeat from core client for 30 sec - exiting 17:17:40 (5008): No heartbeat from core client for 30 sec - exiting 17:17:41 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5080, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4476, selfPID=5304, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_nbki_2013_1_008809490/dataout/atmos_restart.day after 11 attempts forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_nbki_2013_1_008809490\tmp\xaakg.namelists Image PC Routine Line Source hadrm3p_eu_um_6.0 0071C52A Unknown Unknown Unknown hadrm3p_eu_um_6.0 006C4460 Unknown Unknown Unknown hadrm3p_eu_um_6.0 006C362A Unknown Unknown Unknown hadrm3p_eu_um_6.0 006A2469 Unknown Unknown Unknown hadrm3p_eu_um_6.0 005A66EB Unknown Unknown Unknown hadrm3p_eu_um_6.0 00642AE2 Unknown Unknown Unknown hadrm3p_eu_um_6.0 006435AF Unknown Unknown Unknown hadrm3p_eu_um_6.0 003E9860 Unknown Unknown Unknown hadrm3p_eu_um_6.0 00700893 Unknown Unknown Unknown kernel32.dll 7725D3C9 Unknown Unknown Unknown ntdll.dll 77331603 Unknown Unknown Unknown ntdll.dll 773315D6 Unknown Unknown Unknown forrtl: severe (24): end-of-file during read, unit 9, file C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_nbki_2013_1_008809490\tmp\xaakm.namelists Image PC Routine Line Source hadam3p_eu_um_6.0 0126A39A Unknown Unknown Unknown hadam3p_eu_um_6.0 01212CD0 Unknown Unknown Unknown hadam3p_eu_um_6.0 01211E9A Unknown Unknown Unknown hadam3p_eu_um_6.0 011F2819 Unknown Unknown Unknown hadam3p_eu_um_6.0 010F2287 Unknown Unknown Unknown hadam3p_eu_um_6.0 0118E7B2 Unknown Unknown Unknown hadam3p_eu_um_6.0 0118F2DA Unknown Unknown Unknown hadam3p_eu_um_6.0 00F09BD2 Unknown Unknown Unknown hadam3p_eu_um_6.0 0124E638 Unknown Unknown Unknown kernel32.dll 7725D3C9 Unknown Unknown Unknown ntdll.dll 77331603 Unknown Unknown Unknown ntdll.dll 773315D6 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2612, selfPID=5836, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_nbki_2013_1_008809490_1_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_nbki_2013_1_008809490_1_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_nbki_2013_1_008809490_1_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_nbki_2013_1_008809490_1_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_nbki_2013_1_008809490_1_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Aug 2014 16:00:36	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	80,736	244,024	3.0225
15 Aug 2014 10:27:30	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	69,216	211,435	3.0547
14 Aug 2014 19:10:38	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	57,717	176,184	3.0525
14 Aug 2014 19:10:38	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	57,696	175,652	3.0444
14 Aug 2014 19:10:38	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	46,176	140,457	3.0418
14 Aug 2014 19:10:38	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	34,656	105,888	3.0554
14 Aug 2014 19:10:38	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	23,136	70,518	3.0480
05 Aug 2014 11:56:45	1310330	16833380	hadam3p_eu_nbki_2013_1_008809490_1	11,616	35,141	3.0252