Task 13771896

Name	hadam3p_eu_6p38_2007_1_007499785_2
Workunit	7697260
Created	13 Dec 2011, 2:11:27 UTC
Sent	13 Dec 2011, 2:32:31 UTC
Report deadline	24 Nov 2012, 7:52:31 UTC
Received	15 Jan 2012, 22:25:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1184704
Run time	9 days 20 hours 13 min 3 sec
CPU time	4 days 8 hours 7 min 57 sec
Validate state	Invalid
Credit	1,790.21
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> 11:34:00 (5396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:42 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:54:51 (5300): No heartbeat from core client for 30 sec - exiting 11:54:55 (5300): No heartbeat from core client for 30 sec - exiting 11:54:56 (5300): No heartbeat from core client for 30 sec - exiting 11:54:57 (5300): No heartbeat from core client for 30 sec - exiting 11:54:58 (5300): No heartbeat from core client for 30 sec - exiting 11:54:59 (5300): No heartbeat from core client for 30 sec - exiting 11:55:00 (5300): No heartbeat from core client for 30 sec - exiting 11:55:01 (5300): No heartbeat from core client for 30 sec - exiting 11:55:02 (5300): No heartbeat from core client for 30 sec - exiting 11:55:36 (5300): No heartbeat from core client for 30 sec - exiting 11:55:37 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8328, selfPID=6828, iMonCtr=1 Model crash detected, will try to restart... 12:21:17 (5380): No heartbeat from core client for 30 sec - exiting 12:21:19 (5380): No heartbeat from core client for 30 sec - exiting 12:21:20 (5380): No heartbeat from core client for 30 sec - exiting 12:21:21 (5380): No heartbeat from core client for 30 sec - exiting 12:21:22 (5380): No heartbeat from core client for 30 sec - exiting 12:21:23 (5380): No heartbeat from core client for 30 sec - exiting 12:21:25 (5380): No heartbeat from core client for 30 sec - exiting 12:21:26 (5380): No heartbeat from core client for 30 sec - exiting 12:21:27 (5380): No heartbeat from core client for 30 sec - exiting 12:21:28 (5380): No heartbeat from core client for 30 sec - exiting 12:21:29 (5380): No heartbeat from core client for 30 sec - exiting 12:21:30 (5380): No heartbeat from core client for 30 sec - exiting 12:22:04 (5380): No heartbeat from core client for 30 sec - exiting 12:22:05 (5380): No heartbeat from core client for 30 sec - exiting 12:22:06 (5380): No heartbeat from core client for 30 sec - exiting 12:22:07 (5380): No heartbeat from core client for 30 sec - exiting 12:22:08 (5380): No heartbeat from core client for 30 sec - exiting 12:22:09 (5380): No heartbeat from core client for 30 sec - exiting 12:22:10 (5380): No heartbeat from core client for 30 sec - exiting 12:22:12 (5380): No heartbeat from core client for 30 sec - exiting 12:22:13 (5380): No heartbeat from core client for 30 sec - exiting 12:22:14 (5380): No heartbeat from core client for 30 sec - exiting 12:22:15 (5380): No heartbeat from core client for 30 sec - exiting 12:22:16 (5380): No heartbeat from core client for 30 sec - exiting 12:22:17 (5380): No heartbeat from core client for 30 sec - exiting 12:22:18 (5380): No heartbeat from core client for 30 sec - exiting 12:22:19 (5380): No heartbeat from core client for 30 sec - exiting 12:22:20 (5380): No heartbeat from core client for 30 sec - exiting 12:22:21 (5380): No heartbeat from core client for 30 sec - exiting 12:22:22 (5380): No heartbeat from core client for 30 sec - exiting 12:22:24 (5380): No heartbeat from core client for 30 sec - exiting 12:22:25 (5380): No heartbeat from core client for 30 sec - exiting 12:22:26 (5380): No heartbeat from core client for 30 sec - exiting 12:22:27 (5380): No heartbeat from core client for 30 sec - exiting 12:22:28 (5380): No heartbeat from core client for 30 sec - exiting 12:22:29 (5380): No heartbeat from core client for 30 sec - exiting 12:22:30 (5380): No heartbeat from core client for 30 sec - exiting 12:22:31 (5380): No heartbeat from core client for 30 sec - exiting 12:22:32 (5380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5856, selfPID=7728, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 12:39:11 (5792): No heartbeat from core client for 30 sec - exiting 12:39:13 (5792): No heartbeat from core client for 30 sec - exiting 12:39:14 (5792): No heartbeat from core client for 30 sec - exiting 12:39:15 (5792): No heartbeat from core client for 30 sec - exiting 12:39:16 (5792): No heartbeat from core client for 30 sec - exiting 12:39:17 (5792): No heartbeat from core client for 30 sec - exiting 12:39:18 (5792): No heartbeat from core client for 30 sec - exiting 12:39:19 (5792): No heartbeat from core client for 30 sec - exiting 12:39:20 (5792): No heartbeat from core client for 30 sec - exiting 12:39:21 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:23 (5792): No heartbeat from core client for 30 sec - exiting 13:06:58 (5592): No heartbeat from core client for 30 sec - exiting 13:06:59 (5592): No heartbeat from core client for 30 sec - exiting 13:07:01 (5592): No heartbeat from core client for 30 sec - exiting 13:07:02 (5592): No heartbeat from core client for 30 sec - exiting 13:07:03 (5592): No heartbeat from core client for 30 sec - exiting 13:07:04 (5592): No heartbeat from core client for 30 sec - exiting 13:07:05 (5592): No heartbeat from core client for 30 sec - exiting 13:07:06 (5592): No heartbeat from core client for 30 sec - exiting 13:07:07 (5592): No heartbeat from core client for 30 sec - exiting 13:07:08 (5592): No heartbeat from core client for 30 sec - exiting 13:07:09 (5592): No heartbeat from core client for 30 sec - exiting 13:07:10 (5592): No heartbeat from core client for 30 sec - exiting 13:07:11 (5592): No heartbeat from core client for 30 sec - exiting 13:07:13 (5592): No heartbeat from core client for 30 sec - exiting 13:07:14 (5592): No heartbeat from core client for 30 sec - exiting 13:07:15 (5592): No heartbeat from core client for 30 sec - exiting 13:07:16 (5592): No heartbeat from core client for 30 sec - exiting 13:07:17 (5592): No heartbeat from core client for 30 sec - exiting 13:07:18 (5592): No heartbeat from core client for 30 sec - exiting 13:07:19 (5592): No heartbeat from core client for 30 sec - exiting 13:07:20 (5592): No heartbeat from core client for 30 sec - exiting 13:07:21 (5592): No heartbeat from core client for 30 sec - exiting 13:07:22 (5592): No heartbeat from core client for 30 sec - exiting 13:07:23 (5592): No heartbeat from core client for 30 sec - exiting 13:07:25 (5592): No heartbeat from core client for 30 sec - exiting 13:07:26 (5592): No heartbeat from core client for 30 sec - exiting 13:07:27 (5592): No heartbeat from core client for 30 sec - exiting 13:07:28 (5592): No heartbeat from core client for 30 sec - exiting 13:07:29 (5592): No heartbeat from core client for 30 sec - exiting 13:07:30 (5592): No heartbeat from core client for 30 sec - exiting 13:07:31 (5592): No heartbeat from core client for 30 sec - exiting 13:07:32 (5592): No heartbeat from core client for 30 sec - exiting 13:07:33 (5592): No heartbeat from core client for 30 sec - exiting 13:07:34 (5592): No heartbeat from core client for 30 sec - exiting 13:07:35 (5592): No heartbeat from core client for 30 sec - exiting 13:07:37 (5592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:10 (5592): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7068, selfPID=6900, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish 14:06:34 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10676, selfPID=11220, iMonCtr=1 Model crash detected, will try to restart... 14:18:58 (5336): No heartbeat from core client for 30 sec - exiting 14:19:00 (5336): No heartbeat from core client for 30 sec - exiting 14:19:01 (5336): No heartbeat from core client for 30 sec - exiting 14:19:02 (5336): No heartbeat from core client for 30 sec - exiting 14:19:03 (5336): No heartbeat from core client for 30 sec - exiting 14:19:04 (5336): No heartbeat from core client for 30 sec - exiting 14:19:05 (5336): No heartbeat from core client for 30 sec - exiting 14:19:06 (5336): No heartbeat from core client for 30 sec - exiting 14:19:07 (5336): No heartbeat from core client for 30 sec - exiting 14:19:08 (5336): No heartbeat from core client for 30 sec - exiting 14:19:10 (5336): No heartbeat from core client for 30 sec - exiting 14:19:11 (5336): No heartbeat from core client for 30 sec - exiting 14:19:13 (5336): No heartbeat from core client for 30 sec - exiting 14:19:14 (5336): No heartbeat from core client for 30 sec - exiting 14:19:15 (5336): No heartbeat from core client for 30 sec - exiting 14:19:16 (5336): No heartbeat from core client for 30 sec - exiting 14:19:17 (5336): No heartbeat from core client for 30 sec - exiting 14:19:18 (5336): No heartbeat from core client for 30 sec - exiting 14:19:19 (5336): No heartbeat from core client for 30 sec - exiting 14:19:20 (5336): No heartbeat from core client for 30 sec - exiting 14:19:21 (5336): No heartbeat from core client for 30 sec - exiting 14:19:22 (5336): No heartbeat from core client for 30 sec - exiting 14:19:23 (5336): No heartbeat from core client for 30 sec - exiting 14:19:25 (5336): No heartbeat from core client for 30 sec - exiting 14:19:26 (5336): No heartbeat from core client for 30 sec - exiting 14:19:27 (5336): No heartbeat from core client for 30 sec - exiting 14:19:28 (5336): No heartbeat from core client for 30 sec - exiting 14:19:29 (5336): No heartbeat from core client for 30 sec - exiting 14:19:30 (5336): No heartbeat from core client for 30 sec - exiting 14:19:31 (5336): No heartbeat from core client for 30 sec - exiting 14:19:32 (5336): No heartbeat from core client for 30 sec - exiting 14:19:33 (5336): No heartbeat from core client for 30 sec - exiting 14:19:34 (5336): No heartbeat from core client for 30 sec - exiting 14:19:35 (5336): No heartbeat from core client for 30 sec - exiting 14:19:37 (5336): No heartbeat from core client for 30 sec - exiting 14:19:38 (5336): No heartbeat from core client for 30 sec - exiting 14:19:39 (5336): No heartbeat from core client for 30 sec - exiting 14:19:40 (5336): No heartbeat from core client for 30 sec - exiting 14:19:41 (5336): No heartbeat from core client for 30 sec - exiting 14:19:42 (5336): No heartbeat from core client for 30 sec - exiting 14:19:43 (5336): No heartbeat from core client for 30 sec - exiting 14:19:44 (5336): No heartbeat from core client for 30 sec - exiting 14:19:45 (5336): No heartbeat from core client for 30 sec - exiting 14:19:46 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7288, selfPID=7264, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8280, selfPID=5332, iMonCtr=1 Model crash detected, will try to restart... 15:14:00 (4536): No heartbeat from core client for 30 sec - exiting 15:14:02 (4536): No heartbeat from core client for 30 sec - exiting 15:14:03 (4536): No heartbeat from core client for 30 sec - exiting 15:14:04 (4536): No heartbeat from core client for 30 sec - exiting 15:14:06 (4536): No heartbeat from core client for 30 sec - exiting 15:14:07 (4536): No heartbeat from core client for 30 sec - exiting 15:14:08 (4536): No heartbeat from core client for 30 sec - exiting 15:14:09 (4536): No heartbeat from core client for 30 sec - exiting 15:14:10 (4536): No heartbeat from core client for 30 sec - exiting 15:14:11 (4536): No heartbeat from core client for 30 sec - exiting 15:14:12 (4536): No heartbeat from core client for 30 sec - exiting 15:14:13 (4536): No heartbeat from core client for 30 sec - exiting 15:14:14 (4536): No heartbeat from core client for 30 sec - exiting 15:14:15 (4536): No heartbeat from core client for 30 sec - exiting 15:14:17 (4536): No heartbeat from core client for 30 sec - exiting 15:14:18 (4536): No heartbeat from core client for 30 sec - exiting 15:14:19 (4536): No heartbeat from core client for 30 sec - exiting 15:14:20 (4536): No heartbeat from core client for 30 sec - exiting 15:14:21 (4536): No heartbeat from core client for 30 sec - exiting 15:14:22 (4536): No heartbeat from core client for 30 sec - exiting 15:14:23 (4536): No heartbeat from core client for 30 sec - exiting 15:14:24 (4536): No heartbeat from core client for 30 sec - exiting 15:14:25 (4536): No heartbeat from core client for 30 sec - exiting 15:14:26 (4536): No heartbeat from core client for 30 sec - exiting 15:14:27 (4536): No heartbeat from core client for 30 sec - exiting 15:14:29 (4536): No heartbeat from core client for 30 sec - exiting 15:14:30 (4536): No heartbeat from core client for 30 sec - exiting 15:14:31 (4536): No heartbeat from core client for 30 sec - exiting 15:14:32 (4536): No heartbeat from core client for 30 sec - exiting 15:14:33 (4536): No heartbeat from core client for 30 sec - exiting 15:14:34 (4536): No heartbeat from core client for 30 sec - exiting 15:14:35 (4536): No heartbeat from core client for 30 sec - exiting 15:14:36 (4536): No heartbeat from core client for 30 sec - exiting 15:14:37 (4536): No heartbeat from core client for 30 sec - exiting 15:14:38 (4536): No heartbeat from core client for 30 sec - exiting 15:14:39 (4536): No heartbeat from core client for 30 sec - exiting 15:14:41 (4536): No heartbeat from core client for 30 sec - exiting 15:14:42 (4536): No heartbeat from core client for 30 sec - exiting 15:14:43 (4536): No heartbeat from core client for 30 sec - exiting 15:14:44 (4536): No heartbeat from core client for 30 sec - exiting 15:14:45 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9676, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13348, selfPID=792, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_6p38_2007_1_007499785/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file D:\ProgramData\BOINC/projects/climateprediction.net/hadam3p_eu_6p38_2007_1_007499785/dataout/region_restart.day after 11 attempts Model Mrdsheel crasheSd: READHIST: Enin f Eile in READ from historor namelist NLIHlisO NLIHIST t mp/x aak pe du x k .pip d m y 2048 2048 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_6p38_2007_1_007499785_2_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6p38_2007_1_007499785_2_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_6p38_2007_1_007499785_2_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2011 17:06:52	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	103,776	428,112	4.1253
28 Dec 2011 02:58:34	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	92,256	380,157	4.1207
27 Dec 2011 12:48:26	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	80,736	329,280	4.0785
26 Dec 2011 20:34:03	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	69,216	273,845	3.9564
26 Dec 2011 05:24:31	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	57,696	218,762	3.7916
25 Dec 2011 13:14:48	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	46,176	162,682	3.5231
25 Dec 2011 01:01:56	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	34,656	117,008	3.3763
24 Dec 2011 06:19:31	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	23,136	73,786	3.1892
23 Dec 2011 05:00:21	1184704	13771896	hadam3p_eu_6p38_2007_1_007499785_2	11,616	35,356	3.0437