Task 15958430

Name	hadcm3n_7b6z_1980_40_008425790_0
Workunit	8576646
Created	30 Aug 2013, 0:26:00 UTC
Sent	30 Aug 2013, 0:27:34 UTC
Report deadline	29 Nov 2013, 7:54:45 UTC
Received	30 Nov 2013, 2:22:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1141169
Run time	37 days 23 hours 28 min 2 sec
CPU time	29 days 10 hours 29 min 44 sec
Validate state	Invalid
Credit	9,642.24
Device peak FLOPS	1.77 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> 07:59:07 (4720): No heartbeat from core client for 30 sec - exiting 07:59:08 (4720): No heartbeat from core client for 30 sec - exiting 07:59:09 (4720): No heartbeat from core client for 30 sec - exiting 07:59:10 (4720): No heartbeat from core client for 30 sec - exiting 07:59:11 (4720): No heartbeat from core client for 30 sec - exiting 07:59:12 (4720): No heartbeat from core client for 30 sec - exiting 07:59:13 (4720): No heartbeat from core client for 30 sec - exiting 07:59:15 (4720): No heartbeat from core client for 30 sec - exiting 07:59:16 (4720): No heartbeat from core client for 30 sec - exiting 07:59:17 (4720): No heartbeat from core client for 30 sec - exiting 07:59:18 (4720): No heartbeat from core client for 30 sec - exiting 07:59:19 (4720): No heartbeat from core client for 30 sec - exiting 07:59:20 (4720): No heartbeat from core client for 30 sec - exiting 07:59:21 (4720): No heartbeat from core client for 30 sec - exiting 07:59:22 (4720): No heartbeat from core client for 30 sec - exiting 07:59:23 (4720): No heartbeat from core client for 30 sec - exiting 07:59:24 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:26 (4720): No heartbeat from core client for 30 sec - exiting 07:40:08 (5352): No heartbeat from core client for 30 sec - exiting 07:40:09 (5352): No heartbeat from core client for 30 sec - exiting 07:40:13 (5352): No heartbeat from core client for 30 sec - exiting 07:40:14 (5352): No heartbeat from core client for 30 sec - exiting 07:40:15 (5352): No heartbeat from core client for 30 sec - exiting 07:40:16 (5352): No heartbeat from core client for 30 sec - exiting 07:40:17 (5352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:09:46 (4164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5492, iMonCtr=1 Model crash detected, will try to restart... 09:16:32 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6052, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:02:21 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:51:06 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:37:47 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:47:31 (27808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:33 (27808): No heartbeat from core client for 30 sec - exiting 17:47:34 (27808): No heartbeat from core client for 30 sec - exiting 17:47:35 (27808): No heartbeat from core client for 30 sec - exiting 17:49:17 (22156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:01:20 (12884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:01:22 (12884): No heartbeat from core client for 30 sec - exiting 09:01:23 (12884): No heartbeat from core client for 30 sec - exiting 09:01:24 (12884): No heartbeat from core client for 30 sec - exiting 09:01:25 (12884): No heartbeat from core client for 30 sec - exiting 09:01:26 (12884): No heartbeat from core client for 30 sec - exiting 12:19:52 (6064): No heartbeat from core client for 30 sec - exiting 12:19:53 (6064): No heartbeat from core client for 30 sec - exiting 12:19:55 (6064): No heartbeat from core client for 30 sec - exiting 12:19:56 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:59 (6064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:20:36 (2864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:26 (13204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:50:05 (12092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:46:51 (4196): No heartbeat from core client for 30 sec - exiting 22:46:53 (4196): No heartbeat from core client for 30 sec - exiting 22:46:54 (4196): No heartbeat from core client for 30 sec - exiting 22:46:55 (4196): No heartbeat from core client for 30 sec - exiting 22:46:56 (4196): No heartbeat from core client for 30 sec - exiting 22:46:57 (4196): No heartbeat from core client for 30 sec - exiting 22:46:58 (4196): No heartbeat from core client for 30 sec - exiting 22:46:59 (4196): No heartbeat from core client for 30 sec - exiting 22:47:00 (4196): No heartbeat from core client for 30 sec - exiting 22:47:01 (4196): No heartbeat from core client for 30 sec - exiting 22:47:02 (4196): No heartbeat from core client for 30 sec - exiting 22:47:03 (4196): No heartbeat from core client for 30 sec - exiting 22:47:05 (4196): No heartbeat from core client for 30 sec - exiting 22:47:06 (4196): No heartbeat from core client for 30 sec - exiting 22:47:07 (4196): No heartbeat from core client for 30 sec - exiting 22:47:08 (4196): No heartbeat from core client for 30 sec - exiting 22:47:09 (4196): No heartbeat from core client for 30 sec - exiting 22:47:10 (4196): No heartbeat from core client for 30 sec - exiting 22:47:11 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:25:59 (4528): No heartbeat from core client for 30 sec - exiting 18:26:01 (4528): No heartbeat from core client for 30 sec - exiting 18:26:02 (4528): No heartbeat from core client for 30 sec - exiting 18:26:03 (4528): No heartbeat from core client for 30 sec - exiting 18:26:04 (4528): No heartbeat from core client for 30 sec - exiting 18:26:05 (4528): No heartbeat from core client for 30 sec - exiting 18:26:06 (4528): No heartbeat from core client for 30 sec - exiting 18:26:07 (4528): No heartbeat from core client for 30 sec - exiting 18:26:08 (4528): No heartbeat from core client for 30 sec - exiting 18:26:09 (4528): No heartbeat from core client for 30 sec - exiting 18:26:10 (4528): No heartbeat from core client for 30 sec - exiting 18:26:11 (4528): No heartbeat from core client for 30 sec - exiting 18:26:13 (4528): No heartbeat from core client for 30 sec - exiting 18:26:14 (4528): No heartbeat from core client for 30 sec - exiting 18:26:15 (4528): No heartbeat from core client for 30 sec - exiting 18:26:16 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Nov 2013 01:32:45	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	803,520	2,535,949	3.1560
21 Nov 2013 01:11:27	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	777,600	2,464,069	3.1688
17 Nov 2013 05:07:48	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	751,680	2,394,121	3.1850
10 Nov 2013 23:49:29	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	725,760	2,323,028	3.2008
06 Nov 2013 23:52:48	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	699,840	2,252,777	3.2190
28 Oct 2013 19:10:36	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	673,920	2,183,353	3.2398
27 Oct 2013 23:24:56	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	648,000	2,113,966	3.2623
27 Oct 2013 03:41:29	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	622,080	2,044,750	3.2870
26 Oct 2013 08:16:57	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	596,160	1,976,335	3.3151
25 Oct 2013 12:30:36	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	570,240	1,906,885	3.3440
24 Oct 2013 16:49:00	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	544,320	1,837,687	3.3761
23 Oct 2013 21:07:28	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	518,400	1,768,835	3.4121
23 Oct 2013 01:18:31	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	492,480	1,699,670	3.4512
21 Oct 2013 23:54:06	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	466,560	1,622,949	3.4785
20 Oct 2013 20:08:44	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	440,640	1,539,717	3.4943
16 Oct 2013 18:16:24	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	414,720	1,466,061	3.5351
11 Oct 2013 01:51:35	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	388,800	1,390,653	3.5768
05 Oct 2013 04:22:13	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	362,880	1,280,825	3.5296
02 Oct 2013 03:26:34	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	336,960	1,177,945	3.4958
27 Sep 2013 07:11:35	1141169	15958430	hadcm3n_7b6z_1980_40_008425790_0	311,040	1,047,516	3.3678