Task 13608025

Name	hadcm3n_o5x1_1980_40_007539106_1
Workunit	7736338
Created	5 Nov 2011, 23:55:01 UTC
Sent	7 Nov 2011, 3:10:43 UTC
Report deadline	6 Feb 2012, 10:37:54 UTC
Received	17 Dec 2011, 6:11:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	962013
Run time	14 days 14 hours 22 min 9 sec
CPU time	13 days 0 hours 4 min 6 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	2.78 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> Das Laufwerk kann einen bestimmten Bereich oder eine bestimmte Spur nicht finden. (0x19) - exit code 25 (0x19) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:46:17 (6964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:39:18 (6636): No heartbeat from core client for 30 sec - exiting 21:39:19 (6636): No heartbeat from core client for 30 sec - exiting 21:39:20 (6636): No heartbeat from core client for 30 sec - exiting 21:39:21 (6636): No heartbeat from core client for 30 sec - exiting 21:39:22 (6636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:56:43 (6676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3116, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 23:19:50 (3116): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:09:10 (9464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:40:22 (7312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:41:30 (7312): No heartbeat from core client for 30 sec - exiting 13:41:32 (7312): No heartbeat from core client for 30 sec - exiting 13:41:33 (7312): No heartbeat from core client for 30 sec - exiting 13:41:34 (7312): No heartbeat from core client for 30 sec - exiting 13:52:47 (6296): No heartbeat from core client for 30 sec - exiting 13:52:48 (6296): No heartbeat from core client for 30 sec - exiting 13:52:49 (6296): No heartbeat from core client for 30 sec - exiting 13:52:50 (6296): No heartbeat from core client for 30 sec - exiting 13:52:51 (6296): No heartbeat from core client for 30 sec - exiting 13:52:52 (6296): No heartbeat from core client for 30 sec - exiting 13:52:53 (6296): No heartbeat from core client for 30 sec - exiting 13:52:54 (6296): No heartbeat from core client for 30 sec - exiting 13:52:55 (6296): No heartbeat from core client for 30 sec - exiting 13:52:56 (6296): No heartbeat from core client for 30 sec - exiting 13:52:57 (6296): No heartbeat from core client for 30 sec - exiting 13:52:58 (6296): No heartbeat from core client for 30 sec - exiting 13:52:59 (6296): No heartbeat from core client for 30 sec - exiting 13:53:00 (6296): No heartbeat from core client for 30 sec - exiting 13:53:01 (6296): No heartbeat from core client for 30 sec - exiting 13:53:02 (6296): No heartbeat from core client for 30 sec - exiting 13:53:03 (6296): No heartbeat from core client for 30 sec - exiting 13:53:04 (6296): No heartbeat from core client for 30 sec - exiting 13:53:05 (6296): No heartbeat from core client for 30 sec - exiting 13:53:06 (6296): No heartbeat from core client for 30 sec - exiting 13:53:07 (6296): No heartbeat from core client for 30 sec - exiting 13:53:08 (6296): No heartbeat from core client for 30 sec - exiting 13:53:09 (6296): No heartbeat from core client for 30 sec - exiting 13:53:10 (6296): No heartbeat from core client for 30 sec - exiting 13:53:11 (6296): No heartbeat from core client for 30 sec - exiting 13:53:12 (6296): No heartbeat from core client for 30 sec - exiting 13:53:13 (6296): No heartbeat from core client for 30 sec - exiting 13:53:14 (6296): No heartbeat from core client for 30 sec - exiting 13:53:15 (6296): No heartbeat from core client for 30 sec - exiting 13:53:16 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:29:49 (9792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:12:26 (6984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Dec 2011 11:02:03	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	673,920	1,101,991	1.6352
15 Dec 2011 20:36:46	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	648,000	1,072,041	1.6544
15 Dec 2011 11:00:07	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	622,080	1,042,003	1.6750
15 Dec 2011 02:47:45	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	596,160	1,011,933	1.6974
14 Dec 2011 09:22:52	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	570,240	981,806	1.7217
13 Dec 2011 17:38:56	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	544,320	951,934	1.7488
13 Dec 2011 08:50:52	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	518,400	921,902	1.7784
12 Dec 2011 19:29:14	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	492,480	891,918	1.8111
12 Dec 2011 05:32:33	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	466,560	861,907	1.8474
11 Dec 2011 12:07:35	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	440,640	831,513	1.8871
10 Dec 2011 21:28:39	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	414,720	801,708	1.9331
10 Dec 2011 10:41:29	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	388,800	772,393	1.9866
09 Dec 2011 23:08:40	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	362,880	744,458	2.0515
09 Dec 2011 11:58:27	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	336,960	715,112	2.1222
09 Dec 2011 03:16:23	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	311,040	685,813	2.2049
08 Dec 2011 12:59:15	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	285,120	655,973	2.3007
08 Dec 2011 03:51:39	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	259,200	626,479	2.4170
07 Dec 2011 13:23:24	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	233,280	597,023	2.5593
07 Dec 2011 03:39:13	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	207,360	567,693	2.7377
16 Nov 2011 00:31:14	962013	13608025	hadcm3n_o5x1_1980_40_007539106_1	181,440	258,266	1.4234