Task 13418960

Name	hadcm3n_ydzn_1940_40_007424314_2
Workunit	7621949
Created	25 Sep 2011, 0:28:47 UTC
Sent	25 Sep 2011, 0:32:03 UTC
Report deadline	25 Dec 2011, 7:59:14 UTC
Received	27 Oct 2011, 8:34:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1127806
Run time	10 days 8 hours 38 min 55 sec
CPU time	8 days 11 hours 33 min 37 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The drive cannot locate a specific area or track on the disk. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:19:42 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:49:19 (6924): No heartbeat from core client for 30 sec - exiting 12:49:20 (6924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 14:35:03 (864): No heartbeat from core client for 30 sec - exiting 14:35:04 (864): No heartbeat from core client for 30 sec - exiting 14:35:05 (864): No heartbeat from core client for 30 sec - exiting 14:35:06 (864): No heartbeat from core client for 30 sec - exiting 14:35:07 (864): No heartbeat from core client for 30 sec - exiting 14:35:08 (864): No heartbeat from core client for 30 sec - exiting 14:35:09 (864): No heartbeat from core client for 30 sec - exiting 14:35:10 (864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:28 (6200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:47 (4764): No heartbeat from core client for 30 sec - exiting 18:15:48 (4764): No heartbeat from core client for 30 sec - exiting 18:15:49 (4764): No heartbeat from core client for 30 sec - exiting 18:15:50 (4764): No heartbeat from core client for 30 sec - exiting 18:15:51 (4764): No heartbeat from core client for 30 sec - exiting 18:15:52 (4764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:51:09 (5400): No heartbeat from core client for 30 sec - exiting 20:51:10 (5400): No heartbeat from core client for 30 sec - exiting 20:51:11 (5400): No heartbeat from core client for 30 sec - exiting 20:51:12 (5400): No heartbeat from core client for 30 sec - exiting 20:51:13 (5400): No heartbeat from core client for 30 sec - exiting 20:51:14 (5400): No heartbeat from core client for 30 sec - exiting 20:51:15 (5400): No heartbeat from core client for 30 sec - exiting 20:51:16 (5400): No heartbeat from core client for 30 sec - exiting 20:51:17 (5400): No heartbeat from core client for 30 sec - exiting 20:51:18 (5400): No heartbeat from core client for 30 sec - exiting 20:51:19 (5400): No heartbeat from core client for 30 sec - exiting 20:51:20 (5400): No heartbeat from core client for 30 sec - exiting 20:51:21 (5400): No heartbeat from core client for 30 sec - exiting 20:51:22 (5400): No heartbeat from core client for 30 sec - exiting 20:51:23 (5400): No heartbeat from core client for 30 sec - exiting 20:51:24 (5400): No heartbeat from core client for 30 sec - exiting 20:51:25 (5400): No heartbeat from core client for 30 sec - exiting 20:51:26 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:27 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 12:03:12 (3712): No heartbeat from core client for 30 sec - exiting 12:03:13 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:18:35 (7716): No heartbeat from core client for 30 sec - exiting 15:18:36 (7716): No heartbeat from core client for 30 sec - exiting 15:18:37 (7716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:18:38 (7716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:02:59 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:03:43 (3964): No heartbeat from core client for 30 sec - exiting 18:03:44 (3964): No heartbeat from core client for 30 sec - exiting 18:03:45 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:13:41 (2304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:21 (2204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:26 (4492): No heartbeat from core client for 30 sec - exiting 19:33:27 (4492): No heartbeat from core client for 30 sec - exiting 19:33:28 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:29 (4492): No heartbeat from core client for 30 sec - exiting 19:33:30 (4492): No heartbeat from core client for 30 sec - exiting 19:33:31 (4492): No heartbeat from core client for 30 sec - exiting 19:33:32 (4492): No heartbeat from core client for 30 sec - exiting 19:33:33 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:34:30 (5628): No heartbeat from core client for 30 sec - exiting 13:34:31 (5628): No heartbeat from core client for 30 sec - exiting 13:34:32 (5628): No heartbeat from core client for 30 sec - exiting 13:34:33 (5628): No heartbeat from core client for 30 sec - exiting 13:34:34 (5628): No heartbeat from core client for 30 sec - exiting 13:34:35 (5628): No heartbeat from core client for 30 sec - exiting 13:34:36 (5628): No heartbeat from core client for 30 sec - exiting 13:34:37 (5628): No heartbeat from core client for 30 sec - exiting 13:34:38 (5628): No heartbeat from core client for 30 sec - exiting 13:34:39 (5628): No heartbeat from core client for 30 sec - exiting 13:34:40 (5628): No heartbeat from core client for 30 sec - exiting 13:34:41 (5628): No heartbeat from core client for 30 sec - exiting 13:34:42 (5628): No heartbeat from core client for 30 sec - exiting 13:34:43 (5628): No heartbeat from core client for 30 sec - exiting 13:34:44 (5628): No heartbeat from core client for 30 sec - exiting 13:34:45 (5628): No heartbeat from core client for 30 sec - exiting 13:34:46 (5628): No heartbeat from core client for 30 sec - exiting 13:34:47 (5628): No heartbeat from core client for 30 sec - exiting 13:34:48 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:49 (5628): No heartbeat from core client for 30 sec - exiting 17:31:07 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:50:01 (1032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:20:25 (8476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:33:37 (2328): No heartbeat from core client for 30 sec - exiting 12:33:38 (2328): No heartbeat from core client for 30 sec - exiting 12:33:39 (2328): No heartbeat from core client for 30 sec - exiting 12:33:40 (2328): No heartbeat from core client for 30 sec - exiting 12:33:41 (2328): No heartbeat from core client for 30 sec - exiting 12:33:42 (2328): No heartbeat from core client for 30 sec - exiting 12:33:43 (2328): No heartbeat from core client for 30 sec - exiting 12:33:44 (2328): No heartbeat from core client for 30 sec - exiting 12:33:45 (2328): No heartbeat from core client for 30 sec - exiting 12:33:46 (2328): No heartbeat from core client for 30 sec - exiting 12:33:47 (2328): No heartbeat from core client for 30 sec - exiting 12:33:48 (2328): No heartbeat from core client for 30 sec - exiting 12:33:49 (2328): No heartbeat from core client for 30 sec - exiting 12:33:50 (2328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2992, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:52:02 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 13:34:55	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	259,200	689,016	2.6582
31 Oct 2011 13:34:54	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	233,280	614,698	2.6350
31 Oct 2011 13:34:54	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	207,360	541,097	2.6095
31 Oct 2011 13:34:54	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	181,440	466,848	2.5730
06 Oct 2011 06:35:55	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	155,520	396,838	2.5517
04 Oct 2011 09:52:45	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	129,600	330,405	2.5494
02 Oct 2011 08:05:10	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	103,680	265,129	2.5572
30 Sep 2011 21:42:49	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	77,760	197,806	2.5438
29 Sep 2011 05:14:59	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	51,840	128,516	2.4791
27 Sep 2011 16:45:16	1127806	13418960	hadcm3n_ydzn_1940_40_007424314_2	25,920	62,838	2.4243