Task 13100020

Name	hadcm3n_ybqr_1900_40_007348077_0
Workunit	7545507
Created	6 Jul 2011, 13:48:19 UTC
Sent	18 Jul 2011, 13:46:55 UTC
Report deadline	17 Oct 2011, 21:14:06 UTC
Received	17 Oct 2011, 11:41:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	255 (0x000000FF) Unknown error code
Computer ID	1117493
Run time	24 days 16 hours 8 min 50 sec
CPU time	22 days 6 hours 19 min 48 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.34 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The extended attributes are inconsistent. (0xff) - exit code 255 (0xff) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7128, iMonCtr=1 Model crash detected, will try to restart... 12:34:01 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:16:46 (6760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3004, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4680, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5788, iMonCtr=1 Model crash detected, will try to restart... 13:58:43 (5168): Can't acquire lockfile (32) - waiting 35s 13:58:55 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4176, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 12:48:40 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1668, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 12:34:42 (2616): Can't acquire lockfile (32) - waiting 35s 12:35:09 (4580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:09 (8080): Can't acquire lockfile (32) - waiting 35s 12:56:27 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1440, iMonCtr=1 Model crash detected, will try to restart... 21:49:58 (6704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:52:17 (7408): Can't acquire lockfile (32) - waiting 35s 21:52:36 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:31 (3480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:15:21 (3244): Can't acquire lockfile (32) - waiting 35s 21:15:36 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5232, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5212, iMonCtr=1 Model crash detected, will try to restart... 18:51:35 (892): Can't acquire lockfile (32) - waiting 35s 18:51:58 (5232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=892, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5052, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4636, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5104, iMonCtr=1 Model crash detected, will try to restart... 20:56:00 (6768): Can't acquire lockfile (32) - waiting 35s 20:56:18 (6520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:28:09 (932): Can't acquire lockfile (32) - waiting 35s 20:28:25 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5012, iMonCtr=1 Model crash detected, will try to restart... 22:24:07 (576): Can't acquire lockfile (32) - waiting 35s 22:24:19 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:08:16 (1304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:42:40 (5292): Can't acquire lockfile (32) - waiting 35s 08:43:00 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:25 (4512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6140, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3932, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5956, iMonCtr=1 Model crash detected, will try to restart... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6400, iMonCtr=1 Model crash detected, will try to restart... 20:59:03 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:04 (5236): Can't acquire lockfile (32) - waiting 35s 19:14:17 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2728, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 18:32:43 (6628): No heartbeat from core client for 30 sec - exiting 18:32:44 (6628): No heartbeat from core client for 30 sec - exiting 18:32:45 (6628): No heartbeat from core client for 30 sec - exiting 18:33:19 (6628): No heartbeat from core client for 30 sec - exiting 18:33:20 (6628): No heartbeat from core client for 30 sec - exiting 18:33:21 (6628): No heartbeat from core client for 30 sec - exiting 18:33:23 (6628): No heartbeat from core client for 30 sec - exiting 18:33:24 (6628): No heartbeat from core client for 30 sec - exiting 18:33:25 (6628): No heartbeat from core client for 30 sec - exiting 18:33:26 (6628): No heartbeat from core client for 30 sec - exiting 18:33:27 (6628): No heartbeat from core client for 30 sec - exiting 18:33:28 (6628): No heartbeat from core client for 30 sec - exiting 18:33:29 (6628): No heartbeat from core client for 30 sec - exiting 18:33:30 (6628): No heartbeat from core client for 30 sec - exiting 18:33:31 (6628): No heartbeat from core client for 30 sec - exiting 18:33:33 (6628): No heartbeat from core client for 30 sec - exiting 18:33:34 (6628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6624, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6624, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6624, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:05 (7000): No heartbeat from core client for 30 sec - exiting 19:54:06 (7000): No heartbeat from core client for 30 sec - exiting 19:54:07 (7000): No heartbeat from core client for 30 sec - exiting 19:54:08 (7000): No heartbeat from core client for 30 sec - exiting 19:54:09 (7000): No heartbeat from core client for 30 sec - exiting 19:54:10 (7000): No heartbeat from core client for 30 sec - exiting 19:54:11 (7000): No heartbeat from core client for 30 sec - exiting 19:54:12 (7000): No heartbeat from core client for 30 sec - exiting 19:54:13 (7000): No heartbeat from core client for 30 sec - exiting 19:54:14 (7000): No heartbeat from core client for 30 sec - exiting 19:54:15 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:16 (7000): No heartbeat from core client for 30 sec - exiting 12:48:13 (7324): Can't acquire lockfile (32) - waiting 35s 12:48:31 (4104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4796, iMonCtr=1 Model crash detected, will try to restart... 13:05:16 (4808): Can't acquire lockfile (32) - waiting 35s 13:05:30 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1656, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 23:17:31 (6288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1620, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D26E0F read attempt to address 0x40EB93DE Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish ERROR: Invalid parameter detected in function (null). File: (null) Line: 0 ERROR: Expression: (null) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Oct 2011 13:55:57	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	1,036,800	1,922,813	1.8546
13 Oct 2011 14:21:15	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	1,010,880	1,872,972	1.8528
11 Oct 2011 15:47:41	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	984,960	1,825,585	1.8535
10 Oct 2011 09:19:51	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	959,040	1,780,022	1.8560
06 Oct 2011 15:36:34	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	933,120	1,731,851	1.8560
05 Oct 2011 09:51:06	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	907,200	1,684,212	1.8565
03 Oct 2011 21:36:03	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	881,280	1,633,468	1.8535
02 Oct 2011 15:52:09	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	855,360	1,584,000	1.8519
29 Sep 2011 11:48:26	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	829,440	1,534,385	1.8499
27 Sep 2011 11:35:01	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	803,520	1,485,805	1.8491
23 Sep 2011 17:02:26	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	777,600	1,438,223	1.8496
22 Sep 2011 17:48:10	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	751,680	1,389,061	1.8479
20 Sep 2011 17:50:44	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	725,760	1,338,849	1.8448
16 Sep 2011 21:54:31	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	699,840	1,289,392	1.8424
15 Sep 2011 20:35:09	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	673,920	1,241,878	1.8428
13 Sep 2011 20:26:41	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	648,000	1,193,405	1.8417
12 Sep 2011 20:55:28	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	622,080	1,145,282	1.8411
08 Sep 2011 18:49:20	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	596,160	1,095,566	1.8377
07 Sep 2011 17:33:47	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	570,240	1,047,154	1.8363
05 Sep 2011 20:40:36	1117493	13100020	hadcm3n_ybqr_1900_40_007348077_0	544,320	998,367	1.8342