Task 11894353

Name	hadsm3dhet2_u5cq_006725393_7
Workunit	6928736
Created	17 Sep 2010, 8:07:58 UTC
Sent	22 Sep 2010, 13:04:32 UTC
Report deadline	4 Sep 2011, 18:24:32 UTC
Received	20 Apr 2011, 15:23:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	941619
Run time	14 days 12 hours 0 min 59 sec
CPU time	11 days 13 hours 46 min 7 sec
Validate state	Invalid
Credit	3,473.52
Device peak FLOPS	1.38 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=448, selfPID=448, iMonCtr=1 Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. MainError: 04:03:28 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1008, selfPID=1008, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2488, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Model crashed: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Model crashed: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Model crashed: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Model crashed: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Model crashed: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Model crashed: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2912, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2011 15:29:21	941619	11894353	hadsm3dhet2_u5cq_006725393_7	118,822	997,179	2.6376
29 Mar 2011 19:35:59	941619	11894353	hadsm3dhet2_u5cq_006725393_7	108,020	969,334	2.6393
24 Mar 2011 20:35:12	941619	11894353	hadsm3dhet2_u5cq_006725393_7	97,218	940,492	2.6384
22 Mar 2011 16:31:39	941619	11894353	hadsm3dhet2_u5cq_006725393_7	86,416	911,691	2.6375
18 Mar 2011 15:55:50	941619	11894353	hadsm3dhet2_u5cq_006725393_7	75,614	883,286	2.6378
08 Mar 2011 20:02:06	941619	11894353	hadsm3dhet2_u5cq_006725393_7	64,812	855,027	2.6385
21 Feb 2011 18:55:52	941619	11894353	hadsm3dhet2_u5cq_006725393_7	54,010	826,408	2.6381
18 Feb 2011 14:08:51	941619	11894353	hadsm3dhet2_u5cq_006725393_7	43,208	798,180	2.6390
16 Feb 2011 13:03:40	941619	11894353	hadsm3dhet2_u5cq_006725393_7	32,406	769,320	2.6378
09 Feb 2011 21:21:11	941619	11894353	hadsm3dhet2_u5cq_006725393_7	21,604	740,686	2.6373
01 Feb 2011 15:22:47	941619	11894353	hadsm3dhet2_u5cq_006725393_7	10,802	711,471	2.6346
28 Jan 2011 16:00:23	941619	11894353	hadsm3dhet2_u5cq_006725393_7	259,248	683,396	2.6361
20 Jan 2011 14:26:23	941619	11894353	hadsm3dhet2_u5cq_006725393_7	248,446	654,673	2.6351
17 Jan 2011 18:32:15	941619	11894353	hadsm3dhet2_u5cq_006725393_7	237,644	626,617	2.6368
13 Jan 2011 16:51:50	941619	11894353	hadsm3dhet2_u5cq_006725393_7	226,842	597,521	2.6341
06 Jan 2011 16:32:51	941619	11894353	hadsm3dhet2_u5cq_006725393_7	216,040	568,760	2.6327
04 Jan 2011 13:41:13	941619	11894353	hadsm3dhet2_u5cq_006725393_7	205,238	539,541	2.6289
30 Dec 2010 14:07:24	941619	11894353	hadsm3dhet2_u5cq_006725393_7	194,436	511,100	2.6286
28 Dec 2010 15:10:44	941619	11894353	hadsm3dhet2_u5cq_006725393_7	183,634	482,660	2.6284
02 Dec 2010 20:10:42	941619	11894353	hadsm3dhet2_u5cq_006725393_7	172,832	453,729	2.6253