Task 11645981

Name	hadsm3dhet2_u7ai_006670227_4
Workunit	6873481
Created	9 Aug 2010, 15:31:24 UTC
Sent	24 Sep 2010, 18:54:31 UTC
Report deadline	7 Sep 2011, 0:14:31 UTC
Received	28 Oct 2010, 11:15:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1052332
Run time	14 days 5 hours 22 min 41 sec
CPU time	7 days 13 hours 46 min 46 sec
Validate state	Invalid
Credit	2,282.60
Device peak FLOPS	2.60 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5536, selfPID=5536, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7484, selfPID=7484, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1124, selfPID=1124, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4336, selfPID=4336, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7544, selfPID=7544, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5072, selfPID=5072, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=520, selfPID=520, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6608, selfPID=6608, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5416, selfPID=5416, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4484, selfPID=4484, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1932, selfPID=1932, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2432, selfPID=2432, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=8068, selfPID=8068, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6876, selfPID=6876, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7860, selfPID=7860, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=468, selfPID=468, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=4844, selfPID=4844, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3480, selfPID=3480, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6224, selfPID=6224, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1208, selfPID=1208, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2556, selfPID=2556, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4384, selfPID=4384, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7640, selfPID=7640, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7552, selfPID=7552, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2520, selfPID=2520, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7732, selfPID=7732, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7984, selfPID=7984, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=544, selfPID=544, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7744, selfPID=7744, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=7664, selfPID=7664, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=4088, selfPID=4088, iMonCtr=1 No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2420, selfPID=2420, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=6212, selfPID=6212, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=2512, selfPID=2512, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=5580, selfPID=5580, iMonCtr=1 forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN Monitor - Quit request from BOINC... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7896, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7896, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7896, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7896, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7896, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7896, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Oct 2010 22:35:26	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	248,446	352,213	1.4177
04 Oct 2010 07:27:31	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	237,644	337,226	1.4190
03 Oct 2010 21:09:37	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	226,842	322,040	1.4197
03 Oct 2010 06:18:55	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	216,040	306,849	1.4203
02 Oct 2010 13:50:05	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	205,238	291,910	1.4223
01 Oct 2010 22:18:52	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	194,436	276,843	1.4238
01 Oct 2010 11:12:41	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	183,634	261,579	1.4245
30 Sep 2010 22:41:36	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	172,832	246,599	1.4268
30 Sep 2010 11:13:02	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	162,030	231,342	1.4278
29 Sep 2010 23:48:05	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	151,228	215,943	1.4279
29 Sep 2010 13:18:37	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	140,426	199,390	1.4199
29 Sep 2010 04:31:43	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	129,624	183,288	1.4140
28 Sep 2010 19:44:56	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	118,822	167,246	1.4075
28 Sep 2010 10:59:22	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	108,020	151,666	1.4041
28 Sep 2010 03:57:00	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	97,218	135,805	1.3969
27 Sep 2010 16:21:54	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	86,416	120,215	1.3911
27 Sep 2010 07:58:10	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	75,614	105,338	1.3931
26 Sep 2010 23:13:36	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	64,812	89,917	1.3874
26 Sep 2010 14:49:05	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	54,010	74,896	1.3867
26 Sep 2010 06:07:05	1052332	11645981	hadsm3dhet2_u7ai_006670227_4	43,208	59,997	1.3886