Task 12490993

Name	famous_wuke_1999_200_007116533_0
Workunit	7314893
Created	16 Jan 2011, 15:04:13 UTC
Sent	19 Jan 2011, 11:37:53 UTC
Report deadline	20 Apr 2011, 19:05:04 UTC
Received	30 Jan 2011, 20:21:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1106381
Run time	10 days 6 hours 21 min 24 sec
CPU time	8 days 23 hours 40 min 1 sec
Validate state	Invalid
Credit	4,076.46
Device peak FLOPS	2.10 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 02:19:26 (4792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:27 (4792): No heartbeat from core client for 30 sec - exiting 02:19:28 (4792): No heartbeat from core client for 30 sec - exiting 02:19:29 (4792): No heartbeat from core client for 30 sec - exiting 02:19:30 (4792): No heartbeat from core client for 30 sec - exiting 02:19:31 (4792): No heartbeat from core client for 30 sec - exiting 02:19:32 (4792): No heartbeat from core client for 30 sec - exiting 02:19:33 (4792): No heartbeat from core client for 30 sec - exiting 02:19:34 (4792): No heartbeat from core client for 30 sec - exiting 02:19:35 (4792): No heartbeat from core client for 30 sec - exiting 02:19:36 (4792): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3632, selfPID=3632, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4968, selfPID=4968, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3400, selfPID=3400, iMonCtr=1 01:18:26 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:27 (5808): No heartbeat from core client for 30 sec - exiting 01:18:28 (5808): No heartbeat from core client for 30 sec - exiting 01:18:29 (5808): No heartbeat from core client for 30 sec - exiting 01:18:30 (5808): No heartbeat from core client for 30 sec - exiting 01:18:31 (5808): No heartbeat from core client for 30 sec - exiting 01:18:32 (5808): No heartbeat from core client for 30 sec - exiting 01:18:33 (5808): No heartbeat from core client for 30 sec - exiting 01:18:34 (5808): No heartbeat from core client for 30 sec - exiting 01:18:36 (5808): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6340, selfPID=6340, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2168, selfPID=2168, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3384, selfPID=3384, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5056, selfPID=5056, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4496, selfPID=4496, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3188, selfPID=3188, iMonCtr=1 07:17:23 (6464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:17:24 (6464): No heartbeat from core client for 30 sec - exiting 07:17:25 (6464): No heartbeat from core client for 30 sec - exiting 07:17:26 (6464): No heartbeat from core client for 30 sec - exiting 07:17:27 (6464): No heartbeat from core client for 30 sec - exiting 07:17:28 (6464): No heartbeat from core client for 30 sec - exiting 07:17:29 (6464): No heartbeat from core client for 30 sec - exiting 07:17:30 (6464): No heartbeat from core client for 30 sec - exiting 07:17:31 (6464): No heartbeat from core client for 30 sec - exiting 07:17:32 (6464): No heartbeat from core client for 30 sec - exiting 07:17:33 (6464): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4820, selfPID=4820, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6068, selfPID=6068, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4316, selfPID=4316, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5180, selfPID=5180, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7388, selfPID=7388, iMonCtr=1 04:16:18 (7964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:19 (7964): No heartbeat from core client for 30 sec - exiting 04:16:20 (7964): No heartbeat from core client for 30 sec - exiting 04:16:21 (7964): No heartbeat from core client for 30 sec - exiting 04:16:22 (7964): No heartbeat from core client for 30 sec - exiting 04:16:23 (7964): No heartbeat from core client for 30 sec - exiting 04:16:24 (7964): No heartbeat from core client for 30 sec - exiting 04:16:25 (7964): No heartbeat from core client for 30 sec - exiting 04:16:26 (7964): No heartbeat from core client for 30 sec - exiting 04:16:27 (7964): No heartbeat from core client for 30 sec - exiting 04:16:28 (7964): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7320, selfPID=7320, iMonCtr=1 15:15:17 (7452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:15:18 (7452): No heartbeat from core client for 30 sec - exiting 15:15:19 (7452): No heartbeat from core client for 30 sec - exiting 15:15:20 (7452): No heartbeat from core client for 30 sec - exiting 15:15:21 (7452): No heartbeat from core client for 30 sec - exiting 15:15:22 (7452): No heartbeat from core client for 30 sec - exiting 15:15:23 (7452): No heartbeat from core client for 30 sec - exiting 15:15:24 (7452): No heartbeat from core client for 30 sec - exiting 15:15:25 (7452): No heartbeat from core client for 30 sec - exiting 15:15:26 (7452): No heartbeat from core client for 30 sec - exiting 15:15:27 (7452): No heartbeat from core client for 30 sec - exiting 15:15:28 (7452): No heartbeat from core client for 30 sec - exiting 15:15:29 (7452): No heartbeat from core client for 30 sec - exiting 15:15:30 (7452): No heartbeat from core client for 30 sec - exiting 15:15:31 (7452): No heartbeat from core client for 30 sec - exiting 15:15:32 (7452): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=952, selfPID=952, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7380, selfPID=7380, iMonCtr=1 06:14:17 (7276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:18 (7276): No heartbeat from core client for 30 sec - exiting 06:14:19 (7276): No heartbeat from core client for 30 sec - exiting 06:14:20 (7276): No heartbeat from core client for 30 sec - exiting 06:14:21 (7276): No heartbeat from core client for 30 sec - exiting 06:14:22 (7276): No heartbeat from core client for 30 sec - exiting 06:14:23 (7276): No heartbeat from core client for 30 sec - exiting 06:14:24 (7276): No heartbeat from core client for 30 sec - exiting 06:14:25 (7276): No heartbeat from core client for 30 sec - exiting 06:14:26 (7276): No heartbeat from core client for 30 sec - exiting 06:14:27 (7276): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7180, selfPID=7180, iMonCtr=1 No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2340, selfPID=2340, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7268, selfPID=7268, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6704, selfPID=6704, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7632, selfPID=7632, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7452, selfPID=7452, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6548, selfPID=6548, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2172, selfPID=2172, iMonCtr=1 19:12:11 (6368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:12 (6368): No heartbeat from core client for 30 sec - exiting 19:12:13 (6368): No heartbeat from core client for 30 sec - exiting 19:12:14 (6368): No heartbeat from core client for 30 sec - exiting 19:12:15 (6368): No heartbeat from core client for 30 sec - exiting 19:12:16 (6368): No heartbeat from core client for 30 sec - exiting 19:12:17 (6368): No heartbeat from core client for 30 sec - exiting 19:12:18 (6368): No heartbeat from core client for 30 sec - exiting 19:12:19 (6368): No heartbeat from core client for 30 sec - exiting 19:12:20 (6368): No heartbeat from core client for 30 sec - exiting 19:12:21 (6368): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7936, selfPID=7936, iMonCtr=1 17:11:06 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:07 (5812): No heartbeat from core client for 30 sec - exiting 17:11:08 (5812): No heartbeat from core client for 30 sec - exiting 17:11:09 (5812): No heartbeat from core client for 30 sec - exiting 17:11:10 (5812): No heartbeat from core client for 30 sec - exiting 17:11:11 (5812): No heartbeat from core client for 30 sec - exiting 17:11:12 (5812): No heartbeat from core client for 30 sec - exiting 17:11:13 (5812): No heartbeat from core client for 30 sec - exiting 17:11:14 (5812): No heartbeat from core client for 30 sec - exiting 17:11:15 (5812): No heartbeat from core client for 30 sec - exiting 17:11:16 (5812): No heartbeat from core client for 30 sec - exiting 17:11:17 (5812): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1256, selfPID=1256, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7652, selfPID=7652, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3700, selfPID=3700, iMonCtr=1 CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3684, selfPID=3684, iMonCtr=1 00:59:57 (448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:59:58 (448): No heartbeat from core client for 30 sec - exiting 00:59:59 (448): No heartbeat from core client for 30 sec - exiting 01:00:00 (448): No heartbeat from core client for 30 sec - exiting 01:00:01 (448): No heartbeat from core client for 30 sec - exiting 01:00:02 (448): No heartbeat from core client for 30 sec - exiting 01:00:03 (448): No heartbeat from core client for 30 sec - exiting 01:00:04 (448): No heartbeat from core client for 30 sec - exiting 01:00:05 (448): No heartbeat from core client for 30 sec - exiting 01:00:06 (448): No heartbeat from core client for 30 sec - exiting 01:00:07 (448): No heartbeat from core client for 30 sec - exiting Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4188, selfPID=4188, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3476, selfPID=3476, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7400, selfPID=7400, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3744, selfPID=3744, iMonCtr=1 CPDN Monitor - Quit request from BOINC... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_wuke_1999_200_007116533\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_wuke_1999_200_007116533\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_wuke_1999_200_007116533\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_wuke_1999_200_007116533\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_wuke_1999_200_007116533\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (47): write to READONLY file, unit 6, file C:\ProgramData\BOINC\projects\climateprediction.net\famous_wuke_1999_200_007116533\dataout\stdout_um.txt Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4876, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 15:29:19 (4876): called boinc_finish Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3624, selfPID=3624, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jan 2011 18:30:17	1106381	12490993	famous_wuke_1999_200_007116533_0	1,235,546	771,296	0.6243
30 Jan 2011 15:29:22	1106381	12490993	famous_wuke_1999_200_007116533_0	1,226,186	765,706	0.6245
30 Jan 2011 08:20:29	1106381	12490993	famous_wuke_1999_200_007116533_0	1,216,826	760,102	0.6247
30 Jan 2011 06:13:53	1106381	12490993	famous_wuke_1999_200_007116533_0	1,207,466	754,548	0.6249
30 Jan 2011 04:22:20	1106381	12490993	famous_wuke_1999_200_007116533_0	1,198,106	748,980	0.6251
30 Jan 2011 02:50:19	1106381	12490993	famous_wuke_1999_200_007116533_0	1,188,746	743,560	0.6255
29 Jan 2011 21:57:33	1106381	12490993	famous_wuke_1999_200_007116533_0	1,179,386	737,912	0.6257
29 Jan 2011 20:18:21	1106381	12490993	famous_wuke_1999_200_007116533_0	1,170,026	732,310	0.6259
29 Jan 2011 18:44:28	1106381	12490993	famous_wuke_1999_200_007116533_0	1,160,666	726,673	0.6261
29 Jan 2011 16:41:11	1106381	12490993	famous_wuke_1999_200_007116533_0	1,151,306	720,967	0.6262
29 Jan 2011 14:59:53	1106381	12490993	famous_wuke_1999_200_007116533_0	1,141,946	715,284	0.6264
29 Jan 2011 13:16:57	1106381	12490993	famous_wuke_1999_200_007116533_0	1,132,586	709,544	0.6265
29 Jan 2011 13:11:11	1106381	12490993	famous_wuke_1999_200_007116533_0	1,123,226	703,826	0.6266
29 Jan 2011 13:11:10	1106381	12490993	famous_wuke_1999_200_007116533_0	1,113,866	698,096	0.6267
29 Jan 2011 13:11:10	1106381	12490993	famous_wuke_1999_200_007116533_0	1,104,506	692,356	0.6268
29 Jan 2011 13:11:10	1106381	12490993	famous_wuke_1999_200_007116533_0	1,095,146	686,623	0.6270
29 Jan 2011 13:11:10	1106381	12490993	famous_wuke_1999_200_007116533_0	1,085,786	680,870	0.6271
29 Jan 2011 13:11:10	1106381	12490993	famous_wuke_1999_200_007116533_0	1,076,426	675,125	0.6272
29 Jan 2011 01:01:31	1106381	12490993	famous_wuke_1999_200_007116533_0	1,067,066	669,386	0.6273
28 Jan 2011 23:11:32	1106381	12490993	famous_wuke_1999_200_007116533_0	1,057,706	663,614	0.6274