Task 12439044

Name	famous_v7pd_1399_200_006695751_5
Workunit	6899004
Created	20 Dec 2010, 15:55:13 UTC
Sent	11 Jan 2011, 20:31:02 UTC
Report deadline	13 Apr 2011, 3:58:13 UTC
Received	11 Apr 2011, 14:54:49 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1094715
Run time	7 days 16 hours 18 min 16 sec
CPU time	6 days 10 hours 44 min 48 sec
Validate state	Invalid
Credit	2,408.85
Device peak FLOPS	1.53 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2692, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1684, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2984, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/ocean_restart.day after 11 attempts forrtl: severe (24): end-of-file during read, unit 5, file D:\DATA\BOINC\projects\climateprediction.net\famous_v7pd_1399_200_006695751\jobs\climate.cpdc, line 1, position 0 Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/ocean_restart.day after 11 attempts Suspended CPDN Monitor - Suspend request from BOINC... forrtl: severe (24): end-of-file during read, unit 5, file D:\DATA\BOINC\projects\climateprediction.net\famous_v7pd_1399_200_006695751\jobs\climate.cpdc, line 1, position 0 Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/ocean_restart.day after 11 attempts forrtl: severe (24): end-of-file during read, unit 5, file D:\DATA\BOINC\projects\climateprediction.net\famous_v7pd_1399_200_006695751\jobs\climate.cpdc, line 1, position 0 Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/ocean_restart.day after 11 attempts forrtl: severe (24): end-of-file during read, unit 5, file D:\DATA\BOINC\projects\climateprediction.net\famous_v7pd_1399_200_006695751\jobs\climate.cpdc, line 1, position 0 Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/ocean_restart.day after 11 attempts forrtl: severe (24): end-of-file during read, unit 5, file D:\DATA\BOINC\projects\climateprediction.net\famous_v7pd_1399_200_006695751\jobs\climate.cpdc, line 1, position 0 Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file D:\DATA\BOINC/projects/climateprediction.net/famous_v7pd_1399_200_006695751/dataout/ocean_restart.day after 11 attempts forrtl: severe (24): end-of-file during read, unit 5, file D:\DATA\BOINC\projects\climateprediction.net\famous_v7pd_1399_200_006695751\jobs\climate.cpdc, line 1, position 0 Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2148, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( 15:56:59 (2148): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Apr 2011 06:59:27	1094715	12439044	famous_v7pd_1399_200_006695751_5	730,106	555,206	0.7604
07 Apr 2011 20:15:06	1094715	12439044	famous_v7pd_1399_200_006695751_5	720,746	548,398	0.7609
07 Apr 2011 13:29:56	1094715	12439044	famous_v7pd_1399_200_006695751_5	711,386	541,783	0.7616
06 Apr 2011 19:02:19	1094715	12439044	famous_v7pd_1399_200_006695751_5	702,026	534,212	0.7610
06 Apr 2011 17:16:56	1094715	12439044	famous_v7pd_1399_200_006695751_5	692,666	525,687	0.7589
06 Apr 2011 13:46:23	1094715	12439044	famous_v7pd_1399_200_006695751_5	683,306	516,054	0.7552
05 Apr 2011 21:09:31	1094715	12439044	famous_v7pd_1399_200_006695751_5	673,946	508,391	0.7543
05 Apr 2011 19:04:31	1094715	12439044	famous_v7pd_1399_200_006695751_5	664,586	501,227	0.7542
05 Apr 2011 17:43:01	1094715	12439044	famous_v7pd_1399_200_006695751_5	655,226	494,513	0.7547
04 Apr 2011 22:06:45	1094715	12439044	famous_v7pd_1399_200_006695751_5	645,866	487,907	0.7554
04 Apr 2011 20:00:14	1094715	12439044	famous_v7pd_1399_200_006695751_5	636,506	481,456	0.7564
04 Apr 2011 17:38:58	1094715	12439044	famous_v7pd_1399_200_006695751_5	627,146	473,876	0.7556
04 Apr 2011 15:14:59	1094715	12439044	famous_v7pd_1399_200_006695751_5	617,786	465,150	0.7529
04 Apr 2011 12:56:32	1094715	12439044	famous_v7pd_1399_200_006695751_5	608,426	457,083	0.7513
03 Apr 2011 20:58:27	1094715	12439044	famous_v7pd_1399_200_006695751_5	599,066	450,317	0.7517
03 Apr 2011 18:43:20	1094715	12439044	famous_v7pd_1399_200_006695751_5	589,706	442,923	0.7511
03 Apr 2011 15:56:21	1094715	12439044	famous_v7pd_1399_200_006695751_5	580,346	436,273	0.7517
02 Apr 2011 20:57:42	1094715	12439044	famous_v7pd_1399_200_006695751_5	570,986	429,404	0.7520
02 Apr 2011 18:45:40	1094715	12439044	famous_v7pd_1399_200_006695751_5	561,626	422,211	0.7518
02 Apr 2011 08:27:33	1094715	12439044	famous_v7pd_1399_200_006695751_5	552,266	414,683	0.7509