Task 11429429

Name	famous_u281_999_200_006635724_4
Workunit	6839096
Created	10 Jun 2010, 11:25:40 UTC
Sent	18 Jul 2010, 2:49:14 UTC
Report deadline	17 Oct 2010, 10:16:25 UTC
Received	28 Aug 2010, 6:49:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1087914
Run time	9 days 9 hours 40 min 49 sec
CPU time	7 days 23 hours 53 min 38 sec
Validate state	Invalid
Credit	4,447.04
Device peak FLOPS	2.15 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3760, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3760, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4844, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2332, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4536, iMonCtr=1 Model crash detected, will try to restart... 18:20:08 (5816): No heartbeat from core client for 30 sec - exiting 18:20:09 (5816): No heartbeat from core client for 30 sec - exiting 18:20:10 (5816): No heartbeat from core client for 30 sec - exiting 18:20:11 (5816): No heartbeat from core client for 30 sec - exiting 18:20:12 (5816): No heartbeat from core client for 30 sec - exiting 18:20:13 (5816): No heartbeat from core client for 30 sec - exiting 18:20:14 (5816): No heartbeat from core client for 30 sec - exiting 18:20:15 (5816): No heartbeat from core client for 30 sec - exiting 18:20:16 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4424, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4424, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=364, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1204, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1204, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1204, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2560, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3560, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( 13:20:04 (4160): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Aug 2010 04:26:50	1087914	11429429	famous_u281_999_200_006635724_4	1,347,866	687,849	0.5103
28 Aug 2010 03:06:17	1087914	11429429	famous_u281_999_200_006635724_4	1,338,506	683,268	0.5105
28 Aug 2010 02:02:45	1087914	11429429	famous_u281_999_200_006635724_4	1,329,146	678,724	0.5106
28 Aug 2010 01:55:02	1087914	11429429	famous_u281_999_200_006635724_4	1,319,786	674,171	0.5108
27 Aug 2010 14:38:40	1087914	11429429	famous_u281_999_200_006635724_4	1,310,426	669,479	0.5109
27 Aug 2010 12:56:11	1087914	11429429	famous_u281_999_200_006635724_4	1,301,066	664,598	0.5108
26 Aug 2010 15:58:56	1087914	11429429	famous_u281_999_200_006635724_4	1,291,706	659,810	0.5108
25 Aug 2010 15:10:50	1087914	11429429	famous_u281_999_200_006635724_4	1,282,346	654,976	0.5108
24 Aug 2010 15:24:37	1087914	11429429	famous_u281_999_200_006635724_4	1,272,986	650,278	0.5108
24 Aug 2010 13:43:28	1087914	11429429	famous_u281_999_200_006635724_4	1,263,626	645,409	0.5108
24 Aug 2010 12:08:54	1087914	11429429	famous_u281_999_200_006635724_4	1,254,266	640,626	0.5108
23 Aug 2010 14:19:38	1087914	11429429	famous_u281_999_200_006635724_4	1,244,906	635,871	0.5108
23 Aug 2010 12:44:17	1087914	11429429	famous_u281_999_200_006635724_4	1,235,546	630,937	0.5107
22 Aug 2010 15:02:43	1087914	11429429	famous_u281_999_200_006635724_4	1,226,186	626,060	0.5106
22 Aug 2010 13:24:34	1087914	11429429	famous_u281_999_200_006635724_4	1,216,826	621,357	0.5106
22 Aug 2010 12:08:18	1087914	11429429	famous_u281_999_200_006635724_4	1,207,466	616,825	0.5108
22 Aug 2010 10:33:28	1087914	11429429	famous_u281_999_200_006635724_4	1,198,106	612,110	0.5109
22 Aug 2010 09:03:34	1087914	11429429	famous_u281_999_200_006635724_4	1,188,746	607,317	0.5109
22 Aug 2010 07:28:48	1087914	11429429	famous_u281_999_200_006635724_4	1,179,386	602,499	0.5109
22 Aug 2010 05:58:01	1087914	11429429	famous_u281_999_200_006635724_4	1,170,026	597,655	0.5108