Task 11659166

Name	famous_s399_799_200_006670710_1
Workunit	6873963
Created	16 Aug 2010, 1:15:56 UTC
Sent	17 Aug 2010, 0:24:56 UTC
Report deadline	16 Nov 2010, 7:52:07 UTC
Received	7 Sep 2010, 22:53:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	988360
Run time	8 days 5 hours 56 min 58 sec
CPU time	7 days 23 hours 13 min 48 sec
Validate state	Invalid
Credit	5,682.31
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 11:03:16 (3688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:10:45 (4012): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:28:33 (588): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error ferror - Unit 61 - Return code = 32 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy forrtl: Insufficient system resources exist to complete the requested service. forrtl: severe (39): error during read, unit 3, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\famous_s399_799_200_006670710\datain\ancil\ctldata\stasets\X01003277 Stack trace terminated abnormally. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2928, iMonCtr=1 Model crash detected, will try to restart... forrtl: Insufficient system resources exist to complete the requested service. forrtl: severe (39): error during read, unit 3, file C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\famous_s399_799_200_006670710\datain\ancil\ctldata\stasets\X01005208 Image PC Routine Line Source famous_um_6.11_wi 008846D2 Unknown Unknown Unknown famous_um_6.11_wi 0088196C Unknown Unknown Unknown famous_um_6.11_wi 0080BD3E Unknown Unknown Unknown famous_um_6.11_wi 0080B95B Unknown Unknown Unknown famous_um_6.11_wi 00802176 Unknown Unknown Unknown famous_um_6.11_wi 0056FF08 Unknown Unknown Unknown famous_um_6.11_wi 0056FB73 Unknown Unknown Unknown famous_um_6.11_wi 00724CDE Unknown Unknown Unknown famous_um_6.11_wi 00777A20 Unknown Unknown Unknown famous_um_6.11_wi 007CA0F6 Unknown Unknown Unknown kernel32.dll 7C817077 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2928, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error ferror - Unit 69 - Return code = 32 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:36:36 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:19:01 (492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy Sorry, too many model crashes! :-( 13:33:10 (3232): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Sep 2010 16:47:34	988360	11659166	famous_s399_799_200_006670710_1	1,722,266	685,407	0.3980
07 Sep 2010 16:47:15	988360	11659166	famous_s399_799_200_006670710_1	1,712,906	681,693	0.3980
07 Sep 2010 13:40:27	988360	11659166	famous_s399_799_200_006670710_1	1,703,546	677,942	0.3980
07 Sep 2010 12:40:16	988360	11659166	famous_s399_799_200_006670710_1	1,694,186	674,198	0.3979
07 Sep 2010 11:34:33	988360	11659166	famous_s399_799_200_006670710_1	1,684,826	670,472	0.3979
07 Sep 2010 09:45:49	988360	11659166	famous_s399_799_200_006670710_1	1,675,466	666,751	0.3979
07 Sep 2010 08:41:33	988360	11659166	famous_s399_799_200_006670710_1	1,666,106	663,012	0.3979
07 Sep 2010 07:36:18	988360	11659166	famous_s399_799_200_006670710_1	1,656,746	659,241	0.3979
07 Sep 2010 05:33:53	988360	11659166	famous_s399_799_200_006670710_1	1,647,386	655,501	0.3979
07 Sep 2010 04:34:21	988360	11659166	famous_s399_799_200_006670710_1	1,638,026	651,727	0.3979
07 Sep 2010 03:30:03	988360	11659166	famous_s399_799_200_006670710_1	1,628,666	648,001	0.3979
07 Sep 2010 02:27:34	988360	11659166	famous_s399_799_200_006670710_1	1,619,306	644,327	0.3979
07 Sep 2010 00:16:51	988360	11659166	famous_s399_799_200_006670710_1	1,609,946	640,592	0.3979
06 Sep 2010 23:14:39	988360	11659166	famous_s399_799_200_006670710_1	1,600,586	636,828	0.3979
06 Sep 2010 21:33:40	988360	11659166	famous_s399_799_200_006670710_1	1,591,226	632,969	0.3978
06 Sep 2010 20:08:47	988360	11659166	famous_s399_799_200_006670710_1	1,581,866	628,714	0.3975
06 Sep 2010 18:43:17	988360	11659166	famous_s399_799_200_006670710_1	1,572,506	624,992	0.3974
06 Sep 2010 17:38:32	988360	11659166	famous_s399_799_200_006670710_1	1,563,146	621,247	0.3974
06 Sep 2010 15:47:16	988360	11659166	famous_s399_799_200_006670710_1	1,553,786	617,545	0.3974
06 Sep 2010 14:42:17	988360	11659166	famous_s399_799_200_006670710_1	1,544,426	613,780	0.3974