Task 11696496

Name	famous_v17v_1799_200_006687345_2
Workunit	6890598
Created	26 Aug 2010, 15:42:18 UTC
Sent	1 Sep 2010, 12:28:26 UTC
Report deadline	1 Dec 2010, 19:55:37 UTC
Received	3 Sep 2010, 21:43:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	904604
Run time
CPU time	7 hours 10 min 59 sec
Validate state	Invalid
Credit	494.19
Device peak FLOPS	2.17 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> (17257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17261): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17261): No heartbeat from core client for 30 sec - exiting (17261): No heartbeat from core client for 30 sec - exiting (17261): No heartbeat from core client for 30 sec - exiting (17261): No heartbeat from core client for 30 sec - exiting (17261): No heartbeat from core client for 30 sec - exiting (17313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (17681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17681): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting (17712): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... (23377): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23377): No heartbeat from core client for 30 sec - exiting (23377): No heartbeat from core client for 30 sec - exiting (23377): No heartbeat from core client for 30 sec - exiting (23377): No heartbeat from core client for 30 sec - exiting (23377): No heartbeat from core client for 30 sec - exiting (23377): No heartbeat from core client for 30 sec - exiting (23377): No heartbeat from core client for 30 sec - exiting (23377): No heartbeat from core client for 30 sec - exiting (23390): No heartbeat from core client for 30 sec - exiting (23390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (23441): No heartbeat from core client for 30 sec - exiting (23441): No heartbeat from core client for 30 sec - exiting (23441): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (24682): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24682): No heartbeat from core client for 30 sec - exiting (24682): No heartbeat from core client for 30 sec - exiting (24715): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting (24728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... (24801): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24801): No heartbeat from core client for 30 sec - exiting (24801): No heartbeat from core client for 30 sec - exiting (24842): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24842): No heartbeat from core client for 30 sec - exiting (24842): No heartbeat from core client for 30 sec - exiting (24842): No heartbeat from core client for 30 sec - exiting (24887): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24887): No heartbeat from core client for 30 sec - exiting (24913): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24939, selfPID=24939, iMonCtr=1 (24990): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24990): No heartbeat from core client for 30 sec - exiting (24990): No heartbeat from core client for 30 sec - exiting (24990): No heartbeat from core client for 30 sec - exiting (25030): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25030): No heartbeat from core client for 30 sec - exiting (25030): No heartbeat from core client for 30 sec - exiting (25030): No heartbeat from core client for 30 sec - exiting (25068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25068): No heartbeat from core client for 30 sec - exiting (25068): No heartbeat from core client for 30 sec - exiting (25068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (25112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25112): No heartbeat from core client for 30 sec - exiting (25112): No heartbeat from core client for 30 sec - exiting (25147): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25147): No heartbeat from core client for 30 sec - exiting (25162): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (25217): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25217): No heartbeat from core client for 30 sec - exiting (25217): No heartbeat from core client for 30 sec - exiting (25260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25260): No heartbeat from core client for 30 sec - exiting (25330): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25330): No heartbeat from core client for 30 sec - exiting (25338): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (26810): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... (26997): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy Sorry, too many model crashes! :-( (27273): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	149,786	25,530	0.1704
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	140,426	23,896	0.1702
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	131,066	22,294	0.1701
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	121,706	20,679	0.1699
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	112,346	19,094	0.1700
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	102,986	17,466	0.1696
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	93,626	15,841	0.1692
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	84,266	14,329	0.1700
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	74,906	12,803	0.1709
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	65,546	11,146	0.1700
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	56,186	9,538	0.1698
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	46,826	8,027	0.1714
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	37,466	6,387	0.1705
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	28,106	4,816	0.1714
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	18,746	3,197	0.1705
03 Sep 2010 21:49:46	904604	11696496	famous_v17v_1799_200_006687345_2	9,386	1,551	0.1652