Task 12454251

Name	famous_xo27_2099_200_007093014_1
Workunit	7296314
Created	31 Dec 2010, 13:00:19 UTC
Sent	31 Dec 2010, 13:08:23 UTC
Report deadline	1 Apr 2011, 20:35:34 UTC
Received	5 Jan 2011, 20:19:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1113312
Run time	3 days 2 hours 58 min 28 sec
CPU time	3 days 1 hours 39 min 54 sec
Validate state	Invalid
Credit	3,705.88
Device peak FLOPS	3.25 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Fri Dec 31 16:52:15 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98e9046b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x98e2a0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c ss: 0x00000023 efl: 0x00000206 eip: 0x98e2a0fa cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libirc.dylib 0x915cd000 - 0x915d0fff /usr/lib/system/libmathCommon.A.dylib 0x974c6000 - 0x974d4fff /usr/lib/libz.1.dylib 0x98e29000 - 0x98fd0fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=53802, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Sat Jan 1 04:42:58 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98e9046b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x98e2a0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c ss: 0x00000023 efl: 0x00000206 eip: 0x98e2a0fa cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libirc.dylib 0x915cd000 - 0x915d0fff /usr/lib/system/libmathCommon.A.dylib 0x974c6000 - 0x974d4fff /usr/lib/libz.1.dylib 0x98e29000 - 0x98fd0fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2654, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (55913): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (57028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (57115): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (57115): No heartbeat from core client for 30 sec - exiting (57115): No heartbeat from core client for 30 sec - exiting (57115): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (75044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (75044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Wed Jan 5 15:16:42 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98e9046b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x98e2a0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c ss: 0x00000023 efl: 0x00000206 eip: 0x98e2a0fa cs: 0x0000000b ds: 0x00000023 es: 0x00000023 fs: 0x00000000 gs: 0x0000000f Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xo27_2099_200_007093014/lib/libirc.dylib 0x915cd000 - 0x915d0fff /usr/lib/system/libmathCommon.A.dylib 0x974c6000 - 0x974d4fff /usr/lib/libz.1.dylib 0x98e29000 - 0x98fd0fff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=297, iMonCtr=1 Model crash detected, will try to restart... Model crashed: REPLANCA: PP HEADERS ON ANCILLARY FILE DO NOT MATCH tmp/pipe_dummy Sorry, too many model crashes! :-( (297): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jan 2011 20:13:18	1113312	12454251	famous_xo27_2099_200_007093014_1	1,123,226	264,639	0.2356
05 Jan 2011 19:34:06	1113312	12454251	famous_xo27_2099_200_007093014_1	1,113,866	262,364	0.2355
05 Jan 2011 19:34:06	1113312	12454251	famous_xo27_2099_200_007093014_1	1,104,506	260,114	0.2355
05 Jan 2011 18:32:32	1113312	12454251	famous_xo27_2099_200_007093014_1	1,095,146	257,897	0.2355
05 Jan 2011 18:29:03	1113312	12454251	famous_xo27_2099_200_007093014_1	1,085,786	255,693	0.2355
05 Jan 2011 17:04:36	1113312	12454251	famous_xo27_2099_200_007093014_1	1,076,426	253,522	0.2355
05 Jan 2011 16:27:24	1113312	12454251	famous_xo27_2099_200_007093014_1	1,067,066	251,344	0.2355
05 Jan 2011 15:52:57	1113312	12454251	famous_xo27_2099_200_007093014_1	1,057,706	249,121	0.2355
05 Jan 2011 15:12:58	1113312	12454251	famous_xo27_2099_200_007093014_1	1,048,346	246,828	0.2354
05 Jan 2011 14:32:53	1113312	12454251	famous_xo27_2099_200_007093014_1	1,038,986	244,504	0.2353
05 Jan 2011 13:51:33	1113312	12454251	famous_xo27_2099_200_007093014_1	1,029,626	242,187	0.2352
05 Jan 2011 13:15:06	1113312	12454251	famous_xo27_2099_200_007093014_1	1,020,266	239,859	0.2351
05 Jan 2011 12:33:38	1113312	12454251	famous_xo27_2099_200_007093014_1	1,010,906	237,554	0.2350
05 Jan 2011 11:57:01	1113312	12454251	famous_xo27_2099_200_007093014_1	1,001,546	235,322	0.2350
05 Jan 2011 11:20:21	1113312	12454251	famous_xo27_2099_200_007093014_1	992,186	233,095	0.2349
05 Jan 2011 10:43:39	1113312	12454251	famous_xo27_2099_200_007093014_1	982,826	230,887	0.2349
05 Jan 2011 10:06:23	1113312	12454251	famous_xo27_2099_200_007093014_1	973,466	228,665	0.2349
05 Jan 2011 09:28:25	1113312	12454251	famous_xo27_2099_200_007093014_1	964,106	226,416	0.2348
05 Jan 2011 08:51:34	1113312	12454251	famous_xo27_2099_200_007093014_1	954,746	224,214	0.2348
05 Jan 2011 01:31:53	1113312	12454251	famous_xo27_2099_200_007093014_1	945,386	222,038	0.2349