Task 11740282

Name	famous_v7z4_1999_200_006696102_3
Workunit	6899355
Created	26 Aug 2010, 16:25:49 UTC
Sent	10 Dec 2010, 16:09:12 UTC
Report deadline	11 Mar 2011, 23:36:23 UTC
Received	11 Jan 2011, 23:53:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1120730
Run time	15 hours 12 min 41 sec
CPU time	14 hours 2 min 2 sec
Validate state	Invalid
Credit	864.77
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.3 build 10D573 Wed Dec 29 09:27:06 2010 2010-12-29 09:27:18.652 atos[376:60b] -[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0 2010-12-29 09:27:19.081 atos[376:60b] * Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0' * Call stack at first throw: ( 0 CoreFoundation 0x9439a6f4 __raiseError + 168 1 libobjc.A.dylib 0x902f58bc objc_exception_throw + 80 2 CoreFoundation 0x943a38c0 +[NSObject(NSObject) doesNotRecognizeSelector:] + 0 3 CoreFoundation 0x943a0b54 ___forwarding___ + 380 4 CoreFoundation 0x943a0e08 _CF_forwarding_prep_0 + 216 5 atos 0x00003428 0x0 + 13352 6 atos 0x00002904 0x0 + 10500 7 atos 0x00002784 0x0 + 10116 ) 0 0x0048fdcf 1 0x0049054a 2 0x95fdd42b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x003f5826 7 0x00450bd8 8 0x004698c0 9 0x000026b6 10 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd3fc edx: 0x95f772fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd438 esp: 0xbfffd3fc ss: 0x0000001f efl: 0x00000206 eip: 0x95f772fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libirc.dylib 0x92564000 - 0x92567fff /usr/lib/system/libmathCommon.A.dylib 0x92aca000 - 0x92ad8fff /usr/lib/libz.1.dylib 0x95f76000 - 0x9611bfff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=371, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.3 build 10D573 Mon Jan 3 12:43:46 2011 2011-01-03 12:43:58.101 atos[440:60b] -[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0 2011-01-03 12:43:58.476 atos[440:60b] * Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0' * Call stack at first throw: ( 0 CoreFoundation 0x9439a6f4 __raiseError + 168 1 libobjc.A.dylib 0x902f58bc objc_exception_throw + 80 2 CoreFoundation 0x943a38c0 +[NSObject(NSObject) doesNotRecognizeSelector:] + 0 3 CoreFoundation 0x943a0b54 ___forwarding___ + 380 4 CoreFoundation 0x943a0e08 _CF_forwarding_prep_0 + 216 5 atos 0x00003428 0x0 + 13352 6 atos 0x00002904 0x0 + 10500 7 atos 0x00002784 0x0 + 10116 ) 0 0x0048fdcf 1 0x0049054a 2 0x95fdd42b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc36c edx: 0x95f772fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc3a8 esp: 0xbfffc36c ss: 0x0000001f efl: 0x00000206 eip: 0x95f772fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libirc.dylib 0x92564000 - 0x92567fff /usr/lib/system/libmathCommon.A.dylib 0x92aca000 - 0x92ad8fff /usr/lib/libz.1.dylib 0x95f76000 - 0x9611bfff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=435, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.3 build 10D573 Wed Jan 5 09:32:18 2011 2011-01-05 09:32:25.770 atos[574:60b] -[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0 2011-01-05 09:32:26.000 atos[574:60b] * Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0' * Call stack at first throw: ( 0 CoreFoundation 0x9439a6f4 __raiseError + 168 1 libobjc.A.dylib 0x902f58bc objc_exception_throw + 80 2 CoreFoundation 0x943a38c0 +[NSObject(NSObject) doesNotRecognizeSelector:] + 0 3 CoreFoundation 0x943a0b54 ___forwarding___ + 380 4 CoreFoundation 0x943a0e08 _CF_forwarding_prep_0 + 216 5 atos 0x00003428 0x0 + 13352 6 atos 0x00002904 0x0 + 10500 7 atos 0x00002784 0x0 + 10116 ) 0 0x0048fdcf 1 0x0049054a 2 0x95fdd42b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc36c edx: 0x95f772fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc3a8 esp: 0xbfffc36c ss: 0x0000001f efl: 0x00000206 eip: 0x95f772fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libirc.dylib 0x92564000 - 0x92567fff /usr/lib/system/libmathCommon.A.dylib 0x92aca000 - 0x92ad8fff /usr/lib/libz.1.dylib 0x95f76000 - 0x9611bfff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=568, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.3 build 10D573 Wed Jan 5 10:23:47 2011 2011-01-05 10:23:48.522 atos[1034:60b] -[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0 2011-01-05 10:23:48.574 atos[1034:60b] * Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[NSMachOFileImage initWithPath:]: unrecognized selector sent to instance 0x313fc0' * Call stack at first throw: ( 0 CoreFoundation 0x9439a6f4 __raiseError + 168 1 libobjc.A.dylib 0x902f58bc objc_exception_throw + 80 2 CoreFoundation 0x943a38c0 +[NSObject(NSObject) doesNotRecognizeSelector:] + 0 3 CoreFoundation 0x943a0b54 ___forwarding___ + 380 4 CoreFoundation 0x943a0e08 _CF_forwarding_prep_0 + 216 5 atos 0x00003428 0x0 + 13352 6 atos 0x00002904 0x0 + 10500 7 atos 0x00002784 0x0 + 10116 ) 0 0x0048fdcf 1 0x0049054a 2 0x95fdd42b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc36c edx: 0x95f772fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc3a8 esp: 0xbfffc36c ss: 0x0000001f efl: 0x00000206 eip: 0x95f772fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v7z4_1999_200_006696102/lib/libirc.dylib 0x92564000 - 0x92567fff /usr/lib/system/libmathCommon.A.dylib 0x92aca000 - 0x92ad8fff /usr/lib/libz.1.dylib 0x95f76000 - 0x9611bfff /usr/lib/libSystem.B.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1028, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (522): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Jan 2011 19:17:55	1120730	11740282	famous_v7z4_1999_200_006696102_3	262,106	50,215	0.1916
10 Jan 2011 22:38:15	1120730	11740282	famous_v7z4_1999_200_006696102_3	252,746	48,411	0.1915
09 Jan 2011 15:14:21	1120730	11740282	famous_v7z4_1999_200_006696102_3	243,386	46,672	0.1918
09 Jan 2011 14:42:29	1120730	11740282	famous_v7z4_1999_200_006696102_3	234,026	44,872	0.1917
09 Jan 2011 14:42:29	1120730	11740282	famous_v7z4_1999_200_006696102_3	224,666	43,037	0.1916
09 Jan 2011 14:42:29	1120730	11740282	famous_v7z4_1999_200_006696102_3	215,306	41,230	0.1915
07 Jan 2011 20:13:02	1120730	11740282	famous_v7z4_1999_200_006696102_3	205,946	39,432	0.1915
07 Jan 2011 20:11:14	1120730	11740282	famous_v7z4_1999_200_006696102_3	196,586	37,635	0.1914
07 Jan 2011 20:07:53	1120730	11740282	famous_v7z4_1999_200_006696102_3	187,226	35,837	0.1914
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	177,866	34,036	0.1914
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	168,506	32,241	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	159,146	30,445	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	149,786	28,657	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	140,426	26,866	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	131,066	25,077	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	121,706	23,284	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	112,346	21,493	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	102,986	19,705	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	93,626	17,914	0.1913
07 Jan 2011 20:05:38	1120730	11740282	famous_v7z4_1999_200_006696102_3	84,266	16,115	0.1912