Task 12724492

Name	famous_xpfn_899_200_007094794_2
Workunit	7298094
Created	26 Mar 2011, 0:34:03 UTC
Sent	26 Mar 2011, 0:34:04 UTC
Report deadline	25 Jun 2011, 8:01:15 UTC
Received	9 Apr 2011, 0:02:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	818212
Run time	9 days 1 hours 34 min 59 sec
CPU time	6 days 10 hours 37 min 38 sec
Validate state	Invalid
Credit	4,879.38
Device peak FLOPS	1.86 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> ot running, exiting, bRetVal = 1, checkPID=0, selfPID=22633, iMonCtr=1 Model crash detected, will try to restart... (22633): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22725): No heartbeat from core client for 30 sec - exiting (22725): No heartbeat from core client for 30 sec - exiting (22725): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22774): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22833): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22855): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22855): No heartbeat from core client for 30 sec - exiting (22871): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (22964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23038): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23094): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23094): No heartbeat from core client for 30 sec - exiting (23105): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23275): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23323): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23323): No heartbeat from core client for 30 sec - exiting (23365): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23365): No heartbeat from core client for 30 sec - exiting (23396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23534): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23669): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23677): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23899): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (23979): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Thu Apr 7 09:07:07 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc4ac edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc4e8 esp: 0xbfffc4ac ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24006, iMonCtr=1 Model crash detected, will try to restart... (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting (24006): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24093): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24274): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24437): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24462): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24588): No heartbeat from core client for 30 sec - exiting (24588): No heartbeat from core client for 30 sec - exiting (24611): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24701): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24726): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24745): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24758): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24821): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24982): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25115): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25151): No heartbeat from core client for 30 sec - exiting (25151): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25457): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25475): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25521): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25578): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25589): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25718): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25769): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (25892): No heartbeat from core client for 30 sec - exiting (25892): No heartbeat from core client for 30 sec - exiting (25892): No heartbeat from core client for 30 sec - exiting (25892): No heartbeat from core client for 30 sec - exiting (25892): No heartbeat from core client for 30 sec - exiting (25892): No heartbeat from core client for 30 sec - exiting (25892): No heartbeat from core client for 30 sec - exiting (25892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26134): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (26294): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (26300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26447): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Thu Apr 7 15:56:49 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc4ac edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc4e8 esp: 0xbfffc4ac ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26657, iMonCtr=1 Model crash detected, will try to restart... (26657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26657): No heartbeat from core client for 30 sec - exiting (26698): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26698): No heartbeat from core client for 30 sec - exiting (26724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26770): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting (26810): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26831): No heartbeat from core client for 30 sec - exiting (26831): No heartbeat from core client for 30 sec - exiting (26831): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26938): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (26938): No heartbeat from core client for 30 sec - exiting (27042): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting (27137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27234): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting (27306): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27435): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27721): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27765): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27765): No heartbeat from core client for 30 sec - exiting (27903): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27903): No heartbeat from core client for 30 sec - exiting (27903): No heartbeat from core client for 30 sec - exiting (28005): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28228): No heartbeat from core client for 30 sec - exiting (28238): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28238): No heartbeat from core client for 30 sec - exiting (28254): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28271): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28282): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28359): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28359): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting (28694): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Thu Apr 7 21:37:59 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc4ac edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc4e8 esp: 0xbfffc4ac ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28764, iMonCtr=1 Model crash detected, will try to restart... (28764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28878): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (29022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29106): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29121): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29121): No heartbeat from core client for 30 sec - exiting (29138): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29183): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29237): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29262): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29287): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29302): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29366): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29379): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29406): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29455): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29505): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29605): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29699): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Fri Apr 8 00:08:15 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x003f5826 7 0x00450bd8 8 0x004698c0 9 0x000026b6 10 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd53c edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd578 esp: 0xbfffd53c ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29761, iMonCtr=1 Model crash detected, will try to restart... (29761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29835): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29887): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29894): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (29978): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30055): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30170): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30214): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30717): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (30914): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Fri Apr 8 03:18:16 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc4ac edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc4e8 esp: 0xbfffc4ac ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=31073, iMonCtr=1 Model crash detected, will try to restart... (31073): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31127): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31127): No heartbeat from core client for 30 sec - exiting (31127): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting (31184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31218): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31331): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting (31348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31362): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31362): No heartbeat from core client for 30 sec - exiting (31396): No heartbeat from core client for 30 sec - exiting (31396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31650): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31690): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31690): No heartbeat from core client for 30 sec - exiting (31893): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31931): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (31931): No heartbeat from core client for 30 sec - exiting (31931): No heartbeat from core client for 30 sec - exiting (31931): No heartbeat from core client for 30 sec - exiting (31931): No heartbeat from core client for 30 sec - exiting (31949): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32477): No heartbeat from core client for 30 sec - exiting (32477): No heartbeat from core client for 30 sec - exiting (32600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32863): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32863): No heartbeat from core client for 30 sec - exiting (32923): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32957): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (32996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Fri Apr 8 08:31:04 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc4ac edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc4e8 esp: 0xbfffc4ac ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=33062, iMonCtr=1 Model crash detected, will try to restart... (33062): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33326): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33326): No heartbeat from core client for 30 sec - exiting (33348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting (33485): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33542): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33654): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33654): No heartbeat from core client for 30 sec - exiting (33688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33786): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (33933): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34033): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34107): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (34430): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34742): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34823): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34895): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (34989): No heartbeat from core client for 30 sec - exiting (34989): No heartbeat from core client for 30 sec - exiting (34989): No heartbeat from core client for 30 sec - exiting (34989): No heartbeat from core client for 30 sec - exiting (34989): No heartbeat from core client for 30 sec - exiting (34989): No heartbeat from core client for 30 sec - exiting (34989): No heartbeat from core client for 30 sec - exiting (34989): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35043): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35061): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting (35113): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35113): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Fri Apr 8 13:57:07 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc4ac edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc4e8 esp: 0xbfffc4ac ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35150, iMonCtr=1 Model crash detected, will try to restart... (35150): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35187): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35266): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35285): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35683): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35757): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (35774): No heartbeat from core client for 30 sec - exiting (35774): No heartbeat from core client for 30 sec - exiting (35774): No heartbeat from core client for 30 sec - exiting (35774): No heartbeat from core client for 30 sec - exiting (35774): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Fri Apr 8 16:09:56 2011 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x98d3645b 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc4ac edx: 0x98cd009a edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc4e8 esp: 0xbfffc4ac ss: 0x0000001f efl: 0x00000206 eip: 0x98cd009a cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/lib/libirc.dylib 0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib 0x98ccf000 - 0x98e76fff /usr/lib/libSystem.B.dylib 0x99297000 - 0x992a5fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=36003, iMonCtr=1 Model crash detected, will try to restart... (36003): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36046): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36129): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36165): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36173): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36233): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (36339): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36597): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36613): No heartbeat from core client for 30 sec - exiting (36613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (36951): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy no start tag in app init data (37085): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/dataout/stdout_um.txt Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=37025, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (37025): Can't parse init data file - running in standalone mode no start tag in app init data (37087): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/dataout/stdout_um.txt Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=37025, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (37025): Can't parse init data file - running in standalone mode no start tag in app init data (37089): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xpfn_899_200_007094794/dataout/stdout_um.txt Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=37025, iMonCtr=1 Model crash detected, will try to restart... no start tag in app init data (37025): Can't parse init data file - running in standalone mode no start tag in app init data (37090): Can't parse init data file - running in standalone mode forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/proModel crash detected, will try to restart... Sorry, too many model crashes! :-( </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Apr 2011 22:06:31	818212	12724492	famous_xpfn_899_200_007094794_2	1,478,906	554,949	0.3752
08 Apr 2011 17:30:06	818212	12724492	famous_xpfn_899_200_007094794_2	1,469,546	551,507	0.3753
08 Apr 2011 12:33:21	818212	12724492	famous_xpfn_899_200_007094794_2	1,460,186	548,063	0.3753
08 Apr 2011 07:48:36	818212	12724492	famous_xpfn_899_200_007094794_2	1,450,826	544,608	0.3754
08 Apr 2011 01:53:34	818212	12724492	famous_xpfn_899_200_007094794_2	1,441,466	541,197	0.3754
07 Apr 2011 20:04:11	818212	12724492	famous_xpfn_899_200_007094794_2	1,432,106	537,782	0.3755
07 Apr 2011 15:28:55	818212	12724492	famous_xpfn_899_200_007094794_2	1,422,746	534,498	0.3757
07 Apr 2011 09:16:59	818212	12724492	famous_xpfn_899_200_007094794_2	1,413,386	531,074	0.3757
07 Apr 2011 04:25:05	818212	12724492	famous_xpfn_899_200_007094794_2	1,404,026	527,650	0.3758
07 Apr 2011 00:30:33	818212	12724492	famous_xpfn_899_200_007094794_2	1,394,666	524,213	0.3759
06 Apr 2011 20:11:53	818212	12724492	famous_xpfn_899_200_007094794_2	1,385,306	520,775	0.3759
06 Apr 2011 15:15:46	818212	12724492	famous_xpfn_899_200_007094794_2	1,375,946	517,484	0.3761
06 Apr 2011 11:02:48	818212	12724492	famous_xpfn_899_200_007094794_2	1,366,586	514,051	0.3762
06 Apr 2011 06:21:16	818212	12724492	famous_xpfn_899_200_007094794_2	1,357,226	510,597	0.3762
06 Apr 2011 01:17:17	818212	12724492	famous_xpfn_899_200_007094794_2	1,347,866	507,168	0.3763
03 Apr 2011 06:20:08	818212	12724492	famous_xpfn_899_200_007094794_2	1,338,506	503,724	0.3763
03 Apr 2011 00:56:24	818212	12724492	famous_xpfn_899_200_007094794_2	1,329,146	500,274	0.3764
02 Apr 2011 19:32:26	818212	12724492	famous_xpfn_899_200_007094794_2	1,319,786	496,816	0.3764
02 Apr 2011 18:39:54	818212	12724492	famous_xpfn_899_200_007094794_2	1,310,426	493,107	0.3763
02 Apr 2011 18:38:26	818212	12724492	famous_xpfn_899_200_007094794_2	1,301,066	489,393	0.3761