Task 19135404

Name	hadcm3n_sa9t_198012_480_010222856_1
Workunit	10222856
Created	5 Dec 2015, 3:58:45 UTC
Sent	5 Dec 2015, 4:00:09 UTC
Report deadline	16 Nov 2016, 9:20:09 UTC
Received	15 Dec 2015, 4:00:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1280444
Run time	7 days 9 hours 19 min 43 sec
CPU time	6 days 2 hours 49 min 39 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	3.85 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.12</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x806804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x806800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x1016400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x2000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(41921,0xa08881d4) malloc: * error for object 0x2000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1021 Mon Dec 14 16:08:00 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000dfff /usr/lib/system/libmacho.dylib 0x900af000 - 0x900b2fff /usr/lib/system/libdyld.dylib 0x906e2000 - 0x906e2fff /usr/lib/system/libunc.dylib 0x9073c000 - 0x90743fff /usr/lib/system/libunwind.dylib 0x909ce000 - 0x909cffff /usr/lib/libSystem.B.dylib 0x90c49000 - 0x90c4bfff /usr/lib/system/libsystem_coreservices.dylib 0x90d1b000 - 0x90d41fff /usr/lib/system/libxpc.dylib 0x91256000 - 0x9127ffff /usr/lib/system/libsystem_info.dylib 0x916d8000 - 0x916e4fff /usr/lib/system/libcommonCrypto.dylib 0x9206c000 - 0x9206dfff /usr/lib/system/libsystem_blocks.dylib 0x92636000 - 0x92673fff /usr/lib/system/libsystem_network.dylib 0x92d57000 - 0x92d5dfff /usr/lib/system/libsystem_platform.dylib 0x938ed000 - 0x938f6fff /usr/lib/system/libcopyfile.dylib 0x938f7000 - 0x9390efff /usr/lib/system/libsystem_asl.dylib 0x93993000 - 0x939a1fff /usr/lib/libz.1.dylib 0x944b3000 - 0x944b3fff /usr/lib/system/libkeymgr.dylib 0x944b4000 - 0x944b6fff /usr/lib/system/libsystem_secinit.dylib 0x944b7000 - 0x944bffff /usr/lib/system/libsystem_pthread.dylib 0x946a4000 - 0x946aafff /usr/lib/system/libsystem_trace.dylib 0x946ab000 - 0x946b1fff /usr/lib/system/libsystem_networkextension.dylib 0x94870000 - 0x94905fff /usr/lib/system/libsystem_c.dylib 0x94c5a000 - 0x94c79fff /usr/lib/system/libsystem_kernel.dylib 0x96f0f000 - 0x96f18fff /usr/lib/system/libsystem_notify.dylib 0x97727000 - 0x9772cfff /usr/lib/system/libcompiler_rt.dylib 0x97789000 - 0x9778afff /usr/lib/system/libremovefile.dylib 0x9778b000 - 0x9778dfff /usr/lib/system/libsystem_configuration.dylib 0x97a35000 - 0x97a46fff /usr/lib/system/libsystem_coretls.dylib 0x97a73000 - 0x97a73fff /usr/lib/system/liblaunch.dylib 0x986a6000 - 0x986cdfff /usr/lib/system/libdispatch.dylib 0x993c8000 - 0x993cafff /usr/lib/system/libsystem_sandbox.dylib 0x99430000 - 0x9949cfff /usr/lib/system/libcorecrypto.dylib 0x995df000 - 0x995e3fff /usr/lib/system/libcache.dylib 0x995e4000 - 0x99617fff /usr/lib/system/libsystem_m.dylib 0x9977a000 - 0x9977cfff /usr/lib/system/libquarantine.dylib 0x9c164000 - 0x9c17dfff /usr/lib/system/libsystem_malloc.dylib 0x9c1b9000 - 0x9c1c1fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=72640, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1021 Mon Dec 14 16:08:04 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000dfff /usr/lib/system/libmacho.dylib 0x900af000 - 0x900b2fff /usr/lib/system/libdyld.dylib 0x906e2000 - 0x906e2fff /usr/lib/system/libunc.dylib 0x9073c000 - 0x90743fff /usr/lib/system/libunwind.dylib 0x909ce000 - 0x909cffff /usr/lib/libSystem.B.dylib 0x90c49000 - 0x90c4bfff /usr/lib/system/libsystem_coreservices.dylib 0x90d1b000 - 0x90d41fff /usr/lib/system/libxpc.dylib 0x91256000 - 0x9127ffff /usr/lib/system/libsystem_info.dylib 0x916d8000 - 0x916e4fff /usr/lib/system/libcommonCrypto.dylib 0x9206c000 - 0x9206dfff /usr/lib/system/libsystem_blocks.dylib 0x92636000 - 0x92673fff /usr/lib/system/libsystem_network.dylib 0x92d57000 - 0x92d5dfff /usr/lib/system/libsystem_platform.dylib 0x938ed000 - 0x938f6fff /usr/lib/system/libcopyfile.dylib 0x938f7000 - 0x9390efff /usr/lib/system/libsystem_asl.dylib 0x93993000 - 0x939a1fff /usr/lib/libz.1.dylib 0x944b3000 - 0x944b3fff /usr/lib/system/libkeymgr.dylib 0x944b4000 - 0x944b6fff /usr/lib/system/libsystem_secinit.dylib 0x944b7000 - 0x944bffff /usr/lib/system/libsystem_pthread.dylib 0x946a4000 - 0x946aafff /usr/lib/system/libsystem_trace.dylib 0x946ab000 - 0x946b1fff /usr/lib/system/libsystem_networkextension.dylib 0x94870000 - 0x94905fff /usr/lib/system/libsystem_c.dylib 0x94c5a000 - 0x94c79fff /usr/lib/system/libsystem_kernel.dylib 0x96f0f000 - 0x96f18fff /usr/lib/system/libsystem_notify.dylib 0x97727000 - 0x9772cfff /usr/lib/system/libcompiler_rt.dylib 0x97789000 - 0x9778afff /usr/lib/system/libremovefile.dylib 0x9778b000 - 0x9778dfff /usr/lib/system/libsystem_configuration.dylib 0x97a35000 - 0x97a46fff /usr/lib/system/libsystem_coretls.dylib 0x97a73000 - 0x97a73fff /usr/lib/system/liblaunch.dylib 0x986a6000 - 0x986cdfff /usr/lib/system/libdispatch.dylib 0x993c8000 - 0x993cafff /usr/lib/system/libsystem_sandbox.dylib 0x99430000 - 0x9949cfff /usr/lib/system/libcorecrypto.dylib 0x995df000 - 0x995e3fff /usr/lib/system/libcache.dylib 0x995e4000 - 0x99617fff /usr/lib/system/libsystem_m.dylib 0x9977a000 - 0x9977cfff /usr/lib/system/libquarantine.dylib 0x9c164000 - 0x9c17dfff /usr/lib/system/libsystem_malloc.dylib 0x9c1b9000 - 0x9c1c1fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=72640, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1021 Mon Dec 14 16:08:06 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000dfff /usr/lib/system/libmacho.dylib 0x900af000 - 0x900b2fff /usr/lib/system/libdyld.dylib 0x906e2000 - 0x906e2fff /usr/lib/system/libunc.dylib 0x9073c000 - 0x90743fff /usr/lib/system/libunwind.dylib 0x909ce000 - 0x909cffff /usr/lib/libSystem.B.dylib 0x90c49000 - 0x90c4bfff /usr/lib/system/libsystem_coreservices.dylib 0x90d1b000 - 0x90d41fff /usr/lib/system/libxpc.dylib 0x91256000 - 0x9127ffff /usr/lib/system/libsystem_info.dylib 0x916d8000 - 0x916e4fff /usr/lib/system/libcommonCrypto.dylib 0x9206c000 - 0x9206dfff /usr/lib/system/libsystem_blocks.dylib 0x92636000 - 0x92673fff /usr/lib/system/libsystem_network.dylib 0x92d57000 - 0x92d5dfff /usr/lib/system/libsystem_platform.dylib 0x938ed000 - 0x938f6fff /usr/lib/system/libcopyfile.dylib 0x938f7000 - 0x9390efff /usr/lib/system/libsystem_asl.dylib 0x93993000 - 0x939a1fff /usr/lib/libz.1.dylib 0x944b3000 - 0x944b3fff /usr/lib/system/libkeymgr.dylib 0x944b4000 - 0x944b6fff /usr/lib/system/libsystem_secinit.dylib 0x944b7000 - 0x944bffff /usr/lib/system/libsystem_pthread.dylib 0x946a4000 - 0x946aafff /usr/lib/system/libsystem_trace.dylib 0x946ab000 - 0x946b1fff /usr/lib/system/libsystem_networkextension.dylib 0x94870000 - 0x94905fff /usr/lib/system/libsystem_c.dylib 0x94c5a000 - 0x94c79fff /usr/lib/system/libsystem_kernel.dylib 0x96f0f000 - 0x96f18fff /usr/lib/system/libsystem_notify.dylib 0x97727000 - 0x9772cfff /usr/lib/system/libcompiler_rt.dylib 0x97789000 - 0x9778afff /usr/lib/system/libremovefile.dylib 0x9778b000 - 0x9778dfff /usr/lib/system/libsystem_configuration.dylib 0x97a35000 - 0x97a46fff /usr/lib/system/libsystem_coretls.dylib 0x97a73000 - 0x97a73fff /usr/lib/system/liblaunch.dylib 0x986a6000 - 0x986cdfff /usr/lib/system/libdispatch.dylib 0x993c8000 - 0x993cafff /usr/lib/system/libsystem_sandbox.dylib 0x99430000 - 0x9949cfff /usr/lib/system/libcorecrypto.dylib 0x995df000 - 0x995e3fff /usr/lib/system/libcache.dylib 0x995e4000 - 0x99617fff /usr/lib/system/libsystem_m.dylib 0x9977a000 - 0x9977cfff /usr/lib/system/libquarantine.dylib 0x9c164000 - 0x9c17dfff /usr/lib/system/libsystem_malloc.dylib 0x9c1b9000 - 0x9c1c1fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=72640, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1021 Mon Dec 14 16:08:09 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000dfff /usr/lib/system/libmacho.dylib 0x900af000 - 0x900b2fff /usr/lib/system/libdyld.dylib 0x906e2000 - 0x906e2fff /usr/lib/system/libunc.dylib 0x9073c000 - 0x90743fff /usr/lib/system/libunwind.dylib 0x909ce000 - 0x909cffff /usr/lib/libSystem.B.dylib 0x90c49000 - 0x90c4bfff /usr/lib/system/libsystem_coreservices.dylib 0x90d1b000 - 0x90d41fff /usr/lib/system/libxpc.dylib 0x91256000 - 0x9127ffff /usr/lib/system/libsystem_info.dylib 0x916d8000 - 0x916e4fff /usr/lib/system/libcommonCrypto.dylib 0x9206c000 - 0x9206dfff /usr/lib/system/libsystem_blocks.dylib 0x92636000 - 0x92673fff /usr/lib/system/libsystem_network.dylib 0x92d57000 - 0x92d5dfff /usr/lib/system/libsystem_platform.dylib 0x938ed000 - 0x938f6fff /usr/lib/system/libcopyfile.dylib 0x938f7000 - 0x9390efff /usr/lib/system/libsystem_asl.dylib 0x93993000 - 0x939a1fff /usr/lib/libz.1.dylib 0x944b3000 - 0x944b3fff /usr/lib/system/libkeymgr.dylib 0x944b4000 - 0x944b6fff /usr/lib/system/libsystem_secinit.dylib 0x944b7000 - 0x944bffff /usr/lib/system/libsystem_pthread.dylib 0x946a4000 - 0x946aafff /usr/lib/system/libsystem_trace.dylib 0x946ab000 - 0x946b1fff /usr/lib/system/libsystem_networkextension.dylib 0x94870000 - 0x94905fff /usr/lib/system/libsystem_c.dylib 0x94c5a000 - 0x94c79fff /usr/lib/system/libsystem_kernel.dylib 0x96f0f000 - 0x96f18fff /usr/lib/system/libsystem_notify.dylib 0x97727000 - 0x9772cfff /usr/lib/system/libcompiler_rt.dylib 0x97789000 - 0x9778afff /usr/lib/system/libremovefile.dylib 0x9778b000 - 0x9778dfff /usr/lib/system/libsystem_configuration.dylib 0x97a35000 - 0x97a46fff /usr/lib/system/libsystem_coretls.dylib 0x97a73000 - 0x97a73fff /usr/lib/system/liblaunch.dylib 0x986a6000 - 0x986cdfff /usr/lib/system/libdispatch.dylib 0x993c8000 - 0x993cafff /usr/lib/system/libsystem_sandbox.dylib 0x99430000 - 0x9949cfff /usr/lib/system/libcorecrypto.dylib 0x995df000 - 0x995e3fff /usr/lib/system/libcache.dylib 0x995e4000 - 0x99617fff /usr/lib/system/libsystem_m.dylib 0x9977a000 - 0x9977cfff /usr/lib/system/libquarantine.dylib 0x9c164000 - 0x9c17dfff /usr/lib/system/libsystem_malloc.dylib 0x9c1b9000 - 0x9c1c1fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=72640, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1021 Mon Dec 14 16:08:12 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000dfff /usr/lib/system/libmacho.dylib 0x900af000 - 0x900b2fff /usr/lib/system/libdyld.dylib 0x906e2000 - 0x906e2fff /usr/lib/system/libunc.dylib 0x9073c000 - 0x90743fff /usr/lib/system/libunwind.dylib 0x909ce000 - 0x909cffff /usr/lib/libSystem.B.dylib 0x90c49000 - 0x90c4bfff /usr/lib/system/libsystem_coreservices.dylib 0x90d1b000 - 0x90d41fff /usr/lib/system/libxpc.dylib 0x91256000 - 0x9127ffff /usr/lib/system/libsystem_info.dylib 0x916d8000 - 0x916e4fff /usr/lib/system/libcommonCrypto.dylib 0x9206c000 - 0x9206dfff /usr/lib/system/libsystem_blocks.dylib 0x92636000 - 0x92673fff /usr/lib/system/libsystem_network.dylib 0x92d57000 - 0x92d5dfff /usr/lib/system/libsystem_platform.dylib 0x938ed000 - 0x938f6fff /usr/lib/system/libcopyfile.dylib 0x938f7000 - 0x9390efff /usr/lib/system/libsystem_asl.dylib 0x93993000 - 0x939a1fff /usr/lib/libz.1.dylib 0x944b3000 - 0x944b3fff /usr/lib/system/libkeymgr.dylib 0x944b4000 - 0x944b6fff /usr/lib/system/libsystem_secinit.dylib 0x944b7000 - 0x944bffff /usr/lib/system/libsystem_pthread.dylib 0x946a4000 - 0x946aafff /usr/lib/system/libsystem_trace.dylib 0x946ab000 - 0x946b1fff /usr/lib/system/libsystem_networkextension.dylib 0x94870000 - 0x94905fff /usr/lib/system/libsystem_c.dylib 0x94c5a000 - 0x94c79fff /usr/lib/system/libsystem_kernel.dylib 0x96f0f000 - 0x96f18fff /usr/lib/system/libsystem_notify.dylib 0x97727000 - 0x9772cfff /usr/lib/system/libcompiler_rt.dylib 0x97789000 - 0x9778afff /usr/lib/system/libremovefile.dylib 0x9778b000 - 0x9778dfff /usr/lib/system/libsystem_configuration.dylib 0x97a35000 - 0x97a46fff /usr/lib/system/libsystem_coretls.dylib 0x97a73000 - 0x97a73fff /usr/lib/system/liblaunch.dylib 0x986a6000 - 0x986cdfff /usr/lib/system/libdispatch.dylib 0x993c8000 - 0x993cafff /usr/lib/system/libsystem_sandbox.dylib 0x99430000 - 0x9949cfff /usr/lib/system/libcorecrypto.dylib 0x995df000 - 0x995e3fff /usr/lib/system/libcache.dylib 0x995e4000 - 0x99617fff /usr/lib/system/libsystem_m.dylib 0x9977a000 - 0x9977cfff /usr/lib/system/libquarantine.dylib 0x9c164000 - 0x9c17dfff /usr/lib/system/libsystem_malloc.dylib 0x9c1b9000 - 0x9c1c1fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=72640, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F1021 Mon Dec 14 16:08:14 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcc78 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x9000dfff /usr/lib/system/libmacho.dylib 0x900af000 - 0x900b2fff /usr/lib/system/libdyld.dylib 0x906e2000 - 0x906e2fff /usr/lib/system/libunc.dylib 0x9073c000 - 0x90743fff /usr/lib/system/libunwind.dylib 0x909ce000 - 0x909cffff /usr/lib/libSystem.B.dylib 0x90c49000 - 0x90c4bfff /usr/lib/system/libsystem_coreservices.dylib 0x90d1b000 - 0x90d41fff /usr/lib/system/libxpc.dylib 0x91256000 - 0x9127ffff /usr/lib/system/libsystem_info.dylib 0x916d8000 - 0x916e4fff /usr/lib/system/libcommonCrypto.dylib 0x9206c000 - 0x9206dfff /usr/lib/system/libsystem_blocks.dylib 0x92636000 - 0x92673fff /usr/lib/system/libsystem_network.dylib 0x92d57000 - 0x92d5dfff /usr/lib/system/libsystem_platform.dylib 0x938ed000 - 0x938f6fff /usr/lib/system/libcopyfile.dylib 0x938f7000 - 0x9390efff /usr/lib/system/libsystem_asl.dylib 0x93993000 - 0x939a1fff /usr/lib/libz.1.dylib 0x944b3000 - 0x944b3fff /usr/lib/system/libkeymgr.dylib 0x944b4000 - 0x944b6fff /usr/lib/system/libsystem_secinit.dylib 0x944b7000 - 0x944bffff /usr/lib/system/libsystem_pthread.dylib 0x946a4000 - 0x946aafff /usr/lib/system/libsystem_trace.dylib 0x946ab000 - 0x946b1fff /usr/lib/system/libsystem_networkextension.dylib 0x94870000 - 0x94905fff /usr/lib/system/libsystem_c.dylib 0x94c5a000 - 0x94c79fff /usr/lib/system/libsystem_kernel.dylib 0x96f0f000 - 0x96f18fff /usr/lib/system/libsystem_notify.dylib 0x97727000 - 0x9772cfff /usr/lib/system/libcompiler_rt.dylib 0x97789000 - 0x9778afff /usr/lib/system/libremovefile.dylib 0x9778b000 - 0x9778dfff /usr/lib/system/libsystem_configuration.dylib 0x97a35000 - 0x97a46fff /usr/lib/system/libsystem_coretls.dylib 0x97a73000 - 0x97a73fff /usr/lib/system/liblaunch.dylib 0x986a6000 - 0x986cdfff /usr/lib/system/libdispatch.dylib 0x993c8000 - 0x993cafff /usr/lib/system/libsystem_sandbox.dylib 0x99430000 - 0x9949cfff /usr/lib/system/libcorecrypto.dylib 0x995df000 - 0x995e3fff /usr/lib/system/libcache.dylib 0x995e4000 - 0x99617fff /usr/lib/system/libsystem_m.dylib 0x9977a000 - 0x9977cfff /usr/lib/system/libquarantine.dylib 0x9c164000 - 0x9c17dfff /usr/lib/system/libsystem_malloc.dylib 0x9c1b9000 - 0x9c1c1fff /usr/lib/system/libsystem_dnssd.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=72640, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Dec 2015 04:00:32	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	440,640	519,221	1.1783
14 Dec 2015 04:03:55	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	414,720	488,752	1.1785
14 Dec 2015 04:03:55	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	388,800	459,146	1.1809
13 Dec 2015 04:02:59	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	362,880	429,344	1.1832
12 Dec 2015 05:46:14	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	336,960	399,262	1.1849
12 Dec 2015 04:04:06	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	311,040	368,365	1.1843
11 Dec 2015 04:05:05	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	285,120	338,271	1.1864
11 Dec 2015 04:05:05	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	259,200	308,085	1.1886
11 Dec 2015 04:05:05	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	233,280	277,699	1.1904
09 Dec 2015 05:02:47	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	207,360	247,080	1.1916
09 Dec 2015 04:01:54	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	181,440	216,796	1.1949
08 Dec 2015 04:02:24	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	155,520	183,997	1.1831
07 Dec 2015 07:33:53	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	129,600	153,160	1.1818
07 Dec 2015 04:01:04	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	103,680	122,606	1.1825
07 Dec 2015 04:01:04	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	77,760	91,963	1.1827
06 Dec 2015 04:00:20	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	51,840	61,275	1.1820
06 Dec 2015 04:00:20	1280444	19135404	hadcm3n_sa9t_198012_480_010222856_1	25,920	30,642	1.1822