Task 16230227

Name	hadcm3n_7jyu_1980_40_008437161_1
Workunit	8588017
Created	14 Jan 2014, 6:26:02 UTC
Sent	14 Jan 2014, 6:27:02 UTC
Report deadline	15 Apr 2014, 13:54:13 UTC
Received	18 Mar 2014, 18:27:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1229712
Run time	9 days 0 hours 51 min 49 sec
CPU time	7 days 2 hours 50 min 42 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	3.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xae2404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xae2400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4084,0xa03f41a8) malloc: * error for object 0xacd400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:44:26 (11139): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C64 Tue Mar 18 18:44:41 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90b0f000 - 0x90b33fff /usr/lib/system/libxpc.dylib 0x912a4000 - 0x912a9fff /usr/lib/system/libsystem_platform.dylib 0x9243d000 - 0x92465fff /usr/lib/system/libsystem_info.dylib 0x92474000 - 0x9249ffff /usr/lib/system/libsystem_network.dylib 0x924a1000 - 0x924a3fff /usr/lib/system/libquarantine.dylib 0x92f7f000 - 0x92f80fff /usr/lib/system/libsystem_blocks.dylib 0x9305c000 - 0x930acfff /usr/lib/system/libcorecrypto.dylib 0x935a3000 - 0x935c0fff /usr/lib/system/libsystem_kernel.dylib 0x935c1000 - 0x935cafff /usr/lib/system/libsystem_notify.dylib 0x9422e000 - 0x94234fff /usr/lib/system/libunwind.dylib 0x94ffd000 - 0x95001fff /usr/lib/system/libmacho.dylib 0x95088000 - 0x95088fff /usr/lib/system/libkeymgr.dylib 0x95754000 - 0x9575cfff /usr/lib/system/libcopyfile.dylib 0x9587d000 - 0x9587efff /usr/lib/system/libsystem_sandbox.dylib 0x95a99000 - 0x95b2bfff /usr/lib/system/libsystem_c.dylib 0x96068000 - 0x96076fff /usr/lib/libz.1.dylib 0x960a5000 - 0x960a7fff /usr/lib/system/libsystem_configuration.dylib 0x96f06000 - 0x96f0efff /usr/lib/system/liblaunch.dylib 0x96f12000 - 0x96f2afff /usr/lib/system/libdispatch.dylib 0x96f2e000 - 0x96f39fff /usr/lib/system/libcommonCrypto.dylib 0x97230000 - 0x97233fff /usr/lib/system/libdyld.dylib 0x97266000 - 0x97267fff /usr/lib/libSystem.B.dylib 0x98082000 - 0x98089fff /usr/lib/system/libsystem_pthread.dylib 0x9930a000 - 0x9930ffff /usr/lib/system/libcompiler_rt.dylib 0x99397000 - 0x9939bfff /usr/lib/system/libcache.dylib 0x99848000 - 0x99849fff /usr/lib/system/libunc.dylib 0x9984a000 - 0x9987bfff /usr/lib/system/libsystem_m.dylib 0x99880000 - 0x99892fff /usr/lib/system/libsystem_asl.dylib 0x9a6eb000 - 0x9a6ecfff /usr/lib/system/libremovefile.dylib 0x9b65c000 - 0x9b664fff /usr/lib/system/libsystem_dnssd.dylib 0x9bd7b000 - 0x9bd93fff /usr/lib/system/libsystem_malloc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19457, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C64 Tue Mar 18 18:44:44 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90b0f000 - 0x90b33fff /usr/lib/system/libxpc.dylib 0x912a4000 - 0x912a9fff /usr/lib/system/libsystem_platform.dylib 0x9243d000 - 0x92465fff /usr/lib/system/libsystem_info.dylib 0x92474000 - 0x9249ffff /usr/lib/system/libsystem_network.dylib 0x924a1000 - 0x924a3fff /usr/lib/system/libquarantine.dylib 0x92f7f000 - 0x92f80fff /usr/lib/system/libsystem_blocks.dylib 0x9305c000 - 0x930acfff /usr/lib/system/libcorecrypto.dylib 0x935a3000 - 0x935c0fff /usr/lib/system/libsystem_kernel.dylib 0x935c1000 - 0x935cafff /usr/lib/system/libsystem_notify.dylib 0x9422e000 - 0x94234fff /usr/lib/system/libunwind.dylib 0x94ffd000 - 0x95001fff /usr/lib/system/libmacho.dylib 0x95088000 - 0x95088fff /usr/lib/system/libkeymgr.dylib 0x95754000 - 0x9575cfff /usr/lib/system/libcopyfile.dylib 0x9587d000 - 0x9587efff /usr/lib/system/libsystem_sandbox.dylib 0x95a99000 - 0x95b2bfff /usr/lib/system/libsystem_c.dylib 0x96068000 - 0x96076fff /usr/lib/libz.1.dylib 0x960a5000 - 0x960a7fff /usr/lib/system/libsystem_configuration.dylib 0x96f06000 - 0x96f0efff /usr/lib/system/liblaunch.dylib 0x96f12000 - 0x96f2afff /usr/lib/system/libdispatch.dylib 0x96f2e000 - 0x96f39fff /usr/lib/system/libcommonCrypto.dylib 0x97230000 - 0x97233fff /usr/lib/system/libdyld.dylib 0x97266000 - 0x97267fff /usr/lib/libSystem.B.dylib 0x98082000 - 0x98089fff /usr/lib/system/libsystem_pthread.dylib 0x9930a000 - 0x9930ffff /usr/lib/system/libcompiler_rt.dylib 0x99397000 - 0x9939bfff /usr/lib/system/libcache.dylib 0x99848000 - 0x99849fff /usr/lib/system/libunc.dylib 0x9984a000 - 0x9987bfff /usr/lib/system/libsystem_m.dylib 0x99880000 - 0x99892fff /usr/lib/system/libsystem_asl.dylib 0x9a6eb000 - 0x9a6ecfff /usr/lib/system/libremovefile.dylib 0x9b65c000 - 0x9b664fff /usr/lib/system/libsystem_dnssd.dylib 0x9bd7b000 - 0x9bd93fff /usr/lib/system/libsystem_malloc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19457, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C64 Tue Mar 18 18:44:46 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90b0f000 - 0x90b33fff /usr/lib/system/libxpc.dylib 0x912a4000 - 0x912a9fff /usr/lib/system/libsystem_platform.dylib 0x9243d000 - 0x92465fff /usr/lib/system/libsystem_info.dylib 0x92474000 - 0x9249ffff /usr/lib/system/libsystem_network.dylib 0x924a1000 - 0x924a3fff /usr/lib/system/libquarantine.dylib 0x92f7f000 - 0x92f80fff /usr/lib/system/libsystem_blocks.dylib 0x9305c000 - 0x930acfff /usr/lib/system/libcorecrypto.dylib 0x935a3000 - 0x935c0fff /usr/lib/system/libsystem_kernel.dylib 0x935c1000 - 0x935cafff /usr/lib/system/libsystem_notify.dylib 0x9422e000 - 0x94234fff /usr/lib/system/libunwind.dylib 0x94ffd000 - 0x95001fff /usr/lib/system/libmacho.dylib 0x95088000 - 0x95088fff /usr/lib/system/libkeymgr.dylib 0x95754000 - 0x9575cfff /usr/lib/system/libcopyfile.dylib 0x9587d000 - 0x9587efff /usr/lib/system/libsystem_sandbox.dylib 0x95a99000 - 0x95b2bfff /usr/lib/system/libsystem_c.dylib 0x96068000 - 0x96076fff /usr/lib/libz.1.dylib 0x960a5000 - 0x960a7fff /usr/lib/system/libsystem_configuration.dylib 0x96f06000 - 0x96f0efff /usr/lib/system/liblaunch.dylib 0x96f12000 - 0x96f2afff /usr/lib/system/libdispatch.dylib 0x96f2e000 - 0x96f39fff /usr/lib/system/libcommonCrypto.dylib 0x97230000 - 0x97233fff /usr/lib/system/libdyld.dylib 0x97266000 - 0x97267fff /usr/lib/libSystem.B.dylib 0x98082000 - 0x98089fff /usr/lib/system/libsystem_pthread.dylib 0x9930a000 - 0x9930ffff /usr/lib/system/libcompiler_rt.dylib 0x99397000 - 0x9939bfff /usr/lib/system/libcache.dylib 0x99848000 - 0x99849fff /usr/lib/system/libunc.dylib 0x9984a000 - 0x9987bfff /usr/lib/system/libsystem_m.dylib 0x99880000 - 0x99892fff /usr/lib/system/libsystem_asl.dylib 0x9a6eb000 - 0x9a6ecfff /usr/lib/system/libremovefile.dylib 0x9b65c000 - 0x9b664fff /usr/lib/system/libsystem_dnssd.dylib 0x9bd7b000 - 0x9bd93fff /usr/lib/system/libsystem_malloc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19457, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C64 Tue Mar 18 18:44:49 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90b0f000 - 0x90b33fff /usr/lib/system/libxpc.dylib 0x912a4000 - 0x912a9fff /usr/lib/system/libsystem_platform.dylib 0x9243d000 - 0x92465fff /usr/lib/system/libsystem_info.dylib 0x92474000 - 0x9249ffff /usr/lib/system/libsystem_network.dylib 0x924a1000 - 0x924a3fff /usr/lib/system/libquarantine.dylib 0x92f7f000 - 0x92f80fff /usr/lib/system/libsystem_blocks.dylib 0x9305c000 - 0x930acfff /usr/lib/system/libcorecrypto.dylib 0x935a3000 - 0x935c0fff /usr/lib/system/libsystem_kernel.dylib 0x935c1000 - 0x935cafff /usr/lib/system/libsystem_notify.dylib 0x9422e000 - 0x94234fff /usr/lib/system/libunwind.dylib 0x94ffd000 - 0x95001fff /usr/lib/system/libmacho.dylib 0x95088000 - 0x95088fff /usr/lib/system/libkeymgr.dylib 0x95754000 - 0x9575cfff /usr/lib/system/libcopyfile.dylib 0x9587d000 - 0x9587efff /usr/lib/system/libsystem_sandbox.dylib 0x95a99000 - 0x95b2bfff /usr/lib/system/libsystem_c.dylib 0x96068000 - 0x96076fff /usr/lib/libz.1.dylib 0x960a5000 - 0x960a7fff /usr/lib/system/libsystem_configuration.dylib 0x96f06000 - 0x96f0efff /usr/lib/system/liblaunch.dylib 0x96f12000 - 0x96f2afff /usr/lib/system/libdispatch.dylib 0x96f2e000 - 0x96f39fff /usr/lib/system/libcommonCrypto.dylib 0x97230000 - 0x97233fff /usr/lib/system/libdyld.dylib 0x97266000 - 0x97267fff /usr/lib/libSystem.B.dylib 0x98082000 - 0x98089fff /usr/lib/system/libsystem_pthread.dylib 0x9930a000 - 0x9930ffff /usr/lib/system/libcompiler_rt.dylib 0x99397000 - 0x9939bfff /usr/lib/system/libcache.dylib 0x99848000 - 0x99849fff /usr/lib/system/libunc.dylib 0x9984a000 - 0x9987bfff /usr/lib/system/libsystem_m.dylib 0x99880000 - 0x99892fff /usr/lib/system/libsystem_asl.dylib 0x9a6eb000 - 0x9a6ecfff /usr/lib/system/libremovefile.dylib 0x9b65c000 - 0x9b664fff /usr/lib/system/libsystem_dnssd.dylib 0x9bd7b000 - 0x9bd93fff /usr/lib/system/libsystem_malloc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19457, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C64 Tue Mar 18 18:44:51 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90b0f000 - 0x90b33fff /usr/lib/system/libxpc.dylib 0x912a4000 - 0x912a9fff /usr/lib/system/libsystem_platform.dylib 0x9243d000 - 0x92465fff /usr/lib/system/libsystem_info.dylib 0x92474000 - 0x9249ffff /usr/lib/system/libsystem_network.dylib 0x924a1000 - 0x924a3fff /usr/lib/system/libquarantine.dylib 0x92f7f000 - 0x92f80fff /usr/lib/system/libsystem_blocks.dylib 0x9305c000 - 0x930acfff /usr/lib/system/libcorecrypto.dylib 0x935a3000 - 0x935c0fff /usr/lib/system/libsystem_kernel.dylib 0x935c1000 - 0x935cafff /usr/lib/system/libsystem_notify.dylib 0x9422e000 - 0x94234fff /usr/lib/system/libunwind.dylib 0x94ffd000 - 0x95001fff /usr/lib/system/libmacho.dylib 0x95088000 - 0x95088fff /usr/lib/system/libkeymgr.dylib 0x95754000 - 0x9575cfff /usr/lib/system/libcopyfile.dylib 0x9587d000 - 0x9587efff /usr/lib/system/libsystem_sandbox.dylib 0x95a99000 - 0x95b2bfff /usr/lib/system/libsystem_c.dylib 0x96068000 - 0x96076fff /usr/lib/libz.1.dylib 0x960a5000 - 0x960a7fff /usr/lib/system/libsystem_configuration.dylib 0x96f06000 - 0x96f0efff /usr/lib/system/liblaunch.dylib 0x96f12000 - 0x96f2afff /usr/lib/system/libdispatch.dylib 0x96f2e000 - 0x96f39fff /usr/lib/system/libcommonCrypto.dylib 0x97230000 - 0x97233fff /usr/lib/system/libdyld.dylib 0x97266000 - 0x97267fff /usr/lib/libSystem.B.dylib 0x98082000 - 0x98089fff /usr/lib/system/libsystem_pthread.dylib 0x9930a000 - 0x9930ffff /usr/lib/system/libcompiler_rt.dylib 0x99397000 - 0x9939bfff /usr/lib/system/libcache.dylib 0x99848000 - 0x99849fff /usr/lib/system/libunc.dylib 0x9984a000 - 0x9987bfff /usr/lib/system/libsystem_m.dylib 0x99880000 - 0x99892fff /usr/lib/system/libsystem_asl.dylib 0x9a6eb000 - 0x9a6ecfff /usr/lib/system/libremovefile.dylib 0x9b65c000 - 0x9b664fff /usr/lib/system/libsystem_dnssd.dylib 0x9bd7b000 - 0x9bd93fff /usr/lib/system/libsystem_malloc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19457, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.9.2 build 13C64 Tue Mar 18 18:44:54 2014 Thread 0 Crashed: Thread 1: -- Warning: /usr/bin/atos is moving and will be removed from a future OS X release. It is now available in the Xcode developer tools to be invoked via: `xcrun atos` To silence this warning, pass the '-d' command-line flag to this tool. -- Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffcd08 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Volumes/Ananke HD/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90b0f000 - 0x90b33fff /usr/lib/system/libxpc.dylib 0x912a4000 - 0x912a9fff /usr/lib/system/libsystem_platform.dylib 0x9243d000 - 0x92465fff /usr/lib/system/libsystem_info.dylib 0x92474000 - 0x9249ffff /usr/lib/system/libsystem_network.dylib 0x924a1000 - 0x924a3fff /usr/lib/system/libquarantine.dylib 0x92f7f000 - 0x92f80fff /usr/lib/system/libsystem_blocks.dylib 0x9305c000 - 0x930acfff /usr/lib/system/libcorecrypto.dylib 0x935a3000 - 0x935c0fff /usr/lib/system/libsystem_kernel.dylib 0x935c1000 - 0x935cafff /usr/lib/system/libsystem_notify.dylib 0x9422e000 - 0x94234fff /usr/lib/system/libunwind.dylib 0x94ffd000 - 0x95001fff /usr/lib/system/libmacho.dylib 0x95088000 - 0x95088fff /usr/lib/system/libkeymgr.dylib 0x95754000 - 0x9575cfff /usr/lib/system/libcopyfile.dylib 0x9587d000 - 0x9587efff /usr/lib/system/libsystem_sandbox.dylib 0x95a99000 - 0x95b2bfff /usr/lib/system/libsystem_c.dylib 0x96068000 - 0x96076fff /usr/lib/libz.1.dylib 0x960a5000 - 0x960a7fff /usr/lib/system/libsystem_configuration.dylib 0x96f06000 - 0x96f0efff /usr/lib/system/liblaunch.dylib 0x96f12000 - 0x96f2afff /usr/lib/system/libdispatch.dylib 0x96f2e000 - 0x96f39fff /usr/lib/system/libcommonCrypto.dylib 0x97230000 - 0x97233fff /usr/lib/system/libdyld.dylib 0x97266000 - 0x97267fff /usr/lib/libSystem.B.dylib 0x98082000 - 0x98089fff /usr/lib/system/libsystem_pthread.dylib 0x9930a000 - 0x9930ffff /usr/lib/system/libcompiler_rt.dylib 0x99397000 - 0x9939bfff /usr/lib/system/libcache.dylib 0x99848000 - 0x99849fff /usr/lib/system/libunc.dylib 0x9984a000 - 0x9987bfff /usr/lib/system/libsystem_m.dylib 0x99880000 - 0x99892fff /usr/lib/system/libsystem_asl.dylib 0x9a6eb000 - 0x9a6ecfff /usr/lib/system/libremovefile.dylib 0x9b65c000 - 0x9b664fff /usr/lib/system/libsystem_dnssd.dylib 0x9bd7b000 - 0x9bd93fff /usr/lib/system/libsystem_malloc.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19457, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Mar 2014 16:24:19	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	492,480	610,096	1.2388
16 Mar 2014 17:15:39	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	466,560	580,568	1.2444
14 Mar 2014 17:46:21	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	440,640	554,965	1.2595
12 Mar 2014 18:49:13	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	414,720	522,992	1.2611
09 Mar 2014 18:24:16	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	388,800	491,849	1.2650
08 Mar 2014 13:54:50	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	362,880	462,166	1.2736
01 Mar 2014 17:30:06	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	336,960	430,516	1.2776
28 Feb 2014 10:41:32	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	311,040	399,442	1.2842
23 Feb 2014 19:06:52	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	285,120	367,571	1.2892
21 Feb 2014 21:46:04	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	259,200	336,496	1.2982
18 Feb 2014 18:20:12	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	233,280	304,185	1.3039
15 Feb 2014 19:06:21	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	207,360	271,757	1.3106
09 Feb 2014 16:22:07	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	181,440	236,625	1.3042
08 Feb 2014 12:31:34	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	155,520	202,561	1.3025
04 Feb 2014 20:38:36	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	129,600	168,605	1.3010
28 Jan 2014 07:31:09	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	103,680	134,485	1.2971
24 Jan 2014 15:52:03	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	77,760	100,166	1.2881
19 Jan 2014 16:20:26	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	51,840	67,872	1.3093
18 Jan 2014 09:22:09	1229712	16230227	hadcm3n_7jyu_1980_40_008437161_1	25,920	34,372	1.3261