Task 18701658

Name	hadcm3n_ldlr_1940_40_010020985_2
Workunit	10019056
Created	15 Jul 2015, 1:02:15 UTC
Sent	15 Jul 2015, 1:03:05 UTC
Report deadline	14 Oct 2015, 8:30:16 UTC
Received	4 Sep 2015, 3:34:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1235736
Run time	17 days 8 hours 8 min 26 sec
CPU time	15 days 13 hours 48 min 17 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	3.38 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:01:23 (45393): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:34:27 (98665): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:05:07 (32092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:59 (32092): No heartbeat from core client for 30 sec - exiting 00:06:00 (32092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 00:18:08 (32577): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation 00:42:34 (32675): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:17 (32864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:46 (34623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:15:29 (3162): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:02:58 (32104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:16 (32191): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:18 (32191): No heartbeat from core client for 30 sec - exiting 23:10:19 (32191): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation 04:12:13 (32264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:16 (32264): No heartbeat from core client for 30 sec - exiting SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Fri Sep 4 04:31:11 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4378 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90011fff /usr/lib/system/libsystem_notify.dylib 0x900aa000 - 0x900aafff /usr/lib/system/liblaunch.dylib 0x90e3e000 - 0x90e65fff /usr/lib/system/libdispatch.dylib 0x91066000 - 0x9108ffff /usr/lib/system/libsystem_info.dylib 0x91090000 - 0x910cdfff /usr/lib/system/libsystem_network.dylib 0x919d6000 - 0x919e2fff /usr/lib/system/libcommonCrypto.dylib 0x91d9f000 - 0x91da7fff /usr/lib/system/libsystem_pthread.dylib 0x91e22000 - 0x91e27fff /usr/lib/system/libmacho.dylib 0x921a8000 - 0x921a9fff /usr/lib/libSystem.B.dylib 0x921aa000 - 0x921c1fff /usr/lib/system/libsystem_asl.dylib 0x9227c000 - 0x9229bfff /usr/lib/system/libsystem_kernel.dylib 0x93564000 - 0x9356afff /usr/lib/system/libsystem_trace.dylib 0x939ad000 - 0x939d3fff /usr/lib/system/libxpc.dylib 0x93b68000 - 0x93bd4fff /usr/lib/system/libcorecrypto.dylib 0x9400a000 - 0x94012fff /usr/lib/system/libsystem_dnssd.dylib 0x94112000 - 0x94119fff /usr/lib/system/libunwind.dylib 0x951a7000 - 0x951adfff /usr/lib/system/libsystem_platform.dylib 0x951b8000 - 0x951bafff /usr/lib/system/libsystem_sandbox.dylib 0x956d3000 - 0x956ecfff /usr/lib/system/libsystem_malloc.dylib 0x95ab6000 - 0x95ac7fff /usr/lib/system/libsystem_coretls.dylib 0x95faf000 - 0x95fb3fff /usr/lib/system/libcache.dylib 0x9698b000 - 0x9698dfff /usr/lib/system/libsystem_configuration.dylib 0x96c3b000 - 0x96c3bfff /usr/lib/system/libunc.dylib 0x96c4e000 - 0x96c53fff /usr/lib/system/libcompiler_rt.dylib 0x97f66000 - 0x97f67fff /usr/lib/system/libremovefile.dylib 0x982da000 - 0x982dafff /usr/lib/system/libkeymgr.dylib 0x98498000 - 0x984cbfff /usr/lib/system/libsystem_m.dylib 0x98b12000 - 0x98b14fff /usr/lib/system/libsystem_coreservices.dylib 0x98b59000 - 0x98b5bfff /usr/lib/system/libsystem_secinit.dylib 0x98ce4000 - 0x98ce5fff /usr/lib/system/libsystem_blocks.dylib 0x99cd8000 - 0x99cdafff /usr/lib/system/libquarantine.dylib 0x99cdb000 - 0x99d70fff /usr/lib/system/libsystem_c.dylib 0x9b885000 - 0x9b88bfff /usr/lib/system/libsystem_networkextension.dylib 0x9bf9c000 - 0x9bf9ffff /usr/lib/system/libdyld.dylib 0x9c074000 - 0x9c07dfff /usr/lib/system/libcopyfile.dylib 0x9c2df000 - 0x9c2edfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Fri Sep 4 04:31:33 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4378 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90011fff /usr/lib/system/libsystem_notify.dylib 0x900aa000 - 0x900aafff /usr/lib/system/liblaunch.dylib 0x90e3e000 - 0x90e65fff /usr/lib/system/libdispatch.dylib 0x91066000 - 0x9108ffff /usr/lib/system/libsystem_info.dylib 0x91090000 - 0x910cdfff /usr/lib/system/libsystem_network.dylib 0x919d6000 - 0x919e2fff /usr/lib/system/libcommonCrypto.dylib 0x91d9f000 - 0x91da7fff /usr/lib/system/libsystem_pthread.dylib 0x91e22000 - 0x91e27fff /usr/lib/system/libmacho.dylib 0x921a8000 - 0x921a9fff /usr/lib/libSystem.B.dylib 0x921aa000 - 0x921c1fff /usr/lib/system/libsystem_asl.dylib 0x9227c000 - 0x9229bfff /usr/lib/system/libsystem_kernel.dylib 0x93564000 - 0x9356afff /usr/lib/system/libsystem_trace.dylib 0x939ad000 - 0x939d3fff /usr/lib/system/libxpc.dylib 0x93b68000 - 0x93bd4fff /usr/lib/system/libcorecrypto.dylib 0x9400a000 - 0x94012fff /usr/lib/system/libsystem_dnssd.dylib 0x94112000 - 0x94119fff /usr/lib/system/libunwind.dylib 0x951a7000 - 0x951adfff /usr/lib/system/libsystem_platform.dylib 0x951b8000 - 0x951bafff /usr/lib/system/libsystem_sandbox.dylib 0x956d3000 - 0x956ecfff /usr/lib/system/libsystem_malloc.dylib 0x95ab6000 - 0x95ac7fff /usr/lib/system/libsystem_coretls.dylib 0x95faf000 - 0x95fb3fff /usr/lib/system/libcache.dylib 0x9698b000 - 0x9698dfff /usr/lib/system/libsystem_configuration.dylib 0x96c3b000 - 0x96c3bfff /usr/lib/system/libunc.dylib 0x96c4e000 - 0x96c53fff /usr/lib/system/libcompiler_rt.dylib 0x97f66000 - 0x97f67fff /usr/lib/system/libremovefile.dylib 0x982da000 - 0x982dafff /usr/lib/system/libkeymgr.dylib 0x98498000 - 0x984cbfff /usr/lib/system/libsystem_m.dylib 0x98b12000 - 0x98b14fff /usr/lib/system/libsystem_coreservices.dylib 0x98b59000 - 0x98b5bfff /usr/lib/system/libsystem_secinit.dylib 0x98ce4000 - 0x98ce5fff /usr/lib/system/libsystem_blocks.dylib 0x99cd8000 - 0x99cdafff /usr/lib/system/libquarantine.dylib 0x99cdb000 - 0x99d70fff /usr/lib/system/libsystem_c.dylib 0x9b885000 - 0x9b88bfff /usr/lib/system/libsystem_networkextension.dylib 0x9bf9c000 - 0x9bf9ffff /usr/lib/system/libdyld.dylib 0x9c074000 - 0x9c07dfff /usr/lib/system/libcopyfile.dylib 0x9c2df000 - 0x9c2edfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Fri Sep 4 04:31:48 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4378 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90011fff /usr/lib/system/libsystem_notify.dylib 0x900aa000 - 0x900aafff /usr/lib/system/liblaunch.dylib 0x90e3e000 - 0x90e65fff /usr/lib/system/libdispatch.dylib 0x91066000 - 0x9108ffff /usr/lib/system/libsystem_info.dylib 0x91090000 - 0x910cdfff /usr/lib/system/libsystem_network.dylib 0x919d6000 - 0x919e2fff /usr/lib/system/libcommonCrypto.dylib 0x91d9f000 - 0x91da7fff /usr/lib/system/libsystem_pthread.dylib 0x91e22000 - 0x91e27fff /usr/lib/system/libmacho.dylib 0x921a8000 - 0x921a9fff /usr/lib/libSystem.B.dylib 0x921aa000 - 0x921c1fff /usr/lib/system/libsystem_asl.dylib 0x9227c000 - 0x9229bfff /usr/lib/system/libsystem_kernel.dylib 0x93564000 - 0x9356afff /usr/lib/system/libsystem_trace.dylib 0x939ad000 - 0x939d3fff /usr/lib/system/libxpc.dylib 0x93b68000 - 0x93bd4fff /usr/lib/system/libcorecrypto.dylib 0x9400a000 - 0x94012fff /usr/lib/system/libsystem_dnssd.dylib 0x94112000 - 0x94119fff /usr/lib/system/libunwind.dylib 0x951a7000 - 0x951adfff /usr/lib/system/libsystem_platform.dylib 0x951b8000 - 0x951bafff /usr/lib/system/libsystem_sandbox.dylib 0x956d3000 - 0x956ecfff /usr/lib/system/libsystem_malloc.dylib 0x95ab6000 - 0x95ac7fff /usr/lib/system/libsystem_coretls.dylib 0x95faf000 - 0x95fb3fff /usr/lib/system/libcache.dylib 0x9698b000 - 0x9698dfff /usr/lib/system/libsystem_configuration.dylib 0x96c3b000 - 0x96c3bfff /usr/lib/system/libunc.dylib 0x96c4e000 - 0x96c53fff /usr/lib/system/libcompiler_rt.dylib 0x97f66000 - 0x97f67fff /usr/lib/system/libremovefile.dylib 0x982da000 - 0x982dafff /usr/lib/system/libkeymgr.dylib 0x98498000 - 0x984cbfff /usr/lib/system/libsystem_m.dylib 0x98b12000 - 0x98b14fff /usr/lib/system/libsystem_coreservices.dylib 0x98b59000 - 0x98b5bfff /usr/lib/system/libsystem_secinit.dylib 0x98ce4000 - 0x98ce5fff /usr/lib/system/libsystem_blocks.dylib 0x99cd8000 - 0x99cdafff /usr/lib/system/libquarantine.dylib 0x99cdb000 - 0x99d70fff /usr/lib/system/libsystem_c.dylib 0x9b885000 - 0x9b88bfff /usr/lib/system/libsystem_networkextension.dylib 0x9bf9c000 - 0x9bf9ffff /usr/lib/system/libdyld.dylib 0x9c074000 - 0x9c07dfff /usr/lib/system/libcopyfile.dylib 0x9c2df000 - 0x9c2edfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Fri Sep 4 04:32:07 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4378 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90011fff /usr/lib/system/libsystem_notify.dylib 0x900aa000 - 0x900aafff /usr/lib/system/liblaunch.dylib 0x90e3e000 - 0x90e65fff /usr/lib/system/libdispatch.dylib 0x91066000 - 0x9108ffff /usr/lib/system/libsystem_info.dylib 0x91090000 - 0x910cdfff /usr/lib/system/libsystem_network.dylib 0x919d6000 - 0x919e2fff /usr/lib/system/libcommonCrypto.dylib 0x91d9f000 - 0x91da7fff /usr/lib/system/libsystem_pthread.dylib 0x91e22000 - 0x91e27fff /usr/lib/system/libmacho.dylib 0x921a8000 - 0x921a9fff /usr/lib/libSystem.B.dylib 0x921aa000 - 0x921c1fff /usr/lib/system/libsystem_asl.dylib 0x9227c000 - 0x9229bfff /usr/lib/system/libsystem_kernel.dylib 0x93564000 - 0x9356afff /usr/lib/system/libsystem_trace.dylib 0x939ad000 - 0x939d3fff /usr/lib/system/libxpc.dylib 0x93b68000 - 0x93bd4fff /usr/lib/system/libcorecrypto.dylib 0x9400a000 - 0x94012fff /usr/lib/system/libsystem_dnssd.dylib 0x94112000 - 0x94119fff /usr/lib/system/libunwind.dylib 0x951a7000 - 0x951adfff /usr/lib/system/libsystem_platform.dylib 0x951b8000 - 0x951bafff /usr/lib/system/libsystem_sandbox.dylib 0x956d3000 - 0x956ecfff /usr/lib/system/libsystem_malloc.dylib 0x95ab6000 - 0x95ac7fff /usr/lib/system/libsystem_coretls.dylib 0x95faf000 - 0x95fb3fff /usr/lib/system/libcache.dylib 0x9698b000 - 0x9698dfff /usr/lib/system/libsystem_configuration.dylib 0x96c3b000 - 0x96c3bfff /usr/lib/system/libunc.dylib 0x96c4e000 - 0x96c53fff /usr/lib/system/libcompiler_rt.dylib 0x97f66000 - 0x97f67fff /usr/lib/system/libremovefile.dylib 0x982da000 - 0x982dafff /usr/lib/system/libkeymgr.dylib 0x98498000 - 0x984cbfff /usr/lib/system/libsystem_m.dylib 0x98b12000 - 0x98b14fff /usr/lib/system/libsystem_coreservices.dylib 0x98b59000 - 0x98b5bfff /usr/lib/system/libsystem_secinit.dylib 0x98ce4000 - 0x98ce5fff /usr/lib/system/libsystem_blocks.dylib 0x99cd8000 - 0x99cdafff /usr/lib/system/libquarantine.dylib 0x99cdb000 - 0x99d70fff /usr/lib/system/libsystem_c.dylib 0x9b885000 - 0x9b88bfff /usr/lib/system/libsystem_networkextension.dylib 0x9bf9c000 - 0x9bf9ffff /usr/lib/system/libdyld.dylib 0x9c074000 - 0x9c07dfff /usr/lib/system/libcopyfile.dylib 0x9c2df000 - 0x9c2edfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Fri Sep 4 04:32:30 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4378 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90011fff /usr/lib/system/libsystem_notify.dylib 0x900aa000 - 0x900aafff /usr/lib/system/liblaunch.dylib 0x90e3e000 - 0x90e65fff /usr/lib/system/libdispatch.dylib 0x91066000 - 0x9108ffff /usr/lib/system/libsystem_info.dylib 0x91090000 - 0x910cdfff /usr/lib/system/libsystem_network.dylib 0x919d6000 - 0x919e2fff /usr/lib/system/libcommonCrypto.dylib 0x91d9f000 - 0x91da7fff /usr/lib/system/libsystem_pthread.dylib 0x91e22000 - 0x91e27fff /usr/lib/system/libmacho.dylib 0x921a8000 - 0x921a9fff /usr/lib/libSystem.B.dylib 0x921aa000 - 0x921c1fff /usr/lib/system/libsystem_asl.dylib 0x9227c000 - 0x9229bfff /usr/lib/system/libsystem_kernel.dylib 0x93564000 - 0x9356afff /usr/lib/system/libsystem_trace.dylib 0x939ad000 - 0x939d3fff /usr/lib/system/libxpc.dylib 0x93b68000 - 0x93bd4fff /usr/lib/system/libcorecrypto.dylib 0x9400a000 - 0x94012fff /usr/lib/system/libsystem_dnssd.dylib 0x94112000 - 0x94119fff /usr/lib/system/libunwind.dylib 0x951a7000 - 0x951adfff /usr/lib/system/libsystem_platform.dylib 0x951b8000 - 0x951bafff /usr/lib/system/libsystem_sandbox.dylib 0x956d3000 - 0x956ecfff /usr/lib/system/libsystem_malloc.dylib 0x95ab6000 - 0x95ac7fff /usr/lib/system/libsystem_coretls.dylib 0x95faf000 - 0x95fb3fff /usr/lib/system/libcache.dylib 0x9698b000 - 0x9698dfff /usr/lib/system/libsystem_configuration.dylib 0x96c3b000 - 0x96c3bfff /usr/lib/system/libunc.dylib 0x96c4e000 - 0x96c53fff /usr/lib/system/libcompiler_rt.dylib 0x97f66000 - 0x97f67fff /usr/lib/system/libremovefile.dylib 0x982da000 - 0x982dafff /usr/lib/system/libkeymgr.dylib 0x98498000 - 0x984cbfff /usr/lib/system/libsystem_m.dylib 0x98b12000 - 0x98b14fff /usr/lib/system/libsystem_coreservices.dylib 0x98b59000 - 0x98b5bfff /usr/lib/system/libsystem_secinit.dylib 0x98ce4000 - 0x98ce5fff /usr/lib/system/libsystem_blocks.dylib 0x99cd8000 - 0x99cdafff /usr/lib/system/libquarantine.dylib 0x99cdb000 - 0x99d70fff /usr/lib/system/libsystem_c.dylib 0x9b885000 - 0x9b88bfff /usr/lib/system/libsystem_networkextension.dylib 0x9bf9c000 - 0x9bf9ffff /usr/lib/system/libdyld.dylib 0x9c074000 - 0x9c07dfff /usr/lib/system/libcopyfile.dylib 0x9c2df000 - 0x9c2edfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35185, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.5 build 14F27 Fri Sep 4 04:32:47 2015 Thread 0 Crashed: Thread 1: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbebb4378 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x90008000 - 0x90011fff /usr/lib/system/libsystem_notify.dylib 0x900aa000 - 0x900aafff /usr/lib/system/liblaunch.dylib 0x90e3e000 - 0x90e65fff /usr/lib/system/libdispatch.dylib 0x91066000 - 0x9108ffff /usr/lib/system/libsystem_info.dylib 0x91090000 - 0x910cdfff /usr/lib/system/libsystem_network.dylib 0x919d6000 - 0x919e2fff /usr/lib/system/libcommonCrypto.dylib 0x91d9f000 - 0x91da7fff /usr/lib/system/libsystem_pthread.dylib 0x91e22000 - 0x91e27fff /usr/lib/system/libmacho.dylib 0x921a8000 - 0x921a9fff /usr/lib/libSystem.B.dylib 0x921aa000 - 0x921c1fff /usr/lib/system/libsystem_asl.dylib 0x9227c000 - 0x9229bfff /usr/lib/system/libsystem_kernel.dylib 0x93564000 - 0x9356afff /usr/lib/system/libsystem_trace.dylib 0x939ad000 - 0x939d3fff /usr/lib/system/libxpc.dylib 0x93b68000 - 0x93bd4fff /usr/lib/system/libcorecrypto.dylib 0x9400a000 - 0x94012fff /usr/lib/system/libsystem_dnssd.dylib 0x94112000 - 0x94119fff /usr/lib/system/libunwind.dylib 0x951a7000 - 0x951adfff /usr/lib/system/libsystem_platform.dylib 0x951b8000 - 0x951bafff /usr/lib/system/libsystem_sandbox.dylib 0x956d3000 - 0x956ecfff /usr/lib/system/libsystem_malloc.dylib 0x95ab6000 - 0x95ac7fff /usr/lib/system/libsystem_coretls.dylib 0x95faf000 - 0x95fb3fff /usr/lib/system/libcache.dylib 0x9698b000 - 0x9698dfff /usr/lib/system/libsystem_configuration.dylib 0x96c3b000 - 0x96c3bfff /usr/lib/system/libunc.dylib 0x96c4e000 - 0x96c53fff /usr/lib/system/libcompiler_rt.dylib 0x97f66000 - 0x97f67fff /usr/lib/system/libremovefile.dylib 0x982da000 - 0x982dafff /usr/lib/system/libkeymgr.dylib 0x98498000 - 0x984cbfff /usr/lib/system/libsystem_m.dylib 0x98b12000 - 0x98b14fff /usr/lib/system/libsystem_coreservices.dylib 0x98b59000 - 0x98b5bfff /usr/lib/system/libsystem_secinit.dylib 0x98ce4000 - 0x98ce5fff /usr/lib/system/libsystem_blocks.dylib 0x99cd8000 - 0x99cdafff /usr/lib/system/libquarantine.dylib 0x99cdb000 - 0x99d70fff /usr/lib/system/libsystem_c.dylib 0x9b885000 - 0x9b88bfff /usr/lib/system/libsystem_networkextension.dylib 0x9bf9c000 - 0x9bf9ffff /usr/lib/system/libdyld.dylib 0x9c074000 - 0x9c07dfff /usr/lib/system/libcopyfile.dylib 0x9c2df000 - 0x9c2edfff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35185, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Sep 2015 10:29:32	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	984,960	1,323,721	1.3439
02 Sep 2015 03:31:15	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	959,040	1,283,434	1.3382
31 Aug 2015 23:44:37	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	933,120	1,244,038	1.3332
22 Aug 2015 03:46:34	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	907,200	1,204,656	1.3279
21 Aug 2015 13:06:38	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	881,280	1,167,633	1.3249
20 Aug 2015 22:26:31	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	855,360	1,131,682	1.3230
19 Aug 2015 18:29:28	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	829,440	1,088,398	1.3122
18 Aug 2015 23:10:03	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	803,520	1,048,957	1.3055
17 Aug 2015 02:40:50	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	777,600	1,007,178	1.2952
12 Aug 2015 22:33:25	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	751,680	967,632	1.2873
12 Aug 2015 08:08:10	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	725,760	943,469	1.3000
11 Aug 2015 23:09:58	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	699,840	917,982	1.3117
11 Aug 2015 01:12:37	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	673,920	892,555	1.3244
10 Aug 2015 00:18:13	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	648,000	866,911	1.3378
09 Aug 2015 12:41:02	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	622,080	841,444	1.3526
09 Aug 2015 04:03:11	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	596,160	816,069	1.3689
08 Aug 2015 17:39:10	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	570,240	790,224	1.3858
08 Aug 2015 09:27:34	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	544,320	764,138	1.4038
07 Aug 2015 19:08:12	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	518,400	737,836	1.4233
07 Aug 2015 04:59:16	1235736	18701658	hadcm3n_ldlr_1940_40_010020985_2	492,480	711,821	1.4454