Task 17912374

Name	hadcm3n_x09c_1940_40_009147603_2
Workunit	9277939
Created	9 Feb 2015, 10:08:38 UTC
Sent	9 Feb 2015, 10:12:40 UTC
Report deadline	11 May 2015, 17:39:51 UTC
Received	20 Mar 2015, 1:06:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1451375
Run time	16 days 7 hours 23 min 9 sec
CPU time	14 days 18 hours 12 min 15 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.77 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.4.36</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:25:01 (86883): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:40:24 (91408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:13:23 (96336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:10:00 (13086): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:49:46 (36613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:00:47 (40349): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:12 (55282): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:45 (58686): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:48 (97913): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:12 (1534): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:11 (4975): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:05 (8416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:33:19 (12103): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:21 (15576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:42 (19692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:49 (30198): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:48 (49409): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:15 (53898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:55:48 (57866): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:06:56 (62061): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:05:59 (46061): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:58 (50238): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:16 (54278): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:58 (57726): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:44 (61932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:02 (65975): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:17 (70438): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:29 (74182): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:31:21 (78142): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:46:27 (81650): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:27 (87159): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:07:07 (90669): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:57 (94156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:14:38 (98646): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:15:46 (3021): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:48 (6449): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:38 (9974): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:02:29 (260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:06 (12699): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(298,0xa09cb1d4) malloc: * error for object 0x4801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(298,0xa09cb1d4) malloc: * error for object 0x4801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(298,0xa09cb1d4) malloc: * error for object 0x4801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(298,0xa09cb1d4) malloc: * error for object 0x400a004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C1510 Sat Mar 14 20:48:17 2015 Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(262,0xa09cb1d4) malloc: * error for object 0x180aa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa09cb1d4) malloc: * error for object 0x180aa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa09cb1d4) malloc: * error for object 0x180aa04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa09cb1d4) malloc: * error for object 0x180aa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa09cb1d4) malloc: * error for object 0x180aa00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C1510 Sat Mar 14 22:07:57 2015 Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(259,0xa09cb1d4) malloc: * error for object 0x1006804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(259,0xa09cb1d4) malloc: * error for object 0x1006800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(259,0xa09cb1d4) malloc: * error for object 0x2003604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(259,0xa09cb1d4) malloc: * error for object 0x2003600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(259,0xa09cb1d4) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(746,0xa09cb1d4) malloc: * error for object 0x1806804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(746,0xa09cb1d4) malloc: * error for object 0x1806800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(746,0xa09cb1d4) malloc: * error for object 0x1806804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(746,0xa09cb1d4) malloc: * error for object 0x1806800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(746,0xa09cb1d4) malloc: * error for object 0x1806800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(1645,0xa09cb1d4) malloc: * error for object 0x1812400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(74464,0xa09cb1d4) malloc: * error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74464,0xa09cb1d4) malloc: * error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74464,0xa09cb1d4) malloc: * error for object 0x82de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74464,0xa09cb1d4) malloc: * error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(74464,0xa09cb1d4) malloc: * error for object 0x82de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(1760,0xa09cb1d4) malloc: * error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1760,0xa09cb1d4) malloc: * error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1760,0xa09cb1d4) malloc: * error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1760,0xa09cb1d4) malloc: * error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1760,0xa09cb1d4) malloc: * error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C1510 Mon Mar 16 22:47:47 2015 hadcm3n_6.07_i686-apple-darwin(3239,0xa09cb1d4) malloc: * error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3239,0xa09cb1d4) malloc: * error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3239,0xa09cb1d4) malloc: * error for object 0x202de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3239,0xa09cb1d4) malloc: * error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3239,0xa09cb1d4) malloc: * error for object 0x202de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C1510 Tue Mar 17 01:05:46 2015 hadcm3n_6.07_i686-apple-darwin(4672,0xa09cb1d4) malloc: * error for object 0x3807004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4672,0xa09cb1d4) malloc: * error for object 0x3807000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4672,0xa09cb1d4) malloc: * error for object 0x3800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4672,0xa09cb1d4) malloc: * error for object 0x3800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4672,0xa09cb1d4) malloc: * error for object 0x3800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(8369,0xa09cb1d4) malloc: * error for object 0x2805c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8369,0xa09cb1d4) malloc: * error for object 0x2805c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(8369,0xa09cb1d4) malloc: * error for object 0x2805c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(9410,0xa09cb1d4) malloc: * error for object 0x182de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9410,0xa09cb1d4) malloc: * error for object 0x182de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9410,0xa09cb1d4) malloc: * error for object 0x182de04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9410,0xa09cb1d4) malloc: * error for object 0x182de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(9410,0xa09cb1d4) malloc: * error for object 0x182de00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(261,0xa09cb1d4) malloc: * error for object 0x3015e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(261,0xa09cb1d4) malloc: * error for object 0x3015e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(261,0xa09cb1d4) malloc: * error for object 0x2001c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(445,0xa09cb1d4) malloc: * error for object 0x80d204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(445,0xa09cb1d4) malloc: * error for object 0x80e004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(445,0xa09cb1d4) malloc: * error for object 0x80e000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(445,0xa09cb1d4) malloc: * error for object 0x101d800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.10.2 build 14C1510 Thu Mar 19 17:06:32 2015 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fe58 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/8/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90008000 - 0x9000afff /usr/lib/system/libsystem_secinit.dylib 0x90a2d000 - 0x90a96fff /usr/lib/system/libcorecrypto.dylib 0x90e70000 - 0x90e8ffff /usr/lib/system/libsystem_kernel.dylib 0x910d1000 - 0x910f7fff /usr/lib/libc++abi.dylib 0x92ff2000 - 0x93000fff /usr/lib/libz.1.dylib 0x93003000 - 0x9301cfff /usr/lib/system/libsystem_malloc.dylib 0x941ff000 - 0x94201fff /usr/lib/system/libsystem_sandbox.dylib 0x9455e000 - 0x9455ffff /usr/lib/system/libsystem_blocks.dylib 0x94790000 - 0x94796fff /usr/lib/system/libsystem_trace.dylib 0x947d4000 - 0x947d4fff /usr/lib/system/libunc.dylib 0x947e6000 - 0x9487bfff /usr/lib/system/libsystem_c.dylib 0x94896000 - 0x9489efff /usr/lib/system/libsystem_dnssd.dylib 0x94c72000 - 0x94c76fff /usr/lib/system/libcache.dylib 0x94c79000 - 0x94c81fff /usr/lib/system/libsystem_pthread.dylib 0x950be000 - 0x950bffff /usr/lib/system/libremovefile.dylib 0x950ef000 - 0x950f1fff /usr/lib/system/libsystem_coreservices.dylib 0x95320000 - 0x9532cfff /usr/lib/system/libcommonCrypto.dylib 0x9610f000 - 0x96118fff /usr/lib/system/libsystem_notify.dylib 0x96140000 - 0x96167fff /usr/lib/system/libdispatch.dylib 0x9618a000 - 0x9618afff /usr/lib/system/libkeymgr.dylib 0x96544000 - 0x96546fff /usr/lib/system/libsystem_configuration.dylib 0x96801000 - 0x96812fff /usr/lib/system/libsystem_coretls.dylib 0x96c43000 - 0x96c49fff /usr/lib/system/libsystem_networkextension.dylib 0x98230000 - 0x9826dfff /usr/lib/system/libsystem_network.dylib 0x98976000 - 0x989c9fff /usr/lib/libstdc++.6.dylib 0x9979d000 - 0x9979dfff /usr/lib/system/liblaunch.dylib 0x9979e000 - 0x997a7fff /usr/lib/system/libcopyfile.dylib 0x997e4000 - 0x9980dfff /usr/lib/system/libsystem_info.dylib 0x99838000 - 0x99839fff /usr/lib/libSystem.B.dylib 0x99d0d000 - 0x99d12fff /usr/lib/system/libcompiler_rt.dylib 0x99eb6000 - 0x99ecdfff /usr/lib/system/libsystem_asl.dylib 0x9b28e000 - 0x9b2c1fff /usr/lib/system/libsystem_m.dylib 0x9bca4000 - 0x9bcabfff /usr/lib/system/libunwind.dylib 0x9bfc0000 - 0x9bfc3fff /usr/lib/system/libdyld.dylib 0x9c15d000 - 0x9c183fff /usr/lib/system/libxpc.dylib 0x9c258000 - 0x9c25dfff /usr/lib/system/libmacho.dylib 0x9c2ed000 - 0x9c2f3fff /usr/lib/system/libsystem_platform.dylib 0x9c34a000 - 0x9c34cfff /usr/lib/system/libquarantine.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Mar 2015 04:20:12	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	1,036,800	1,274,571	1.2293
14 Mar 2015 18:55:16	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	1,010,880	1,244,585	1.2312
14 Mar 2015 10:17:35	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	984,960	1,215,545	1.2341
14 Mar 2015 01:37:26	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	959,040	1,186,177	1.2368
13 Mar 2015 17:04:19	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	933,120	1,157,544	1.2405
13 Mar 2015 08:10:20	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	907,200	1,127,888	1.2433
12 Mar 2015 02:38:40	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	881,280	1,096,661	1.2444
11 Mar 2015 16:39:28	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	855,360	1,066,499	1.2468
10 Mar 2015 16:04:23	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	829,440	1,037,625	1.2510
26 Feb 2015 11:05:11	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	803,520	1,008,606	1.2552
23 Feb 2015 12:41:40	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	777,600	979,864	1.2601
22 Feb 2015 05:39:10	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	751,680	948,490	1.2618
21 Feb 2015 18:14:00	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	725,760	915,465	1.2614
21 Feb 2015 06:30:53	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	699,840	882,731	1.2613
20 Feb 2015 18:55:02	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	673,920	848,552	1.2591
20 Feb 2015 08:42:14	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	648,000	814,509	1.2570
19 Feb 2015 22:01:21	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	622,080	779,963	1.2538
19 Feb 2015 11:33:51	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	596,160	745,712	1.2509
19 Feb 2015 00:51:05	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	570,240	710,992	1.2468
18 Feb 2015 14:33:41	1313549	17912374	hadcm3n_x09c_1940_40_009147603_2	544,320	676,793	1.2434