Task 19418560

Name	hadcm3n_xbxu_198012_480_374_010413011_0
Workunit	10413011
Created	21 Mar 2016, 15:22:22 UTC
Sent	21 Mar 2016, 21:10:03 UTC
Report deadline	4 Mar 2017, 2:30:03 UTC
Received	8 Apr 2016, 16:37:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1332112
Run time	8 days 21 hours 22 min 6 sec
CPU time	8 days 13 hours 22 min 13 sec
Validate state	Invalid
Credit	9,020.16
Device peak FLOPS	4.50 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/xbxuko.pjk6c10 is not a valid UM file. Error converting file to netcdf: dataout/xbxuko.pjk6c10 Error: Input file: dataout/xbxuko.pik6c10 is not a valid UM file. Error converting file to netcdf: dataout/xbxuko.pik6c10 Error: Input file: dataout/xbxuko.pfk6c10 is not a valid UM file. Error converting file to netcdf: dataout/xbxuko.pfk6c10 Error: Input file: dataout/xbxuka.phk6c10 is not a valid UM file. Error converting file to netcdf: dataout/xbxuka.phk6c10 Error: Input file: dataout/xbxuka.pgk6c10 is not a valid UM file. Error converting file to netcdf: dataout/xbxuka.pgk6c10 Error: Input file: dataout/xbxuka.pek6c10 is not a valid UM file. Error converting file to netcdf: dataout/xbxuka.pek6c10 Error: Input file: dataout/xbxuka.pdk6c10 is not a valid UM file. Error converting file to netcdf: dataout/xbxuka.pdk6c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x282ca04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x282ca00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x3825804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x3825800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x3020804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x482ea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x282ca04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x1033c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x3825804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x482ea04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(73892,0xa403a000) malloc: * error for object 0x7000e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.11.4 build 15E65 Fri Apr 8 11:46:27 2016 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fab8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9099f000 - 0x909c9fff /usr/lib/system/libsystem_info.dylib 0x90a1b000 - 0x90a23fff /usr/lib/system/libsystem_dnssd.dylib 0x90d45000 - 0x90d53fff /usr/lib/libz.1.dylib 0x911c5000 - 0x911c6fff /usr/lib/libSystem.B.dylib 0x923a2000 - 0x923f5fff /usr/lib/libstdc++.6.dylib 0x9290c000 - 0x9291dfff /usr/lib/system/libsystem_trace.dylib 0x92bd4000 - 0x92bdefff /usr/lib/system/libsystem_notify.dylib 0x93330000 - 0x9333bfff /usr/lib/system/libcommonCrypto.dylib 0x9351e000 - 0x93520fff /usr/lib/system/libsystem_configuration.dylib 0x93573000 - 0x93579fff /usr/lib/system/libsystem_platform.dylib 0x9357a000 - 0x9357efff /usr/lib/system/libcache.dylib 0x93ac0000 - 0x93ad7fff /usr/lib/system/libsystem_coretls.dylib 0x93af9000 - 0x93afbfff /usr/lib/system/libsystem_secinit.dylib 0x952ab000 - 0x952c4fff /usr/lib/system/libsystem_asl.dylib 0x95cc8000 - 0x95cfbfff /usr/lib/system/libsystem_m.dylib 0x95de6000 - 0x95deffff /usr/lib/system/libcopyfile.dylib 0x95f1b000 - 0x95fb0fff /usr/lib/system/libsystem_c.dylib 0x968b1000 - 0x968d4fff /usr/lib/libc++abi.dylib 0x9692b000 - 0x9692dfff /usr/lib/system/libsystem_coreservices.dylib 0x972fe000 - 0x97317fff /usr/lib/system/libsystem_malloc.dylib 0x97888000 - 0x978b2fff /usr/lib/system/libdispatch.dylib 0x98311000 - 0x98311fff /usr/lib/system/libunc.dylib 0x99a3b000 - 0x99a3cfff /usr/lib/system/libremovefile.dylib 0x99b63000 - 0x99b68fff /usr/lib/system/libmacho.dylib 0x99b88000 - 0x99b8bfff /usr/lib/system/libsystem_sandbox.dylib 0x9a038000 - 0x9a03bfff /usr/lib/system/libdyld.dylib 0x9a041000 - 0x9a04afff /usr/lib/system/libsystem_networkextension.dylib 0x9b119000 - 0x9b141fff /usr/lib/system/libxpc.dylib 0x9b798000 - 0x9b806fff /usr/lib/system/libsystem_network.dylib 0x9bda3000 - 0x9bda3fff /usr/lib/system/libsystem_blocks.dylib 0x9bda4000 - 0x9bdaafff /usr/lib/system/libunwind.dylib 0x9bdab000 - 0x9bdb3fff /usr/lib/system/libsystem_pthread.dylib 0x9dc8e000 - 0x9dcf5fff /usr/lib/system/libcorecrypto.dylib 0x9dd6d000 - 0x9dd72fff /usr/lib/system/libcompiler_rt.dylib 0x9ddae000 - 0x9ddaefff /usr/lib/system/libkeymgr.dylib 0x9df61000 - 0x9df61fff /usr/lib/system/liblaunch.dylib 0x9dfb2000 - 0x9dfd3fff /usr/lib/system/libsystem_kernel.dylib 0x9e159000 - 0x9e15bfff /usr/lib/system/libquarantine.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Apr 2016 16:38:33	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	751,680	715,370	0.9517
07 Apr 2016 23:01:19	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	725,760	691,467	0.9527
07 Apr 2016 14:48:36	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	699,840	667,730	0.9541
07 Apr 2016 05:15:30	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	673,920	644,147	0.9558
06 Apr 2016 19:43:40	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	648,000	620,251	0.9572
06 Apr 2016 10:35:58	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	622,080	596,534	0.9589
05 Apr 2016 17:02:30	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	596,160	572,867	0.9609
05 Apr 2016 02:43:32	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	570,240	547,668	0.9604
05 Apr 2016 00:41:26	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	544,320	522,653	0.9602
03 Apr 2016 21:49:59	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	518,400	497,550	0.9598
03 Apr 2016 14:32:02	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	492,480	472,336	0.9591
03 Apr 2016 07:21:23	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	466,560	447,115	0.9583
03 Apr 2016 00:14:08	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	440,640	421,772	0.9572
02 Apr 2016 16:12:45	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	414,720	396,325	0.9556
02 Apr 2016 08:51:57	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	388,800	371,055	0.9544
02 Apr 2016 01:39:58	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	362,880	345,840	0.9530
01 Apr 2016 18:24:04	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	336,960	320,522	0.9512
01 Apr 2016 11:12:31	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	311,040	295,151	0.9489
01 Apr 2016 02:26:11	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	285,120	270,516	0.9488
31 Mar 2016 18:33:44	1332112	19418560	hadcm3n_xbxu_198012_480_374_010413011_0	259,200	246,198	0.9498