Task 15803736

Name	hadcm3n_n1gr_1880_40_008375063_0
Workunit	8525922
Created	29 May 2013, 23:09:26 UTC
Sent	31 May 2013, 5:49:38 UTC
Report deadline	30 Aug 2013, 13:16:49 UTC
Received	8 Jun 2013, 5:48:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1282478
Run time	5 days 13 hours 27 min 50 sec
CPU time	4 days 21 hours 58 min 56 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.96 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 07:37:37 (67020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:38 (67020): No heartbeat from core client for 30 sec - exiting 07:37:39 (67020): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 15:43:05 (63552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 22:45:27 (89043): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:29 (89043): No heartbeat from core client for 30 sec - exiting 22:45:30 (89043): No heartbeat from core client for 30 sec - exiting 22:45:31 (89043): No heartbeat from core client for 30 sec - exiting 22:45:32 (89043): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 10:35:58 (28454): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:59 (28454): No heartbeat from core client for 30 sec - exiting 10:36:00 (28454): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 16:20:25 (19196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:27 (19196): No heartbeat from core client for 30 sec - exiting 16:20:28 (19196): No heartbeat from core client for 30 sec - exiting dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 16:21:27 (76143): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 18:16:28 (78356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 21:21:58 (4066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 22:13:44 (39150): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid 02:05:59 (49467): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid CPDN Monitor - Quit request from BOINC... dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/30/../../switcher/switcher) is setuid or setgid hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0x40f6004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0x40f6000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0xd8f9204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0xd8fa004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0xd8fa000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0xd8fa004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0xd8fa000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7342,0xac485a28) malloc: * error for object 0xd8fa004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.8.3 build 12D78 Fri Jun 7 21:46:55 2013 dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid dyld: DYLD_ environment variables being ignored because main executable (/bin/ps) is setuid or setgid Thread 0 Crashed: Thread 1: dyld: DYLD_ environment variables being ignored because main executable (/usr/bin/atos) has __RESTRICT/__restrict section atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8faa8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/30/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x90c6d000 - 0x90c6efff /usr/lib/system/libunc.dylib 0x910ed000 - 0x910f0fff /usr/lib/system/libcompiler_rt.dylib 0x9153f000 - 0x91561fff /usr/lib/libc++abi.dylib 0x91640000 - 0x91652fff /usr/lib/system/libdispatch.dylib 0x91653000 - 0x91657fff /usr/lib/system/libmacho.dylib 0x91d41000 - 0x91d6dfff /usr/lib/system/libsystem_info.dylib 0x91de4000 - 0x91e48fff /usr/lib/libstdc++.6.dylib 0x91e49000 - 0x91e53fff /usr/lib/system/libsystem_notify.dylib 0x9252e000 - 0x925ebfff /usr/lib/system/libsystem_c.dylib 0x9263c000 - 0x9263dfff /usr/lib/system/libquarantine.dylib 0x9263e000 - 0x9263efff /usr/lib/system/libsystem_blocks.dylib 0x92864000 - 0x92864fff /usr/lib/system/libkeymgr.dylib 0x92865000 - 0x92869fff /usr/lib/system/libcache.dylib 0x92fc3000 - 0x92fc4fff /usr/lib/system/libsystem_sandbox.dylib 0x93361000 - 0x9337bfff /usr/lib/system/libsystem_kernel.dylib 0x938ed000 - 0x9391afff /usr/lib/system/libsystem_m.dylib 0x9391b000 - 0x93922fff /usr/lib/system/libsystem_dnssd.dylib 0x95f20000 - 0x95f21fff /usr/lib/system/libremovefile.dylib 0x95f2f000 - 0x95f36fff /usr/lib/system/liblaunch.dylib 0x95f37000 - 0x95f45fff /usr/lib/system/libsystem_network.dylib 0x95f67000 - 0x95f6ffff /usr/lib/system/libcopyfile.dylib 0x9667d000 - 0x96688fff /usr/lib/system/libcommonCrypto.dylib 0x96689000 - 0x966a6fff /usr/lib/system/libxpc.dylib 0x97fd4000 - 0x97fe2fff /usr/lib/libz.1.dylib 0x98476000 - 0x98476fff /usr/lib/libSystem.B.dylib 0x98e0f000 - 0x98e10fff /usr/lib/system/libdnsinfo.dylib 0x99027000 - 0x99029fff /usr/lib/system/libdyld.dylib 0x99e0d000 - 0x99e14fff /usr/lib/system/libunwind.dylib 0x9a71b000 - 0x9a767fff /usr/lib/system/libcorecrypto.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jun 2013 02:51:06	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	259,200	424,729	1.6386
07 Jun 2013 13:02:19	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	233,280	380,726	1.6321
04 Jun 2013 23:11:11	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	207,360	338,804	1.6339
04 Jun 2013 10:10:33	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	181,440	296,344	1.6333
03 Jun 2013 20:16:30	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	155,520	253,463	1.6298
03 Jun 2013 04:19:59	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	129,600	211,050	1.6285
02 Jun 2013 14:40:50	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	103,680	169,434	1.6342
02 Jun 2013 01:10:55	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	77,760	127,544	1.6402
01 Jun 2013 11:15:13	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	51,840	85,298	1.6454
31 May 2013 21:07:26	1282478	15803736	hadcm3n_n1gr_1880_40_008375063_0	25,920	43,546	1.6800