Task 13623735

Name	hadcm3n_002o_1940_40_007540497_4
Workunit	7737729
Created	9 Nov 2011, 17:51:07 UTC
Sent	9 Nov 2011, 17:58:47 UTC
Report deadline	9 Feb 2012, 1:25:58 UTC
Received	28 Nov 2011, 13:37:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1164517
Run time	6 days 22 hours 48 min 1 sec
CPU time	6 days 2 hours 28 min 5 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x188a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x188a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x186ee04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x188a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x188a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x188a404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x188a400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x2863e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x287f404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3038,0xace722c0) malloc: * error for object 0x287f400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3042, selfPID=3042, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(3166,0xace722c0) malloc: * error for object 0x96ae04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3166,0xace722c0) malloc: * error for object 0x1138404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3166,0xace722c0) malloc: * error for object 0x1138400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(3166,0xace722c0) malloc: * error for object 0x927604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.7.2 build 11C74 Wed Nov 23 15:19:37 2011 Thread 0 Crashed: Thread 1: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386. Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fdd8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/2/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x9044a000 - 0x90452fff /usr/lib/system/libunwind.dylib 0x92b1f000 - 0x92b3dfff /usr/lib/system/libsystem_kernel.dylib 0x92b3e000 - 0x92b40fff /usr/lib/system/libdyld.dylib 0x9341f000 - 0x93428fff /usr/lib/libc++abi.dylib 0x9387d000 - 0x9388bfff /usr/lib/libz.1.dylib 0x93c99000 - 0x93ca0fff /usr/lib/system/libsystem_dnssd.dylib 0x93cb2000 - 0x93cb5fff /usr/lib/system/libcompiler_rt.dylib 0x93d42000 - 0x93d4afff /usr/lib/system/libcopyfile.dylib 0x93f42000 - 0x93f43fff /usr/lib/system/libsystem_sandbox.dylib 0x95cd1000 - 0x95cd5fff /usr/lib/system/libsystem_network.dylib 0x95dd4000 - 0x95e02fff /usr/lib/libSystem.B.dylib 0x96517000 - 0x9651bfff /usr/lib/system/libcache.dylib 0x9651c000 - 0x96523fff /usr/lib/system/libsystem_notify.dylib 0x966a8000 - 0x966b6fff /usr/lib/system/libdispatch.dylib 0x966b7000 - 0x966bafff /usr/lib/system/libmathCommon.A.dylib 0x9702c000 - 0x9702dfff /usr/lib/system/libremovefile.dylib 0x97173000 - 0x971d5fff /usr/lib/libstdc++.6.dylib 0x97d5b000 - 0x97d71fff /usr/lib/system/libxpc.dylib 0x99873000 - 0x99874fff /usr/lib/system/libquarantine.dylib 0x9a9d4000 - 0x9aa03fff /usr/lib/system/libsystem_info.dylib 0x9aa16000 - 0x9aa17fff /usr/lib/system/libsystem_blocks.dylib 0x9bbb7000 - 0x9bbfafff /usr/lib/system/libcommonCrypto.dylib 0x9bcaa000 - 0x9bcabfff /usr/lib/system/libunc.dylib 0x9bf37000 - 0x9c002fff /usr/lib/system/libsystem_c.dylib 0x9c426000 - 0x9c426fff /usr/lib/system/libkeymgr.dylib 0x9c574000 - 0x9c57cfff /usr/lib/system/liblaunch.dylib 0x9c57d000 - 0x9c57dfff /usr/lib/system/libdnsinfo.dylib 0x9cb46000 - 0x9cb4bfff /usr/lib/system/libmacho.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Nov 2011 20:07:33	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	518,400	526,766	1.0161
21 Nov 2011 22:20:56	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	492,480	501,374	1.0181
17 Nov 2011 15:40:11	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	466,560	476,263	1.0208
16 Nov 2011 14:36:51	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	440,640	450,986	1.0235
16 Nov 2011 04:22:55	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	414,720	426,425	1.0282
15 Nov 2011 19:34:03	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	388,800	401,742	1.0333
15 Nov 2011 17:05:44	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	362,880	376,663	1.0380
15 Nov 2011 17:05:44	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	336,960	352,268	1.0454
15 Nov 2011 17:05:44	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	311,040	328,212	1.0552
15 Nov 2011 17:05:44	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	285,120	304,189	1.0669
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	259,200	280,124	1.0807
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	233,280	256,098	1.0978
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	207,360	231,609	1.1169
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	181,440	202,652	1.1169
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	155,520	173,948	1.1185
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	129,600	145,037	1.1191
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	103,680	116,039	1.1192
15 Nov 2011 17:05:43	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	77,760	87,068	1.1197
15 Nov 2011 17:05:42	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	51,840	57,962	1.1181
10 Nov 2011 03:07:57	1164517	13623735	hadcm3n_002o_1940_40_007540497_4	25,920	29,009	1.1192