Task 12961140

Name	hadcm3n_o40f_1940_40_007265810_2
Workunit	7464050
Created	8 Jun 2011, 23:19:14 UTC
Sent	8 Jun 2011, 23:19:36 UTC
Report deadline	8 Sep 2011, 6:46:47 UTC
Received	29 Jun 2011, 2:14:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1025983
Run time	11 days 4 hours 19 min 29 sec
CPU time	10 days 10 hours 50 min 58 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.86 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(15903,0xa0ba7540) malloc: * error for object 0x4802004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15903,0xa0ba7540) malloc: * error for object 0x4802000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15903,0xa0ba7540) malloc: * error for object 0x3806604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15903,0xa0ba7540) malloc: * error for object 0x3806600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15903,0xa0ba7540) malloc: * error for object 0x3005e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15903,0xa0ba7540) malloc: * error for object 0x3005e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15903,0xa0ba7540) malloc: * error for object 0x3005e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Wed Jun 29 02:34:45 2011 Thread 0 Crashed: atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin. 0 libSystem.B.dylib 0x990d30af small_free_list_remove_ptr + 246 1 libSystem.B.dylib 0x990cfb6c szone_free_definite_size + 3457 2 libSystem.B.dylib 0x990ceb88 free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const, char const, int, int) + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b decadalMeans(int, char const) + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff doCM3Proc() + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000791c mainLoop() + 410 7 hadcm3n_6.07_i686-apple-darwin 0x000087c7 worker() + 2989 8 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 main + 491 9 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x990c81ae mach_wait_until + 10 1 libSystem.B.dylib 0x9914f809 nanosleep + 345 2 libSystem.B.dylib 0x9914f6aa usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c boinc_sleep(double) + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 timer_thread(void) + 78 5 libSystem.B.dylib 0x990f57fd _pthread_start + 345 6 libSystem.B.dylib 0x990f5682 thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f758 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/5/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x939f1000 - 0x93a5bfff /usr/lib/libstdc++.6.dylib 0x9556b000 - 0x95579fff /usr/lib/libz.1.dylib 0x97b50000 - 0x97b53fff /usr/lib/system/libmathCommon.A.dylib 0x990c7000 - 0x9926efff /usr/lib/libSystem.B.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jun 2011 00:34:51	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	518,400	903,052	1.7420
27 Jun 2011 12:25:02	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	492,480	857,927	1.7421
26 Jun 2011 17:05:31	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	466,560	812,987	1.7425
26 Jun 2011 03:29:50	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	440,640	768,840	1.7448
25 Jun 2011 08:07:34	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	414,720	723,250	1.7439
22 Jun 2011 17:19:54	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	388,800	677,539	1.7426
21 Jun 2011 06:48:51	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	362,880	632,207	1.7422
19 Jun 2011 22:05:53	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	336,960	587,027	1.7421
17 Jun 2011 12:16:58	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	311,040	541,432	1.7407
15 Jun 2011 17:35:34	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	285,120	496,214	1.7404
15 Jun 2011 03:32:43	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	259,200	451,426	1.7416
14 Jun 2011 03:19:50	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	233,280	406,648	1.7432
13 Jun 2011 14:16:26	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	207,360	361,959	1.7456
13 Jun 2011 00:06:08	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	181,440	317,309	1.7488
12 Jun 2011 08:48:16	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	155,520	272,469	1.7520
11 Jun 2011 20:42:46	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	129,600	227,316	1.7540
11 Jun 2011 05:44:07	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	103,680	181,307	1.7487
10 Jun 2011 17:36:46	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	77,760	135,605	1.7439
10 Jun 2011 02:44:15	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	51,840	90,814	1.7518
09 Jun 2011 14:22:24	1025983	12961140	hadcm3n_o40f_1940_40_007265810_2	25,920	45,629	1.7604