Task 13567538

Name	hadcm3n_ygfu_1900_40_007525241_2
Workunit	7722716
Created	30 Oct 2011, 8:59:13 UTC
Sent	30 Oct 2011, 9:01:44 UTC
Report deadline	29 Jan 2012, 16:28:55 UTC
Received	16 Nov 2011, 19:36:24 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1087414
Run time	16 days 5 hours 31 min 32 sec
CPU time	15 days 10 hours 26 min 41 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=18986, selfPID=18986, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x281f604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x81d004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x103ac04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x2048604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x2048600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x280a604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x280a600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(30660,0xa0a37540) malloc: * error for object 0x800e00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Wed Nov 16 14:20:26 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x98394b0f _small_free_list_remove_ptr + 246 1 libSystem.B.dylib 0x983915cc _szone_free_definite_size + 3457 2 libSystem.B.dylib 0x983905e8 _free + 244 3 hadcm3n_6.07_i686-apple-darwin 0x0000ba58 __Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3482 4 hadcm3n_6.07_i686-apple-darwin 0x0000d36b __Z12decadalMeansiPKc + 957 5 hadcm3n_6.07_i686-apple-darwin 0x000067ff __Z9doCM3Procv + 185 6 hadcm3n_6.07_i686-apple-darwin 0x0000876a __Z6workerv + 2896 7 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 _main + 491 8 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x98389c0e _mach_wait_until + 10 1 libSystem.B.dylib 0x98411429 _nanosleep + 345 2 libSystem.B.dylib 0x984112ca _usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c __Z11boinc_sleepd + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x983b7259 __pthread_start + 345 6 libSystem.B.dylib 0x983b70de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/1/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x942cb000 - 0x94335fff /usr/lib/libstdc++.6.dylib 0x95349000 - 0x95357fff /usr/lib/libz.1.dylib 0x95ac4000 - 0x95ac7fff /usr/lib/system/libmathCommon.A.dylib 0x98389000 - 0x98530fff /usr/lib/libSystem.B.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Nov 2011 16:42:41	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	777,600	1,325,459	1.7046
16 Nov 2011 03:17:24	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	751,680	1,280,002	1.7029
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	725,760	1,236,360	1.7035
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	699,840	1,194,491	1.7068
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	673,920	1,153,189	1.7112
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	648,000	1,111,973	1.7160
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	622,080	1,070,786	1.7213
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	596,160	1,029,588	1.7270
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	570,240	988,364	1.7332
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	544,320	947,114	1.7400
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	518,400	905,768	1.7472
15 Nov 2011 18:32:38	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	492,480	861,420	1.7491
10 Nov 2011 03:44:49	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	466,560	816,098	1.7492
09 Nov 2011 13:18:53	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	440,640	770,607	1.7488
08 Nov 2011 23:50:48	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	414,720	724,973	1.7481
08 Nov 2011 09:37:42	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	388,800	677,815	1.7434
07 Nov 2011 19:13:21	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	362,880	630,775	1.7382
07 Nov 2011 05:29:50	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	336,960	585,546	1.7377
06 Nov 2011 14:58:27	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	311,040	540,262	1.7370
06 Nov 2011 01:24:47	1087414	13567538	hadcm3n_ygfu_1900_40_007525241_2	285,120	495,093	1.7364