climateprediction.net home page
Task 15603872

Task 15603872

Name hadcm3n_4bt4_1940_40_008307594_3
Workunit 8458729
Created 10 Feb 2013, 15:52:42 UTC
Sent 10 Feb 2013, 15:52:47 UTC
Report deadline 12 May 2013, 23:19:58 UTC
Received 25 Feb 2013, 9:43:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1231328
Run time 8 days 7 hours 12 min 45 sec
CPU time 5 days 2 hours 12 min 25 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 3.04 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.31</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
04:29:15 (54816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:29:20 (54816): No heartbeat from core client for 30 sec - exiting
04:29:21 (54816): No heartbeat from core client for 30 sec - exiting
04:29:22 (54816): No heartbeat from core client for 30 sec - exiting
04:29:23 (54816): No heartbeat from core client for 30 sec - exiting
04:29:24 (54816): No heartbeat from core client for 30 sec - exiting
04:29:25 (54816): No heartbeat from core client for 30 sec - exiting
04:29:26 (54816): No heartbeat from core client for 30 sec - exiting
04:29:27 (54816): No heartbeat from core client for 30 sec - exiting
04:29:28 (54816): No heartbeat from core client for 30 sec - exiting
04:29:29 (54816): No heartbeat from core client for 30 sec - exiting
04:29:30 (54816): No heartbeat from core client for 30 sec - exiting
04:29:31 (54816): No heartbeat from core client for 30 sec - exiting
04:29:32 (54816): No heartbeat from core client for 30 sec - exiting
04:29:33 (54816): No heartbeat from core client for 30 sec - exiting
04:29:34 (54816): No heartbeat from core client for 30 sec - exiting
04:29:35 (54816): No heartbeat from core client for 30 sec - exiting
04:29:36 (54816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:20:54 (15645): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:20:55 (15645): No heartbeat from core client for 30 sec - exiting
02:20:56 (15645): No heartbeat from core client for 30 sec - exiting
02:20:57 (15645): No heartbeat from core client for 30 sec - exiting
02:20:58 (15645): No heartbeat from core client for 30 sec - exiting
02:20:59 (15645): No heartbeat from core client for 30 sec - exiting
02:21:00 (15645): No heartbeat from core client for 30 sec - exiting
02:21:01 (15645): No heartbeat from core client for 30 sec - exiting
02:21:02 (15645): No heartbeat from core client for 30 sec - exiting
02:21:03 (15645): No heartbeat from core client for 30 sec - exiting
02:21:04 (15645): No heartbeat from core client for 30 sec - exiting
02:21:05 (15645): No heartbeat from core client for 30 sec - exiting
02:21:06 (15645): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:06:20 (77375): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:06:25 (77375): No heartbeat from core client for 30 sec - exiting
21:06:26 (77375): No heartbeat from core client for 30 sec - exiting
21:06:27 (77375): No heartbeat from core client for 30 sec - exiting
21:06:28 (77375): No heartbeat from core client for 30 sec - exiting
21:06:29 (77375): No heartbeat from core client for 30 sec - exiting
21:06:30 (77375): No heartbeat from core client for 30 sec - exiting
21:06:31 (77375): No heartbeat from core client for 30 sec - exiting
21:06:32 (77375): No heartbeat from core client for 30 sec - exiting
21:06:33 (77375): No heartbeat from core client for 30 sec - exiting
21:06:34 (77375): No heartbeat from core client for 30 sec - exiting
21:06:35 (77375): No heartbeat from core client for 30 sec - exiting
03:58:18 (78594): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:58:21 (78594): No heartbeat from core client for 30 sec - exiting
03:58:22 (78594): No heartbeat from core client for 30 sec - exiting
03:58:23 (78594): No heartbeat from core client for 30 sec - exiting
03:58:25 (78594): No heartbeat from core client for 30 sec - exiting
03:58:26 (78594): No heartbeat from core client for 30 sec - exiting
03:58:27 (78594): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x820e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x83c404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x83c400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x302b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x4022c04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x4022c00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x820e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x83c404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x83c400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x1047604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(97581,0xa0767540) malloc: *** error for object 0x3824a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Mon Feb 25 00:42:48 2013

Thread 0 Crashed:
atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
0   libSystem.B.dylib                   0x94e44d3a small_malloc_from_free_list + 762
1   libSystem.B.dylib                   0x94e414d9 szone_malloc_should_clear + 2271
2   libSystem.B.dylib                   0x94e40ba8 malloc_zone_malloc + 81
3   libSystem.B.dylib                   0x94e3ec78 malloc + 50
4   libstdc++.6.dylib                   0x912ec617 operator new(unsigned long) + 36
5   libstdc++.6.dylib                   0x912ec703 operator new[](unsigned long) + 17
6   hadcm3n_6.07_i686-apple-darwin      0x0000b8e7 annual_cycle(std::vector<std::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::allocator<std::basic_string<char, std::char_traits<char>, std::allocator<char> > > > const*, char const*, int, int) + 3113
7   hadcm3n_6.07_i686-apple-darwin      0x0000d36b decadalMeans(int, char const*) + 957
8   hadcm3n_6.07_i686-apple-darwin      0x000067ff doCM3Proc() + 185
9   hadcm3n_6.07_i686-apple-darwin      0x0000791c mainLoop() + 410
10  hadcm3n_6.07_i686-apple-darwin      0x000087c7 worker() + 2989
11  hadcm3n_6.07_i686-apple-darwin      0x00008aa9 main + 491
12  hadcm3n_6.07_i686-apple-darwin      0x00002676 start + 54

Thread 1:
0   libSystem.B.dylib                   0x94e3cc0e mach_wait_until + 10
1   libSystem.B.dylib                   0x94ec4429 nanosleep + 345
2   libSystem.B.dylib                   0x94ec42ca usleep + 61
3   hadcm3n_6.07_i686-apple-darwin      0x00071a7c boinc_sleep(double) + 188
4   hadcm3n_6.07_i686-apple-darwin      0x00067282 timer_thread(void*) + 78
5   libSystem.B.dylib                   0x94e6a259 _pthread_start + 345
6   libSystem.B.dylib                   0x94e6a0de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f668 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/4/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x904ea000 - 0x904f8fff /usr/lib/libz.1.dylib
0x912a2000 - 0x9130cfff /usr/lib/libstdc++.6.dylib
0x94e3c000 - 0x94fe3fff /usr/lib/libSystem.B.dylib
0x977a4000 - 0x977a7fff /usr/lib/system/libmathCommon.A.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Feb 2013 08:44:43 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 259,200 439,943 1.6973
23 Feb 2013 15:50:45 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 233,280 394,482 1.6910
22 Feb 2013 09:47:12 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 207,360 350,598 1.6908
21 Feb 2013 03:08:25 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 181,440 306,534 1.6895
19 Feb 2013 10:23:37 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 155,520 262,763 1.6896
18 Feb 2013 05:17:33 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 129,600 219,214 1.6915
16 Feb 2013 12:40:06 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 103,680 175,101 1.6889
15 Feb 2013 06:41:43 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 77,760 131,017 1.6849
13 Feb 2013 13:50:18 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 51,840 87,567 1.6892
12 Feb 2013 08:34:34 1231328 15603872 hadcm3n_4bt4_1940_40_008307594_3 25,920 44,576 1.7198


©2024 climateprediction.net