climateprediction.net home page
Task 13094699

Task 13094699

Name hadcm3n_y9ov_1900_40_007345417_0
Workunit 7542847
Created 6 Jul 2011, 13:31:08 UTC
Sent 20 Jul 2011, 10:02:49 UTC
Report deadline 19 Oct 2011, 17:30:00 UTC
Received 12 Aug 2011, 13:07:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 993563
Run time 20 days 20 hours 55 min 35 sec
CPU time 18 days 3 hours 23 min 39 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 0.80 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
01:27:00 (6351): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:27:59 (6833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:49:47 (19098): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:34 (19110): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:52:40 (19118): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:53:35 (19124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:55:02 (19135): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:55:43 (19143): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:57:09 (19153): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:57:50 (19161): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:59:16 (19178): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:59:57 (19184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:01:23 (19193): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:02:19 (19204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:03:00 (19213): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:04:26 (19220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:05:22 (19226): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:07:14 (19237): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:07:56 (19246): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:09:04 (19260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:10:45 (19280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:12:54 (19293): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:13:35 (19299): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:14:36 (19307): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:16:16 (19313): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:17:27 (19328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:18:08 (19341): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:19:49 (19347): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:20:55 (19364): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:22:54 (19370): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:31:55 (19377): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:03:32 (19406): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:20:07 (19516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
06:36:36 (20100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:37:16 (22556): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:38:31 (22565): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:39:54 (22583): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:02:17 (22593): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:02:58 (23036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:03:36 (23043): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:05:58 (23056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:10:10 (23067): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:12:25 (23102): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:18:39 (23122): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:47:13 (528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:48:49 (5682): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
04:53:13 (11926): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:53:55 (13415): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:04:23 (13421): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:05:04 (15281): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:30:49 (15294): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:32:31 (16952): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:34:13 (16958): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
13:12:32 (3972): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:45:55 (3982): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:49:19 (4333): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:35:49 (4348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:36:53 (5800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:39:58 (5808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:41:32 (6010): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:35:43 (6018): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09ecd370 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0x961591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0x962de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0x965ecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x3e9741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x3e979d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x90cbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
00249000-0024b000 r-xp 00000000 08:01 1111992    /lib/tls/i686/cmov/libdl-2.11.1.so
0024b000-0024c000 r--p 00001000 08:01 1111992    /lib/tls/i686/cmov/libdl-2.11.1.so
0024c000-0024d000 rw-p 00002000 08:01 1111992    /lib/tls/i686/cmov/libdl-2.11.1.so
00289000-0028a000 r-xp 00000000 00:00 0          [vdso]
0032e000-00417000 r-xp 00000000 08:01 1276970    /usr/lib/libstdc++.so.6.0.13
00417000-00418000 ---p 000e9000 08:01 1276970    /usr/lib/libstdc++.so.6.0.13
00418000-0041c000 r--p 000e9000 08:01 1276970    /usr/lib/libstdc++.so.6.0.13
0041c000-0041d000 rw-p 000ed000 08:01 1276970    /usr/lib/libstdc++.so.6.0.13
0041d000-00424000 rw-p 00000000 00:00 0 
006f6000-0071a000 r-xp 00000000 08:01 1111996    /lib/tls/i686/cmov/libm-2.11.1.so
0071a000-0071b000 r--p 00023000 08:01 1111996    /lib/tls/i686/cmov/libm-2.11.1.so
0071b000-0071c000 rw-p 00024000 08:01 1111996    /lib/tls/i686/cmov/libm-2.11.1.so
008f6000-00a49000 r-xp 00000000 08:01 1111972    /lib/tls/i686/cmov/libc-2.11.1.so
00a49000-00a4a000 ---p 00153000 08:01 1111972    /lib/tls/i686/cmov/libc-2.11.1.so
00a4a000-00a4c000 r--p 00153000 08:01 1111972    /lib/tls/i686/cmov/libc-2.11.1.so
00a4c000-00a4d000 rw-p 00155000 08:01 1111972    /lib/tls/i686/cmov/libc-2.11.1.so
00a4d000-00a50000 rw-p 00000000 00:00 0 
00dc9000-00de6000 r-xp 00000000 08:01 1112133    /lib/libgcc_s.so.1
00de6000-00de7000 r--p 0001c000 08:01 1112133    /lib/libgcc_s.so.1
00de7000-00de8000 rw-p 0001d000 08:01 1112133    /lib/libgcc_s.so.1
00f80000-00f9b000 r-xp 00000000 08:01 1247084    /lib/ld-2.11.1.so
00f9b000-00f9c000 r--p 0001a000 08:01 1247084    /lib/ld-2.11.1.so
00f9c000-00f9d000 rw-p 0001b000 08:01 1247084    /lib/ld-2.11.1.so
00fa2000-00fb7000 r-xp 00000000 08:01 1112096    /lib/tls/i686/cmov/libpthread-2.11.1.so
00fb7000-00fb8000 r--p 00014000 08:01 1112096    /lib/tls/i686/cmov/libpthread-2.11.1.so
00fb8000-00fb9000 rw-p 00015000 08:01 1112096    /lib/tls/i686/cmov/libpthread-2.11.1.so
00fb9000-00fbb000 rw-p 00000000 00:00 0 
08048000-080e3000 r-xp 00000000 08:01 3581185    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 3581185    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09e78000-09ede000 rw-p 00000000 00:00 0          [heap]
b7200000-b7221000 rw-p 00000000 00:00 0 
b7221000-b7300000 ---p 00000000 00:00 0 
b73cc000-b7847000 rw-s 00000000 08:01 1194689    /var/lib/boinc-client/slots/3/137635
b7847000-b784a000 rw-p 00000000 00:00 0 
b785f000-b7860000 rw-p 00000000 00:00 0 
b7860000-b7861000 ---p 00000000 00:00 0 
b7861000-b7864000 rw-p 00000000 00:00 0 
b7864000-b7866000 rw-s 00000000 08:01 1194685    /var/lib/boinc-client/slots/3/boinc_mmap_file
b7866000-b7868000 rw-p 00000000 00:00 0 
bf859000-bf8c8000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0x289400]
[0x289422]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51)[0x920651]
/lib/tls/i686/cmov/libc.so.6(abort+0x182)[0x923a82]
/lib/tls/i686/cmov/libc.so.6(+0x6149d)[0x95749d]
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0x961591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0x962de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0x965ecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x3e9741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x3e979d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x90cbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Aug 2011 13:03:11 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 259,200 1,567,412 6.0471
09 Aug 2011 02:29:13 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 233,280 1,402,904 6.0138
07 Aug 2011 03:21:48 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 207,360 1,243,764 5.9981
05 Aug 2011 04:12:13 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 181,440 1,085,617 5.9833
02 Aug 2011 21:09:36 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 155,520 928,655 5.9713
31 Jul 2011 17:39:19 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 129,600 775,287 5.9822
29 Jul 2011 01:04:00 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 103,680 615,597 5.9375
26 Jul 2011 18:33:51 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 77,760 459,009 5.9029
25 Jul 2011 21:53:38 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 51,840 304,407 5.8720
25 Jul 2011 19:01:24 993563 13094699 hadcm3n_y9ov_1900_40_007345417_0 25,920 154,509 5.9610


©2024 climateprediction.net