climateprediction.net home page
Task 13270708

Task 13270708

Name hadcm3n_yl8g_1940_40_007414038_1
Workunit 7611668
Created 17 Aug 2011, 11:04:32 UTC
Sent 17 Aug 2011, 23:40:51 UTC
Report deadline 17 Nov 2011, 7:08:02 UTC
Received 31 Aug 2011, 4:24:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1140527
Run time 11 days 10 hours 18 min 26 sec
CPU time 10 days 2 hours 55 min 54 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.86 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x082bb8c8 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c231)[0xf7513231]
/lib32/libc.so.6(+0x6dab8)[0xf7514ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf7517b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7701a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7701aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74bdbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:22 11403860                           /opt/BOINC/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 08:22 11403860                           /opt/BOINC/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 00000000 00:00 0 
08266000-082cb000 rwxp 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rwxp 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f702a000-f74a5000 rwxs 00000000 08:22 12849034                           /opt/BOINC/BOINC/slots/10/136155
f74a5000-f74a7000 rwxp 00000000 00:00 0 
f74a7000-f75fa000 r-xp 00000000 08:22 4063237                            /lib32/libc-2.11.1.so
f75fa000-f75fb000 ---p 00153000 08:22 4063237                            /lib32/libc-2.11.1.so
f75fb000-f75fd000 r-xp 00153000 08:22 4063237                            /lib32/libc-2.11.1.so
f75fd000-f75fe000 rwxp 00155000 08:22 4063237                            /lib32/libc-2.11.1.so
f75fe000-f7601000 rwxp 00000000 00:00 0 
f7601000-f761e000 r-xp 00000000 08:22 3282217                            /usr/lib32/libgcc_s.so.1
f761e000-f761f000 r-xp 0001c000 08:22 3282217                            /usr/lib32/libgcc_s.so.1
f761f000-f7620000 rwxp 0001d000 08:22 3282217                            /usr/lib32/libgcc_s.so.1
f7620000-f7644000 r-xp 00000000 08:22 4063241                            /lib32/libm-2.11.1.so
f7644000-f7645000 r-xp 00023000 08:22 4063241                            /lib32/libm-2.11.1.so
f7645000-f7646000 rwxp 00024000 08:22 4063241                            /lib32/libm-2.11.1.so
f7646000-f772f000 r-xp 00000000 08:22 3282231                            /usr/lib32/libstdc++.so.6.0.13
f772f000-f7730000 ---p 000e9000 08:22 3282231                            /usr/lib32/libstdc++.so.6.0.13
f7730000-f7734000 r-xp 000e9000 08:22 3282231                            /usr/lib32/libstdc++.so.6.0.13
f7734000-f7735000 rwxp 000ed000 08:22 3282231                            /usr/lib32/libstdc++.so.6.0.13
f7735000-f773c000 rwxp 00000000 00:00 0 
f773c000-f773e000 r-xp 00000000 08:22 4063240                            /lib32/libdl-2.11.1.so
f773e000-f773f000 r-xp 00001000 08:22 4063240                            /lib32/libdl-2.11.1.so
f773f000-f7740000 rwxp 00002000 08:22 4063240                            /lib32/libdl-2.11.1.so
f7740000-f7755000 r-xp 00000000 08:22 4063251                            /lib32/libpthread-2.11.1.so
f7755000-f7756000 r-xp 00014000 08:22 4063251                            /lib32/libpthread-2.11.1.so
f7756000-f7757000 rwxp 00015000 08:22 4063251                            /lib32/libpthread-2.11.1.so
f7757000-f775a000 rwxp 00000000 00:00 0 
f776e000-f776f000 rwxp 00000000 00:00 0 
f776f000-f7770000 ---p 00000000 00:00 0 
f7770000-f7773000 rwxp 00000000 00:00 0 
f7773000-f7775000 rwxs 00000000 08:22 12849023                           /opt/BOINC/BOINC/slots/10/boinc_mmap_file
f7775000-f7777000 rwxp 00000000 00:00 0 
f7777000-f7778000 r-xp 00000000 00:00 0                                  [vdso]
f7778000-f7794000 r-xp 00000000 08:22 4063234                            /lib32/ld-2.11.1.so
f7794000-f7795000 r-xp 0001b000 08:22 4063234                            /lib32/ld-2.11.1.so
f7795000-f7796000 rwxp 0001c000 08:22 4063234                            /lib32/ld-2.11.1.so
ffc92000-ffd03000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7777400]
[0xf7777430]
/lib32/libc.so.6(gsignal+0x51)[0xf74d1921]
/lib32/libc.so.6(abort+0x182)[0xf74d4d52]
/lib32/libc.so.6(+0x6213d)[0xf750913d]
/lib32/libc.so.6(+0x6c231)[0xf7513231]
/lib32/libc.so.6(+0x6dab8)[0xf7514ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf7517b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7701a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7701aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74bdbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 Aug 2011 04:24:27 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 518,400 874,553 1.6870
30 Aug 2011 10:24:38 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 492,480 827,416 1.6801
29 Aug 2011 16:26:17 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 466,560 780,157 1.6721
28 Aug 2011 22:56:41 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 440,640 735,792 1.6698
27 Aug 2011 21:45:59 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 414,720 688,101 1.6592
27 Aug 2011 01:25:45 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 388,800 639,261 1.6442
26 Aug 2011 07:16:56 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 362,880 590,566 1.6274
25 Aug 2011 12:59:49 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 336,960 541,667 1.6075
24 Aug 2011 20:01:42 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 311,040 487,339 1.5668
24 Aug 2011 05:29:18 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 285,120 440,770 1.5459
23 Aug 2011 15:20:31 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 259,200 393,822 1.5194
23 Aug 2011 02:57:28 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 233,280 352,617 1.5116
22 Aug 2011 17:26:55 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 207,360 318,102 1.5341
22 Aug 2011 07:38:36 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 181,440 283,616 1.5631
21 Aug 2011 22:55:58 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 155,520 250,077 1.6080
21 Aug 2011 13:14:46 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 129,600 215,971 1.6664
21 Aug 2011 02:40:48 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 103,680 180,428 1.7402
20 Aug 2011 12:28:37 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 77,760 133,304 1.7143
19 Aug 2011 20:17:25 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 51,840 87,644 1.6907
18 Aug 2011 23:03:54 1140527 13270708 hadcm3n_yl8g_1940_40_007414038_1 25,920 43,239 1.6682


©2024 climateprediction.net