climateprediction.net home page
Task 15876893

Task 15876893

Name hadcm3n_o3ny_1980_40_008386529_3
Workunit 8537388
Created 2 Jul 2013, 12:02:34 UTC
Sent 2 Jul 2013, 12:25:44 UTC
Report deadline 1 Oct 2013, 19:52:55 UTC
Received 18 Jul 2013, 11:35:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1279431
Run time 8 days 10 hours 11 min 18 sec
CPU time 7 days 1 hours 45 min 16 sec
Validate state Invalid
Credit 5,909.76
Device peak FLOPS 2.63 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:43:53 (12287): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09ab3218 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6bbe1)[0xf755cbe1]
/lib32/libc.so.6(+0x6d458)[0xf755e458]
/lib32/libc.so.6(cfree+0x6d)[0xf756153d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7737a31]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7737a8d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7507ca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 14737686                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 14737686                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09a5d000-09ac3000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7074000-f74ef000 rw-s 00000000 08:01 90166                              /var/lib/boinc-client/slots/13/138990
f74ef000-f74f1000 rw-p 00000000 00:00 0 
f74f1000-f7631000 r-xp 00000000 08:01 4440074                            /lib32/libc-2.11.3.so
f7631000-f7632000 ---p 00140000 08:01 4440074                            /lib32/libc-2.11.3.so
f7632000-f7634000 r--p 00140000 08:01 4440074                            /lib32/libc-2.11.3.so
f7634000-f7635000 rw-p 00142000 08:01 4440074                            /lib32/libc-2.11.3.so
f7635000-f7638000 rw-p 00000000 00:00 0 
f7638000-f7655000 r-xp 00000000 08:01 5720706                            /usr/lib32/libgcc_s.so.1
f7655000-f7656000 rw-p 0001c000 08:01 5720706                            /usr/lib32/libgcc_s.so.1
f7656000-f767a000 r-xp 00000000 08:01 4440087                            /lib32/libm-2.11.3.so
f767a000-f767b000 r--p 00023000 08:01 4440087                            /lib32/libm-2.11.3.so
f767b000-f767c000 rw-p 00024000 08:01 4440087                            /lib32/libm-2.11.3.so
f767c000-f7765000 r-xp 00000000 08:01 5720713                            /usr/lib32/libstdc++.so.6.0.13
f7765000-f7769000 r--p 000e9000 08:01 5720713                            /usr/lib32/libstdc++.so.6.0.13
f7769000-f776a000 rw-p 000ed000 08:01 5720713                            /usr/lib32/libstdc++.so.6.0.13
f776a000-f7771000 rw-p 00000000 00:00 0 
f7771000-f7773000 r-xp 00000000 08:01 4440086                            /lib32/libdl-2.11.3.so
f7773000-f7774000 r--p 00001000 08:01 4440086                            /lib32/libdl-2.11.3.so
f7774000-f7775000 rw-p 00002000 08:01 4440086                            /lib32/libdl-2.11.3.so
f7775000-f7776000 rw-p 00000000 00:00 0 
f7776000-f778b000 r-xp 00000000 08:01 4440069                            /lib32/libpthread-2.11.3.so
f778b000-f778c000 r--p 00014000 08:01 4440069                            /lib32/libpthread-2.11.3.so
f778c000-f778d000 rw-p 00015000 08:01 4440069                            /lib32/libpthread-2.11.3.so
f778d000-f778f000 rw-p 00000000 00:00 0 
f779c000-f779d000 rw-p 00000000 00:00 0 
f779d000-f779e000 ---p 00000000 00:00 0 
f779e000-f77a1000 rw-p 00000000 00:00 0 
f77a1000-f77a3000 rw-s 00000000 08:01 90162                              /var/lib/boinc-client/slots/13/boinc_mmap_file
f77a3000-f77a5000 rw-p 00000000 00:00 0 
f77a5000-f77a6000 r-xp 00000000 00:00 0                                  [vdso]
f77a6000-f77c2000 r-xp 00000000 08:01 4440070                            /lib32/ld-2.11.3.so
f77c2000-f77c3000 r--p 0001b000 08:01 4440070                            /lib32/ld-2.11.3.so
f77c3000-f77c4000 rw-p 0001c000 08:01 4440070                            /lib32/ld-2.11.3.so
fface000-ffb3e000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77a5400]
[0xf77a5430]
/lib32/libc.so.6(gsignal+0x51)[0xf751ba71]
/lib32/libc.so.6(abort+0x182)[0xf751ee92]
/lib32/libc.so.6(+0x61ae5)[0xf7552ae5]
/lib32/libc.so.6(+0x6bbe1)[0xf755cbe1]
/lib32/libc.so.6(+0x6d458)[0xf755e458]
/lib32/libc.so.6(cfree+0x6d)[0xf756153d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7737a31]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7737a8d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7507ca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jul 2013 15:03:53 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 492,480 579,997 1.1777
23 Jul 2013 15:03:54 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 466,560 549,966 1.1788
23 Jul 2013 15:03:54 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 440,640 519,805 1.1797
23 Jul 2013 15:03:53 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 414,720 489,676 1.1807
09 Jul 2013 12:23:31 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 388,800 459,504 1.1819
09 Jul 2013 02:30:33 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 362,880 428,961 1.1821
08 Jul 2013 13:58:38 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 336,960 399,151 1.1846
08 Jul 2013 03:41:14 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 311,040 368,203 1.1838
07 Jul 2013 17:31:38 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 285,120 337,213 1.1827
07 Jul 2013 07:10:44 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 259,200 306,420 1.1822
06 Jul 2013 19:23:29 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 233,280 275,366 1.1804
06 Jul 2013 05:40:29 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 207,360 244,617 1.1797
06 Jul 2013 05:15:06 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 181,440 213,560 1.1770
06 Jul 2013 04:43:08 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 155,520 183,364 1.1790
04 Jul 2013 19:07:40 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 129,600 153,289 1.1828
04 Jul 2013 14:25:09 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 103,680 122,389 1.1804
04 Jul 2013 14:02:30 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 77,760 91,432 1.1758
03 Jul 2013 12:11:58 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 51,840 61,047 1.1776
02 Jul 2013 22:12:57 1279431 15876893 hadcm3n_o3ny_1980_40_008386529_3 25,920 30,572 1.1795


©2024 climateprediction.net