climateprediction.net home page
Task 12974047

Task 12974047

Name hadcm3n_o3nw_1940_40_007267827_2
Workunit 7466067
Created 12 Jun 2011, 23:07:01 UTC
Sent 12 Jun 2011, 23:07:02 UTC
Report deadline 12 Sep 2011, 6:34:13 UTC
Received 15 Jul 2011, 15:13:33 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 922483
Run time 13 days 17 hours 46 min 58 sec
CPU time 13 days 12 hours 39 min 27 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.23 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:08:31 (1994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09e4bba8 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c421)[0xf750d421]
/lib32/libc.so.6(+0x6dcb0)[0xf750ecb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7511d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76e87b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76e880d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74b7ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 4546641                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 4546641                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09df6000-09e5c000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7023000-f749e000 rw-s 00000000 08:01 4194338                            /var/lib/boinc-client/slots/0/138340
f749e000-f74a1000 rw-p 00000000 00:00 0 
f74a1000-f75f5000 r-xp 00000000 08:01 11927585                           /lib32/libc-2.12.1.so
f75f5000-f75f6000 ---p 00154000 08:01 11927585                           /lib32/libc-2.12.1.so
f75f6000-f75f8000 r--p 00154000 08:01 11927585                           /lib32/libc-2.12.1.so
f75f8000-f75f9000 rw-p 00156000 08:01 11927585                           /lib32/libc-2.12.1.so
f75f9000-f75fc000 rw-p 00000000 00:00 0 
f75fc000-f7616000 r-xp 00000000 08:01 3072013                            /usr/lib32/libgcc_s.so.1
f7616000-f7617000 r--p 00019000 08:01 3072013                            /usr/lib32/libgcc_s.so.1
f7617000-f7618000 rw-p 0001a000 08:01 3072013                            /usr/lib32/libgcc_s.so.1
f7618000-f763c000 r-xp 00000000 08:01 11927598                           /lib32/libm-2.12.1.so
f763c000-f763d000 r--p 00023000 08:01 11927598                           /lib32/libm-2.12.1.so
f763d000-f763e000 rw-p 00024000 08:01 11927598                           /lib32/libm-2.12.1.so
f763e000-f771d000 r-xp 00000000 08:01 3072022                            /usr/lib32/libstdc++.so.6.0.14
f771d000-f7721000 r--p 000de000 08:01 3072022                            /usr/lib32/libstdc++.so.6.0.14
f7721000-f7722000 rw-p 000e2000 08:01 3072022                            /usr/lib32/libstdc++.so.6.0.14
f7722000-f7729000 rw-p 00000000 00:00 0 
f7729000-f772b000 r-xp 00000000 08:01 11927615                           /lib32/libdl-2.12.1.so
f772b000-f772c000 r--p 00001000 08:01 11927615                           /lib32/libdl-2.12.1.so
f772c000-f772d000 rw-p 00002000 08:01 11927615                           /lib32/libdl-2.12.1.so
f772d000-f772e000 rw-p 00000000 00:00 0 
f772e000-f7743000 r-xp 00000000 08:01 11927589                           /lib32/libpthread-2.12.1.so
f7743000-f7744000 r--p 00014000 08:01 11927589                           /lib32/libpthread-2.12.1.so
f7744000-f7745000 rw-p 00015000 08:01 11927589                           /lib32/libpthread-2.12.1.so
f7745000-f7747000 rw-p 00000000 00:00 0 
f7761000-f7762000 rw-p 00000000 00:00 0 
f7762000-f7763000 ---p 00000000 00:00 0 
f7763000-f7766000 rw-p 00000000 00:00 0 
f7766000-f7768000 rw-s 00000000 08:01 4194335                            /var/lib/boinc-client/slots/0/boinc_mmap_file
f7768000-f776a000 rw-p 00000000 00:00 0 
f776a000-f776b000 r-xp 00000000 00:00 0                                  [vdso]
f776b000-f7787000 r-xp 00000000 08:01 11927599                           /lib32/ld-2.12.1.so
f7787000-f7788000 r--p 0001b000 08:01 11927599                           /lib32/ld-2.12.1.so
f7788000-f7789000 rw-p 0001c000 08:01 11927599                           /lib32/ld-2.12.1.so
ff990000-ffa01000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf776a400]
[0xf776a430]
/lib32/libc.so.6(gsignal+0x51)[0xf74cba01]
/lib32/libc.so.6(abort+0x182)[0xf74cee42]
/lib32/libc.so.6(+0x62345)[0xf7503345]
/lib32/libc.so.6(+0x6c421)[0xf750d421]
/lib32/libc.so.6(+0x6dcb0)[0xf750ecb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7511d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76e87b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76e880d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74b7ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2011 13:28:50 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 518,400 1,168,758 2.2545
25 Jul 2011 13:28:50 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 492,480 1,115,068 2.2642
25 Jul 2011 13:28:50 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 466,560 1,061,072 2.2742
25 Jul 2011 13:28:50 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 440,640 1,007,130 2.2856
25 Jul 2011 13:28:50 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 414,720 953,278 2.2986
25 Jul 2011 13:28:50 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 388,800 899,482 2.3135
10 Jul 2011 17:48:04 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 362,880 845,525 2.3300
09 Jul 2011 23:43:09 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 336,960 785,029 2.3297
09 Jul 2011 03:02:18 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 311,040 722,913 2.3242
08 Jul 2011 05:42:33 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 285,120 659,790 2.3141
07 Jul 2011 15:43:39 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 259,200 598,137 2.3076
24 Jun 2011 18:15:00 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 233,280 536,437 2.2995
23 Jun 2011 13:53:20 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 207,360 475,154 2.2914
22 Jun 2011 08:57:14 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 181,440 414,006 2.2818
21 Jun 2011 15:44:19 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 155,520 353,070 2.2703
20 Jun 2011 22:08:12 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 129,600 292,152 2.2543
19 Jun 2011 22:04:46 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 103,680 235,464 2.2711
16 Jun 2011 14:52:32 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 77,760 176,221 2.2662
15 Jun 2011 21:21:03 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 51,840 116,436 2.2461
13 Jun 2011 18:14:30 922483 12974047 hadcm3n_o3nw_1940_40_007267827_2 25,920 58,023 2.2385


©2024 climateprediction.net