climateprediction.net home page
Task 12921207

Task 12921207

Name hadcm3n_o1re_1940_40_007265025_1
Workunit 7463265
Created 2 Jun 2011, 4:43:46 UTC
Sent 2 Jun 2011, 4:43:50 UTC
Report deadline 1 Sep 2011, 12:11:01 UTC
Received 4 Jul 2011, 7:58:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1039585
Run time
CPU time 16 days 6 hours 4 min 34 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.30 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.4.5</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
22:19:03 (7618): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09498968 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6[0x1a10d1]
/lib/tls/i686/cmov/libc.so.6[0x1a27d2]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0x1a58ad]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xc046f1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xc0474d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x14cb56]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
00110000-00134000 r-xp 00000000 08:01 133147     /lib/tls/i686/cmov/libm-2.10.1.so
00134000-00135000 r--p 00023000 08:01 133147     /lib/tls/i686/cmov/libm-2.10.1.so
00135000-00136000 rw-p 00024000 08:01 133147     /lib/tls/i686/cmov/libm-2.10.1.so
00136000-00274000 r-xp 00000000 08:01 133143     /lib/tls/i686/cmov/libc-2.10.1.so
00274000-00275000 ---p 0013e000 08:01 133143     /lib/tls/i686/cmov/libc-2.10.1.so
00275000-00277000 r--p 0013e000 08:01 133143     /lib/tls/i686/cmov/libc-2.10.1.so
00277000-00278000 rw-p 00140000 08:01 133143     /lib/tls/i686/cmov/libc-2.10.1.so
00278000-0027b000 rw-p 00000000 00:00 0 
004f8000-00514000 r-xp 00000000 08:01 737        /lib/libgcc_s.so.1
00514000-00515000 r--p 0001b000 08:01 737        /lib/libgcc_s.so.1
00515000-00516000 rw-p 0001c000 08:01 737        /lib/libgcc_s.so.1
00641000-00642000 r-xp 00000000 00:00 0          [vdso]
00b20000-00b35000 r-xp 00000000 08:01 133157     /lib/tls/i686/cmov/libpthread-2.10.1.so
00b35000-00b36000 r--p 00014000 08:01 133157     /lib/tls/i686/cmov/libpthread-2.10.1.so
00b36000-00b37000 rw-p 00015000 08:01 133157     /lib/tls/i686/cmov/libpthread-2.10.1.so
00b37000-00b39000 rw-p 00000000 00:00 0 
00b4c000-00c32000 r-xp 00000000 08:01 144215     /usr/lib/libstdc++.so.6.0.13
00c32000-00c36000 r--p 000e6000 08:01 144215     /usr/lib/libstdc++.so.6.0.13
00c36000-00c37000 rw-p 000ea000 08:01 144215     /usr/lib/libstdc++.so.6.0.13
00c37000-00c3e000 rw-p 00000000 00:00 0 
00cb1000-00ccc000 r-xp 00000000 08:01 650        /lib/ld-2.10.1.so
00ccc000-00ccd000 r--p 0001a000 08:01 650        /lib/ld-2.10.1.so
00ccd000-00cce000 rw-p 0001b000 08:01 650        /lib/ld-2.10.1.so
00e0a000-00e0c000 r-xp 00000000 08:01 133146     /lib/tls/i686/cmov/libdl-2.10.1.so
00e0c000-00e0d000 r--p 00001000 08:01 133146     /lib/tls/i686/cmov/libdl-2.10.1.so
00e0d000-00e0e000 rw-p 00002000 08:01 133146     /lib/tls/i686/cmov/libdl-2.10.1.so
08048000-080e3000 r-xp 00000000 08:01 264120     /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 264120     /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09443000-094a9000 rw-p 00000000 00:00 0          [heap]
b7300000-b7321000 rw-p 00000000 00:00 0 
b7321000-b7400000 ---p 00000000 00:00 0 
b7426000-b78a1000 rw-s 00000000 08:01 792667     /var/lib/boinc-client/slots/1/135830
b78a1000-b78a4000 rw-p 00000000 00:00 0 
b78b1000-b78b2000 rw-p 00000000 00:00 0 
b78b2000-b78b3000 ---p 00000000 00:00 0 
b78b3000-b78b6000 rw-p 00000000 00:00 0 
b78b6000-b78b8000 rw-s 00000000 08:01 792576     /var/lib/boinc-client/slots/1/boinc_mmap_file
b78b8000-b78ba000 rw-p 00000000 00:00 0 
bf896000-bf905000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0x641400]
[0x641422]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51)[0x1604d1]
/lib/tls/i686/cmov/libc.so.6(abort+0x182)[0x163932]
/lib/tls/i686/cmov/libc.so.6[0x196fc5]
/lib/tls/i686/cmov/libc.so.6[0x1a10d1]
/lib/tls/i686/cmov/libc.so.6[0x1a27d2]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0x1a58ad]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xc046f1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xc0474d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x14cb56]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Jul 2011 12:51:43 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 518,400 1,404,258 2.7088
02 Jul 2011 05:43:53 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 492,480 1,330,397 2.7014
30 Jun 2011 22:03:51 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 466,560 1,260,221 2.7011
29 Jun 2011 03:16:44 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 440,640 1,188,663 2.6976
27 Jun 2011 06:43:14 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 414,720 1,117,438 2.6944
25 Jun 2011 21:10:30 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 388,800 1,047,134 2.6932
24 Jun 2011 13:23:51 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 362,880 977,126 2.6927
23 Jun 2011 07:41:48 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 336,960 907,190 2.6923
22 Jun 2011 01:07:43 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 311,040 836,603 2.6897
20 Jun 2011 03:33:18 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 285,120 762,406 2.6740
19 Jun 2011 22:05:41 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 259,200 692,201 2.6705
17 Jun 2011 12:32:05 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 233,280 622,285 2.6675
16 Jun 2011 16:02:49 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 207,360 551,523 2.6597
15 Jun 2011 18:53:48 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 181,440 483,549 2.6651
14 Jun 2011 23:35:22 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 155,520 416,244 2.6765
14 Jun 2011 04:05:03 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 129,600 348,476 2.6889
13 Jun 2011 08:44:09 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 103,680 281,359 2.7137
11 Jun 2011 03:32:44 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 77,760 208,170 2.6771
10 Jun 2011 07:43:25 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 51,840 139,999 2.7006
08 Jun 2011 17:45:36 1039585 12921207 hadcm3n_o1re_1940_40_007265025_1 25,920 68,714 2.6510


©2024 climateprediction.net