climateprediction.net home page
Task 12824616

Task 12824616

Name hadcm3n_p3oa_1900_40_007222346_1
Workunit 7420586
Created 26 Apr 2011, 15:25:39 UTC
Sent 30 Apr 2011, 19:37:25 UTC
Report deadline 31 Jul 2011, 3:04:36 UTC
Received 6 May 2011, 4:52:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1026335
Run time 5 days 3 hours 2 min 14 sec
CPU time 5 days 0 hours 30 min 55 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 3.28 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
15:34:26 (8561): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:35:15 (8599): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:59:10 (8613): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
03:41:18 (8658): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:48:12 (8696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
15:53:21 (8898): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:24:30 (8930): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:24:16 (8985): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
04:29:16 (8999): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:03:06 (9031): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:44:14 (9298): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
16:48:56 (9316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:58:49 (9348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
04:57:15 (9404): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:10:08 (9436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
17:04:07 (9648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:48 (9679): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
05:09:53 (9736): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:25 (9768): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:05:10 (9781): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:27:04 (9798): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
17:21:59 (12017): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:24 (12311): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
05:27:32 (12367): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x095dc578 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c231)[0xf7530231]
/lib32/libc.so.6(+0x6dab8)[0xf7531ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf7534b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771ea91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771eaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74dabd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 8136955                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 8136955                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09587000-095ec000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7047000-f74c2000 rw-s 00000000 08:01 8131840                            /var/lib/boinc-client/slots/1/135230
f74c2000-f74c4000 rw-p 00000000 00:00 0 
f74c4000-f7617000 r-xp 00000000 08:01 5636172                            /lib32/libc-2.11.1.so
f7617000-f7618000 ---p 00153000 08:01 5636172                            /lib32/libc-2.11.1.so
f7618000-f761a000 r--p 00153000 08:01 5636172                            /lib32/libc-2.11.1.so
f761a000-f761b000 rw-p 00155000 08:01 5636172                            /lib32/libc-2.11.1.so
f761b000-f761e000 rw-p 00000000 00:00 0 
f761e000-f763b000 r-xp 00000000 08:01 655963                             /usr/lib32/libgcc_s.so.1
f763b000-f763c000 r--p 0001c000 08:01 655963                             /usr/lib32/libgcc_s.so.1
f763c000-f763d000 rw-p 0001d000 08:01 655963                             /usr/lib32/libgcc_s.so.1
f763d000-f7661000 r-xp 00000000 08:01 5636178                            /lib32/libm-2.11.1.so
f7661000-f7662000 r--p 00023000 08:01 5636178                            /lib32/libm-2.11.1.so
f7662000-f7663000 rw-p 00024000 08:01 5636178                            /lib32/libm-2.11.1.so
f7663000-f774c000 r-xp 00000000 08:01 655966                             /usr/lib32/libstdc++.so.6.0.13
f774c000-f774d000 ---p 000e9000 08:01 655966                             /usr/lib32/libstdc++.so.6.0.13
f774d000-f7751000 r--p 000e9000 08:01 655966                             /usr/lib32/libstdc++.so.6.0.13
f7751000-f7752000 rw-p 000ed000 08:01 655966                             /usr/lib32/libstdc++.so.6.0.13
f7752000-f7759000 rw-p 00000000 00:00 0 
f7759000-f775b000 r-xp 00000000 08:01 5636176                            /lib32/libdl-2.11.1.so
f775b000-f775c000 r--p 00001000 08:01 5636176                            /lib32/libdl-2.11.1.so
f775c000-f775d000 rw-p 00002000 08:01 5636176                            /lib32/libdl-2.11.1.so
f775d000-f775e000 rw-p 00000000 00:00 0 
f775e000-f7773000 r-xp 00000000 08:01 5636192                            /lib32/libpthread-2.11.1.so
f7773000-f7774000 r--p 00014000 08:01 5636192                            /lib32/libpthread-2.11.1.so
f7774000-f7775000 rw-p 00015000 08:01 5636192                            /lib32/libpthread-2.11.1.so
f7775000-f7777000 rw-p 00000000 00:00 0 
f778c000-f778d000 rw-p 00000000 00:00 0 
f778d000-f778e000 ---p 00000000 00:00 0 
f778e000-f7791000 rw-p 00000000 00:00 0 
f7791000-f7793000 rw-s 00000000 08:01 8127577                            /var/lib/boinc-client/slots/1/boinc_mmap_file
f7793000-f7795000 rw-p 00000000 00:00 0 
f7795000-f7796000 r-xp 00000000 00:00 0                                  [vdso]
f7796000-f77b2000 r-xp 00000000 08:01 5636137                            /lib32/ld-2.11.1.so
f77b2000-f77b3000 r--p 0001b000 08:01 5636137                            /lib32/ld-2.11.1.so
f77b3000-f77b4000 rw-p 0001c000 08:01 5636137                            /lib32/ld-2.11.1.so
ffca6000-ffd15000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7795400]
[0xf7795430]
/lib32/libc.so.6(gsignal+0x51)[0xf74ee921]
/lib32/libc.so.6(abort+0x182)[0xf74f1d52]
/lib32/libc.so.6(+0x6213d)[0xf752613d]
/lib32/libc.so.6(+0x6c231)[0xf7530231]
/lib32/libc.so.6(+0x6dab8)[0xf7531ab8]
/lib32/libc.so.6(cfree+0x6d)[0xf7534b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771ea91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771eaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74dabd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 May 2011 04:59:38 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 259,200 433,851 1.6738
05 May 2011 17:09:43 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 233,280 391,626 1.6788
05 May 2011 04:22:33 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 207,360 349,107 1.6836
04 May 2011 16:13:18 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 181,440 306,509 1.6893
04 May 2011 04:07:48 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 155,520 263,868 1.6967
03 May 2011 15:58:11 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 129,600 220,656 1.7026
03 May 2011 03:45:01 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 103,680 177,340 1.7105
02 May 2011 15:24:43 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 77,760 133,902 1.7220
02 May 2011 02:44:55 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 51,840 89,389 1.7243
01 May 2011 13:58:55 1026335 12824616 hadcm3n_p3oa_1900_40_007222346_1 25,920 44,021 1.6983


©2024 climateprediction.net