climateprediction.net home page
Task 12821234

Task 12821234

Name hadcm3n_p2dc_1900_40_007220656_0
Workunit 7418896
Created 26 Apr 2011, 15:20:49 UTC
Sent 2 May 2011, 16:06:52 UTC
Report deadline 1 Aug 2011, 23:34:03 UTC
Received 25 May 2011, 11:23:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1060199
Run time 18 days 8 hours 5 min 47 sec
CPU time 18 days 6 hours 25 min 54 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.93 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:21:05 (14980): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
11:21:19 (14980): No heartbeat from core client for 30 sec - exiting
11:21:20 (14980): No heartbeat from core client for 30 sec - exiting
11:21:21 (14980): No heartbeat from core client for 30 sec - exiting
11:52:56 (9695): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:53:00 (9695): No heartbeat from core client for 30 sec - exiting
11:53:01 (9695): No heartbeat from core client for 30 sec - exiting
11:53:02 (9695): No heartbeat from core client for 30 sec - exiting
11:53:03 (9695): No heartbeat from core client for 30 sec - exiting
11:53:04 (9695): No heartbeat from core client for 30 sec - exiting
11:53:05 (9695): No heartbeat from core client for 30 sec - exiting
11:53:06 (9695): No heartbeat from core client for 30 sec - exiting
11:53:07 (9695): No heartbeat from core client for 30 sec - exiting
11:53:08 (9695): No heartbeat from core client for 30 sec - exiting
11:53:10 (9695): No heartbeat from core client for 30 sec - exiting
11:53:11 (9695): No heartbeat from core client for 30 sec - exiting
11:53:12 (9695): No heartbeat from core client for 30 sec - exiting
11:53:13 (9695): No heartbeat from core client for 30 sec - exiting
11:53:14 (9695): No heartbeat from core client for 30 sec - exiting
11:53:15 (9695): No heartbeat from core client for 30 sec - exiting
11:53:16 (9695): No heartbeat from core client for 30 sec - exiting
11:53:17 (9695): No heartbeat from core client for 30 sec - exiting
11:53:18 (9695): No heartbeat from core client for 30 sec - exiting
11:53:19 (9695): No heartbeat from core client for 30 sec - exiting
11:53:21 (9695): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:54:10 (10135): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
16:54:16 (10135): No heartbeat from core client for 30 sec - exiting
16:54:17 (10135): No heartbeat from core client for 30 sec - exiting
16:54:18 (10135): No heartbeat from core client for 30 sec - exiting
16:54:19 (10135): No heartbeat from core client for 30 sec - exiting
16:54:20 (10135): No heartbeat from core client for 30 sec - exiting
16:54:21 (10135): No heartbeat from core client for 30 sec - exiting
16:54:22 (10135): No heartbeat from core client for 30 sec - exiting
16:54:23 (10135): No heartbeat from core client for 30 sec - exiting
16:54:24 (10135): No heartbeat from core client for 30 sec - exiting
16:54:25 (10135): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:44:32 (15453): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08ca4cb0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c421)[0xf74fc421]
/lib32/libc.so.6(+0x6dcb0)[0xf74fdcb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7500d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76d77b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76d780d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74a6ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 09:09 1834947                            /home/boinc/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 09:09 1834947                            /home/boinc/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08c4f000-08cb4000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7012000-f748d000 rw-s 00000000 09:09 1834846                            /home/boinc/var/lib/boinc-client/slots/0/135030
f748d000-f7490000 rw-p 00000000 00:00 0 
f7490000-f75e4000 r-xp 00000000 08:08 931878                             /lib32/libc-2.12.1.so
f75e4000-f75e5000 ---p 00154000 08:08 931878                             /lib32/libc-2.12.1.so
f75e5000-f75e7000 r--p 00154000 08:08 931878                             /lib32/libc-2.12.1.so
f75e7000-f75e8000 rw-p 00156000 08:08 931878                             /lib32/libc-2.12.1.so
f75e8000-f75eb000 rw-p 00000000 00:00 0 
f75eb000-f7605000 r-xp 00000000 08:08 138818                             /usr/lib32/libgcc_s.so.1
f7605000-f7606000 r--p 00019000 08:08 138818                             /usr/lib32/libgcc_s.so.1
f7606000-f7607000 rw-p 0001a000 08:08 138818                             /usr/lib32/libgcc_s.so.1
f7607000-f762b000 r-xp 00000000 08:08 931885                             /lib32/libm-2.12.1.so
f762b000-f762c000 r--p 00023000 08:08 931885                             /lib32/libm-2.12.1.so
f762c000-f762d000 rw-p 00024000 08:08 931885                             /lib32/libm-2.12.1.so
f762d000-f770c000 r-xp 00000000 08:08 138821                             /usr/lib32/libstdc++.so.6.0.14
f770c000-f7710000 r--p 000de000 08:08 138821                             /usr/lib32/libstdc++.so.6.0.14
f7710000-f7711000 rw-p 000e2000 08:08 138821                             /usr/lib32/libstdc++.so.6.0.14
f7711000-f7718000 rw-p 00000000 00:00 0 
f7718000-f771a000 r-xp 00000000 08:08 931894                             /lib32/libdl-2.12.1.so
f771a000-f771b000 r--p 00001000 08:08 931894                             /lib32/libdl-2.12.1.so
f771b000-f771c000 rw-p 00002000 08:08 931894                             /lib32/libdl-2.12.1.so
f771c000-f771d000 rw-p 00000000 00:00 0 
f771d000-f7732000 r-xp 00000000 08:08 931880                             /lib32/libpthread-2.12.1.so
f7732000-f7733000 r--p 00014000 08:08 931880                             /lib32/libpthread-2.12.1.so
f7733000-f7734000 rw-p 00015000 08:08 931880                             /lib32/libpthread-2.12.1.so
f7734000-f7736000 rw-p 00000000 00:00 0 
f7751000-f7752000 rw-p 00000000 00:00 0 
f7752000-f7753000 ---p 00000000 00:00 0 
f7753000-f7756000 rw-p 00000000 00:00 0 
f7756000-f7758000 rw-s 00000000 09:09 1833399                            /home/boinc/var/lib/boinc-client/slots/0/boinc_mmap_file
f7758000-f775a000 rw-p 00000000 00:00 0 
f775a000-f775b000 r-xp 00000000 00:00 0                                  [vdso]
f775b000-f7777000 r-xp 00000000 08:08 931886                             /lib32/ld-2.12.1.so
f7777000-f7778000 r--p 0001b000 08:08 931886                             /lib32/ld-2.12.1.so
f7778000-f7779000 rw-p 0001c000 08:08 931886                             /lib32/ld-2.12.1.so
ffbfd000-ffc6d000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf775a400]
[0xf775a430]
/lib32/libc.so.6(gsignal+0x51)[0xf74baa01]
/lib32/libc.so.6(abort+0x182)[0xf74bde42]
/lib32/libc.so.6(+0x62345)[0xf74f2345]
/lib32/libc.so.6(+0x6c421)[0xf74fc421]
/lib32/libc.so.6(+0x6dcb0)[0xf74fdcb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7500d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76d77b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76d780d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74a6ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 May 2011 11:25:01 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 1,036,800 1,578,352 1.5223
25 May 2011 00:49:03 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 1,010,880 1,540,419 1.5238
24 May 2011 13:25:34 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 984,960 1,499,511 1.5224
24 May 2011 02:56:17 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 959,040 1,461,654 1.5241
23 May 2011 15:31:48 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 933,120 1,421,093 1.5229
23 May 2011 05:05:48 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 907,200 1,383,885 1.5254
22 May 2011 18:20:06 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 881,280 1,345,103 1.5263
22 May 2011 08:02:18 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 855,360 1,308,079 1.5293
20 May 2011 10:45:51 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 829,440 1,269,479 1.5305
19 May 2011 13:57:50 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 803,520 1,229,928 1.5307
19 May 2011 02:47:55 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 777,600 1,189,830 1.5301
18 May 2011 15:33:49 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 751,680 1,149,650 1.5294
18 May 2011 05:11:59 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 725,760 1,112,224 1.5325
17 May 2011 18:07:39 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 699,840 1,072,748 1.5328
17 May 2011 07:43:59 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 673,920 1,035,375 1.5363
16 May 2011 20:43:41 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 648,000 995,865 1.5368
16 May 2011 10:08:14 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 622,080 958,107 1.5402
15 May 2011 23:32:33 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 596,160 919,961 1.5431
15 May 2011 12:29:30 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 570,240 880,211 1.5436
15 May 2011 01:32:32 1060199 12821234 hadcm3n_p2dc_1900_40_007220656_0 544,320 841,250 1.5455


©2024 climateprediction.net