climateprediction.net home page
Task 15927515

Task 15927515

Name hadcm3n_39ng_2020_40_008406090_0
Workunit 8556946
Created 20 Aug 2013, 4:29:20 UTC
Sent 20 Aug 2013, 6:02:17 UTC
Report deadline 19 Nov 2013, 13:29:28 UTC
Received 11 Sep 2013, 15:06:49 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1203187
Run time 11 days 14 hours 57 min 42 sec
CPU time 11 days 14 hours 22 min 12 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.59 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:24:21 (13131): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:25:45 (14814): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:26:50 (14848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:28:16 (14878): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:29:22 (14913): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:50 (14943): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
13:02:10 (15355): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:18:31 (20725): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:21:53 (22476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:26:51 (22544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:20:25 (15347): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:22:28 (15574): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:24:27 (15616): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:26:29 (15658): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:28:28 (15700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:55 (15742): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:29:27 (17655): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:37 (19716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:32:25 (19747): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:29:23 (16811): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:50 (18820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:29:27 (11709): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:54 (11938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09286ec8 ***
======= Backtrace: =========
/lib/i686/cmov/libc.so.6(+0x6b381)[0xf7513381]
/lib/i686/cmov/libc.so.6(+0x6cbd8)[0xf7514bd8]
/lib/i686/cmov/libc.so.6(cfree+0x6d)[0xf7517cbd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76ee701]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf76ee75d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf74beca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:03 4844757                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:03 4844757                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09231000-09297000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f702b000-f74a6000 rw-s 00000000 08:03 6164749                            /var/lib/boinc-client/slots/7/132975
f74a6000-f74a8000 rw-p 00000000 00:00 0 
f74a8000-f75e8000 r-xp 00000000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75e8000-f75e9000 ---p 00140000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75e9000-f75eb000 r--p 00140000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75eb000-f75ec000 rw-p 00142000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75ec000-f75ef000 rw-p 00000000 00:00 0 
f75ef000-f760c000 r-xp 00000000 08:03 9451459                            /lib/libgcc_s.so.1
f760c000-f760d000 rw-p 0001c000 08:03 9451459                            /lib/libgcc_s.so.1
f760d000-f7631000 r-xp 00000000 08:03 7440166                            /lib/i686/cmov/libm-2.11.3.so
f7631000-f7632000 r--p 00023000 08:03 7440166                            /lib/i686/cmov/libm-2.11.3.so
f7632000-f7633000 rw-p 00024000 08:03 7440166                            /lib/i686/cmov/libm-2.11.3.so
f7633000-f771c000 r-xp 00000000 08:03 53058                              /usr/lib/libstdc++.so.6.0.13
f771c000-f7720000 r--p 000e9000 08:03 53058                              /usr/lib/libstdc++.so.6.0.13
f7720000-f7721000 rw-p 000ed000 08:03 53058                              /usr/lib/libstdc++.so.6.0.13
f7721000-f7729000 rw-p 00000000 00:00 0 
f7729000-f772b000 r-xp 00000000 08:03 7440162                            /lib/i686/cmov/libdl-2.11.3.so
f772b000-f772c000 r--p 00001000 08:03 7440162                            /lib/i686/cmov/libdl-2.11.3.so
f772c000-f772d000 rw-p 00002000 08:03 7440162                            /lib/i686/cmov/libdl-2.11.3.so
f772d000-f7742000 r-xp 00000000 08:03 7440174                            /lib/i686/cmov/libpthread-2.11.3.so
f7742000-f7743000 r--p 00014000 08:03 7440174                            /lib/i686/cmov/libpthread-2.11.3.so
f7743000-f7744000 rw-p 00015000 08:03 7440174                            /lib/i686/cmov/libpthread-2.11.3.so
f7744000-f7746000 rw-p 00000000 00:00 0 
f774f000-f7750000 rw-p 00000000 00:00 0 
f7750000-f7751000 ---p 00000000 00:00 0 
f7751000-f7754000 rw-p 00000000 00:00 0 
f7754000-f7756000 rw-s 00000000 08:03 6164746                            /var/lib/boinc-client/slots/7/boinc_mmap_file
f7756000-f7758000 rw-p 00000000 00:00 0 
f7758000-f7759000 r-xp 00000000 00:00 0                                  [vdso]
f7759000-f7774000 r-xp 00000000 08:03 53232                              /lib/ld-2.11.3.so
f7774000-f7775000 r--p 0001b000 08:03 53232                              /lib/ld-2.11.3.so
f7775000-f7776000 rw-p 0001c000 08:03 53232                              /lib/ld-2.11.3.so
ffbfa000-ffc69000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7758400]
[0xf7758425]
/lib/i686/cmov/libc.so.6(gsignal+0x51)[0xf74d2781]
/lib/i686/cmov/libc.so.6(abort+0x182)[0xf74d5bb2]
/lib/i686/cmov/libc.so.6(+0x61285)[0xf7509285]
/lib/i686/cmov/libc.so.6(+0x6b381)[0xf7513381]
/lib/i686/cmov/libc.so.6(+0x6cbd8)[0xf7514bd8]
/lib/i686/cmov/libc.so.6(cfree+0x6d)[0xf7517cbd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76ee701]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf76ee75d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf74beca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Sep 2013 05:45:22 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 518,400 1,002,124 1.9331
10 Sep 2013 11:25:13 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 492,480 953,700 1.9365
09 Sep 2013 17:48:10 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 466,560 904,942 1.9396
08 Sep 2013 20:30:13 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 440,640 855,276 1.9410
08 Sep 2013 02:34:50 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 414,720 804,746 1.9405
07 Sep 2013 07:43:52 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 388,800 753,646 1.9384
06 Sep 2013 13:53:40 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 362,880 703,726 1.9393
05 Sep 2013 20:02:13 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 336,960 654,362 1.9420
05 Sep 2013 01:41:30 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 311,040 604,693 1.9441
04 Sep 2013 07:05:59 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 285,120 554,527 1.9449
03 Sep 2013 12:06:48 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 259,200 504,054 1.9447
02 Sep 2013 15:37:49 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 233,280 452,888 1.9414
01 Sep 2013 20:19:09 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 207,360 402,390 1.9405
01 Sep 2013 03:17:24 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 181,440 352,187 1.9411
31 Aug 2013 10:40:41 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 155,520 302,190 1.9431
30 Aug 2013 17:10:52 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 129,600 252,079 1.9451
30 Aug 2013 01:03:00 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 103,680 201,484 1.9433
29 Aug 2013 08:18:54 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 77,760 150,953 1.9413
28 Aug 2013 17:15:38 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 51,840 100,831 1.9450
24 Aug 2013 07:22:51 1203187 15927515 hadcm3n_39ng_2020_40_008406090_0 25,920 50,924 1.9647


©2024 climateprediction.net