climateprediction.net home page
Task 14177496

Task 14177496

Name hadcm3n_ygrm_1900_40_007516657_3
Workunit 7714132
Created 22 Feb 2012, 1:56:19 UTC
Sent 22 Feb 2012, 1:56:22 UTC
Report deadline 23 May 2012, 9:23:33 UTC
Received 15 Mar 2012, 1:58:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1179592
Run time 18 days 1 hours 40 min 4 sec
CPU time 18 days 1 hours 40 min 4 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.39 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
02:00:35 (17588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:31:05 (17833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:41:26 (18084): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:03:00 (18180): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:40:36 (20439): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:04:54 (21850): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:00:43 (23196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:02:39 (25560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:04:25 (25772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:06:11 (25956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:09:27 (26140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:10:37 (26360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:13:05 (26546): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:14:48 (26730): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:16:35 (26916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:38:44 (27111): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:18:13 (27304): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:19:57 (27512): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:31:27 (27698): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:01:13 (27886): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:13:31 (28087): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:22:37 (28279): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:33:34 (28468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:54:47 (1935): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:31:10 (2627): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:34:04 (2864): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:44:43 (3052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:40:30 (3240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:09:03 (3761): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:36:28 (4287): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:39:46 (4541): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:52:00 (4725): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:54:34 (4910): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:56:59 (5094): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:59:12 (5278): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:01:01 (5462): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:01:43 (5646): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:58 (5830): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:13:21 (6014): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:16:59 (6198): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:19:36 (6386): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:22:39 (6570): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:24:51 (6755): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:26:53 (6939): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:29:21 (7123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:31:21 (7307): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:33:47 (7491): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:36:34 (7675): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:45:45 (7779): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:47:54 (7959): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:50:39 (8143): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:03:05 (8328): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:05:20 (8516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:07:43 (8696): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:09:51 (8880): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:35 (9064): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:14:36 (9248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:43 (9432): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:19:17 (9620): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:32:12 (9804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:45:50 (9989): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:48:54 (10201): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:53 (10381): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:53:33 (10566): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:56:07 (10750): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:58:31 (10934): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:00:32 (11119): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:04:29 (11303): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:47:20 (12170): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:48:24 (12357): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:14:12 (12535): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
04:30:05 (12706): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:00:35 (13804): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:03:37 (14271): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:05:46 (14471): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:08:36 (14689): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:07 (14871): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:14:18 (15053): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:09:15 (15239): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:10:24 (15423): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:12:50 (15605): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:24:17 (15775): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:28:55 (15968): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x0a1eada0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c421)[0xf7521421]
/lib32/libc.so.6(+0x6dcb0)[0xf7522cb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7525d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76fc7b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76fc80d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74cbce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:02 3514494                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:02 3514494                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0a127000-0a227000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7037000-f74b2000 rw-s 00000000 08:02 3784729                            /var/lib/boinc-client/slots/12/140185
f74b2000-f74b5000 rw-p 00000000 00:00 0 
f74b5000-f7609000 r-xp 00000000 08:02 9879558                            /lib32/libc-2.12.1.so
f7609000-f760a000 ---p 00154000 08:02 9879558                            /lib32/libc-2.12.1.so
f760a000-f760c000 r--p 00154000 08:02 9879558                            /lib32/libc-2.12.1.so
f760c000-f760d000 rw-p 00156000 08:02 9879558                            /lib32/libc-2.12.1.so
f760d000-f7610000 rw-p 00000000 00:00 0 
f7610000-f762a000 r-xp 00000000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f762a000-f762b000 r--p 00019000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f762b000-f762c000 rw-p 0001a000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f762c000-f7650000 r-xp 00000000 08:02 9879565                            /lib32/libm-2.12.1.so
f7650000-f7651000 r--p 00023000 08:02 9879565                            /lib32/libm-2.12.1.so
f7651000-f7652000 rw-p 00024000 08:02 9879565                            /lib32/libm-2.12.1.so
f7652000-f7731000 r-xp 00000000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f7731000-f7735000 r--p 000de000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f7735000-f7736000 rw-p 000e2000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f7736000-f773d000 rw-p 00000000 00:00 0 
f773d000-f773f000 r-xp 00000000 08:02 9879574                            /lib32/libdl-2.12.1.so
f773f000-f7740000 r--p 00001000 08:02 9879574                            /lib32/libdl-2.12.1.so
f7740000-f7741000 rw-p 00002000 08:02 9879574                            /lib32/libdl-2.12.1.so
f7741000-f7742000 rw-p 00000000 00:00 0 
f7742000-f7757000 r-xp 00000000 08:02 9879560                            /lib32/libpthread-2.12.1.so
f7757000-f7758000 r--p 00014000 08:02 9879560                            /lib32/libpthread-2.12.1.so
f7758000-f7759000 rw-p 00015000 08:02 9879560                            /lib32/libpthread-2.12.1.so
f7759000-f775b000 rw-p 00000000 00:00 0 
f776c000-f776d000 rw-p 00000000 00:00 0 
f776d000-f776e000 ---p 00000000 00:00 0 
f776e000-f7771000 rw-p 00000000 00:00 0 
f7771000-f7773000 rw-s 00000000 08:02 3784726                            /var/lib/boinc-client/slots/12/boinc_mmap_file
f7773000-f7775000 rw-p 00000000 00:00 0 
f7775000-f7776000 r-xp 00000000 00:00 0                                  [vdso]
f7776000-f7792000 r-xp 00000000 08:02 9879566                            /lib32/ld-2.12.1.so
f7792000-f7793000 r--p 0001b000 08:02 9879566                            /lib32/ld-2.12.1.so
f7793000-f7794000 rw-p 0001c000 08:02 9879566                            /lib32/ld-2.12.1.so
ffe1d000-ffe8c000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7775400]
[0xf7775425]
/lib32/libc.so.6(gsignal+0x51)[0xf74dfa01]
/lib32/libc.so.6(abort+0x182)[0xf74e2e42]
/lib32/libc.so.6(+0x62345)[0xf7517345]
/lib32/libc.so.6(+0x6c421)[0xf7521421]
/lib32/libc.so.6(+0x6dcb0)[0xf7522cb0]
/lib32/libc.so.6(cfree+0x6d)[0xf7525d5d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76fc7b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76fc80d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74cbce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Mar 2012 01:58:42 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 518,400 1,561,200 3.0116
14 Mar 2012 02:02:18 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 492,480 1,483,824 3.0130
13 Mar 2012 02:01:14 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 466,560 1,406,017 3.0136
12 Mar 2012 02:03:35 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 440,640 1,326,553 3.0105
11 Mar 2012 02:02:38 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 414,720 1,247,491 3.0080
10 Mar 2012 02:00:45 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 388,800 1,170,438 3.0104
09 Mar 2012 02:03:38 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 362,880 1,094,315 3.0156
08 Mar 2012 02:02:46 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 336,960 1,016,464 3.0166
07 Mar 2012 02:03:51 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 311,040 934,597 3.0047
06 Mar 2012 02:04:25 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 285,120 854,221 2.9960
05 Mar 2012 02:00:27 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 259,200 774,856 2.9894
04 Mar 2012 02:01:21 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 233,280 695,055 2.9795
03 Mar 2012 04:03:51 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 207,360 615,630 2.9689
03 Mar 2012 02:01:42 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 181,440 537,715 2.9636
02 Mar 2012 02:09:24 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 155,520 461,257 2.9659
01 Mar 2012 01:58:18 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 129,600 384,861 2.9696
29 Feb 2012 01:58:13 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 103,680 308,528 2.9758
28 Feb 2012 01:57:55 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 77,760 232,222 2.9864
27 Feb 2012 01:59:19 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 51,840 154,846 2.9870
26 Feb 2012 02:00:13 1179592 14177496 hadcm3n_ygrm_1900_40_007516657_3 25,920 76,717 2.9598


©2024 climateprediction.net