climateprediction.net home page
Task 16036136

Task 16036136

Name hadcm3n_3cfd_2020_40_008409305_1
Workunit 8560161
Created 27 Sep 2013, 9:03:38 UTC
Sent 27 Sep 2013, 9:05:17 UTC
Report deadline 27 Dec 2013, 16:32:28 UTC
Received 26 Oct 2013, 6:20:57 UTC
Server state Over
Outcome Computation error
Client state Aborted by user
Exit status 203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID 1215191
Run time 25 days 6 hours 36 min 14 sec
CPU time 24 days 2 hours 33 min 4 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.68 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
aborted by user
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:35:27 (6607): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:36:54 (6607): No heartbeat from core client for 30 sec - exiting
13:36:55 (6607): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:49:09 (14509): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:31:33 (17985): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:55:21 (18300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:03:37 (20478): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:10:09 (20487): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:13:01 (20504): No heartbeat from core client for 30 sec - exiting
19:13:02 (20504): No heartbeat from core client for 30 sec - exiting
19:13:03 (20504): No heartbeat from core client for 30 sec - exiting
19:13:04 (20504): No heartbeat from core client for 30 sec - exiting
19:13:05 (20504): No heartbeat from core client for 30 sec - exiting
19:13:06 (20504): No heartbeat from core client for 30 sec - exiting
19:13:09 (20504): No heartbeat from core client for 30 sec - exiting
19:13:10 (20504): No heartbeat from core client for 30 sec - exiting
19:13:11 (20504): No heartbeat from core client for 30 sec - exiting
19:13:14 (20504): No heartbeat from core client for 30 sec - exiting
19:13:15 (20504): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:22:01 (20508): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:53:18 (20525): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:54:33 (20525): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:53:38 (21252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:08:42 (23507): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:20:47 (23517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:43:59 (24000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:49:25 (24320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
00:25:17 (22858): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:28:19 (24256): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:47:53 (28832): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:41:22 (30914): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
20:39:42 (346): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:16:38 (2917): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:50:24 (8181): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:31:20 (18353): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:38:40 (18591): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:48:51 (18630): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:44:31 (28771): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:47 (29243): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:52:27 (9384): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:06:16 (9643): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:35:18 (14264): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09f86830 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a9f038 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
12:24:55 (22563): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x097e7038 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
19:02:27 (942): No heartbeat from core client for 30 sec - exiting
19:02:33 (942): No heartbeat from core client for 30 sec - exiting
19:02:34 (942): No heartbeat from core client for 30 sec - exiting
19:02:35 (942): No heartbeat from core client for 30 sec - exiting
19:02:36 (942): No heartbeat from core client for 30 sec - exiting
19:02:37 (942): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08fd3038 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
19:02:38 (942): No heartbeat from core client for 30 sec - exiting
19:02:39 (942): No heartbeat from core client for 30 sec - exiting
19:02:40 (942): No heartbeat from core client for 30 sec - exiting
19:02:41 (942): No heartbeat from core client for 30 sec - exiting
19:02:42 (942): No heartbeat from core client for 30 sec - exiting
19:02:43 (942): No heartbeat from core client for 30 sec - exiting
19:02:44 (942): No heartbeat from core client for 30 sec - exiting
19:02:45 (942): No heartbeat from core client for 30 sec - exiting
19:02:46 (942): No heartbeat from core client for 30 sec - exiting
19:02:47 (942): No heartbeat from core client for 30 sec - exiting
19:02:48 (942): No heartbeat from core client for 30 sec - exiting
19:02:49 (942): No heartbeat from core client for 30 sec - exiting
19:02:50 (942): No heartbeat from core client for 30 sec - exiting
19:02:51 (942): No heartbeat from core client for 30 sec - exiting
19:02:52 (942): No heartbeat from core client for 30 sec - exiting
19:02:53 (942): No heartbeat from core client for 30 sec - exiting
19:02:54 (942): No heartbeat from core client for 30 sec - exiting
19:02:55 (942): No heartbeat from core client for 30 sec - exiting
19:02:56 (942): No heartbeat from core client for 30 sec - exiting
19:02:57 (942): No heartbeat from core client for 30 sec - exiting
19:02:58 (942): No heartbeat from core client for 30 sec - exiting
19:03:00 (942): No heartbeat from core client for 30 sec - exiting
19:03:01 (942): No heartbeat from core client for 30 sec - exiting
19:03:02 (942): No heartbeat from core client for 30 sec - exiting
19:03:03 (942): No heartbeat from core client for 30 sec - exiting
19:03:04 (942): No heartbeat from core client for 30 sec - exiting
19:03:06 (942): No heartbeat from core client for 30 sec - exiting
19:03:07 (942): No heartbeat from core client for 30 sec - exiting
19:03:08 (942): No heartbeat from core client for 30 sec - exiting
19:03:09 (942): No heartbeat from core client for 30 sec - exiting
19:03:10 (942): No heartbeat from core client for 30 sec - exiting
19:03:11 (942): No heartbeat from core client for 30 sec - exiting
19:03:12 (942): No heartbeat from core client for 30 sec - exiting
19:03:13 (942): No heartbeat from core client for 30 sec - exiting
19:03:14 (942): No heartbeat from core client for 30 sec - exiting
19:03:15 (942): No heartbeat from core client for 30 sec - exiting
19:03:16 (942): No heartbeat from core client for 30 sec - exiting
19:03:17 (942): No heartbeat from core client for 30 sec - exiting
19:03:56 (942): No heartbeat from core client for 30 sec - exiting
19:03:57 (942): No heartbeat from core client for 30 sec - exiting
19:03:58 (942): No heartbeat from core client for 30 sec - exiting
19:03:59 (942): No heartbeat from core client for 30 sec - exiting
19:04:00 (942): No heartbeat from core client for 30 sec - exiting
19:04:01 (942): No heartbeat from core client for 30 sec - exiting
19:04:02 (942): No heartbeat from core client for 30 sec - exiting
19:04:03 (942): No heartbeat from core client for 30 sec - exiting
19:04:04 (942): No heartbeat from core client for 30 sec - exiting
19:04:05 (942): No heartbeat from core client for 30 sec - exiting
19:04:06 (942): No heartbeat from core client for 30 sec - exiting
19:04:07 (942): No heartbeat from core client for 30 sec - exiting
19:04:08 (942): No heartbeat from core client for 30 sec - exiting
19:04:09 (942): No heartbeat from core client for 30 sec - exiting
19:04:10 (942): No heartbeat from core client for 30 sec - exiting
19:04:11 (942): No heartbeat from core client for 30 sec - exiting
19:04:12 (942): No heartbeat from core client for 30 sec - exiting
19:04:13 (942): No heartbeat from core client for 30 sec - exiting
19:04:14 (942): No heartbeat from core client for 30 sec - exiting
19:04:15 (942): No heartbeat from core client for 30 sec - exiting
19:04:16 (942): No heartbeat from core client for 30 sec - exiting
19:04:17 (942): No heartbeat from core client for 30 sec - exiting
19:04:18 (942): No heartbeat from core client for 30 sec - exiting
19:04:19 (942): No heartbeat from core client for 30 sec - exiting
19:04:20 (942): No heartbeat from core client for 30 sec - exiting
19:04:21 (942): No heartbeat from core client for 30 sec - exiting
19:04:22 (942): No heartbeat from core client for 30 sec - exiting
19:04:23 (942): No heartbeat from core client for 30 sec - exiting
19:04:24 (942): No heartbeat from core client for 30 sec - exiting
19:04:25 (942): No heartbeat from core client for 30 sec - exiting
19:04:26 (942): No heartbeat from core client for 30 sec - exiting
19:04:27 (942): No heartbeat from core client for 30 sec - exiting
19:04:28 (942): No heartbeat from core client for 30 sec - exiting
19:04:29 (942): No heartbeat from core client for 30 sec - exiting
19:04:30 (942): No heartbeat from core client for 30 sec - exiting
19:04:31 (942): No heartbeat from core client for 30 sec - exiting
19:04:32 (942): No heartbeat from core client for 30 sec - exiting
19:04:33 (942): No heartbeat from core client for 30 sec - exiting
19:04:34 (942): No heartbeat from core client for 30 sec - exiting
19:04:35 (942): No heartbeat from core client for 30 sec - exiting
19:04:41 (942): No heartbeat from core client for 30 sec - exiting
19:04:42 (942): No heartbeat from core client for 30 sec - exiting
19:04:43 (2213): Can't acquire lockfile (-154) - waiting 35s
19:04:43 (942): No heartbeat from core client for 30 sec - exiting
19:04:44 (942): No heartbeat from core client for 30 sec - exiting
19:04:45 (942): No heartbeat from core client for 30 sec - exiting
19:04:46 (942): No heartbeat from core client for 30 sec - exiting
19:04:47 (942): No heartbeat from core client for 30 sec - exiting
19:04:48 (942): No heartbeat from core client for 30 sec - exiting
19:04:49 (942): No heartbeat from core client for 30 sec - exiting
19:04:50 (942): No heartbeat from core client for 30 sec - exiting
19:04:51 (942): No heartbeat from core client for 30 sec - exiting
19:04:52 (942): No heartbeat from core client for 30 sec - exiting
19:04:53 (942): No heartbeat from core client for 30 sec - exiting
19:04:54 (942): No heartbeat from core client for 30 sec - exiting
19:04:55 (942): No heartbeat from core client for 30 sec - exiting
19:04:56 (942): No heartbeat from core client for 30 sec - exiting
19:04:57 (942): No heartbeat from core client for 30 sec - exiting
19:04:58 (942): No heartbeat from core client for 30 sec - exiting
19:04:59 (942): No heartbeat from core client for 30 sec - exiting
19:05:00 (942): No heartbeat from core client for 30 sec - exiting
19:05:01 (942): No heartbeat from core client for 30 sec - exiting
19:05:02 (942): No heartbeat from core client for 30 sec - exiting
19:05:04 (942): No heartbeat from core client for 30 sec - exiting
19:05:05 (942): No heartbeat from core client for 30 sec - exiting
19:05:06 (942): No heartbeat from core client for 30 sec - exiting
19:05:07 (942): No heartbeat from core client for 30 sec - exiting
19:05:14 (942): No heartbeat from core client for 30 sec - exiting
19:05:15 (942): No heartbeat from core client for 30 sec - exiting
19:05:16 (942): No heartbeat from core client for 30 sec - exiting
19:05:17 (942): No heartbeat from core client for 30 sec - exiting
19:05:18 (2213): Can't acquire lockfile (-154) - exiting
19:05:18 (942): No heartbeat from core client for 30 sec - exiting
19:05:19 (942): No heartbeat from core client for 30 sec - exiting
19:05:20 (942): No heartbeat from core client for 30 sec - exiting
19:05:21 (942): No heartbeat from core client for 30 sec - exiting
19:05:22 (942): No heartbeat from core client for 30 sec - exiting
19:05:23 (942): No heartbeat from core client for 30 sec - exiting
19:05:24 (942): No heartbeat from core client for 30 sec - exiting
19:05:25 (942): No heartbeat from core client for 30 sec - exiting
19:05:26 (942): No heartbeat from core client for 30 sec - exiting
19:05:27 (942): No heartbeat from core client for 30 sec - exiting
19:05:28 (942): No heartbeat from core client for 30 sec - exiting
19:05:29 (942): No heartbeat from core client for 30 sec - exiting
19:05:30 (942): No heartbeat from core client for 30 sec - exiting
19:05:31 (942): No heartbeat from core client for 30 sec - exiting
19:05:32 (942): No heartbeat from core client for 30 sec - exiting
19:05:33 (942): No heartbeat from core client for 30 sec - exiting
19:05:34 (942): No heartbeat from core client for 30 sec - exiting
19:05:35 (942): No heartbeat from core client for 30 sec - exiting
19:05:36 (942): No heartbeat from core client for 30 sec - exiting
19:05:37 (942): No heartbeat from core client for 30 sec - exiting
19:05:38 (942): No heartbeat from core client for 30 sec - exiting
19:05:39 (942): No heartbeat from core client for 30 sec - exiting
19:05:40 (942): No heartbeat from core client for 30 sec - exiting
19:05:41 (942): No heartbeat from core client for 30 sec - exiting
19:05:42 (942): No heartbeat from core client for 30 sec - exiting
19:05:43 (942): No heartbeat from core client for 30 sec - exiting
19:05:44 (942): No heartbeat from core client for 30 sec - exiting
19:05:45 (942): No heartbeat from core client for 30 sec - exiting
19:05:46 (942): No heartbeat from core client for 30 sec - exiting
19:05:47 (942): No heartbeat from core client for 30 sec - exiting
19:05:48 (942): No heartbeat from core client for 30 sec - exiting
19:05:49 (942): No heartbeat from core client for 30 sec - exiting
19:05:50 (942): No heartbeat from core client for 30 sec - exiting
19:05:51 (942): No heartbeat from core client for 30 sec - exiting
19:05:52 (942): No heartbeat from core client for 30 sec - exiting
19:05:53 (942): No heartbeat from core client for 30 sec - exiting
19:05:54 (942): No heartbeat from core client for 30 sec - exiting
19:05:55 (942): No heartbeat from core client for 30 sec - exiting
19:05:56 (942): No heartbeat from core client for 30 sec - exiting
19:05:57 (942): No heartbeat from core client for 30 sec - exiting
19:05:58 (942): No heartbeat from core client for 30 sec - exiting
19:05:59 (942): No heartbeat from core client for 30 sec - exiting
19:06:00 (942): No heartbeat from core client for 30 sec - exiting
19:06:01 (942): No heartbeat from core client for 30 sec - exiting
19:06:02 (942): No heartbeat from core client for 30 sec - exiting
19:06:03 (942): No heartbeat from core client for 30 sec - exiting
19:06:04 (942): No heartbeat from core client for 30 sec - exiting
19:06:05 (942): No heartbeat from core client for 30 sec - exiting
19:06:06 (942): No heartbeat from core client for 30 sec - exiting
19:06:07 (942): No heartbeat from core client for 30 sec - exiting
19:06:08 (942): No heartbeat from core client for 30 sec - exiting
19:06:09 (942): No heartbeat from core client for 30 sec - exiting
19:06:10 (942): No heartbeat from core client for 30 sec - exiting
19:06:11 (942): No heartbeat from core client for 30 sec - exiting
19:06:12 (942): No heartbeat from core client for 30 sec - exiting
19:06:13 (942): No heartbeat from core client for 30 sec - exiting
19:06:14 (942): No heartbeat from core client for 30 sec - exiting
19:06:15 (942): No heartbeat from core client for 30 sec - exiting
19:06:16 (942): No heartbeat from core client for 30 sec - exiting
19:06:19 (942): No heartbeat from core client for 30 sec - exiting
19:06:20 (942): No heartbeat from core client for 30 sec - exiting
19:06:21 (942): No heartbeat from core client for 30 sec - exiting
19:06:22 (942): No heartbeat from core client for 30 sec - exiting
19:06:23 (942): No heartbeat from core client for 30 sec - exiting
19:06:24 (942): No heartbeat from core client for 30 sec - exiting
19:06:25 (942): No heartbeat from core client for 30 sec - exiting
19:06:26 (942): No heartbeat from core client for 30 sec - exiting
19:06:27 (942): No heartbeat from core client for 30 sec - exiting
19:06:29 (942): No heartbeat from core client for 30 sec - exiting
19:06:30 (942): No heartbeat from core client for 30 sec - exiting
19:06:31 (942): No heartbeat from core client for 30 sec - exiting
19:06:32 (942): No heartbeat from core client for 30 sec - exiting
19:06:33 (942): No heartbeat from core client for 30 sec - exiting
19:06:34 (942): No heartbeat from core client for 30 sec - exiting
19:06:35 (942): No heartbeat from core client for 30 sec - exiting
19:06:36 (942): No heartbeat from core client for 30 sec - exiting
19:06:37 (942): No heartbeat from core client for 30 sec - exiting
19:06:38 (942): No heartbeat from core client for 30 sec - exiting
19:06:39 (942): No heartbeat from core client for 30 sec - exiting
19:06:40 (942): No heartbeat from core client for 30 sec - exiting
19:06:41 (942): No heartbeat from core client for 30 sec - exiting
19:06:42 (942): No heartbeat from core client for 30 sec - exiting
19:06:43 (942): No heartbeat from core client for 30 sec - exiting
19:06:44 (942): No heartbeat from core client for 30 sec - exiting
19:06:45 (942): No heartbeat from core client for 30 sec - exiting
19:06:46 (942): No heartbeat from core client for 30 sec - exiting
19:06:47 (942): No heartbeat from core client for 30 sec - exiting
19:06:48 (942): No heartbeat from core client for 30 sec - exiting
19:06:49 (942): No heartbeat from core client for 30 sec - exiting
19:06:50 (942): No heartbeat from core client for 30 sec - exiting
19:06:51 (942): No heartbeat from core client for 30 sec - exiting
19:06:52 (942): No heartbeat from core client for 30 sec - exiting
19:06:53 (942): No heartbeat from core client for 30 sec - exiting
19:06:54 (942): No heartbeat from core client for 30 sec - exiting
19:06:55 (942): No heartbeat from core client for 30 sec - exiting
19:06:56 (942): No heartbeat from core client for 30 sec - exiting
19:06:57 (942): No heartbeat from core client for 30 sec - exiting
19:06:58 (942): No heartbeat from core client for 30 sec - exiting
19:06:59 (942): No heartbeat from core client for 30 sec - exiting
19:07:00 (942): No heartbeat from core client for 30 sec - exiting
19:07:01 (942): No heartbeat from core client for 30 sec - exiting
19:07:02 (942): No heartbeat from core client for 30 sec - exiting
19:07:03 (942): No heartbeat from core client for 30 sec - exiting
19:07:04 (942): No heartbeat from core client for 30 sec - exiting
19:07:05 (942): No heartbeat from core client for 30 sec - exiting
19:07:06 (942): No heartbeat from core client for 30 sec - exiting
19:07:07 (942): No heartbeat from core client for 30 sec - exiting
19:07:08 (942): No heartbeat from core client for 30 sec - exiting
19:07:09 (942): No heartbeat from core client for 30 sec - exiting
19:07:16 (942): No heartbeat from core client for 30 sec - exiting
19:07:17 (942): No heartbeat from core client for 30 sec - exiting
19:07:18 (942): No heartbeat from core client for 30 sec - exiting
19:07:19 (942): No heartbeat from core client for 30 sec - exiting
19:07:20 (942): No heartbeat from core client for 30 sec - exiting
19:07:21 (942): No heartbeat from core client for 30 sec - exiting
19:07:22 (942): No heartbeat from core client for 30 sec - exiting
19:07:23 (942): No heartbeat from core client for 30 sec - exiting
19:07:24 (942): No heartbeat from core client for 30 sec - exiting
19:07:25 (942): No heartbeat from core client for 30 sec - exiting
19:07:26 (942): No heartbeat from core client for 30 sec - exiting
19:07:27 (942): No heartbeat from core client for 30 sec - exiting
19:07:28 (942): No heartbeat from core client for 30 sec - exiting
19:07:29 (942): No heartbeat from core client for 30 sec - exiting
19:07:30 (942): No heartbeat from core client for 30 sec - exiting
19:07:31 (942): No heartbeat from core client for 30 sec - exiting
19:07:32 (942): No heartbeat from core client for 30 sec - exiting
19:07:33 (942): No heartbeat from core client for 30 sec - exiting
19:07:34 (942): No heartbeat from core client for 30 sec - exiting
19:07:35 (942): No heartbeat from core client for 30 sec - exiting
19:07:36 (942): No heartbeat from core client for 30 sec - exiting
19:07:37 (942): No heartbeat from core client for 30 sec - exiting
19:07:38 (942): No heartbeat from core client for 30 sec - exiting
19:07:39 (942): No heartbeat from core client for 30 sec - exiting
19:07:41 (942): No heartbeat from core client for 30 sec - exiting
19:07:42 (942): No heartbeat from core client for 30 sec - exiting
19:07:43 (942): No heartbeat from core client for 30 sec - exiting
19:07:44 (942): No heartbeat from core client for 30 sec - exiting
19:07:45 (942): No heartbeat from core client for 30 sec - exiting
19:07:46 (942): No heartbeat from core client for 30 sec - exiting
19:07:47 (942): No heartbeat from core client for 30 sec - exiting
19:07:48 (942): No heartbeat from core client for 30 sec - exiting
19:07:49 (942): No heartbeat from core client for 30 sec - exiting
19:07:50 (942): No heartbeat from core client for 30 sec - exiting
19:07:51 (942): No heartbeat from core client for 30 sec - exiting
19:07:52 (942): No heartbeat from core client for 30 sec - exiting
19:07:53 (942): No heartbeat from core client for 30 sec - exiting
19:07:54 (942): No heartbeat from core client for 30 sec - exiting
19:07:55 (942): No heartbeat from core client for 30 sec - exiting
19:07:56 (942): No heartbeat from core client for 30 sec - exiting
19:07:57 (942): No heartbeat from core client for 30 sec - exiting
19:07:58 (942): No heartbeat from core client for 30 sec - exiting
19:07:59 (942): No heartbeat from core client for 30 sec - exiting
19:08:00 (942): No heartbeat from core client for 30 sec - exiting
19:08:01 (942): No heartbeat from core client for 30 sec - exiting
19:08:02 (942): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish
19:08:03 (942): No heartbeat from core client for 30 sec - exiting
19:08:04 (942): No heartbeat from core client for 30 sec - exiting
19:09:57 (2597): No heartbeat from core client for 30 sec - exiting
19:10:04 (2597): No heartbeat from core client for 30 sec - exiting
19:10:05 (2597): No heartbeat from core client for 30 sec - exiting
19:10:06 (2597): No heartbeat from core client for 30 sec - exiting
19:10:07 (2597): No heartbeat from core client for 30 sec - exiting
19:10:08 (2597): No heartbeat from core client for 30 sec - exiting
19:10:09 (2597): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0983b038 ***
hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed.
SIGABRT: abort called
19:10:10 (2597): No heartbeat from core client for 30 sec - exiting
19:10:11 (2597): No heartbeat from core client for 30 sec - exiting
19:10:12 (2597): No heartbeat from core client for 30 sec - exiting
19:10:13 (2597): No heartbeat from core client for 30 sec - exiting
19:10:14 (2597): No heartbeat from core client for 30 sec - exiting
19:10:15 (2597): No heartbeat from core client for 30 sec - exiting
19:10:16 (2597): No heartbeat from core client for 30 sec - exiting
19:10:17 (2597): No heartbeat from core client for 30 sec - exiting
19:10:18 (2597): No heartbeat from core client for 30 sec - exiting
19:10:19 (2597): No heartbeat from core client for 30 sec - exiting
19:10:20 (2597): No heartbeat from core client for 30 sec - exiting
19:10:21 (2597): No heartbeat from core client for 30 sec - exiting
19:10:22 (2597): No heartbeat from core client for 30 sec - exiting
19:10:23 (2597): No heartbeat from core client for 30 sec - exiting
19:10:24 (2597): No heartbeat from core client for 30 sec - exiting
19:10:25 (2597): No heartbeat from core client for 30 sec - exiting
19:10:26 (2597): No heartbeat from core client for 30 sec - exiting
19:10:27 (2597): No heartbeat from core client for 30 sec - exiting
19:10:28 (2597): No heartbeat from core client for 30 sec - exiting
19:10:29 (2597): No heartbeat from core client for 30 sec - exiting
19:10:30 (2597): No heartbeat from core client for 30 sec - exiting
19:10:31 (2597): No heartbeat from core client for 30 sec - exiting
19:10:36 (2597): No heartbeat from core client for 30 sec - exiting
19:10:37 (2597): No heartbeat from core client for 30 sec - exiting
19:10:38 (2597): No heartbeat from core client for 30 sec - exiting
19:10:39 (2597): No heartbeat from core client for 30 sec - exiting
19:10:40 (2597): No heartbeat from core client for 30 sec - exiting
19:10:41 (2597): No heartbeat from core client for 30 sec - exiting
19:10:42 (2597): No heartbeat from core client for 30 sec - exiting
19:10:43 (2597): No heartbeat from core client for 30 sec - exiting
19:10:44 (2597): No heartbeat from core client for 30 sec - exiting
19:10:45 (2597): No heartbeat from core client for 30 sec - exiting
19:14:41 (2597): No heartbeat from core client for 30 sec - exiting
19:14:55 (2597): No heartbeat from core client for 30 sec - exiting
19:14:56 (2597): No heartbeat from core client for 30 sec - exiting
19:14:57 (2597): No heartbeat from core client for 30 sec - exiting

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
24 Oct 2013 02:10:54 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 1,036,800 2,081,841 2.0079
22 Oct 2013 23:02:18 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 1,010,880 2,037,077 2.0152
22 Oct 2013 02:20:33 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 984,960 1,993,982 2.0244
21 Oct 2013 08:43:30 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 959,040 1,962,170 2.0460
20 Oct 2013 15:25:04 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 933,120 1,913,131 2.0503
20 Oct 2013 00:50:34 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 907,200 1,861,869 2.0523
19 Oct 2013 10:35:50 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 881,280 1,811,177 2.0552
18 Oct 2013 19:30:21 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 855,360 1,758,418 2.0558
18 Oct 2013 05:54:33 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 829,440 1,710,434 2.0622
17 Oct 2013 10:19:11 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 803,520 1,658,481 2.0640
16 Oct 2013 15:17:42 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 777,600 1,605,495 2.0647
16 Oct 2013 00:05:23 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 751,680 1,553,477 2.0667
15 Oct 2013 10:11:47 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 725,760 1,504,395 2.0729
14 Oct 2013 17:52:04 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 699,840 1,451,890 2.0746
13 Oct 2013 23:02:07 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 673,920 1,398,725 2.0755
13 Oct 2013 07:48:58 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 648,000 1,344,619 2.0750
12 Oct 2013 17:12:10 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 622,080 1,292,449 2.0776
12 Oct 2013 01:51:37 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 596,160 1,237,763 2.0762
11 Oct 2013 11:34:10 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 570,240 1,186,873 2.0814
10 Oct 2013 20:49:05 1215191 16036136 hadcm3n_3cfd_2020_40_008409305_1 544,320 1,134,576 2.0844


©2024 climateprediction.net