Name | hadcm3n_odyd_1900_40_008473208_3 |
Workunit | 8624047 |
Created | 4 Oct 2013, 10:16:36 UTC |
Sent | 4 Oct 2013, 10:48:45 UTC |
Report deadline | 3 Jan 2014, 18:15:56 UTC |
Received | 4 Dec 2013, 1:30:50 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Aborted by user |
Exit status | 203 (0x000000CB) EXIT_ABORTED_VIA_GUI |
Computer ID | 1223320 |
Run time | 13 days 3 hours 54 min 34 sec |
CPU time | 9 days 19 hours 20 min 40 sec |
Validate state | Invalid |
Credit | 6,220.80 |
Device peak FLOPS | 2.87 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>7.0.65</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> o heartbeat from core client for 30 sec - exiting 04:48:47 (3590): No heartbeat from core client for 30 sec - exiting 04:48:48 (3590): No heartbeat from core client for 30 sec - exiting 04:48:49 (3590): No heartbeat from core client for 30 sec - exiting 04:48:50 (3590): No heartbeat from core client for 30 sec - exiting 04:48:51 (3590): No heartbeat from core client for 30 sec - exiting 04:48:52 (3590): No heartbeat from core client for 30 sec - exiting 04:48:53 (3590): No heartbeat from core client for 30 sec - exiting 04:48:54 (3590): No heartbeat from core client for 30 sec - exiting 04:48:55 (3590): No heartbeat from core client for 30 sec - exiting 04:48:56 (3590): No heartbeat from core client for 30 sec - exiting 04:48:57 (3590): No heartbeat from core client for 30 sec - exiting 04:48:58 (3590): No heartbeat from core client for 30 sec - exiting 04:48:59 (3590): No heartbeat from core client for 30 sec - exiting 04:49:00 (3590): No heartbeat from core client for 30 sec - exiting 04:49:01 (3590): No heartbeat from core client for 30 sec - exiting 04:49:02 (3590): No heartbeat from core client for 30 sec - exiting 04:49:03 (3590): No heartbeat from core client for 30 sec - exiting 04:49:04 (3590): No heartbeat from core client for 30 sec - exiting 04:49:05 (3590): No heartbeat from core client for 30 sec - exiting 04:49:06 (3590): No heartbeat from core client for 30 sec - exiting 04:49:07 (3590): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08461308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 05:35:52 (3678): No heartbeat from core client for 30 sec - exiting 05:35:54 (3678): No heartbeat from core client for 30 sec - exiting 05:35:55 (3678): No heartbeat from core client for 30 sec - exiting 05:35:56 (3678): No heartbeat from core client for 30 sec - exiting 05:35:57 (3678): No heartbeat from core client for 30 sec - exiting 05:35:58 (3678): No heartbeat from core client for 30 sec - exiting 05:35:59 (3678): No heartbeat from core client for 30 sec - exiting 05:36:00 (3678): No heartbeat from core client for 30 sec - exiting 05:36:01 (3678): No heartbeat from core client for 30 sec - exiting 05:36:02 (3678): No heartbeat from core client for 30 sec - exiting 05:36:03 (3678): No heartbeat from core client for 30 sec - exiting 05:36:04 (3678): No heartbeat from core client for 30 sec - exiting 05:36:05 (3678): No heartbeat from core client for 30 sec - exiting 05:36:06 (3678): No heartbeat from core client for 30 sec - exiting 05:36:07 (3678): No heartbeat from core client for 30 sec - exiting 05:36:08 (3678): No heartbeat from core client for 30 sec - exiting 05:36:09 (3678): No heartbeat from core client for 30 sec - exiting 05:36:10 (3678): No heartbeat from core client for 30 sec - exiting 05:36:11 (3678): No heartbeat from core client for 30 sec - exiting 05:36:12 (3678): No heartbeat from core client for 30 sec - exiting 05:36:13 (3678): No heartbeat from core client for 30 sec - exiting 05:36:14 (3678): No heartbeat from core client for 30 sec - exiting 05:36:15 (3678): No heartbeat from core client for 30 sec - exiting 05:36:16 (3678): No heartbeat from core client for 30 sec - exiting 05:36:17 (3678): No heartbeat from core client for 30 sec - exiting 05:36:18 (3678): No heartbeat from core client for 30 sec - exiting 05:36:19 (3678): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09090308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09f67308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08acd308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 20:55:23 (3667): No heartbeat from core client for 30 sec - exiting 20:55:25 (3667): No heartbeat from core client for 30 sec - exiting 20:55:26 (3667): No heartbeat from core client for 30 sec - exiting 20:55:27 (3667): No heartbeat from core client for 30 sec - exiting 20:55:28 (3667): No heartbeat from core client for 30 sec - exiting 20:55:29 (3667): No heartbeat from core client for 30 sec - exiting 20:55:30 (3667): No heartbeat from core client for 30 sec - exiting 20:55:31 (3667): No heartbeat from core client for 30 sec - exiting 20:55:32 (3667): No heartbeat from core client for 30 sec - exiting 20:55:33 (3667): No heartbeat from core client for 30 sec - exiting 20:55:34 (3667): No heartbeat from core client for 30 sec - exiting 20:55:35 (3667): No heartbeat from core client for 30 sec - exiting 20:55:36 (3667): No heartbeat from core client for 30 sec - exiting 20:55:37 (3667): No heartbeat from core client for 30 sec - exiting 20:55:38 (3667): No heartbeat from core client for 30 sec - exiting 20:55:39 (3667): No heartbeat from core client for 30 sec - exiting 20:55:40 (3667): No heartbeat from core client for 30 sec - exiting 20:55:41 (3667): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c5c308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08693308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 05:24:17 (3695): No heartbeat from core client for 30 sec - exiting 05:24:22 (3695): No heartbeat from core client for 30 sec - exiting 05:24:23 (3695): No heartbeat from core client for 30 sec - exiting 05:24:24 (3695): No heartbeat from core client for 30 sec - exiting 05:24:25 (3695): No heartbeat from core client for 30 sec - exiting 05:24:26 (3695): No heartbeat from core client for 30 sec - exiting 05:24:27 (3695): No heartbeat from core client for 30 sec - exiting 05:24:28 (3695): No heartbeat from core client for 30 sec - exiting 05:24:29 (3695): No heartbeat from core client for 30 sec - exiting 05:24:32 (3695): No heartbeat from core client for 30 sec - exiting 05:24:33 (3695): No heartbeat from core client for 30 sec - exiting 05:24:34 (3695): No heartbeat from core client for 30 sec - exiting 05:24:35 (3695): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09555308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 05:24:36 (3695): No heartbeat from core client for 30 sec - exiting 05:36:53 (3699): No heartbeat from core client for 30 sec - exiting 05:36:54 (3699): No heartbeat from core client for 30 sec - exiting 05:36:55 (3699): No heartbeat from core client for 30 sec - exiting 05:36:56 (3699): No heartbeat from core client for 30 sec - exiting 05:36:57 (3699): No heartbeat from core client for 30 sec - exiting 05:36:58 (3699): No heartbeat from core client for 30 sec - exiting 05:36:59 (3699): No heartbeat from core client for 30 sec - exiting 05:37:00 (3699): No heartbeat from core client for 30 sec - exiting 05:37:01 (3699): No heartbeat from core client for 30 sec - exiting 05:37:02 (3699): No heartbeat from core client for 30 sec - exiting 05:37:03 (3699): No heartbeat from core client for 30 sec - exiting 05:37:04 (3699): No heartbeat from core client for 30 sec - exiting 05:37:05 (3699): No heartbeat from core client for 30 sec - exiting 05:37:06 (3699): No heartbeat from core client for 30 sec - exiting 05:37:07 (3699): No heartbeat from core client for 30 sec - exiting 05:37:08 (3699): No heartbeat from core client for 30 sec - exiting 05:37:09 (3699): No heartbeat from core client for 30 sec - exiting 05:37:10 (3699): No heartbeat from core client for 30 sec - exiting 05:37:11 (3699): No heartbeat from core client for 30 sec - exiting 05:37:12 (3699): No heartbeat from core client for 30 sec - exiting 05:37:13 (3699): No heartbeat from core client for 30 sec - exiting 05:37:14 (3699): No heartbeat from core client for 30 sec - exiting 05:37:15 (3699): No heartbeat from core client for 30 sec - exiting 05:37:16 (3699): No heartbeat from core client for 30 sec - exiting 05:37:17 (3699): No heartbeat from core client for 30 sec - exiting 05:37:18 (3699): No heartbeat from core client for 30 sec - exiting 05:37:19 (3699): No heartbeat from core client for 30 sec - exiting 05:37:20 (3699): No heartbeat from core client for 30 sec - exiting 05:37:21 (3699): No heartbeat from core client for 30 sec - exiting 05:37:23 (3699): No heartbeat from core client for 30 sec - exiting 05:37:24 (3699): No heartbeat from core client for 30 sec - exiting 05:37:25 (3699): No heartbeat from core client for 30 sec - exiting 05:37:26 (3699): No heartbeat from core client for 30 sec - exiting 05:37:27 (3699): No heartbeat from core client for 30 sec - exiting 05:37:28 (3699): No heartbeat from core client for 30 sec - exiting 05:37:29 (3699): No heartbeat from core client for 30 sec - exiting 05:37:30 (3699): No heartbeat from core client for 30 sec - exiting 05:37:31 (3699): No heartbeat from core client for 30 sec - exiting 05:37:32 (3699): No heartbeat from core client for 30 sec - exiting 05:37:33 (3699): No heartbeat from core client for 30 sec - exiting 05:37:34 (3699): No heartbeat from core client for 30 sec - exiting 05:37:35 (3699): No heartbeat from core client for 30 sec - exiting 05:37:36 (3699): No heartbeat from core client for 30 sec - exiting 05:37:37 (3699): No heartbeat from core client for 30 sec - exiting 05:37:38 (3699): No heartbeat from core client for 30 sec - exiting 05:37:39 (3699): No heartbeat from core client for 30 sec - exiting 05:37:40 (3699): No heartbeat from core client for 30 sec - exiting 05:37:41 (3699): No heartbeat from core client for 30 sec - exiting 05:37:42 (3699): No heartbeat from core client for 30 sec - exiting 05:37:43 (3699): No heartbeat from core client for 30 sec - exiting 05:37:44 (3699): No heartbeat from core client for 30 sec - exiting 05:37:45 (3699): No heartbeat from core client for 30 sec - exiting 05:37:46 (3699): No heartbeat from core client for 30 sec - exiting 05:37:47 (3699): No heartbeat from core client for 30 sec - exiting 05:37:48 (3699): No heartbeat from core client for 30 sec - exiting 05:37:49 (3699): No heartbeat from core client for 30 sec - exiting 05:37:50 (3699): No heartbeat from core client for 30 sec - exiting 05:37:52 (3699): No heartbeat from core client for 30 sec - exiting 05:37:53 (3699): No heartbeat from core client for 30 sec - exiting 05:37:54 (3699): No heartbeat from core client for 30 sec - exiting 05:37:55 (3699): No heartbeat from core client for 30 sec - exiting 05:37:56 (3699): No heartbeat from core client for 30 sec - exiting 05:37:57 (3699): No heartbeat from core client for 30 sec - exiting 05:37:58 (3699): No heartbeat from core client for 30 sec - exiting 05:37:59 (3699): No heartbeat from core client for 30 sec - exiting 05:38:00 (3699): No heartbeat from core client for 30 sec - exiting 05:38:01 (3699): No heartbeat from core client for 30 sec - exiting 05:38:02 (3699): No heartbeat from core client for 30 sec - exiting 05:38:03 (3699): No heartbeat from core client for 30 sec - exiting 05:38:04 (3699): No heartbeat from core client for 30 sec - exiting 05:38:05 (3699): No heartbeat from core client for 30 sec - exiting 05:38:06 (3699): No heartbeat from core client for 30 sec - exiting 05:38:07 (3699): No heartbeat from core client for 30 sec - exiting 05:38:08 (3699): No heartbeat from core client for 30 sec - exiting 05:38:09 (3699): No heartbeat from core client for 30 sec - exiting 05:38:10 (3699): No heartbeat from core client for 30 sec - exiting 05:38:11 (3699): No heartbeat from core client for 30 sec - exiting 05:38:12 (3699): No heartbeat from core client for 30 sec - exiting 05:38:13 (3699): No heartbeat from core client for 30 sec - exiting 05:38:14 (3699): No heartbeat from core client for 30 sec - exiting 05:38:15 (3699): No heartbeat from core client for 30 sec - exiting 05:38:16 (3699): No heartbeat from core client for 30 sec - exiting 05:38:17 (3699): No heartbeat from core client for 30 sec - exiting 05:38:18 (3699): No heartbeat from core client for 30 sec - exiting 05:38:19 (3699): No heartbeat from core client for 30 sec - exiting 05:38:20 (3699): No heartbeat from core client for 30 sec - exiting 05:38:21 (3699): No heartbeat from core client for 30 sec - exiting 05:38:22 (3699): No heartbeat from core client for 30 sec - exiting 05:38:23 (3699): No heartbeat from core client for 30 sec - exiting 05:38:24 (3699): No heartbeat from core client for 30 sec - exiting 05:38:25 (3699): No heartbeat from core client for 30 sec - exiting 05:38:26 (3699): No heartbeat from core client for 30 sec - exiting 05:38:27 (3699): No heartbeat from core client for 30 sec - exiting 05:38:28 (3699): No heartbeat from core client for 30 sec - exiting 05:38:30 (3699): No heartbeat from core client for 30 sec - exiting 05:38:31 (3699): No heartbeat from core client for 30 sec - exiting 05:38:32 (3699): No heartbeat from core client for 30 sec - exiting 05:38:33 (3699): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a67308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08243308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0888d308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 05:37:59 (3683): No heartbeat from core client for 30 sec - exiting 05:38:00 (3683): No heartbeat from core client for 30 sec - exiting 05:38:01 (3683): No heartbeat from core client for 30 sec - exiting 05:38:02 (3683): No heartbeat from core client for 30 sec - exiting 05:38:03 (3683): No heartbeat from core client for 30 sec - exiting 05:38:04 (3683): No heartbeat from core client for 30 sec - exiting 05:38:05 (3683): No heartbeat from core client for 30 sec - exiting 05:38:06 (3683): No heartbeat from core client for 30 sec - exiting 05:38:07 (3683): No heartbeat from core client for 30 sec - exiting 05:38:08 (3683): No heartbeat from core client for 30 sec - exiting 05:38:09 (3683): No heartbeat from core client for 30 sec - exiting 05:38:10 (3683): No heartbeat from core client for 30 sec - exiting 05:38:11 (3683): No heartbeat from core client for 30 sec - exiting 05:38:12 (3683): No heartbeat from core client for 30 sec - exiting 05:38:13 (3683): No heartbeat from core client for 30 sec - exiting 05:38:15 (3683): No heartbeat from core client for 30 sec - exiting 05:38:16 (3683): No heartbeat from core client for 30 sec - exiting 05:38:17 (3683): No heartbeat from core client for 30 sec - exiting 05:38:18 (3683): No heartbeat from core client for 30 sec - exiting 05:38:19 (3683): No heartbeat from core client for 30 sec - exiting 05:38:20 (3683): No heartbeat from core client for 30 sec - exiting 05:38:21 (3683): No heartbeat from core client for 30 sec - exiting 05:38:22 (3683): No heartbeat from core client for 30 sec - exiting 05:38:23 (3683): No heartbeat from core client for 30 sec - exiting 05:38:24 (3683): No heartbeat from core client for 30 sec - exiting 05:38:25 (3683): No heartbeat from core client for 30 sec - exiting 05:38:26 (3683): No heartbeat from core client for 30 sec - exiting 05:38:27 (3683): No heartbeat from core client for 30 sec - exiting 05:38:28 (3683): No heartbeat from core client for 30 sec - exiting 05:38:29 (3683): No heartbeat from core client for 30 sec - exiting 05:38:30 (3683): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09bbb308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 05:39:01 (3683): No heartbeat from core client for 30 sec - exiting 05:39:02 (3683): No heartbeat from core client for 30 sec - exiting 05:39:03 (3683): No heartbeat from core client for 30 sec - exiting 05:39:04 (3683): No heartbeat from core client for 30 sec - exiting 05:39:05 (3683): No heartbeat from core client for 30 sec - exiting 05:39:06 (3683): No heartbeat from core client for 30 sec - exiting 05:39:07 (3683): No heartbeat from core client for 30 sec - exiting 05:39:08 (3683): No heartbeat from core client for 30 sec - exiting 05:39:09 (3683): No heartbeat from core client for 30 sec - exiting 05:39:10 (3683): No heartbeat from core client for 30 sec - exiting 05:39:11 (3683): No heartbeat from core client for 30 sec - exiting 05:39:12 (3683): No heartbeat from core client for 30 sec - exiting 05:39:13 (3683): No heartbeat from core client for 30 sec - exiting 05:39:14 (3683): No heartbeat from core client for 30 sec - exiting 05:39:15 (3683): No heartbeat from core client for 30 sec - exiting 05:39:16 (3683): No heartbeat from core client for 30 sec - exiting 05:39:17 (3683): No heartbeat from core client for 30 sec - exiting 05:39:18 (3683): No heartbeat from core client for 30 sec - exiting 05:39:19 (3683): No heartbeat from core client for 30 sec - exiting 05:39:20 (3683): No heartbeat from core client for 30 sec - exiting 05:39:21 (3683): No heartbeat from core client for 30 sec - exiting 05:39:22 (3683): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a4d308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x097ec308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0843d308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 22:16:12 (3563): No heartbeat from core client for 30 sec - exiting 22:16:16 (3563): No heartbeat from core client for 30 sec - exiting 22:16:17 (3563): No heartbeat from core client for 30 sec - exiting 22:16:18 (3563): No heartbeat from core client for 30 sec - exiting 22:16:19 (3563): No heartbeat from core client for 30 sec - exiting 22:16:20 (3563): No heartbeat from core client for 30 sec - exiting 22:16:21 (3563): No heartbeat from core client for 30 sec - exiting 22:16:22 (3563): No heartbeat from core client for 30 sec - exiting 22:16:23 (3563): No heartbeat from core client for 30 sec - exiting 22:16:24 (3563): No heartbeat from core client for 30 sec - exiting 22:16:25 (3563): No heartbeat from core client for 30 sec - exiting 22:16:26 (3563): No heartbeat from core client for 30 sec - exiting 22:16:27 (3563): No heartbeat from core client for 30 sec - exiting 22:16:28 (3563): No heartbeat from core client for 30 sec - exiting 22:16:29 (3563): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09326308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 22:16:30 (3563): No heartbeat from core client for 30 sec - exiting 22:16:31 (3563): No heartbeat from core client for 30 sec - exiting 03:18:43 (3754): No heartbeat from core client for 30 sec - exiting 03:18:44 (3754): No heartbeat from core client for 30 sec - exiting 03:18:45 (3754): No heartbeat from core client for 30 sec - exiting 03:18:46 (3754): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a07b308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 03:18:47 (3754): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09d52308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c5a308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x091bb308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09c2d308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08611308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08893308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08686308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09026308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a80308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0905b308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08953308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09be8308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08e38308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08b4d308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09dc0308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09265308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08551308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09cdd308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08990308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x083a7308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 22:25:17 (3679): No heartbeat from core client for 30 sec - exiting 22:25:19 (3679): No heartbeat from core client for 30 sec - exiting 22:25:20 (3679): No heartbeat from core client for 30 sec - exiting 22:25:21 (3679): No heartbeat from core client for 30 sec - exiting 22:25:22 (3679): No heartbeat from core client for 30 sec - exiting 22:25:23 (3679): No heartbeat from core client for 30 sec - exiting 22:25:24 (3679): No heartbeat from core client for 30 sec - exiting 22:25:25 (3679): No heartbeat from core client for 30 sec - exiting 22:25:26 (3679): No heartbeat from core client for 30 sec - exiting 22:25:27 (3679): No heartbeat from core client for 30 sec - exiting 22:25:28 (3679): No heartbeat from core client for 30 sec - exiting 22:25:29 (3679): No heartbeat from core client for 30 sec - exiting 22:25:30 (3679): No heartbeat from core client for 30 sec - exiting 22:25:31 (3679): No heartbeat from core client for 30 sec - exiting 22:25:32 (3679): No heartbeat from core client for 30 sec - exiting 22:25:33 (3679): No heartbeat from core client for 30 sec - exiting 22:25:34 (3679): No heartbeat from core client for 30 sec - exiting 22:25:35 (3679): No heartbeat from core client for 30 sec - exiting 22:25:36 (3679): No heartbeat from core client for 30 sec - exiting 22:25:37 (3679): No heartbeat from core client for 30 sec - exiting 22:25:38 (3679): No heartbeat from core client for 30 sec - exiting 22:25:39 (3679): No heartbeat from core client for 30 sec - exiting 22:25:40 (3679): No heartbeat from core client for 30 sec - exiting 22:25:41 (3679): No heartbeat from core client for 30 sec - exiting 22:25:42 (3679): No heartbeat from core client for 30 sec - exiting 22:25:43 (3679): No heartbeat from core client for 30 sec - exiting 22:25:44 (3679): No heartbeat from core client for 30 sec - exiting 22:25:45 (3679): No heartbeat from core client for 30 sec - exiting 22:25:46 (3679): No heartbeat from core client for 30 sec - exiting 22:25:47 (3679): No heartbeat from core client for 30 sec - exiting 22:25:48 (3679): No heartbeat from core client for 30 sec - exiting 22:25:49 (3679): No heartbeat from core client for 30 sec - exiting 22:25:50 (3679): No heartbeat from core client for 30 sec - exiting 22:25:51 (3679): No heartbeat from core client for 30 sec - exiting 22:25:52 (3679): No heartbeat from core client for 30 sec - exiting 22:25:53 (3679): No heartbeat from core client for 30 sec - exiting 22:25:54 (3679): No heartbeat from core client for 30 sec - exiting 22:25:55 (3679): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08d53308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 22:25:56 (3679): No heartbeat from core client for 30 sec - exiting 22:25:57 (3679): No heartbeat from core client for 30 sec - exiting 22:25:58 (3679): No heartbeat from core client for 30 sec - exiting 22:26:00 (3679): No heartbeat from core client for 30 sec - exiting 22:26:01 (3679): No heartbeat from core client for 30 sec - exiting 22:26:02 (3679): No heartbeat from core client for 30 sec - exiting 22:26:03 (3679): No heartbeat from core client for 30 sec - exiting 22:26:35 (3679): No heartbeat from core client for 30 sec - exiting 22:26:36 (3679): No heartbeat from core client for 30 sec - exiting 22:26:37 (3679): No heartbeat from core client for 30 sec - exiting 22:26:38 (3679): No heartbeat from core client for 30 sec - exiting 22:26:39 (3679): No heartbeat from core client for 30 sec - exiting 22:26:40 (3679): No heartbeat from core client for 30 sec - exiting 22:26:41 (3679): No heartbeat from core client for 30 sec - exiting 22:26:42 (3679): No heartbeat from core client for 30 sec - exiting 22:26:43 (3679): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08cc4308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x087b4308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08df6308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 22:05:18 (4197): No heartbeat from core client for 30 sec - exiting 22:05:19 (4197): No heartbeat from core client for 30 sec - exiting 22:05:20 (4197): No heartbeat from core client for 30 sec - exiting 22:05:21 (4197): No heartbeat from core client for 30 sec - exiting 22:05:22 (4197): No heartbeat from core client for 30 sec - exiting 22:05:23 (4197): No heartbeat from core client for 30 sec - exiting 22:05:24 (4197): No heartbeat from core client for 30 sec - exiting 22:05:25 (4197): No heartbeat from core client for 30 sec - exiting 22:05:26 (4197): No heartbeat from core client for 30 sec - exiting 22:05:27 (4197): No heartbeat from core client for 30 sec - exiting 22:05:28 (4197): No heartbeat from core client for 30 sec - exiting 22:05:29 (4197): No heartbeat from core client for 30 sec - exiting 22:05:30 (4197): No heartbeat from core client for 30 sec - exiting 22:05:31 (4197): No heartbeat from core client for 30 sec - exiting 22:05:32 (4197): No heartbeat from core client for 30 sec - exiting 22:06:17 (4197): No heartbeat from core client for 30 sec - exiting 22:06:18 (4197): No heartbeat from core client for 30 sec - exiting 22:06:19 (4197): No heartbeat from core client for 30 sec - exiting 22:06:20 (4197): No heartbeat from core client for 30 sec - exiting 22:06:21 (4197): No heartbeat from core client for 30 sec - exiting 22:06:22 (4197): No heartbeat from core client for 30 sec - exiting 22:06:23 (4197): No heartbeat from core client for 30 sec - exiting 22:06:24 (4197): No heartbeat from core client for 30 sec - exiting 22:06:25 (4197): No heartbeat from core client for 30 sec - exiting 22:06:26 (4197): No heartbeat from core client for 30 sec - exiting 22:06:27 (4197): No heartbeat from core client for 30 sec - exiting 22:06:28 (4197): No heartbeat from core client for 30 sec - exiting 22:06:34 (4197): No heartbeat from core client for 30 sec - exiting 22:06:35 (4197): No heartbeat from core client for 30 sec - exiting 22:06:36 (4197): No heartbeat from core client for 30 sec - exiting 22:06:37 (4197): No heartbeat from core client for 30 sec - exiting 22:06:38 (4197): No heartbeat from core client for 30 sec - exiting 22:06:39 (4197): No heartbeat from core client for 30 sec - exiting 22:06:40 (4197): No heartbeat from core client for 30 sec - exiting 22:06:41 (4197): No heartbeat from core client for 30 sec - exiting 22:06:42 (4197): No heartbeat from core client for 30 sec - exiting 22:06:43 (4197): No heartbeat from core client for 30 sec - exiting 22:06:44 (4197): No heartbeat from core client for 30 sec - exiting 22:06:45 (4197): No heartbeat from core client for 30 sec - exiting 22:06:46 (4197): No heartbeat from core client for 30 sec - exiting 22:06:47 (4197): No heartbeat from core client for 30 sec - exiting 22:06:48 (4197): No heartbeat from core client for 30 sec - exiting 22:06:49 (4197): No heartbeat from core client for 30 sec - exiting 22:06:50 (4197): No heartbeat from core client for 30 sec - exiting 22:06:51 (4197): No heartbeat from core client for 30 sec - exiting 22:06:53 (4197): No heartbeat from core client for 30 sec - exiting 22:06:54 (4197): No heartbeat from core client for 30 sec - exiting 22:06:55 (4197): No heartbeat from core client for 30 sec - exiting 22:06:56 (4197): No heartbeat from core client for 30 sec - exiting 22:06:57 (4197): No heartbeat from core client for 30 sec - exiting 22:06:58 (4197): No heartbeat from core client for 30 sec - exiting 22:06:59 (4197): No heartbeat from core client for 30 sec - exiting 22:07:00 (4197): No heartbeat from core client for 30 sec - exiting 22:07:01 (4197): No heartbeat from core client for 30 sec - exiting 22:07:02 (4197): No heartbeat from core client for 30 sec - exiting 22:07:03 (4197): No heartbeat from core client for 30 sec - exiting 22:07:04 (4197): No heartbeat from core client for 30 sec - exiting 22:07:05 (4197): No heartbeat from core client for 30 sec - exiting 22:07:06 (4197): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09cb2308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x094ea308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09eb8308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08944308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09c05308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 22:19:59 (3594): No heartbeat from core client for 30 sec - exiting 22:20:07 (3594): No heartbeat from core client for 30 sec - exiting 22:20:08 (3594): No heartbeat from core client for 30 sec - exiting 22:20:09 (3594): No heartbeat from core client for 30 sec - exiting 22:20:10 (3594): No heartbeat from core client for 30 sec - exiting 22:20:11 (3594): No heartbeat from core client for 30 sec - exiting 22:20:12 (3594): No heartbeat from core client for 30 sec - exiting 22:20:13 (3594): No heartbeat from core client for 30 sec - exiting 22:20:14 (3594): No heartbeat from core client for 30 sec - exiting 22:20:15 (3594): No heartbeat from core client for 30 sec - exiting 22:20:16 (3594): No heartbeat from core client for 30 sec - exiting 22:20:17 (3594): No heartbeat from core client for 30 sec - exiting 22:20:18 (3594): No heartbeat from core client for 30 sec - exiting 22:20:19 (3594): No heartbeat from core client for 30 sec - exiting 22:20:20 (3594): No heartbeat from core client for 30 sec - exiting 22:20:21 (3594): No heartbeat from core client for 30 sec - exiting 22:20:22 (3594): No heartbeat from core client for 30 sec - exiting 22:20:23 (3594): No heartbeat from core client for 30 sec - exiting 22:20:24 (3594): No heartbeat from core client for 30 sec - exiting 22:20:25 (3594): No heartbeat from core client for 30 sec - exiting 22:20:26 (3594): No heartbeat from core client for 30 sec - exiting 22:20:27 (3594): No heartbeat from core client for 30 sec - exiting 22:20:28 (3594): No heartbeat from core client for 30 sec - exiting 22:20:29 (3594): No heartbeat from core client for 30 sec - exiting 22:20:30 (3594): No heartbeat from core client for 30 sec - exiting 22:20:31 (3594): No heartbeat from core client for 30 sec - exiting 22:20:32 (3594): No heartbeat from core client for 30 sec - exiting 22:20:33 (3594): No heartbeat from core client for 30 sec - exiting 22:20:34 (3594): No heartbeat from core client for 30 sec - exiting 22:20:35 (3594): No heartbeat from core client for 30 sec - exiting 22:20:36 (3594): No heartbeat from core client for 30 sec - exiting 22:20:37 (3594): No heartbeat from core client for 30 sec - exiting 22:20:38 (3594): No heartbeat from core client for 30 sec - exiting 22:20:39 (3594): No heartbeat from core client for 30 sec - exiting 22:20:42 (3594): No heartbeat from core client for 30 sec - exiting 22:20:43 (3594): No heartbeat from core client for 30 sec - exiting 22:20:44 (3594): No heartbeat from core client for 30 sec - exiting 22:20:45 (3594): No heartbeat from core client for 30 sec - exiting 22:20:46 (3594): No heartbeat from core client for 30 sec - exiting 22:20:47 (3594): No heartbeat from core client for 30 sec - exiting 22:20:48 (3594): No heartbeat from core client for 30 sec - exiting 22:20:59 (3594): No heartbeat from core client for 30 sec - exiting 22:21:03 (3594): No heartbeat from core client for 30 sec - exiting 22:21:04 (3594): No heartbeat from core client for 30 sec - exiting 22:21:05 (3594): No heartbeat from core client for 30 sec - exiting 22:21:06 (3594): No heartbeat from core client for 30 sec - exiting 22:21:07 (3594): No heartbeat from core client for 30 sec - exiting 22:21:08 (3594): No heartbeat from core client for 30 sec - exiting 22:21:09 (3594): No heartbeat from core client for 30 sec - exiting 22:21:10 (3594): No heartbeat from core client for 30 sec - exiting 22:21:11 (3594): No heartbeat from core client for 30 sec - exiting 22:21:12 (3594): No heartbeat from core client for 30 sec - exiting 22:21:13 (3594): No heartbeat from core client for 30 sec - exiting 22:21:14 (3594): No heartbeat from core client for 30 sec - exiting 22:21:15 (3594): No heartbeat from core client for 30 sec - exiting 22:21:16 (3594): No heartbeat from core client for 30 sec - exiting 22:21:17 (3594): No heartbeat from core client for 30 sec - exiting 22:21:18 (3594): No heartbeat from core client for 30 sec - exiting 22:21:19 (3594): No heartbeat from core client for 30 sec - exiting 22:21:20 (3594): No heartbeat from core client for 30 sec - exiting 22:21:21 (3594): No heartbeat from core client for 30 sec - exiting 22:21:22 (3594): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08dbd308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 22:21:23 (3594): No heartbeat from core client for 30 sec - exiting 22:21:24 (3594): No heartbeat from core client for 30 sec - exiting 22:21:25 (3594): No heartbeat from core client for 30 sec - exiting 22:21:26 (3594): No heartbeat from core client for 30 sec - exiting 22:21:27 (3594): No heartbeat from core client for 30 sec - exiting 22:21:28 (3594): No heartbeat from core client for 30 sec - exiting 22:21:29 (3594): No heartbeat from core client for 30 sec - exiting 22:21:30 (3594): No heartbeat from core client for 30 sec - exiting 22:21:31 (3594): No heartbeat from core client for 30 sec - exiting 22:21:32 (3594): No heartbeat from core client for 30 sec - exiting 22:21:33 (3594): No heartbeat from core client for 30 sec - exiting 22:21:34 (3594): No heartbeat from core client for 30 sec - exiting 22:21:35 (3594): No heartbeat from core client for 30 sec - exiting 22:21:36 (3594): No heartbeat from core client for 30 sec - exiting 22:21:37 (3594): No heartbeat from core client for 30 sec - exiting 22:21:38 (3594): No heartbeat from core client for 30 sec - exiting 22:21:39 (3594): No heartbeat from core client for 30 sec - exiting 22:21:40 (3594): No heartbeat from core client for 30 sec - exiting 22:21:41 (3594): No heartbeat from core client for 30 sec - exiting 22:21:42 (3594): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x087bb308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09159308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09b8c308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a3b308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 20:40:06 (3581): No heartbeat from core client for 30 sec - exiting 20:40:07 (3581): No heartbeat from core client for 30 sec - exiting 20:40:08 (3581): No heartbeat from core client for 30 sec - exiting 20:40:09 (3581): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x092f4308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 20:40:10 (3581): No heartbeat from core client for 30 sec - exiting 20:40:11 (3581): No heartbeat from core client for 30 sec - exiting 20:40:12 (3581): No heartbeat from core client for 30 sec - exiting 20:40:13 (3581): No heartbeat from core client for 30 sec - exiting 20:40:14 (3581): No heartbeat from core client for 30 sec - exiting 20:40:15 (3581): No heartbeat from core client for 30 sec - exiting *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a009308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0888a308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x087dd308 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
01 Nov 2013 23:29:44 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 518,400 | 839,837 | 1.6201 |
01 Nov 2013 09:27:22 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 492,480 | 797,880 | 1.6201 |
31 Oct 2013 14:51:40 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 466,560 | 755,255 | 1.6188 |
30 Oct 2013 04:36:07 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 440,640 | 712,944 | 1.6180 |
29 Oct 2013 08:22:40 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 414,720 | 671,232 | 1.6185 |
28 Oct 2013 10:47:00 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 388,800 | 628,883 | 1.6175 |
27 Oct 2013 17:20:55 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 362,880 | 587,323 | 1.6185 |
26 Oct 2013 19:27:57 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 336,960 | 546,095 | 1.6207 |
25 Oct 2013 22:01:58 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 311,040 | 505,054 | 1.6238 |
25 Oct 2013 07:22:40 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 285,120 | 463,209 | 1.6246 |
24 Oct 2013 03:36:34 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 259,200 | 422,153 | 1.6287 |
23 Oct 2013 10:32:21 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 233,280 | 379,632 | 1.6274 |
22 Oct 2013 15:20:40 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 207,360 | 337,535 | 1.6278 |
21 Oct 2013 23:38:58 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 181,440 | 295,377 | 1.6280 |
21 Oct 2013 08:08:20 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 155,520 | 253,108 | 1.6275 |
20 Oct 2013 12:51:34 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 129,600 | 211,446 | 1.6315 |
19 Oct 2013 18:02:56 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 103,680 | 169,858 | 1.6383 |
19 Oct 2013 01:32:50 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 77,760 | 128,274 | 1.6496 |
18 Oct 2013 07:29:57 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 51,840 | 86,245 | 1.6637 |
16 Oct 2013 17:05:33 | 1223320 | 16056264 | hadcm3n_odyd_1900_40_008473208_3 | 25,920 | 42,824 | 1.6522 |
©2024 climateprediction.net