Task 15420030

Name	hadcm3n_zjhf_1880_40_008242874_1
Workunit	8397998
Created	30 Oct 2012, 15:03:57 UTC
Sent	30 Oct 2012, 15:04:03 UTC
Report deadline	29 Jan 2013, 22:31:14 UTC
Received	20 Dec 2012, 4:06:06 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1244759
Run time	31 days 5 hours 24 min 5 sec
CPU time	9 days 4 hours 30 min 35 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.19 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> m BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09915d08 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0843d368 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09cc9368 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 00:35:27 (3502): No heartbeat from core client for 30 sec - exiting 00:46:25 (3502): No heartbeat from core client for 30 sec - exiting 00:47:10 (3502): No heartbeat from core client for 30 sec - exiting 00:47:11 (3502): No heartbeat from core client for 30 sec - exiting 00:48:14 (3502): No heartbeat from core client for 30 sec - exiting 00:48:15 (3502): No heartbeat from core client for 30 sec - exiting 00:48:16 (3502): No heartbeat from core client for 30 sec - exiting 01:34:19 (3502): No heartbeat from core client for 30 sec - exiting 01:49:10 (3502): No heartbeat from core client for 30 sec - exiting 01:50:49 (3502): No heartbeat from core client for 30 sec - exiting 01:59:17 (3502): No heartbeat from core client for 30 sec - exiting 02:02:38 (3502): No heartbeat from core client for 30 sec - exiting 02:03:08 (3502): No heartbeat from core client for 30 sec - exiting 02:03:09 (3502): No heartbeat from core client for 30 sec - exiting 02:03:10 (3502): No heartbeat from core client for 30 sec - exiting 02:03:11 (3502): No heartbeat from core client for 30 sec - exiting 02:03:12 (3502): No heartbeat from core client for 30 sec - exiting 02:03:13 (3502): No heartbeat from core client for 30 sec - exiting 02:03:14 (3502): No heartbeat from core client for 30 sec - exiting 02:03:15 (3502): No heartbeat from core client for 30 sec - exiting 02:03:16 (3502): No heartbeat from core client for 30 sec - exiting 02:03:17 (3502): No heartbeat from core client for 30 sec - exiting 02:03:18 (3502): No heartbeat from core client for 30 sec - exiting 02:03:19 (3502): No heartbeat from core client for 30 sec - exiting 02:03:20 (3502): No heartbeat from core client for 30 sec - exiting 02:19:10 (3502): No heartbeat from core client for 30 sec - exiting 02:20:35 (3502): No heartbeat from core client for 30 sec - exiting 02:21:54 (3502): No heartbeat from core client for 30 sec - exiting 02:21:55 (3502): No heartbeat from core client for 30 sec - exiting 02:22:26 (3502): No heartbeat from core client for 30 sec - exiting 02:22:27 (3502): No heartbeat from core client for 30 sec - exiting 02:22:28 (3502): No heartbeat from core client for 30 sec - exiting 02:22:29 (3502): No heartbeat from core client for 30 sec - exiting 02:22:30 (3502): No heartbeat from core client for 30 sec - exiting 02:22:31 (3502): No heartbeat from core client for 30 sec - exiting 02:22:32 (3502): No heartbeat from core client for 30 sec - exiting 02:22:33 (3502): No heartbeat from core client for 30 sec - exiting 02:22:34 (3502): No heartbeat from core client for 30 sec - exiting 02:22:35 (3502): No heartbeat from core client for 30 sec - exiting 02:22:36 (3502): No heartbeat from core client for 30 sec - exiting 02:22:37 (3502): No heartbeat from core client for 30 sec - exiting 02:22:38 (3502): No heartbeat from core client for 30 sec - exiting 02:22:39 (3502): No heartbeat from core client for 30 sec - exiting 02:22:40 (3502): No heartbeat from core client for 30 sec - exiting 02:22:41 (3502): No heartbeat from core client for 30 sec - exiting 02:22:42 (3502): No heartbeat from core client for 30 sec - exiting 02:22:43 (3502): No heartbeat from core client for 30 sec - exiting 02:22:44 (3502): No heartbeat from core client for 30 sec - exiting 02:22:45 (3502): No heartbeat from core client for 30 sec - exiting 02:22:46 (3502): No heartbeat from core client for 30 sec - exiting 02:22:47 (3502): No heartbeat from core client for 30 sec - exiting 02:22:48 (3502): No heartbeat from core client for 30 sec - exiting 02:22:49 (3502): No heartbeat from core client for 30 sec - exiting 02:22:50 (3502): No heartbeat from core client for 30 sec - exiting 02:22:52 (3502): No heartbeat from core client for 30 sec - exiting 02:22:53 (3502): No heartbeat from core client for 30 sec - exiting 02:24:16 (3502): No heartbeat from core client for 30 sec - exiting 02:24:17 (3502): No heartbeat from core client for 30 sec - exiting 02:24:18 (3502): No heartbeat from core client for 30 sec - exiting 02:24:19 (3502): No heartbeat from core client for 30 sec - exiting 02:24:20 (3502): No heartbeat from core client for 30 sec - exiting 02:24:21 (3502): No heartbeat from core client for 30 sec - exiting 02:24:22 (3502): No heartbeat from core client for 30 sec - exiting 02:24:23 (3502): No heartbeat from core client for 30 sec - exiting 02:24:24 (3502): No heartbeat from core client for 30 sec - exiting 02:24:25 (3502): No heartbeat from core client for 30 sec - exiting 02:24:26 (3502): No heartbeat from core client for 30 sec - exiting 02:24:27 (3502): No heartbeat from core client for 30 sec - exiting 02:24:28 (3502): No heartbeat from core client for 30 sec - exiting 02:24:29 (3502): No heartbeat from core client for 30 sec - exiting 02:24:30 (3502): No heartbeat from core client for 30 sec - exiting 02:24:31 (3502): No heartbeat from core client for 30 sec - exiting 02:24:32 (3502): No heartbeat from core client for 30 sec - exiting 02:24:33 (3502): No heartbeat from core client for 30 sec - exiting 02:24:34 (3502): No heartbeat from core client for 30 sec - exiting 02:24:35 (3502): No heartbeat from core client for 30 sec - exiting 02:24:36 (3502): No heartbeat from core client for 30 sec - exiting 02:24:37 (3502): No heartbeat from core client for 30 sec - exiting 02:24:38 (3502): No heartbeat from core client for 30 sec - exiting 02:24:39 (3502): No heartbeat from core client for 30 sec - exiting 02:24:40 (3502): No heartbeat from core client for 30 sec - exiting 02:24:41 (3502): No heartbeat from core client for 30 sec - exiting 02:24:42 (3502): No heartbeat from core client for 30 sec - exiting 02:24:43 (3502): No heartbeat from core client for 30 sec - exiting 02:24:44 (3502): No heartbeat from core client for 30 sec - exiting 02:24:45 (3502): No heartbeat from core client for 30 sec - exiting 02:24:46 (3502): No heartbeat from core client for 30 sec - exiting 02:24:47 (3502): No heartbeat from core client for 30 sec - exiting 02:24:48 (3502): No heartbeat from core client for 30 sec - exiting 02:24:49 (3502): No heartbeat from core client for 30 sec - exiting 02:24:50 (3502): No heartbeat from core client for 30 sec - exiting 02:24:53 (3502): No heartbeat from core client for 30 sec - exiting 02:24:54 (3502): No heartbeat from core client for 30 sec - exiting 02:24:55 (3502): No heartbeat from core client for 30 sec - exiting 02:24:56 (3502): No heartbeat from core client for 30 sec - exiting 02:24:57 (3502): No heartbeat from core client for 30 sec - exiting 02:24:58 (3502): No heartbeat from core client for 30 sec - exiting 02:24:59 (3502): No heartbeat from core client for 30 sec - exiting 02:25:00 (3502): No heartbeat from core client for 30 sec - exiting 02:25:01 (3502): No heartbeat from core client for 30 sec - exiting 02:25:02 (3502): No heartbeat from core client for 30 sec - exiting 02:25:03 (3502): No heartbeat from core client for 30 sec - exiting 02:25:04 (3502): No heartbeat from core client for 30 sec - exiting 02:25:05 (3502): No heartbeat from core client for 30 sec - exiting 02:25:06 (3502): No heartbeat from core client for 30 sec - exiting 02:25:07 (3502): No heartbeat from core client for 30 sec - exiting 02:25:08 (3502): No heartbeat from core client for 30 sec - exiting 02:25:09 (3502): No heartbeat from core client for 30 sec - exiting 02:25:10 (3502): No heartbeat from core client for 30 sec - exiting 02:25:11 (3502): No heartbeat from core client for 30 sec - exiting 02:25:12 (3502): No heartbeat from core client for 30 sec - exiting 02:25:13 (3502): No heartbeat from core client for 30 sec - exiting 02:25:14 (3502): No heartbeat from core client for 30 sec - exiting 02:25:15 (3502): No heartbeat from core client for 30 sec - exiting 02:25:16 (3502): No heartbeat from core client for 30 sec - exiting 02:25:17 (3502): No heartbeat from core client for 30 sec - exiting 02:25:18 (3502): No heartbeat from core client for 30 sec - exiting 02:25:19 (3502): No heartbeat from core client for 30 sec - exiting 02:25:20 (3502): No heartbeat from core client for 30 sec - exiting 02:25:21 (3502): No heartbeat from core client for 30 sec - exiting 02:25:22 (3502): No heartbeat from core client for 30 sec - exiting 02:25:23 (3502): No heartbeat from core client for 30 sec - exiting 02:25:24 (3502): No heartbeat from core client for 30 sec - exiting 02:25:25 (3502): No heartbeat from core client for 30 sec - exiting 02:25:26 (3502): No heartbeat from core client for 30 sec - exiting 02:25:30 (3502): No heartbeat from core client for 30 sec - exiting 02:25:31 (3502): No heartbeat from core client for 30 sec - exiting 02:25:32 (3502): No heartbeat from core client for 30 sec - exiting 02:25:33 (3502): No heartbeat from core client for 30 sec - exiting 02:25:34 (3502): No heartbeat from core client for 30 sec - exiting 02:25:35 (3502): No heartbeat from core client for 30 sec - exiting 02:25:36 (3502): No heartbeat from core client for 30 sec - exiting 02:25:37 (3502): No heartbeat from core client for 30 sec - exiting 02:25:38 (3502): No heartbeat from core client for 30 sec - exiting 02:25:39 (3502): No heartbeat from core client for 30 sec - exiting 02:25:40 (3502): No heartbeat from core client for 30 sec - exiting 02:25:41 (3502): No heartbeat from core client for 30 sec - exiting 02:25:42 (3502): No heartbeat from core client for 30 sec - exiting 02:25:43 (3502): No heartbeat from core client for 30 sec - exiting 02:25:44 (3502): No heartbeat from core client for 30 sec - exiting 02:25:45 (3502): No heartbeat from core client for 30 sec - exiting 02:25:46 (3502): No heartbeat from core client for 30 sec - exiting 02:25:47 (3502): No heartbeat from core client for 30 sec - exiting 02:33:51 (3502): No heartbeat from core client for 30 sec - exiting 02:47:57 (3502): No heartbeat from core client for 30 sec - exiting 03:15:58 (3502): No heartbeat from core client for 30 sec - exiting 04:34:17 (3502): No heartbeat from core client for 30 sec - exiting 04:39:27 (3502): No heartbeat from core client for 30 sec - exiting 04:40:03 (3502): No heartbeat from core client for 30 sec - exiting 04:40:04 (3502): No heartbeat from core client for 30 sec - exiting 04:40:05 (3502): No heartbeat from core client for 30 sec - exiting 04:40:06 (3502): No heartbeat from core client for 30 sec - exiting 04:40:07 (3502): No heartbeat from core client for 30 sec - exiting 04:40:08 (3502): No heartbeat from core client for 30 sec - exiting 04:40:09 (3502): No heartbeat from core client for 30 sec - exiting 04:40:10 (3502): No heartbeat from core client for 30 sec - exiting 04:40:11 (3502): No heartbeat from core client for 30 sec - exiting 04:40:12 (3502): No heartbeat from core client for 30 sec - exiting 04:40:13 (3502): No heartbeat from core client for 30 sec - exiting 04:40:14 (3502): No heartbeat from core client for 30 sec - exiting 04:40:15 (3502): No heartbeat from core client for 30 sec - exiting 04:40:16 (3502): No heartbeat from core client for 30 sec - exiting 04:40:17 (3502): No heartbeat from core client for 30 sec - exiting 04:40:18 (3502): No heartbeat from core client for 30 sec - exiting 04:40:19 (3502): No heartbeat from core client for 30 sec - exiting 04:40:20 (3502): No heartbeat from core client for 30 sec - exiting 04:40:21 (3502): No heartbeat from core client for 30 sec - exiting 04:40:22 (3502): No heartbeat from core client for 30 sec - exiting 04:40:23 (3502): No heartbeat from core client for 30 sec - exiting 04:40:24 (3502): No heartbeat from core client for 30 sec - exiting 04:40:26 (3502): No heartbeat from core client for 30 sec - exiting 04:40:27 (3502): No heartbeat from core client for 30 sec - exiting 04:40:28 (3502): No heartbeat from core client for 30 sec - exiting 04:40:29 (3502): No heartbeat from core client for 30 sec - exiting 04:40:30 (3502): No heartbeat from core client for 30 sec - exiting 04:42:01 (3502): No heartbeat from core client for 30 sec - exiting 04:42:39 (3502): No heartbeat from core client for 30 sec - exiting 04:42:40 (3502): No heartbeat from core client for 30 sec - exiting 04:42:41 (3502): No heartbeat from core client for 30 sec - exiting 04:42:42 (3502): No heartbeat from core client for 30 sec - exiting 04:42:43 (3502): No heartbeat from core client for 30 sec - exiting 04:42:44 (3502): No heartbeat from core client for 30 sec - exiting 04:42:45 (3502): No heartbeat from core client for 30 sec - exiting 04:42:46 (3502): No heartbeat from core client for 30 sec - exiting 04:42:47 (3502): No heartbeat from core client for 30 sec - exiting 04:42:48 (3502): No heartbeat from core client for 30 sec - exiting 04:49:32 (3502): No heartbeat from core client for 30 sec - exiting 04:49:37 (3502): No heartbeat from core client for 30 sec - exiting 04:54:09 (3502): No heartbeat from core client for 30 sec - exiting 04:58:20 (3502): No heartbeat from core client for 30 sec - exiting 05:01:20 (3502): No heartbeat from core client for 30 sec - exiting 05:04:12 (3502): No heartbeat from core client for 30 sec - exiting 05:05:16 (3502): No heartbeat from core client for 30 sec - exiting 05:05:17 (3502): No heartbeat from core client for 30 sec - exiting 05:05:18 (3502): No heartbeat from core client for 30 sec - exiting 05:05:20 (3502): No heartbeat from core client for 30 sec - exiting 05:05:21 (3502): No heartbeat from core client for 30 sec - exiting 05:05:45 (3502): No heartbeat from core client for 30 sec - exiting 05:07:59 (3502): No heartbeat from core client for 30 sec - exiting 05:08:00 (3502): No heartbeat from core client for 30 sec - exiting 05:08:01 (3502): No heartbeat from core client for 30 sec - exiting 05:08:02 (3502): No heartbeat from core client for 30 sec - exiting 05:08:03 (3502): No heartbeat from core client for 30 sec - exiting 05:08:04 (3502): No heartbeat from core client for 30 sec - exiting 05:08:05 (3502): No heartbeat from core client for 30 sec - exiting 05:08:06 (3502): No heartbeat from core client for 30 sec - exiting 05:08:07 (3502): No heartbeat from core client for 30 sec - exiting 05:08:08 (3502): No heartbeat from core client for 30 sec - exiting 05:08:09 (3502): No heartbeat from core client for 30 sec - exiting 05:08:10 (3502): No heartbeat from core client for 30 sec - exiting 05:08:11 (3502): No heartbeat from core client for 30 sec - exiting 05:08:12 (3502): No heartbeat from core client for 30 sec - exiting 05:08:13 (3502): No heartbeat from core client for 30 sec - exiting 05:08:14 (3502): No heartbeat from core client for 30 sec - exiting 05:08:15 (3502): No heartbeat from core client for 30 sec - exiting 05:08:16 (3502): No heartbeat from core client for 30 sec - exiting 05:08:17 (3502): No heartbeat from core client for 30 sec - exiting 05:08:18 (3502): No heartbeat from core client for 30 sec - exiting 05:08:19 (3502): No heartbeat from core client for 30 sec - exiting 05:08:26 (3502): No heartbeat from core client for 30 sec - exiting 05:08:27 (3502): No heartbeat from core client for 30 sec - exiting 05:08:28 (3502): No heartbeat from core client for 30 sec - exiting 05:08:29 (3502): No heartbeat from core client for 30 sec - exiting 05:09:05 (3502): No heartbeat from core client for 30 sec - exiting 05:09:06 (3502): No heartbeat from core client for 30 sec - exiting 05:09:07 (3502): No heartbeat from core client for 30 sec - exiting 05:09:08 (3502): No heartbeat from core client for 30 sec - exiting 05:09:09 (3502): No heartbeat from core client for 30 sec - exiting 05:09:10 (3502): No heartbeat from core client for 30 sec - exiting 05:09:11 (3502): No heartbeat from core client for 30 sec - exiting 05:09:12 (3502): No heartbeat from core client for 30 sec - exiting 05:09:13 (3502): No heartbeat from core client for 30 sec - exiting 05:09:14 (3502): No heartbeat from core client for 30 sec - exiting 05:09:15 (3502): No heartbeat from core client for 30 sec - exiting 05:09:16 (3502): No heartbeat from core client for 30 sec - exiting 05:09:17 (3502): No heartbeat from core client for 30 sec - exiting 05:09:18 (3502): No heartbeat from core client for 30 sec - exiting 05:09:55 (3502): No heartbeat from core client for 30 sec - exiting 05:09:56 (3502): No heartbeat from core client for 30 sec - exiting 05:09:57 (3502): No heartbeat from core client for 30 sec - exiting 05:09:58 (3502): No heartbeat from core client for 30 sec - exiting 05:09:59 (3502): No heartbeat from core client for 30 sec - exiting 05:10:00 (3502): No heartbeat from core client for 30 sec - exiting 05:10:01 (3502): No heartbeat from core client for 30 sec - exiting 05:10:02 (3502): No heartbeat from core client for 30 sec - exiting 05:10:03 (3502): No heartbeat from core client for 30 sec - exiting 05:10:04 (3502): No heartbeat from core client for 30 sec - exiting 05:10:05 (3502): No heartbeat from core client for 30 sec - exiting 05:10:06 (3502): No heartbeat from core client for 30 sec - exiting 05:10:07 (3502): No heartbeat from core client for 30 sec - exiting 05:10:08 (3502): No heartbeat from core client for 30 sec - exiting 05:10:09 (3502): No heartbeat from core client for 30 sec - exiting 05:10:10 (3502): No heartbeat from core client for 30 sec - exiting 05:10:11 (3502): No heartbeat from core client for 30 sec - exiting 05:10:12 (3502): No heartbeat from core client for 30 sec - exiting 05:10:13 (3502): No heartbeat from core client for 30 sec - exiting 05:10:14 (3502): No heartbeat from core client for 30 sec - exiting 05:10:15 (3502): No heartbeat from core client for 30 sec - exiting 05:10:16 (3502): No heartbeat from core client for 30 sec - exiting 05:10:17 (3502): No heartbeat from core client for 30 sec - exiting 05:10:18 (3502): No heartbeat from core client for 30 sec - exiting 05:10:19 (3502): No heartbeat from core client for 30 sec - exiting 05:10:20 (3502): No heartbeat from core client for 30 sec - exiting 05:10:21 (3502): No heartbeat from core client for 30 sec - exiting 05:13:32 (3502): No heartbeat from core client for 30 sec - exiting 05:13:41 (3502): No heartbeat from core client for 30 sec - exiting 05:13:42 (3502): No heartbeat from core client for 30 sec - exiting 05:13:43 (3502): No heartbeat from core client for 30 sec - exiting 05:13:44 (3502): No heartbeat from core client for 30 sec - exiting 05:18:51 (3502): No heartbeat from core client for 30 sec - exiting 05:19:34 (3502): No heartbeat from core client for 30 sec - exiting 05:20:12 (3502): No heartbeat from core client for 30 sec - exiting 05:20:13 (3502): No heartbeat from core client for 30 sec - exiting 05:20:14 (3502): No heartbeat from core client for 30 sec - exiting 05:20:15 (3502): No heartbeat from core client for 30 sec - exiting 05:20:16 (3502): No heartbeat from core client for 30 sec - exiting 05:20:17 (3502): No heartbeat from core client for 30 sec - exiting 05:20:18 (3502): No heartbeat from core client for 30 sec - exiting 05:20:19 (3502): No heartbeat from core client for 30 sec - exiting 05:20:20 (3502): No heartbeat from core client for 30 sec - exiting 05:20:21 (3502): No heartbeat from core client for 30 sec - exiting 05:20:22 (3502): No heartbeat from core client for 30 sec - exiting 05:20:23 (3502): No heartbeat from core client for 30 sec - exiting 05:20:24 (3502): No heartbeat from core client for 30 sec - exiting 05:20:25 (3502): No heartbeat from core client for 30 sec - exiting 05:20:26 (3502): No heartbeat from core client for 30 sec - exiting 05:20:27 (3502): No heartbeat from core client for 30 sec - exiting 05:20:28 (3502): No heartbeat from core client for 30 sec - exiting 05:20:29 (3502): No heartbeat from core client for 30 sec - exiting 05:25:52 (3502): No heartbeat from core client for 30 sec - exiting 05:30:35 (3502): No heartbeat from core client for 30 sec - exiting 05:31:05 (3502): No heartbeat from core client for 30 sec - exiting 05:31:36 (3502): No heartbeat from core client for 30 sec - exiting 05:31:37 (3502): No heartbeat from core client for 30 sec - exiting 05:31:40 (3502): No heartbeat from core client for 30 sec - exiting 05:31:45 (3502): No heartbeat from core client for 30 sec - exiting 05:31:46 (3502): No heartbeat from core client for 30 sec - exiting 05:31:47 (3502): No heartbeat from core client for 30 sec - exiting 05:31:48 (3502): No heartbeat from core client for 30 sec - exiting 05:31:49 (3502): No heartbeat from core client for 30 sec - exiting 05:31:50 (3502): No heartbeat from core client for 30 sec - exiting 05:31:51 (3502): No heartbeat from core client for 30 sec - exiting 05:34:31 (3502): No heartbeat from core client for 30 sec - exiting 05:46:38 (3502): No heartbeat from core client for 30 sec - exiting 05:46:51 (3502): No heartbeat from core client for 30 sec - exiting 05:46:52 (3502): No heartbeat from core client for 30 sec - exiting 05:46:53 (3502): No heartbeat from core client for 30 sec - exiting 05:46:54 (3502): No heartbeat from core client for 30 sec - exiting 05:46:55 (3502): No heartbeat from core client for 30 sec - exiting 05:47:30 (3502): No heartbeat from core client for 30 sec - exiting 05:47:31 (3502): No heartbeat from core client for 30 sec - exiting 05:47:32 (3502): No heartbeat from core client for 30 sec - exiting 05:47:35 (3502): No heartbeat from core client for 30 sec - exiting 05:47:36 (3502): No heartbeat from core client for 30 sec - exiting 05:47:37 (3502): No heartbeat from core client for 30 sec - exiting 05:47:38 (3502): No heartbeat from core client for 30 sec - exiting 05:47:39 (3502): No heartbeat from core client for 30 sec - exiting 05:52:31 (3502): No heartbeat from core client for 30 sec - exiting 05:52:37 (3502): No heartbeat from core client for 30 sec - exiting 06:01:20 (3502): No heartbeat from core client for 30 sec - exiting 06:10:36 (3502): No heartbeat from core client for 30 sec - exiting 06:10:37 (3502): No heartbeat from core client for 30 sec - exiting 06:10:38 (3502): No heartbeat from core client for 30 sec - exiting 06:10:39 (3502): No heartbeat from core client for 30 sec - exiting 06:10:40 (3502): No heartbeat from core client for 30 sec - exiting 06:10:41 (3502): No heartbeat from core client for 30 sec - exiting 06:10:42 (3502): No heartbeat from core client for 30 sec - exiting 06:10:43 (3502): No heartbeat from core client for 30 sec - exiting 06:10:44 (3502): No heartbeat from core client for 30 sec - exiting 06:10:45 (3502): No heartbeat from core client for 30 sec - exiting 06:10:46 (3502): No heartbeat from core client for 30 sec - exiting 06:10:47 (3502): No heartbeat from core client for 30 sec - exiting 06:10:48 (3502): No heartbeat from core client for 30 sec - exiting 06:10:49 (3502): No heartbeat from core client for 30 sec - exiting 06:10:50 (3502): No heartbeat from core client for 30 sec - exiting 06:10:51 (3502): No heartbeat from core client for 30 sec - exiting 06:10:52 (3502): No heartbeat from core client for 30 sec - exiting 06:10:53 (3502): No heartbeat from core client for 30 sec - exiting 06:10:54 (3502): No heartbeat from core client for 30 sec - exiting 06:10:55 (3502): No heartbeat from core client for 30 sec - exiting 06:10:56 (3502): No heartbeat from core client for 30 sec - exiting 06:10:57 (3502): No heartbeat from core client for 30 sec - exiting 06:10:58 (3502): No heartbeat from core client for 30 sec - exiting 06:10:59 (3502): No heartbeat from core client for 30 sec - exiting 06:11:11 (3502): No heartbeat from core client for 30 sec - exiting 06:11:12 (3502): No heartbeat from core client for 30 sec - exiting 06:11:13 (3502): No heartbeat from core client for 30 sec - exiting 06:11:14 (3502): No heartbeat from core client for 30 sec - exiting 06:11:15 (3502): No heartbeat from core client for 30 sec - exiting 06:11:16 (3502): No heartbeat from core client for 30 sec - exiting 06:11:17 (3502): No heartbeat from core client for 30 sec - exiting 06:11:18 (3502): No heartbeat from core client for 30 sec - exiting 06:11:19 (3502): No heartbeat from core client for 30 sec - exiting 06:11:20 (3502): No heartbeat from core client for 30 sec - exiting 06:11:21 (3502): No heartbeat from core client for 30 sec - exiting 06:11:57 (3502): No heartbeat from core client for 30 sec - exiting 06:11:58 (3502): No heartbeat from core client for 30 sec - exiting 06:11:59 (3502): No heartbeat from core client for 30 sec - exiting 06:12:00 (3502): No heartbeat from core client for 30 sec - exiting 06:12:01 (3502): No heartbeat from core client for 30 sec - exiting 06:12:02 (3502): No heartbeat from core client for 30 sec - exiting 06:12:03 (3502): No heartbeat from core client for 30 sec - exiting 06:12:04 (3502): No heartbeat from core client for 30 sec - exiting 06:12:05 (3502): No heartbeat from core client for 30 sec - exiting 06:12:06 (3502): No heartbeat from core client for 30 sec - exiting 06:12:07 (3502): No heartbeat from core client for 30 sec - exiting 06:12:08 (3502): No heartbeat from core client for 30 sec - exiting 06:12:09 (3502): No heartbeat from core client for 30 sec - exiting 06:12:10 (3502): No heartbeat from core client for 30 sec - exiting 06:12:11 (3502): No heartbeat from core client for 30 sec - exiting 06:12:12 (3502): No heartbeat from core client for 30 sec - exiting 06:12:13 (3502): No heartbeat from core client for 30 sec - exiting 06:12:14 (3502): No heartbeat from core client for 30 sec - exiting 06:12:15 (3502): No heartbeat from core client for 30 sec - exiting 06:12:16 (3502): No heartbeat from core client for 30 sec - exiting 06:12:17 (3502): No heartbeat from core client for 30 sec - exiting 06:12:18 (3502): No heartbeat from core client for 30 sec - exiting 06:12:19 (3502): No heartbeat from core client for 30 sec - exiting 06:12:20 (3502): No heartbeat from core client for 30 sec - exiting 06:12:21 (3502): No heartbeat from core client for 30 sec - exiting 06:12:22 (3502): No heartbeat from core client for 30 sec - exiting 06:12:23 (3502): No heartbeat from core client for 30 sec - exiting 06:12:24 (3502): No heartbeat from core client for 30 sec - exiting 06:12:25 (3502): No heartbeat from core client for 30 sec - exiting 06:12:26 (3502): No heartbeat from core client for 30 sec - exiting 06:12:27 (3502): No heartbeat from core client for 30 sec - exiting 06:12:28 (3502): No heartbeat from core client for 30 sec - exiting 06:12:29 (3502): No heartbeat from core client for 30 sec - exiting 06:12:30 (3502): No heartbeat from core client for 30 sec - exiting 06:12:31 (3502): No heartbeat from core client for 30 sec - exiting 06:12:32 (3502): No heartbeat from core client for 30 sec - exiting 06:12:33 (3502): No heartbeat from core client for 30 sec - exiting 06:12:34 (3502): No heartbeat from core client for 30 sec - exiting 06:12:35 (3502): No heartbeat from core client for 30 sec - exiting 06:12:36 (3502): No heartbeat from core client for 30 sec - exiting 06:12:37 (3502): No heartbeat from core client for 30 sec - exiting 06:12:38 (3502): No heartbeat from core client for 30 sec - exiting 06:12:39 (3502): No heartbeat from core client for 30 sec - exiting 06:12:40 (3502): No heartbeat from core client for 30 sec - exiting 06:12:41 (3502): No heartbeat from core client for 30 sec - exiting 06:12:42 (3502): No heartbeat from core client for 30 sec - exiting 06:12:43 (3502): No heartbeat from core client for 30 sec - exiting 06:12:44 (3502): No heartbeat from core client for 30 sec - exiting 06:12:45 (3502): No heartbeat from core client for 30 sec - exiting 06:12:46 (3502): No heartbeat from core client for 30 sec - exiting 06:12:47 (3502): No heartbeat from core client for 30 sec - exiting 06:12:48 (3502): No heartbeat from core client for 30 sec - exiting 06:12:49 (3502): No heartbeat from core client for 30 sec - exiting 06:12:50 (3502): No heartbeat from core client for 30 sec - exiting 06:12:51 (3502): No heartbeat from core client for 30 sec - exiting 06:12:52 (3502): No heartbeat from core client for 30 sec - exiting 06:12:53 (3502): No heartbeat from core client for 30 sec - exiting 06:12:54 (3502): No heartbeat from core client for 30 sec - exiting 06:14:11 (3502): No heartbeat from core client for 30 sec - exiting 06:14:32 (3502): No heartbeat from core client for 30 sec - exiting 06:15:10 (3502): No heartbeat from core client for 30 sec - exiting 06:15:11 (3502): No heartbeat from core client for 30 sec - exiting 06:15:12 (3502): No heartbeat from core client for 30 sec - exiting 06:15:13 (3502): No heartbeat from core client for 30 sec - exiting 06:15:14 (3502): No heartbeat from core client for 30 sec - exiting 06:15:15 (3502): No heartbeat from core client for 30 sec - exiting 06:15:16 (3502): No heartbeat from core client for 30 sec - exiting 06:15:17 (3502): No heartbeat from core client for 30 sec - exiting 06:15:18 (3502): No heartbeat from core client for 30 sec - exiting 06:15:19 (3502): No heartbeat from core client for 30 sec - exiting 06:15:20 (3502): No heartbeat from core client for 30 sec - exiting 06:15:21 (3502): No heartbeat from core client for 30 sec - exiting 06:15:22 (3502): No heartbeat from core client for 30 sec - exiting 06:15:23 (3502): No heartbeat from core client for 30 sec - exiting 06:15:24 (3502): No heartbeat from core client for 30 sec - exiting 06:15:25 (3502): No heartbeat from core client for 30 sec - exiting 06:15:26 (3502): No heartbeat from core client for 30 sec - exiting 06:15:27 (3502): No heartbeat from core client for 30 sec - exiting 06:15:28 (3502): No heartbeat from core client for 30 sec - exiting 06:15:29 (3502): No heartbeat from core client for 30 sec - exiting 06:15:30 (3502): No heartbeat from core client for 30 sec - exiting 06:15:31 (3502): No heartbeat from core client for 30 sec - exiting 06:15:32 (3502): No heartbeat from core client for 30 sec - exiting 06:15:33 (3502): No heartbeat from core client for 30 sec - exiting 06:15:34 (3502): No heartbeat from core client for 30 sec - exiting 06:15:35 (3502): No heartbeat from core client for 30 sec - exiting 06:15:36 (3502): No heartbeat from core client for 30 sec - exiting 06:15:37 (3502): No heartbeat from core client for 30 sec - exiting 06:15:38 (3502): No heartbeat from core client for 30 sec - exiting 06:15:39 (3502): No heartbeat from core client for 30 sec - exiting 06:15:40 (3502): No heartbeat from core client for 30 sec - exiting 06:15:41 (3502): No heartbeat from core client for 30 sec - exiting 06:15:42 (3502): No heartbeat from core client for 30 sec - exiting 06:15:43 (3502): No heartbeat from core client for 30 sec - exiting 06:15:44 (3502): No heartbeat from core client for 30 sec - exiting 06:15:45 (3502): No heartbeat from core client for 30 sec - exiting 06:36:46 (3502): No heartbeat from core client for 30 sec - exiting 06:37:15 (3502): No heartbeat from core client for 30 sec - exiting 06:37:16 (3502): No heartbeat from core client for 30 sec - exiting 06:37:17 (3502): No heartbeat from core client for 30 sec - exiting 06:37:18 (3502): No heartbeat from core client for 30 sec - exiting 06:37:19 (3502): No heartbeat from core client for 30 sec - exiting 06:37:20 (3502): No heartbeat from core client for 30 sec - exiting 06:37:21 (3502): No heartbeat from core client for 30 sec - exiting 06:37:22 (3502): No heartbeat from core client for 30 sec - exiting 06:37:23 (3502): No heartbeat from core client for 30 sec - exiting 06:37:24 (3502): No heartbeat from core client for 30 sec - exiting 06:37:25 (3502): No heartbeat from core client for 30 sec - exiting 06:37:26 (3502): No heartbeat from core client for 30 sec - exiting 06:37:27 (3502): No heartbeat from core client for 30 sec - exiting 06:37:28 (3502): No heartbeat from core client for 30 sec - exiting 06:37:29 (3502): No heartbeat from core client for 30 sec - exiting 06:37:30 (3502): No heartbeat from core client for 30 sec - exiting 06:37:31 (3502): No heartbeat from core client for 30 sec - exiting 06:37:32 (3502): No heartbeat from core client for 30 sec - exiting 06:37:33 (3502): No heartbeat from core client for 30 sec - exiting 06:37:34 (3502): No heartbeat from core client for 30 sec - exiting 06:37:35 (3502): No heartbeat from core client for 30 sec - exiting 06:37:36 (3502): No heartbeat from core client for 30 sec - exiting 06:37:37 (3502): No heartbeat from core client for 30 sec - exiting 06:37:38 (3502): No heartbeat from core client for 30 sec - exiting 06:37:42 (3502): No heartbeat from core client for 30 sec - exiting 06:37:43 (3502): No heartbeat from core client for 30 sec - exiting 06:37:44 (3502): No heartbeat from core client for 30 sec - exiting 06:37:45 (3502): No heartbeat from core client for 30 sec - exiting 06:37:46 (3502): No heartbeat from core client for 30 sec - exiting 06:37:47 (3502): No heartbeat from core client for 30 sec - exiting 06:37:48 (3502): No heartbeat from core client for 30 sec - exiting 06:37:49 (3502): No heartbeat from core client for 30 sec - exiting 06:37:50 (3502): No heartbeat from core client for 30 sec - exiting 06:37:51 (3502): No heartbeat from core client for 30 sec - exiting 06:37:52 (3502): No heartbeat from core client for 30 sec - exiting 06:37:53 (3502): No heartbeat from core client for 30 sec - exiting 06:37:54 (3502): No heartbeat from core client for 30 sec - exiting 06:37:55 (3502): No heartbeat from core client for 30 sec - exiting 06:37:56 (3502): No heartbeat from core client for 30 sec - exiting 06:37:57 (3502): No heartbeat from core client for 30 sec - exiting 06:37:58 (3502): No heartbeat from core client for 30 sec - exiting 06:37:59 (3502): No heartbeat from core client for 30 sec - exiting 06:38:00 (3502): No heartbeat from core client for 30 sec - exiting 06:38:01 (3502): No heartbeat from core client for 30 sec - exiting 06:38:02 (3502): No heartbeat from core client for 30 sec - exiting 06:38:03 (3502): No heartbeat from core client for 30 sec - exiting 06:38:04 (3502): No heartbeat from core client for 30 sec - exiting 06:38:05 (3502): No heartbeat from core client for 30 sec - exiting 06:38:06 (3502): No heartbeat from core client for 30 sec - exiting 06:38:07 (3502): No heartbeat from core client for 30 sec - exiting 06:38:08 (3502): No heartbeat from core client for 30 sec - exiting 06:38:09 (3502): No heartbeat from core client for 30 sec - exiting 06:38:10 (3502): No heartbeat from core client for 30 sec - exiting 06:38:11 (3502): No heartbeat from core client for 30 sec - exiting 06:38:12 (3502): No heartbeat from core client for 30 sec - exiting 06:38:13 (3502): No heartbeat from core client for 30 sec - exiting 06:38:14 (3502): No heartbeat from core client for 30 sec - exiting 06:38:15 (3502): No heartbeat from core client for 30 sec - exiting 06:38:16 (3502): No heartbeat from core client for 30 sec - exiting 06:38:17 (3502): No heartbeat from core client for 30 sec - exiting 06:38:18 (3502): No heartbeat from core client for 30 sec - exiting 06:38:19 (3502): No heartbeat from core client for 30 sec - exiting 06:38:20 (3502): No heartbeat from core client for 30 sec - exiting 06:38:21 (3502): No heartbeat from core client for 30 sec - exiting 06:38:22 (3502): No heartbeat from core client for 30 sec - exiting 06:38:23 (3502): No heartbeat from core client for 30 sec - exiting 06:38:24 (3502): No heartbeat from core client for 30 sec - exiting 06:38:25 (3502): No heartbeat from core client for 30 sec - exiting 06:38:26 (3502): No heartbeat from core client for 30 sec - exiting 06:38:27 (3502): No heartbeat from core client for 30 sec - exiting 06:38:28 (3502): No heartbeat from core client for 30 sec - exiting 06:38:29 (3502): No heartbeat from core client for 30 sec - exiting 06:38:30 (3502): No heartbeat from core client for 30 sec - exiting 06:38:31 (3502): No heartbeat from core client for 30 sec - exiting 06:38:32 (3502): No heartbeat from core client for 30 sec - exiting 06:38:33 (3502): No heartbeat from core client for 30 sec - exiting 06:38:34 (3502): No heartbeat from core client for 30 sec - exiting 06:38:35 (3502): No heartbeat from core client for 30 sec - exiting 06:38:36 (3502): No heartbeat from core client for 30 sec - exiting 06:38:37 (3502): No heartbeat from core client for 30 sec - exiting 06:38:38 (3502): No heartbeat from core client for 30 sec - exiting 06:38:39 (3502): No heartbeat from core client for 30 sec - exiting 06:38:40 (3502): No heartbeat from core client for 30 sec - exiting 06:40:47 (3502): No heartbeat from core client for 30 sec - exiting 06:40:48 (3502): No heartbeat from core client for 30 sec - exiting 06:40:49 (3502): No heartbeat from core client for 30 sec - exiting 06:40:50 (3502): No heartbeat from core client for 30 sec - exiting 06:49:36 (3502): No heartbeat from core client for 30 sec - exiting 07:03:25 (3502): No heartbeat from core client for 30 sec - exiting 07:03:35 (3502): No heartbeat from core client for 30 sec - exiting 07:03:36 (3502): No heartbeat from core client for 30 sec - exiting 07:03:37 (3502): No heartbeat from core client for 30 sec - exiting 07:03:38 (3502): No heartbeat from core client for 30 sec - exiting 07:03:39 (3502): No heartbeat from core client for 30 sec - exiting 07:03:40 (3502): No heartbeat from core client for 30 sec - exiting 07:04:11 (3502): No heartbeat from core client for 30 sec - exiting 07:04:12 (3502): No heartbeat from core client for 30 sec - exiting 07:04:13 (3502): No heartbeat from core client for 30 sec - exiting 07:04:14 (3502): No heartbeat from core client for 30 sec - exiting 07:04:15 (3502): No heartbeat from core client for 30 sec - exiting 07:04:16 (3502): No heartbeat from core client for 30 sec - exiting 07:04:17 (3502): No heartbeat from core client for 30 sec - exiting 07:04:18 (3502): No heartbeat from core client for 30 sec - exiting 07:04:19 (3502): No heartbeat from core client for 30 sec - exiting 07:04:20 (3502): No heartbeat from core client for 30 sec - exiting 07:04:21 (3502): No heartbeat from core client for 30 sec - exiting 07:04:22 (3502): No heartbeat from core client for 30 sec - exiting 07:04:26 (3502): No heartbeat from core client for 30 sec - exiting 07:04:27 (3502): No heartbeat from core client for 30 sec - exiting 07:04:28 (3502): No heartbeat from core client for 30 sec - exiting 07:04:29 (3502): No heartbeat from core client for 30 sec - exiting 07:04:31 (3502): No heartbeat from core client for 30 sec - exiting 07:04:32 (3502): No heartbeat from core client for 30 sec - exiting 07:04:33 (3502): No heartbeat from core client for 30 sec - exiting 07:05:04 (3502): No heartbeat from core client for 30 sec - exiting 07:05:05 (3502): No heartbeat from core client for 30 sec - exiting 07:05:06 (3502): No heartbeat from core client for 30 sec - exiting 07:05:07 (3502): No heartbeat from core client for 30 sec - exiting 07:05:08 (3502): No heartbeat from core client for 30 sec - exiting 07:05:09 (3502): No heartbeat from core client for 30 sec - exiting 07:05:10 (3502): No heartbeat from core client for 30 sec - exiting 07:05:11 (3502): No heartbeat from core client for 30 sec - exiting 07:05:12 (3502): No heartbeat from core client for 30 sec - exiting 07:05:13 (3502): No heartbeat from core client for 30 sec - exiting 07:05:14 (3502): No heartbeat from core client for 30 sec - exiting 07:05:15 (3502): No heartbeat from core client for 30 sec - exiting 07:05:16 (3502): No heartbeat from core client for 30 sec - exiting 07:05:17 (3502): No heartbeat from core client for 30 sec - exiting 07:05:18 (3502): No heartbeat from core client for 30 sec - exiting 07:05:19 (3502): No heartbeat from core client for 30 sec - exiting 07:05:20 (3502): No heartbeat from core client for 30 sec - exiting 07:05:21 (3502): No heartbeat from core client for 30 sec - exiting 07:05:22 (3502): No heartbeat from core client for 30 sec - exiting 07:05:23 (3502): No heartbeat from core client for 30 sec - exiting 07:05:24 (3502): No heartbeat from core client for 30 sec - exiting 07:05:25 (3502): No heartbeat from core client for 30 sec - exiting 07:10:24 (3502): No heartbeat from core client for 30 sec - exiting * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08d19368 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09415368 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08b42368 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09248368 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x086ea368 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char ) &((av)->bins[((1) - 1) 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) \|\| ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Nov 2012 04:28:33	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	518,400	761,742	1.4694
13 Nov 2012 17:24:41	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	492,480	723,313	1.4687
12 Nov 2012 23:12:04	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	466,560	685,758	1.4698
12 Nov 2012 12:07:45	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	440,640	647,379	1.4692
12 Nov 2012 00:26:22	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	414,720	608,875	1.4682
11 Nov 2012 09:47:45	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	388,800	569,175	1.4639
10 Nov 2012 16:36:54	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	362,880	530,974	1.4632
09 Nov 2012 22:34:13	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	336,960	492,986	1.4630
09 Nov 2012 04:49:49	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	311,040	455,149	1.4633
08 Nov 2012 07:44:25	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	285,120	417,390	1.4639
07 Nov 2012 08:17:35	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	259,200	379,429	1.4638
05 Nov 2012 21:18:40	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	233,280	342,201	1.4669
05 Nov 2012 10:43:26	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	207,360	305,459	1.4731
04 Nov 2012 15:01:28	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	181,440	268,310	1.4788
03 Nov 2012 01:13:46	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	155,520	229,811	1.4777
02 Nov 2012 08:34:53	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	129,600	189,702	1.4638
01 Nov 2012 18:26:47	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	103,680	150,434	1.4509
01 Nov 2012 07:31:18	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	77,760	112,396	1.4454
31 Oct 2012 19:03:07	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	51,840	74,427	1.4357
31 Oct 2012 05:03:23	1244759	15420030	hadcm3n_zjhf_1880_40_008242874_1	25,920	37,519	1.4475