Task 13788410

Name	hadcm3n_t4go_1940_40_007446331_4
Workunit	7643834
Created	16 Dec 2011, 23:08:04 UTC
Sent	16 Dec 2011, 23:08:06 UTC
Report deadline	17 Mar 2012, 6:35:17 UTC
Received	26 Jan 2012, 17:27:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1185308
Run time	13 days 10 hours 15 min 47 sec
CPU time	12 days 15 hours 27 min 13 sec
Validate state	Invalid
Credit	5,909.76
Device peak FLOPS	2.60 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:21:26 (6512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:48 (6631): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:03 (6715): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:56 (6748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:31:39 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:32:32 (6840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:35:45 (6884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:36:37 (6921): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:37:30 (6959): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:38:23 (7002): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:16 (7034): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:40:09 (7081): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:04:31 (4738): No heartbeat from core client for 30 sec - exiting 11:04:42 (4738): No heartbeat from core client for 30 sec - exiting 11:04:43 (4738): No heartbeat from core client for 30 sec - exiting 11:04:44 (4738): No heartbeat from core client for 30 sec - exiting 11:04:45 (4738): No heartbeat from core client for 30 sec - exiting 11:04:46 (4738): No heartbeat from core client for 30 sec - exiting 11:04:48 (4738): No heartbeat from core client for 30 sec - exiting 11:04:49 (4738): No heartbeat from core client for 30 sec - exiting 11:04:52 (4738): No heartbeat from core client for 30 sec - exiting 11:04:53 (4738): No heartbeat from core client for 30 sec - exiting 11:04:54 (4738): No heartbeat from core client for 30 sec - exiting 11:04:55 (4738): No heartbeat from core client for 30 sec - exiting 11:04:56 (4738): No heartbeat from core client for 30 sec - exiting 11:04:57 (4738): No heartbeat from core client for 30 sec - exiting 11:04:58 (4738): No heartbeat from core client for 30 sec - exiting 11:04:59 (4738): No heartbeat from core client for 30 sec - exiting 11:05:01 (4738): No heartbeat from core client for 30 sec - exiting 11:05:02 (4738): No heartbeat from core client for 30 sec - exiting 11:05:03 (4738): No heartbeat from core client for 30 sec - exiting 11:05:04 (4738): No heartbeat from core client for 30 sec - exiting 11:05:06 (4738): No heartbeat from core client for 30 sec - exiting 11:05:09 (4738): No heartbeat from core client for 30 sec - exiting 11:05:11 (4738): No heartbeat from core client for 30 sec - exiting 11:05:12 (4738): No heartbeat from core client for 30 sec - exiting 11:05:13 (4738): No heartbeat from core client for 30 sec - exiting 11:05:15 (4738): No heartbeat from core client for 30 sec - exiting 11:05:22 (4738): No heartbeat from core client for 30 sec - exiting 11:05:25 (4738): No heartbeat from core client for 30 sec - exiting 11:05:26 (4738): No heartbeat from core client for 30 sec - exiting 11:05:27 (4738): No heartbeat from core client for 30 sec - exiting 11:05:28 (4738): No heartbeat from core client for 30 sec - exiting 11:05:29 (4738): No heartbeat from core client for 30 sec - exiting 11:05:30 (4738): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:31 (4738): No heartbeat from core client for 30 sec - exiting 11:06:57 (5388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:21:55 (8621): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:20 (9426): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:26:06 (9582): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:13 (9679): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:01 (9725): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:31 (9782): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:18 (9829): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:04 (9874): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:50 (9921): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:36 (9964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:22 (10009): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:08 (10053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:54 (10096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:40 (10141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:37:26 (10185): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:12 (10228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:58 (10272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:44 (16225): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:31 (16269): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:16 (16313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:02 (16357): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:08 (16425): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:56 (16470): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:41 (16512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:27 (16558): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:14 (16602): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:59 (16645): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:46 (16688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:31 (16732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:18 (16777): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:03 (16820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:50 (16863): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:36 (16906): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:22 (16950): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:08 (16994): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:54 (17038): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:41 (17082): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:56:37 (17125): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:46:32 (1790): No heartbeat from core client for 30 sec - exiting 09:46:34 (1790): No heartbeat from core client for 30 sec - exiting 09:46:35 (1790): No heartbeat from core client for 30 sec - exiting 09:46:36 (1790): No heartbeat from core client for 30 sec - exiting 09:46:37 (1790): No heartbeat from core client for 30 sec - exiting 09:46:38 (1790): No heartbeat from core client for 30 sec - exiting 09:46:39 (1790): No heartbeat from core client for 30 sec - exiting 09:46:40 (1790): No heartbeat from core client for 30 sec - exiting 09:46:41 (1790): No heartbeat from core client for 30 sec - exiting 09:46:42 (1790): No heartbeat from core client for 30 sec - exiting 09:46:43 (1790): No heartbeat from core client for 30 sec - exiting 09:46:44 (1790): No heartbeat from core client for 30 sec - exiting 09:46:45 (1790): No heartbeat from core client for 30 sec - exiting 09:46:46 (1790): No heartbeat from core client for 30 sec - exiting 09:46:47 (1790): No heartbeat from core client for 30 sec - exiting 09:46:48 (1790): No heartbeat from core client for 30 sec - exiting 09:46:49 (1790): No heartbeat from core client for 30 sec - exiting 09:46:50 (1790): No heartbeat from core client for 30 sec - exiting 09:46:51 (1790): No heartbeat from core client for 30 sec - exiting 09:46:52 (1790): No heartbeat from core client for 30 sec - exiting 09:46:53 (1790): No heartbeat from core client for 30 sec - exiting 09:46:54 (1790): No heartbeat from core client for 30 sec - exiting 09:46:55 (1790): No heartbeat from core client for 30 sec - exiting 09:46:57 (1790): No heartbeat from core client for 30 sec - exiting 09:46:58 (1790): No heartbeat from core client for 30 sec - exiting 09:46:59 (1790): No heartbeat from core client for 30 sec - exiting 09:47:00 (1790): No heartbeat from core client for 30 sec - exiting 09:47:01 (1790): No heartbeat from core client for 30 sec - exiting 09:47:02 (1790): No heartbeat from core client for 30 sec - exiting 09:47:04 (1790): No heartbeat from core client for 30 sec - exiting 09:47:05 (1790): No heartbeat from core client for 30 sec - exiting 09:47:10 (1790): No heartbeat from core client for 30 sec - exiting 09:47:11 (1790): No heartbeat from core client for 30 sec - exiting 09:47:12 (1790): No heartbeat from core client for 30 sec - exiting 09:47:15 (1790): No heartbeat from core client for 30 sec - exiting 09:47:16 (1790): No heartbeat from core client for 30 sec - exiting 09:47:17 (1790): No heartbeat from core client for 30 sec - exiting 09:47:18 (1790): No heartbeat from core client for 30 sec - exiting 09:47:20 (1790): No heartbeat from core client for 30 sec - exiting 09:47:21 (1790): No heartbeat from core client for 30 sec - exiting 09:47:22 (1790): No heartbeat from core client for 30 sec - exiting 09:47:23 (1790): No heartbeat from core client for 30 sec - exiting 09:47:24 (1790): No heartbeat from core client for 30 sec - exiting 09:47:25 (1790): No heartbeat from core client for 30 sec - exiting 09:47:26 (1790): No heartbeat from core client for 30 sec - exiting 09:47:27 (1790): No heartbeat from core client for 30 sec - exiting 09:47:28 (1790): No heartbeat from core client for 30 sec - exiting 09:47:29 (1790): No heartbeat from core client for 30 sec - exiting 09:47:30 (1790): No heartbeat from core client for 30 sec - exiting 09:47:31 (1790): No heartbeat from core client for 30 sec - exiting 09:47:32 (1790): No heartbeat from core client for 30 sec - exiting 09:47:33 (1790): No heartbeat from core client for 30 sec - exiting 09:47:34 (1790): No heartbeat from core client for 30 sec - exiting 09:47:35 (1790): No heartbeat from core client for 30 sec - exiting 09:47:36 (1790): No heartbeat from core client for 30 sec - exiting 09:47:37 (1790): No heartbeat from core client for 30 sec - exiting 09:47:39 (1790): No heartbeat from core client for 30 sec - exiting 09:47:41 (1790): No heartbeat from core client for 30 sec - exiting 09:47:42 (1790): No heartbeat from core client for 30 sec - exiting 09:47:43 (1790): No heartbeat from core client for 30 sec - exiting 09:47:44 (1790): No heartbeat from core client for 30 sec - exiting 09:47:45 (1790): No heartbeat from core client for 30 sec - exiting 09:47:46 (1790): No heartbeat from core client for 30 sec - exiting 09:47:53 (1790): No heartbeat from core client for 30 sec - exiting 09:48:04 (1790): No heartbeat from core client for 30 sec - exiting 09:48:07 (1790): No heartbeat from core client for 30 sec - exiting 09:48:09 (1790): No heartbeat from core client for 30 sec - exiting 09:48:10 (1790): No heartbeat from core client for 30 sec - exiting 09:48:22 (1790): No heartbeat from core client for 30 sec - exiting 09:48:30 (1790): No heartbeat from core client for 30 sec - exiting 09:48:37 (1790): No heartbeat from core client for 30 sec - exiting 09:48:48 (1790): No heartbeat from core client for 30 sec - exiting 09:48:49 (1790): No heartbeat from core client for 30 sec - exiting 09:48:50 (1790): No heartbeat from core client for 30 sec - exiting 09:48:51 (1790): No heartbeat from core client for 30 sec - exiting 09:48:52 (1790): No heartbeat from core client for 30 sec - exiting 09:48:53 (1790): No heartbeat from core client for 30 sec - exiting 09:48:54 (1790): No heartbeat from core client for 30 sec - exiting 09:48:56 (1790): No heartbeat from core client for 30 sec - exiting 09:48:57 (1790): No heartbeat from core client for 30 sec - exiting 09:48:58 (1790): No heartbeat from core client for 30 sec - exiting 09:48:59 (1790): No heartbeat from core client for 30 sec - exiting 09:49:00 (1790): No heartbeat from core client for 30 sec - exiting 09:49:01 (1790): No heartbeat from core client for 30 sec - exiting 09:49:02 (1790): No heartbeat from core client for 30 sec - exiting 09:49:05 (1790): No heartbeat from core client for 30 sec - exiting 09:49:06 (1790): No heartbeat from core client for 30 sec - exiting 09:49:07 (1790): No heartbeat from core client for 30 sec - exiting 09:49:08 (1790): No heartbeat from core client for 30 sec - exiting 09:49:09 (1790): No heartbeat from core client for 30 sec - exiting 09:49:10 (1790): No heartbeat from core client for 30 sec - exiting 09:49:11 (1790): No heartbeat from core client for 30 sec - exiting 09:49:15 (1790): No heartbeat from core client for 30 sec - exiting 09:49:16 (1790): No heartbeat from core client for 30 sec - exiting 09:49:17 (1790): No heartbeat from core client for 30 sec - exiting 09:49:18 (1790): No heartbeat from core client for 30 sec - exiting 09:49:19 (1790): No heartbeat from core client for 30 sec - exiting 09:49:20 (1790): No heartbeat from core client for 30 sec - exiting 09:49:21 (1790): No heartbeat from core client for 30 sec - exiting 09:49:22 (1790): No heartbeat from core client for 30 sec - exiting 09:49:23 (1790): No heartbeat from core client for 30 sec - exiting 09:49:24 (1790): No heartbeat from core client for 30 sec - exiting 09:49:25 (1790): No heartbeat from core client for 30 sec - exiting 09:49:26 (1790): No heartbeat from core client for 30 sec - exiting 09:49:27 (1790): No heartbeat from core client for 30 sec - exiting 09:49:28 (1790): No heartbeat from core client for 30 sec - exiting 09:49:29 (1790): No heartbeat from core client for 30 sec - exiting 09:49:30 (1790): No heartbeat from core client for 30 sec - exiting 09:49:31 (1790): No heartbeat from core client for 30 sec - exiting 09:49:32 (1790): No heartbeat from core client for 30 sec - exiting 09:49:33 (1790): No heartbeat from core client for 30 sec - exiting 09:49:34 (1790): No heartbeat from core client for 30 sec - exiting 09:49:35 (1790): No heartbeat from core client for 30 sec - exiting 09:49:36 (1790): No heartbeat from core client for 30 sec - exiting 09:49:38 (1790): No heartbeat from core client for 30 sec - exiting 09:49:39 (1790): No heartbeat from core client for 30 sec - exiting 09:49:40 (1790): No heartbeat from core client for 30 sec - exiting 09:49:41 (1790): No heartbeat from core client for 30 sec - exiting 09:49:42 (1790): No heartbeat from core client for 30 sec - exiting 09:49:43 (1790): No heartbeat from core client for 30 sec - exiting 09:49:44 (1790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf771d400] [0xf771d430] /lib32/libc.so.6(gsignal+0x4f)[0xf755cc4f] /lib32/libc.so.6(abort+0x175)[0xf7560175] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf75480f3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19370, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf774b400] [0xf774b430] /lib32/libc.so.6(gsignal+0x4f)[0xf758ac4f] /lib32/libc.so.6(abort+0x175)[0xf758e175] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf75760f3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19370, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf777c400] [0xf777c430] /lib32/libc.so.6(gsignal+0x4f)[0xf75bbc4f] /lib32/libc.so.6(abort+0x175)[0xf75bf175] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf75a70f3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19370, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7764400] [0xf7764430] /lib32/libc.so.6(gsignal+0x4f)[0xf75a3c4f] /lib32/libc.so.6(abort+0x175)[0xf75a7175] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf758f0f3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19370, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7705400] [0xf7705430] /lib32/libc.so.6(gsignal+0x4f)[0xf7544c4f] /lib32/libc.so.6(abort+0x175)[0xf7548175] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf75300f3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19370, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf775a400] [0xf775a430] /lib32/libc.so.6(gsignal+0x4f)[0xf7599c4f] /lib32/libc.so.6(abort+0x175)[0xf759d175] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf75850f3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19370, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jan 2012 07:49:56	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	492,480	1,043,523	2.1189
24 Jan 2012 05:04:46	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	466,560	987,587	2.1167
23 Jan 2012 00:28:25	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	440,640	931,791	2.1146
21 Jan 2012 20:28:03	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	414,720	875,715	2.1116
20 Jan 2012 20:17:00	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	388,800	819,541	2.1079
19 Jan 2012 07:46:19	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	362,880	763,380	2.1037
18 Jan 2012 00:22:10	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	336,960	706,973	2.0981
16 Jan 2012 12:26:03	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	311,040	650,609	2.0917
15 Jan 2012 14:41:40	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	285,120	594,144	2.0838
14 Jan 2012 10:27:30	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	259,200	537,836	2.0750
29 Dec 2011 16:56:27	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	233,280	487,988	2.0919
29 Dec 2011 16:56:27	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	207,360	442,404	2.1335
29 Dec 2011 16:56:27	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	181,440	387,601	2.1362
29 Dec 2011 16:56:26	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	155,520	332,339	2.1370
29 Dec 2011 16:56:26	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	129,600	277,063	2.1378
29 Dec 2011 16:56:27	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	103,680	221,614	2.1375
29 Dec 2011 16:56:27	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	77,760	166,286	2.1385
29 Dec 2011 16:56:26	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	51,840	111,061	2.1424
29 Dec 2011 16:56:26	1185308	13788410	hadcm3n_t4go_1940_40_007446331_4	25,920	55,765	2.1514