climateprediction.net home page
Task 13011699

Task 13011699

Name hadcm3n_t052_1940_40_007310635_0
Workunit 7508065
Created 27 Jun 2011, 17:06:56 UTC
Sent 27 Jun 2011, 17:32:49 UTC
Report deadline 27 Sep 2011, 1:00:00 UTC
Received 3 Aug 2011, 20:07:42 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1084958
Run time 21 days 22 hours 27 min 29 sec
CPU time 19 days 7 hours 43 min 32 sec
Validate state Invalid
Credit 7,153.92
Device peak FLOPS 2.52 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
04:12:52 (6246): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:07:30 (6987): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  2048    

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  2048    
07:18:21 (7223): Can't acquire lockfile (-154) - waiting 35s
07:18:56 (7223): Can't acquire lockfile (-154) - exiting
07:18:59 (7250): Can't acquire lockfile (-154) - waiting 35s
07:19:34 (7250): Can't acquire lockfile (-154) - exiting
07:19:34 (7258): Can't acquire lockfile (-154) - waiting 35s
07:20:09 (7258): Can't acquire lockfile (-154) - exiting
07:20:10 (7299): Can't acquire lockfile (-154) - waiting 35s
07:20:45 (7299): Can't acquire lockfile (-154) - exiting
07:20:45 (7310): Can't acquire lockfile (-154) - waiting 35s
07:21:20 (7310): Can't acquire lockfile (-154) - exiting
07:21:20 (7314): Can't acquire lockfile (-154) - waiting 35s
07:21:55 (7314): Can't acquire lockfile (-154) - exiting
07:21:55 (7318): Can't acquire lockfile (-154) - waiting 35s
07:22:30 (7318): Can't acquire lockfile (-154) - exiting
07:22:31 (7322): Can't acquire lockfile (-154) - waiting 35s
07:23:06 (7322): Can't acquire lockfile (-154) - exiting
07:23:06 (7326): Can't acquire lockfile (-154) - waiting 35s
07:23:41 (7326): Can't acquire lockfile (-154) - exiting
07:23:42 (7330): Can't acquire lockfile (-154) - waiting 35s
07:24:17 (7330): Can't acquire lockfile (-154) - exiting
07:24:17 (7334): Can't acquire lockfile (-154) - waiting 35s
07:24:52 (7334): Can't acquire lockfile (-154) - exiting
07:24:52 (7338): Can't acquire lockfile (-154) - waiting 35s
07:25:27 (7338): Can't acquire lockfile (-154) - exiting
07:25:28 (7342): Can't acquire lockfile (-154) - waiting 35s
07:26:03 (7342): Can't acquire lockfile (-154) - exiting
07:26:04 (7346): Can't acquire lockfile (-154) - waiting 35s
07:26:39 (7346): Can't acquire lockfile (-154) - exiting
07:26:39 (7353): Can't acquire lockfile (-154) - waiting 35s
07:27:14 (7353): Can't acquire lockfile (-154) - exiting
07:27:14 (7357): Can't acquire lockfile (-154) - waiting 35s
07:27:49 (7357): Can't acquire lockfile (-154) - exiting
07:27:50 (7361): Can't acquire lockfile (-154) - waiting 35s
07:28:25 (7361): Can't acquire lockfile (-154) - exiting
07:28:25 (7365): Can't acquire lockfile (-154) - waiting 35s
07:29:00 (7365): Can't acquire lockfile (-154) - exiting
07:29:00 (7369): Can't acquire lockfile (-154) - waiting 35s
07:29:35 (7369): Can't acquire lockfile (-154) - exiting
07:29:35 (7373): Can't acquire lockfile (-154) - waiting 35s
07:30:10 (7373): Can't acquire lockfile (-154) - exiting
07:30:12 (7383): Can't acquire lockfile (-154) - waiting 35s
07:30:47 (7383): Can't acquire lockfile (-154) - exiting
07:30:47 (7387): Can't acquire lockfile (-154) - waiting 35s
07:31:22 (7387): Can't acquire lockfile (-154) - exiting
07:31:23 (7391): Can't acquire lockfile (-154) - waiting 35s
07:31:58 (7391): Can't acquire lockfile (-154) - exiting
07:32:00 (7396): Can't acquire lockfile (-154) - waiting 35s
07:32:35 (7396): Can't acquire lockfile (-154) - exiting
07:32:36 (7400): Can't acquire lockfile (-154) - waiting 35s
07:33:11 (7400): Can't acquire lockfile (-154) - exiting
07:33:11 (7404): Can't acquire lockfile (-154) - waiting 35s
07:33:46 (7404): Can't acquire lockfile (-154) - exiting
07:33:46 (7408): Can't acquire lockfile (-154) - waiting 35s
07:34:21 (7408): Can't acquire lockfile (-154) - exiting
07:34:22 (7412): Can't acquire lockfile (-154) - waiting 35s
07:34:57 (7412): Can't acquire lockfile (-154) - exiting
07:34:57 (7416): Can't acquire lockfile (-154) - waiting 35s
07:35:32 (7416): Can't acquire lockfile (-154) - exiting
07:35:33 (7450): Can't acquire lockfile (-154) - waiting 35s
07:36:08 (7450): Can't acquire lockfile (-154) - exiting
07:36:08 (7454): Can't acquire lockfile (-154) - waiting 35s
07:36:44 (7454): Can't acquire lockfile (-154) - exiting
07:36:44 (7462): Can't acquire lockfile (-154) - waiting 35s
07:37:19 (7462): Can't acquire lockfile (-154) - exiting
07:37:20 (7466): Can't acquire lockfile (-154) - waiting 35s
07:37:55 (7466): Can't acquire lockfile (-154) - exiting
07:37:55 (7470): Can't acquire lockfile (-154) - waiting 35s
07:38:30 (7470): Can't acquire lockfile (-154) - exiting
07:38:31 (7474): Can't acquire lockfile (-154) - waiting 35s
07:39:06 (7474): Can't acquire lockfile (-154) - exiting
07:39:06 (7478): Can't acquire lockfile (-154) - waiting 35s
07:39:41 (7478): Can't acquire lockfile (-154) - exiting
07:39:41 (7482): Can't acquire lockfile (-154) - waiting 35s
07:40:16 (7482): Can't acquire lockfile (-154) - exiting
07:40:16 (7486): Can't acquire lockfile (-154) - waiting 35s
07:40:51 (7486): Can't acquire lockfile (-154) - exiting
07:40:52 (7490): Can't acquire lockfile (-154) - waiting 35s
07:41:27 (7490): Can't acquire lockfile (-154) - exiting
07:41:27 (7494): Can't acquire lockfile (-154) - waiting 35s
07:42:02 (7494): Can't acquire lockfile (-154) - exiting
07:42:03 (7498): Can't acquire lockfile (-154) - waiting 35s
07:42:38 (7498): Can't acquire lockfile (-154) - exiting
07:42:38 (7502): Can't acquire lockfile (-154) - waiting 35s
07:43:13 (7502): Can't acquire lockfile (-154) - exiting
07:43:14 (7506): Can't acquire lockfile (-154) - waiting 35s
07:43:49 (7506): Can't acquire lockfile (-154) - exiting
07:43:49 (7510): Can't acquire lockfile (-154) - waiting 35s
07:44:24 (7510): Can't acquire lockfile (-154) - exiting
07:44:24 (7558): Can't acquire lockfile (-154) - waiting 35s
07:44:59 (7558): Can't acquire lockfile (-154) - exiting
07:45:00 (7642): Can't acquire lockfile (-154) - waiting 35s
07:45:35 (7642): Can't acquire lockfile (-154) - exiting
07:45:35 (7653): Can't acquire lockfile (-154) - waiting 35s
07:46:10 (7653): Can't acquire lockfile (-154) - exiting
07:46:11 (7657): Can't acquire lockfile (-154) - waiting 35s
07:46:46 (7657): Can't acquire lockfile (-154) - exiting
07:46:47 (7665): Can't acquire lockfile (-154) - waiting 35s
07:47:22 (7665): Can't acquire lockfile (-154) - exiting
07:47:22 (7669): Can't acquire lockfile (-154) - waiting 35s
07:47:57 (7669): Can't acquire lockfile (-154) - exiting
07:47:58 (7673): Can't acquire lockfile (-154) - waiting 35s
07:48:33 (7673): Can't acquire lockfile (-154) - exiting
07:48:34 (7677): Can't acquire lockfile (-154) - waiting 35s
07:49:09 (7677): Can't acquire lockfile (-154) - exiting
07:49:10 (7681): Can't acquire lockfile (-154) - waiting 35s
07:49:45 (7681): Can't acquire lockfile (-154) - exiting
07:49:45 (7685): Can't acquire lockfile (-154) - waiting 35s
07:50:20 (7685): Can't acquire lockfile (-154) - exiting
07:50:20 (7689): Can't acquire lockfile (-154) - waiting 35s
07:50:55 (7689): Can't acquire lockfile (-154) - exiting
07:50:56 (7693): Can't acquire lockfile (-154) - waiting 35s
07:51:31 (7693): Can't acquire lockfile (-154) - exiting
07:51:32 (7738): Can't acquire lockfile (-154) - waiting 35s
07:52:07 (7738): Can't acquire lockfile (-154) - exiting
07:52:07 (7742): Can't acquire lockfile (-154) - waiting 35s
07:52:42 (7742): Can't acquire lockfile (-154) - exiting
07:52:43 (7746): Can't acquire lockfile (-154) - waiting 35s
07:53:18 (7746): Can't acquire lockfile (-154) - exiting
07:53:18 (7750): Can't acquire lockfile (-154) - waiting 35s
07:53:53 (7750): Can't acquire lockfile (-154) - exiting
07:53:53 (7754): Can't acquire lockfile (-154) - waiting 35s
07:54:29 (7754): Can't acquire lockfile (-154) - exiting
07:54:30 (7758): Can't acquire lockfile (-154) - waiting 35s
07:55:05 (7758): Can't acquire lockfile (-154) - exiting
07:55:05 (7762): Can't acquire lockfile (-154) - waiting 35s
07:55:40 (7762): Can't acquire lockfile (-154) - exiting
07:55:40 (7766): Can't acquire lockfile (-154) - waiting 35s
07:56:15 (7766): Can't acquire lockfile (-154) - exiting
07:56:16 (7770): Can't acquire lockfile (-154) - waiting 35s
07:56:51 (7770): Can't acquire lockfile (-154) - exiting
07:56:51 (7778): Can't acquire lockfile (-154) - waiting 35s
07:57:26 (7778): Can't acquire lockfile (-154) - exiting
07:57:26 (7782): Can't acquire lockfile (-154) - waiting 35s
07:58:01 (7782): Can't acquire lockfile (-154) - exiting
07:58:02 (7786): Can't acquire lockfile (-154) - waiting 35s
07:58:37 (7786): Can't acquire lockfile (-154) - exiting
07:58:37 (7790): Can't acquire lockfile (-154) - waiting 35s
07:59:12 (7790): Can't acquire lockfile (-154) - exiting
07:59:13 (7794): Can't acquire lockfile (-154) - waiting 35s
07:59:48 (7794): Can't acquire lockfile (-154) - exiting
07:59:48 (7798): Can't acquire lockfile (-154) - waiting 35s
08:00:23 (7798): Can't acquire lockfile (-154) - exiting
08:00:24 (7802): Can't acquire lockfile (-154) - waiting 35s
08:00:59 (7802): Can't acquire lockfile (-154) - exiting
08:00:59 (7806): Can't acquire lockfile (-154) - waiting 35s
08:01:35 (7806): Can't acquire lockfile (-154) - exiting
08:01:35 (7810): Can't acquire lockfile (-154) - waiting 35s
08:02:10 (7810): Can't acquire lockfile (-154) - exiting
08:02:11 (7815): Can't acquire lockfile (-154) - waiting 35s
08:02:46 (7815): Can't acquire lockfile (-154) - exiting
08:02:47 (7819): Can't acquire lockfile (-154) - waiting 35s
08:03:22 (7819): Can't acquire lockfile (-154) - exiting
08:03:22 (7825): Can't acquire lockfile (-154) - waiting 35s
08:03:57 (7825): Can't acquire lockfile (-154) - exiting
08:03:58 (7829): Can't acquire lockfile (-154) - waiting 35s
08:04:33 (7829): Can't acquire lockfile (-154) - exiting
08:04:33 (7833): Can't acquire lockfile (-154) - waiting 35s
08:05:08 (7833): Can't acquire lockfile (-154) - exiting
08:05:08 (7837): Can't acquire lockfile (-154) - waiting 35s
08:05:43 (7837): Can't acquire lockfile (-154) - exiting
08:05:44 (7841): Can't acquire lockfile (-154) - waiting 35s
08:06:19 (7841): Can't acquire lockfile (-154) - exiting
08:06:19 (7845): Can't acquire lockfile (-154) - waiting 35s
08:06:54 (7845): Can't acquire lockfile (-154) - exiting
08:06:54 (7853): Can't acquire lockfile (-154) - waiting 35s
08:07:30 (7853): Can't acquire lockfile (-154) - exiting
08:07:30 (7857): Can't acquire lockfile (-154) - waiting 35s
08:08:05 (7857): Can't acquire lockfile (-154) - exiting
08:08:06 (7861): Can't acquire lockfile (-154) - waiting 35s
08:08:41 (7861): Can't acquire lockfile (-154) - exiting
08:08:41 (7865): Can't acquire lockfile (-154) - waiting 35s
08:09:16 (7865): Can't acquire lockfile (-154) - exiting
08:09:16 (7869): Can't acquire lockfile (-154) - waiting 35s
08:09:51 (7869): Can't acquire lockfile (-154) - exiting
08:09:52 (7873): Can't acquire lockfile (-154) - waiting 35s
08:10:27 (7873): Can't acquire lockfile (-154) - exiting
08:10:27 (7877): Can't acquire lockfile (-154) - waiting 35s
08:11:02 (7877): Can't acquire lockfile (-154) - exiting
08:11:02 (7881): Can't acquire lockfile (-154) - waiting 35s
08:11:37 (7881): Can't acquire lockfile (-154) - exiting
08:11:37 (7885): Can't acquire lockfile (-154) - waiting 35s
08:12:12 (7885): Can't acquire lockfile (-154) - exiting
08:12:13 (7889): Can't acquire lockfile (-154) - waiting 35s
08:12:48 (7889): Can't acquire lockfile (-154) - exiting
08:12:48 (7893): Can't acquire lockfile (-154) - waiting 35s
08:13:23 (7893): Can't acquire lockfile (-154) - exiting
08:13:24 (7897): Can't acquire lockfile (-154) - waiting 35s
08:13:59 (7897): Can't acquire lockfile (-154) - exiting
08:13:59 (7901): Can't acquire lockfile (-154) - waiting 35s
08:14:34 (7901): Can't acquire lockfile (-154) - exiting
08:14:34 (7905): Can't acquire lockfile (-154) - waiting 35s
08:15:09 (7905): Can't acquire lockfile (-154) - exiting
08:15:10 (7909): Can't acquire lockfile (-154) - waiting 35s
08:15:45 (7909): Can't acquire lockfile (-154) - exiting
08:15:46 (7913): Can't acquire lockfile (-154) - waiting 35s
08:16:21 (7913): Can't acquire lockfile (-154) - exiting
08:16:22 (7917): Can't acquire lockfile (-154) - waiting 35s
08:16:57 (7917): Can't acquire lockfile (-154) - exiting
08:16:57 (7926): Can't acquire lockfile (-154) - waiting 35s
08:17:32 (7926): Can't acquire lockfile (-154) - exiting
08:17:32 (7934): Can't acquire lockfile (-154) - waiting 35s
08:18:07 (7934): Can't acquire lockfile (-154) - exiting
08:18:07 (7938): Can't acquire lockfile (-154) - waiting 35s
08:18:42 (7938): Can't acquire lockfile (-154) - exiting
08:18:43 (7942): Can't acquire lockfile (-154) - waiting 35s
08:19:18 (7942): Can't acquire lockfile (-154) - exiting
08:19:19 (7946): Can't acquire lockfile (-154) - waiting 35s
08:19:54 (7946): Can't acquire lockfile (-154) - exiting
08:19:54 (7950): Can't acquire lockfile (-154) - waiting 35s
08:20:29 (7950): Can't acquire lockfile (-154) - exiting
08:20:29 (7954): Can't acquire lockfile (-154) - waiting 35s
08:21:04 (7954): Can't acquire lockfile (-154) - exiting
08:21:05 (7958): Can't acquire lockfile (-154) - waiting 35s
08:21:40 (7958): Can't acquire lockfile (-154) - exiting
08:21:41 (7962): Can't acquire lockfile (-154) - waiting 35s
08:22:16 (7962): Can't acquire lockfile (-154) - exiting
08:22:16 (7966): Can't acquire lockfile (-154) - waiting 35s
08:22:51 (7966): Can't acquire lockfile (-154) - exiting
08:22:51 (7970): Can't acquire lockfile (-154) - waiting 35s
08:23:26 (7970): Can't acquire lockfile (-154) - exiting
08:23:26 (7974): Can't acquire lockfile (-154) - waiting 35s
08:24:01 (7974): Can't acquire lockfile (-154) - exiting
08:24:02 (7978): Can't acquire lockfile (-154) - waiting 35s
08:24:37 (7978): Can't acquire lockfile (-154) - exiting
08:24:37 (7982): Can't acquire lockfile (-154) - waiting 35s
08:25:12 (7982): Can't acquire lockfile (-154) - exiting
08:25:12 (7986): Can't acquire lockfile (-154) - waiting 35s
08:25:47 (7986): Can't acquire lockfile (-154) - exiting
08:25:48 (7990): Can't acquire lockfile (-154) - waiting 35s
08:26:23 (7990): Can't acquire lockfile (-154) - exiting
08:26:24 (7994): Can't acquire lockfile (-154) - waiting 35s
08:26:59 (7994): Can't acquire lockfile (-154) - exiting
08:26:59 (8002): Can't acquire lockfile (-154) - waiting 35s
08:27:34 (8002): Can't acquire lockfile (-154) - exiting
08:27:34 (8006): Can't acquire lockfile (-154) - waiting 35s
08:28:09 (8006): Can't acquire lockfile (-154) - exiting
08:28:10 (8010): Can't acquire lockfile (-154) - waiting 35s
08:28:45 (8010): Can't acquire lockfile (-154) - exiting
08:28:45 (8014): Can't acquire lockfile (-154) - waiting 35s
08:29:20 (8014): Can't acquire lockfile (-154) - exiting
08:29:21 (8018): Can't acquire lockfile (-154) - waiting 35s
08:29:56 (8018): Can't acquire lockfile (-154) - exiting
08:29:56 (8022): Can't acquire lockfile (-154) - waiting 35s
08:30:31 (8022): Can't acquire lockfile (-154) - exiting
08:30:32 (8026): Can't acquire lockfile (-154) - waiting 35s
08:31:07 (8026): Can't acquire lockfile (-154) - exiting
08:31:07 (8030): Can't acquire lockfile (-154) - waiting 35s
08:31:42 (8030): Can't acquire lockfile (-154) - exiting
08:31:42 (8034): Can't acquire lockfile (-154) - waiting 35s
08:32:17 (8034): Can't acquire lockfile (-154) - exiting
08:32:18 (8039): Can't acquire lockfile (-154) - waiting 35s
08:32:53 (8039): Can't acquire lockfile (-154) - exiting
08:32:53 (8043): Can't acquire lockfile (-154) - waiting 35s
08:33:28 (8043): Can't acquire lockfile (-154) - exiting
08:33:29 (8047): Can't acquire lockfile (-154) - waiting 35s
08:34:04 (8047): Can't acquire lockfile (-154) - exiting
08:34:04 (8051): Can't acquire lockfile (-154) - waiting 35s
08:34:39 (8051): Can't acquire lockfile (-154) - exiting
08:34:39 (8055): Can't acquire lockfile (-154) - waiting 35s
08:35:14 (8055): Can't acquire lockfile (-154) - exiting
08:35:14 (8059): Can't acquire lockfile (-154) - waiting 35s
08:35:49 (8059): Can't acquire lockfile (-154) - exiting
08:35:50 (8063): Can't acquire lockfile (-154) - waiting 35s
08:36:25 (8063): Can't acquire lockfile (-154) - exiting
08:36:25 (8067): Can't acquire lockfile (-154) - waiting 35s
08:37:00 (8067): Can't acquire lockfile (-154) - exiting
08:37:01 (8075): Can't acquire lockfile (-154) - waiting 35s
08:37:36 (8075): Can't acquire lockfile (-154) - exiting
08:37:36 (8079): Can't acquire lockfile (-154) - waiting 35s
08:38:11 (8079): Can't acquire lockfile (-154) - exiting
08:38:12 (8083): Can't acquire lockfile (-154) - waiting 35s
08:38:47 (8083): Can't acquire lockfile (-154) - exiting
08:38:47 (8087): Can't acquire lockfile (-154) - waiting 35s
08:39:22 (8087): Can't acquire lockfile (-154) - exiting
08:39:22 (8091): Can't acquire lockfile (-154) - waiting 35s
08:39:57 (8091): Can't acquire lockfile (-154) - exiting
08:39:58 (8095): Can't acquire lockfile (-154) - waiting 35s
08:40:33 (8095): Can't acquire lockfile (-154) - exiting
08:40:33 (8099): Can't acquire lockfile (-154) - waiting 35s
08:41:08 (8099): Can't acquire lockfile (-154) - exiting
08:41:09 (8103): Can't acquire lockfile (-154) - waiting 35s
08:41:44 (8103): Can't acquire lockfile (-154) - exiting
08:41:44 (8107): Can't acquire lockfile (-154) - waiting 35s
08:42:19 (8107): Can't acquire lockfile (-154) - exiting
08:42:20 (8111): Can't acquire lockfile (-154) - waiting 35s
08:42:55 (8111): Can't acquire lockfile (-154) - exiting
08:42:55 (8115): Can't acquire lockfile (-154) - waiting 35s
08:43:30 (8115): Can't acquire lockfile (-154) - exiting
08:43:30 (8119): Can't acquire lockfile (-154) - waiting 35s
08:44:05 (8119): Can't acquire lockfile (-154) - exiting
08:44:05 (8123): Can't acquire lockfile (-154) - waiting 35s
08:44:41 (8123): Can't acquire lockfile (-154) - exiting
08:44:41 (8127): Can't acquire lockfile (-154) - waiting 35s
08:45:16 (8127): Can't acquire lockfile (-154) - exiting
08:45:16 (8131): Can't acquire lockfile (-154) - waiting 35s
08:45:51 (8131): Can't acquire lockfile (-154) - exiting
08:45:51 (8135): Can't acquire lockfile (-154) - waiting 35s
08:46:26 (8135): Can't acquire lockfile (-154) - exiting
08:46:27 (8139): Can't acquire lockfile (-154) - waiting 35s
08:47:02 (8139): Can't acquire lockfile (-154) - exiting
08:47:02 (8149): Can't acquire lockfile (-154) - waiting 35s
08:47:37 (8149): Can't acquire lockfile (-154) - exiting
08:47:37 (8153): Can't acquire lockfile (-154) - waiting 35s
08:48:12 (8153): Can't acquire lockfile (-154) - exiting
08:48:13 (8157): Can't acquire lockfile (-154) - waiting 35s
08:48:48 (8157): Can't acquire lockfile (-154) - exiting
08:48:48 (8161): Can't acquire lockfile (-154) - waiting 35s
08:49:23 (8161): Can't acquire lockfile (-154) - exiting
08:49:23 (8165): Can't acquire lockfile (-154) - waiting 35s
08:49:58 (8165): Can't acquire lockfile (-154) - exiting
08:49:59 (8169): Can't acquire lockfile (-154) - waiting 35s
08:50:34 (8169): Can't acquire lockfile (-154) - exiting
08:50:34 (8173): Can't acquire lockfile (-154) - waiting 35s
08:51:09 (8173): Can't acquire lockfile (-154) - exiting
08:51:09 (8177): Can't acquire lockfile (-154) - waiting 35s
08:51:44 (8177): Can't acquire lockfile (-154) - exiting
08:51:45 (8181): Can't acquire lockfile (-154) - waiting 35s
08:52:20 (8181): Can't acquire lockfile (-154) - exiting
08:52:21 (8185): Can't acquire lockfile (-154) - waiting 35s
08:52:56 (8185): Can't acquire lockfile (-154) - exiting
08:52:57 (8189): Can't acquire lockfile (-154) - waiting 35s
08:53:32 (8189): Can't acquire lockfile (-154) - exiting
08:53:32 (8193): Can't acquire lockfile (-154) - waiting 35s
08:54:07 (8193): Can't acquire lockfile (-154) - exiting
08:54:07 (8197): Can't acquire lockfile (-154) - waiting 35s
08:54:42 (8197): Can't acquire lockfile (-154) - exiting
08:54:43 (8201): Can't acquire lockfile (-154) - waiting 35s
08:55:18 (8201): Can't acquire lockfile (-154) - exiting
08:55:18 (8205): Can't acquire lockfile (-154) - waiting 35s
08:55:53 (8205): Can't acquire lockfile (-154) - exiting
08:55:53 (8209): Can't acquire lockfile (-154) - waiting 35s
08:56:28 (8209): Can't acquire lockfile (-154) - exiting
08:56:29 (8213): Can't acquire lockfile (-154) - waiting 35s
08:57:04 (8213): Can't acquire lockfile (-154) - exiting
08:57:04 (8221): Can't acquire lockfile (-154) - waiting 35s
08:57:39 (8221): Can't acquire lockfile (-154) - exiting
08:57:40 (8225): Can't acquire lockfile (-154) - waiting 35s
08:58:15 (8225): Can't acquire lockfile (-154) - exiting
08:58:16 (8229): Can't acquire lockfile (-154) - waiting 35s
08:58:51 (8229): Can't acquire lockfile (-154) - exiting
08:58:52 (8233): Can't acquire lockfile (-154) - waiting 35s
08:59:27 (8233): Can't acquire lockfile (-154) - exiting
08:59:27 (8237): Can't acquire lockfile (-154) - waiting 35s
09:00:02 (8237): Can't acquire lockfile (-154) - exiting
09:00:02 (8241): Can't acquire lockfile (-154) - waiting 35s
09:00:37 (8241): Can't acquire lockfile (-154) - exiting
09:00:38 (8245): Can't acquire lockfile (-154) - waiting 35s
09:01:13 (8245): Can't acquire lockfile (-154) - exiting
09:01:14 (8249): Can't acquire lockfile (-154) - waiting 35s
09:01:49 (8249): Can't acquire lockfile (-154) - exiting
09:01:49 (8254): Can't acquire lockfile (-154) - waiting 35s
09:02:24 (8254): Can't acquire lockfile (-154) - exiting
09:02:24 (8258): Can't acquire lockfile (-154) - waiting 35s
09:02:59 (8258): Can't acquire lockfile (-154) - exiting
09:02:59 (8262): Can't acquire lockfile (-154) - waiting 35s
09:03:34 (8262): Can't acquire lockfile (-154) - exiting
09:03:34 (8268): Can't acquire lockfile (-154) - waiting 35s
09:04:09 (8268): Can't acquire lockfile (-154) - exiting
09:04:10 (8272): Can't acquire lockfile (-154) - waiting 35s
09:04:45 (8272): Can't acquire lockfile (-154) - exiting
09:04:46 (8276): Can't acquire lockfile (-154) - waiting 35s
09:05:21 (8276): Can't acquire lockfile (-154) - exiting
09:05:21 (8280): Can't acquire lockfile (-154) - waiting 35s
09:05:56 (8280): Can't acquire lockfile (-154) - exiting
09:05:57 (8284): Can't acquire lockfile (-154) - waiting 35s
09:06:32 (8284): Can't acquire lockfile (-154) - exiting
09:06:32 (8288): Can't acquire lockfile (-154) - waiting 35s
09:07:07 (8288): Can't acquire lockfile (-154) - exiting
09:07:08 (8296): Can't acquire lockfile (-154) - waiting 35s
09:07:43 (8296): Can't acquire lockfile (-154) - exiting
09:07:43 (8300): Can't acquire lockfile (-154) - waiting 35s
09:08:18 (8300): Can't acquire lockfile (-154) - exiting
09:08:19 (8304): Can't acquire lockfile (-154) - waiting 35s
09:08:54 (8304): Can't acquire lockfile (-154) - exiting
09:08:54 (8308): Can't acquire lockfile (-154) - waiting 35s
09:09:29 (8308): Can't acquire lockfile (-154) - exiting
09:09:29 (8312): Can't acquire lockfile (-154) - waiting 35s
09:10:04 (8312): Can't acquire lockfile (-154) - exiting
09:10:05 (8316): Can't acquire lockfile (-154) - waiting 35s
09:10:40 (8316): Can't acquire lockfile (-154) - exiting
09:10:41 (8320): Can't acquire lockfile (-154) - waiting 35s
09:11:16 (8320): Can't acquire lockfile (-154) - exiting
09:11:16 (8324): Can't acquire lockfile (-154) - waiting 35s
09:11:51 (8324): Can't acquire lockfile (-154) - exiting
09:11:52 (8328): Can't acquire lockfile (-154) - waiting 35s
09:12:27 (8328): Can't acquire lockfile (-154) - exiting
09:12:27 (8332): Can't acquire lockfile (-154) - waiting 35s
09:13:02 (8332): Can't acquire lockfile (-154) - exiting
09:13:03 (8336): Can't acquire lockfile (-154) - waiting 35s
09:13:38 (8336): Can't acquire lockfile (-154) - exiting
09:13:38 (8340): Can't acquire lockfile (-154) - waiting 35s
09:14:13 (8340): Can't acquire lockfile (-154) - exiting
09:14:14 (8344): Can't acquire lockfile (-154) - waiting 35s
09:14:49 (8344): Can't acquire lockfile (-154) - exiting
09:14:49 (8348): Can't acquire lockfile (-154) - waiting 35s
09:15:24 (8348): Can't acquire lockfile (-154) - exiting
09:15:25 (8352): Can't acquire lockfile (-154) - waiting 35s
09:16:00 (8352): Can't acquire lockfile (-154) - exiting
09:16:01 (8356): Can't acquire lockfile (-154) - waiting 35s
09:16:36 (8356): Can't acquire lockfile (-154) - exiting
09:16:36 (8360): Can't acquire lockfile (-154) - waiting 35s
09:17:11 (8360): Can't acquire lockfile (-154) - exiting
09:17:11 (8372): Can't acquire lockfile (-154) - waiting 35s
09:17:46 (8372): Can't acquire lockfile (-154) - exiting
09:17:46 (8376): Can't acquire lockfile (-154) - waiting 35s
09:18:22 (8376): Can't acquire lockfile (-154) - exiting
09:18:22 (8380): Can't acquire lockfile (-154) - waiting 35s
09:18:57 (8380): Can't acquire lockfile (-154) - exiting
09:18:57 (8384): Can't acquire lockfile (-154) - waiting 35s
09:19:32 (8384): Can't acquire lockfile (-154) - exiting
09:19:33 (8388): Can't acquire lockfile (-154) - waiting 35s
09:20:08 (8388): Can't acquire lockfile (-154) - exiting
09:20:09 (8392): Can't acquire lockfile (-154) - waiting 35s
09:20:44 (8392): Can't acquire lockfile (-154) - exiting
09:20:44 (8396): Can't acquire lockfile (-154) - waiting 35s
09:21:19 (8396): Can't acquire lockfile (-154) - exiting
09:21:20 (8400): Can't acquire lockfile (-154) - waiting 35s
09:21:55 (8400): Can't acquire lockfile (-154) - exiting
09:21:55 (8404): Can't acquire lockfile (-154) - waiting 35s
09:22:31 (8404): Can't acquire lockfile (-154) - exiting
09:22:32 (8408): Can't acquire lockfile (-154) - waiting 35s
09:23:07 (8408): Can't acquire lockfile (-154) - exiting
09:23:08 (8412): Can't acquire lockfile (-154) - waiting 35s
09:23:43 (8412): Can't acquire lockfile (-154) - exiting
09:23:43 (8416): Can't acquire lockfile (-154) - waiting 35s
09:24:18 (8416): Can't acquire lockfile (-154) - exiting
09:24:18 (8420): Can't acquire lockfile (-154) - waiting 35s
09:24:54 (8420): Can't acquire lockfile (-154) - exiting
09:24:54 (8424): Can't acquire lockfile (-154) - waiting 35s
09:25:29 (8424): Can't acquire lockfile (-154) - exiting
09:25:30 (8428): Can't acquire lockfile (-154) - waiting 35s
09:26:05 (8428): Can't acquire lockfile (-154) - exiting
09:26:06 (8432): Can't acquire lockfile (-154) - waiting 35s
09:26:41 (8432): Can't acquire lockfile (-154) - exiting
09:26:42 (8440): Can't acquire lockfile (-154) - waiting 35s
09:27:17 (8440): Can't acquire lockfile (-154) - exiting
09:27:17 (8445): Can't acquire lockfile (-154) - waiting 35s
09:27:52 (8445): Can't acquire lockfile (-154) - exiting
09:27:52 (8449): Can't acquire lockfile (-154) - waiting 35s
09:28:27 (8449): Can't acquire lockfile (-154) - exiting
09:28:28 (8453): Can't acquire lockfile (-154) - waiting 35s
09:29:03 (8453): Can't acquire lockfile (-154) - exiting
09:29:03 (8457): Can't acquire lockfile (-154) - waiting 35s
09:29:38 (8457): Can't acquire lockfile (-154) - exiting
09:29:38 (8461): Can't acquire lockfile (-154) - waiting 35s
09:30:13 (8461): Can't acquire lockfile (-154) - exiting
09:30:14 (8465): Can't acquire lockfile (-154) - waiting 35s
09:30:49 (8465): Can't acquire lockfile (-154) - exiting
09:30:50 (8469): Can't acquire lockfile (-154) - waiting 35s
09:31:25 (8469): Can't acquire lockfile (-154) - exiting
09:31:26 (8473): Can't acquire lockfile (-154) - waiting 35s
09:32:01 (8473): Can't acquire lockfile (-154) - exiting
09:32:02 (8478): Can't acquire lockfile (-154) - waiting 35s
09:32:37 (8478): Can't acquire lockfile (-154) - exiting
09:32:37 (8482): Can't acquire lockfile (-154) - waiting 35s
09:33:12 (8482): Can't acquire lockfile (-154) - exiting
09:33:12 (8486): Can't acquire lockfile (-154) - waiting 35s
09:33:47 (8486): Can't acquire lockfile (-154) - exiting
09:33:47 (8490): Can't acquire lockfile (-154) - waiting 35s
09:34:22 (8490): Can't acquire lockfile (-154) - exiting
09:34:22 (8494): Can't acquire lockfile (-154) - waiting 35s
09:34:57 (8494): Can't acquire lockfile (-154) - exiting
09:34:58 (8498): Can't acquire lockfile (-154) - waiting 35s
09:35:33 (8498): Can't acquire lockfile (-154) - exiting
09:35:33 (8502): Can't acquire lockfile (-154) - waiting 35s
09:36:08 (8502): Can't acquire lockfile (-154) - exiting
09:36:08 (8506): Can't acquire lockfile (-154) - waiting 35s
09:36:43 (8506): Can't acquire lockfile (-154) - exiting
09:36:43 (8515): Can't acquire lockfile (-154) - waiting 35s
09:37:18 (8515): Can't acquire lockfile (-154) - exiting
09:37:19 (8519): Can't acquire lockfile (-154) - waiting 35s
09:37:54 (8519): Can't acquire lockfile (-154) - exiting
09:37:54 (8523): Can't acquire lockfile (-154) - waiting 35s
09:38:29 (8523): Can't acquire lockfile (-154) - exiting
09:38:30 (8527): Can't acquire lockfile (-154) - waiting 35s
09:39:05 (8527): Can't acquire lockfile (-154) - exiting
09:39:05 (8531): Can't acquire lockfile (-154) - waiting 35s
09:39:40 (8531): Can't acquire lockfile (-154) - exiting
09:39:41 (8535): Can't acquire lockfile (-154) - waiting 35s
09:40:16 (8535): Can't acquire lockfile (-154) - exiting
09:40:17 (8539): Can't acquire lockfile (-154) - waiting 35s
09:40:52 (8539): Can't acquire lockfile (-154) - exiting
09:40:52 (8543): Can't acquire lockfile (-154) - waiting 35s

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
09:41:27 (8543): Can't acquire lockfile (-154) - exiting
09:41:28 (8560): Can't acquire lockfile (-154) - waiting 35s
09:42:03 (8560): Can't acquire lockfile (-154) - exiting
10:17:40 (7119): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

SETPOS: Seek Failed: No space left on device
SETPOS: Unit 22 to Word Address 464896 Failed with Error Code -1

Model crashed: SETPOS: Unit 22 to Word Address 464896 Failed with Error Code -1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77df400]
[0xf77df425]
/lib32/libc.so.6(gsignal+0x51)[0xf7537921]
/lib32/libc.so.6(abort+0x182)[0xf753ad52]
/lib32/libc.so.6(+0x6213d)[0xf756f13d]
/lib32/libc.so.6(+0x6c231)[0xf7579231]
/lib32/libc.so.6(+0x6dab8)[0xf757aab8]
/lib32/libc.so.6(cfree+0x6d)[0xf757db9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7767a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7767aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7523bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2011 13:12:43 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 596,160 994,087 1.6675
25 Jul 2011 13:12:44 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 570,240 949,058 1.6643
25 Jul 2011 13:12:44 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 544,320 904,388 1.6615
25 Jul 2011 13:12:44 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 518,400 859,740 1.6584
25 Jul 2011 13:12:44 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 492,480 815,248 1.6554
10 Jul 2011 22:49:52 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 466,560 769,878 1.6501
10 Jul 2011 02:09:19 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 440,640 725,517 1.6465
09 Jul 2011 13:42:00 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 414,720 681,173 1.6425
09 Jul 2011 01:11:39 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 388,800 636,868 1.6380
08 Jul 2011 06:17:46 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 362,880 592,541 1.6329
07 Jul 2011 17:56:10 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 336,960 548,676 1.6283
07 Jul 2011 15:40:42 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 311,040 505,836 1.6263
07 Jul 2011 15:40:42 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 285,120 463,035 1.6240
06 Jul 2011 00:27:56 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 259,200 420,352 1.6217
05 Jul 2011 12:55:39 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 233,280 377,629 1.6188
05 Jul 2011 00:29:42 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 207,360 335,123 1.6161
04 Jul 2011 12:56:39 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 181,440 292,658 1.6130
04 Jul 2011 01:28:16 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 155,520 250,535 1.6110
03 Jul 2011 13:06:53 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 129,600 208,341 1.6076
30 Jun 2011 17:43:30 1084958 13011699 hadcm3n_t052_1940_40_007310635_0 103,680 166,569 1.6066


©2024 climateprediction.net