climateprediction.net home page
Task 15606937

Task 15606937

Name hadcm3n_o4i7_2140_40_008279966_2
Workunit 8431101
Created 13 Feb 2013, 9:19:40 UTC
Sent 13 Feb 2013, 9:19:44 UTC
Report deadline 15 May 2013, 16:46:55 UTC
Received 11 Mar 2013, 13:16:04 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1263691
Run time 14 days 10 hours 51 min 29 sec
CPU time 14 days 4 hours 31 min 30 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.85 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:08:49 (25834): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:08:52 (25834): No heartbeat from core client for 30 sec - exiting
01:08:53 (25834): No heartbeat from core client for 30 sec - exiting
01:08:54 (25834): No heartbeat from core client for 30 sec - exiting
01:08:55 (25834): No heartbeat from core client for 30 sec - exiting
01:08:56 (25834): No heartbeat from core client for 30 sec - exiting
01:10:11 (31007): No heartbeat from core client for 30 sec - exiting
01:10:12 (31007): No heartbeat from core client for 30 sec - exiting
01:10:13 (31007): No heartbeat from core client for 30 sec - exiting
01:10:14 (31007): No heartbeat from core client for 30 sec - exiting
01:10:15 (31007): No heartbeat from core client for 30 sec - exiting
01:10:16 (31007): No heartbeat from core client for 30 sec - exiting
01:10:17 (31007): No heartbeat from core client for 30 sec - exiting
01:10:18 (31007): No heartbeat from core client for 30 sec - exiting
01:10:19 (31007): No heartbeat from core client for 30 sec - exiting
01:10:20 (31007): No heartbeat from core client for 30 sec - exiting
01:10:21 (31007): No heartbeat from core client for 30 sec - exiting
01:10:22 (31007): No heartbeat from core client for 30 sec - exiting
01:10:23 (31007): No heartbeat from core client for 30 sec - exiting
01:10:24 (31007): No heartbeat from core client for 30 sec - exiting
01:10:25 (31007): No heartbeat from core client for 30 sec - exiting
01:10:26 (31007): No heartbeat from core client for 30 sec - exiting
01:10:27 (31007): No heartbeat from core client for 30 sec - exiting
01:10:28 (31007): No heartbeat from core client for 30 sec - exiting
01:10:29 (31007): No heartbeat from core client for 30 sec - exiting
01:10:30 (31007): No heartbeat from core client for 30 sec - exiting
01:10:31 (31007): No heartbeat from core client for 30 sec - exiting
01:10:32 (31007): No heartbeat from core client for 30 sec - exiting
01:10:33 (31007): No heartbeat from core client for 30 sec - exiting
01:10:34 (31007): No heartbeat from core client for 30 sec - exiting
01:10:35 (31007): No heartbeat from core client for 30 sec - exiting
01:10:36 (31007): No heartbeat from core client for 30 sec - exiting
01:10:37 (31007): No heartbeat from core client for 30 sec - exiting
01:10:38 (31007): No heartbeat from core client for 30 sec - exiting
01:10:39 (31007): No heartbeat from core client for 30 sec - exiting
01:10:40 (31007): No heartbeat from core client for 30 sec - exiting
01:10:41 (31007): No heartbeat from core client for 30 sec - exiting
01:10:42 (31007): No heartbeat from core client for 30 sec - exiting
01:10:43 (31007): No heartbeat from core client for 30 sec - exiting
01:10:44 (31007): No heartbeat from core client for 30 sec - exiting
01:10:45 (31007): No heartbeat from core client for 30 sec - exiting
01:10:46 (31007): No heartbeat from core client for 30 sec - exiting
01:10:47 (31007): No heartbeat from core client for 30 sec - exiting
01:10:48 (31007): No heartbeat from core client for 30 sec - exiting
01:10:49 (31007): No heartbeat from core client for 30 sec - exiting
01:10:50 (31007): No heartbeat from core client for 30 sec - exiting
01:10:51 (31007): No heartbeat from core client for 30 sec - exiting
01:10:52 (31007): No heartbeat from core client for 30 sec - exiting
01:10:53 (31007): No heartbeat from core client for 30 sec - exiting
01:10:54 (31007): No heartbeat from core client for 30 sec - exiting
01:10:55 (31007): No heartbeat from core client for 30 sec - exiting
01:10:56 (31007): No heartbeat from core client for 30 sec - exiting
01:10:57 (31007): No heartbeat from core client for 30 sec - exiting
01:10:58 (31007): No heartbeat from core client for 30 sec - exiting
01:10:59 (31007): No heartbeat from core client for 30 sec - exiting
01:11:00 (31007): No heartbeat from core client for 30 sec - exiting
01:11:01 (31007): No heartbeat from core client for 30 sec - exiting
01:11:02 (31007): No heartbeat from core client for 30 sec - exiting
01:11:03 (31007): No heartbeat from core client for 30 sec - exiting
01:11:35 (31007): No heartbeat from core client for 30 sec - exiting
01:11:36 (31007): No heartbeat from core client for 30 sec - exiting
01:11:37 (31007): No heartbeat from core client for 30 sec - exiting
01:11:38 (31007): No heartbeat from core client for 30 sec - exiting
01:11:39 (31007): No heartbeat from core client for 30 sec - exiting
01:11:40 (31007): No heartbeat from core client for 30 sec - exiting
01:11:41 (31007): No heartbeat from core client for 30 sec - exiting
01:11:42 (31007): No heartbeat from core client for 30 sec - exiting
01:11:43 (31007): No heartbeat from core client for 30 sec - exiting
01:11:44 (31007): No heartbeat from core client for 30 sec - exiting
01:11:45 (31007): No heartbeat from core client for 30 sec - exiting
01:11:46 (31007): No heartbeat from core client for 30 sec - exiting
01:11:47 (31007): No heartbeat from core client for 30 sec - exiting
01:11:48 (31007): No heartbeat from core client for 30 sec - exiting
01:11:49 (31007): No heartbeat from core client for 30 sec - exiting
01:11:50 (31007): No heartbeat from core client for 30 sec - exiting
01:11:51 (31007): No heartbeat from core client for 30 sec - exiting
01:11:52 (31007): No heartbeat from core client for 30 sec - exiting
01:11:53 (31007): No heartbeat from core client for 30 sec - exiting
01:11:54 (31007): No heartbeat from core client for 30 sec - exiting
01:11:55 (31007): No heartbeat from core client for 30 sec - exiting
01:11:56 (31007): No heartbeat from core client for 30 sec - exiting
01:11:57 (31007): No heartbeat from core client for 30 sec - exiting
01:11:58 (31007): No heartbeat from core client for 30 sec - exiting
01:11:59 (31007): No heartbeat from core client for 30 sec - exiting
01:12:00 (31007): No heartbeat from core client for 30 sec - exiting
01:12:01 (31007): No heartbeat from core client for 30 sec - exiting
01:12:02 (31007): No heartbeat from core client for 30 sec - exiting
01:12:03 (31007): No heartbeat from core client for 30 sec - exiting
01:12:04 (31007): No heartbeat from core client for 30 sec - exiting
01:12:05 (31007): No heartbeat from core client for 30 sec - exiting
01:12:07 (31007): No heartbeat from core client for 30 sec - exiting
01:12:08 (31007): No heartbeat from core client for 30 sec - exiting
01:12:09 (31007): No heartbeat from core client for 30 sec - exiting
01:12:10 (31007): No heartbeat from core client for 30 sec - exiting
01:12:11 (31007): No heartbeat from core client for 30 sec - exiting
01:12:12 (31007): No heartbeat from core client for 30 sec - exiting
01:12:13 (31007): No heartbeat from core client for 30 sec - exiting
01:12:14 (31007): No heartbeat from core client for 30 sec - exiting
01:12:15 (31007): No heartbeat from core client for 30 sec - exiting
01:12:16 (31007): No heartbeat from core client for 30 sec - exiting
01:12:17 (31007): No heartbeat from core client for 30 sec - exiting
01:12:18 (31007): No heartbeat from core client for 30 sec - exiting
01:12:19 (31007): No heartbeat from core client for 30 sec - exiting
01:12:20 (31007): No heartbeat from core client for 30 sec - exiting
01:12:21 (31007): No heartbeat from core client for 30 sec - exiting
01:12:22 (31007): No heartbeat from core client for 30 sec - exiting
01:12:23 (31007): No heartbeat from core client for 30 sec - exiting
01:12:24 (31007): No heartbeat from core client for 30 sec - exiting
01:12:25 (31007): No heartbeat from core client for 30 sec - exiting
01:12:26 (31007): No heartbeat from core client for 30 sec - exiting
01:12:27 (31007): No heartbeat from core client for 30 sec - exiting
01:12:28 (31007): No heartbeat from core client for 30 sec - exiting
01:12:29 (31007): No heartbeat from core client for 30 sec - exiting
01:12:30 (31007): No heartbeat from core client for 30 sec - exiting
01:12:31 (31007): No heartbeat from core client for 30 sec - exiting
01:12:32 (31007): No heartbeat from core client for 30 sec - exiting
01:12:33 (31007): No heartbeat from core client for 30 sec - exiting
01:12:34 (31007): No heartbeat from core client for 30 sec - exiting
01:12:35 (31007): No heartbeat from core client for 30 sec - exiting
01:12:36 (31007): No heartbeat from core client for 30 sec - exiting
01:12:37 (31007): No heartbeat from core client for 30 sec - exiting
01:12:38 (31007): No heartbeat from core client for 30 sec - exiting
01:12:39 (31007): No heartbeat from core client for 30 sec - exiting
01:13:10 (31007): No heartbeat from core client for 30 sec - exiting
01:13:11 (31007): No heartbeat from core client for 30 sec - exiting
01:13:12 (31007): No heartbeat from core client for 30 sec - exiting
01:13:13 (31007): No heartbeat from core client for 30 sec - exiting
01:13:14 (31007): No heartbeat from core client for 30 sec - exiting
01:13:15 (31007): No heartbeat from core client for 30 sec - exiting
01:13:16 (31007): No heartbeat from core client for 30 sec - exiting
01:13:17 (31007): No heartbeat from core client for 30 sec - exiting
01:13:18 (31007): No heartbeat from core client for 30 sec - exiting
01:13:19 (31007): No heartbeat from core client for 30 sec - exiting
01:13:20 (31007): No heartbeat from core client for 30 sec - exiting
01:13:21 (31007): No heartbeat from core client for 30 sec - exiting
01:13:22 (31007): No heartbeat from core client for 30 sec - exiting
01:13:23 (31007): No heartbeat from core client for 30 sec - exiting
01:13:24 (31007): No heartbeat from core client for 30 sec - exiting
01:13:25 (31007): No heartbeat from core client for 30 sec - exiting
01:13:26 (31007): No heartbeat from core client for 30 sec - exiting
01:13:27 (31007): No heartbeat from core client for 30 sec - exiting
01:13:28 (31007): No heartbeat from core client for 30 sec - exiting
01:13:29 (31007): No heartbeat from core client for 30 sec - exiting
01:13:30 (31007): No heartbeat from core client for 30 sec - exiting
01:13:31 (31007): No heartbeat from core client for 30 sec - exiting
01:13:32 (31007): No heartbeat from core client for 30 sec - exiting
01:13:33 (31007): No heartbeat from core client for 30 sec - exiting
01:13:34 (31007): No heartbeat from core client for 30 sec - exiting
01:13:35 (31007): No heartbeat from core client for 30 sec - exiting
01:13:36 (31007): No heartbeat from core client for 30 sec - exiting
01:13:37 (31007): No heartbeat from core client for 30 sec - exiting
01:13:38 (31007): No heartbeat from core client for 30 sec - exiting
01:13:39 (31007): No heartbeat from core client for 30 sec - exiting
01:13:40 (31007): No heartbeat from core client for 30 sec - exiting
01:13:41 (31007): No heartbeat from core client for 30 sec - exiting
01:13:42 (31007): No heartbeat from core client for 30 sec - exiting
01:13:43 (31007): No heartbeat from core client for 30 sec - exiting
01:13:44 (31007): No heartbeat from core client for 30 sec - exiting
01:13:45 (31007): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:13:46 (31007): No heartbeat from core client for 30 sec - exiting
01:13:47 (31007): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:36:34 (10139): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:36:39 (10139): No heartbeat from core client for 30 sec - exiting
01:36:40 (10139): No heartbeat from core client for 30 sec - exiting
01:36:41 (10139): No heartbeat from core client for 30 sec - exiting
01:36:42 (10139): No heartbeat from core client for 30 sec - exiting
01:36:43 (10139): No heartbeat from core client for 30 sec - exiting
01:36:44 (10139): No heartbeat from core client for 30 sec - exiting
01:36:45 (10139): No heartbeat from core client for 30 sec - exiting
01:36:46 (10139): No heartbeat from core client for 30 sec - exiting
01:36:47 (10139): No heartbeat from core client for 30 sec - exiting
01:36:48 (10139): No heartbeat from core client for 30 sec - exiting
01:36:49 (10139): No heartbeat from core client for 30 sec - exiting
01:36:50 (10139): No heartbeat from core client for 30 sec - exiting
01:36:51 (10139): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
01:38:07 (10298): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
01:38:09 (10298): No heartbeat from core client for 30 sec - exiting
01:38:10 (10298): No heartbeat from core client for 30 sec - exiting
01:38:11 (10298): No heartbeat from core client for 30 sec - exiting
01:38:12 (10298): No heartbeat from core client for 30 sec - exiting
01:38:13 (10298): No heartbeat from core client for 30 sec - exiting
01:39:26 (10305): No heartbeat from core client for 30 sec - exiting
01:39:28 (10305): No heartbeat from core client for 30 sec - exiting
01:39:29 (10305): No heartbeat from core client for 30 sec - exiting
01:39:30 (10305): No heartbeat from core client for 30 sec - exiting
01:39:31 (10305): No heartbeat from core client for 30 sec - exiting
01:39:32 (10305): No heartbeat from core client for 30 sec - exiting
01:39:33 (10305): No heartbeat from core client for 30 sec - exiting
01:39:34 (10305): No heartbeat from core client for 30 sec - exiting
01:39:35 (10305): No heartbeat from core client for 30 sec - exiting
01:39:36 (10305): No heartbeat from core client for 30 sec - exiting
01:39:37 (10305): No heartbeat from core client for 30 sec - exiting
01:39:38 (10305): No heartbeat from core client for 30 sec - exiting
01:39:39 (10305): No heartbeat from core client for 30 sec - exiting
01:39:40 (10305): No heartbeat from core client for 30 sec - exiting
01:39:41 (10305): No heartbeat from core client for 30 sec - exiting
01:39:42 (10305): No heartbeat from core client for 30 sec - exiting
01:39:43 (10305): No heartbeat from core client for 30 sec - exiting
01:39:44 (10305): No heartbeat from core client for 30 sec - exiting
01:39:45 (10305): No heartbeat from core client for 30 sec - exiting
01:39:46 (10305): No heartbeat from core client for 30 sec - exiting
01:39:47 (10305): No heartbeat from core client for 30 sec - exiting
01:39:48 (10305): No heartbeat from core client for 30 sec - exiting
01:39:49 (10305): No heartbeat from core client for 30 sec - exiting
01:39:50 (10305): No heartbeat from core client for 30 sec - exiting
01:39:51 (10305): No heartbeat from core client for 30 sec - exiting
01:39:52 (10305): No heartbeat from core client for 30 sec - exiting
01:39:53 (10305): No heartbeat from core client for 30 sec - exiting
01:39:54 (10305): No heartbeat from core client for 30 sec - exiting
01:39:55 (10305): No heartbeat from core client for 30 sec - exiting
01:39:56 (10305): No heartbeat from core client for 30 sec - exiting
01:39:57 (10305): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:19:45 (16713): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:19:50 (16713): No heartbeat from core client for 30 sec - exiting
01:19:51 (16713): No heartbeat from core client for 30 sec - exiting
01:19:52 (16713): No heartbeat from core client for 30 sec - exiting
01:19:53 (16713): No heartbeat from core client for 30 sec - exiting
01:19:54 (16713): No heartbeat from core client for 30 sec - exiting
01:19:55 (16713): No heartbeat from core client for 30 sec - exiting
01:19:56 (16713): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	05:56:14 PM	No files match the supplied pattern.
MainError:	05:56:14 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	07:47:02 AM	No files match the supplied pattern.
MainError:	07:47:02 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	06:50:39 AM	No files match the supplied pattern.
MainError:	06:50:39 AM	No files match the supplied pattern.
MainError:	06:08:24 PM	No files match the supplied pattern.
MainError:	06:08:24 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	02:35:20 PM	No files match the supplied pattern.
MainError:	02:35:20 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:23:41 (18416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	09:24:50 AM	No files match the supplied pattern.
MainError:	09:24:50 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:15:15 (5603): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:16:32 (6172): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
MainError:	07:35:30 AM	No files match the supplied pattern.
MainError:	07:35:30 AM	No files match the supplied pattern.
01:36:06 (6184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:48:04 (6253): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	11:27:34 PM	No files match the supplied pattern.
MainError:	11:27:34 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
01:14:06 (11398): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:14:09 (11398): No heartbeat from core client for 30 sec - exiting
01:14:10 (11398): No heartbeat from core client for 30 sec - exiting
01:14:11 (11398): No heartbeat from core client for 30 sec - exiting
01:14:12 (11398): No heartbeat from core client for 30 sec - exiting
01:14:13 (11398): No heartbeat from core client for 30 sec - exiting
01:14:14 (11398): No heartbeat from core client for 30 sec - exiting
01:14:15 (11398): No heartbeat from core client for 30 sec - exiting
01:14:16 (11398): No heartbeat from core client for 30 sec - exiting
01:14:17 (11398): No heartbeat from core client for 30 sec - exiting
01:25:11 (15520): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:25:13 (15520): No heartbeat from core client for 30 sec - exiting
01:41:01 (15537): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:41:02 (15537): No heartbeat from core client for 30 sec - exiting
01:41:03 (15537): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	11:19:41 AM	No files match the supplied pattern.
MainError:	11:19:41 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	02:05:36 AM	No files match the supplied pattern.
MainError:	02:05:36 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:35:42 (1654): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:37:03 (1663): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:37:43 (1669): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:39:03 (1677): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:39:43 (1683): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:40:28 (1718): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:41:09 (1725): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:42:30 (1730): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:43:15 (1737): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:43:55 (1744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:45:16 (1749): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:01 (1757): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:46:55 (1764): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
11:49:46 (1787): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:50:27 (1798): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:51:07 (1808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Error converting file to netcdf: dataout/o4i7ka.ph11c10
Error converting file to netcdf: dataout/o4i7ka.pg11c10
Error converting file to netcdf: dataout/o4i7ka.pe11c10
MainError:	01:36:22 PM	No files match the supplied pattern.
MainError:	01:36:22 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Mar 2013 13:40:11 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 777,600 1,224,404 1.5746
09 Mar 2013 02:05:48 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 751,680 1,183,422 1.5744
08 Mar 2013 11:22:20 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 725,760 1,142,505 1.5742
07 Mar 2013 23:28:19 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 699,840 1,102,088 1.5748
07 Mar 2013 07:40:20 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 673,920 1,061,435 1.5750
06 Mar 2013 09:25:56 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 648,000 1,019,867 1.5739
04 Mar 2013 14:40:22 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 622,080 979,283 1.5742
03 Mar 2013 18:09:34 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 596,160 938,855 1.5748
03 Mar 2013 06:55:26 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 570,240 898,447 1.5756
02 Mar 2013 07:47:51 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 544,320 857,771 1.5759
01 Mar 2013 18:01:46 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 518,400 816,689 1.5754
28 Feb 2013 23:25:07 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 492,480 776,532 1.5768
27 Feb 2013 03:05:31 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 466,560 736,148 1.5778
25 Feb 2013 10:40:24 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 440,640 694,935 1.5771
24 Feb 2013 21:03:07 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 414,720 652,953 1.5744
24 Feb 2013 08:55:26 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 388,800 611,497 1.5728
23 Feb 2013 20:54:21 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 362,880 570,470 1.5721
23 Feb 2013 07:56:57 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 336,960 529,482 1.5713
21 Feb 2013 21:59:21 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 311,040 487,857 1.5685
21 Feb 2013 08:34:37 1263691 15606937 hadcm3n_o4i7_2140_40_008279966_2 285,120 447,034 1.5679


©2024 climateprediction.net