 |
|
| Name | hadcm3n_t50a_1980_40_007412274_0 |
| Workunit | 7609904 |
| Created | 17 Aug 2011, 1:02:33 UTC |
| Sent | 18 Aug 2011, 17:33:41 UTC |
| Report deadline | 18 Nov 2011, 1:00:52 UTC |
| Received | 6 Dec 2011, 5:48:58 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 22 (0x00000016) Unknown error code |
| Computer ID | 889646 |
| Run time | 23 days 7 hours 11 min |
| CPU time | 20 days 14 hours 39 min 43 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 2.20 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:12:55 (44168): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:17:36 (56376): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:17:38 (56376): No heartbeat from core client for 30 sec - exiting 15:17:39 (56376): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:06 (49432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:08 (49432): No heartbeat from core client for 30 sec - exiting 19:54:09 (49432): No heartbeat from core client for 30 sec - exiting 19:54:10 (49432): No heartbeat from core client for 30 sec - exiting 18:20:03 (53768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:04 (53768): No heartbeat from core client for 30 sec - exiting 19:22:05 (61840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:07 (61840): No heartbeat from core client for 30 sec - exiting 21:08:04 (46648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:58 (57992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:08:59 (57992): No heartbeat from core client for 30 sec - exiting 01:09:01 (57992): No heartbeat from core client for 30 sec - exiting 01:09:02 (57992): No heartbeat from core client for 30 sec - exiting 03:11:11 (68772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:13 (68772): No heartbeat from core client for 30 sec - exiting 03:11:14 (68772): No heartbeat from core client for 30 sec - exiting 03:17:48 (69240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:17:51 (69240): No heartbeat from core client for 30 sec - exiting 03:17:52 (69240): No heartbeat from core client for 30 sec - exiting 05:21:14 (69236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:21:15 (69236): No heartbeat from core client for 30 sec - exiting 05:27:15 (70204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:27:17 (70204): No heartbeat from core client for 30 sec - exiting 05:32:15 (69844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:17 (69844): No heartbeat from core client for 30 sec - exiting 05:32:18 (69844): No heartbeat from core client for 30 sec - exiting BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 13:07:44 (71176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 13:46:09 (71864): No heartbeat from core client for 30 sec - exiting 13:46:10 (71864): No heartbeat from core client for 30 sec - exiting 13:46:11 (71864): No heartbeat from core client for 30 sec - exiting 13:46:12 (71864): No heartbeat from core client for 30 sec - exiting 13:46:13 (71864): No heartbeat from core client for 30 sec - exiting 13:46:14 (71864): No heartbeat from core client for 30 sec - exiting 13:46:16 (71864): No heartbeat from core client for 30 sec - exiting 13:46:17 (71864): No heartbeat from core client for 30 sec - exiting 13:46:18 (71864): No heartbeat from core client for 30 sec - exiting 13:46:19 (71864): No heartbeat from core client for 30 sec - exiting 13:46:20 (71864): No heartbeat from core client for 30 sec - exiting 13:46:21 (71864): No heartbeat from core client for 30 sec - exiting 13:46:22 (71864): No heartbeat from core client for 30 sec - exiting 13:46:23 (71864): No heartbeat from core client for 30 sec - exiting 13:46:24 (71864): No heartbeat from core client for 30 sec - exiting 13:46:25 (71864): No heartbeat from core client for 30 sec - exiting 13:46:26 (71864): No heartbeat from core client for 30 sec - exiting 13:46:28 (71864): No heartbeat from core client for 30 sec - exiting 13:46:29 (71864): No heartbeat from core client for 30 sec - exiting 13:46:30 (71864): No heartbeat from core client for 30 sec - exiting 13:46:31 (71864): No heartbeat from core client for 30 sec - exiting 13:46:32 (71864): No heartbeat from core client for 30 sec - exiting 13:46:33 (71864): No heartbeat from core client for 30 sec - exiting 13:46:34 (71864): No heartbeat from core client for 30 sec - exiting 13:46:35 (71864): No heartbeat from core client for 30 sec - exiting 13:46:36 (71864): No heartbeat from core client for 30 sec - exiting 13:46:37 (71864): No heartbeat from core client for 30 sec - exiting 13:46:38 (71864): No heartbeat from core client for 30 sec - exiting 13:46:40 (71864): No heartbeat from core client for 30 sec - exiting 13:46:41 (71864): No heartbeat from core client for 30 sec - exiting 13:46:42 (71864): No heartbeat from core client for 30 sec - exiting 13:46:43 (71864): No heartbeat from core client for 30 sec - exiting 13:46:44 (71864): No heartbeat from core client for 30 sec - exiting 13:46:45 (71864): No heartbeat from core client for 30 sec - exiting 13:46:46 (71864): No heartbeat from core client for 30 sec - exiting 13:46:47 (71864): No heartbeat from core client for 30 sec - exiting 13:46:48 (71864): No heartbeat from core client for 30 sec - exiting 13:46:49 (71864): No heartbeat from core client for 30 sec - exiting 13:46:51 (71864): No heartbeat from core client for 30 sec - exiting 13:46:52 (71864): No heartbeat from core client for 30 sec - exiting 13:46:53 (71864): No heartbeat from core client for 30 sec - exiting 13:46:54 (71864): No heartbeat from core client for 30 sec - exiting 13:46:55 (71864): No heartbeat from core client for 30 sec - exiting 13:46:56 (71864): No heartbeat from core client for 30 sec - exiting 13:46:57 (71864): No heartbeat from core client for 30 sec - exiting 13:46:58 (71864): No heartbeat from core client for 30 sec - exiting 13:46:59 (71864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:32 (53948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:52:50 (2464): No heartbeat from core client for 30 sec - exiting 09:52:51 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:54:19 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:54:20 (2544): No heartbeat from core client for 30 sec - exiting 01:54:21 (2544): No heartbeat from core client for 30 sec - exiting 01:54:22 (2544): No heartbeat from core client for 30 sec - exiting 01:54:23 (2544): No heartbeat from core client for 30 sec - exiting 01:55:29 (7952): No heartbeat from core client for 30 sec - exiting 01:55:30 (7952): No heartbeat from core client for 30 sec - exiting 01:55:31 (7952): No heartbeat from core client for 30 sec - exiting 01:55:32 (7952): No heartbeat from core client for 30 sec - exiting 01:55:34 (7952): No heartbeat from core client for 30 sec - exiting 01:55:35 (7952): No heartbeat from core client for 30 sec - exiting 01:55:36 (7952): No heartbeat from core client for 30 sec - exiting 01:55:37 (7952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:19:38 (55832): No heartbeat from core client for 30 sec - exiting 10:19:39 (55832): No heartbeat from core client for 30 sec - exiting 10:19:41 (55832): No heartbeat from core client for 30 sec - exiting 10:19:42 (55832): No heartbeat from core client for 30 sec - exiting 10:19:43 (55832): No heartbeat from core client for 30 sec - exiting 10:19:44 (55832): No heartbeat from core client for 30 sec - exiting 10:19:45 (55832): No heartbeat from core client for 30 sec - exiting 10:19:46 (55832): No heartbeat from core client for 30 sec - exiting 10:19:47 (55832): No heartbeat from core client for 30 sec - exiting 10:19:48 (55832): No heartbeat from core client for 30 sec - exiting 10:19:49 (55832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:18:14 (18148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:54 (9564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:59:01 (1604): No heartbeat from core client for 30 sec - exiting 08:59:02 (1604): No heartbeat from core client for 30 sec - exiting 08:59:03 (1604): No heartbeat from core client for 30 sec - exiting 08:59:04 (1604): No heartbeat from core client for 30 sec - exiting 08:59:06 (1604): No heartbeat from core client for 30 sec - exiting 08:59:07 (1604): No heartbeat from core client for 30 sec - exiting 08:59:08 (1604): No heartbeat from core client for 30 sec - exiting 08:59:09 (1604): No heartbeat from core client for 30 sec - exiting 08:59:10 (1604): No heartbeat from core client for 30 sec - exiting 08:59:11 (1604): No heartbeat from core client for 30 sec - exiting 08:59:12 (1604): No heartbeat from core client for 30 sec - exiting 08:59:13 (1604): No heartbeat from core client for 30 sec - exiting 08:59:14 (1604): No heartbeat from core client for 30 sec - exiting 08:59:15 (1604): No heartbeat from core client for 30 sec - exiting 08:59:16 (1604): No heartbeat from core client for 30 sec - exiting 08:59:18 (1604): No heartbeat from core client for 30 sec - exiting 08:59:19 (1604): No heartbeat from core client for 30 sec - exiting 08:59:20 (1604): No heartbeat from core client for 30 sec - exiting 08:59:21 (1604): No heartbeat from core client for 30 sec - exiting 08:59:22 (1604): No heartbeat from core client for 30 sec - exiting 08:59:23 (1604): No heartbeat from core client for 30 sec - exiting 08:59:24 (1604): No heartbeat from core client for 30 sec - exiting 08:59:25 (1604): No heartbeat from core client for 30 sec - exiting 08:59:26 (1604): No heartbeat from core client for 30 sec - exiting 08:59:27 (1604): No heartbeat from core client for 30 sec - exiting 08:59:29 (1604): No heartbeat from core client for 30 sec - exiting 08:59:30 (1604): No heartbeat from core client for 30 sec - exiting 08:59:31 (1604): No heartbeat from core client for 30 sec - exiting 08:59:32 (1604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:33 (1604): No heartbeat from core client for 30 sec - exiting 08:59:34 (1604): No heartbeat from core client for 30 sec - exiting 08:59:35 (1604): No heartbeat from core client for 30 sec - exiting 09:53:25 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:26 (3296): No heartbeat from core client for 30 sec - exiting 20:13:16 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:08 (7144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:09 (7144): No heartbeat from core client for 30 sec - exiting 06:10:56 (2072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:45 (11772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:36 (14348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:25 (8052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:23 (15936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:07 (17552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:08 (17552): No heartbeat from core client for 30 sec - exiting 10:04:05 (18716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:04 (22484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:03:05 (22484): No heartbeat from core client for 30 sec - exiting 19:01:52 (22768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:54 (22768): No heartbeat from core client for 30 sec - exiting 23:00:50 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:38 (19780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:59:39 (19780): No heartbeat from core client for 30 sec - exiting 07:58:36 (12568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:35 (30160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:57:36 (30160): No heartbeat from core client for 30 sec - exiting 11:57:37 (30160): No heartbeat from core client for 30 sec - exiting 16:56:23 (31296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:24 (31296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:40:10 (9628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:11 (9628): No heartbeat from core client for 30 sec - exiting 16:39:04 (9400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:05 (9400): No heartbeat from core client for 30 sec - exiting 00:37:56 (6452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:57 (13144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:13:54 (13148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:13:55 (13148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 19:33:08 (15896): No heartbeat from core client for 30 sec - exiting 19:33:09 (15896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:17 (14360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:18 (14360): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 01:49:15 (23112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:49:16 (23112): No heartbeat from core client for 30 sec - exiting 04:48:23 (21328): No heartbeat from core client for 30 sec - exiting 04:48:25 (21328): No heartbeat from core client for 30 sec - exiting 04:48:26 (21328): No heartbeat from core client for 30 sec - exiting 04:48:27 (21328): No heartbeat from core client for 30 sec - exiting 04:48:28 (21328): No heartbeat from core client for 30 sec - exiting 04:48:29 (21328): No heartbeat from core client for 30 sec - exiting 04:48:30 (21328): No heartbeat from core client for 30 sec - exiting 04:48:31 (21328): No heartbeat from core client for 30 sec - exiting 04:48:32 (21328): No heartbeat from core client for 30 sec - exiting 04:48:33 (21328): No heartbeat from core client for 30 sec - exiting 04:48:34 (21328): No heartbeat from core client for 30 sec - exiting 04:48:36 (21328): No heartbeat from core client for 30 sec - exiting 04:48:37 (21328): No heartbeat from core client for 30 sec - exiting 04:48:38 (21328): No heartbeat from core client for 30 sec - exiting 04:48:39 (21328): No heartbeat from core client for 30 sec - exiting 04:48:40 (21328): No heartbeat from core client for 30 sec - exiting 04:48:41 (21328): No heartbeat from core client for 30 sec - exiting 04:48:42 (21328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... zip error: Could not create output file (was replacing the original zip file) cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\Documents and Settings\All Users\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t50a_1980_40_007412274/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 06 Dec 2011 04:53:36 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 518,400 | 1,780,900 | 3.4354 |
| 05 Dec 2011 05:15:07 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 492,480 | 1,700,376 | 3.4527 |
| 04 Dec 2011 06:04:14 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 466,560 | 1,620,872 | 3.4741 |
| 03 Dec 2011 07:10:55 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 440,640 | 1,541,675 | 3.4987 |
| 02 Dec 2011 06:26:13 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 414,720 | 1,458,867 | 3.5177 |
| 30 Nov 2011 03:44:59 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 388,800 | 1,375,673 | 3.5383 |
| 29 Nov 2011 03:59:34 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 362,880 | 1,294,656 | 3.5677 |
| 20 Nov 2011 05:22:06 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 336,960 | 1,204,623 | 3.5750 |
| 02 Nov 2011 09:13:08 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 311,040 | 1,100,288 | 3.5374 |
| 01 Nov 2011 02:32:20 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 285,120 | 1,002,022 | 3.5144 |
| 31 Oct 2011 19:21:04 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 259,200 | 902,532 | 3.4820 |
| 31 Oct 2011 19:12:32 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 233,280 | 805,868 | 3.4545 |
| 19 Oct 2011 03:19:40 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 207,360 | 710,155 | 3.4247 |
| 09 Oct 2011 13:05:26 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 181,440 | 613,200 | 3.3796 |
| 19 Sep 2011 04:20:14 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 155,520 | 520,579 | 3.3473 |
| 18 Sep 2011 03:36:53 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 129,600 | 440,302 | 3.3974 |
| 17 Sep 2011 01:56:46 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 103,680 | 352,199 | 3.3970 |
| 06 Sep 2011 20:04:25 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 77,760 | 262,765 | 3.3792 |
| 05 Sep 2011 15:15:36 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 51,840 | 167,957 | 3.2399 |
| 30 Aug 2011 22:16:35 | 889646 | 13265725 | hadcm3n_t50a_1980_40_007412274_0 | 25,920 | 92,895 | 3.5839 |
©2024 climateprediction.net