Name | hadcm3n_o1ea_2100_40_008116497_0 |
Workunit | 8271611 |
Created | 30 Jul 2012, 19:18:10 UTC |
Sent | 30 Jul 2012, 19:18:32 UTC |
Report deadline | 30 Oct 2012, 2:45:43 UTC |
Received | 26 Sep 2012, 19:01:40 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 979686 |
Run time | 35 days 23 hours 38 min 59 sec |
CPU time | 31 days 14 hours 30 min 49 sec |
Validate state | Invalid |
Credit | 9,331.20 |
Device peak FLOPS | 2.29 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4448, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4292, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4228, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5316, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4432, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4152, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:53:44 (4916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4340, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4292, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4352, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4400, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4372, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4780, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4416, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3280, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4252, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4240, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3092, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... 10:08:25 (1352): No heartbeat from core client for 30 sec - exiting 10:08:26 (1352): No heartbeat from core client for 30 sec - exiting 10:08:27 (1352): No heartbeat from core client for 30 sec - exiting 10:08:29 (1352): No heartbeat from core client for 30 sec - exiting 10:08:30 (1352): No heartbeat from core client for 30 sec - exiting 10:08:31 (1352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4412, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4328, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4472, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4476, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4220, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=904, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77046E5F read attempt to address 0x40342D2A Engaging BOINC Windows Runtime Debugger... 19:03:43 (4760): No heartbeat from core client for 30 sec - exiting 19:03:44 (4760): No heartbeat from core client for 30 sec - exiting 19:03:45 (4760): No heartbeat from core client for 30 sec - exiting 19:03:46 (4760): No heartbeat from core client for 30 sec - exiting 19:03:47 (4760): No heartbeat from core client for 30 sec - exiting 19:03:48 (4760): No heartbeat from core client for 30 sec - exiting 19:03:49 (4760): No heartbeat from core client for 30 sec - exiting 19:03:50 (4760): No heartbeat from core client for 30 sec - exiting 19:03:51 (4760): No heartbeat from core client for 30 sec - exiting 19:03:52 (4760): No heartbeat from core client for 30 sec - exiting 19:03:53 (4760): No heartbeat from core client for 30 sec - exiting 19:03:54 (4760): No heartbeat from core client for 30 sec - exiting 19:03:55 (4760): No heartbeat from core client for 30 sec - exiting 19:03:56 (4760): No heartbeat from core client for 30 sec - exiting 19:03:57 (4760): No heartbeat from core client for 30 sec - exiting 19:03:58 (4760): No heartbeat from core client for 30 sec - exiting 19:03:59 (4760): No heartbeat from core client for 30 sec - exiting 19:04:00 (4760): No heartbeat from core client for 30 sec - exiting 19:04:01 (4760): No heartbeat from core client for 30 sec - exiting 19:04:02 (4760): No heartbeat from core client for 30 sec - exiting 19:04:03 (4760): No heartbeat from core client for 30 sec - exiting 19:04:04 (4760): No heartbeat from core client for 30 sec - exiting 19:04:05 (4760): No heartbeat from core client for 30 sec - exiting 19:04:06 (4760): No heartbeat from core client for 30 sec - exiting 19:04:07 (4760): No heartbeat from core client for 30 sec - exiting 19:04:08 (4760): No heartbeat from core client for 30 sec - exiting 19:04:09 (4760): No heartbeat from core client for 30 sec - exiting 19:04:10 (4760): No heartbeat from core client for 30 sec - exiting 19:04:11 (4760): No heartbeat from core client for 30 sec - exiting 19:04:12 (4760): No heartbeat from core client for 30 sec - exiting 19:04:13 (4760): No heartbeat from core client for 30 sec - exiting 19:04:14 (4760): No heartbeat from core client for 30 sec - exiting 19:04:15 (4760): No heartbeat from core client for 30 sec - exiting 19:04:16 (4760): No heartbeat from core client for 30 sec - exiting 19:04:17 (4760): No heartbeat from core client for 30 sec - exiting 19:04:18 (4760): No heartbeat from core client for 30 sec - exiting 19:04:19 (4760): No heartbeat from core client for 30 sec - exiting 19:04:20 (4760): No heartbeat from core client for 30 sec - exiting 19:04:21 (4760): No heartbeat from core client for 30 sec - exiting 19:04:22 (4760): No heartbeat from core client for 30 sec - exiting 19:04:23 (4760): No heartbeat from core client for 30 sec - exiting 19:04:24 (4760): No heartbeat from core client for 30 sec - exiting 19:04:25 (4760): No heartbeat from core client for 30 sec - exiting 19:04:26 (4760): No heartbeat from core client for 30 sec - exiting 19:04:27 (4760): No heartbeat from core client for 30 sec - exiting 19:04:28 (4760): No heartbeat from core client for 30 sec - exiting 19:04:29 (4760): No heartbeat from core client for 30 sec - exiting 19:04:30 (4760): No heartbeat from core client for 30 sec - exiting 19:04:31 (4760): No heartbeat from core client for 30 sec - exiting 19:04:32 (4760): No heartbeat from core client for 30 sec - exiting 19:04:33 (4760): No heartbeat from core client for 30 sec - exiting 19:04:34 (4760): No heartbeat from core client for 30 sec - exiting 19:04:35 (4760): No heartbeat from core client for 30 sec - exiting 19:04:37 (4760): No heartbeat from core client for 30 sec - exiting 19:07:02 (4760): No heartbeat from core client for 30 sec - exiting 19:07:03 (4760): No heartbeat from core client for 30 sec - exiting 19:07:04 (4760): No heartbeat from core client for 30 sec - exiting 19:07:05 (4760): No heartbeat from core client for 30 sec - exiting 19:07:06 (4760): No heartbeat from core client for 30 sec - exiting 19:07:07 (4760): No heartbeat from core client for 30 sec - exiting 19:07:08 (4760): No heartbeat from core client for 30 sec - exiting 19:07:09 (4760): No heartbeat from core client for 30 sec - exiting 19:07:10 (4760): No heartbeat from core client for 30 sec - exiting 19:07:11 (4760): No heartbeat from core client for 30 sec - exiting 19:07:12 (4760): No heartbeat from core client for 30 sec - exiting 19:07:13 (4760): No heartbeat from core client for 30 sec - exiting 19:07:14 (4760): No heartbeat from core client for 30 sec - exiting 19:07:15 (4760): No heartbeat from core client for 30 sec - exiting 19:07:16 (4760): No heartbeat from core client for 30 sec - exiting 19:07:17 (4760): No heartbeat from core client for 30 sec - exiting 19:07:18 (4760): No heartbeat from core client for 30 sec - exiting 19:07:19 (4760): No heartbeat from core client for 30 sec - exiting 19:07:20 (4760): No heartbeat from core client for 30 sec - exiting 19:07:21 (4760): No heartbeat from core client for 30 sec - exiting 19:07:22 (4760): No heartbeat from core client for 30 sec - exiting 19:07:23 (4760): No heartbeat from core client for 30 sec - exiting 19:07:24 (4760): No heartbeat from core client for 30 sec - exiting 19:07:25 (4760): No heartbeat from core client for 30 sec - exiting 19:07:26 (4760): No heartbeat from core client for 30 sec - exiting 19:07:27 (4760): No heartbeat from core client for 30 sec - exiting 19:07:28 (4760): No heartbeat from core client for 30 sec - exiting 19:07:29 (4760): No heartbeat from core client for 30 sec - exiting 19:07:30 (4760): No heartbeat from core client for 30 sec - exiting 19:07:31 (4760): No heartbeat from core client for 30 sec - exiting 19:07:32 (4760): No heartbeat from core client for 30 sec - exiting 19:07:33 (4760): No heartbeat from core client for 30 sec - exiting 19:07:34 (4760): No heartbeat from core client for 30 sec - exiting 19:07:35 (4760): No heartbeat from core client for 30 sec - exiting 19:07:36 (4760): No heartbeat from core client for 30 sec - exiting 19:07:37 (4760): No heartbeat from core client for 30 sec - exiting 19:07:38 (4760): No heartbeat from core client for 30 sec - exiting 19:07:39 (4760): No heartbeat from core client for 30 sec - exiting 19:07:40 (4760): No heartbeat from core client for 30 sec - exiting 19:07:41 (4760): No heartbeat from core client for 30 sec - exiting 19:07:42 (4760): No heartbeat from core client for 30 sec - exiting 19:07:43 (4760): No heartbeat from core client for 30 sec - exiting 19:07:44 (4760): No heartbeat from core client for 30 sec - exiting 19:07:45 (4760): No heartbeat from core client for 30 sec - exiting 19:07:46 (4760): No heartbeat from core client for 30 sec - exiting 19:07:47 (4760): No heartbeat from core client for 30 sec - exiting 19:07:48 (4760): No heartbeat from core client for 30 sec - exiting 19:07:49 (4760): No heartbeat from core client for 30 sec - exiting 19:07:50 (4760): No heartbeat from core client for 30 sec - exiting 19:07:51 (4760): No heartbeat from core client for 30 sec - exiting 19:07:52 (4760): No heartbeat from core client for 30 sec - exiting 19:07:53 (4760): No heartbeat from core client for 30 sec - exiting 19:07:54 (4760): No heartbeat from core client for 30 sec - exiting 19:07:55 (4760): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77498851 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o1ea_2100_40_008116497/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
26 Sep 2012 13:54:58 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 777,600 | 2,715,444 | 3.4921 |
24 Sep 2012 16:27:04 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 751,680 | 2,623,259 | 3.4899 |
22 Sep 2012 15:39:17 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 725,760 | 2,531,340 | 3.4878 |
20 Sep 2012 21:59:26 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 699,840 | 2,442,302 | 3.4898 |
18 Sep 2012 22:33:34 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 673,920 | 2,351,394 | 3.4891 |
17 Sep 2012 08:05:05 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 648,000 | 2,260,207 | 3.4880 |
14 Sep 2012 22:40:11 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 622,080 | 2,168,993 | 3.4867 |
13 Sep 2012 00:35:11 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 596,160 | 2,075,126 | 3.4808 |
11 Sep 2012 10:00:53 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 570,240 | 1,982,112 | 3.4759 |
09 Sep 2012 13:00:59 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 544,320 | 1,890,429 | 3.4730 |
07 Sep 2012 13:00:48 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 518,400 | 1,798,317 | 3.4690 |
05 Sep 2012 14:31:48 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 492,480 | 1,705,040 | 3.4622 |
03 Sep 2012 15:52:45 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 466,560 | 1,613,193 | 3.4576 |
01 Sep 2012 14:16:29 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 440,640 | 1,520,515 | 3.4507 |
30 Aug 2012 15:53:03 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 414,720 | 1,429,292 | 3.4464 |
28 Aug 2012 15:07:26 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 388,800 | 1,337,519 | 3.4401 |
26 Aug 2012 14:16:16 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 362,880 | 1,245,245 | 3.4316 |
24 Aug 2012 17:31:48 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 336,960 | 1,154,449 | 3.4261 |
22 Aug 2012 21:28:33 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 311,040 | 1,064,311 | 3.4218 |
20 Aug 2012 23:07:32 | 979686 | 15055000 | hadcm3n_o1ea_2100_40_008116497_0 | 285,120 | 973,068 | 3.4128 |
©2024 climateprediction.net