climateprediction.net home page
Task 11896662

Task 11896662

Name hadsm3dhet2_u8ch_006725624_6
Workunit 6928967
Created 17 Sep 2010, 8:08:19 UTC
Sent 21 Sep 2010, 20:53:47 UTC
Report deadline 4 Sep 2011, 2:13:47 UTC
Received 9 Oct 2010, 22:12:53 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1042170
Run time 13 days 0 hours 53 min 43 sec
CPU time 12 days 10 hours 15 min 8 sec
Validate state Invalid
Credit 6,947.04
Device peak FLOPS 2.53 GFLOPS
Application version UK Met Office HadSM3 Slab Model v6.07
windows_intelx86
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5008, selfPID=5008, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=2504, selfPID=2504, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4012, selfPID=4012, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=7112, selfPID=7112, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6384, selfPID=6384, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6968, selfPID=6968, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=728, selfPID=728, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5968, selfPID=5968, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5984, selfPID=5984, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=3624, selfPID=3624, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2040, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2040, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2040, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6308, selfPID=6308, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=7908, selfPID=7908, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6508, selfPID=6508, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5192, selfPID=5192, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=7304, selfPID=7304, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5456, selfPID=5456, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=7940, selfPID=7940, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4864, selfPID=4864, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=3508, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=1532, selfPID=1532, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5768, selfPID=5768, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5812, selfPID=5812, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4564, selfPID=4564, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5732, selfPID=5732, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5300, selfPID=5300, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=2388, selfPID=2388, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=2176, selfPID=2176, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=7116, selfPID=7116, iMonCtr=1
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
MainError:	03:56:23 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5920, selfPID=5920, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6432, selfPID=6432, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6156, selfPID=6156, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6192, selfPID=6192, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6204, selfPID=6204, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4648, selfPID=4648, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=2700, selfPID=2700, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6944, selfPID=6944, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=7088, selfPID=7088, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=2080, selfPID=2080, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=3320, selfPID=3320, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5656, selfPID=5656, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5344, selfPID=5344, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=3752, selfPID=3752, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6016, selfPID=6016, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6184, selfPID=6184, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6748, selfPID=6748, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=5924, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=2008, selfPID=2008, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3968, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=1920, selfPID=1920, iMonCtr=1
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
MainError:	02:00:01 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=2916, selfPID=2916, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4836, selfPID=4836, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=3552, selfPID=3552, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6996, selfPID=6996, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=3788, selfPID=3788, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=368, selfPID=368, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6476, selfPID=6476, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=1704, selfPID=1704, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=1948, selfPID=1948, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5852, selfPID=5852, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6816, selfPID=6816, iMonCtr=1
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
CPDN process is not running, exiting, bRetVal = 1, checkPID=4156, selfPID=4156, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=6668, selfPID=6668, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN process is not running, exiting, bRetVal = 1, checkPID=7016, selfPID=7016, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5728, selfPID=5728, iMonCtr=1
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
No heartbeat from core client for 30 sec - exiting
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=488, selfPID=488, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5424, selfPID=5424, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5776, selfPID=5776, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=700, selfPID=700, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5296, selfPID=5296, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=5952, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5252, selfPID=5252, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=984, selfPID=984, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4936, selfPID=4936, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=3916, selfPID=3916, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1
Model crash detected, will try to restart...
forrtl: Access is denied.

CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 237,644 1,069,125 1.4139
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 226,842 1,053,636 1.4136
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 216,040 1,038,123 1.4133
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 205,238 1,022,536 1.4129
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 194,436 1,007,031 1.4125
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 183,634 991,577 1.4122
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 172,832 976,339 1.4123
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 162,030 960,853 1.4119
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 151,228 945,314 1.4115
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 140,426 929,870 1.4112
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 129,624 914,523 1.4110
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 118,822 899,328 1.4111
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 108,020 884,167 1.4112
09 Oct 2010 22:18:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 97,218 868,558 1.4107
06 Oct 2010 09:40:02 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 86,416 852,690 1.4096
06 Oct 2010 03:38:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 75,614 837,367 1.4094
05 Oct 2010 22:48:35 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 64,812 821,887 1.4090
05 Oct 2010 15:42:49 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 54,010 806,002 1.4078
05 Oct 2010 09:59:51 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 43,208 790,230 1.4068
05 Oct 2010 04:05:37 1042170 11896662 hadsm3dhet2_u8ch_006725624_6 32,406 774,536 1.4059


©2024 climateprediction.net