climateprediction.net home page
Task 21354614

Task 21354614

Name wah2_global_e1nl_200412_145_766_011656517_0
Workunit 11656517
Created 4 Nov 2018, 20:14:26 UTC
Sent 5 Nov 2018, 2:58:32 UTC
Report deadline 18 Oct 2019, 8:18:32 UTC
Received 17 Nov 2018, 10:45:43 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1445153
Run time 8 days 4 hours 28 min 26 sec
CPU time 7 days 9 hours 4 min 38 sec
Validate state Invalid
Credit 11,973.42
Device peak FLOPS 3.85 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 245.44 MB
Peak swap size 174.33 MB
Peak disk usage 202.88 MB
Stderr
<core_client_version>7.12.1</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3136, selfPID=0, iMonCtr=1
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3136, selfPID=3136, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5912, selfPID=5912, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5912, selfPID=15668, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
04:45:28 (15668): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_64.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_65.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_66.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_67.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_68.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_69.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_70.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_71.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_72.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_73.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_74.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_86.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_87.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_88.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_89.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_90.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_91.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_92.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_93.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_94.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_95.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_96.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_97.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_98.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_99.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_100.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_101.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_102.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_103.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_104.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_105.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_106.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e1nl_200412_145_766_011656517_0_r1397094807_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Nov 2018 07:34:47 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 181,507 628,737 3.4640
17 Nov 2018 02:43:55 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 178,627 618,955 3.4651
16 Nov 2018 22:37:25 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 175,747 609,389 3.4674
16 Nov 2018 19:37:03 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 172,867 599,893 3.4703
16 Nov 2018 17:12:49 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 169,987 591,361 3.4789
16 Nov 2018 12:34:34 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 167,107 582,846 3.4879
16 Nov 2018 10:04:31 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 164,227 574,173 3.4962
15 Nov 2018 02:38:34 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 161,347 565,601 3.5055
14 Nov 2018 23:34:32 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 158,467 557,147 3.5159
14 Nov 2018 20:34:10 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 155,587 547,969 3.5219
14 Nov 2018 14:08:45 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 152,707 538,892 3.5289
14 Nov 2018 12:05:04 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 149,827 530,499 3.5407
14 Nov 2018 08:39:26 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 146,947 522,112 3.5531
14 Nov 2018 06:06:06 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 144,067 513,556 3.5647
14 Nov 2018 03:01:47 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 141,187 504,695 3.5747
13 Nov 2018 20:47:34 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 138,307 494,876 3.5781
13 Nov 2018 17:42:55 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 135,427 484,569 3.5781
13 Nov 2018 13:39:37 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 132,547 473,863 3.5751
13 Nov 2018 09:37:54 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 129,667 463,150 3.5718
13 Nov 2018 06:33:22 1445153 21354614 wah2_global_e1nl_200412_145_766_011656517_0 126,787 452,504 3.5690


©2024 climateprediction.net