climateprediction.net home page
Task 19905772

Task 19905772

Name wah2_mex50_kbe0_193312_13_436_010683085_0
Workunit 10683085
Created 23 Aug 2016, 3:51:13 UTC
Sent 23 Aug 2016, 11:14:28 UTC
Report deadline 5 Aug 2017, 16:34:28 UTC
Received 4 Sep 2016, 7:01:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1402267
Run time 5 days 15 hours 6 min 34 sec
CPU time 5 days 9 hours 43 min 43 sec
Validate state Invalid
Credit 8,379.03
Device peak FLOPS 3.04 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.12
windows_intelx86
Peak working set size 190.84 MB
Peak swap size 170.81 MB
Peak disk usage 24.71 MB
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
The storage control block address is invalid.
 (0x9) - exit code 9 (0x9)
</message>
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x77E0E9A4 read attempt to address 0x65626AFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 08/23/16 20:01:17
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\8;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.12_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077df0000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.23455) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000077250000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.23455) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000075890000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.23455) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000075780000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.19061) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075970000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.23457) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.23457 (win7sp1_ldr.160518-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23457

ModLoad: 0000000076ab0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.23453) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.23453 (win7sp1_ldr.160513-1233)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23453

ModLoad: 0000000076ec0000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.19054) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.19054 (win7sp1_gdr.151103-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.19054

ModLoad: 00000000771a0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000077390000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.23455) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.23455 (win7sp1_ldr.160516-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23455

ModLoad: 0000000077360000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000774c0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.23497) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075700000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.23497) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.23497 (win7sp1_ldr.160708-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23497

ModLoad: 00000000756f0000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.23497) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.23497 (win7sp1_ldr.160708-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23497

ModLoad: 0000000075910000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000077730000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075590000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000077470000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000071710000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.19050) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075310000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075620000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 16218, Write: 0, Other 58535

- I/O Transfers Counters -
Read: 0, Write: 6903, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 193384, QuotaPeakPagedPoolUsage: 193384
QuotaNonPagedPoolUsage: 7688, QuotaPeakNonPagedPoolUsage: 7768

- Virtual Memory Usage -
VirtualSize: 105242624, PeakVirtualSize: 105242624

- Pagefile Usage -
PagefileUsage: 2600960, PeakPagefileUsage: 3280896

- Working Set Size -
WorkingSetSize: 78454784, PeakWorkingSetSize: 79294464, PageFaultCount: 20464

*** Dump of thread ID 1720 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2772409.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x77E0E9A4 read attempt to address 0x65626AFF

- Registers -
eax=65626af8 ebx=65626b00 ecx=182da89c edx=0561e8b8 esi=003f0000 edi=00000000
eip=77e0e9a4 esp=0571fe5c ebp=0571fe6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
0571fe6c 772614bd 003f0000 00000000 65626b00 0571fe94 ntdll!RtlFreeHeap+0x0 
0571fe80 004831db 003f0000 00000000 65626b00 0571feac kernel32!HeapFree+0x0 
0571fe94 004485a1 65626b00 00000000 00ff0020 80000000 wah2_8.12_windows_intelx86!+0x0 
0571feac 0044fd08 00ff0020 00000000 0051d6a8 0571fefc wah2_8.12_windows_intelx86!+0x0 
0571fec0 00485b9c 00000015 1d5c5660 00000001 00000006 wah2_8.12_windows_intelx86!+0x0 
0571fefc 77307609 00000006 1d5c7438 00000000 00000000 wah2_8.12_windows_intelx86!+0x0 
0571ff88 7726338a 00000006 0571ffd4 77e1a242 80000006 kernel32!CtrlRoutine+0x0 
0571ff94 77e1a242 80000006 72753666 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0571ffd4 77e1a215 77307454 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0571ffec 00000000 77307454 80000006 00000000 2b51e9fa ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 7356 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 13884089.000000, User Time: 72696464.000000, Wait Time: 2772398.000000

- Registers -
eax=00000000 ebx=004d0c41 ecx=00000000 edx=00000000 esi=0018efbc edi=00000000
eip=77e006e9 esp=0018ef78 ebp=0018efe0
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018efe0 758a460c 000000c8 00000000 0018f004 004691c1 ntdll!NtDelayExecution+0x0 
0018eff0 004691c1 000000c8 000000c8 00000000 0018f03c KERNELBASE!Sleep+0x0 
0018f004 00407f7d a0000000 027f9999 004d0c48 00000020 wah2_8.12_windows_intelx86!+0x0 
0018f03c 00409542 00000000 183555d4 00000000 00000000 wah2_8.12_windows_intelx86!+0x0 
0018fd48 00409731 0018fef8 004097af 004d1368 0018fd68 wah2_8.12_windows_intelx86!+0x0 
0018fd50 004097af 004d1368 0018fd68 00243720 0018fd68 wah2_8.12_windows_intelx86!+0x0 
0018fef8 0048611b 00400000 00000000 0024375e 0000000a wah2_8.12_windows_intelx86!+0x0 
0018ff88 7726338a 7efde000 0018ffd4 77e1a242 7efde000 wah2_8.12_windows_intelx86!+0x0 
0018ff94 77e1a242 7efde000 771c3666 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 77e1a215 0048616e 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 0048616e 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 4780 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 1092007.000000, User Time: 1872012.000000, Wait Time: 2772409.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=00fefd24 edi=00000000
eip=77e006e9 esp=00fefce0 ebp=00fefd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
00fefd48 758a460c 00000064 00000000 00feff88 004790c4 ntdll!NtDelayExecution+0x0 
00fefd58 004790c4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
00feff88 7726338a 00000000 00feffd4 77e1a242 00000000 wah2_8.12_windows_intelx86!+0x0 
00feff94 77e1a242 00000000 77fa3666 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
00feffd4 77e1a215 004790a0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
00feffec 00000000 004790a0 00000000 00000000 32686177 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3248, selfPID=6944, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3248, selfPID=3248, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7600, selfPID=7600, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7600, selfPID=8120, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=2944, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=2900, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2420, selfPID=2420, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2420, selfPID=2440, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4052, selfPID=4052, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4052, selfPID=880, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4284, selfPID=4284, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4284, selfPID=4392, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2468, selfPID=2512, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2468, selfPID=2468, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2556, selfPID=2556, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2556, selfPID=2572, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Sep 2016 12:34:23 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 127,019 435,371 3.4276
02 Sep 2016 12:53:49 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 115,499 394,743 3.4177
01 Sep 2016 11:34:37 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 103,979 353,962 3.4042
31 Aug 2016 14:00:02 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 92,459 314,194 3.3982
29 Aug 2016 17:51:53 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 80,939 275,241 3.4006
28 Aug 2016 20:33:10 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 69,419 236,190 3.4024
28 Aug 2016 09:10:33 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 57,899 196,883 3.4005
26 Aug 2016 18:38:21 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 46,379 157,531 3.3966
26 Aug 2016 07:04:52 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 34,859 118,487 3.3990
25 Aug 2016 09:11:32 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 23,339 79,424 3.4031
24 Aug 2016 11:08:09 1402267 19905772 wah2_mex50_kbe0_193312_13_436_010683085_0 11,819 40,546 3.4306


©2024 climateprediction.net