climateprediction.net home page
Task 19890792

Task 19890792

Name wah2_mex50_k0dc_193012_13_435_010668812_0
Workunit 10668812
Created 22 Aug 2016, 14:28:20 UTC
Sent 26 Aug 2016, 19:35:36 UTC
Report deadline 9 Aug 2017, 0:55:36 UTC
Received 11 Sep 2016, 10:19:27 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1312566
Run time 3 days 7 hours 42 min 59 sec
CPU time 3 days 3 hours 57 min 32 sec
Validate state Valid
Credit 9,898.90
Device peak FLOPS 3.48 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.12
windows_intelx86
Peak working set size 242.15 MB
Peak swap size 170.77 MB
Peak disk usage 75.48 MB
Stderr 
<core_client_version>7.6.9</core_client_version>
<![CDATA[
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x7784E064 read attempt to address 0x64306AFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 08/26/16 16:43:28
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\slots\1;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.12_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077820000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076820000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 00000000757e0000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076990000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.19061) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076620000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.23457) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.23457 (win7sp1_ldr.160518-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23457

ModLoad: 0000000076950000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.23453) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.23453 (win7sp1_ldr.160513-1233)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23453

ModLoad: 0000000076a90000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.19054) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.19054 (win7sp1_gdr.151103-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.19054

ModLoad: 0000000075380000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000077160000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.23418 (win7sp1_ldr.160408-2045)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23418

ModLoad: 0000000076d10000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076d30000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.23497) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075130000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.23497) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.23497 (win7sp1_ldr.160708-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23497

ModLoad: 0000000075120000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.23497) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.23497 (win7sp1_ldr.160708-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23497

ModLoad: 0000000075320000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000077320000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006bb00000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076710000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006c010000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.19050) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006c4c0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000071c80000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 19287, Write: 0, Other 70145

- I/O Transfers Counters -
Read: 0, Write: 3177, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 193376, QuotaPeakPagedPoolUsage: 193376
QuotaNonPagedPoolUsage: 7688, QuotaPeakNonPagedPoolUsage: 7768

- Virtual Memory Usage -
VirtualSize: 105238528, PeakVirtualSize: 105238528

- Pagefile Usage -
PagefileUsage: 2588672, PeakPagefileUsage: 2965504

- Working Set Size -
WorkingSetSize: 78458880, PeakWorkingSetSize: 78643200, PageFaultCount: 20129

*** Dump of thread ID 6232 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 10941947.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x7784E064 read attempt to address 0x64306AFF

- Registers -
eax=64306af8 ebx=64306b00 ecx=914dc218 edx=003fe8b8 esi=00c30000 edi=00000000
eip=7784e064 esp=0582fe5c ebp=0582fe6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
0582fe6c 768314bd 00c30000 00000000 64306b00 0582fe94 ntdll!RtlFreeHeap+0x0 
0582fe80 004831db 00c30000 00000000 64306b00 0582feac kernel32!HeapFree+0x0 
0582fe94 004485a1 64306b00 00000000 01140020 80000000 wah2_8.12_windows_intelx86!+0x0 
0582feac 0044fd08 01140020 00000000 0051d6a8 0582fefc wah2_8.12_windows_intelx86!+0x0 
0582fec0 00485b9c 00000015 94cf3ce4 00000001 00000006 wah2_8.12_windows_intelx86!+0x0 
0582fefc 768d7609 00000006 94c307bc 00000000 00000000 wah2_8.12_windows_intelx86!+0x0 
0582ff88 7683338a 00000006 0582ffd4 77859902 80000006 kernel32!CtrlRoutine+0x0 
0582ff94 77859902 80000006 7bff7aaf 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0582ffd4 778598d5 768d7454 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0582ffec 00000000 768d7454 80000006 00000000 4a5c74c2 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 7484 (state: Ready): ***

- Information -
Status: Base Priority: Above Normal, Priority: Above Normal, , Kernel Time: 13572087.000000, User Time: 61932396.000000, Wait Time: 10941948.000000

- Registers -
eax=00000000 ebx=004d0c41 ecx=00000000 edx=00000000 esi=0018efbc edi=00000000
eip=7783fda1 esp=0018ef78 ebp=0018efe0
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018efe0 757f460c 000000c8 00000000 0018f004 004691c1 ntdll!NtDelayExecution+0x0 
0018eff0 004691c1 000000c8 000000c8 00000000 0018f03c KERNELBASE!Sleep+0x0 
0018f004 00407f7d a0000000 027f9999 004d0c48 00000020 wah2_8.12_windows_intelx86!+0x0 
0018f03c 00409542 00000000 91553f50 00000000 00000000 wah2_8.12_windows_intelx86!+0x0 
0018fd48 00409731 0018fef8 004097af 004d1368 0018fd68 wah2_8.12_windows_intelx86!+0x0 
0018fd50 004097af 004d1368 0018fd68 006e3418 0018fd68 wah2_8.12_windows_intelx86!+0x0 
0018fef8 0048611b 00400000 00000000 006e3456 0000000a wah2_8.12_windows_intelx86!+0x0 
0018ff88 7683338a 7efde000 0018ffd4 77859902 7efde000 wah2_8.12_windows_intelx86!+0x0 
0018ff94 77859902 7efde000 7e657aaf 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 778598d5 0048616e 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 0048616e 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 6832 (state: Ready): ***

- Information -
Status: Base Priority: Unknown, Priority: Unknown, , Kernel Time: 312002.000000, User Time: 468003.000000, Wait Time: 10941948.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=0113fd24 edi=00000000
eip=7783fda1 esp=0113fce0 ebp=0113fd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0113fd48 757f460c 00000064 00000000 0113ff88 004790c4 ntdll!NtDelayExecution+0x0 
0113fd58 004790c4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
0113ff88 7683338a 00000000 0113ffd4 77859902 00000000 wah2_8.12_windows_intelx86!+0x0 
0113ff94 77859902 00000000 7f6e7aaf 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0113ffd4 778598d5 004790a0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0113ffec 00000000 004790a0 00000000 00000000 32686177 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9040, selfPID=8332, iMonCtr=1
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9040, selfPID=9040, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=5952, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5952, selfPID=3860, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4652, selfPID=4652, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4652, selfPID=1108, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1196, selfPID=5536, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1196, selfPID=1196, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Leaving CPDN_Main::Monitor...
05:17:40 (4492): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Sep 2016 09:17:56 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 150,059 273,330 1.8215
10 Sep 2016 16:14:52 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 138,539 251,857 1.8180
10 Sep 2016 10:03:32 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 127,019 230,710 1.8163
10 Sep 2016 03:01:34 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 115,499 209,972 1.8180
09 Sep 2016 21:10:08 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 103,979 189,265 1.8202
09 Sep 2016 15:21:59 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 92,459 168,936 1.8271
08 Sep 2016 23:59:20 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 80,939 148,499 1.8347
08 Sep 2016 15:06:50 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 69,419 126,414 1.8210
04 Sep 2016 20:08:16 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 57,899 104,518 1.8052
03 Sep 2016 18:16:00 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 46,379 83,024 1.7901
01 Sep 2016 17:01:07 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 34,859 62,490 1.7927
01 Sep 2016 02:07:44 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 23,339 42,662 1.8279
31 Aug 2016 18:36:07 1312566 19890792 wah2_mex50_k0dc_193012_13_435_010668812_0 11,819 22,310 1.8876


©2024 climateprediction.net