climateprediction.net home page
Task 20847670

Task 20847670

Name wah2_pnw25_rbq6_199912_24_664_011271313_2
Workunit 11271313
Created 23 Oct 2017, 10:22:58 UTC
Sent 23 Oct 2017, 10:35:24 UTC
Report deadline 5 Oct 2018, 15:55:24 UTC
Received 25 Oct 2017, 9:40:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1410283
Run time 1 days 22 hours 26 min 18 sec
CPU time 1 days 20 hours 15 min 50 sec
Validate state Invalid
Credit 8,379.03
Device peak FLOPS 3.64 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 167.01 MB
Peak swap size 166.00 MB
Peak disk usage 1.65 MB
Stderr 
<core_client_version>7.6.33</core_client_version>
<![CDATA[
<message>
 - exit code 9 (0x9)
</message>
<stderr_txt>
18:39:29 (12536): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x028D43AC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 10/23/17 20:04:25
Install Directory : 
Data Directory    : D:\Boinc
Project Symstore  : 
LoadLibraryA( D:\Boinc\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Boinc\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Boinc\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Boinc\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Boinc\slots\1;D:\Boinc\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 D:\Boinc\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077160000 000000000018d000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000768e0000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000075a60000 00000000001d7000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000758e0000 0000000000175000 C:\WINDOWS\System32\USER32.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000075c40000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000076810000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000075ed0000 000000000015e000 C:\WINDOWS\System32\gdi32full.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000076330000 000000000007c000 C:\WINDOWS\System32\msvcp_win.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000075c90000 0000000000117000 C:\WINDOWS\System32\ucrtbase.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000076790000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000075820000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 7.0.16299.15

ModLoad: 0000000074420000 0000000000043000 C:\WINDOWS\System32\sechost.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 00000000766d0000 00000000000be000 C:\WINDOWS\System32\RPCRT4.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000073b80000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000073b70000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000074170000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000071710000 0000000000028000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000073970000 0000000000181000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15

ModLoad: 0000000073960000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.16299.15) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.16299.15 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.16299.15



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 26840, Write: 0, Other 112835

- I/O Transfers Counters -
Read: 0, Write: 2475, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 201960, QuotaPeakPagedPoolUsage: 202232
QuotaNonPagedPoolUsage: 8208, QuotaPeakNonPagedPoolUsage: 9040

- Virtual Memory Usage -
VirtualSize: 142348288, PeakVirtualSize: 142376960

- Pagefile Usage -
PagefileUsage: 2981888, PeakPagefileUsage: 3092480

- Working Set Size -
WorkingSetSize: 79446016, PeakWorkingSetSize: 80494592, PageFaultCount: 20852

*** Dump of thread ID 4792 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 345826.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x028D43AC

- Registers -
eax=00000015 ebx=fffffffe ecx=00000000 edx=00000000 esi=02804020 edi=00000000
eip=00463007 esp=028ffe7c ebp=028ffe80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010216

- Callstack -
ChildEBP RetAddr  Args to Child
028ffe80 0044826f 02804020 00000000 02804020 fffffffe wah2_8.24_windows_intelx86!+0x0 
028ffe98 0044fa68 02804020 00000000 0051d6b0 028ffee8 wah2_8.24_windows_intelx86!+0x0 
028ffeac 004856fc 00000015 d202ff4c 00000006 0048566c wah2_8.24_windows_intelx86!+0x0 
028ffee8 75bb13a9 00000006 5d3ece2f 75bb11f0 75bb11f0 wah2_8.24_windows_intelx86!+0x0 
028fff80 768f8654 80000006 768f8630 a70a1d2a 028fffdc KERNELBASE!CtrlRoutine+0x0 
028fff94 771c4a47 80000006 ed5154d6 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
028fffdc 771c4a17 ffffffff 771e9ed1 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
028fffec 00000000 75bb11f0 80000006 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 4244 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 15625000.000000, User Time: 72500000.000000, Wait Time: 345822.000000

- Registers -
eax=00000000 ebx=00000050 ecx=00000000 edx=00000000 esi=00000000 edi=00000e65
eip=771ceaac esp=0019ed38 ebp=0019ed9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0019ed9c 75b6285f 000000c8 00000000 0019edc0 00468ec1 ntdll!ZwDelayExecution+0x0 
0019edac 00468ec1 000000c8 000000c8 00000000 0019edf8 KERNELBASE!Sleep+0x0 
0019edc0 00407a89 a0000000 027f9999 00000000 004d0c50 wah2_8.24_windows_intelx86!+0x0 
0019edf8 004092c5 00000000 d094fce4 00485cce 00000000 wah2_8.24_windows_intelx86!+0x0 
0019fd40 004094b7 0019fef0 00409535 004d1370 0019fd60 wah2_8.24_windows_intelx86!+0x0 
0019fd48 00409535 004d1370 0019fd60 025e2d48 0019fd60 wah2_8.24_windows_intelx86!+0x0 
0019fef0 00485c7b 00400000 00000000 025e2d86 0000000a wah2_8.24_windows_intelx86!+0x0 
0019ff80 768f8654 002cd000 768f8630 a59c1d2a 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 771c4a47 002cd000 efc754d6 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 771c4a17 ffffffff 771e9ed1 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 002cd000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 4588 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 345822.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=771ceaac esp=0359fcdc ebp=0359fd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0359fd40 75b6285f 00000064 00000000 0359ff80 00478b44 ntdll!ZwDelayExecution+0x0 
0359fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
0359ff80 768f8654 00000000 768f8630 a6dc1d2a 0359ffdc wah2_8.24_windows_intelx86!+0x0 
0359ff94 771c4a47 00000000 ec8754d6 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0359ffdc 771c4a17 ffffffff 771e9ed1 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0359ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12536, selfPID=12536, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12536, selfPID=6168, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7952, selfPID=8132, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7952, selfPID=7952, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Oct 2017 07:07:13 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 127,019 150,418 1.1842
25 Oct 2017 04:01:27 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 115,499 136,760 1.1841
24 Oct 2017 23:07:36 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 103,979 123,014 1.1831
24 Oct 2017 19:04:53 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 92,459 109,287 1.1820
24 Oct 2017 15:06:07 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 80,939 95,575 1.1808
24 Oct 2017 11:18:58 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 69,419 81,866 1.1793
24 Oct 2017 07:06:00 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 57,899 68,209 1.1781
24 Oct 2017 03:07:51 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 46,379 54,599 1.1772
23 Oct 2017 23:05:05 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 34,859 40,888 1.1730
23 Oct 2017 20:04:44 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 23,339 27,276 1.1687
23 Oct 2017 15:16:05 1410283 20847670 wah2_pnw25_rbq6_199912_24_664_011271313_2 11,819 13,902 1.1762


©2024 climateprediction.net