climateprediction.net home page
Task 21652680

Task 21652680

Name wah2_sam50_a172_201412_24_813_011838702_0
Workunit 11838702
Created 4 May 2019, 21:08:07 UTC
Sent 5 May 2019, 6:00:34 UTC
Report deadline 16 Apr 2020, 11:20:34 UTC
Received 11 May 2019, 6:00:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -529697949 (0xE06D7363) Unknown error code
Computer ID 1456908
Run time 2 days 3 hours 14 min 20 sec
CPU time 2 days 2 hours 31 min 23 sec
Validate state Invalid
Credit 9,898.90
Device peak FLOPS 5.00 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 224.57 MB
Peak swap size 188.42 MB
Peak disk usage 298.69 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
(unknown error) - exit code -529697949 (0xe06d7363)</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75FBC6F2

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 05/10/19 17:10:33
Install Directory : 
Data Directory    : E:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( E:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( E:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: E:\ProgramData\BOINC\projects\climateprediction.net\wah2_sam50_a172_201412_24_813_011838702;E:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 E:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077590000 000000000019c000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17763.404) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076780000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17763.437) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000075ea0000 00000000001fa000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17763.404) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074d90000 0000000000199000 C:\WINDOWS\System32\USER32.dll (6.2.17763.168) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000077100000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076100000 0000000000023000 C:\WINDOWS\System32\GDI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074c20000 0000000000167000 C:\WINDOWS\System32\gdi32full.dll (6.2.17763.437) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17763.437 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.437

ModLoad: 00000000758d0000 0000000000080000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076e10000 0000000000122000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17763.404) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17763.404 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.404

ModLoad: 0000000076130000 000000000007e000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000076f40000 00000000000c0000 C:\WINDOWS\System32\msvcrt.dll (7.0.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17763.1

ModLoad: 00000000756b0000 0000000000079000 C:\WINDOWS\System32\sechost.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000755f0000 00000000000bf000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17763.379) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074c00000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074bf0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000768f0000 0000000000062000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 00000000768c0000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000069740000 0000000000029000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000062ec0000 0000000000086000 E:\ProgramData\BOINC\projects\climateprediction.net\wah2_se_8.24_windows_intelx86.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\umtonc.pdb

ModLoad: 00000000695b0000 000000000018f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1

ModLoad: 0000000074b80000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17763.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17763.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17763.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 889416, Write: 0, Other 722076

- I/O Transfers Counters -
Read: 0, Write: 18545, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 244544, QuotaPeakPagedPoolUsage: 244544
QuotaNonPagedPoolUsage: 9640, QuotaPeakNonPagedPoolUsage: 9640

- Virtual Memory Usage -
VirtualSize: 186851328, PeakVirtualSize: 194031616

- Pagefile Usage -
PagefileUsage: 4272128, PeakPagefileUsage: 66826240

- Working Set Size -
WorkingSetSize: 78737408, PeakWorkingSetSize: 143687680, PageFaultCount: 453808

*** Dump of thread ID 16108 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 123125000.000000, User Time: 1115000064.000000, Wait Time: 29603088.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75FBC6F2

- Registers -
eax=0019e680 ebx=06eb9ff8 ecx=00000003 edx=00000000 esi=62f2922c edi=62f3c450
eip=75fbc6f2 esp=0019e680 ebp=0019e6dc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
0019e6dc 62f0caf9 e06d7363 00000001 00000003 0019e708 KERNELBASE!RaiseException+0x0 
0019e714 62f09ebc 0019e724 62f359d8 62f2922c 62f2b27c wah2_se_8.24_windows_intelx86!umtonc+0x0 
0019e734 62ece42b 03527300 06eb9ff8 004e4d99 06ee18d0 wah2_se_8.24_windows_intelx86!umtonc+0x0 
0019e750 62ec29b1 0019e788 0019e874 0019e85c 0019e850 wah2_se_8.24_windows_intelx86!+0x0 
0019e998 62ecefac 06f82ad0 0019ea2d 00000000 0019eb34 wah2_se_8.24_windows_intelx86!+0x0 
0019eb34 0040bdf2 004e4d98 004e4ed0 004e4c90 00000000 wah2_se_8.24_windows_intelx86!umtonc+0x0 
0019eb6c 00401f39 0257ef90 0257efc8 0257efc8 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ebc0 004021ad 000007e0 00000001 00000000 004cefe0 wah2_8.24_windows_intelx86!+0x0 
0019ed88 00402703 000007e0 00000001 02860040 0019ede8 wah2_8.24_windows_intelx86!+0x0 
0019ed9c 0040724e 000007e0 02860040 004cefe0 004a56b0 wah2_8.24_windows_intelx86!+0x0 
0019ede8 004092c5 00000000 c31969c1 00485cce 00000000 wah2_8.24_windows_intelx86!+0x0 
0019fd30 004094b7 0019fee0 00409535 004d1370 0019fd50 wah2_8.24_windows_intelx86!+0x0 
0019fd38 00409535 004d1370 0019fd50 005f4668 0019fd50 wah2_8.24_windows_intelx86!+0x0 
0019fee0 00485c7b 00400000 00000000 005f46a6 0000000a wah2_8.24_windows_intelx86!+0x0 
0019ff70 767a0419 0026f000 767a0400 0019ffdc 775f662d wah2_8.24_windows_intelx86!+0x0 
0019ff80 775f662d 0026f000 054d6a00 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 775f65fd ffffffff 77615180 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 0026f000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 19404 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 156250.000000, User Time: 781250.000000, Wait Time: 29603084.000000

- Registers -
eax=00000000 ebx=0267fd0c ecx=00000000 edx=00000000 esi=00000000 edi=0267fd0c
eip=776007ec esp=0267fccc ebp=0267fd30
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0267fd30 75fadb6f 00000064 00000000 0267ff70 00478b44 ntdll!ZwDelayExecution+0x0 
0267fd40 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
0267ff70 767a0419 00000000 767a0400 0267ffdc 775f662d wah2_8.24_windows_intelx86!+0x0 
0267ff80 775f662d 00000000 07336a00 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0267ffdc 775f65fd ffffffff 77615180 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0267ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9556, selfPID=9556, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9556, selfPID=4780, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 May 2019 06:02:37 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 150,059 169,130 1.1271
11 May 2019 06:02:37 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 138,539 157,357 1.1358
11 May 2019 06:02:37 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 127,019 145,549 1.1459
10 May 2019 10:04:14 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 115,499 133,706 1.1576
10 May 2019 07:04:07 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 103,979 121,880 1.1722
10 May 2019 06:02:33 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 92,459 108,685 1.1755
10 May 2019 06:02:33 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 80,939 94,704 1.1701
10 May 2019 06:02:33 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 69,419 80,392 1.1581
10 May 2019 06:02:33 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 57,899 67,910 1.1729
09 May 2019 11:05:50 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 46,379 55,937 1.2061
09 May 2019 06:01:04 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 34,859 42,733 1.2259
09 May 2019 06:01:04 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 23,339 27,762 1.1895
09 May 2019 06:01:04 1456908 21652680 wah2_sam50_a172_201412_24_813_011838702_0 11,819 13,849 1.1718


©2024 climateprediction.net