climateprediction.net home page
Task 20573682

Task 20573682

Name wah2_sas50_l77o_201012_13_617_011140897_0
Workunit 11140897
Created 25 Jul 2017, 13:42:17 UTC
Sent 25 Jul 2017, 17:05:22 UTC
Report deadline 7 Jul 2018, 22:25:22 UTC
Received 11 Aug 2017, 2:53:12 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1415397
Run time 6 days 8 hours 19 min 32 sec
CPU time 6 days 1 hours 35 min 48 sec
Validate state Invalid
Credit 9,138.96
Device peak FLOPS 3.33 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 233.54 MB
Peak swap size 198.98 MB
Peak disk usage 105.15 MB
Stderr 
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
finish file present too long
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5120, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3540, selfPID=4040, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2644, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3204, iMonCtr=2
Leaving CPDN_ain::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: 
Leaving CPDN_ain::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3156, selfPID=3596, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3492, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: 
Leaving CPDN_ain::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:52:51 (5940): Can't acquire lockfile (32) - waiting 35s
16:53:26 (5940): Can't acquire lockfile (32) - exiting
16:53:26 (5940): Error: 
17:53:22 (5908): Can't acquire lockfile (32) - waiting 35s
17:53:57 (5908): Can't acquire lockfile (32) - exiting
17:53:57 (5908): Error: 
18:04:32 (3112): Can't acquire lockfile (32) - waiting 35s
18:05:07 (3112): Can't acquire lockfile (32) - exiting
18:05:07 (3112): Error: 
18:54:22 (5928): Can't acquire lockfile (32) - waiting 35s
18:54:57 (5928): Can't acquire lockfile (32) - exiting
18:54:57 (5928): Error: 
19:05:01 (832): Can't acquire lockfile (32) - waiting 35s
19:05:36 (832): Can't acquire lockfile (32) - exiting
19:05:36 (832): Error: 
19:15:40 (4320): Can't acquire lockfile (32) - waiting 35s
19:16:15 (4320): Can't acquire lockfile (32) - exiting
19:16:15 (4320): Error: 
19:49:46 (3700): Can't acquire lockfile (32) - waiting 35s
19:50:21 (3700): Can't acquire lockfile (32) - exiting
19:50:21 (3700): Error: 
20:01:04 (4324): Can't acquire lockfile (32) - waiting 35s
20:01:39 (4324): Can't acquire lockfile (32) - exiting
20:01:39 (4324): Error: 
20:11:51 (4836): Can't acquire lockfile (32) - waiting 35s
20:12:26 (4836): Can't acquire lockfile (32) - exiting
20:12:26 (4836): Error: 
20:22:55 (5708): Can't acquire lockfile (32) - waiting 35s
20:23:30 (5708): Can't acquire lockfile (32) - exiting
20:23:30 (5708): Error: 
20:33:47 (2760): Can't acquire lockfile (32) - waiting 35s
20:34:22 (2760): Can't acquire lockfile (32) - exiting
20:34:22 (2760): Error: 
20:52:32 (5060): Can't acquire lockfile (32) - waiting 35s
20:53:07 (5060): Can't acquire lockfile (32) - exiting
20:53:07 (5060): Error: 
21:03:46 (5504): Can't acquire lockfile (32) - waiting 35s
21:04:21 (5504): Can't acquire lockfile (32) - exiting
21:04:21 (5504): Error: 
21:14:31 (1620): Can't acquire lockfile (32) - waiting 35s
21:15:06 (1620): Can't acquire lockfile (32) - exiting
21:15:06 (1620): Error: 
21:25:37 (3408): Can't acquire lockfile (32) - waiting 35s
21:26:12 (3408): Can't acquire lockfile (32) - exiting
21:26:12 (3408): Error: 
21:36:42 (3848): Can't acquire lockfile (32) - waiting 35s
21:37:17 (3848): Can't acquire lockfile (32) - exiting
21:37:17 (3848): Error: 
21:55:31 (1632): Can't acquire lockfile (32) - waiting 35s
21:56:06 (1632): Can't acquire lockfile (32) - exiting
21:56:06 (1632): Error: 
Leaving CPDN_ain::Monitor...
22:12:14 (2460): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x01DB012C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 08/11/17 09:51:45
Install Directory : C:\Program Files\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\Program Files\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Program Files\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077650000 000000000013c000 C:\Windows\SYSTEM32\ntdll.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076ca0000 00000000000d4000 C:\Windows\system32\kernel32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernel32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075990000 000000000004a000 C:\Windows\system32\KERNELBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : kernelbase.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075bf0000 00000000000c9000 C:\Windows\system32\USER32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : user32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076f80000 000000000004e000 C:\Windows\system32\GDI32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : gdi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076d80000 000000000000a000 C:\Windows\system32\LPK.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : lpk.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000777e0000 000000000009d000 C:\Windows\system32\USP10.dll (1.626.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7600.16385

ModLoad: 00000000774f0000 00000000000ac000 C:\Windows\system32\msvcrt.dll (7.0.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 7.0.7600.16385

ModLoad: 0000000075b30000 00000000000a0000 C:\Windows\system32\ADVAPI32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076d90000 0000000000019000 C:\Windows\SYSTEM32\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000775a0000 00000000000a1000 C:\Windows\system32\RPCRT4.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : rpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075bd0000 000000000001f000 C:\Windows\system32\IMM32.DLL (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : imm32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000773a0000 00000000000cc000 C:\Windows\system32\MSCTF.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000073280000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074ca0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 7343, Write: 0, Other 43652

- I/O Transfers Counters -
Read: 0, Write: 2816, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 67700, QuotaPeakPagedPoolUsage: 67700
QuotaNonPagedPoolUsage: 2640, QuotaPeakNonPagedPoolUsage: 3260

- Virtual Memory Usage -
VirtualSize: 37548032, PeakVirtualSize: 38404096

- Pagefile Usage -
PagefileUsage: 1830912, PeakPagefileUsage: 2506752

- Working Set Size -
WorkingSetSize: 3608576, PeakWorkingSetSize: 4182016, PageFaultCount: 1131

*** Dump of thread ID 3632 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 4062500.000000, User Time: 11562500.000000, Wait Time: 5114.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x01DB012C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0012de5c edx=01db012c esi=0012dc14 edi=0012de8c
eip=0048ee46 esp=0012dba8 ebp=0012de38
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0012de38 0048161c 0012de5c 004b63b8 00000000 0012de8c wah2_8.24_windows_intelx86!+0x0 
0012de7c 0044fa52 01db012c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0012de9c 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0012deb4 00485ca1 c0000005 0012dee8 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0012ff88 76cf1174 7ffdf000 0012ffd4 776ab3f5 7ffdf000 wah2_8.24_windows_intelx86!+0x0 
0012ff94 776ab3f5 7ffdf000 77606f5b 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0012ffd4 776ab3c8 00485cce 7ffdf000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0012ffec 00000000 00485cce 7ffdf000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 3764 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 5108.000000

- Registers -
eax=01cef900 ebx=00000000 ecx=5cd52c88 edx=776964f4 esi=01cefd24 edi=00000000
eip=776964f4 esp=01cefce0 ebp=01cefd48
cs=001b  ss=0023  ds=0023  es=0023  fs=003b  gs=0000             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
01cefd48 75991818 00000064 00000000 01ceff88 00478b44 ntdll!KiFastSystemCallRet+0x0 
01cefd58 00478b44 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
01ceff88 76cf1174 00000000 01ceffd4 776ab3f5 00000000 wah2_8.24_windows_intelx86!+0x0 
01ceff94 776ab3f5 00000000 76bc6f5b 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
01ceffd4 776ab3c8 00478b20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
01ceffec 00000000 00478b20 00000000 00000000 02720000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Aug 2017 00:53:03 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 138,539 496,878 3.5866
09 Aug 2017 11:57:49 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 127,019 451,121 3.5516
02 Aug 2017 07:26:42 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 115,499 397,750 3.4438
01 Aug 2017 18:17:13 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 103,979 352,295 3.3881
01 Aug 2017 04:30:13 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 92,459 305,421 3.3033
31 Jul 2017 14:34:45 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 80,939 257,539 3.1819
31 Jul 2017 01:21:44 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 69,419 212,301 3.0583
27 Jul 2017 18:22:06 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 57,899 162,829 2.8123
27 Jul 2017 04:47:13 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 46,379 116,415 2.5101
26 Jul 2017 15:05:11 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 34,859 69,564 1.9956
26 Jul 2017 02:45:38 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 23,339 34,291 1.4693
25 Jul 2017 22:09:21 1415397 20573682 wah2_sas50_l77o_201012_13_617_011140897_0 11,819 16,477 1.3941


©2024 climateprediction.net