climateprediction.net home page
Task 19998526

Task 19998526

Name wah2_sas50_l711_201012_13_449_010729481_2
Workunit 10729481
Created 28 Sep 2016, 17:12:33 UTC
Sent 28 Sep 2016, 17:12:35 UTC
Report deadline 10 Sep 2017, 22:32:35 UTC
Received 21 Oct 2016, 11:44:11 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1359988
Run time 4 days 15 hours 24 min 39 sec
CPU time 4 days 15 hours 6 min 35 sec
Validate state Valid
Credit 9,898.90
Device peak FLOPS 3.86 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.12
windows_intelx86
Peak working set size 273.29 MB
Peak swap size 197.54 MB
Peak disk usage 91.15 MB
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
02:14:36 (9068): start_timer_thread(): CreateThread() failed, errno 0
02:14:38 (9704): start_timer_thread(): CreateThread() failed, errno 0


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463327 read attempt to address 0x017013AC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 09/29/16 03:26:14
Install Directory : 
Data Directory    : E:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( E:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( E:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( E:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: E:\ProgramData\BOINC\slots\2;E:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 E:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.12_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000076ed0000 000000000017b000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.10586.306) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000075b70000 00000000000e0000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.10586.589) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000076c50000 000000000017e000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.10586.589) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074240000 0000000000147000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.10586.306) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000073f80000 000000000014f000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.10586.420) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.10586.420 (th2_release_sec.160527-1834)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.420

ModLoad: 0000000076e50000 000000000007b000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.10586.63) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000073c00000 00000000000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 7.0.10586.0

ModLoad: 0000000075b10000 0000000000044000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 00000000740d0000 00000000000ad000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.10586.306) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000073be0000 000000000001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.10586.589) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.10586.589 (th2_release.160906-1759)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.589

ModLoad: 0000000073bd0000 000000000000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000076dd0000 0000000000058000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.10586.589) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.10586.589 (th2_release.160906-1759)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.589

ModLoad: 000000006f4e0000 0000000000028000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 000000006dde0000 0000000000071000 C:\WINDOWS\SYSTEM32\efswrt.dll (6.2.10586.494) (-exported- Symbols Loaded)
    Linked PDB Filename   : efswrt.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000076ac0000 000000000008d000 C:\WINDOWS\SYSTEM32\SHCORE.dll (6.2.10586.589) (-exported- Symbols Loaded)
    Linked PDB Filename   : shcore.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 00000000762d0000 00000000001bd000 C:\WINDOWS\SYSTEM32\combase.dll (6.2.10586.589) (-exported- Symbols Loaded)
    Linked PDB Filename   : combase.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000074180000 000000000000c000 C:\WINDOWS\SYSTEM32\kernel.appcore.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : Kernel.Appcore.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

Get Product Name Failed.
ModLoad: 0000000076180000 0000000000095000 C:\WINDOWS\SYSTEM32\OLEAUT32.dll (6.2.10586.589) (-exported- Symbols Loaded)
    Linked PDB Filename   : oleaut32.pdb
    File Version          : 10.0.10586.589
    Company Name          : Microsoft Corporation
    Product Name          : 
    Product Version       : 10.0.10586.589

ModLoad: 000000006dd10000 00000000000c8000 C:\WINDOWS\SYSTEM32\wintypes.dll (6.2.10586.103) (-exported- Symbols Loaded)
    Linked PDB Filename   : WinTypes.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 000000006d890000 0000000000049000 C:\WINDOWS\SYSTEM32\edputil.dll (6.2.10586.494) (-exported- Symbols Loaded)
    Linked PDB Filename   : edputil.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 00000000741f0000 0000000000045000 C:\WINDOWS\SYSTEM32\shlwapi.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000072710000 000000000013f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0

ModLoad: 0000000073220000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : MicrosoftR WindowsR Operating System
    Product Version       : 10.0.10586.0



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 17772, Write: 0, Other 62696

- I/O Transfers Counters -
Read: 0, Write: 4800, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 204896, QuotaPeakPagedPoolUsage: 205472
QuotaNonPagedPoolUsage: 8680, QuotaPeakNonPagedPoolUsage: 9496

- Virtual Memory Usage -
VirtualSize: 111972352, PeakVirtualSize: 113324032

- Pagefile Usage -
PagefileUsage: 2871296, PeakPagefileUsage: 3260416

- Working Set Size -
WorkingSetSize: 79884288, PeakWorkingSetSize: 80203776, PageFaultCount: 20781

*** Dump of thread ID 10040 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 67817104.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463327 read attempt to address 0x017013AC

- Registers -
eax=00000015 ebx=fffffffe ecx=00000000 edx=00000000 esi=01631020 edi=00000000
eip=00463327 esp=00a4fe7c ebp=00a4fe80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010216

- Callstack -
ChildEBP RetAddr  Args to Child
00a4fe80 004484ff 01631020 00000000 01631020 fffffffe wah2_8.12_windows_intelx86!+0x0 
00a4fe98 0044fd08 01631020 00000000 0051d6a8 00a4fee8 wah2_8.12_windows_intelx86!+0x0 
00a4feac 00485b9c 00000015 5fa7080e 00000006 00485b0c wah2_8.12_windows_intelx86!+0x0 
00a4fee8 76d6a8bf 00000006 2931ab47 76d6a700 76d6a700 wah2_8.12_windows_intelx86!+0x0 
00a4ff80 75b838f4 80000006 75b838d0 2a29fc84 00a4ffdc KERNELBASE!CtrlRoutine+0x0 
00a4ff94 76f35de3 80000006 2916c8df 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00a4ffdc 76f35dae ffffffff 76f5b7d5 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
00a4ffec 00000000 76d6a700 80000006 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 6228 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 11562500.000000, User Time: 57031248.000000, Wait Time: 67817104.000000

- Registers -
eax=00000000 ebx=0019efb4 ecx=00000000 edx=00000000 esi=00000000 edi=000005ef
eip=76f46f1c esp=0019ef74 ebp=0019efd8
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
0019efd8 76d0a6ff 000000c8 00000000 0019effc 004691c1 ntdll!ZwDelayExecution+0x0 
0019efe8 004691c1 000000c8 000000c8 00000000 0019f034 KERNELBASE!Sleep+0x0 
0019effc 00407f7d a0000000 027f9999 004d0c48 00000020 wah2_8.12_windows_intelx86!+0x0 
0019f034 00409542 00000000 5f1a0ba6 0048616e 00000000 wah2_8.12_windows_intelx86!+0x0 
0019fd40 00409731 0019fef0 004097af 004d1368 0019fd60 wah2_8.12_windows_intelx86!+0x0 
0019fd48 004097af 004d1368 0019fd60 00755088 0019fd60 wah2_8.12_windows_intelx86!+0x0 
0019fef0 0048611b 00400000 00000000 007550c6 0000000a wah2_8.12_windows_intelx86!+0x0 
0019ff80 75b838f4 00361000 75b838d0 2a94fc84 0019ffdc wah2_8.12_windows_intelx86!+0x0 
0019ff94 76f35de3 00361000 29abc8df 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 76f35dae ffffffff 76f5b7d5 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
0019ffec 00000000 0048616e 00361000 00000000 78746341 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 6332 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 67817096.000000

- Registers -
eax=c0000022 ebx=0162fd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=76f46f1c esp=0162fcdc ebp=0162fd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0162fd40 76d0a6ff 00000064 00000000 0162ff80 004790c4 ntdll!ZwDelayExecution+0x0 
0162fd50 004790c4 00000064 004790a0 004790a0 00000000 KERNELBASE!Sleep+0x0 
0162ff80 75b838f4 00000000 75b838d0 2beffc84 0162ffdc wah2_8.12_windows_intelx86!+0x0 
0162ff94 76f35de3 00000000 28d0c8df 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0162ffdc 76f35dae ffffffff 76f5b7d5 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
0162ffec 00000000 004790a0 00000000 00000000 0660c000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 3752 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 67817088.000000

- Registers -
eax=00000000 ebx=00759080 ecx=00000000 edx=00000000 esi=00758ec0 edi=00755880
eip=76f4876c esp=0094fdc8 ebp=0094ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0094ff80 75b838f4 00755880 75b838d0 2a19fc84 0094ffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 
0094ff94 76f35de3 00755880 2926c8df 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0094ffdc 76f35dae ffffffff 76f5b7d5 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
0094ffec 00000000 76efc6d0 00755880 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9068, selfPID=9068, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9068, selfPID=9704, iMonCtr=1
04:21:55 (6536): start_timer_thread(): CreateThread() failed, errno 0
04:21:57 (7520): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:01:18 (13996): start_timer_thread(): CreateThread() failed, errno 0
23:01:19 (2512): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:43:27 (13432): start_timer_thread(): CreateThread() failed, errno 0
20:43:29 (7980): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:44:21 (10080): start_timer_thread(): CreateThread() failed, errno 0
07:44:22 (5164): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:12:32 (12792): start_timer_thread(): CreateThread() failed, errno 0
21:12:33 (9812): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:49:24 (11412): start_timer_thread(): CreateThread() failed, errno 0
21:49:26 (10472): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:01:52 (13252): start_timer_thread(): CreateThread() failed, errno 0
09:01:54 (11160): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:17:14 (13476): start_timer_thread(): CreateThread() failed, errno 0
22:17:17 (15132): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13476, selfPID=13476, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13476, selfPID=15132, iMonCtr=1
00:17:04 (5636): start_timer_thread(): CreateThread() failed, errno 0
00:17:05 (2644): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:09:41 (8644): start_timer_thread(): CreateThread() failed, errno 0
21:09:43 (1416): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:21:08 (11188): start_timer_thread(): CreateThread() failed, errno 0
00:21:09 (10964): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:14:01 (13764): start_timer_thread(): CreateThread() failed, errno 0
21:14:03 (8384): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:55:57 (1328): start_timer_thread(): CreateThread() failed, errno 0
01:55:59 (828): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:12:06 (3028): start_timer_thread(): CreateThread() failed, errno 0
08:12:07 (12620): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:37:05 (9084): start_timer_thread(): CreateThread() failed, errno 0
13:37:06 (10744): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:52:27 (10828): start_timer_thread(): CreateThread() failed, errno 0
20:52:28 (10664): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:03:58 (6844): start_timer_thread(): CreateThread() failed, errno 0
21:03:59 (12376): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:10:57 (10300): start_timer_thread(): CreateThread() failed, errno 0
21:10:58 (5188): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:46:04 (10220): start_timer_thread(): CreateThread() failed, errno 0
21:46:06 (5048): start_timer_thread(): CreateThread() failed, errno 0
Leaving CPDN_Main::Monitor...
01:49:54 (14236): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Oct 2016 16:47:03 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 150,059 399,797 2.6643
19 Oct 2016 12:12:57 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 138,539 368,705 2.6614
16 Oct 2016 16:25:08 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 127,019 337,573 2.6577
16 Oct 2016 08:08:57 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 115,499 307,958 2.6663
15 Oct 2016 16:46:13 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 103,979 277,856 2.6722
15 Oct 2016 08:19:46 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 92,459 247,595 2.6779
14 Oct 2016 23:27:59 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 80,939 215,901 2.6675
13 Oct 2016 20:41:14 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 69,419 184,173 2.6531
12 Oct 2016 14:58:26 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 57,899 153,652 2.6538
10 Oct 2016 21:42:13 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 46,379 123,911 2.6717
08 Oct 2016 01:41:41 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 34,859 94,138 2.7005
05 Oct 2016 18:39:49 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 23,339 62,715 2.6871
04 Oct 2016 19:17:15 1359988 19998526 wah2_sas50_l711_201012_13_449_010729481_2 11,819 31,827 2.6929


©2024 climateprediction.net