climateprediction.net home page
Task 18652467

Task 18652467

Name hadam3p_pnw_pv26_2013_1_009987450_0
Workunit 9993808
Created 29 Jun 2015, 19:23:19 UTC
Sent 12 Jul 2015, 5:17:23 UTC
Report deadline 23 Jun 2016, 10:37:23 UTC
Received 16 Jul 2015, 14:24:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 907613
Run time 1 days 3 hours 52 min 29 sec
CPU time 1 days 3 hours 40 min 26 sec
Validate state Invalid
Credit 2,009.02
Device peak FLOPS 5.11 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v7.27
windows_intelx86
Stderr 
<core_client_version>7.4.42</core_client_version>
<![CDATA[
<message>
 - exit code 9 (0x9)
</message>
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x7765DFE4 read attempt to address 0x766FFFFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.5.1


Dump Timestamp    : 07/12/15 15:05:38
Install Directory : 
Data Directory    : F:\BOINC
Project Symstore  : 
LoadLibraryA( F:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( F:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( F:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( F:\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: F:\BOINC\slots\4;F:\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 000000000018e000 F:\BOINC\projects\climateprediction.net\hadam3p_pnw_7.27_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077630000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.18798) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000751f0000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18847) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.17965

ModLoad: 0000000076cb0000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18847) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.17965

ModLoad: 0000000074ef0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076b10000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18778) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.18778 (win7sp1_gdr.150304-1507)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.18778

ModLoad: 00000000758f0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18768) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.18768 (win7sp1_gdr.150219-1512)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.18768

ModLoad: 0000000076910000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18454) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.18454 (win7sp1_gdr.140424-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.18454

ModLoad: 00000000756e0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000074b80000 00000000000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.18247) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075350000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000769b0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18532) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074b20000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.18812) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.18812 (win7sp1_gdr.150403-1507)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.18812

ModLoad: 0000000074b10000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076ab0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075820000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000749b0000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075380000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000072330000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006bc50000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000074a40000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 14834, Write: 0, Other 56315

- I/O Transfers Counters -
Read: 0, Write: 3054, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 98568, QuotaPeakPagedPoolUsage: 98568
QuotaNonPagedPoolUsage: 7448, QuotaPeakNonPagedPoolUsage: 7528

- Virtual Memory Usage -
VirtualSize: 56696832, PeakVirtualSize: 56696832

- Pagefile Usage -
PagefileUsage: 2838528, PeakPagefileUsage: 3301376

- Working Set Size -
WorkingSetSize: 30937088, PeakWorkingSetSize: 31326208, PageFaultCount: 8770

*** Dump of thread ID 9420 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156001.000000, User Time: 0.000000, Wait Time: 584063.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x7765DFE4 read attempt to address 0x766FFFFF

- Registers -
eax=766ffff8 ebx=76700000 ecx=2dd29f74 edx=027be8b8 esi=00a10000 edi=00000000
eip=7765dfe4 esp=028bfe5c ebp=028bfe6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
028bfe6c 752014bd 00a10000 00000000 76700000 028bfe94 ntdll!RtlFreeHeap+0x0 
028bfe80 00482de7 00a10000 00000000 76700000 028bfeac kernel32!HeapFree+0x0 
028bfe94 00447e11 76700000 00000000 00ff0020 80000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
028bfeac 0044f568 00ff0020 00000000 005597a4 028bfefc hadam3p_pnw_7.27_windows_intelx!+0x0 
028bfec0 0048374c 00000015 2f596188 00000001 00000006 hadam3p_pnw_7.27_windows_intelx!+0x0 
028bfefc 752a7441 00000006 2f6a6596 00000000 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
028bff88 7520337a 00000006 028bffd4 776692b2 80000006 kernel32!CtrlRoutine+0x0 
028bff94 776692b2 80000006 75cf36d8 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
028bffd4 77669285 752a728c 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
028bffec 00000000 752a728c 80000006 00000000 2691a4bd ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 272 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 4368028.000000, User Time: 23088148.000000, Wait Time: 584058.000000

- Registers -
eax=00000000 ebx=004cf850 ecx=00000000 edx=00000000 esi=0018f9d8 edi=00000000
eip=7764fd8d esp=0018f994 ebp=0018f9fc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018f9fc 76cc44ab 000000c8 00000000 0018fa20 004689c1 ntdll!NtDelayExecution+0x0 
0018fa0c 004689c1 000000c8 000000c8 00000000 0018fa58 KERNELBASE!Sleep+0x0 
0018fa20 00403ddc a0000000 027f9999 004cf858 004cfb88 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fa58 00404d76 00000000 2dca623c 00000000 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fd48 00404f67 0018fef8 00404fe5 004d02a8 0018fd68 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fd50 00404fe5 004d02a8 0018fd68 007235d8 0018fd68 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fef8 00484e1b 00400000 00000000 0072361d 0000000a hadam3p_pnw_7.27_windows_intelx!+0x0 
0018ff88 7520337a 7efde000 0018ffd4 776692b2 7efde000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018ff94 776692b2 7efde000 775c36d8 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 77669285 00484e6e 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 00484e6e 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 8088 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 584058.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=00eefd24 edi=00000000
eip=7764fd8d esp=00eefce0 ebp=00eefd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
00eefd48 76cc44ab 00000064 00000000 00eeff88 00477e94 ntdll!NtDelayExecution+0x0 
00eefd58 00477e94 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
00eeff88 7520337a 00000000 00eeffd4 776692b2 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
00eeff94 776692b2 00000000 77aa36d8 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
00eeffd4 77669285 00477e70 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
00eeffec 00000000 00477e70 00000000 00000000 1272cb2f ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8880, selfPID=8880, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8880, selfPID=9476, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8280, selfPID=8280, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8280, selfPID=8284, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8336, selfPID=8288, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8336, selfPID=8336, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9036, selfPID=9036, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9036, selfPID=9116, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1932, selfPID=9012, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1932, selfPID=1932, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8228, selfPID=8288, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8228, selfPID=8228, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jul 2015 13:14:55 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 92,459 96,130 1.0397
15 Jul 2015 14:23:57 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 80,939 84,224 1.0406
15 Jul 2015 05:10:02 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 69,419 72,003 1.0372
14 Jul 2015 13:41:23 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 57,899 60,066 1.0374
13 Jul 2015 15:39:48 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 46,379 48,015 1.0353
13 Jul 2015 12:22:40 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 34,859 36,050 1.0342
12 Jul 2015 13:59:25 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 23,339 24,227 1.0380
12 Jul 2015 10:38:22 907613 18652467 hadam3p_pnw_pv26_2013_1_009987450_0 11,819 12,242 1.0358


©2024 climateprediction.net