climateprediction.net home page
Task 20767093

Task 20767093

Name wah2_pnw25_r7v8_199812_24_664_011266311_0
Workunit 11266311
Created 28 Sep 2017, 21:17:51 UTC
Sent 13 Oct 2017, 18:37:09 UTC
Report deadline 25 Sep 2018, 23:57:09 UTC
Received 6 Nov 2017, 18:02:23 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1277339
Run time 18 days 19 hours 33 min 57 sec
CPU time 1 days 13 hours 56 min 13 sec
Validate state Invalid
Credit 4,579.34
Device peak FLOPS 3.36 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 182.03 MB
Peak swap size 168.29 MB
Peak disk usage 1.65 MB
Stderr 
<core_client_version>7.8.3</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=104956, selfPID=90228, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7080, selfPID=6432, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6760, selfPID=4868, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7944, selfPID=6240, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
08:52:14 (6240): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0248012C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 11/06/17 09:01:39
Install Directory : C:\Program Files (x86)\BOINC\
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077cc0000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076480000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000076040000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000077580000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.23594) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075d50000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.23914) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.23914 (win7sp1_ldr.170908-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23914

ModLoad: 0000000075d30000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.23807) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.23807 (win7sp1_ldr.170512-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23807

ModLoad: 0000000075c40000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.23894) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.23894 (win7sp1_ldr.170816-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.23894

ModLoad: 0000000077800000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000077690000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.23915 (win7sp1_ldr.170913-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23915

ModLoad: 0000000076020000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000077490000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075560000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.23915 (win7sp1_ldr.170913-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23915

ModLoad: 0000000075550000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.23915 (win7sp1_ldr.170913-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23915

ModLoad: 00000000755e0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000075990000 00000000000cd000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.23915) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075140000 0000000000029000 C:\Windows\SysWOW64\nvinit.dll (21.21.13.7684) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r375\r375_00\drivers\umdshim\tools\NvInitDll\_out\wddm_x86_release\nvinit.pdb
    File Version          : 21.21.13.7684
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA D3D shim drivers
    Product Version       : 21.21.13.7684

ModLoad: 0000000075480000 0000000000009000 C:\Windows\system32\VERSION.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 000000006f440000 0000000000006000 C:\Program Files (x86)\NVIDIA Corporation\CoProcManager\detoured.dll (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\p4\sw\tools\sdk\detours2.1.1\bin\winxp_x86_release\detoured.pdb

ModLoad: 000000006f400000 0000000000031000 C:\Program Files (x86)\NVIDIA Corporation\CoProcManager\nvd3d9wrap.dll (21.21.13.7684) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r375\r375_00\drivers\umdshim\tools\Det\nvd3d9wrap\_out\wddm_x86_release\nvd3d9wrap.pdb
    File Version          : 21.21.13.7684
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA D3D shim drivers
    Product Version       : 21.21.13.7684

ModLoad: 0000000076590000 000000000019d000 C:\Windows\syswow64\SETUPAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075a70000 0000000000027000 C:\Windows\syswow64\CFGMGR32.dll (6.1.7601.17621) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 6.1.7601.17621 (win7sp1_gdr.110523-2108)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17621

Get Product Name Failed.
ModLoad: 0000000075790000 0000000000091000 C:\Windows\syswow64\OLEAUT32.dll (6.1.7601.23775) (-exported- Symbols Loaded)
    Linked PDB Filename   : oleaut32.pdb
    File Version          : 6.1.7601.23775
    Company Name          : Microsoft Corporation
    Product Name          : 
    Product Version       : 6.1.7601.23775

ModLoad: 0000000075830000 000000000015d000 C:\Windows\syswow64\ole32.dll (6.1.7601.23889) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 6.1.7601.23889 (win7sp1_ldr.170810-1615)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23889

ModLoad: 00000000755c0000 0000000000012000 C:\Windows\syswow64\DEVOBJ.dll (6.1.7601.17621) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 6.1.7601.17621 (win7sp1_gdr.110523-2108)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17621

ModLoad: 000000006f3e0000 0000000000020000 C:\Program Files (x86)\NVIDIA Corporation\CoProcManager\nvdxgiwrap.dll (21.21.13.7684) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\dvs\p4\build\sw\rel\gpu_drv\r375\r375_00\drivers\umdshim\tools\Det\nvdxgiwrap\_out\wddm_x86_release\nvdxgiwrap.pdb
    File Version          : 21.21.13.7684
    Company Name          : NVIDIA Corporation
    Product Name          : NVIDIA D3D shim drivers
    Product Version       : 21.21.13.7684

ModLoad: 0000000070ef0000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 1597, Write: 0, Other 13802

- I/O Transfers Counters -
Read: 0, Write: 2008, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 97808, QuotaPeakPagedPoolUsage: 97840
QuotaNonPagedPoolUsage: 8040, QuotaPeakNonPagedPoolUsage: 8720

- Virtual Memory Usage -
VirtualSize: 55169024, PeakVirtualSize: 56025088

- Pagefile Usage -
PagefileUsage: 3174400, PeakPagefileUsage: 3321856

- Working Set Size -
WorkingSetSize: 6184960, PeakWorkingSetSize: 6221824, PageFaultCount: 1803

*** Dump of thread ID 5748 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 2184014.000000, User Time: 7800050.000000, Wait Time: 27138.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0248012C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0018dca8 edx=0248012c esi=0018da60 edi=0018dcd8
eip=0048ee46 esp=0018d9f4 ebp=0018dc84
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0018dc84 0048161c 0018dca8 004b63b8 00000000 0018dcd8 wah2_8.24_windows_intelx86!+0x0 
0018dcc8 0044fa52 0248012c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0018dce8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0018dd00 00485ca1 c0000005 0018dd34 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0018ff88 7649336a 7efde000 0018ffd4 77cf98f2 7efde000 wah2_8.24_windows_intelx86!+0x0 
0018ff94 77cf98f2 7efde000 77c2fd7c 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 77cf98c5 00485cce 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 00485cce 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 3848 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 27133.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=023bfd24 edi=00000000
eip=77cdfda1 esp=023bfce0 ebp=023bfd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
023bfd48 7605460c 00000064 00000000 023bff88 00478b44 ntdll!NtDelayExecution+0x0 
023bfd58 00478b44 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
023bff88 7649336a 00000000 023bffd4 77cf98f2 00000000 wah2_8.24_windows_intelx86!+0x0 
023bff94 77cf98f2 00000000 75e1fd7c 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
023bffd4 77cf98c5 00478b20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
023bffec 00000000 00478b20 00000000 00000000 7f5f5e7d ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Nov 2017 04:16:24 1277339 20767093 wah2_pnw25_r7v8_199812_24_664_011266311_0 69,419 132,556 1.9095
02 Nov 2017 11:28:48 1277339 20767093 wah2_pnw25_r7v8_199812_24_664_011266311_0 57,899 109,518 1.8915
29 Oct 2017 17:48:17 1277339 20767093 wah2_pnw25_r7v8_199812_24_664_011266311_0 46,379 88,824 1.9152
24 Oct 2017 21:45:18 1277339 20767093 wah2_pnw25_r7v8_199812_24_664_011266311_0 34,859 69,030 1.9803
21 Oct 2017 13:43:39 1277339 20767093 wah2_pnw25_r7v8_199812_24_664_011266311_0 23,339 47,758 2.0463
17 Oct 2017 12:15:30 1277339 20767093 wah2_pnw25_r7v8_199812_24_664_011266311_0 11,819 23,953 2.0267


©2024 climateprediction.net