Task 21709584

Name	wah2_pnw25_cadz_190312_49_695_011383509_0
Workunit	11383509
Created	13 Jun 2019, 19:58:39 UTC
Sent	13 Jun 2019, 20:13:28 UTC
Report deadline	26 May 2020, 1:33:28 UTC
Received	15 Jun 2019, 5:26:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1448744
Run time	17 hours 29 min 59 sec
CPU time	14 hours 13 min 53 sec
Validate state	Invalid
Credit	1,539.60
Device peak FLOPS	3.95 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	180.39 MB
Peak swap size	165.72 MB
Peak disk usage	0.02 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> finish file present too long</message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_pnw25_cadz_190312_49_695_011383509/dataout\cadzga.pda3dec Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Clontroller:: CPDNDN poocess is not runn is not runnng, bRxiting, bRetVaetVal = 1, cPID=0, sel, selfPID=11764, iMonC tr=2 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 21:12:08 (41860): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0268E12C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 06/14/19 21:43:59 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077810000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.799) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.17134.228 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.228 ModLoad: 0000000076c30000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.753) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.17134.376 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.376 ModLoad: 0000000076760000 00000000001e4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.799) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.17134.376 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.376 ModLoad: 0000000075f00000 000000000018d000 C:\WINDOWS\System32\USER32.dll (6.2.17134.376) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000076740000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000074430000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.285) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.17134.285 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.285 ModLoad: 00000000763f0000 0000000000164000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.829) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.17134.829 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.829 ModLoad: 00000000740f0000 000000000007d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.619) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.17134.619 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.619 ModLoad: 0000000075860000 000000000011d000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.677) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.17134.677 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.677 ModLoad: 0000000074300000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.471) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000076ad0000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.17134.1 ModLoad: 0000000074180000 0000000000044000 C:\WINDOWS\System32\sechost.dll (6.2.17134.319) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000075980000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.648) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 00000000740d0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17134.376) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.17134.376 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.376 ModLoad: 00000000740c0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17134.1) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000076bc0000 0000000000058000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.829) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.17134.829 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.829 ModLoad: 0000000075a40000 0000000000026000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000067d70000 0000000000182000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 ModLoad: 0000000072870000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.17134.1 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.17134.1 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 1979, Write: 0, Other 17973 - I/O Transfers Counters - Read: 0, Write: 1662, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 91936, QuotaPeakPagedPoolUsage: 92096 QuotaNonPagedPoolUsage: 8760, QuotaPeakNonPagedPoolUsage: 9184 - Virtual Memory Usage - VirtualSize: 56229888, PeakVirtualSize: 56229888 - Pagefile Usage - PagefileUsage: 3715072, PeakPagefileUsage: 3715072 - Working Set Size - WorkingSetSize: 6017024, PeakWorkingSetSize: 6017024, PageFaultCount: 1755 * Dump of thread ID 11860 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 5781250.000000, User Time: 4062500.000000, Wait Time: 106546.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0268E12C - Registers - eax=00000065 ebx=004b63b9 ecx=0019dc88 edx=0268e12c esi=0019da40 edi=0019dcb8 eip=0048ee46 esp=0019d9d4 ebp=0019dc64 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019dc64 0048161c 0019dc88 004b63b8 00000000 0019dcb8 wah2_8.24_windows_intelx86!+0x0 0019dca8 0044fa52 0268e12c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019dcc8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dce0 00485ca1 c0000005 0019dd14 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 76c48494 00328000 76c48470 8c0112d1 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 778741c8 00328000 5a128314 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 77874198 ffffffff 7788f343 00000000 00000000 ntdll!RtlAreBitsSet+0x0 0019ffec 00000000 00485cce 00328000 00000000 78746341 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 13940 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 105755.000000 - Registers - eax=00000000 ebx=006f53a8 ecx=00000000 edx=00000000 esi=006f51e8 edi=006f3f58 eip=7787c58c esp=008efdc8 ebp=008eff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 008eff80 76c48494 006f3f58 76c48470 8c9612d1 008effdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 008eff94 778741c8 006f3f58 5a858314 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 008effdc 77874198 ffffffff 7788f343 00000000 00000000 ntdll!RtlAreBitsSet+0x0 008effec 00000000 77861440 006f3f58 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 10940 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 105755.000000 - Registers - eax=00000000 ebx=006f5fe0 ecx=00000000 edx=00000000 esi=006f5e20 edi=006f3f58 eip=7787c58c esp=009efdc8 ebp=009eff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 009eff80 76c48494 006f3f58 76c48470 8c8612d1 009effdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 009eff94 778741c8 006f3f58 5a958314 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 009effdc 77874198 ffffffff 7788f343 00000000 00000000 ntdll!RtlAreBitsSet+0x0 009effec 00000000 77861440 006f3f58 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 15596 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 105755.000000 - Registers - eax=00000000 ebx=006f9350 ecx=00000000 edx=00000000 esi=006f9190 edi=006f3f58 eip=7787c58c esp=00aefdc8 ebp=00aeff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00aeff80 76c48494 006f3f58 76c48470 8cb612d1 00aeffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 00aeff94 778741c8 006f3f58 5aa58314 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00aeffdc 77874198 ffffffff 7788f343 00000000 00000000 ntdll!RtlAreBitsSet+0x0 00aeffec 00000000 77861440 006f3f58 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Dump of thread ID 16348 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 106544.000000 - Registers - eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=7787ac1c esp=025bfcdc ebp=025bfd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 025bfd40 7686855f 00000064 00000000 025bff80 00478b44 ntdll!ZwDelayExecution+0x0 025bfd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 025bff80 76c48494 00000000 76c48470 8e4312d1 025bffdc wah2_8.24_windows_intelx86!+0x0 025bff94 778741c8 00000000 58508314 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 025bffdc 77874198 ffffffff 7788f343 00000000 00000000 ntdll!RtlAreBitsSet+0x0 025bffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlAreBitsSet+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jun 2019 18:44:01	1448744	21709584	wah2_pnw25_cadz_190312_49_695_011383509_0	23,339	38,943	1.6686
14 Jun 2019 04:15:15	1448744	21709584	wah2_pnw25_cadz_190312_49_695_011383509_0	11,819	18,721	1.5840