climateprediction.net home page
Task 21599410

Task 21599410

Name wah2_sam50_n49l_200412_13_807_011801631_0
Workunit 11801631
Created 11 Apr 2019, 16:24:07 UTC
Sent 21 Apr 2019, 1:40:35 UTC
Report deadline 2 Apr 2020, 7:00:35 UTC
Received 24 Aug 2019, 9:42:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1482656
Run time 2 days 4 hours 44 min 42 sec
CPU time 2 days 3 hours 0 min 37 sec
Validate state Invalid
Credit 7,619.09
Device peak FLOPS 3.78 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 226.14 MB
Peak swap size 188.15 MB
Peak disk usage 46.30 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
finish file present too long</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19524, selfPID=19524, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19524, selfPID=8176, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14504, selfPID=14344, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15940, selfPID=15052, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11004, selfPID=5684, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
17:36:04 (5684): called boinc_finish(0)
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x02B2F12C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 08/24/19 17:38:50
Install Directory : 
Data Directory    : H:\BONIC Data
Project Symstore  : 
LoadLibraryA( H:\BONIC Data\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( H:\BONIC Data\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( H:\BONIC Data\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( H:\BONIC Data\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: H:\BONIC Data\projects\climateprediction.net;H:\BONIC Data\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 H:\BONIC Data\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077e40000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.799) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17134.941 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.941

ModLoad: 0000000077850000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.753) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17134.858 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.858

ModLoad: 0000000077aa0000 00000000001e4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.885) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17134.858 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.858

ModLoad: 00000000747b0000 000000000018d000 C:\WINDOWS\System32\USER32.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17134.941 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.941

ModLoad: 0000000075e80000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.1

ModLoad: 00000000774b0000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.285) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17134.285 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.285

ModLoad: 0000000076b60000 0000000000164000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.885) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17134.885 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.885

ModLoad: 0000000077740000 000000000007d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.619) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17134.619 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.619

ModLoad: 0000000076630000 000000000011d000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.677) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17134.677 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.677

ModLoad: 0000000074730000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.471) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17134.941 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.941

ModLoad: 0000000075d80000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 7.0.17134.1

ModLoad: 0000000076750000 0000000000044000 C:\WINDOWS\System32\sechost.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000077c90000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.648) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17134.941 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.941

ModLoad: 0000000074700000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.376

ModLoad: 00000000746f0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000075ff0000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.885) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17134.885 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.885

ModLoad: 0000000075fb0000 0000000000026000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000073d40000 0000000000182000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.1

ModLoad: 00000000746e0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.17134.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 7246, Write: 0, Other 40957

- I/O Transfers Counters -
Read: 0, Write: 4019, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 98640, QuotaPeakPagedPoolUsage: 98728
QuotaNonPagedPoolUsage: 8896, QuotaPeakNonPagedPoolUsage: 9184

- Virtual Memory Usage -
VirtualSize: 59867136, PeakVirtualSize: 59867136

- Pagefile Usage -
PagefileUsage: 3600384, PeakPagefileUsage: 3600384

- Working Set Size -
WorkingSetSize: 6209536, PeakWorkingSetSize: 6209536, PageFaultCount: 1861

*** Dump of thread ID 15104 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 13125000.000000, User Time: 15156250.000000, Wait Time: 4403.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x02B2F12C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019dc88 edx=02b2f12c esi=0019da40 edi=0019dcb8
eip=0048ee46 esp=0019d9d4 ebp=0019dc64
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019dc64 0048161c 0019dc88 004b63b8 00000000 0019dcb8 wah2_8.24_windows_intelx86!+0x0 
0019dca8 0044fa52 02b2f12c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019dcc8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019dce0 00485ca1 c0000005 0019dd14 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff80 77868494 0024a000 77868470 81f36309 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 77ea41c8 0024a000 ce5df4cd 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 77ea4198 ffffffff 77ebf350 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
0019ffec 00000000 00485cce 0024a000 00000000 78746341 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 15120 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3030.000000

- Registers -
eax=00000000 ebx=005c47b0 ecx=00000000 edx=00000000 esi=005c45f0 edi=005c2798
eip=77eac58c esp=008cfdc8 ebp=008cff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
008cff80 77868494 005c2798 77868470 81666309 008cffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
008cff94 77ea41c8 005c2798 cec8f4cd 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
008cffdc 77ea4198 ffffffff 77ebf350 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
008cffec 00000000 77e91440 005c2798 00000000 00000000 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 15124 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3030.000000

- Registers -
eax=00000000 ebx=005c55a0 ecx=00000000 edx=00000000 esi=005c53e0 edi=005c2798
eip=77eac58c esp=00a0fdc8 ebp=00a0ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
00a0ff80 77868494 005c2798 77868470 814a6309 00a0ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
00a0ff94 77ea41c8 005c2798 cee4f4cd 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00a0ffdc 77ea4198 ffffffff 77ebf350 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
00a0ffec 00000000 77e91440 005c2798 00000000 00000000 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 15128 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 3032.000000

- Registers -
eax=77e91440 ebx=00000000 ecx=00000000 edx=00000000 esi=005d0ed8 edi=005c2798
eip=77eac58c esp=00b4fdc8 ebp=00b4ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
00b4ff80 77868494 005c2798 77868470 815e6309 00b4ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
00b4ff94 77ea41c8 005c2798 cef0f4cd 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
00b4ffdc 77ea4198 ffffffff 77ebf350 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
00b4ffec 00000000 77e91440 005c2798 00000000 00000000 ntdll!RtlAreBitsSet+0x0 

*** Dump of thread ID 15184 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4400.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=77eaac1c esp=02a5fcdc ebp=02a5fd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
02a5fd40 77ba85bf 00000064 00000000 02a5ff80 00478b44 ntdll!ZwDelayExecution+0x0 
02a5fd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
02a5ff80 77868494 00000000 77868470 834f6309 02a5ffdc wah2_8.24_windows_intelx86!+0x0 
02a5ff94 77ea41c8 00000000 cce1f4cd 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
02a5ffdc 77ea4198 ffffffff 77ebf350 00000000 00000000 ntdll!RtlAreBitsSet+0x0 
02a5ffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlAreBitsSet+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2019 03:12:14 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 115,499 177,458 1.5364
07 Jul 2019 10:10:31 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 103,979 163,300 1.5705
06 Jul 2019 12:05:56 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 92,459 147,690 1.5974
06 Jul 2019 07:59:35 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 80,939 132,977 1.6429
06 Jul 2019 02:36:06 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 69,419 119,099 1.7157
05 Jul 2019 11:47:21 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 57,899 103,205 1.7825
05 Jul 2019 07:40:55 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 46,379 88,559 1.9095
05 Jul 2019 02:12:09 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 34,859 74,532 2.1381
12 May 2019 10:33:01 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 23,339 51,105 2.1897
02 May 2019 05:15:47 1482656 21599410 wah2_sam50_n49l_200412_13_807_011801631_0 11,819 25,620 2.1677


©2024 climateprediction.net