climateprediction.net home page
Task 20554102

Task 20554102

Name wah2_sas50_155a_209312_12_604_011124123_0
Workunit 11124123
Created 18 Jul 2017, 14:00:26 UTC
Sent 18 Jul 2017, 14:29:06 UTC
Report deadline 30 Jun 2018, 19:49:06 UTC
Received 21 Jul 2017, 13:31:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 907613
Run time 9 hours 33 min 17 sec
CPU time 9 hours 22 min 11 sec
Validate state Invalid
Credit 1,539.60
Device peak FLOPS 5.68 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 233.32 MB
Peak swap size 196.51 MB
Peak disk usage 0.02 MB
Stderr
<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
22:42:50 (36424): start_timer_thread(): CreateThread() failed, errno 0
22:42:54 (36260): start_timer_thread(): CreateThread() failed, errno 0


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x036CB3AC

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 07/18/17 23:07:23
Install Directory : 
Data Directory    : F:\BOINC
Project Symstore  : 
LoadLibraryA( F:\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( F:\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( F:\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( F:\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: F:\BOINC\slots\7;F:\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 F:\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077340000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000074c70000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000074940000 00000000001d5000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000077070000 0000000000175000 C:\WINDOWS\System32\USER32.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000075020000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000074b90000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 00000000750e0000 0000000000159000 C:\WINDOWS\System32\gdi32full.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000074f00000 0000000000079000 C:\WINDOWS\System32\msvcp_win.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 00000000745d0000 000000000011b000 C:\WINDOWS\System32\ucrtbase.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000074750000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000074e40000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 7.0.16226.1000

ModLoad: 0000000075090000 0000000000043000 C:\WINDOWS\System32\sechost.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000073d80000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000073d60000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000073d50000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000075860000 0000000000056000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000070ed0000 0000000000028000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 00000000728f0000 0000000000181000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000

ModLoad: 0000000072f60000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.16226.1000) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.16226.1000 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft? Windows? Operating System
    Product Version       : 10.0.16226.1000



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 20880, Write: 0, Other 75772

- I/O Transfers Counters -
Read: 0, Write: 2974, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 201944, QuotaPeakPagedPoolUsage: 202120
QuotaNonPagedPoolUsage: 8344, QuotaPeakNonPagedPoolUsage: 9312

- Virtual Memory Usage -
VirtualSize: 142667776, PeakVirtualSize: 145321984

- Pagefile Usage -
PagefileUsage: 2871296, PeakPagefileUsage: 3112960

- Working Set Size -
WorkingSetSize: 79904768, PeakWorkingSetSize: 80289792, PageFaultCount: 20979

*** Dump of thread ID 30344 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 11865958.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00463007 read attempt to address 0x036CB3AC

- Registers -
eax=00000015 ebx=fffffffe ecx=00000000 edx=00000000 esi=035fb020 edi=00000000
eip=00463007 esp=028dfe7c ebp=028dfe80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010216

- Callstack -
ChildEBP RetAddr  Args to Child
028dfe80 0044826f 035fb020 00000000 035fb020 fffffffe wah2_8.24_windows_intelx86!+0x0 
028dfe98 0044fa68 035fb020 00000000 0051d6b0 028dfee8 wah2_8.24_windows_intelx86!+0x0 
028dfeac 004856fc 00000015 6c68b92f 00000006 0048566c wah2_8.24_windows_intelx86!+0x0 
028dfee8 74a8eba9 00000006 3989fda6 74a8e9f0 74a8e9f0 wah2_8.24_windows_intelx86!+0x0 
028dff80 74c886d4 80000006 74c886b0 4ecbf177 028dffdc KERNELBASE!CtrlRoutine+0x0 
028dff94 773a5017 80000006 46b8d1eb 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
028dffdc 773a4fe7 ffffffff 773ca0b2 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
028dffec 00000000 74a8e9f0 80000006 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 36748 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 10937500.000000, User Time: 37812500.000000, Wait Time: 11865957.000000

- Registers -
eax=00000000 ebx=00000050 ecx=00000000 edx=00000000 esi=00000000 edi=0000058b
eip=773aee7c esp=0019ed38 ebp=0019ed9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0019ed9c 74a3f9bf 000000c8 00000000 0019edc0 00468ec1 ntdll!ZwDelayExecution+0x0 
0019edac 00468ec1 000000c8 000000c8 00000000 0019edf8 KERNELBASE!Sleep+0x0 
0019edc0 00407a89 a0000000 027f9999 00000000 004d0c50 wah2_8.24_windows_intelx86!+0x0 
0019edf8 004092c5 00000000 6efcba87 00485cce 00000000 wah2_8.24_windows_intelx86!+0x0 
0019fd40 004094b7 0019fef0 00409535 004d1370 0019fd60 wah2_8.24_windows_intelx86!+0x0 
0019fd48 00409535 004d1370 0019fd60 02603b58 0019fd60 wah2_8.24_windows_intelx86!+0x0 
0019fef0 00485c7b 00400000 00000000 02603b96 0000000a wah2_8.24_windows_intelx86!+0x0 
0019ff80 74c886d4 00362000 74c886b0 4c5ff177 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 773a5017 00362000 442cd1eb 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 773a4fe7 ffffffff 773ca0b2 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 00362000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 36140 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 11865958.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=773aee7c esp=035efcdc ebp=035efd40
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
035efd40 74a3f9bf 00000064 00000000 035eff80 00478b44 ntdll!ZwDelayExecution+0x0 
035efd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 
035eff80 74c886d4 00000000 74c886b0 4f18f177 035effdc wah2_8.24_windows_intelx86!+0x0 
035eff94 773a5017 00000000 476bd1eb 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
035effdc 773a4fe7 ffffffff 773ca0b2 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
035effec 00000000 00478b20 00000000 00000000 085ca000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=36424, selfPID=36424, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=36424, selfPID=36260, iMonCtr=1
23:25:19 (8340): start_timer_thread(): CreateThread() failed, errno 0
23:25:21 (7776): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:55:38 (8496): start_timer_thread(): CreateThread() failed, errno 0
23:55:39 (5048): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
18:46:45 (11860): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11860, selfPID=13420, iMonCtr=1
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11860, selfPID=11860, iMonCtr=1
13:15:49 (15584): start_timer_thread(): CreateThread() failed, errno 0
13:15:51 (9964): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:31:15 (13276): start_timer_thread(): CreateThread() failed, errno 0
01:31:16 (13392): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:44:59 (17644): start_timer_thread(): CreateThread() failed, errno 0
01:45:01 (17736): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:56:50 (7516): start_timer_thread(): CreateThread() failed, errno 0
01:56:51 (10052): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:53:23 (10296): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:39:26 (12832): start_timer_thread(): CreateThread() failed, errno 0
18:39:28 (1096): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:59:59 (8296): start_timer_thread(): CreateThread() failed, errno 0
19:00:00 (13508): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:21:45 (16268): start_timer_thread(): CreateThread() failed, errno 0
19:21:46 (7896): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:28:06 (7408): start_timer_thread(): CreateThread() failed, errno 0
19:28:07 (6596): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:39:11 (12036): start_timer_thread(): CreateThread() failed, errno 0
19:39:12 (1268): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
19:48:19 (5860): start_timer_thread(): CreateThread() failed, errno 0
19:48:21 (15492): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:11:02 (5764): start_timer_thread(): CreateThread() failed, errno 0
20:11:04 (5324): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:22:12 (6656): start_timer_thread(): CreateThread() failed, errno 0
20:22:13 (6484): start_timer_thread(): CreateThread() failed, errno 0

Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO                                                                                                                                                                                           tmp/xadae.pipe_dummy                                                            
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8880, selfPID=8880, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8880, selfPID=15700, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
20:29:05 (15700): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_3.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_4.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_5.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_6.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_7.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_8.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_9.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_10.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_11.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_12.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_155a_209312_12_604_011124123_0_r824146535_restart.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Jul 2017 04:28:27 907613 20554102 wah2_sas50_155a_209312_12_604_011124123_0 23,339 25,342 1.0858
19 Jul 2017 13:38:57 907613 20554102 wah2_sas50_155a_209312_12_604_011124123_0 11,819 12,581 1.0645


©2024 climateprediction.net