climateprediction.net home page
Task 20684883

Task 20684883

Name wah2_sas50_s3ic_201512_13_633_011183863_1
Workunit 11183863
Created 26 Aug 2017, 5:05:03 UTC
Sent 26 Aug 2017, 17:17:58 UTC
Report deadline 8 Aug 2018, 22:37:58 UTC
Received 22 Oct 2017, 4:31:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID 1384388
Run time 18 days 11 hours 23 min 40 sec
CPU time 11 days 11 hours 15 min 29 sec
Validate state Invalid
Credit 8,379.03
Device peak FLOPS 1.46 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 269.25 MB
Peak swap size 198.14 MB
Peak disk usage 37.90 MB
Stderr 
<core_client_version>7.8.2</core_client_version>
<![CDATA[
<message>
finish file present too long
</message>
<stderr_txt>
07:35:15 (9888): start_timer_thread(): CreateThread() failed, errno 0
05:08:45 (9208): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10064, selfPID=9208, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11272, selfPID=11272, iMonCtr=1
05:22:55 (3860): start_timer_thread(): CreateThread() failed, errno 0
05:54:23 (10124): start_timer_thread(): CreateThread() failed, errno 0
05:54:24 (7612): start_timer_thread(): CreateThread() failed, errno 0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7612, selfPID=10752, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12032, selfPID=8796, iMonCtr=1
Model crash detected, will try to restart...
05:53:07 (11584): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11584, selfPID=11584, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
12:14:13 (14044): start_timer_thread(): CreateThread() failed, errno 0
12:14:15 (14272): start_timer_thread(): CreateThread() failed, errno 0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14272, selfPID=2436, iMonCtr=1
Model crash detected, will try to restart...
05:11:45 (11652): start_timer_thread(): CreateThread() failed, errno 0
05:11:47 (11688): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11652, selfPID=11652, iMonCtr=1
08:36:40 (3656): start_timer_thread(): CreateThread() failed, errno 0
08:36:41 (11952): start_timer_thread(): CreateThread() failed, errno 0
10:17:10 (9540): start_timer_thread(): CreateThread() failed, errno 0
10:17:24 (11732): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
17:17:15 (9232): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9232, selfPID=9232, iMonCtr=1
05:40:42 (13032): start_timer_thread(): CreateThread() failed, errno 0
05:28:02 (7960): start_timer_thread(): CreateThread() failed, errno 0
08:07:54 (11192): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:59:18 (4920): start_timer_thread(): CreateThread() failed, errno 0
03:59:20 (11904): start_timer_thread(): CreateThread() failed, errno 0
05:58:32 (788): start_timer_thread(): CreateThread() failed, errno 0
05:58:34 (8784): start_timer_thread(): CreateThread() failed, errno 0
14:38:20 (13124): start_timer_thread(): CreateThread() failed, errno 0
14:38:22 (13196): start_timer_thread(): CreateThread() failed, errno 0
05:15:40 (11096): start_timer_thread(): CreateThread() failed, errno 0
05:15:42 (10580): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:28:20 (10352): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10352, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12056, iMonCtr=2
Model crash detected, will try to restart...
06:27:08 (8680): start_timer_thread(): CreateThread() failed, errno 0
06:27:09 (1196): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8680, selfPID=1196, iMonCtr=1
19:04:08 (11748): start_timer_thread(): CreateThread() failed, errno 0
07:20:03 (9716): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:22:40 (8840): start_timer_thread(): CreateThread() failed, errno 0
05:23:36 (12652): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12344, selfPID=12652, iMonCtr=1
05:59:32 (10044): start_timer_thread(): CreateThread() failed, errno 0
07:19:44 (12436): start_timer_thread(): CreateThread() failed, errno 0
07:19:47 (13108): start_timer_thread(): CreateThread() failed, errno 0
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13108, selfPID=8716, iMonCtr=1
05:20:16 (12060): start_timer_thread(): CreateThread() failed, errno 0
05:20:18 (11656): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:33:35 (13080): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13080, selfPID=13228, iMonCtr=1
05:50:01 (12176): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10424, selfPID=10424, iMonCtr=1
05:59:31 (11624): start_timer_thread(): CreateThread() failed, errno 0
05:59:33 (2628): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11624, selfPID=11624, iMonCtr=1
19:29:33 (8148): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8148, selfPID=10056, iMonCtr=1
06:12:54 (11548): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:18:43 (8416): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3664, iMonCtr=2
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12268, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
20:42:59 (3664): called boinc_finish(0)
CPDN Monitor - Abort request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0252212C

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 10/22/17 05:31:24
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000774e0000 000000000018e000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.15063.608) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.608

ModLoad: 00000000743c0000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.15063.296) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.608

ModLoad: 00000000745c0000 00000000001c2000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.608

ModLoad: 0000000076d00000 000000000013c000 C:\WINDOWS\System32\USER32.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.0

ModLoad: 0000000074160000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.15063.608) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.15063.608 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.608

ModLoad: 00000000772d0000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.15063.483) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.15063.483 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.483

ModLoad: 0000000076aa0000 0000000000158000 C:\WINDOWS\System32\gdi32full.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.15063.674 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.674

ModLoad: 0000000077240000 0000000000079000 C:\WINDOWS\System32\msvcp_win.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 0000000075c10000 0000000000118000 C:\WINDOWS\System32\ucrtbase.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.15063.674 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.674

ModLoad: 0000000075d50000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.0

ModLoad: 0000000074490000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.15063.0

ModLoad: 0000000076000000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 0000000075dd0000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Syst&#232;me d&#146;exploitation Microsoft&#174; Windows&#174;
    Product Version       : 10.0.15063.0

ModLoad: 0000000073fb0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.15063.674) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.15063.674 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.674

ModLoad: 0000000073fa0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 0000000074550000 0000000000057000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.15063.138) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.15063.138 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.138

ModLoad: 0000000076c40000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0

ModLoad: 00000000726f0000 000000000015d000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.15063.447) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.15063.447 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.447

ModLoad: 0000000073400000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.15063.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.15063.0 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.15063.0



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 2147, Write: 0, Other 18177

- I/O Transfers Counters -
Read: 0, Write: 2582, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 90504, QuotaPeakPagedPoolUsage: 90640
QuotaNonPagedPoolUsage: 8352, QuotaPeakNonPagedPoolUsage: 8776

- Virtual Memory Usage -
VirtualSize: 53882880, PeakVirtualSize: 53882880

- Pagefile Usage -
PagefileUsage: 3252224, PeakPagefileUsage: 3252224

- Working Set Size -
WorkingSetSize: 6201344, PeakWorkingSetSize: 6201344, PageFaultCount: 1813

*** Dump of thread ID 11792 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 23750000.000000, User Time: 14375000.000000, Wait Time: 54446.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0252212C

- Registers -
eax=00000065 ebx=004b63b9 ecx=0019d8e8 edx=0252212c esi=0019d6a0 edi=0019d918
eip=0048ee46 esp=0019d634 ebp=0019d8c4
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202

- Callstack -
ChildEBP RetAddr  Args to Child
0019d8c4 0048161c 0019d8e8 004b63b8 00000000 0019d918 wah2_8.24_windows_intelx86!+0x0 
0019d908 0044fa52 0252212c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 
0019d928 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 
0019d940 00485ca1 c0000005 0019d974 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 
0019ff80 743d8744 002c3000 743d8720 5a3a853c 0019ffdc wah2_8.24_windows_intelx86!+0x0 
0019ff94 7754582d 002c3000 59211610 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0019ffdc 775457fd ffffffff 77566396 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0019ffec 00000000 00485cce 002c3000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 11700 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53041.000000

- Registers -
eax=00000000 ebx=00634190 ecx=00000000 edx=00000000 esi=0063ebc0 edi=0063ed80
eip=7755396c esp=0086fd7c ebp=0086ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
0086ff80 743d8744 00634190 743d8720 5aa5853c 0086ffdc ntdll!ZwWaitForWorkViaWorkerFactory+0x0 
0086ff94 7754582d 00634190 59be1610 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
0086ffdc 775457fd ffffffff 77566396 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 
0086ffec 00000000 7751a470 00634190 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 

*** Dump of thread ID 12488 (state: Waiting): ***

- Information -
Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53041.000000

- Registers -
eax=7751a470 ebx=00634190 ecx=00000000 edx=00000000 esi=0063ed98 edi=00000000
eip=7755396c esp=0225fd7c ebp=0225ff80
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Oct 2017 04:59:35 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 127,019 912,734 7.1858
17 Oct 2017 12:14:48 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 115,499 830,008 7.1863
17 Oct 2017 11:51:03 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 103,979 747,485 7.1888
17 Oct 2017 11:34:08 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 92,459 665,114 7.1936
08 Oct 2017 10:09:08 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 80,939 580,445 7.1714
23 Sep 2017 16:34:28 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 69,419 496,631 7.1541
12 Sep 2017 16:19:32 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 57,899 412,032 7.1164
07 Sep 2017 16:56:20 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 46,379 327,857 7.0691
04 Sep 2017 15:38:47 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 34,859 247,810 7.1089
01 Sep 2017 18:49:46 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 23,339 167,306 7.1685
30 Aug 2017 08:53:23 1384388 20684883 wah2_sas50_s3ic_201512_13_633_011183863_1 11,819 85,751 7.2554


©2024 climateprediction.net