Task 20184801

Name	wah2_eas50_e1vy_201412_10_507_010881471_0
Workunit	10881471
Created	27 Jan 2017, 11:10:05 UTC
Sent	31 Jan 2017, 20:30:39 UTC
Report deadline	14 Jan 2018, 1:50:39 UTC
Received	11 Feb 2017, 8:56:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1419921
Run time	3 days 9 hours 54 min 32 sec
CPU time	1 days 23 hours 16 min 24 sec
Validate state	Invalid
Credit	4,579.34
Device peak FLOPS	3.97 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	251.88 MB
Peak swap size	215.89 MB
Peak disk usage	111.62 MB
Stderr	<core_client_version>7.6.33</core_client_version> <![CDATA[ <message> finish file present too long </message> <stderr_txt> 21:33:00 (15328): start_timer_thread(): CreateThread() failed, errno 0 21:33:01 (11604): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:20:52 (1312): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:23:08 (11352): start_timer_thread(): CreateThread() failed, errno 0 10:23:09 (11248): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:33:45 (7604): start_timer_thread(): CreateThread() failed, errno 0 20:33:49 (13420): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 02:03:47 (17180): start_timer_thread(): CreateThread() failed, errno 0 02:03:48 (15988): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 10:43:39 (444): start_timer_thread(): CreateThread() failed, errno 0 10:43:40 (14784): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:44:32 (12660): start_timer_thread(): CreateThread() failed, errno 0 23:44:34 (12328): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 11:27:46 (13328): start_timer_thread(): CreateThread() failed, errno 0 11:27:48 (9512): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 12:06:03 (10664): start_timer_thread(): CreateThread() failed, errno 0 12:06:04 (7072): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:00:19 (11712): start_timer_thread(): CreateThread() failed, errno 0 11:00:21 (13776): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... 19:21:51 (13916): start_timer_thread(): CreateThread() failed, errno 0 19:21:52 (13320): start_timer_thread(): CreateThread() failed, errno 0 09:24:28 (16012): start_timer_thread(): CreateThread() failed, errno 0 09:24:30 (14168): start_timer_thread(): CreateThread() failed, errno 0 16:54:30 (11268): start_timer_thread(): CreateThread() failed, errno 0 16:54:32 (7544): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:52:11 (6556): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1 22:52:16 (10700): start_timer_thread(): CreateThread() failed, errno 0 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10700, selfPID=5288, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 22:52:24 (5288): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x026C912C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 02/10/17 22:56:04 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : D:\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: D:\BOINC\projects\climateprediction.net;D:\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 D:\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077810000 0000000000183000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.14393.479) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.206 ModLoad: 00000000765a0000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.206 ModLoad: 0000000076770000 00000000001a1000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.14393.479) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.206 ModLoad: 0000000076fd0000 000000000015f000 C:\WINDOWS\System32\USER32.dll (6.2.14393.576) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 0000000076680000 0000000000015000 C:\WINDOWS\System32\win32u.dll (6.2.14393.51) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.14393.51 (rs1_release_inmarket.160801-1836) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.51 ModLoad: 0000000075190000 000000000002b000 C:\WINDOWS\System32\GDI32.dll (6.2.14393.206) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.14393.206 (rs1_release.160915-0644) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.206 ModLoad: 0000000076b70000 000000000015b000 C:\WINDOWS\System32\gdi32full.dll (6.2.14393.576) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.14393.576 (rs1_release_inmarket.161208-2252) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.576 ModLoad: 0000000076e10000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 00000000769c0000 00000000000be000 C:\WINDOWS\System32\msvcrt.dll (7.0.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.14393.0 ModLoad: 0000000076ee0000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 00000000766a0000 00000000000c1000 C:\WINDOWS\System32\RPCRT4.dll (6.2.14393.82) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Betriebssystem Microsoft® Windows® Product Version : 10.0.14393.0 ModLoad: 00000000742b0000 000000000001e000 C:\WINDOWS\System32\SspiCli.dll (6.2.14393.576) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.14393.576 (rs1_release_inmarket.161208-2252) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.576 ModLoad: 00000000742a0000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000076cd0000 000000000005a000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000076fa0000 0000000000025000 C:\WINDOWS\System32\IMM32.DLL (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000073ab0000 0000000000145000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.14321.1024) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.14321.1024 (rs1_release.160715-1616) Company Name : Microsoft Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14321.1024 ModLoad: 0000000076d30000 00000000000e0000 C:\WINDOWS\System32\ucrtbase.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 ModLoad: 0000000073a00000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.14393.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.14393.0 (rs1_release.160715-1616) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.14393.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 9606, Write: 0, Other 58505 - I/O Transfers Counters - Read: 0, Write: 1723, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 86040, QuotaPeakPagedPoolUsage: 86176 QuotaNonPagedPoolUsage: 8072, QuotaPeakNonPagedPoolUsage: 8632 - Virtual Memory Usage - VirtualSize: 52527104, PeakVirtualSize: 52527104 - Pagefile Usage - PagefileUsage: 2748416, PeakPagefileUsage: 2748416 - Working Set Size - WorkingSetSize: 5943296, PeakWorkingSetSize: 5943296, PageFaultCount: 1869 * Dump of thread ID 4116 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 5937500.000000, User Time: 19531250.000000, Wait Time: 43287504.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x026C912C - Registers - eax=00000065 ebx=004b63b9 ecx=0019dc88 edx=026c912c esi=0019da40 edi=0019dcb8 eip=0048ee46 esp=0019d9d4 ebp=0019dc64 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0019dc64 0048161c 0019dc88 004b63b8 00000000 0019dcb8 wah2_8.24_windows_intelx86!+0x0 0019dca8 0044fa52 026c912c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0019dcc8 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0019dce0 00485ca1 c0000005 0019dd14 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0019ff80 765b62c4 002a5000 765b62a0 4cd8f199 0019ffdc wah2_8.24_windows_intelx86!+0x0 0019ff94 77870fd9 002a5000 01959368 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0019ffdc 77870fa4 ffffffff 77892ed0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 0019ffec 00000000 00485cce 002a5000 00000000 78746341 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 10648 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 43287504.000000 - Registers - eax=00000000 ebx=00564cc0 ecx=00000000 edx=00000000 esi=00565368 edi=00565528 eip=778801cc esp=008ffddc ebp=008fff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 008fff80 765b62c4 00564cc0 765b62a0 4c4ef199 008fffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 008fff94 77870fd9 00564cc0 01039368 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 008fffdc 77870fa4 ffffffff 77892ed0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 008fffec 00000000 778467c0 00564cc0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 10596 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 43287504.000000 - Registers - eax=00000000 ebx=00564cc0 ecx=00000000 edx=00000000 esi=005688b8 edi=00568a78 eip=778801cc esp=009ffddc ebp=009fff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 009fff80 765b62c4 00564cc0 765b62a0 4c5ef199 009fffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 009fff94 77870fd9 00564cc0 01139368 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 009fffdc 77870fa4 ffffffff 77892ed0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 009fffec 00000000 778467c0 00564cc0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 6836 (state: Waiting): * - Information - Status: Wait Reason: EventPairLow, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 43287504.000000 - Registers - eax=00000000 ebx=00564cc0 ecx=00000000 edx=00000000 esi=00568d48 edi=00568f08 eip=778801cc esp=00affddc ebp=00afff80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00afff80 765b62c4 00564cc0 765b62a0 4c6ef199 00afffdc ntdll!NtWaitForWorkViaWorkerFactory+0x0 00afff94 77870fd9 00564cc0 01239368 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00afffdc 77870fa4 ffffffff 77892ed0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 00afffec 00000000 778467c0 00564cc0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Dump of thread ID 14180 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 43287444.000000 - Registers - eax=00000000 ebx=025ffd1c ecx=00000000 edx=00000000 esi=00000000 edi=025ffd1c eip=7787e91c esp=025ffcdc ebp=025ffd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 025ffd40 76842bcf 00000064 00000000 025fff80 00478b44 ntdll!NtDelayExecution+0x0 025ffd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 025fff80 765b62c4 00000000 765b62a0 4e9ef199 025fffdc wah2_8.24_windows_intelx86!+0x0 025fff94 77870fd9 00000000 03d39368 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 025fffdc 77870fa4 ffffffff 77892ed0 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 025fffec 00000000 00478b20 00000000 00000000 00000000 ntdll!RtlSubscribeWnfStateChangeNotification+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2017 16:14:12	1419921	20184801	wah2_eas50_e1vy_201412_10_507_010881471_0	69,419	160,814	2.3166
09 Feb 2017 19:00:59	1419921	20184801	wah2_eas50_e1vy_201412_10_507_010881471_0	57,899	136,922	2.3648
08 Feb 2017 21:09:37	1419921	20184801	wah2_eas50_e1vy_201412_10_507_010881471_0	46,379	112,859	2.4334
07 Feb 2017 11:42:38	1419921	20184801	wah2_eas50_e1vy_201412_10_507_010881471_0	34,859	88,738	2.5456
02 Feb 2017 17:57:18	1419921	20184801	wah2_eas50_e1vy_201412_10_507_010881471_0	23,339	62,756	2.6889
01 Feb 2017 17:41:15	1419921	20184801	wah2_eas50_e1vy_201412_10_507_010881471_0	11,819	31,825	2.6927