Task 20702663

Name	wah2_afr50_k2th_201512_13_644_011208315_1
Workunit	11208315
Created	1 Sep 2017, 22:25:13 UTC
Sent	6 Sep 2017, 4:18:59 UTC
Report deadline	19 Aug 2018, 9:38:59 UTC
Received	10 Sep 2017, 13:03:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1378344
Run time	2 days 2 hours 53 min 43 sec
CPU time	2 days 2 hours 53 min 43 sec
Validate state	Invalid
Credit	7,619.09
Device peak FLOPS	3.97 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	219.52 MB
Peak swap size	183.24 MB
Peak disk usage	13.29 MB
Stderr	<core_client_version>7.6.33</core_client_version> <![CDATA[ <stderr_txt> 00:35:29 (17176): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 04:58:45 (4708): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:35:45 (8912): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:03:54 (15500): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:25:29 (21052): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:36:39 (20060): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:27:15 (8484): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:58:34 (11868): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:31:19 (9412): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:13:05 (13488): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:14:27 (11312): start_timer_thread(): CreateThread() failed, errno 0 20:14:29 (8684): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 00:13:41 (19576): start_timer_thread(): CreateThread() failed, errno 0 00:13:43 (3312): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:16:15 (13652): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 03:33:48 (14676): start_timer_thread(): CreateThread() failed, errno 0 03:33:50 (19896): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:08 (212): start_timer_thread(): CreateThread() failed, errno 0 07:32:10 (844): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:15:15 (12076): start_timer_thread(): CreateThread() failed, errno 0 20:15:17 (12148): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:04:52 (15940): start_timer_thread(): CreateThread() failed, errno 0 01:04:54 (15248): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:40:11 (16280): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:41:16 (16760): start_timer_thread(): CreateThread() failed, errno 0 12:41:18 (11768): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:13:58 (6364): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:16:37 (12636): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:02:56 (11060): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:45:35 (17956): start_timer_thread(): CreateThread() failed, errno 0 18:45:36 (1340): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:46:42 (9452): start_timer_thread(): CreateThread() failed, errno 0 23:46:44 (14012): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:48:04 (14860): start_timer_thread(): CreateThread() failed, errno 0 03:48:05 (17412): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:09:33 (9504): start_timer_thread(): CreateThread() failed, errno 0 06:09:35 (19388): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 07:34:11 (12988): start_timer_thread(): CreateThread() failed, errno 0 07:34:13 (7324): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:46:09 (15920): start_timer_thread(): CreateThread() failed, errno 0 10:46:11 (20924): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:53 (15448): start_timer_thread(): CreateThread() failed, errno 0 12:16:55 (13892): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:16:26 (19916): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:25:43 (16608): start_timer_thread(): CreateThread() failed, errno 0 21:25:44 (8708): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:23:04 (20000): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:08:15 (448): start_timer_thread(): CreateThread() failed, errno 0 02:08:16 (4020): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 02:18:38 (20312): start_timer_thread(): CreateThread() failed, errno 0 02:18:40 (17192): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:49:36 (11420): Can't acquire lockfile (32) - waiting 35s 05:50:11 (11420): Can't acquire lockfile (32) - exiting 05:50:11 (11420): Error: The process cannot access the file because it is being used by another process. (0x20) 06:57:26 (3008): Can't acquire lockfile (32) - waiting 35s 06:58:01 (3008): Can't acquire lockfile (32) - exiting 06:58:01 (3008): Error: The process cannot access the file because it is being used by another process. (0x20) Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75DCB802 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 09/10/17 07:45:38 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\wah2_afr50_k2th_201512_13_644_011208315;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077af0000 000000000018e000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000076890000 00000000000d0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.15063.296) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000075ce0000 00000000001c2000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.15063.502) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.15063.502 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.502 ModLoad: 0000000077520000 000000000013c000 C:\WINDOWS\System32\USER32.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000075b70000 0000000000016000 C:\WINDOWS\System32\win32u.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : wwin32u.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000076850000 0000000000021000 C:\WINDOWS\System32\GDI32.dll (6.2.15063.483) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.15063.483 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.483 ModLoad: 0000000077760000 0000000000158000 C:\WINDOWS\System32\gdi32full.dll (6.2.15063.413) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32full.pdb File Version : 10.0.15063.413 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.413 ModLoad: 0000000076720000 0000000000079000 C:\WINDOWS\System32\msvcp_win.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcp_win.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000077180000 0000000000118000 C:\WINDOWS\System32\ucrtbase.dll (6.2.15063.447) (-nosymbols- Symbols Loaded) Linked PDB Filename : ucrtbase.pdb File Version : 10.0.15063.447 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.447 ModLoad: 0000000076a00000 0000000000077000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.15063.0) (-nosymbols- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000077a30000 00000000000bd000 C:\WINDOWS\System32\msvcrt.dll (7.0.15063.0) (-nosymbols- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.15063.0 ModLoad: 00000000745c0000 0000000000041000 C:\WINDOWS\System32\sechost.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000076240000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.15063.447) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 00000000745a0000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.15063.0) (-nosymbols- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 ModLoad: 0000000074590000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.15063.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.15063.0 (WinBuild.160101.0800) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.15063.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 24127, Write: 0, Other 23465 - I/O Transfers Counters - Read: 0, Write: 4774, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 241592, QuotaPeakPagedPoolUsage: 241592 QuotaNonPagedPoolUsage: 8824, QuotaPeakNonPagedPoolUsage: 9000 - Virtual Memory Usage - VirtualSize: 144318464, PeakVirtualSize: 144318464 - Pagefile Usage - PagefileUsage: 4018176, PeakPagefileUsage: 17477632 - Working Set Size - WorkingSetSize: 80703488, PeakWorkingSetSize: 94265344, PageFaultCount: 31635 * Dump of thread ID 20328 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 9687500.000000, User Time: 56250000.000000, Wait Time: 27441258.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75DCB802 - Registers - eax=0019e690 ebx=007c6c10 ecx=00000003 edx=00000000 esi=62fa922c edi=62fbc450 eip=75dcb802 esp=0019e690 ebp=0019e6ec cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 0019e6ec 62f8caf9 e06d7363 00000001 00000003 0019e718 KERNELBASE!RaiseException+0x0 0019e724 62f89ebc 0019e734 62fb59d8 62fa922c 62fab27c KERNELBASE!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '62f8caf9' 0019e744 62f4e42b 00dc6f40 007c6c10 004e4d99 00893618 KERNELBASE!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '62f89ebc' 0019e760 62f429b1 0019e798 0019e884 0019e86c 0019e860 KERNELBASE!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '62f4e42b' 0019e9a8 62f4efac 00827910 0019ea3d 00000000 0019eb44 KERNELBASE!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '62f429b1' 0019eb44 0040bdf2 004e4d98 004e4ed0 004e4c90 00000000 KERNELBASE!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '62f4efac' 0019eb7c 00401f96 023ba418 023ba46c 023ba46c 00000001 wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '0040bdf2' 0019ebd0 004021f0 000007e0 0000000a 0019eb84 004cefe0 wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00401f96' 0019ed98 00402703 000007e0 0000000a 024c0040 0019edf8 wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004021f0' 0019edac 0040724e 000007e0 024c0040 004cefe0 004a56b0 wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00402703' 0019edf8 004092c5 00000000 038aee88 00485cce 00000000 wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '0040724e' 0019fd40 004094b7 0019fef0 00409535 004d1370 0019fd60 wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004092c5' 0019fd48 00409535 004d1370 0019fd60 005953b0 0019fd60 wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004094b7' 0019fef0 00485c7b 00400000 00000000 005953ee 0000000a wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00409535' 0019ff80 768a8744 0025a000 768a8720 75551beb 0019ffdc wah2_8.24_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00485c7b' 0019ff94 77b5582d 0025a000 7406fb3e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '768a8744' 0019ffdc 77b557fd ffffffff 77b7636a 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '77b5582d' 0019ffec 00000000 00485cce 0025a000 00000000 78746341 ntdll!RtlGetAppContainerNamedObjectPath+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '77b557fd' * Dump of thread ID 7900 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 156250.000000, User Time: 156250.000000, Wait Time: 27441254.000000 - Registers - eax=00000000 ebx=024bfd1c ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=77b6205c esp=024bfcdc ebp=024bfd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 024bfd40 75dd351f 00000064 00000000 024bff80 00478b44 ntdll!NtDelayExecution+0x0 024bfd50 00478b44 00000064 00478b20 00478b20 00000000 KERNELBASE!Sleep+0x0 024bff80 768a8744 00000000 768a8720 77071beb 024bffdc wah2_8.24_windows_intelx86!+0x0 024bff94 77b5582d 00000000 7654fb3e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 024bffdc 77b557fd ffffffff 77b7636a 00000000 00000000 ntdll!RtlGetAppContainerNamedObjectPath+0x0 024bffec 00000000 00478b20 00000000 00000000 32686177 ntdll!RtlGetAppContainerNamedObjectPath+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20312, selfPID=20312, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20312, selfPID=17192, iMonCtr=1 07:58:16 (4672): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received: Segment violation Signal 11 received: Software termination signal from kill Signal 11 received: Abnormal termination triggered by abort call Signal 11 received, exiting... 08:03:16 (14020): called boinc_finish(193) Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4672, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14020, selfPID=16080, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 08:03:20 (16080): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_afr50_k2th_201512_13_644_011208315_1_r189530231_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_afr50_k2th_201512_13_644_011208315_1_r189530231_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_afr50_k2th_201512_13_644_011208315_1_r189530231_13.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_afr50_k2th_201512_13_644_011208315_1_r189530231_restart.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Sep 2017 07:08:09	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	115,499	166,748	1.4437
09 Sep 2017 23:39:37	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	103,979	150,152	1.4441
09 Sep 2017 08:28:19	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	92,459	133,656	1.4456
09 Sep 2017 01:40:47	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	80,939	116,941	1.4448
08 Sep 2017 08:39:27	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	69,419	100,396	1.4462
07 Sep 2017 20:58:05	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	57,899	84,161	1.4536
07 Sep 2017 16:11:24	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	46,379	67,254	1.4501
07 Sep 2017 09:26:07	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	34,859	50,186	1.4397
07 Sep 2017 01:11:39	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	23,339	33,860	1.4508
06 Sep 2017 10:35:42	1378344	20702663	wah2_afr50_k2th_201512_13_644_011208315_1	11,819	17,220	1.4570