Task 21377952

Name	wah2_sam25_b0a5_199012_85_762_011674762_0
Workunit	11674762
Created	11 Nov 2018, 14:16:18 UTC
Sent	13 Nov 2018, 19:55:20 UTC
Report deadline	27 Oct 2019, 1:15:20 UTC
Received	4 Jan 2019, 14:31:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1468277
Run time	14 days 10 hours 37 min 33 sec
CPU time	14 days 6 hours 15 min 20 sec
Validate state	Invalid
Credit	12,178.71
Device peak FLOPS	3.62 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	414.32 MB
Peak swap size	380.98 MB
Peak disk usage	0.02 MB
Stderr	<core_client_version>7.8.3</core_client_version> <![CDATA[ <message> finish file present too long</message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj0dec CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1feb CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1mar CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1apr Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1may CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1jun Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1jul Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1aug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1sep CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1oct Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1nov CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj1dec CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj2feb Error converting file to netcdf: U:\BOINC\data/projects/climateprediction.net/wah2_sam25_b0a5_199012_85_762_011674762/dataout\b0a5ga.pdj2mar CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5852, selfPID=4372, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 15:15:48 (4372): called boinc_finish(0) CPDN Monitor - Abort request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0160012C Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 01/04/19 15:21:41 Install Directory : U:\BOINC\program\ Data Directory : U:\BOINC\data Project Symstore : LoadLibraryA( U:\BOINC\program\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( U:\BOINC\program\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( U:\BOINC\program\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( U:\BOINC\program\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: U:\BOINC\data\projects\climateprediction.net;U:\BOINC\data\projects\climateprediction.net ModLoad: 0000000000400000 0000000000152000 U:\BOINC\data\projects\climateprediction.net\wah2_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000076ff0000 0000000000142000 C:\Windows\SYSTEM32\ntdll.dll (6.1.7601.24308) (-exported- Symbols Loaded) Linked PDB Filename : ntdll.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000075750000 00000000000d5000 C:\Windows\system32\kernel32.dll (6.1.7601.24291) (-exported- Symbols Loaded) Linked PDB Filename : kernel32.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18015 ModLoad: 0000000074e20000 000000000004b000 C:\Windows\system32\KERNELBASE.dll (6.1.7601.24291) (-exported- Symbols Loaded) Linked PDB Filename : kernelbase.pdb File Version : 6.1.7601.18015 (win7sp1_gdr.121129-1432) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18015 ModLoad: 0000000076a70000 00000000000c9000 C:\Windows\system32\USER32.dll (6.1.7601.23594) (-exported- Symbols Loaded) Linked PDB Filename : user32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000076c10000 000000000004e000 C:\Windows\system32\GDI32.dll (6.1.7601.24308) (-exported- Symbols Loaded) Linked PDB Filename : gdi32.pdb File Version : 6.1.7601.24308 (win7sp1_ldr.181111-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.24308 ModLoad: 0000000075200000 000000000000a000 C:\Windows\system32\LPK.dll (6.1.7601.24280) (-exported- Symbols Loaded) Linked PDB Filename : lpk.pdb File Version : 6.1.7601.24280 (win7sp1_ldr.181006-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.24280 ModLoad: 0000000076590000 000000000009d000 C:\Windows\system32\USP10.dll (1.626.7601.23894) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.7601.23894 (win7sp1_ldr.170816-0600) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.7601.23894 ModLoad: 0000000075150000 00000000000ac000 C:\Windows\system32\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.7601.17744 (win7sp1_gdr.111215-1535) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.7601.17744 ModLoad: 0000000076b60000 00000000000a1000 C:\Windows\system32\ADVAPI32.dll (6.1.7601.24308) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.1.7601.24308 (win7sp1_ldr.181111-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.24308 ModLoad: 0000000076b40000 0000000000019000 C:\Windows\SYSTEM32\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000077190000 00000000000a2000 C:\Windows\system32\RPCRT4.dll (6.1.7601.24308) (-exported- Symbols Loaded) Linked PDB Filename : rpcrt4.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000077160000 000000000001f000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : imm32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 0000000075830000 00000000000cd000 C:\Windows\system32\MSCTF.dll (6.1.7601.23915) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 ModLoad: 0000000072a30000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.17514 ModLoad: 00000000741b0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.1.7600.16385 (win7_rtm.090713-1255) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7600.16385 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 1510, Write: 0, Other 13018 - I/O Transfers Counters - Read: 0, Write: 1977, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 53676, QuotaPeakPagedPoolUsage: 53756 QuotaNonPagedPoolUsage: 2340, QuotaPeakNonPagedPoolUsage: 2960 - Virtual Memory Usage - VirtualSize: 30359552, PeakVirtualSize: 31215616 - Pagefile Usage - PagefileUsage: 1601536, PeakPagefileUsage: 2285568 - Working Set Size - WorkingSetSize: 3166208, PeakWorkingSetSize: 3751936, PageFaultCount: 1013 * Dump of thread ID 3504 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 1404009.000000, User Time: 2808018.000000, Wait Time: 352630.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0048EE46 write attempt to address 0x0160012C - Registers - eax=00000065 ebx=004b63b9 ecx=0012dcf0 edx=0160012c esi=0012daa8 edi=0012dd20 eip=0048ee46 esp=0012da3c ebp=0012dccc cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00010202 - Callstack - ChildEBP RetAddr Args to Child 0012dccc 0048161c 0012dcf0 004b63b8 00000000 0012dd20 wah2_8.24_windows_intelx86!+0x0 0012dd10 0044fa52 0160012c 004b63b8 004b6484 00000421 wah2_8.24_windows_intelx86!+0x0 0012dd30 00496e90 0000000b 00000000 00000000 00000000 wah2_8.24_windows_intelx86!+0x0 0012dd48 00485ca1 c0000005 0012dd7c 00490c54 00000000 wah2_8.24_windows_intelx86!+0x0 0012ff88 7579efac 7ffd4000 0012ffd4 77053618 7ffd4000 wah2_8.24_windows_intelx86!+0x0 0012ff94 77053618 7ffd4000 774defd8 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 0012ffd4 770535eb 00485cce 7ffd4000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 0012ffec 00000000 00485cce 7ffd4000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 4472 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 352629.000000 - Registers - eax=00000062 ebx=00000000 ecx=00000002 edx=0153fce8 esi=0153fd24 edi=00000000 eip=77036c04 esp=0153fce0 ebp=0153fd48 cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 0153fd48 74e21818 00000064 00000000 0153ff88 00478b44 ntdll!KiFastSystemCallRet+0x0 0153fd58 00478b44 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 0153ff88 7579efac 00000000 0153ffd4 77053618 00000000 wah2_8.24_windows_intelx86!+0x0 0153ff94 77053618 00000000 760cefd8 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 0153ffd4 770535eb 00478b20 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 0153ffec 00000000 00478b20 00000000 00000000 01c30000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jan 2019 16:03:37	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	184,619	1,163,161	6.3003
02 Jan 2019 14:59:11	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	173,099	1,074,345	6.2065
31 Dec 2018 10:49:58	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	161,579	1,002,144	6.2022
30 Dec 2018 08:52:52	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	150,059	910,463	6.0674
29 Dec 2018 03:50:43	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	138,539	838,616	6.0533
28 Dec 2018 02:11:30	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	127,019	747,414	5.8843
27 Dec 2018 04:02:33	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	115,499	674,321	5.8383
25 Dec 2018 15:26:06	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	103,979	604,155	5.8104
24 Dec 2018 17:15:35	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	92,459	525,594	5.6846
23 Dec 2018 20:57:14	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	80,939	455,133	5.6232
22 Dec 2018 13:23:41	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	69,419	389,041	5.6042
21 Dec 2018 20:33:44	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	57,899	327,139	5.6502
20 Dec 2018 12:49:25	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	46,379	273,377	5.8944
19 Dec 2018 10:50:14	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	34,859	211,135	6.0568
18 Dec 2018 14:43:05	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	23,339	139,383	5.9721
15 Dec 2018 10:42:30	1468277	21377952	wah2_sam25_b0a5_199012_85_762_011674762_0	11,819	71,388	6.0401