Task 19258642

Name	wah2_eu25_o128_204112_12_333_010298051_0
Workunit	10298051
Created	9 Feb 2016, 19:37:16 UTC
Sent	9 Feb 2016, 23:01:00 UTC
Report deadline	22 Jan 2017, 4:21:00 UTC
Received	24 Feb 2016, 23:27:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1375559
Run time	6 days 8 hours 38 min 9 sec
CPU time	6 days 4 hours 15 min 3 sec
Validate state	Invalid
Credit	4,579.34
Device peak FLOPS	3.52 GFLOPS
Application version	Weather At Home 2 (wah2) (region independent) v7.08 windows_intelx86
Stderr	<core_client_version>7.6.9</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... 00:00:05 (6308): called boinc_finish(193) Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75FDC42D Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.5.0 Dump Timestamp : 02/25/16 00:00:06 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\wah2_eu25_o128_204112_12_333_010298051;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000230000 00000000008e7000 C:\ProgramData\BOINC\projects\climateprediction.net\wah2rm3m2t_um_7.08_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : F:\region_independent\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2rm3m2t.pdb ModLoad: 0000000077420000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.19110) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.1.7601.19110 (win7sp1_gdr.151230-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.19110 ModLoad: 0000000075da0000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.19110) (-nosymbols- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.1.7601.19110 (win7sp1_gdr.151230-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.19110 ModLoad: 0000000075fd0000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.19110) (-nosymbols- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.1.7601.19110 (win7sp1_gdr.151230-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.19110 ModLoad: 00000000750c0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.19061) (-nosymbols- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.1.7601.17514 (win7sp1_rtm.101119-1850) Company Name : Microsoft Corporation Product Name : Système dexploitation Microsoft® Windows® Product Version : 6.1.7601.17514 ModLoad: 0000000075c80000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.19091) (-nosymbols- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.1.7601.19091 (win7sp1_gdr.151208-0600) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.19091 ModLoad: 00000000773f0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18985) (-nosymbols- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.1.7601.18985 (win7sp1_gdr.150901-1452) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.1.7601.18985 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 6, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 151, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 248976, QuotaPeakPagedPoolUsage: 248976 QuotaNonPagedPoolUsage: 7080, QuotaPeakNonPagedPoolUsage: 7200 - Virtual Memory Usage - VirtualSize: 1007669248, PeakVirtualSize: 1007669248 - Pagefile Usage - PagefileUsage: 9052160, PeakPagefileUsage: 25161728 - Working Set Size - WorkingSetSize: 4730880, PeakWorkingSetSize: 4730880, PageFaultCount: 1198 * Dump of thread ID 4392 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1968989.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x75FDC42D - Registers - eax=1235f5a8 ebx=7efde000 ecx=00000003 edx=00000000 esi=005ba6f8 edi=006a3b4c eip=75fdc42d esp=1235f5a8 ebp=1235f5f8 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 1235f5f8 00560967 e06d7363 00000001 00000003 1235f624 KERNELBASE!+0x0 1235f630 0055d531 1235f640 005d6ed4 005ba6f8 005cf364 wah2rm3m2t_um_7.08_windows_inte!+0x0 1235f650 00236302 01000000 00238e29 13f70000 13f73b46 wah2rm3m2t_um_7.08_windows_inte!+0x0 1235fa7c 0055f94a 00230000 00000000 123f671e 0000000a wah2rm3m2t_um_7.08_windows_inte!+0x0 1235fb0c 75db338a 7efde000 1235fb58 77459882 7efde000 wah2rm3m2t_um_7.08_windows_inte!+0x0 1235fb18 77459882 7efde000 64b36a29 00000000 00000000 kernel32!+0x0 1235fb58 77459855 0055f99d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 1235fb70 00000000 0055f99d 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 7584 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1968989.000000 - Registers - eax=004e2090 ebx=00000000 ecx=00000000 edx=00000000 esi=3b9ff530 edi=00000000 eip=7743fdd1 esp=3b9ff4ec ebp=3b9ff554 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000246 - Callstack - ChildEBP RetAddr Args to Child 3b9ff554 75fe44ab 00000064 00000000 3b9ff794 004e20b4 ntdll!ZwDelayExecution+0x0 3b9ff564 004e20b4 00000064 00000000 00000000 00000000 KERNELBASE!+0x0 3b9ff794 75db338a 00000000 3b9ff7e0 77459882 00000000 wah2rm3m2t_um_7.08_windows_inte!+0x0 3b9ff7a0 77459882 00000000 4d196691 00000000 00000000 kernel32!+0x0 3b9ff7e0 77459855 004e2090 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 3b9ff7f8 00000000 004e2090 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6564, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 00:00:09 (6564): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_eu25_o128_204112_12_333_010298051_0_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_o128_204112_12_333_010298051_0_8.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_o128_204112_12_333_010298051_0_9.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_o128_204112_12_333_010298051_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_o128_204112_12_333_010298051_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_o128_204112_12_333_010298051_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eu25_o128_204112_12_333_010298051_0_13.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Feb 2016 01:09:20	1375559	19258642	wah2_eu25_o128_204112_12_333_010298051_0	69,419	506,029	7.2895
21 Feb 2016 05:53:47	1375559	19258642	wah2_eu25_o128_204112_12_333_010298051_0	57,899	415,332	7.1734
20 Feb 2016 04:47:09	1375559	19258642	wah2_eu25_o128_204112_12_333_010298051_0	46,379	333,728	7.1957
16 Feb 2016 03:04:37	1375559	19258642	wah2_eu25_o128_204112_12_333_010298051_0	34,859	251,383	7.2114
14 Feb 2016 08:56:27	1375559	19258642	wah2_eu25_o128_204112_12_333_010298051_0	23,339	168,998	7.2410
13 Feb 2016 07:00:42	1375559	19258642	wah2_eu25_o128_204112_12_333_010298051_0	11,819	85,288	7.2162