Task 20535216

Name	hadcm3s_90mq_202412_120_595_011107893_1
Workunit	11107893
Created	3 Jul 2017, 17:05:47 UTC
Sent	3 Jul 2017, 17:05:51 UTC
Report deadline	15 Jun 2018, 22:25:51 UTC
Received	6 Aug 2017, 7:33:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1418959
Run time	4 days 14 hours 19 min 26 sec
CPU time	3 days 7 hours 4 min 54 sec
Validate state	Invalid
Credit	3,111.26
Device peak FLOPS	3.31 GFLOPS
Application version	UK Met Office HadCM3 short v8.34 windows_intelx86
Peak working set size	161.56 MB
Peak swap size	192.69 MB
Peak disk usage	51.41 MB
Stderr	<core_client_version>7.6.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0045A9B7 read attempt to address 0x00DBF3AC Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.7.0 Dump Timestamp : 07/28/17 07:00:11 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\slots\33;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 0000000000144000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3s_8.34_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 00000000772f0000 000000000016f000 C:\Windows\SYSTEM32\ntdll.dll (6.3.9600.18233) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.3.9600.18217 (winblue_ltsb.160124-0053) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18217 ModLoad: 0000000075470000 0000000000140000 C:\Windows\SYSTEM32\KERNEL32.DLL (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.3.9600.18217 (winblue_ltsb.160124-0053) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18217 ModLoad: 0000000074d20000 00000000000d7000 C:\Windows\SYSTEM32\KERNELBASE.dll (6.3.9600.18340) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.3.9600.18217 (winblue_ltsb.160124-0053) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18217 ModLoad: 0000000076e30000 0000000000153000 C:\Windows\SYSTEM32\USER32.dll (6.3.9600.18439) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000076db0000 000000000007c000 C:\Windows\SYSTEM32\ADVAPI32.dll (6.3.9600.18155) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000076ca0000 000000000010f000 C:\Windows\SYSTEM32\GDI32.dll (6.3.9600.18344) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.3.9600.18344 (winblue_ltsb.160518-1031) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18344 ModLoad: 00000000757c0000 00000000000c3000 C:\Windows\SYSTEM32\msvcrt.dll (7.0.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9600.17415 ModLoad: 0000000074fd0000 0000000000041000 C:\Windows\SYSTEM32\sechost.dll (6.3.9600.17734) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000075370000 00000000000ba000 C:\Windows\SYSTEM32\RPCRT4.dll (6.3.9600.18292) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 00000000757a0000 000000000001e000 C:\Windows\SYSTEM32\SspiCli.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 0000000074ad0000 000000000000a000 C:\Windows\SYSTEM32\CRYPTBASE.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 0000000074a70000 0000000000054000 C:\Windows\SYSTEM32\bcryptPrimitives.dll (6.3.9600.18344) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.3.9600.18344 (winblue_ltsb.160518-1031) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.18344 ModLoad: 0000000074a30000 0000000000028000 C:\Windows\SYSTEM32\ntmarta.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 00000000748e0000 0000000000141000 C:\Windows\SYSTEM32\dbghelp.dll (6.3.9600.17787) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.3.9600.17787 (winblue_r10.150331-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17787 ModLoad: 0000000074a60000 0000000000008000 C:\Windows\SYSTEM32\version.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 1015, Write: 0, Other 4478 - I/O Transfers Counters - Read: 0, Write: 3712, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 52400, QuotaPeakPagedPoolUsage: 52576 QuotaNonPagedPoolUsage: 7536, QuotaPeakNonPagedPoolUsage: 7536 - Virtual Memory Usage - VirtualSize: 31412224, PeakVirtualSize: 31412224 - Pagefile Usage - PagefileUsage: 2162688, PeakPagefileUsage: 2359296 - Working Set Size - WorkingSetSize: 9216000, PeakWorkingSetSize: 9216000, PageFaultCount: 2600 * Dump of thread ID 5328 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 2765055.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x0045A9B7 read attempt to address 0x00DBF3AC - Registers - eax=00000015 ebx=fffffffe ecx=00000000 edx=00000000 esi=00cef020 edi=00000000 eip=0045a9b7 esp=0144fe7c ebp=0144fe80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010216 - Callstack - ChildEBP RetAddr Args to Child 0144fe80 0043fc0f 00cef020 00000000 00cef020 fffffffe hadcm3s_8.34_windows_intelx86!+0x0 0144fe98 00447418 00cef020 00000000 0050e9f0 0144fee8 hadcm3s_8.34_windows_intelx86!+0x0 0144feac 0047d443 00000015 62b92397 00000006 0047d3b3 hadcm3s_8.34_windows_intelx86!+0x0 0144fee8 74db2354 00000006 162b1ec6 74db2190 74db2190 hadcm3s_8.34_windows_intelx86!+0x0 0144ff80 75487c04 80000006 75487be0 17a2296c 0144ffdc KERNELBASE!CtrlRoutine+0x0 0144ff94 7734ab8f 80000006 15cb85f6 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0144ffdc 7734ab5a ffffffff 7732ffd4 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 0144ffec 00000000 74db2190 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 4788 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 4218750.000000, User Time: 10625000.000000, Wait Time: 2765054.000000 - Registers - eax=00000000 ebx=0018ed3c ecx=00000000 edx=00000000 esi=00000000 edi=0018ed3c eip=7732c57c esp=0018ecfc ebp=0018ed60 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 0018ed60 74d2104f 000000c8 00000000 0018ed84 00460611 ntdll!ZwDelayExecution+0x0 0018ed70 00460611 000000c8 000000c8 00000000 0018edcc KERNELBASE!Sleep+0x0 0018ed84 0040d157 a0000000 027f9999 004c234f 00000000 hadcm3s_8.34_windows_intelx86!+0x0 0018edcc 0040d50b 00000001 00000000 004c2368 00000000 hadcm3s_8.34_windows_intelx86!+0x0 0018edfc 0040e795 00000000 63e5203f 0047da15 00000000 hadcm3s_8.34_windows_intelx86!+0x0 0018fd40 0040e91a 0018fef0 0040e999 004c2590 0018fd60 hadcm3s_8.34_windows_intelx86!+0x0 0018fd48 0040e999 004c2590 0018fd60 006c26d0 0018fd60 hadcm3s_8.34_windows_intelx86!+0x0 0018fef0 0047d9c2 00400000 00000000 006c2711 0000000a hadcm3s_8.34_windows_intelx86!+0x0 0018ff80 75487c04 7ffde000 75487be0 16fe296c 0018ffdc hadcm3s_8.34_windows_intelx86!+0x0 0018ff94 7734ab8f 7ffde000 149785f6 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0018ffdc 7734ab5a ffffffff 7732ffd4 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 0018ffec 00000000 0047da15 7ffde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 352 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 312500.000000, User Time: 312500.000000, Wait Time: 2765051.000000 - Registers - eax=c0000022 ebx=00cdfd1c ecx=00000000 edx=00000000 esi=00000000 edi=00cdfd1c eip=7732c57c esp=00cdfcdc ebp=00cdfd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00cdfd40 74d2104f 00000064 00000000 00cdff80 004705d4 ntdll!ZwDelayExecution+0x0 00cdfd50 004705d4 00000064 004705b0 004705b0 00000000 KERNELBASE!Sleep+0x0 00cdff80 75487c04 00000000 75487be0 162b296c 00cdffdc hadcm3s_8.34_windows_intelx86!+0x0 00cdff94 7734ab8f 00000000 144285f6 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00cdffdc 7734ab5a ffffffff 7732ffd4 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 00cdffec 00000000 004705b0 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( 03:26:48 (3536): called boinc_finish(22) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jul 2017 07:17:55	1418959	20535216	hadcm3s_90mq_202412_120_595_011107893_1	259,272	50,151	0.1934