Task 18744716

Name	hadam3p_pnw_e8cx_2012_1_010053491_0
Workunit	10033346
Created	29 Jul 2015, 13:51:13 UTC
Sent	29 Jul 2015, 14:01:34 UTC
Report deadline	10 Jul 2016, 19:21:34 UTC
Received	2 Aug 2015, 16:51:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	9 (0x00000009) Unknown error code
Computer ID	1335410
Run time	14 hours 25 min 23 sec
CPU time	12 hours 18 min 20 sec
Validate state	Invalid
Credit	256.81
Device peak FLOPS	3.01 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.27 windows_intelx86
Stderr	<core_client_version>7.6.6</core_client_version> <![CDATA[ <message> The storage control block address is invalid. (0x9) - exit code 9 (0x9) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00462B87 read attempt to address 0x00CE73AC Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.5.1 Dump Timestamp : 07/29/15 16:10:21 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\slots\0;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000000400000 000000000018e000 C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_pnw_7.27_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 0000000077110000 000000000016e000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.3.9600.17736) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.3.9600.17031 (winblue_gdr.140221-1952) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17031 ModLoad: 0000000075650000 0000000000140000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.3.9600.17031 (winblue_gdr.140221-1952) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17031 ModLoad: 0000000074e80000 00000000000d7000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.3.9600.17031 (winblue_gdr.140221-1952) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17031 ModLoad: 0000000074bf0000 0000000000153000 C:\WINDOWS\SYSTEM32\USER32.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000074b20000 000000000007c000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000075790000 000000000010f000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.3.9600.17902) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.3.9600.17902 (winblue_ltsb.150609-2200) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17902 ModLoad: 0000000076d50000 00000000000c3000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9600.17415 ModLoad: 0000000076ff0000 0000000000041000 C:\WINDOWS\SYSTEM32\sechost.dll (6.3.9600.17734) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000075590000 00000000000ba000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.3.9600.17919) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 0000000074910000 000000000001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 0000000074900000 000000000000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 00000000748a0000 0000000000054000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 ModLoad: 00000000747c0000 0000000000028000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 00000000729f0000 0000000000141000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.3.9600.17787) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.3.9600.17787 (winblue_r10.150331-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17787 ModLoad: 0000000074890000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.3.9600.17415) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.3.9600.17415 (winblue_r4.141028-1500) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.17415 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 14887, Write: 0, Other 56175 - I/O Transfers Counters - Read: 0, Write: 3103, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 92024, QuotaPeakPagedPoolUsage: 92200 QuotaNonPagedPoolUsage: 7536, QuotaPeakNonPagedPoolUsage: 7584 - Virtual Memory Usage - VirtualSize: 51056640, PeakVirtualSize: 51056640 - Pagefile Usage - PagefileUsage: 2355200, PeakPagefileUsage: 2965504 - Working Set Size - WorkingSetSize: 29843456, PeakWorkingSetSize: 30773248, PageFaultCount: 8816 * Dump of thread ID 3520 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4258129.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00462B87 read attempt to address 0x00CE73AC - Registers - eax=00000015 ebx=fffffffe ecx=00000000 edx=00000000 esi=00c17020 edi=00000000 eip=00462b87 esp=0267fe7c ebp=0267fe80 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010216 - Callstack - ChildEBP RetAddr Args to Child 0267fe80 00447d6f 00c17020 00000000 00c17020 fffffffe hadam3p_pnw_7.27_windows_intelx!+0x0 0267fe98 0044f568 00c17020 00000000 005597a4 0267fee8 hadam3p_pnw_7.27_windows_intelx!+0x0 0267feac 0048374c 00000015 b30b22f8 00000006 004836bc hadam3p_pnw_7.27_windows_intelx!+0x0 0267fee8 74f123c4 00000006 c7b3f95e 74f12200 74f12200 hadam3p_pnw_7.27_windows_intelx!+0x0 0267ff80 75667c04 80000006 75667be0 c632c0d6 0267ffdc KERNELBASE!CtrlRoutine+0x0 0267ff94 7716ad1f 80000006 c466f5c4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0267ffdc 7716acea ffffffff 77150233 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 0267ffec 00000000 74f12200 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 5332 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 18906250.000000, User Time: 57500000.000000, Wait Time: 4258117.000000 - Registers - eax=00000000 ebx=0018f9d0 ecx=00000000 edx=00000000 esi=00000000 edi=0018f9d0 eip=7714c7bc esp=0018f990 ebp=0018f9f4 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 0018f9f4 74e8104f 000000c8 00000000 0018fa18 004689c1 ntdll!NtDelayExecution+0x0 0018fa04 004689c1 000000c8 000000c8 00000000 0018fa50 KERNELBASE!Sleep+0x0 0018fa18 00403ddc a0000000 027f9999 004cf858 004cfb88 hadam3p_pnw_7.27_windows_intelx!+0x0 0018fa50 00404d76 00000000 b1742150 00484e6e 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 0018fd40 00404f67 0018fef0 00404fe5 004d02a8 0018fd60 hadam3p_pnw_7.27_windows_intelx!+0x0 0018fd48 00404fe5 004d02a8 0018fd60 006a31b0 0018fd60 hadam3p_pnw_7.27_windows_intelx!+0x0 0018fef0 00484e1b 00400000 00000000 006a31f5 0000000a hadam3p_pnw_7.27_windows_intelx!+0x0 0018ff80 75667c04 7ffde000 75667be0 c44dc0d6 0018ffdc hadam3p_pnw_7.27_windows_intelx!+0x0 0018ff94 7716ad1f 7ffde000 c619f5c4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 0018ffdc 7716acea ffffffff 77150233 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 0018ffec 00000000 00484e6e 7ffde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 * Dump of thread ID 9176 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 4258125.000000 - Registers - eax=c0000022 ebx=00c0fd1c ecx=00000000 edx=00000000 esi=00000000 edi=00c0fd1c eip=7714c7bc esp=00c0fcdc ebp=00c0fd40 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00c0fd40 74e8104f 00000064 00000000 00c0ff80 00477e94 ntdll!NtDelayExecution+0x0 00c0fd50 00477e94 00000064 00477e70 00477e70 00000000 KERNELBASE!Sleep+0x0 00c0ff80 75667c04 00000000 75667be0 c495c0d6 00c0ffdc hadam3p_pnw_7.27_windows_intelx!+0x0 00c0ff94 7716ad1f 00000000 c6c1f5c4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 00c0ffdc 7716acea ffffffff 77150233 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 00c0ffec 00000000 00477e70 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8956, selfPID=7416, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8956, selfPID=8956, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2460, selfPID=2460, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2460, selfPID=4952, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jul 2015 14:46:12	1335410	18744716	hadam3p_pnw_e8cx_2012_1_010053491_0	11,819	35,343	2.9904