climateprediction.net home page
Task 18644640

Task 18644640

Name hadam3p_pnw_popw_2013_1_009979688_0
Workunit 9986046
Created 29 Jun 2015, 18:24:42 UTC
Sent 13 Jul 2015, 19:05:03 UTC
Report deadline 25 Jun 2016, 0:25:03 UTC
Received 21 Aug 2015, 22:01:22 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 14 (0x0000000E) Unknown error code
Computer ID 1358851
Run time 15 hours 48 min 50 sec
CPU time 12 hours 19 min 18 sec
Validate state Invalid
Credit 256.81
Device peak FLOPS 2.86 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v7.27
windows_intelx86
Stderr
<core_client_version>7.4.42</core_client_version>
<![CDATA[
<message>
Not enough storage is available to complete this operation.
 (0xe) - exit code 14 (0xe)
</message>
<stderr_txt>


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x7796DFE4 read attempt to address 0x6F6FFFFF

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.5.1


Dump Timestamp    : 07/13/15 22:35:07
Install Directory : 
Data Directory    : D:\BOINC_data
Project Symstore  : 
LoadLibraryA( D:\BOINC_data\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\BOINC_data\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\BOINC_data\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\BOINC_data\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\BOINC_data\slots\5;D:\BOINC_data\projects\climateprediction.net


ModLoad: 0000000000400000 000000000018e000 D:\BOINC_data\projects\climateprediction.net\hadam3p_pnw_7.27_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 0000000077940000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.22436) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000758e0000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.18229) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 00000000755e0000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.18229) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 00000000770e0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076010000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.18275) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.18275 (win7sp1_gdr.131002-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18275

ModLoad: 0000000077910000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.18177) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.18177 (win7sp1_gdr.130605-1534)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18177

ModLoad: 0000000075ba0000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.18151) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.18151 (win7sp1_gdr.130512-1533)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.18151

ModLoad: 00000000759f0000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 0000000075700000 00000000000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.22436) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000077520000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000763a0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.18205) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075360000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.22465) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.22465 (win7sp1_ldr.130924-1532)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.22465

ModLoad: 0000000075350000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075ab0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 0000000076280000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075200000 0000000000073000 C:\Windows\SysWOW64\guard32.dll (8.2.0.4591) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\jenkins\workspace\CIS_DRV_CIS_8.2_Hotfix\Release\x32\Symbols\guard32.pdb
    File Version          : 8, 2, 0, 4591
    Company Name          : COMODO
    Product Name          : COMODO Internet Security
    Product Version       : 8, 2, 0, 4591

ModLoad: 00000000771e0000 000000000015c000 C:\Windows\syswow64\ole32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075560000 0000000000057000 C:\Windows\syswow64\SHLWAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : shlwapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075280000 0000000000009000 C:\Windows\system32\VERSION.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000077510000 0000000000005000 C:\Windows\syswow64\PSAPI.DLL (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : psapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000751f0000 0000000000007000 C:\Windows\system32\fltlib.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : fltLib.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000733f0000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000076350000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000072090000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075100000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 15657, Write: 0, Other 56520

- I/O Transfers Counters -
Read: 0, Write: 3512, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 104304, QuotaPeakPagedPoolUsage: 130600
QuotaNonPagedPoolUsage: 49088, QuotaPeakNonPagedPoolUsage: 49168

- Virtual Memory Usage -
VirtualSize: 62046208, PeakVirtualSize: 74199040

- Pagefile Usage -
PagefileUsage: 4530176, PeakPagefileUsage: 9560064

- Working Set Size -
WorkingSetSize: 32772096, PeakWorkingSetSize: 33157120, PageFaultCount: 11678

*** Dump of thread ID 4540 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1216604.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x7796DFE4 read attempt to address 0x6F6FFFFF

- Registers -
eax=6f6ffff8 ebx=6f700000 ecx=d6bff2ff edx=02e9e8b8 esi=012c0000 edi=00000000
eip=7796dfe4 esp=02f9fe5c ebp=02f9fe6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010246

- Callstack -
ChildEBP RetAddr  Args to Child
02f9fe6c 758f14ad 012c0000 00000000 6f700000 02f9fe94 ntdll!RtlFreeHeap+0x0 
02f9fe80 00482de7 012c0000 00000000 6f700000 02f9feac kernel32!HeapFree+0x0 
02f9fe94 00447e11 6f700000 00000000 016d0020 80000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
02f9feac 0044f568 016d0020 00000000 005597a4 02f9fefc hadam3p_pnw_7.27_windows_intelx!+0x0 
02f9fec0 0048374c 00000015 d4460c03 00000001 00000006 hadam3p_pnw_7.27_windows_intelx!+0x0 
02f9fefc 75996e51 00000006 d443905c 00000000 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
02f9ff88 758f336a 00000006 02f9ffd4 7797bf32 80000006 kernel32!CtrlRoutine+0x0 
02f9ff94 7797bf32 80000006 745a84b6 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
02f9ffd4 7797bf05 75996c9c 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
02f9ffec 00000000 75996c9c 80000006 00000000 17f66361 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 5076 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 7020045.000000, User Time: 40716260.000000, Wait Time: 1216599.000000

- Registers -
eax=00000000 ebx=004cf850 ecx=00000000 edx=00000000 esi=0018f9d8 edi=00000000
eip=7795fd91 esp=0018f994 ebp=0018f9fc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018f9fc 755f4498 000000c8 00000000 0018fa20 004689c1 ntdll!NtDelayExecution+0x0 
0018fa0c 004689c1 000000c8 000000c8 00000000 0018fa58 KERNELBASE!Sleep+0x0 
0018fa20 00403ddc a0000000 027f9999 004cf858 004cfb88 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fa58 00404d76 00000000 d6a70fb7 00000000 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fd48 00404f67 0018fef8 00404fe5 004d02a8 0018fd68 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fd50 00404fe5 004d02a8 0018fd68 00302e18 0018fd68 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018fef8 00484e1b 00400000 00000000 00302e5d 0000000a hadam3p_pnw_7.27_windows_intelx!+0x0 
0018ff88 758f336a 7efde000 0018ffd4 7797bf32 7efde000 hadam3p_pnw_7.27_windows_intelx!+0x0 
0018ff94 7797bf32 7efde000 76bb84b6 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 7797bf05 00484e6e 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 00484e6e 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 3384 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1216598.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=016cfd24 edi=00000000
eip=7795fd91 esp=016cfce0 ebp=016cfd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
016cfd48 755f4498 00000064 00000000 016cff88 00477e94 ntdll!NtDelayExecution+0x0 
016cfd58 00477e94 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
016cff88 758f336a 00000000 016cffd4 7797bf32 00000000 hadam3p_pnw_7.27_windows_intelx!+0x0 
016cff94 7797bf32 00000000 77cf84b6 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
016cffd4 7797bf05 00477e70 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
016cffec 00000000 00477e70 00000000 00000000 61646168 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4752, selfPID=4752, iMonCtr=1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4752, selfPID=5072, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/xaakm.pipe_dummy                                                            2048    
Leaving CPDN_Main::Monitor...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Aug 2015 17:23:34 1358851 18644640 hadam3p_pnw_popw_2013_1_009979688_0 11,819 30,534 2.5835


©2024 climateprediction.net