climateprediction.net home page
Task 19761744

Task 19761744

Name hadam3p_eu_iek2_20165_3_412_010613436_0
Workunit 10613436
Created 21 Jun 2016, 9:22:40 UTC
Sent 21 Jun 2016, 15:41:11 UTC
Report deadline 3 Jun 2017, 21:01:11 UTC
Received 24 Jun 2016, 14:32:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1291402
Run time 15 hours 11 min 3 sec
CPU time 9 hours 24 min 21 sec
Validate state Invalid
Credit 203.89
Device peak FLOPS 3.84 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Europe v7.28
windows_intelx86
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<message>
Adresa  - exit code 9 (0x9)
</message>
<stderr_txt>
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7084, selfPID=7144, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7084, selfPID=7084, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2588, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2660, selfPID=2152, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
17:10:24 (2152): called boinc_finish(0)


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00462BB0 read attempt to address 0x3F061D7E

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 06/22/16 22:11:33
Install Directory : 
Data Directory    : D:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( D:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\ProgramData\BOINC\slots\2;D:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 0000000000400000 0000000000199000 D:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_eu_7.28_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 00000000774e0000 0000000000180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000769b0000 0000000000110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 0000000077030000 0000000000047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.18015 (win7sp1_gdr.121129-1432)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.18015

ModLoad: 000000006af60000 000000000003e000 C:\Program Files (x86)\Norton Internet Security\NortonData\22.6.0.142\Definitions\BASHDefs\20160613.001\UMEngx86.dll (10.1.0.96) (-exported- Symbols Loaded)
    Linked PDB Filename   : C:\bld_area\BehaviorBlocking\BB10.1\Src\10.1.0\Bin\Win32\Release\UMEngx86.pdb
    File Version          : 10.1.0.96
    Company Name          : Symantec Corporation
    Product Name          : BASH
    Product Version       : 10.1.0.96

ModLoad: 00000000754b0000 0000000000100000 C:\Windows\syswow64\USER32.dll (6.1.7601.19061) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000751a0000 0000000000090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.23457) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.23457 (win7sp1_ldr.160518-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23457

ModLoad: 00000000774b0000 000000000000a000 C:\Windows\syswow64\LPK.dll (6.1.7601.23453) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7601.23453 (win7sp1_ldr.160513-1233)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23453

ModLoad: 00000000767b0000 000000000009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.19054) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.19054 (win7sp1_gdr.151103-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.19054

ModLoad: 0000000076b20000 00000000000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 00000000768b0000 00000000000a1000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.23418) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7601.23418 (win7sp1_ldr.160408-2045)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23418

ModLoad: 0000000075950000 0000000000019000 C:\Windows\SysWOW64\sechost.dll (6.1.7601.18869) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 00000000755b0000 00000000000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.23452) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000074e30000 0000000000060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.23452) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.23452 (win7sp1_ldr.160512-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23452

ModLoad: 0000000074e20000 000000000000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7601.23452) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7601.23452 (win7sp1_ldr.160512-0600)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.23452

ModLoad: 00000000753d0000 0000000000060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000750c0000 00000000000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7601.18731) (-exported- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000072390000 0000000000021000 C:\Windows\system32\ntmarta.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ntmarta.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000075460000 0000000000045000 C:\Windows\syswow64\WLDAP32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wldap32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000071db0000 000000000004c000 C:\Windows\system32\apphelp.dll (6.1.7601.19050) (-exported- Symbols Loaded)
    Linked PDB Filename   : apphelp.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 0000000071830000 00000000000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 00000000737d0000 0000000000009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 17115, Write: 0, Other 64580

- I/O Transfers Counters -
Read: 0, Write: 2926, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 102768, QuotaPeakPagedPoolUsage: 102768
QuotaNonPagedPoolUsage: 9248, QuotaPeakNonPagedPoolUsage: 9328

- Virtual Memory Usage -
VirtualSize: 60211200, PeakVirtualSize: 60211200

- Pagefile Usage -
PagefileUsage: 2777088, PeakPagefileUsage: 3555328

- Working Set Size -
WorkingSetSize: 30445568, PeakWorkingSetSize: 30982144, PageFaultCount: 8654

*** Dump of thread ID 5776 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1617677.000000

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x00462BB0 read attempt to address 0x3F061D7E

- Registers -
eax=3f061d82 ebx=80000000 ecx=00000000 edx=0078e8b8 esi=01380020 edi=00000000
eip=00462bb0 esp=02c9fe80 ebp=02c9fe84
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00010206

- Callstack -
ChildEBP RetAddr  Args to Child
02c9fe84 00462bec 3f061d82 01380020 02c9feac 00447e2f hadam3p_eu_7.28_windows_intelx8!+0x0 
02c9fe94 00447e2f 01380020 00000000 01380020 80000000 hadam3p_eu_7.28_windows_intelx8!+0x0 
02c9feac 0044f628 01380020 00000000 005646bc 02c9fefc hadam3p_eu_7.28_windows_intelx8!+0x0 
02c9fec0 00483d6c 00000015 518fb945 00000001 00000006 hadam3p_eu_7.28_windows_intelx8!+0x0 
02c9fefc 76a67609 00000006 5188d369 00000000 00000000 hadam3p_eu_7.28_windows_intelx8!+0x0 
02c9ff88 769c338a 00000006 02c9ffd4 77519902 80000006 kernel32!CtrlRoutine+0x0 
02c9ff94 77519902 80000006 757a8399 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
02c9ffd4 775198d5 76a67454 80000006 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
02c9ffec 00000000 76a67454 80000006 00000000 12f6e2d4 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 6376 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 9218750.000000, User Time: 43593752.000000, Wait Time: 1617665.000000

- Registers -
eax=00000000 ebx=004d0850 ecx=00000000 edx=00000000 esi=0018f9d8 edi=00000000
eip=774ffda1 esp=0018f994 ebp=0018f9fc
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0018f9fc 7704460c 000000c8 00000000 0018fa20 00468a51 ntdll!NtDelayExecution+0x0 
0018fa0c 00468a51 000000c8 000000c8 00000000 0018fa58 KERNELBASE!Sleep+0x0 
0018fa20 00403e16 a0000000 027f9999 004d0858 004d0b88 hadam3p_eu_7.28_windows_intelx8!+0x0 
0018fa58 00404db0 00000000 535ebaf1 00000000 00000000 hadam3p_eu_7.28_windows_intelx8!+0x0 
0018fd48 00404fa1 0018fef8 0040501f 004d12a8 0018fd68 hadam3p_eu_7.28_windows_intelx8!+0x0 
0018fd50 0040501f 004d12a8 0018fd68 009f2e08 0018fd68 hadam3p_eu_7.28_windows_intelx8!+0x0 
0018fef8 0048543b 00400000 00000000 009f2e4c 0000000a hadam3p_eu_7.28_windows_intelx8!+0x0 
0018ff88 769c338a 7efde000 0018ffd4 77519902 7efde000 hadam3p_eu_7.28_windows_intelx8!+0x0 
0018ff94 77519902 7efde000 77ab8399 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0018ffd4 775198d5 0048548e 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0018ffec 00000000 0048548e 7efde000 00000000 78746341 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 5620 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 1617666.000000

- Registers -
eax=00000000 ebx=00020000 ecx=00000000 edx=00000000 esi=00000000 edi=00000000
eip=001c03a3 esp=0038ff54 ebp=0038ff88
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0038ff88 769c338a 00020000 0038ffd4 77519902 00020000 !+0x0 SymFromAddr(): GetLastError = '126'  SymGetModuleInfo(): GetLastError = '126' Address = '001c03a3'
0038ff94 77519902 00020000 778b8399 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126'  SymGetModuleInfo(): GetLastError = '126' Address = '769c338a'
0038ffd4 775198d5 00020064 00020000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126'  SymGetModuleInfo(): GetLastError = '126' Address = '77519902'
0038ffec 00000000 00020064 00020000 00000000 001d1900 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126'  SymGetModuleInfo(): GetLastError = '126' Address = '775198d5'

*** Dump of thread ID 4996 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 312500.000000, Wait Time: 1617672.000000

- Registers -
eax=c0000022 ebx=00000000 ecx=00000000 edx=00000000 esi=0137fd24 edi=00000000
eip=774ffda1 esp=0137fce0 ebp=0137fd48
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
0137fd48 7704460c 00000064 00000000 0137ff88 004784b4 ntdll!NtDelayExecution+0x0 
0137fd58 004784b4 00000064 00000000 00000000 00000000 KERNELBASE!Sleep+0x0 
0137ff88 769c338a 00000000 0137ffd4 77519902 00000000 hadam3p_eu_7.28_windows_intelx8!+0x0 
0137ff94 77519902 00000000 76848399 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
0137ffd4 775198d5 00478490 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
0137ffec 00000000 00478490 00000000 00000000 61646168 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3728, selfPID=3728, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3728, selfPID=4076, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3576, selfPID=3576, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3576, selfPID=3608, iMonCtr=1

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jun 2016 17:21:03 1291402 19761744 hadam3p_eu_iek2_20165_3_412_010613436_0 11,819 20,869 1.7657


©2024 climateprediction.net