climateprediction.net home page
Task 19325229

Task 19325229

Name hadam3p_anz_h12f_199912_12_289_010254786_2
Workunit 10254786
Created 5 Mar 2016, 8:32:53 UTC
Sent 5 Mar 2016, 8:33:41 UTC
Report deadline 15 Feb 2017, 13:53:41 UTC
Received 25 Mar 2016, 22:56:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1388047
Run time 5 days 15 hours 26 min 34 sec
CPU time 3 days 1 hours 57 min 12 sec
Validate state Invalid
Credit 509.72
Device peak FLOPS 3.04 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10
windows_intelx86
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
10:02:00 (4020): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:30:43 (692): start_timer_thread(): CreateThread() failed, errno 0
19:49:54 (6300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:06:17 (4204): start_timer_thread(): CreateThread() failed, errno 0
05:06:22 (6136): start_timer_thread(): CreateThread() failed, errno 0
02:40:26 (7072): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:40:28 (7072): No heartbeat from core client for 30 sec - exiting
02:42:22 (3268): start_timer_thread(): CreateThread() failed, errno 0
14:31:59 (7828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:36:23 (4644): start_timer_thread(): CreateThread() failed, errno 0
01:00:09 (7404): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:00:54 (6504): start_timer_thread(): CreateThread() failed, errno 0
01:00:56 (1464): start_timer_thread(): CreateThread() failed, errno 0
10:47:56 (4932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:48:40 (5584): start_timer_thread(): CreateThread() failed, errno 0
11:00:48 (6632): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:03:45 (7924): start_timer_thread(): CreateThread() failed, errno 0
11:03:48 (7136): start_timer_thread(): CreateThread() failed, errno 0


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x76DADAD8

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 03/19/16 11:03:48
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
Loaded Library    : symsrv.dll
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_anz_h12f_199912_12_289_010254786;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 003a0000 008e6000 C:\ProgramData\BOINC\projects\climateprediction.net\hadrm3p_anz_um_6.10_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : d:\cpdn\cpdnboinc\cpdnprecis\test\projects\reqs.comlab.ox.ac.uk_cpdn\hadrm3p_anz_um_6.10_windows_intelx86.pdb

ModLoad: 77e80000 0017b000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.10586.122) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 76210000 000e0000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 76cf0000 0017e000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.10586.162) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 77d00000 00147000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.10586.20) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 77a20000 0014f000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.10586.63) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.10586.63 (th2_release.160104-1513)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.63

ModLoad: 74cd0000 0007b000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.10586.63) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 74d50000 000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.10586.0

ModLoad: 76a40000 00044000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 76c40000 000ad000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 74bb0000 0001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 74ba0000 0000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 773d0000 00058000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 76a90000 0001b000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 693e0000 000e0000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : opengl32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 6a810000 00025000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : glu32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 692f0000 000ee000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : ddraw.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.10586.0

ModLoad: 6a800000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.2.10586.3) (-exported- Symbols Loaded)
    Linked PDB Filename   : dciman32.pdb
    File Version          : 10.0.10586.3 (th2_release_sec.151104-1948)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.3

ModLoad: 76c10000 0002b000 C:\WINDOWS\SYSTEM32\IMM32.DLL (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 6cf90000 0013f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0

ModLoad: 6a900000 00048000 C:\Program Files\Samsung\SamsungLink\AllShare Framework DMS\bin\symsrv.dll (6.11.1.404) (-exported- Symbols Loaded)
    Linked PDB Filename   : symsrv.pdb
    File Version          : 6.11.0001.404 (debuggers(dbg).090225-1745)
    Company Name          : Microsoft Corporation
    Product Name          : Debugging Tools for Windows(R)
    Product Version       : 6.11.0001.404

ModLoad: 74ad0000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.10586.0) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.10586.0 (th2_release.151029-1700)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.10586.0



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 0, Write: 0, Other 0

- I/O Transfers Counters -
Read: 0, Write: 0, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0
QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0

- Virtual Memory Usage -
VirtualSize: 0, PeakVirtualSize: 0

- Pagefile Usage -
PagefileUsage: 0, PeakPagefileUsage: 0

- Working Set Size -
WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0

*** Dump of thread ID 5076 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x76DADAD8

- Registers -
eax=1272f300 ebx=00000001 ecx=00000ignal 11 re0ei3 edd, exit0ng...
0 esled boinc8 edi=ff
fffffe
eip=76dadad8 esp=1272f300 ebp=1272f358
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
1272f358 006c1d43 e06d7363 00000001 00000003 1272f384 KERNELBASE!RaiseException+0x0 
1272f390 006bef45 1272f3a0 00759608 0072f15c 00755754 hadrm3p_anz_um_6.10_windows_int!+0x0 
1272f3ac 003a8361 00fd9f80 01000000 003a98a8 00000000 hadrm3p_anz_um_6.10_windows_int!+0x0 
1272f40c 003a95e0 1272f420 12873637 1272f420 128735b1 hadrm3p_anz_um_6.10_windows_int!+0x0 
1272f8bc 762238f4 00f1e000 762238d0 b9480fa8 1272f918 hadrm3p_anz_um_6.10_windows_int!+0x0 
1272f8d0 77ee5de3 00f1e000 c6b15909 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
1272f918 77ee5dae ffffffff 77f0b7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
1272f928 00000000 006c0ea6 00f1e000 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 7996 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=12879170 ecx=00000000 edx=00000000 esi=12878fb0 edi=12873e70
eip=77ef876c esp=2408f834 ebp=2408f9ec
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
2408f9ec 762238f4 12873e70 762238d0 8f320d78 2408fa48 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
2408fa00 77ee5de3 12873e70 f0cb5a59 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
2408fa48 77ee5dae ffffffff 77f0b7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
2408fa58 00000000 77eac6d0 12873e70 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 7752 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=12879438 ecx=00000000 edx=00000000 esi=12879278 edi=12873e70
eip=77ef876c esp=357afdb4 ebp=357aff6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
357aff6c 762238f4 12873e70 762238d0 9e4008f8 357affc8 ntdll!NtWaitForWorkViaWorkerFactory+0x0 
357aff80 77ee5de3 12873e70 e1b95fd9 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
357affc8 77ee5dae ffffffff 77f0b7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
357affd8 00000000 77eac6d0 12873e70 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 

*** Dump of thread ID 6992 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=77eac6d0 ebx=00000000 ecx=00000000 edx=00000000 esi=1287b900 edi=12873e70
eip=77ef876c esp=46ecf828 ebp=46ecf9e0
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
46ecf9e0 762238f4 12873e70 762238d0 edd60e8c 46ecfa3c ntdll!NtWaitForWorkViaWorkerFactory+0x0 
46ecf9f4 77ee5de3 12873e70 922f5a2d 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
46ecfa3c 77ee5dae ffffffff 77f0b7c3 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 
46ecfa4c 00000000 77eac6d0 12873e70 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7136, selfPID=4320, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
11:04:22 (4320): No heartbeat from core client for 30 sec - exiting
11:04:23 (4320): No heartbeat from core client for 30 sec - exiting
11:04:24 (4320): No heartbeat from core client for 30 sec - exiting
11:04:25 (4320): No heartbeat from core client for 30 sec - exiting
11:04:26 (4320): No heartbeat from core client for 30 sec - exiting
11:04:27 (4320): No heartbeat from core client for 30 sec - exiting
11:04:28 (4320): No heartbeat from core client for 30 sec - exiting
11:04:29 (4320): No heartbeat from core client for 30 sec - exiting
11:04:30 (4320): No heartbeat from core client for 30 sec - exiting
11:04:32 (4320): No heartbeat from core client for 30 sec - exiting
11:04:33 (4320): No heartbeat from core client for 30 sec - exiting
11:04:34 (4320): No heartbeat from core client for 30 sec - exiting
11:04:35 (4320): No heartbeat from core client for 30 sec - exiting
11:04:36 (4320): No heartbeat from core client for 30 sec - exiting
11:04:37 (4320): No heartbeat from core client for 30 sec - exiting
11:04:38 (4320): No heartbeat from core client for 30 sec - exiting
11:04:39 (4320): No heartbeat from core client for 30 sec - exiting
11:04:40 (4320): No heartbeat from core client for 30 sec - exiting
11:04:41 (4320): No heartbeat from core client for 30 sec - exiting
11:04:42 (4320): No heartbeat from core client for 30 sec - exiting
11:04:43 (4320): No heartbeat from core client for 30 sec - exiting
11:04:44 (4320): No heartbeat from core client for 30 sec - exiting
11:04:45 (4320): No heartbeat from core client for 30 sec - exiting
11:04:46 (4320): No heartbeat from core client for 30 sec - exiting
11:04:47 (4320): No heartbeat from core client for 30 sec - exiting
11:04:48 (4320): No heartbeat from core client for 30 sec - exiting
11:04:49 (4320): No heartbeat from core client for 30 sec - exiting
11:04:50 (4320): No heartbeat from core client for 30 sec - exiting
Called boinc_finish

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_2.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_3.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_4.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_5.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_6.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_7.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_8.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_9.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_10.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_11.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_h12f_199912_12_289_010254786_2_12.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Mar 2016 22:10:14 1388047 19325229 hadam3p_anz_h12f_199912_12_289_010254786_2 11,819 200,813 16.9907


©2024 climateprediction.net