climateprediction.net home page
Task 15451640

Task 15451640

Name hadcm3n_zkvd_1880_40_008250404_1
Workunit 8405528
Created 22 Nov 2012, 5:21:21 UTC
Sent 22 Nov 2012, 5:21:59 UTC
Report deadline 21 Feb 2013, 12:49:10 UTC
Received 13 Mar 2013, 20:18:58 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 1165600
Run time 14 days 6 hours 21 min 28 sec
CPU time 13 days 13 hours 1 min 58 sec
Validate state Invalid
Credit 11,197.44
Device peak FLOPS 3.28 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
too many exit(0)s
</message>
<stderr_txt>
 client for 30 sec - exiting
13:58:47 (12208): No heartbeat from core client for 30 sec - exiting
13:58:48 (12208): No heartbeat from core client for 30 sec - exiting
13:58:49 (12208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:59:31 (10824): No heartbeat from core client for 30 sec - exiting
13:59:32 (10824): No heartbeat from core client for 30 sec - exiting
13:59:33 (10824): No heartbeat from core client for 30 sec - exiting
13:59:34 (10824): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:00:15 (11444): No heartbeat from core client for 30 sec - exiting
14:00:16 (11444): No heartbeat from core client for 30 sec - exiting
14:00:17 (11444): No heartbeat from core client for 30 sec - exiting
14:00:18 (11444): No heartbeat from core client for 30 sec - exiting
14:00:19 (11444): No heartbeat from core client for 30 sec - exiting
14:00:20 (11444): No heartbeat from core client for 30 sec - exiting
14:00:21 (11444): No heartbeat from core client for 30 sec - exiting
14:00:22 (11444): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:00:23 (11444): No heartbeat from core client for 30 sec - exiting
14:01:07 (11012): No heartbeat from core client for 30 sec - exiting
14:01:08 (11012): No heartbeat from core client for 30 sec - exiting
14:01:09 (11012): No heartbeat from core client for 30 sec - exiting
14:01:10 (11012): No heartbeat from core client for 30 sec - exiting
14:01:11 (11012): No heartbeat from core client for 30 sec - exiting
14:01:12 (11012): No heartbeat from core client for 30 sec - exiting
14:01:13 (11012): No heartbeat from core client for 30 sec - exiting
14:01:14 (11012): No heartbeat from core client for 30 sec - exiting
14:01:15 (11012): No heartbeat from core client for 30 sec - exiting
14:01:16 (11012): No heartbeat from core client for 30 sec - exiting
14:01:17 (11012): No heartbeat from core client for 30 sec - exiting
14:01:18 (11012): No heartbeat from core client for 30 sec - exiting
14:01:19 (11012): No heartbeat from core client for 30 sec - exiting
14:01:20 (11012): No heartbeat from core client for 30 sec - exiting
14:01:21 (11012): No heartbeat from core client for 30 sec - exiting
14:01:22 (11012): No heartbeat from core client for 30 sec - exiting
14:01:23 (11012): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:02:00 (8756): No heartbeat from core client for 30 sec - exiting
14:02:01 (8756): No heartbeat from core client for 30 sec - exiting
14:02:02 (8756): No heartbeat from core client for 30 sec - exiting
14:02:03 (8756): No heartbeat from core client for 30 sec - exiting
14:02:04 (8756): No heartbeat from core client for 30 sec - exiting
14:02:05 (8756): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:02:06 (8756): No heartbeat from core client for 30 sec - exiting
14:02:07 (8756): No heartbeat from core client for 30 sec - exiting
14:02:44 (11796): No heartbeat from core client for 30 sec - exiting
14:02:45 (11796): No heartbeat from core client for 30 sec - exiting
14:02:46 (11796): No heartbeat from core client for 30 sec - exiting
14:02:47 (11796): No heartbeat from core client for 30 sec - exiting
14:02:48 (11796): No heartbeat from core client for 30 sec - exiting
14:02:49 (11796): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:33 (12208): No heartbeat from core client for 30 sec - exiting
14:03:34 (12208): No heartbeat from core client for 30 sec - exiting
14:03:35 (12208): No heartbeat from core client for 30 sec - exiting
14:03:36 (12208): No heartbeat from core client for 30 sec - exiting
14:03:37 (12208): No heartbeat from core client for 30 sec - exiting
14:03:38 (12208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:04:31 (6324): No heartbeat from core client for 30 sec - exiting
14:04:32 (6324): No heartbeat from core client for 30 sec - exiting
14:04:33 (6324): No heartbeat from core client for 30 sec - exiting
14:04:34 (6324): No heartbeat from core client for 30 sec - exiting
14:04:35 (6324): No heartbeat from core client for 30 sec - exiting
14:04:36 (6324): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:05:21 (11668): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:06:03 (10076): No heartbeat from core client for 30 sec - exiting
14:06:04 (10076): No heartbeat from core client for 30 sec - exiting
14:06:05 (10076): No heartbeat from core client for 30 sec - exiting
14:06:06 (10076): No heartbeat from core client for 30 sec - exiting
14:06:07 (10076): No heartbeat from core client for 30 sec - exiting
14:06:08 (10076): No heartbeat from core client for 30 sec - exiting
14:06:09 (10076): No heartbeat from core client for 30 sec - exiting
14:06:10 (10076): No heartbeat from core client for 30 sec - exiting
14:06:11 (10076): No heartbeat from core client for 30 sec - exiting
14:06:12 (10076): No heartbeat from core client for 30 sec - exiting
14:06:13 (10076): No heartbeat from core client for 30 sec - exiting
14:06:14 (10076): No heartbeat from core client for 30 sec - exiting
14:06:15 (10076): No heartbeat from core client for 30 sec - exiting
14:06:16 (10076): No heartbeat from core client for 30 sec - exiting
14:06:17 (10076): No heartbeat from core client for 30 sec - exiting
14:06:18 (10076): No heartbeat from core client for 30 sec - exiting
14:06:19 (10076): No heartbeat from core client for 30 sec - exiting
14:06:20 (10076): No heartbeat from core client for 30 sec - exiting
14:06:21 (10076): No heartbeat from core client for 30 sec - exiting
14:06:22 (10076): No heartbeat from core client for 30 sec - exiting
14:06:23 (10076): No heartbeat from core client for 30 sec - exiting
14:06:24 (10076): No heartbeat from core client for 30 sec - exiting
14:06:25 (10076): No heartbeat from core client for 30 sec - exiting
14:06:26 (10076): No heartbeat from core client for 30 sec - exiting
14:06:27 (10076): No heartbeat from core client for 30 sec - exiting
14:06:28 (10076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:07:18 (9860): No heartbeat from core client for 30 sec - exiting
14:07:19 (9860): No heartbeat from core client for 30 sec - exiting
14:07:20 (9860): No heartbeat from core client for 30 sec - exiting
14:07:21 (9860): No heartbeat from core client for 30 sec - exiting
14:07:22 (9860): No heartbeat from core client for 30 sec - exiting
14:07:23 (9860): No heartbeat from core client for 30 sec - exiting
14:07:24 (9860): No heartbeat from core client for 30 sec - exiting
14:07:25 (9860): No heartbeat from core client for 30 sec - exiting
14:07:26 (9860): No heartbeat from core client for 30 sec - exiting
14:07:27 (9860): No heartbeat from core client for 30 sec - exiting
14:07:28 (9860): No heartbeat from core client for 30 sec - exiting
14:07:29 (9860): No heartbeat from core client for 30 sec - exiting
14:07:30 (9860): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:07:31 (9860): No heartbeat from core client for 30 sec - exiting
14:08:11 (10448): No heartbeat from core client for 30 sec - exiting
14:08:12 (10448): No heartbeat from core client for 30 sec - exiting
14:08:13 (10448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x757BC41F

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 03/13/13 14:08:54
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_zkvd_1880_40_008250404;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 777c0000 00180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.17725) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 76910000 00110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.17965) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17965

ModLoad: 757b0000 00047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.17965) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17965

ModLoad: 76a80000 00100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 75390000 00090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 75930000 0000a000 C:\Windows\syswow64\LPK.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 75260000 0009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.17514

ModLoad: 74f00000 000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 76840000 000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 755f0000 00019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 74fb0000 000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 74ea0000 00060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.17856) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.17856 (win7sp1_gdr.120601-1505)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17856

ModLoad: 74e90000 0000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 64f00000 000c8000 C:\Windows\system32\OPENGL32.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : opengl32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 69da0000 00022000 C:\Windows\system32\GLU32.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : glu32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 64e10000 000e7000 C:\Windows\system32\DDRAW.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ddraw.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 69cb0000 00006000 C:\Windows\system32\DCIMAN32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : dciman32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 75610000 0019d000 C:\Windows\syswow64\SETUPAPI.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 759d0000 00027000 C:\Windows\syswow64\CFGMGR32.dll (6.1.7601.17621) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 6.1.7601.17621 (win7sp1_gdr.110523-2108)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17621

Get Product Name Failed.
ModLoad: 75940000 0008f000 C:\Windows\syswow64\OLEAUT32.dll (6.1.7601.17676) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : oleaut32.pdb
    File Version          : 6.1.7601.17676
    Company Name          : Microsoft Corporation
    Product Name          : 
    Product Version       : 6.1.7601.17676

ModLoad: 75100000 0015c000 C:\Windows\syswow64\ole32.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 76b80000 00012000 C:\Windows\syswow64\DEVOBJ.dll (6.1.7601.17621) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 6.1.7601.17621 (win7sp1_gdr.110523-2108)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17621

ModLoad: 71690000 00013000 C:\Windows\system32\dwmapi.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : dwmapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 768e0000 0002a000 C:\Windows\syswow64\imagehlp.dll (6.1.7601.17787) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 6.1.7601.17787 (win7sp1_gdr.120229-1502)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17787

ModLoad: 750a0000 00060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 75a00000 000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 713b0000 000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 74dc0000 00009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 0, Write: 0, Other 0

- I/O Transfers Counters -
Read: 0, Write: 0, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0
QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0

- Virtual Memory Usage -
VirtualSize: 0, PeakVirtualSize: 0

- Pagefile Usage -
PagefileUsage: 0, PeakPagefileUsage: 0

- Working Set Size -
WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0

*** Dump of thread ID 10100 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x757BC41F

- Registers -
eax=1132f9cc ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe
eip=757bc41f esp=1132f9cc ebp=1132fa1c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa1c 007bfa90 e06d7363 00000001 00000003 1132fa48 KERNELBASE!RaiseException+0x0 
1132fa54 007bbbcb 1132fa64 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132fa70 00406e6e 00500000 004083ee 00000000 33992fe0 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132fad8 00408130 1132faec 114d3a59 1132faec 114d39e1 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132ff88 769233aa 7efde000 1132ffd4 777f9ef2 7efde000 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132ff94 777f9ef2 7efde000 65760714 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
1132ffd4 777f9ec5 007bde7f 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
1132ffec 00000000 007bde7f 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 5560 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000000
eip=00000000 esp=00000000 ebp=00000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !onChain+0x0 

*** Dump of thread ID 10508 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000000
eip=00000000 esp=00000000 ebp=00000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !onChain+0x0 

*** Dump of thread ID 8768 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=5468ff48 edi=00000000
eip=777dfd71 esp=5468ff04 ebp=5468ff6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
5468ff6c 757c4498 00000064 00000000 5468ff88 00749924 ntdll!ZwDelayExecution+0x0 
5468ff7c 00749924 00000064 5468ff94 769233aa 00000000 KERNELBASE!Sleep+0x0 
5468ff88 769233aa 00000000 5468ffd4 777f9ef2 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 
5468ff94 777f9ef2 00000000 202c0714 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
5468ffd4 777f9ec5 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
5468ffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10704, iMonCtr=1
Model crash detected, will try to restart...
14:08:59 (10704): No heartbeat from core client for 30 sec - exiting
14:09:00 (10704): No heartbeat from core client for 30 sec - exiting
14:09:01 (10704): No heartbeat from core client for 30 sec - exiting
14:09:02 (10704): No heartbeat from core client for 30 sec - exiting
14:09:03 (10704): No heartbeat from core client for 30 sec - exiting
14:09:04 (10704): No heartbeat from core client for 30 sec - exiting
14:09:05 (10704): No heartbeat from core client for 30 sec - exiting
14:09:06 (10704): No heartbeat from core client for 30 sec - exiting
14:09:07 (10704): No heartbeat from core client for 30 sec - exiting
14:09:08 (10704): No heartbeat from core client for 30 sec - exiting
14:09:09 (10704): No heartbeat from core client for 30 sec - exiting
14:09:10 (10704): No heartbeat from core client for 30 sec - exiting
14:09:11 (10704): No heartbeat from core client for 30 sec - exiting
14:09:12 (10704): No heartbeat from core client for 30 sec - exiting
14:09:13 (10704): No heartbeat from core client for 30 sec - exiting
14:09:14 (10704): No heartbeat from core client for 30 sec - exiting
14:09:45 (10704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:10:29 (11700): No heartbeat from core client for 30 sec - exiting
14:10:30 (11700): No heartbeat from core client for 30 sec - exiting
14:10:31 (11700): No heartbeat from core client for 30 sec - exiting
14:10:32 (11700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:11:13 (10564): No heartbeat from core client for 30 sec - exiting
14:11:14 (10564): No heartbeat from core client for 30 sec - exiting
14:11:15 (10564): No heartbeat from core client for 30 sec - exiting
14:11:16 (10564): No heartbeat from core client for 30 sec - exiting
14:11:17 (10564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:11:56 (3716): No heartbeat from core client for 30 sec - exiting
14:11:57 (3716): No heartbeat from core client for 30 sec - exiting
14:11:58 (3716): No heartbeat from core client for 30 sec - exiting
14:11:59 (3716): No heartbeat from core client for 30 sec - exiting
14:12:00 (3716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:12:45 (10932): No heartbeat from core client for 30 sec - exiting
14:12:46 (10932): No heartbeat from core client for 30 sec - exiting
14:12:47 (10932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:13:28 (576): No heartbeat from core client for 30 sec - exiting
14:13:29 (576): No heartbeat from core client for 30 sec - exiting
14:13:30 (576): No heartbeat from core client for 30 sec - exiting
14:13:31 (576): No heartbeat from core client for 30 sec - exiting
14:13:32 (576): No heartbeat from core client for 30 sec - exiting
14:13:33 (576): No heartbeat from core client for 30 sec - exiting
14:13:34 (576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:14:09 (4716): No heartbeat from core client for 30 sec - exiting
14:14:10 (4716): No heartbeat from core client for 30 sec - exiting
14:14:11 (4716): No heartbeat from core client for 30 sec - exiting
14:14:12 (4716): No heartbeat from core client for 30 sec - exiting
14:14:13 (4716): No heartbeat from core client for 30 sec - exiting
14:14:14 (4716): No heartbeat from core client for 30 sec - exiting
14:14:15 (4716): No heartbeat from core client for 30 sec - exiting
14:14:16 (4716): No heartbeat from core client for 30 sec - exiting
14:14:17 (4716): No heartbeat from core client for 30 sec - exiting
14:14:18 (4716): No heartbeat from core client for 30 sec - exiting
14:14:19 (4716): No heartbeat from core client for 30 sec - exiting
14:14:20 (4716): No heartbeat from core client for 30 sec - exiting
14:14:21 (4716): No heartbeat from core client for 30 sec - exiting
14:14:22 (4716): No heartbeat from core client for 30 sec - exiting
14:14:23 (4716): No heartbeat from core client for 30 sec - exiting
14:14:24 (4716): No heartbeat from core client for 30 sec - exiting
14:14:25 (4716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:15:01 (7896): No heartbeat from core client for 30 sec - exiting
14:15:02 (7896): No heartbeat from core client for 30 sec - exiting
14:15:03 (7896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:15:44 (876): No heartbeat from core client for 30 sec - exiting
14:15:45 (876): No heartbeat from core client for 30 sec - exiting
14:15:46 (876): No heartbeat from core client for 30 sec - exiting
14:15:47 (876): No heartbeat from core client for 30 sec - exiting
14:15:48 (876): No heartbeat from core client for 30 sec - exiting
14:15:49 (876): No heartbeat from core client for 30 sec - exiting
14:15:50 (876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:16:27 (8680): No heartbeat from core client for 30 sec - exiting
14:16:28 (8680): No heartbeat from core client for 30 sec - exiting
14:16:29 (8680): No heartbeat from core client for 30 sec - exiting
14:16:30 (8680): No heartbeat from core client for 30 sec - exiting
14:16:31 (8680): No heartbeat from core client for 30 sec - exiting
14:16:32 (8680): No heartbeat from core client for 30 sec - exiting
14:16:33 (8680): No heartbeat from core client for 30 sec - exiting
14:16:34 (8680): No heartbeat from core client for 30 sec - exiting
14:16:35 (8680): No heartbeat from core client for 30 sec - exiting
14:16:36 (8680): No heartbeat from core client for 30 sec - exiting
14:16:37 (8680): No heartbeat from core client for 30 sec - exiting
14:16:38 (8680): No heartbeat from core client for 30 sec - exiting
14:16:39 (8680): No heartbeat from core client for 30 sec - exiting
14:16:40 (8680): No heartbeat from core client for 30 sec - exiting
14:16:41 (8680): No heartbeat from core client for 30 sec - exiting
14:16:42 (8680): No heartbeat from core client for 30 sec - exiting
14:16:43 (8680): No heartbeat from core client for 30 sec - exiting
14:16:44 (8680): No heartbeat from core client for 30 sec - exiting
14:16:45 (8680): No heartbeat from core client for 30 sec - exiting
14:16:46 (8680): No heartbeat from core client for 30 sec - exiting
14:16:47 (8680): No heartbeat from core client for 30 sec - exiting
14:16:48 (8680): No heartbeat from core client for 30 sec - exiting
14:16:49 (8680): No heartbeat from core client for 30 sec - exiting
14:16:50 (8680): No heartbeat from core client for 30 sec - exiting
14:16:51 (8680): No heartbeat from core client for 30 sec - exiting
14:16:52 (8680): No heartbeat from core client for 30 sec - exiting
14:16:53 (8680): No heartbeat from core client for 30 sec - exiting
14:16:54 (8680): No heartbeat from core client for 30 sec - exiting
14:16:55 (8680): No heartbeat from core client for 30 sec - exiting
14:16:56 (8680): No heartbeat from core client for 30 sec - exiting
14:16:57 (8680): No heartbeat from core client for 30 sec - exiting
14:16:58 (8680): No heartbeat from core client for 30 sec - exiting
14:16:59 (8680): No heartbeat from core client for 30 sec - exiting
14:17:00 (8680): No heartbeat from core client for 30 sec - exiting
14:17:01 (8680): No heartbeat from core client for 30 sec - exiting
14:17:02 (8680): No heartbeat from core client for 30 sec - exiting
14:17:03 (8680): No heartbeat from core client for 30 sec - exiting
14:17:04 (8680): No heartbeat from core client for 30 sec - exiting
14:17:05 (8680): No heartbeat from core client for 30 sec - exiting
14:17:06 (8680): No heartbeat from core client for 30 sec - exiting
14:17:07 (8680): No heartbeat from core client for 30 sec - exiting
14:17:08 (8680): No heartbeat from core client for 30 sec - exiting
14:17:09 (8680): No heartbeat from core client for 30 sec - exiting
14:17:10 (8680): No heartbeat from core client for 30 sec - exiting
14:17:11 (8680): No heartbeat from core client for 30 sec - exiting
14:17:12 (8680): No heartbeat from core client for 30 sec - exiting
14:17:13 (8680): No heartbeat from core client for 30 sec - exiting
14:17:14 (8680): No heartbeat from core client for 30 sec - exiting
14:17:15 (8680): No heartbeat from core client for 30 sec - exiting
14:17:16 (8680): No heartbeat from core client for 30 sec - exiting
14:17:17 (8680): No heartbeat from core client for 30 sec - exiting
14:17:18 (8680): No heartbeat from core client for 30 sec - exiting
14:17:19 (8680): No heartbeat from core client for 30 sec - exiting
14:17:20 (8680): No heartbeat from core client for 30 sec - exiting
14:17:21 (8680): No heartbeat from core client for 30 sec - exiting
14:17:22 (8680): No heartbeat from core client for 30 sec - exiting
14:17:23 (8680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:17:24 (8680): No heartbeat from core client for 30 sec - exiting
14:18:24 (6596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:19:06 (11452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:19:46 (11684): No heartbeat from core client for 30 sec - exiting
14:19:47 (11684): No heartbeat from core client for 30 sec - exiting
14:19:48 (11684): No heartbeat from core client for 30 sec - exiting
14:19:49 (11684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:20:36 (6264): No heartbeat from core client for 30 sec - exiting
14:20:37 (6264): No heartbeat from core client for 30 sec - exiting
14:20:38 (6264): No heartbeat from core client for 30 sec - exiting
14:20:39 (6264): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:20:40 (6264): No heartbeat from core client for 30 sec - exiting
14:21:19 (568): No heartbeat from core client for 30 sec - exiting
14:21:20 (568): No heartbeat from core client for 30 sec - exiting
14:21:21 (568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:22:01 (11624): No heartbeat from core client for 30 sec - exiting
14:22:02 (11624): No heartbeat from core client for 30 sec - exiting
14:22:03 (11624): No heartbeat from core client for 30 sec - exiting
14:22:04 (11624): No heartbeat from core client for 30 sec - exiting
14:22:05 (11624): No heartbeat from core client for 30 sec - exiting
14:22:06 (11624): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:22:51 (11208): No heartbeat from core client for 30 sec - exiting
14:22:52 (11208): No heartbeat from core client for 30 sec - exiting
14:22:53 (11208): No heartbeat from core client for 30 sec - exiting
14:22:54 (11208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:23:35 (10848): No heartbeat from core client for 30 sec - exiting
14:23:36 (10848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:23:37 (10848): No heartbeat from core client for 30 sec - exiting
14:24:17 (11840): No heartbeat from core client for 30 sec - exiting
14:24:18 (11840): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:25:19 (12036): No heartbeat from core client for 30 sec - exiting
14:25:22 (12036): No heartbeat from core client for 30 sec - exiting
14:25:23 (12036): No heartbeat from core client for 30 sec - exiting
14:25:24 (12036): No heartbeat from core client for 30 sec - exiting
14:25:25 (12036): No heartbeat from core client for 30 sec - exiting
14:25:26 (12036): No heartbeat from core client for 30 sec - exiting
14:25:27 (12036): No heartbeat from core client for 30 sec - exiting
14:25:28 (12036): No heartbeat from core client for 30 sec - exiting
14:25:29 (12036): No heartbeat from core client for 30 sec - exiting
14:25:30 (12036): No heartbeat from core client for 30 sec - exiting
14:25:31 (12036): No heartbeat from core client for 30 sec - exiting
14:25:32 (12036): No heartbeat from core client for 30 sec - exiting
14:25:33 (12036): No heartbeat from core client for 30 sec - exiting
14:25:34 (12036): No heartbeat from core client for 30 sec - exiting
14:25:35 (12036): No heartbeat from core client for 30 sec - exiting
14:25:36 (12036): No heartbeat from core client for 30 sec - exiting
14:25:37 (12036): No heartbeat from core client for 30 sec - exiting
14:25:38 (12036): No heartbeat from core client for 30 sec - exiting
14:25:39 (12036): No heartbeat from core client for 30 sec - exiting
14:25:40 (12036): No heartbeat from core client for 30 sec - exiting
14:25:41 (12036): No heartbeat from core client for 30 sec - exiting
14:25:42 (12036): No heartbeat from core client for 30 sec - exiting
14:25:43 (12036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7304, iMonCtr=1
Model crash detected, will try to restart...
14:28:47 (7304): No heartbeat from core client for 30 sec - exiting
14:28:48 (7304): No heartbeat from core client for 30 sec - exiting
14:28:49 (7304): No heartbeat from core client for 30 sec - exiting
14:28:50 (7304): No heartbeat from core client for 30 sec - exiting
14:28:51 (7304): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:30:07 (6892): No heartbeat from core client for 30 sec - exiting
14:30:08 (6892): No heartbeat from core client for 30 sec - exiting
14:30:09 (6892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:30:47 (10796): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:31:34 (8732): No heartbeat from core client for 30 sec - exiting


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x757BC41F

Engaging BOINC Windows Runtime Debugger...

14:31:35 (8732): No heartbeat from core client for 30 sec - exiting


********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 03/13/13 14:31:35
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_zkvd_1880_40_008250404;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 777c0000 00180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.17725) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

14:31:36 (8732): No heartbeat from core client for 30 sec - exiting
ModLoad: 76910000 00110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.17965) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17965

ModLoad: 757b0000 00047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.17965) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17965

ModLoad: 76a80000 00100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 75390000 00090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 75930000 0000a000 C:\Windows\syswow64\LPK.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 75260000 0009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.760C.17514 (win7sp1_rDt m.1itor - N8 'h50)tb
    Company Name          : Micreat' from BOINC...

   Product Name     14:32:16 (10220): No heartbeat from core client for 30 sec - exiting
14:32:17 (10220): No heartbeat from core client for 30 sec - exiting
14:32:18 (10220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:33:12 (11500): No heartbeat from core client for 30 sec - exiting
14:33:13 (11500): No heartbeat from core client for 30 sec - exiting
14:33:14 (11500): No heartbeat from core client for 30 sec - exiting
14:33:15 (11500): No heartbeat from core client for 30 sec - exiting
14:33:16 (11500): No heartbeat from core client for 30 sec - exiting
14:33:17 (11500): No heartbeat from core client for 30 sec - exiting
14:33:18 (11500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:33:50 (10544): No heartbeat from core client for 30 sec - exiting
14:33:51 (10544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:33:52 (10544): No heartbeat from core client for 30 sec - exiting
14:34:33 (1056): No heartbeat from core client for 30 sec - exiting
14:34:34 (1056): No heartbeat from core client for 30 sec - exiting
14:34:35 (1056): No heartbeat from core client for 30 sec - exiting
14:34:36 (1056): No heartbeat from core client for 30 sec - exiting
14:34:37 (1056): No heartbeat from core client for 30 sec - exiting
14:34:38 (1056): No heartbeat from core client for 30 sec - exiting
14:34:39 (1056): No heartbeat from core client for 30 sec - exiting
14:34:40 (1056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:35:18 (11652): No heartbeat from core client for 30 sec - exiting
14:35:19 (11652): No heartbeat from core client for 30 sec - exiting
14:35:20 (11652): No heartbeat from core client for 30 sec - exiting
14:35:21 (11652): No heartbeat from core client for 30 sec - exiting
14:35:22 (11652): No heartbeat from core client for 30 sec - exiting
14:35:23 (11652): No heartbeat from core client for 30 sec - exiting
14:35:24 (11652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:36:02 (10340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x757BC41F

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 03/13/13 14:36:39
Install Directory : 
Data Directory    : C:\ProgramData\BOINC
Project Symstore  : 
LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_zkvd_1880_40_008250404;C:\ProgramData\BOINC\projects\climateprediction.net


ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : 

ModLoad: 777c0000 00180000 C:\Windows\SysWOW64\ntdll.dll (6.1.7601.17725) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 76910000 00110000 C:\Windows\syswow64\kernel32.dll (6.1.7601.17965) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17965

ModLoad: 757b0000 00047000 C:\Windows\syswow64\KERNELBASE.dll (6.1.7601.17965) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 6.1.7601.17965 (win7sp1_gdr.121004-0333)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17965

ModLoad: 76a80000 00100000 C:\Windows\syswow64\USER32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7601.17514

ModLoad: 75390000 00090000 C:\Windows\syswow64\GDI32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 75930000 0000a000 C:\Windows\syswow64\LPK.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : wlpk.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 75260000 0009d000 C:\Windows\syswow64\USP10.dll (1.626.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : usp10.pdb
    File Version          : 1.0626.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft(R) Uniscribe Unicode script processor
    Product Version       : 1.0626.7601.17514

ModLoad: 74f00000 000ac000 C:\Windows\syswow64\msvcrt.dll (7.0.7601.17744) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.7601.17744 (win7sp1_gdr.111215-1535)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.7601.17744

ModLoad: 76840000 000a0000 C:\Windows\syswow64\ADVAPI32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 755f0000 00019000 C:\Windows\SysWOW64\sechost.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 74fb0000 000f0000 C:\Windows\syswow64\RPCRT4.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 74ea0000 00060000 C:\Windows\syswow64\SspiCli.dll (6.1.7601.17856) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 6.1.7601.17856 (win7sp1_gdr.120601-1505)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17856

ModLoad: 74e90000 0000c000 C:\Windows\syswow64\CRYPTBASE.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 64f00000 000c8000 C:\Windows\system32\OPENGL32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : opengl32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 69da0000 00022000 C:\Windows\system32\GLU32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : glu32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 64e10000 000e7000 C:\Windows\system32\DDRAW.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : ddraw.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 69cb0000 00006000 C:\Windows\system32\DCIMAN32.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : dciman32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385

ModLoad: 75610000 0019d000 C:\Windows\syswow64\SETUPAPI.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : setupapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 759d0000 00027000 C:\Windows\syswow64\CFGMGR32.dll (6.1.7601.17621) (-exported- Symbols Loaded)
    Linked PDB Filename   : cfgmgr32.pdb
    File Version          : 6.1.7601.17621 (win7sp1_gdr.110523-2108)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17621

Get Product Name Failed.
ModLoad: 75940000 0008f000 C:\Windows\syswow64\OLEAUT32.dll (6.1.7601.17676) (-exported- Symbols Loaded)
    Linked PDB Filename   : oleaut32.pdb
    File Version          : 6.1.7601.17676
    Company Name          : Microsoft Corporation
    Product Name          : 
    Product Version       : 6.1.7601.17676

ModLoad: 75100000 0015c000 C:\Windows\syswow64\ole32.dll (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : ole32.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 76b80000 00012000 C:\Windows\syswow64\DEVOBJ.dll (6.1.7601.17621) (-exported- Symbols Loaded)
    Linked PDB Filename   : devobj.pdb
    File Version          : 6.1.7601.17621 (win7sp1_gdr.110523-2108)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17621

ModLoad: 71690000 00013000 C:\Windows\system32\dwmapi.dll (6.1.7600.16385) (-exported- Symbols Loaded)
    Linked PDB Filename   : dwmapi.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 768e0000 0002a000 C:\Windows\syswow64\imagehlp.dll (6.1.7601.17787) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 6.1.7601.17787 (win7sp1_gdr.120229-1502)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17787

ModLoad: 750a0000 00060000 C:\Windows\system32\IMM32.DLL (6.1.7601.17514) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 75a00000 000cc000 C:\Windows\syswow64\MSCTF.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : msctf.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 6.1.7600.16385

ModLoad: 713b0000 000eb000 C:\Windows\system32\dbghelp.dll (6.1.7601.17514) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 6.1.7601.17514 (win7sp1_rtm.101119-1850)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7601.17514

ModLoad: 74dc0000 00009000 C:\Windows\system32\version.dll (6.1.7600.16385) (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 6.1.7600.16385 (win7_rtm.090713-1255)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 6.1.7600.16385



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 0, Write: 0, Other 0

- I/O Transfers Counters -
Read: 0, Write: 0, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0
QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0

- Virtual Memory Usage -
VirtualSize: 0, PeakVirtualSize: 0

- Pagefile Usage -
PagefileUsage: 0, PeakPagefileUsage: 0

- Working Set Size -
WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0

*** Dump of thread ID 7304 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x757BC41F

- Registers -
eax=1132f9c4 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe
eip=757bc41f esp=1132f9c4 ebp=1132fa14
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000212

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 
1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 
1132fad8 00408130 1132faec 002a3a59 1132faec 002a39e1 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132ff88 769233aa 7efde000 1132ffd4 777f9ef2 7efde000 hadcm3n_um_6.07_windows_intelx8!+0x0 
1132ff94 777f9ef2 7efde000 655ce170 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
1132ffd4 777f9ec5 007bde7f 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
1132ffec 00000000 007bde7f 7efde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 

*** Dump of thread ID 10020 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000000
eip=00000000 esp=00000000 ebp=00000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !onChain+0x0 

*** Dump of thread ID 8168 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000000
eip=00000000 esp=00000000 ebp=00000000
cs=0000  ss=0000  ds=0000  es=0000  fs=0000  gs=0000             efl=00000000

- Callstack -
ChildEBP RetAddr  Args to Child
(-nosymbols- PC == 0)
00000000 00000000 00000000 00000000 00000000 00000000 !onChain+0x0 

*** Dump of thread ID 380 (state: Initialized): ***

- Information -
Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000

- Registers -
eax=00749910 ebx=00000000 ecx=00000000 edx=00000000 esi=546eff48 edi=00000000
eip=777dfd71 esp=546eff04 ebp=546eff6c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000246

- Callstack -
ChildEBP RetAddr  Args to Child
546eff6c 757c4498 00000064 00000000 546eff88 00749924 ntdll!ZwDelayExecution+0x0 
546eff7c 00749924 00000064 546eff94 769233aa 00000000 KERNELBASE!Sleep+0x0 
546eff88 769233aa 00000000 546effd4 777f9ef2 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 
546eff94 777f9ef2 00000000 2000e170 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 
546effd4 777f9ec5 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 
546effec 00000000 00749910 00000000 00000000 54c00000 ntdll!RtlInitializeExceptionChain+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10476, iMonCtr=1
Model crash detected, will try to restart...
14:36:41 (10476): No heartbeat from core client for 30 sec - exiting
14:36:42 (10476): No heartbeat from core client for 30 sec - exiting
14:36:43 (10476): No heartbeat from core client for 30 sec - exiting
14:36:44 (10476): No heartbeat from core client for 30 sec - exiting
14:36:45 (10476): No heartbeat from core client for 30 sec - exiting
14:36:46 (10476): No heartbeat from core client for 30 sec - exiting
14:36:47 (10476): No heartbeat from core client for 30 sec - exiting
14:36:48 (10476): No heartbeat from core client for 30 sec - exiting
14:36:49 (10476): No heartbeat from core client for 30 sec - exiting
14:36:50 (10476): No heartbeat from core client for 30 sec - exiting
14:36:51 (10476): No heartbeat from core client for 30 sec - exiting
14:36:52 (10476): No heartbeat from core client for 30 sec - exiting
14:36:53 (10476): No heartbeat from core client for 30 sec - exiting
14:36:54 (10476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:38:09 (11960): No heartbeat from core client for 30 sec - exiting
14:38:10 (11960): No heartbeat from core client for 30 sec - exiting
14:38:11 (11960): No heartbeat from core client for 30 sec - exiting
14:38:12 (11960): No heartbeat from core client for 30 sec - exiting
14:38:13 (11960): No heartbeat from core client for 30 sec - exiting
14:38:14 (11960): No heartbeat from core client for 30 sec - exiting
14:38:15 (11960): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:38:55 (11340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:38:56 (11340): No heartbeat from core client for 30 sec - exiting
14:39:44 (3880): No heartbeat from core client for 30 sec - exiting
14:39:45 (3880): No heartbeat from core client for 30 sec - exiting
14:39:46 (3880): No heartbeat from core client for 30 sec - exiting
14:39:47 (3880): No heartbeat from core client for 30 sec - exiting
14:39:48 (3880): No heartbeat from core client for 30 sec - exiting
14:39:49 (3880): No heartbeat from core client for 30 sec - exiting
14:39:50 (3880): No heartbeat from core client for 30 sec - exiting
14:39:51 (3880): No heartbeat from core client for 30 sec - exiting
14:39:52 (3880): No heartbeat from core client for 30 sec - exiting
14:39:53 (3880): No heartbeat from core client for 30 sec - exiting
14:39:54 (3880): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:40:42 (11028): No heartbeat from core client for 30 sec - exiting
14:40:43 (11028): No heartbeat from core client for 30 sec - exiting
14:40:44 (11028): No heartbeat from core client for 30 sec - exiting
14:40:45 (11028): No heartbeat from core client for 30 sec - exiting
14:40:46 (11028): No heartbeat from core client for 30 sec - exiting
14:40:47 (11028): No heartbeat from core client for 30 sec - exiting
14:40:48 (11028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:40:49 (11028): No heartbeat from core client for 30 sec - exiting
14:40:50 (11028): No heartbeat from core client for 30 sec - exiting
14:41:27 (828): No heartbeat from core client for 30 sec - exiting
14:41:28 (828): No heartbeat from core client for 30 sec - exiting
14:41:29 (828): No heartbeat from core client for 30 sec - exiting
14:41:30 (828): No heartbeat from core client for 30 sec - exiting
14:41:31 (828): No heartbeat from core client for 30 sec - exiting
14:41:32 (828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:42:14 (12248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:42:54 (11780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:43:47 (12100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 11 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9168, iMonCtr=1
Model crash detected, will try to restart...
14:45:13 (9168): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:45:14 (9168): No he
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Mar 2013 07:24:33 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 933,120 1,153,721 1.2364
12 Mar 2013 20:49:56 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 907,200 1,119,867 1.2344
12 Mar 2013 11:32:20 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 881,280 1,088,320 1.2349
12 Mar 2013 02:09:38 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 855,360 1,057,267 1.2360
11 Mar 2013 17:16:07 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 829,440 1,025,990 1.2370
11 Mar 2013 08:33:03 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 803,520 995,200 1.2386
11 Mar 2013 00:04:59 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 777,600 965,463 1.2416
10 Mar 2013 15:40:36 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 751,680 936,233 1.2455
24 Feb 2013 02:43:00 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 725,760 907,012 1.2497
23 Feb 2013 17:51:50 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 699,840 877,875 1.2544
23 Feb 2013 08:57:09 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 673,920 848,882 1.2596
23 Feb 2013 00:15:16 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 648,000 819,570 1.2648
22 Feb 2013 15:50:39 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 622,080 790,429 1.2706
22 Feb 2013 07:21:42 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 596,160 760,535 1.2757
20 Feb 2013 10:58:31 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 570,240 729,880 1.2800
20 Feb 2013 02:06:45 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 544,320 698,769 1.2837
19 Feb 2013 17:06:20 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 518,400 668,662 1.2899
19 Feb 2013 08:28:12 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 492,480 638,656 1.2968
19 Feb 2013 00:21:21 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 466,560 609,960 1.3074
18 Feb 2013 15:50:43 1165600 15451640 hadcm3n_zkvd_1880_40_008250404_1 440,640 579,926 1.3161


©2024 climateprediction.net