climateprediction.net home page
Task 15400240

Task 15400240

Name hadcm3n_o2og_2100_40_008239505_2
Workunit 8394629
Created 26 Oct 2012, 17:54:21 UTC
Sent 26 Oct 2012, 17:54:25 UTC
Report deadline 26 Jan 2013, 1:21:36 UTC
Received 14 Nov 2012, 15:24:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1032517
Run time 18 days 12 hours 5 min 58 sec
CPU time 17 days 17 hours 35 min 20 sec
Validate state Invalid
Credit 11,819.52
Device peak FLOPS 2.52 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
06:05:36 (28948): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:59:24 (101208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:58:15 (142636): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:57:05 (139344): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:57:55 (2656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:56:47 (3640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:55:39 (4612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:54:31 (3616): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:53:24 (7272): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:02:27 (552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:01:25 (708652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:01:27 (708652): No heartbeat from core client for 30 sec - exiting
07:01:28 (708652): No heartbeat from core client for 30 sec - exiting
07:01:29 (708652): No heartbeat from core client for 30 sec - exiting


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 11/14/12 07:03:17
Install Directory : 
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o2og_2100_40_008239505;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 9, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 84, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 123824, QuotaPeakPagedPoolUsage: 123824
QuotaNonPagedPoolUsage: 5584, QuotaPeakNonPagedPoolUsage: 5584

- Virtual Memory Usage -
VirtualSize: 906256384, PeakVirtualSize: 906256384

- Pagefile Usage -
PagefileUsage: 33558528, PeakPagefileUsage: 106467328

- Working Set Size -
WorkingSetSize: 4513792, PeakWorkingSetSize: 4513792, PageFaultCount: 1117

*** Dump of thread ID 537096 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 53477924.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

- Registers -
eax=1132fa04 ebx=00000001 ecx=00000000 edx=00000000 esi=1132fa8c edi=fffffffe
eip=7d4e237e esp=1132fa00 ebp=1132fa54
cs=120023  ss=13002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa54 007bfa90 e06d7363 00000001 00000003 1132fa80 !RaiseException+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e237e'
1132fa8c 007bbbcb 1132fa9c 00860978 0082f1b4 0085d354 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bfa90'
1132faa8 00406e8c 04600000 01000000 00500000 004083ee !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bbbcb'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00406e8c'
1132ffc0 7d4e7d42 00000000 00000000 7efde000 e06d7363 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7d42'

*** Dump of thread ID 708972 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53477924.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3400ff74
eip=7d61ccc6 esp=3400ff38 ebp=3400ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3400ff9c 7d4d14ef 00000064 00000000 3400ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3400ffac 00749924 00000064 3400ffec 7d4dfe37 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3400ffb8 7d4dfe37 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3400ffec 00000000 00749910 00000000 00000000 34520000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfe37'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1075420, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 11/14/12 07:03:21
Install Directory : 
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o2og_2100_40_008239505;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 9, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 84, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 123824, QuotaPeakPagedPoolUsage: 123824
QuotaNonPagedPoolUsage: 5584, QuotaPeakNonPagedPoolUsage: 5584

- Virtual Memory Usage -
VirtualSize: 906256384, PeakVirtualSize: 906256384

- Pagefile Usage -
PagefileUsage: 33558528, PeakPagefileUsage: 106467328

- Working Set Size -
WorkingSetSize: 4382720, PeakWorkingSetSize: 4382720, PageFaultCount: 1085

*** Dump of thread ID 1075672 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 53478160.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

- Registers -
eax=1132fa04 ebx=00000001 ecx=00000000 edx=00000000 esi=1132fa8c edi=fffffffe
eip=7d4e237e esp=1132fa00 ebp=1132fa54
cs=120023  ss=13002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa54 007bfa90 e06d7363 00000001 00000003 1132fa80 !RaiseException+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e237e'
1132fa8c 007bbbcb 1132fa9c 00860978 0082f1b4 0085d354 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bfa90'
1132faa8 00406e8c 04600000 01000000 00500000 004083ee !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bbbcb'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00406e8c'
1132ffc0 7d4e7d42 00000000 00000000 7efde000 e06d7363 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7d42'

*** Dump of thread ID 1075724 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53478160.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3400ff74
eip=7d61ccc6 esp=3400ff38 ebp=3400ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3400ff9c 7d4d14ef 00000064 00000000 3400ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3400ffac 00749924 00000064 3400ffec 7d4dfe37 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3400ffb8 7d4dfe37 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3400ffec 00000000 00749910 00000000 00000000 34520000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfe37'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1075420, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 11/14/12 07:03:23
Install Directory : 
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o2og_2100_40_008239505;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 9, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 84, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 123824, QuotaPeakPagedPoolUsage: 123824
QuotaNonPagedPoolUsage: 5584, QuotaPeakNonPagedPoolUsage: 5584

- Virtual Memory Usage -
VirtualSize: 906256384, PeakVirtualSize: 906256384

- Pagefile Usage -
PagefileUsage: 33558528, PeakPagefileUsage: 106467328

- Working Set Size -
WorkingSetSize: 4382720, PeakWorkingSetSize: 4382720, PageFaultCount: 1085

*** Dump of thread ID 1075920 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53478320.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

- Registers -
eax=1132fa04 ebx=00000001 ecx=00000000 edx=00000000 esi=1132fa8c edi=fffffffe
eip=7d4e237e esp=1132fa00 ebp=1132fa54
cs=120023  ss=13002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa54 007bfa90 e06d7363 00000001 00000003 1132fa80 !RaiseException+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e237e'
1132fa8c 007bbbcb 1132fa9c 00860978 0082f1b4 0085d354 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bfa90'
1132faa8 00406e8c 04600000 01000000 00500000 004083ee !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bbbcb'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00406e8c'
1132ffc0 7d4e7d42 00000000 00000000 7efde000 e06d7363 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7d42'

*** Dump of thread ID 1075988 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53478320.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3400ff74
eip=7d61ccc6 esp=3400ff38 ebp=3400ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3400ff9c 7d4d14ef 00000064 00000000 3400ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3400ffac 00749924 00000064 3400ffec 7d4dfe37 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3400ffb8 7d4dfe37 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3400ffec 00000000 00749910 00000000 00000000 34520000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfe37'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1075420, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 11/14/12 07:03:27
Install Directory : 
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o2og_2100_40_008239505;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 9, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 84, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 123824, QuotaPeakPagedPoolUsage: 123824
QuotaNonPagedPoolUsage: 5584, QuotaPeakNonPagedPoolUsage: 5584

- Virtual Memory Usage -
VirtualSize: 906256384, PeakVirtualSize: 906256384

- Pagefile Usage -
PagefileUsage: 33558528, PeakPagefileUsage: 106467328

- Working Set Size -
WorkingSetSize: 4317184, PeakWorkingSetSize: 4317184, PageFaultCount: 1069

*** Dump of thread ID 1076192 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 156250.000000, Wait Time: 53478528.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

- Registers -
eax=1132fa04 ebx=00000001 ecx=00000000 edx=00000000 esi=1132fa8c edi=fffffffe
eip=7d4e237e esp=1132fa00 ebp=1132fa54
cs=120023  ss=13002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa54 007bfa90 e06d7363 00000001 00000003 1132fa80 !RaiseException+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e237e'
1132fa8c 007bbbcb 1132fa9c 00860978 0082f1b4 0085d354 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bfa90'
1132faa8 00406e8c 04600000 01000000 00500000 004083ee !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bbbcb'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00406e8c'
1132ffc0 7d4e7d42 00000000 00000000 7efde000 e06d7363 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7d42'

*** Dump of thread ID 1065064 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53478520.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3400ff74
eip=7d61ccc6 esp=3400ff38 ebp=3400ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3400ff9c 7d4d14ef 00000064 00000000 3400ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3400ffac 00749924 00000064 3400ffec 7d4dfe37 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3400ffb8 7d4dfe37 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3400ffec 00000000 00749910 00000000 00000000 34520000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfe37'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1075420, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 11/14/12 07:04:06
Install Directory : 
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o2og_2100_40_008239505;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 9, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 84, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 123824, QuotaPeakPagedPoolUsage: 123824
QuotaNonPagedPoolUsage: 5424, QuotaPeakNonPagedPoolUsage: 5424

- Virtual Memory Usage -
VirtualSize: 884228096, PeakVirtualSize: 884228096

- Pagefile Usage -
PagefileUsage: 11493376, PeakPagefileUsage: 16105472

- Working Set Size -
WorkingSetSize: 4243456, PeakWorkingSetSize: 4243456, PageFaultCount: 1049

*** Dump of thread ID 1075280 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53481032.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

- Registers -
eax=1132fa0c ebx=00000001 ecx=00000000 edx=00000000 esi=1132fa94 edi=fffffffe
eip=7d4e237e esp=1132fa08 ebp=1132fa5c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa5c 007bfa90 e06d7363 00000001 00000003 1132fa88 !RaiseException+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e237e'
1132fa94 007bbbcb 1132faa4 00860978 0082f1b4 0085d354 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bfa90'
1132fab0 00406e6e 00500000 004083ee 00000000 7d61f768 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bbbcb'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00406e6e'
1132ffc0 7d4e7d42 00000000 00000000 7efde000 e06d7363 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7d42'

*** Dump of thread ID 709080 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53481032.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3400ff74
eip=7d61ccc6 esp=3400ff38 ebp=3400ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3400ff9c 7d4d14ef 00000064 00000000 3400ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3400ffac 00749924 00000064 3400ffec 7d4dfe37 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3400ffb8 7d4dfe37 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3400ffec 00000000 00749910 00000000 00000000 000000c8 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfe37'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1075420, iMonCtr=1
Model crash detected, will try to restart...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 6.13.0


Dump Timestamp    : 11/14/12 07:04:34
Install Directory : 
Data Directory    : C:\Documents and Settings\All Users\Application Data\BOINC
Project Symstore  : 
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( C:\Documents and Settings\All Users\Application Data\BOINC\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_o2og_2100_40_008239505;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net


SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 

SymGetModuleInfo(): GetLastError = 87
ModLoad: 00000000 00000000  ( Symbols Loaded)
    Linked PDB Filename   : 



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 9, Write: 0, Other 186

- I/O Transfers Counters -
Read: 0, Write: 84, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 123824, QuotaPeakPagedPoolUsage: 123824
QuotaNonPagedPoolUsage: 5584, QuotaPeakNonPagedPoolUsage: 5584

- Virtual Memory Usage -
VirtualSize: 906256384, PeakVirtualSize: 906256384

- Pagefile Usage -
PagefileUsage: 33558528, PeakPagefileUsage: 106467328

- Working Set Size -
WorkingSetSize: 4284416, PeakWorkingSetSize: 4284416, PageFaultCount: 1059

*** Dump of thread ID 1075480 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 156250.000000, User Time: 0.000000, Wait Time: 53482824.000000

- Unhandled Exception Record -
Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7D4E237E

- Registers -
eax=1132fa04 ebx=00000001 ecx=00000000 edx=00000000 esi=1132fa8c edi=fffffffe
eip=7d4e237e esp=1132fa00 ebp=1132fa54
cs=120023  ss=13002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000206

- Callstack -
ChildEBP RetAddr  Args to Child
1132fa54 007bfa90 e06d7363 00000001 00000003 1132fa80 !RaiseException+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e237e'
1132fa8c 007bbbcb 1132fa9c 00860978 0082f1b4 0085d354 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bfa90'
1132faa8 00406e8c 04600000 01000000 00500000 004083ee !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '007bbbcb'
1132fb10 00408130 1132fb24 001224ef 1132fb24 00122451 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00406e8c'
1132ffc0 7d4e7d42 00000000 00000000 7efde000 e06d7363 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00408130'
1132fff0 00000000 007bde7f 00000000 00000000 00000000 !BaseProcessInitPostImport+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4e7d42'

*** Dump of thread ID 1075496 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 53482824.000000

- Registers -
eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=3400ff74
eip=7d61ccc6 esp=3400ff38 ebp=3400ff9c
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
3400ff9c 7d4d14ef 00000064 00000000 3400ffb8 00749924 !NtDelayExecution+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d61ccc6'
3400ffac 00749924 00000064 3400ffec 7d4dfe37 00000000 !Sleep+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4d14ef'
3400ffb8 7d4dfe37 00000000 00000000 00000000 00000000 !+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '00749924'
3400ffec 00000000 00749910 00000000 00000000 34520000 !FlsSetValue+0x0   SymGetModuleInfo(): GetLastError = '87' Address = '7d4dfe37'


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1075420, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Nov 2012 03:23:26 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 984,960 1,501,798 1.5247
13 Nov 2012 16:04:24 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 959,040 1,462,436 1.5249
13 Nov 2012 04:42:57 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 933,120 1,423,164 1.5252
12 Nov 2012 17:28:40 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 907,200 1,383,722 1.5253
12 Nov 2012 06:07:04 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 881,280 1,344,002 1.5251
11 Nov 2012 18:52:30 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 855,360 1,304,379 1.5249
11 Nov 2012 07:17:30 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 829,440 1,264,412 1.5244
10 Nov 2012 19:44:20 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 803,520 1,224,944 1.5245
10 Nov 2012 08:05:48 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 777,600 1,184,874 1.5238
09 Nov 2012 20:43:39 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 751,680 1,144,798 1.5230
09 Nov 2012 09:25:31 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 725,760 1,105,082 1.5227
08 Nov 2012 22:03:36 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 699,840 1,064,906 1.5216
08 Nov 2012 06:34:18 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 673,920 1,024,631 1.5204
07 Nov 2012 19:13:51 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 648,000 984,644 1.5195
07 Nov 2012 07:47:31 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 622,080 944,865 1.5189
06 Nov 2012 20:30:08 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 596,160 906,004 1.5197
06 Nov 2012 09:00:43 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 570,240 866,415 1.5194
05 Nov 2012 21:38:51 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 544,320 827,089 1.5195
05 Nov 2012 10:18:22 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 518,400 787,802 1.5197
04 Nov 2012 22:56:27 1032517 15400240 hadcm3n_o2og_2100_40_008239505_2 492,480 747,868 1.5186


©2024 climateprediction.net