Task 15722239

Name	hadcm3n_3jr3_1940_40_008261050_3
Workunit	8416174
Created	12 Apr 2013, 5:56:50 UTC
Sent	12 Apr 2013, 5:57:14 UTC
Report deadline	12 Jul 2013, 13:24:25 UTC
Received	30 Apr 2013, 16:15:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-529697949 (0xE06D7363) Unknown error code
Computer ID	1040449
Run time	9 days 2 hours 29 min 24 sec
CPU time	8 days 7 hours 56 min 29 sec
Validate state	Invalid
Credit	4,043.52
Device peak FLOPS	2.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -529697949 (0xe06d7363) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1124, iMonCtr=1 Model crash detected, will try to restart... 21:16:05 (4384): No heartbeat from core client for 30 sec - exiting 21:16:06 (4384): No heartbeat from core client for 30 sec - exiting 21:16:08 (4384): No heartbeat from core client for 30 sec - exiting 21:16:09 (4384): No heartbeat from core client for 30 sec - exiting 21:16:10 (4384): No heartbeat from core client for 30 sec - exiting 21:16:11 (4384): No heartbeat from core client for 30 sec - exiting 21:16:12 (4384): No heartbeat from core client for 30 sec - exiting 21:16:13 (4384): No heartbeat from core client for 30 sec - exiting 21:16:14 (4384): No heartbeat from core client for 30 sec - exiting 21:16:15 (4384): No heartbeat from core client for 30 sec - exiting 21:16:16 (4384): No heartbeat from core client for 30 sec - exiting 21:16:17 (4384): No heartbeat from core client for 30 sec - exiting 21:16:18 (4384): No heartbeat from core client for 30 sec - exiting 21:16:20 (4384): No heartbeat from core client for 30 sec - exiting 21:16:21 (4384): No heartbeat from core client for 30 sec - exiting 21:16:22 (4384): No heartbeat from core client for 30 sec - exiting 21:16:23 (4384): No heartbeat from core client for 30 sec - exiting 21:16:24 (4384): No heartbeat from core client for 30 sec - exiting 21:16:25 (4384): No heartbeat from core client for 30 sec - exiting 21:16:26 (4384): No heartbeat from core client for 30 sec - exiting 21:16:27 (4384): No heartbeat from core client for 30 sec - exiting 21:16:28 (4384): No heartbeat from core client for 30 sec - exiting 21:16:29 (4384): No heartbeat from core client for 30 sec - exiting 21:16:30 (4384): No heartbeat from core client for 30 sec - exiting 21:16:32 (4384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:52 (5004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:54 (5004): No heartbeat from core client for 30 sec - exiting 12:28:55 (5004): No heartbeat from core client for 30 sec - exiting 06:07:33 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:15 (4464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:51 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:50:17 (2000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:07:24 (4184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:08:15 (6120): No heartbeat from core client for 30 sec - exiting 07:08:17 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:13:16 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:14:30 (6056): No heartbeat from core client for 30 sec - exiting 07:14:31 (6056): No heartbeat from core client for 30 sec - exiting 07:14:32 (6056): No heartbeat from core client for 30 sec - exiting 07:14:33 (6056): No heartbeat from core client for 30 sec - exiting 07:14:34 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:36 (5416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:29:15 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:22 (1944): No heartbeat from core client for 30 sec - exiting 07:30:23 (1944): No heartbeat from core client for 30 sec - exiting 07:30:24 (1944): No heartbeat from core client for 30 sec - exiting 07:30:25 (1944): No heartbeat from core client for 30 sec - exiting 07:30:26 (1944): No heartbeat from core client for 30 sec - exiting 07:30:27 (1944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:03 (2212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:59 (4388): No heartbeat from core client for 30 sec - exiting 07:39:00 (4388): No heartbeat from core client for 30 sec - exiting 07:39:01 (4388): No heartbeat from core client for 30 sec - exiting 07:39:02 (4388): No heartbeat from core client for 30 sec - exiting 07:39:03 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:35 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:45 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:43 (3364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:01 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4864, iMonCtr=1 Model crash detected, will try to restart... 10:49:32 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:26 (4884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:25 (4692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:05 (512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:36 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:16 (3940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:09 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:24 (5396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7653D8CB Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 04/30/13 11:33:05 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jr3_1940_40_008261050;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b60000 00160000 C:\Windows\SysWOW64\ntdll.dll (6.0.6002.18541) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 76520000 00110000 C:\Windows\syswow64\kernel32.dll (6.0.6002.18704) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75d00000 000d0000 C:\Windows\syswow64\USER32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75c70000 00090000 C:\Windows\syswow64\GDI32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 75dd0000 000c6000 C:\Windows\syswow64\ADVAPI32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 759f0000 000f0000 C:\Windows\syswow64\RPCRT4.dll (6.0.6002.18024) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75680000 00060000 C:\Windows\syswow64\Secur32.dll (6.0.6002.18643) (-exported- Symbols Loaded) Linked PDB Filename : wsecur32.pdb File Version : 6.0.6002.18643 (vistasp2_gdr.120601-1144) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18643 ModLoad: 70b30000 000cb000 C:\Windows\system32\OPENGL32.dll (6.0.6000.16386) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 76380000 000aa000 C:\Windows\syswow64\msvcrt.dll (7.0.6002.18551) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.6002.18551 (vistasp2_gdr.111214-0301) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.6002.18551 ModLoad: 71a00000 00023000 C:\Windows\system32\GLU32.dll (6.0.6000.16386) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 70a40000 000e5000 C:\Windows\system32\DDRAW.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 75550000 00006000 C:\Windows\system32\DCIMAN32.dll (6.0.6002.18051) (-exported- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.0.6002.18051 (vistasp2_gdr.090615-0258) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18051 ModLoad: 76630000 0018a000 C:\Windows\syswow64\SETUPAPI.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : setupapi.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 Get Product Name Failed. ModLoad: 762c0000 0008d000 C:\Windows\syswow64\OLEAUT32.dll (6.0.6002.18508) (-exported- Symbols Loaded) Linked PDB Filename : oleaut32.pdb File Version : 6.0.6002.18508 Company Name : Microsoft Corporation Product Name : Product Version : 6.0.6002.18508 ModLoad: 76140000 00145000 C:\Windows\syswow64\ole32.dll (6.0.6002.18277) (-exported- Symbols Loaded) Linked PDB Filename : ole32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 753f0000 0000c000 C:\Windows\system32\dwmapi.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : dwmapi.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 76350000 0002a000 C:\Windows\syswow64\imagehlp.dll (6.0.6002.18592) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.0.6002.18592 (vistasp2_gdr.120229-0238) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18592 ModLoad: 75930000 00060000 C:\Windows\system32\IMM32.DLL (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 76430000 000c8000 C:\Windows\syswow64\MSCTF.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 76510000 00009000 C:\Windows\syswow64\LPK.DLL (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 75ae0000 0007d000 C:\Windows\syswow64\USP10.dll (1.626.6002.18244) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.6002.18244 (vistasp2_gdr.100416-0345) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.6002.18244 ModLoad: 70960000 000dc000 C:\Windows\system32\dbghelp.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 755f0000 00008000 C:\Windows\system32\version.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 333, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 134088, QuotaPeakPagedPoolUsage: 134144 QuotaNonPagedPoolUsage: 6864, QuotaPeakNonPagedPoolUsage: 6864 - Virtual Memory Usage - VirtualSize: 912093184, PeakVirtualSize: 912093184 - Pagefile Usage - PagefileUsage: 34406400, PeakPagefileUsage: 107503616 - Working Set Size - WorkingSetSize: 5365760, PeakWorkingSetSize: 5365760, PageFaultCount: 1353 * Dump of thread ID 4960 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156001.000000, User Time: 0.000000, Wait Time: 47615504.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7653D8CB - Registers - eax=1132f9c4 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=7653d8cb esp=1132f9c4 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 kernel32!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad8 00408130 1132faec 003029d1 1132faec 00302959 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff88 765af271 7efde000 1132ffd4 77bdd819 7efde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff94 77bdd819 7efde000 4ab0abe4 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1132ffd4 77bdda2b 007bde7f 7efde000 00000000 00000000 ntdll!RtlCreateUserProcess+0x0 1132ffec 00000000 007bde7f 7efde000 00000000 00000030 ntdll!RtlCreateProcessParameters+0x0 * Dump of thread ID 4116 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 47615504.000000 - Registers - eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=3401ff48 edi=00000000 eip=77ba982d esp=3401ff08 ebp=3401ff6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 3401ff6c 76530c88 00000064 00000000 3401ff88 00749924 ntdll!NtDelayExecution+0x0 3401ff7c 00749924 00000064 3401ff94 765af271 00000000 kernel32!Sleep+0x0 3401ff88 765af271 00000000 3401ffd4 77bdd819 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 3401ff94 77bdd819 00000000 6f83abe4 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 3401ffd4 77bdda2b 00749910 00000000 00000000 00000000 ntdll!RtlCreateUserProcess+0x0 3401ffec 00000000 00749910 00000000 00000000 34530000 ntdll!RtlCreateProcessParameters+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7653D8CB Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 04/30/13 11:33:28 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jr3_1940_40_008261050;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b60000 00160000 C:\Windows\SysWOW64\ntdll.dll (6.0.6002.18541) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 76520000 00110000 C:\Windows\syswow64\kernel32.dll (6.0.6002.18704) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75d00000 000d0000 C:\Windows\syswow64\USER32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75c70000 00090000 C:\Windows\syswow64\GDI32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 75dd0000 000c6000 C:\Windows\syswow64\ADVAPI32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 759f0000 000f0000 C:\Windows\syswow64\RPCRT4.dll (6.0.6002.18024) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75680000 00060000 C:\Windows\syswow64\Secur32.dll (6.0.6002.18643) (-exported- Symbols Loaded) Linked PDB Filename : wsecur32.pdb File Version : 6.0.6002.18643 (vistasp2_gdr.120601-1144) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18643 ModLoad: 70b30000 000cb000 C:\Windows\system32\OPENGL32.dll (6.0.6000.16386) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 76380000 000aa000 C:\Windows\syswow64\msvcrt.dll (7.0.6002.18551) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.6002.18551 (vistasp2_gdr.111214-0301) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.6002.18551 ModLoad: 71a00000 00023000 C:\Windows\system32\GLU32.dll (6.0.6000.16386) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 70a40000 000e5000 C:\Windows\system32\DDRAW.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 75550000 00006000 C:\Windows\system32\DCIMAN32.dll (6.0.6002.18051) (-exported- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.0.6002.18051 (vistasp2_gdr.090615-0258) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18051 ModLoad: 76630000 0018a000 C:\Windows\syswow64\SETUPAPI.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : setupapi.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 Get Product Name Failed. ModLoad: 762c0000 0008d000 C:\Windows\syswow64\OLEAUT32.dll (6.0.6002.18508) (-exported- Symbols Loaded) Linked PDB Filename : oleaut32.pdb File Version : 6.0.6002.18508 Company Name : Microsoft Corporation Product Name : Product Version : 6.0.6002.18508 ModLoad: 76140000 00145000 C:\Windows\syswow64\ole32.dll (6.0.6002.18277) (-exported- Symbols Loaded) Linked PDB Filename : ole32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 753f0000 0000c000 C:\Windows\system32\dwmapi.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : dwmapi.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 76350000 0002a000 C:\Windows\syswow64\imagehlp.dll (6.0.6002.18592) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.0.6002.18592 (vistasp2_gdr.120229-0238) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18592 ModLoad: 75930000 00060000 C:\Windows\system32\IMM32.DLL (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 76430000 000c8000 C:\Windows\syswow64\MSCTF.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 76510000 00009000 C:\Windows\syswow64\LPK.DLL (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 75ae0000 0007d000 C:\Windows\syswow64\USP10.dll (1.626.6002.18244) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.6002.18244 (vistasp2_gdr.100416-0345) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.6002.18244 ModLoad: 70960000 000dc000 C:\Windows\system32\dbghelp.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 755f0000 00008000 C:\Windows\system32\version.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 4, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 346, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 134088, QuotaPeakPagedPoolUsage: 134144 QuotaNonPagedPoolUsage: 6864, QuotaPeakNonPagedPoolUsage: 6864 - Virtual Memory Usage - VirtualSize: 912093184, PeakVirtualSize: 912093184 - Pagefile Usage - PagefileUsage: 34406400, PeakPagefileUsage: 107507712 - Working Set Size - WorkingSetSize: 5402624, PeakWorkingSetSize: 5402624, PageFaultCount: 1362 * Dump of thread ID 6064 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156001.000000, User Time: 0.000000, Wait Time: 47616988.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7653D8CB - Registers - eax=1132f9c4 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=7653d8cb esp=1132f9c4 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 kernel32!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad8 00408130 1132faec 114629d1 1132faec 11462959 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff88 765af271 7efde000 1132ffd4 77bdd819 7efde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff94 77bdd819 7efde000 4ab0515a 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 1132ffd4 77bdda2b 007bde7f 7efde000 00000000 00000000 ntdll!RtlCreateUserProcess+0x0 1132ffec 00000000 007bde7f 7efde000 00000000 13430000 ntdll!RtlCreateProcessParameters+0x0 * Dump of thread ID 4936 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 47616988.000000 - Registers - eax=00749910 ebx=00000000 ecx=00000000 edx=00000000 esi=341aff48 edi=00000000 eip=77ba982d esp=341aff08 ebp=341aff6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 341aff6c 76530c88 00000064 00000000 341aff88 00749924 ntdll!NtDelayExecution+0x0 341aff7c 00749924 00000064 341aff94 765af271 00000000 kernel32!Sleep+0x0 341aff88 765af271 00000000 341affd4 77bdd819 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 341aff94 77bdd819 00000000 6f98515a 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 341affd4 77bdda2b 00749910 00000000 00000000 00000000 ntdll!RtlCreateUserProcess+0x0 341affec 00000000 00749910 00000000 00000000 346c0000 ntdll!RtlCreateProcessParameters+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... 14:47:06 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:59 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1912, iMonCtr=1 Model crash detected, will try to restart... 14:51:01 (1912): No heartbeat from core client for 30 sec - exiting 14:51:02 (1912): No heartbeat from core client for 30 sec - exiting 14:51:03 (1912): No heartbeat from core client for 30 sec - exiting 14:51:04 (1912): No heartbeat from core client for 30 sec - exiting 14:51:05 (1912): No heartbeat from core client for 30 sec - exiting 14:51:07 (1912): No heartbeat from core client for 30 sec - exiting 14:51:08 (1912): No heartbeat from core client for 30 sec - exiting 14:51:09 (1912): No heartbeat from core client for 30 sec - exiting 14:51:10 (1912): No heartbeat from core client for 30 sec - exiting 14:51:11 (1912): No heartbeat from core client for 30 sec - exiting 14:51:12 (1912): No heartbeat from core client for 30 sec - exiting 14:51:13 (1912): No heartbeat from core client for 30 sec - exiting 14:51:14 (1912): No heartbeat from core client for 30 sec - exiting 14:51:15 (1912): No heartbeat from core client for 30 sec - exiting 14:51:16 (1912): No heartbeat from core client for 30 sec - exiting 14:51:17 (1912): No heartbeat from core client for 30 sec - exiting 14:51:19 (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:40 (4724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7653D8CB Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 04/30/13 16:29:08 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jr3_1940_40_008261050;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00111000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b60000 00160000 C:\Windows\SysWOW64\ntdll.dll (6.0.6002.18541) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 76520000 00110000 C:\Windows\syswow64\kernel32.dll (6.0.6002.18704) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75d00000 000d0000 C:\Windows\syswow64\USER32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75c70000 00090000 C:\Windows\syswow64\GDI32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 75dd0000 000c6000 C:\Windows\syswow64\ADVAPI32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 759f0000 000f0000 C:\Windows\syswow64\RPCRT4.dll (6.0.6002.18024) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 75680000 00060000 C:\Windows\syswow64\Secur32.dll (6.0.6002.18643) (-exported- Symbols Loaded) Linked PDB Filename : wsecur32.pdb File Version : 6.0.6002.18643 (vistasp2_gdr.120601-1144) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18643 ModLoad: 75930000 00060000 C:\Windows\system32\IMM32.DLL (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 76430000 000c8000 C:\Windows\syswow64\MSCTF.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 76380000 000aa000 C:\Windows\syswow64\msvcrt.dll (7.0.6002.18551) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.6002.18551 (vistasp2_gdr.111214-0301) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.6002.18551 ModLoad: 76510000 00009000 C:\Windows\syswow64\LPK.DLL (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wlpk.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 75ae0000 0007d000 C:\Windows\syswow64\USP10.dll (1.626.6002.18244) (-exported- Symbols Loaded) Linked PDB Filename : usp10.pdb File Version : 1.0626.6002.18244 (vistasp2_gdr.100416-0345) Company Name : Microsoft Corporation Product Name : Microsoft(R) Uniscribe Unicode script processor Product Version : 1.0626.6002.18244 ModLoad: 71f30000 00021000 C:\Windows\system32\NTMARTA.DLL (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 75ea0000 00049000 C:\Windows\syswow64\WLDAP32.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : wldap32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 76290000 0002d000 C:\Windows\syswow64\WS2_32.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : ws2_32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 76500000 00006000 C:\Windows\syswow64\NSI.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : nsi.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 77b30000 00007000 C:\Windows\syswow64\PSAPI.DLL (6.0.6000.16386) (-exported- Symbols Loaded) Linked PDB Filename : psapi.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 71f10000 00011000 C:\Windows\system32\SAMLIB.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : samlib.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 ModLoad: 76140000 00145000 C:\Windows\syswow64\ole32.dll (6.0.6002.18277) (-exported- Symbols Loaded) Linked PDB Filename : ole32.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 71b00000 0002c000 C:\Windows\system32\apphelp.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : apphelp.pdb File Version : 6.0.6000.16386 (vista_rtm.061101-2205) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6000.16386 ModLoad: 70f40000 000a4000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_se_6.07_windows_intelx86.dll (-exported- Symbols Loaded) Linked PDB Filename : d:\cpdn\cpdnboinc\hadcm3\test\projects\reqs.comlab.ox.ac.uk_cpdn\hadcm3n_se_6.07_windows_intelx86.pdb ModLoad: 707d0000 000dc000 C:\Windows\system32\dbghelp.dll (6.0.6001.18000) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.0.6001.18000 (longhorn_rtm.080118-1840) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6001.18000 ModLoad: 755f0000 00008000 C:\Windows\system32\version.dll (6.0.6002.18005) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.0.6002.18005 (lh_sp2rtm.090410-1830) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.0.6002.18005 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 1744, Write: 0, Other 232 - I/O Transfers Counters - Read: 0, Write: 1164, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 107952, QuotaPeakPagedPoolUsage: 113216 QuotaNonPagedPoolUsage: 6768, QuotaPeakNonPagedPoolUsage: 6768 - Virtual Memory Usage - VirtualSize: 61874176, PeakVirtualSize: 63455232 - Pagefile Usage - PagefileUsage: 2727936, PeakPagefileUsage: 85016576 - Working Set Size - WorkingSetSize: 3112960, PeakWorkingSetSize: 9183232, PageFaultCount: 3084 * Dump of thread ID 6068 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 1092007.000000, User Time: 2496016.000000, Wait Time: 48754144.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7653D8CB - Registers - eax=0017f228 ebx=0280d828 ecx=00000003 edx=00000000 esi=70fda484 edi=013afa00 eip=7653d8cb esp=0017f228 ebp=0017f278 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 0017f278 70f9e730 e06d7363 00000001 00000003 0017f2a4 kernel32!RaiseException+0x0 0017f2b0 70f9bcdc 0017f2c0 70fd1fe0 70fc13f4 70fcb230 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 0017f2cc 70f4fa97 04ebe800 00000010 02f53b18 00000000 hadcm3n_se_6.07_windows_intelx8!umtonc+0x0 0017f2e4 70f436b8 baafa294 004bb848 004bb710 0017f6e4 hadcm3n_se_6.07_windows_intelx8!+0x0 00000000 00000000 00000000 00000000 00000000 00000000 hadcm3n_se_6.07_windows_intelx8!+0x0 * Dump of thread ID 3716 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 48754140.000000 - Registers - eax=00000000 ebx=00000000 ecx=00000000 edx=00000000 esi=027eff48 edi=00000000 eip=77ba982d esp=027eff08 ebp=027eff6c cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 027eff6c 76530c88 00000064 00000000 027eff88 00413da4 ntdll!NtDelayExecution+0x0 027eff7c 00413da4 00000064 027eff94 765af271 00000000 kernel32!Sleep+0x0 027eff88 765af271 00000000 027effd4 77bdd819 00000000 hadcm3n_6.07_windows_intelx86!+0x0 027eff94 77bdd819 00000000 59441389 00000000 00000000 kernel32!BaseThreadInitThunk+0x0 027effd4 77bdda2b 00413d90 00000000 00000000 00000000 ntdll!RtlCreateUserProcess+0x0 027effec 00000000 00413d90 00000000 00000000 0db91a84 ntdll!RtlCreateProcessParameters+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Apr 2013 22:27:09	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	336,960	674,659	2.0022
29 Apr 2013 07:32:18	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	311,040	624,547	2.0079
28 Apr 2013 16:56:29	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	285,120	574,235	2.0140
28 Apr 2013 00:38:35	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	259,200	521,336	2.0113
27 Apr 2013 08:22:52	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	233,280	467,947	2.0059
26 Apr 2013 15:51:34	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	207,360	414,655	1.9997
26 Apr 2013 00:05:06	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	181,440	361,997	1.9951
25 Apr 2013 07:36:34	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	155,520	308,785	1.9855
24 Apr 2013 15:20:38	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	129,600	255,511	1.9715
23 Apr 2013 23:26:59	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	103,680	203,833	1.9660
23 Apr 2013 08:08:53	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	77,760	153,143	1.9694
22 Apr 2013 16:46:25	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	51,840	102,313	1.9736
22 Apr 2013 01:11:13	1040449	15722239	hadcm3n_3jr3_1940_40_008261050_3	25,920	51,050	1.9695