Task 15457379

Name	hadcm3n_zbss_1880_40_008252547_1
Workunit	8407671
Created	23 Nov 2012, 14:20:06 UTC
Sent	23 Nov 2012, 14:22:26 UTC
Report deadline	22 Feb 2013, 21:49:37 UTC
Received	14 Dec 2012, 12:02:42 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1050746
Run time	7 days 11 hours 24 min 52 sec
CPU time	5 days 15 hours 34 min 20 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.87 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:02:28 (672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:29 (672): No heartbeat from core client for 30 sec - exiting 21:02:30 (672): No heartbeat from core client for 30 sec - exiting 21:02:31 (672): No heartbeat from core client for 30 sec - exiting 21:02:32 (672): No heartbeat from core client for 30 sec - exiting 21:02:33 (672): No heartbeat from core client for 30 sec - exiting 21:02:34 (672): No heartbeat from core client for 30 sec - exiting 21:02:35 (672): No heartbeat from core client for 30 sec - exiting 21:02:36 (672): No heartbeat from core client for 30 sec - exiting 21:02:37 (672): No heartbeat from core client for 30 sec - exiting 21:02:38 (672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:28:42 (2392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:41:57 (3316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:03:49 (3092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00477C9A write attempt to address 0x011A0000 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 12/12/12 19:02:54 Install Directory : D:\Program Files\BOINC\ Data Directory : C:\Documents and Settings\All Users\Application Data\BOINC Project Symstore : Loaded Library : D:\Program Files\BOINC\\dbghelp.dll Loaded Library : D:\Program Files\BOINC\\symsrv.dll Loaded Library : D:\Program Files\BOINC\\srcsrv.dll LoadLibraryA( D:\Program Files\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_zbss_1880_40_008252547;C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net ModLoad: 00400000 00111000 C:\Documents and Settings\All Users\Application Data\BOINC\projects\climateprediction.net\hadcm3n_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 7c900000 000b2000 C:\WINDOWS\system32\ntdll.dll (5.1.2600.5755) (-exported- Symbols Loaded) Linked PDB Filename : ntdll.pdb File Version : 5.1.2600.5755 (xpsp_sp3_gdr.090206-1234) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5755 ModLoad: 7c800000 000f6000 C:\WINDOWS\system32\kernel32.dll (5.1.2600.5781) (-exported- Symbols Loaded) Linked PDB Filename : kernel32.pdb File Version : 5.1.2600.5781 (xpsp_sp3_gdr.090321-1317) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5781 ModLoad: 7e410000 00091000 C:\WINDOWS\system32\USER32.dll (5.1.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : user32.pdb File Version : 5.1.2600.5512 (xpsp.080413-2105) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5512 ModLoad: 77f10000 00049000 C:\WINDOWS\system32\GDI32.dll (5.1.2600.5698) (-exported- Symbols Loaded) Linked PDB Filename : gdi32.pdb File Version : 5.1.2600.5698 (xpsp_sp3_gdr.081022-1932) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5698 ModLoad: 77dd0000 0009b000 C:\WINDOWS\system32\ADVAPI32.dll (5.1.2600.5755) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 5.1.2600.5755 (xpsp_sp3_gdr.090206-1234) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5755 ModLoad: 77e70000 00092000 C:\WINDOWS\system32\RPCRT4.dll (5.1.2600.5795) (-exported- Symbols Loaded) Linked PDB Filename : rpcrt4.pdb File Version : 5.1.2600.5795 (xpsp_sp3_gdr.090415-1241) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5795 ModLoad: 77fe0000 00011000 C:\WINDOWS\system32\Secur32.dll (5.1.2600.5834) (-exported- Symbols Loaded) Linked PDB Filename : secur32.pdb File Version : 5.1.2600.5834 (xpsp_sp3_gdr.090624-1305) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5834 ModLoad: 76390000 0001d000 C:\WINDOWS\system32\IMM32.DLL (5.1.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : imm32.pdb File Version : 5.1.2600.5512 (xpsp.080413-2105) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5512 ModLoad: 77690000 00021000 C:\WINDOWS\system32\NTMARTA.DLL (5.1.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 5.1.2600.5512 (xpsp.080413-2113) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5512 ModLoad: 77c10000 00058000 C:\WINDOWS\system32\msvcrt.dll (7.0.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.2600.5512 (xpsp.080413-2111) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.2600.5512 ModLoad: 774e0000 0013d000 C:\WINDOWS\system32\ole32.dll (5.1.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : ole32.pdb File Version : 5.1.2600.5512 (xpsp.080413-2108) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5512 ModLoad: 71bf0000 00013000 C:\WINDOWS\system32\SAMLIB.dll (5.1.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : samlib.pdb File Version : 5.1.2600.5512 (xpsp.080413-2113) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5512 ModLoad: 76f60000 0002c000 C:\WINDOWS\system32\WLDAP32.dll (5.1.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : wldap32.pdb File Version : 5.1.2600.5512 (xpsp.080413-2113) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5512 ModLoad: 03000000 00115000 D:\Program Files\BOINC\dbghelp.dll (6.8.4.0) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.8.0004.0 (debuggers(dbg).070515-1751) Company Name : Microsoft Corporation Product Name : Debugging Tools for Windows(R) Product Version : 6.8.0004.0 ModLoad: 02f80000 00048000 D:\Program Files\BOINC\symsrv.dll (6.8.4.0) (-exported- Symbols Loaded) Linked PDB Filename : symsrv.pdb File Version : 6.8.0004.0 (debuggers(dbg).070515-1751) Company Name : Microsoft Corporation Product Name : Debugging Tools for Windows(R) Product Version : 6.8.0004.0 ModLoad: 03220000 0003b000 D:\Program Files\BOINC\srcsrv.dll (6.8.4.0) (-exported- Symbols Loaded) Linked PDB Filename : srcsrv.pdb File Version : 6.8.0004.0 (debuggers(dbg).070515-1751) Company Name : Microsoft Corporation Product Name : Debugging Tools for Windows(R) Product Version : 6.8.0004.0 ModLoad: 77c00000 00008000 C:\WINDOWS\system32\version.dll (5.1.2600.5512) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 5.1.2600.5512 (xpsp.080413-2105) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 5.1.2600.5512 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 366584, Write: 0, Other 110954 - I/O Transfers Counters - Read: 0, Write: 33201, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 41564, QuotaPeakPagedPoolUsage: 50860 QuotaNonPagedPoolUsage: 2256, QuotaPeakNonPagedPoolUsage: 3936 - Virtual Memory Usage - VirtualSize: 55914496, PeakVirtualSize: 108748800 - Pagefile Usage - PagefileUsage: 3465216, PeakPagefileUsage: 84729856 - Working Set Size - WorkingSetSize: 9830400, PeakWorkingSetSize: 91144192, PageFaultCount: 138112 * Dump of thread ID 2688 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 26875000.000000, User Time: 95625000.000000, Wait Time: 1855934.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00477C9A write attempt to address 0x011A0000 - Registers - eax=01259020 ebx=00000001 ecx=00000f36 edx=00000000 esi=01255348 edi=011a0000 eip=00477c9a esp=000c2750 ebp=000c2758 cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00010212 - Callstack - ChildEBP RetAddr Args to Child 000c2758 00417335 0119fcd8 01255020 00004000 01100f58 hadcm3n_6.07_windows_intelx86!+0x0 000c2770 004186cd 010e3438 01100f58 00000001 00000000 hadcm3n_6.07_windows_intelx86!+0x0 000c2788 004179bd 01100f58 00000000 000c2894 000000d9 hadcm3n_6.07_windows_intelx86!+0x0 000c27a4 004169ee 00000000 00000000 0000012f 0046b924 hadcm3n_6.07_windows_intelx86!+0x0 000c27bc 004048e8 010e3438 000c2894 0000012f 000c2854 hadcm3n_6.07_windows_intelx86!+0x0 000c2854 0117b710 000c2898 000c2894 000c285c 000c2860 hadcm3n_6.07_windows_intelx86!+0x0 004af960 004048a0 00403710 004038f0 00404800 00403730 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '0117b710' 004af964 00403710 004038f0 00404800 00403730 00403760 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004048a0' 004af968 004038f0 00404800 00403730 00403760 00403780 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00403710' 004af96c 00404800 00403730 00403760 00403780 00403810 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004038f0' 004af970 00403730 00403760 00403780 00403810 004038a0 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00404800' 004af974 00403760 00403780 00403810 004038a0 004038c0 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00403730' 004af978 00403780 00403810 004038a0 004038c0 004038e0 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00403760' 004af97c 00403810 004038a0 004038c0 004038e0 00404920 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00403780' 004af980 004038a0 004038c0 004038e0 00404920 00403900 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00403810' 004af984 004038c0 004038e0 00404920 00403900 004b00a0 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004038a0' 004af988 004038e0 00404920 00403900 004b00a0 00402010 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004038c0' 004af98c 00404920 00403900 004b00a0 00402010 004b001c hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004038e0' 004af990 00403900 004b00a0 00402010 004b001c 00402130 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00404920' 004af994 004b00a0 00402010 004b001c 00402130 00000000 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00403900' 004af998 00402010 004b001c 00402130 00000000 00000180 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '004b00a0' 004b00a0 00000000 00000000 004b7100 004b00b4 00000000 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00402010' * Dump of thread ID 2584 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1855931.000000 - Registers - eax=00bff790 ebx=00000000 ecx=00000005 edx=00000078 esi=00000000 edi=00bfff70 eip=7c90e514 esp=00bfff40 ebp=00bfff98 cs=001b ss=0023 ds=0023 es=0023 fs=003b gs=0000 efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 00bfff98 7c802455 00000064 00000000 00bfffb4 00413da4 ntdll!KiFastSystemCallRet+0x0 00bfffa8 00413da4 00000064 00bfffec 7c80b729 00000000 kernel32!Sleep+0x0 00bfffb4 7c80b729 00000000 735c6c61 625f6d68 00000000 hadcm3n_6.07_windows_intelx86!+0x0 00bfffec 00000000 00413d90 00000000 00000000 63646168 kernel32!GetModuleFileNameA+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Dec 2012 12:05:08	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	259,200	488,025	1.8828
14 Dec 2012 12:05:08	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	233,280	441,719	1.8935
14 Dec 2012 12:05:08	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	207,360	396,758	1.9134
14 Dec 2012 12:05:08	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	181,440	352,588	1.9433
06 Dec 2012 08:53:22	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	155,520	302,356	1.9442
04 Dec 2012 09:02:17	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	129,600	251,773	1.9427
02 Dec 2012 09:53:50	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	103,680	201,479	1.9433
30 Nov 2012 12:07:41	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	77,760	151,240	1.9450
29 Nov 2012 12:38:18	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	51,840	100,345	1.9357
27 Nov 2012 14:24:48	1050746	15457379	hadcm3n_zbss_1880_40_008252547_1	25,920	50,080	1.9321