Task 12748399

Name	hadcm3n_o6dh_1900_40_007203592_0
Workunit	7401872
Created	28 Mar 2011, 14:16:47 UTC
Sent	29 Mar 2011, 5:14:15 UTC
Report deadline	28 Jun 2011, 12:41:26 UTC
Received	21 Apr 2011, 2:27:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-529697949 (0xE06D7363) Unknown error code
Computer ID	1130384
Run time	19 days 21 hours 57 min 44 sec
CPU time	18 days 21 hours 11 min 8 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	3.36 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -529697949 (0xe06d7363) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:51:45 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x76ACE124 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 04/20/11 22:00:20 Install Directory : D:\Program Files (x86)\BOINC\ Data Directory : D:\ProgramData\BOINC Project Symstore : Loaded Library : D:\Program Files (x86)\BOINC\\dbghelp.dll Loaded Library : D:\Program Files (x86)\BOINC\\symsrv.dll Loaded Library : D:\Program Files (x86)\BOINC\\srcsrv.dll LoadLibraryA( D:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll * Dump of the Process Statistics: * - I/O Operations Counters - Read: 366450, Write: 0, Other 110833 - I/O Transfers Counters - Read: 0, Write: 6796, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 106112, QuotaPeakPagedPoolUsage: 112696 QuotaNonPagedPoolUsage: 6464, QuotaPeakNonPagedPoolUsage: 7392 - Virtual Memory Usage - VirtualSize: 61915136, PeakVirtualSize: 146276352 - Pagefile Usage - PagefileUsage: 5058560, PeakPagefileUsage: 86200320 - Working Set Size - WorkingSetSize: 12914688, PeakWorkingSetSize: 94560256, PageFaultCount: 84033 * Dump of thread ID 7852 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 41496264.000000, User Time: 192505232.000000, Wait Time: 16452456.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x76ACE124 * Dump of thread ID 8184 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 624004.000000, Wait Time: 16452453.000000 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3780, selfPID=3780, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Apr 2011 02:29:45	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	1,036,800	1,631,464	1.5736
20 Apr 2011 18:11:23	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	1,010,880	1,591,652	1.5745
20 Apr 2011 18:11:23	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	984,960	1,552,283	1.5760
20 Apr 2011 18:11:22	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	959,040	1,512,330	1.5769
20 Apr 2011 18:11:22	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	933,120	1,473,090	1.5787
20 Apr 2011 18:05:06	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	907,200	1,433,736	1.5804
20 Apr 2011 18:05:04	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	881,280	1,393,491	1.5812
20 Apr 2011 18:05:02	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	855,360	1,351,634	1.5802
20 Apr 2011 18:05:00	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	829,440	1,310,290	1.5797
20 Apr 2011 18:04:57	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	803,520	1,269,327	1.5797
20 Apr 2011 18:04:55	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	777,600	1,227,205	1.5782
20 Apr 2011 18:04:52	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	751,680	1,185,693	1.5774
20 Apr 2011 18:04:28	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	725,760	1,144,275	1.5767
20 Apr 2011 18:04:19	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	699,840	1,103,114	1.5762
13 Apr 2011 10:02:33	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	673,920	1,061,716	1.5754
12 Apr 2011 21:27:57	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	648,000	1,020,145	1.5743
12 Apr 2011 09:14:48	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	622,080	977,919	1.5720
12 Apr 2011 09:07:19	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	596,160	935,809	1.5697
12 Apr 2011 09:06:30	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	570,240	892,970	1.5660
12 Apr 2011 09:04:59	1130384	12748399	hadcm3n_o6dh_1900_40_007203592_0	544,320	851,931	1.5651