Task 11272268

Name	hadsm3dhet2_k8sp_006621051_9
Workunit	6824424
Created	15 Mar 2010, 12:34:50 UTC
Sent	14 Apr 2010, 4:26:18 UTC
Report deadline	27 Mar 2011, 9:46:18 UTC
Received	1 Jul 2010, 11:50:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1069006
Run time	9 days 1 hours 16 min 49 sec
CPU time	8 days 17 hours 47 min 49 sec
Validate state	Invalid
Credit	3,572.76
Device peak FLOPS	0.00 GFLOPS
Application version	---
Stderr	<core_client_version>6.10.43</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3168, selfPID=3168, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. MainError: 02:41:47 AM No files match the supplied pattern. No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3796, selfPID=3796, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=3192, selfPID=3192, iMonCtr=1 No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7620FBAE Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.3.8 Dump Timestamp : 07/01/10 06:49:06 Install Directory : C:\Program Files\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : Loaded Library : C:\Program Files\BOINC\\dbghelp.dll Loaded Library : C:\Program Files\BOINC\\symsrv.dll Loaded Library : C:\Program Files\BOINC\\srcsrv.dll LoadLibraryA( C:\Program Files\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll SymInitialize(): GetLastError = 3221225725 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 3, Write: 0, Other 186 - I/O Transfers Counters - Read: 0, Write: 409, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 150296, QuotaPeakPagedPoolUsage: 150296 QuotaNonPagedPoolUsage: 4304, QuotaPeakNonPagedPoolUsage: 4304 - Virtual Memory Usage - VirtualSize: 273817600, PeakVirtualSize: 273817600 - Pagefile Usage - PagefileUsage: 8851456, PeakPagefileUsage: 10809344 - Working Set Size - WorkingSetSize: 5922816, PeakWorkingSetSize: 5922816, PageFaultCount: 1647 * Dump of thread ID 2744 (state: Waiting): * - Information - Status: Wait Reason: UserRequest, , Kernel Time: 156001.000000, User Time: 156001.000000, Wait Time: 20595190.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7620FBAE * Dump of thread ID 12 (state: Waiting): * - Information - Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 20595188.000000 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2884, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Jun 2010 21:59:03	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	129,624	747,501	1.9222
30 Jun 2010 01:45:37	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	118,822	726,849	1.9225
29 Jun 2010 07:23:17	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	108,020	706,172	1.9228
28 Jun 2010 05:58:16	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	97,218	685,247	1.9223
26 Jun 2010 10:41:13	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	86,416	664,594	1.9227
25 Jun 2010 15:23:13	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	75,614	643,965	1.9231
25 Jun 2010 00:00:04	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	64,812	623,394	1.9237
21 Jun 2010 21:04:09	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	54,010	602,776	1.9242
21 Jun 2010 07:45:09	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	43,208	582,368	1.9255
20 Jun 2010 22:28:19	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	32,406	562,085	1.9272
20 Jun 2010 15:55:29	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	21,604	541,488	1.9280
20 Jun 2010 09:37:44	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	10,802	520,984	1.9292
20 Jun 2010 02:43:57	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	259,248	500,222	1.9295
19 Jun 2010 20:04:50	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	248,446	479,408	1.9296
12 May 2010 19:28:48	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	237,644	458,405	1.9290
11 May 2010 15:46:20	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	226,842	437,330	1.9279
08 May 2010 11:11:01	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	216,040	416,369	1.9273
07 May 2010 09:15:43	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	205,238	395,138	1.9253
06 May 2010 10:05:12	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	194,436	373,940	1.9232
04 May 2010 20:18:44	1069006	11272268	hadsm3dhet2_k8sp_006621051_9	183,634	352,984	1.9222