Task 11215416

Name	hadsm3dhet2_k4es_006615366_9
Workunit	6818739
Created	15 Mar 2010, 12:27:29 UTC
Sent	30 Apr 2010, 4:33:49 UTC
Report deadline	12 Apr 2011, 9:53:49 UTC
Received	18 Jul 2010, 15:08:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1051161
Run time	4 days 9 hours 8 min 46 sec
CPU time	4 days 0 hours 12 min 58 sec
Validate state	Invalid
Credit	3,870.49
Device peak FLOPS	0.00 GFLOPS
Application version	---
Stderr	<core_client_version>6.10.21</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. MainError: 12:54:58 AM No files match the supplied pattern. Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Model crashed: cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9322, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9322, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9322, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9322, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/yabsd.ihist cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.spin cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.cont cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/jobs/climate.doub cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/dataout/restart.day cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/heatflux.ph1 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadsm3dhet2_k4es_006615366/datain/phase2.start forrtl: Bad file descriptor forrtl: severe (30): open failure, unit 6, file stdout Image PC Routine Line Source libirc.dylib 00B8B5E3 Unknown Unknown Unknown libirc.dylib 00B8A2D3 Unknown Unknown Unknown libifcoremt.dylib 008C5EFA Unknown Unknown Unknown libifcoremt.dylib 0083C2E0 Unknown Unknown Unknown libifcoremt.dylib 00879BCF Unknown Unknown Unknown hadsm3_um_6.09_i6 0027D503 Unknown Unknown Unknown hadsm3_um_6.09_i6 0029A2BE Unknown Unknown Unknown hadsm3_um_6.09_i6 000023B2 Unknown Unknown Unknown hadsm3_um_6.09_i6 000022D9 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9322, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Jul 2010 13:55:39	1051161	11215416	hadsm3dhet2_k4es_006615366_9	162,030	344,892	0.8187
27 Jun 2010 12:47:26	1051161	11215416	hadsm3dhet2_k4es_006615366_9	151,228	336,101	0.8188
22 Jun 2010 10:23:10	1051161	11215416	hadsm3dhet2_k4es_006615366_9	140,426	327,273	0.8188
22 Jun 2010 06:43:43	1051161	11215416	hadsm3dhet2_k4es_006615366_9	129,624	318,464	0.8189
21 Jun 2010 10:57:16	1051161	11215416	hadsm3dhet2_k4es_006615366_9	118,822	309,677	0.8191
21 Jun 2010 07:15:23	1051161	11215416	hadsm3dhet2_k4es_006615366_9	108,020	300,871	0.8192
18 Jun 2010 08:34:52	1051161	11215416	hadsm3dhet2_k4es_006615366_9	97,218	292,075	0.8194
16 Jun 2010 12:42:26	1051161	11215416	hadsm3dhet2_k4es_006615366_9	86,416	283,274	0.8195
16 Jun 2010 09:05:32	1051161	11215416	hadsm3dhet2_k4es_006615366_9	75,614	274,477	0.8197
12 Jun 2010 18:07:12	1051161	11215416	hadsm3dhet2_k4es_006615366_9	64,812	265,653	0.8198
11 Jun 2010 15:02:41	1051161	11215416	hadsm3dhet2_k4es_006615366_9	54,010	256,833	0.8199
03 Jun 2010 13:15:17	1051161	11215416	hadsm3dhet2_k4es_006615366_9	43,208	248,055	0.8201
03 Jun 2010 13:15:17	1051161	11215416	hadsm3dhet2_k4es_006615366_9	32,406	239,299	0.8205
03 Jun 2010 13:15:17	1051161	11215416	hadsm3dhet2_k4es_006615366_9	21,604	230,504	0.8207
24 May 2010 04:51:14	1051161	11215416	hadsm3dhet2_k4es_006615366_9	10,802	221,760	0.8212
24 May 2010 01:03:49	1051161	11215416	hadsm3dhet2_k4es_006615366_9	259,248	212,988	0.8216
22 May 2010 19:04:24	1051161	11215416	hadsm3dhet2_k4es_006615366_9	248,446	204,175	0.8218
22 May 2010 19:04:24	1051161	11215416	hadsm3dhet2_k4es_006615366_9	237,644	195,188	0.8213
20 May 2010 13:01:25	1051161	11215416	hadsm3dhet2_k4es_006615366_9	226,842	186,179	0.8207
19 May 2010 10:23:48	1051161	11215416	hadsm3dhet2_k4es_006615366_9	216,040	177,217	0.8203