Task 15550922

Name	hadcm3n_3mrd_1980_40_008283449_1
Workunit	8434584
Created	18 Jan 2013, 11:46:12 UTC
Sent	18 Jan 2013, 11:46:27 UTC
Report deadline	19 Apr 2013, 19:13:38 UTC
Received	31 Jan 2013, 14:36:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1222815
Run time	9 days 20 hours 47 min 16 sec
CPU time	9 days 18 hours 5 min 26 sec
Validate state	Invalid
Credit	10,886.40
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3mrdko.pjl2c10 Error converting file to netcdf: dataout/3mrdko.pil2c10 Error converting file to netcdf: dataout/3mrdko.pfl2c10 Error converting file to netcdf: dataout/3mrdka.phl2c10 Error converting file to netcdf: dataout/3mrdka.pgl2c10 Error converting file to netcdf: dataout/3mrdka.pel2c10 Error converting file to netcdf: dataout/3mrdka.pdl2c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Jan 2013 03:14:43	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	907,200	838,949	0.9248
30 Jan 2013 20:37:36	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	881,280	815,025	0.9248
30 Jan 2013 13:40:17	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	855,360	790,847	0.9246
30 Jan 2013 07:02:55	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	829,440	766,998	0.9247
29 Jan 2013 22:51:52	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	803,520	743,342	0.9251
28 Jan 2013 09:04:34	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	777,600	719,235	0.9249
28 Jan 2013 02:23:29	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	751,680	695,370	0.9251
27 Jan 2013 19:45:05	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	725,760	671,470	0.9252
27 Jan 2013 13:01:50	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	699,840	647,504	0.9252
27 Jan 2013 05:30:27	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	673,920	623,860	0.9257
26 Jan 2013 23:44:02	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	648,000	600,022	0.9260
26 Jan 2013 16:05:42	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	622,080	576,024	0.9260
26 Jan 2013 09:35:01	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	596,160	551,931	0.9258
25 Jan 2013 06:24:54	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	570,240	528,307	0.9265
24 Jan 2013 20:46:55	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	544,320	504,988	0.9277
24 Jan 2013 11:11:31	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	518,400	481,066	0.9280
24 Jan 2013 03:55:15	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	492,480	456,851	0.9277
23 Jan 2013 20:47:18	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	466,560	432,818	0.9277
23 Jan 2013 13:45:18	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	440,640	408,685	0.9275
23 Jan 2013 07:07:56	1222815	15550922	hadcm3n_3mrd_1980_40_008283449_1	414,720	384,733	0.9277