Task 15675496

Name	hadcm3n_3kbv_1940_40_008259769_1
Workunit	8414893
Created	21 Mar 2013, 23:15:12 UTC
Sent	21 Mar 2013, 23:15:27 UTC
Report deadline	21 Jun 2013, 6:42:38 UTC
Received	9 Apr 2013, 12:19:55 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1231599
Run time	6 days 7 hours 8 min 35 sec
CPU time	5 days 2 hours 50 min 52 sec
Validate state	Invalid
Credit	3,421.44
Device peak FLOPS	3.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on 3kbvko.dae57h0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:26:37 (7032): No heartbeat from core client for 30 sec - exiting 00:26:41 (7032): No heartbeat from core client for 30 sec - exiting 00:26:42 (7032): No heartbeat from core client for 30 sec - exiting 00:26:43 (7032): No heartbeat from core client for 30 sec - exiting 00:26:44 (7032): No heartbeat from core client for 30 sec - exiting 00:26:45 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=856, selfPID=856, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/3kbvko.pjf1c10 Error converting file to netcdf: dataout/3kbvko.pif1c10 Error converting file to netcdf: dataout/3kbvko.pff1c10 Error converting file to netcdf: dataout/3kbvka.phf1c10 Error converting file to netcdf: dataout/3kbvka.pgf1c10 Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Apr 2013 12:21:20	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	285,120	442,314	1.5513
08 Apr 2013 07:41:45	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	259,200	399,709	1.5421
04 Apr 2013 08:30:32	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	233,280	357,152	1.5310
03 Apr 2013 09:30:50	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	207,360	313,293	1.5109
02 Apr 2013 15:55:55	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	181,440	268,415	1.4794
01 Apr 2013 21:49:21	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	155,520	227,025	1.4598
29 Mar 2013 11:31:55	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	129,600	187,160	1.4441
27 Mar 2013 00:28:44	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	103,680	148,424	1.4316
23 Mar 2013 15:15:41	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	77,760	112,719	1.4496
23 Mar 2013 02:50:58	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	51,840	76,268	1.4712
22 Mar 2013 12:50:17	1231599	15675496	hadcm3n_3kbv_1940_40_008259769_1	25,920	39,526	1.5249