Task 12988827

Name	hadcm3n_s2um_1940_40_007299221_1
Workunit	7496645
Created	20 Jun 2011, 17:30:58 UTC
Sent	20 Jun 2011, 17:31:06 UTC
Report deadline	20 Sep 2011, 0:58:17 UTC
Received	28 Jun 2011, 11:00:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	996482
Run time	6 days 1 hours 40 min 55 sec
CPU time	5 days 5 hours 36 min 22 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4712, iMonCtr=1 Model crash detected, will try to restart... 21:52:48 (3988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:25:37 (1256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:46:57 (128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:20 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/s2umko.pje9c10 Error converting file to netcdf: dataout/s2umko.pie9c10 Error converting file to netcdf: dataout/s2umko.pfe9c10 Error converting file to netcdf: dataout/s2umka.phe9c10 Error converting file to netcdf: dataout/s2umka.pge9c10 Error converting file to netcdf: dataout/s2umka.pee9c10 Error converting file to netcdf: dataout/s2umka.pde9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jun 2011 23:37:36	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	233,280	449,865	1.9284
26 Jun 2011 14:46:37	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	207,360	394,344	1.9017
25 Jun 2011 11:54:22	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	181,440	343,912	1.8955
24 Jun 2011 21:32:34	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	155,520	295,637	1.9010
24 Jun 2011 08:16:25	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	129,600	247,915	1.9129
23 Jun 2011 12:17:00	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	103,680	199,106	1.9204
22 Jun 2011 21:53:03	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	77,760	149,771	1.9261
22 Jun 2011 02:58:16	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	51,840	97,628	1.8833
21 Jun 2011 10:40:03	996482	12988827	hadcm3n_s2um_1940_40_007299221_1	25,920	49,101	1.8943