Task 12991129

Name	hadcm3n_s5ln_1940_40_007300220_0
Workunit	7497644
Created	20 Jun 2011, 22:26:30 UTC
Sent	20 Jun 2011, 22:26:43 UTC
Report deadline	20 Sep 2011, 5:53:54 UTC
Received	30 Jun 2011, 5:00:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	415790
Run time	4 days 22 hours 56 min 30 sec
CPU time	4 days 13 hours 27 min 21 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.21</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:00:44 (336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/s5lnko.pje8c10 is not a valid UM file. Error converting file to netcdf: dataout/s5lnko.pje8c10 Error: Input file: dataout/s5lnko.pie8c10 is not a valid UM file. Error converting file to netcdf: dataout/s5lnko.pie8c10 Error: Input file: dataout/s5lnko.pfe8c10 is not a valid UM file. Error converting file to netcdf: dataout/s5lnko.pfe8c10 Error: Input file: dataout/s5lnka.phe8c10 is not a valid UM file. Error converting file to netcdf: dataout/s5lnka.phe8c10 Error: Input file: dataout/s5lnka.pge8c10 is not a valid UM file. Error converting file to netcdf: dataout/s5lnka.pge8c10 Error: Input file: dataout/s5lnka.pee8c10 is not a valid UM file. Error converting file to netcdf: dataout/s5lnka.pee8c10 Error: Input file: dataout/s5lnka.pde8c10 is not a valid UM file. Error converting file to netcdf: dataout/s5lnka.pde8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Jun 2011 19:08:48	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	233,280	391,481	1.6782
29 Jun 2011 00:44:56	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	207,360	348,221	1.6793
27 Jun 2011 15:05:57	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	181,440	304,589	1.6787
27 Jun 2011 01:31:51	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	155,520	261,602	1.6821
26 Jun 2011 08:54:35	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	129,600	218,121	1.6830
25 Jun 2011 19:34:37	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	103,680	174,433	1.6824
24 Jun 2011 04:51:13	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	77,760	130,535	1.6787
22 Jun 2011 23:23:38	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	51,840	86,618	1.6709
21 Jun 2011 16:14:34	415790	12991129	hadcm3n_s5ln_1940_40_007300220_0	25,920	43,549	1.6801