Task 12819312

Name	hadcm3n_p1mn_1900_40_007219695_0
Workunit	7417935
Created	26 Apr 2011, 15:18:16 UTC
Sent	26 Apr 2011, 15:20:20 UTC
Report deadline	26 Jul 2011, 22:47:31 UTC
Received	3 May 2011, 17:15:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1054209
Run time	6 days 17 hours 4 min 6 sec
CPU time	6 days 14 hours 29 min 29 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/p1mnko.pjb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnko.pjb0c10 Error: Input file: dataout/p1mnko.pib0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnko.pib0c10 Error: Input file: dataout/p1mnko.pfb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnko.pfb0c10 Error: Input file: dataout/p1mnko.pcb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnko.pcb0c10 Error: Input file: dataout/p1mnko.pbb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnko.pbb0c10 Error: Input file: dataout/p1mnko.pab0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnko.pab0c10 Error: Input file: dataout/p1mnka.phb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnka.phb0c10 Error: Input file: dataout/p1mnka.pgb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnka.pgb0c10 Error: Input file: dataout/p1mnka.peb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnka.peb0c10 Error: Input file: dataout/p1mnka.pdb0c10 is not a valid UM file. Error converting file to netcdf: dataout/p1mnka.pdb0c10 Signal 3 received, exiting... Called boinc_finish cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_p1mn_1900_40_007219695/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 May 2011 17:31:25	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	259,200	570,558	2.2012
02 May 2011 23:55:06	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	233,280	513,178	2.1998
02 May 2011 07:38:50	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	207,360	455,983	2.1990
01 May 2011 15:29:55	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	181,440	398,925	2.1987
30 Apr 2011 23:18:55	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	155,520	341,933	2.1986
30 Apr 2011 07:18:10	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	129,600	284,983	2.1989
29 Apr 2011 15:17:32	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	103,680	227,933	2.1984
28 Apr 2011 23:16:16	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	77,760	170,933	2.1982
28 Apr 2011 07:03:22	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	51,840	113,983	2.1987
27 Apr 2011 14:58:00	1054209	12819312	hadcm3n_p1mn_1900_40_007219695_0	25,920	56,910	2.1956