Task 12008941

Name	hadcm3igeo_w2pp_2000_80_06759540_4
Workunit	6962856
Created	12 Nov 2010, 15:28:50 UTC
Sent	18 Nov 2010, 12:47:57 UTC
Report deadline	19 May 2012, 9:31:06 UTC
Received	6 Jan 2011, 15:52:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1062099
Run time
CPU time	21 days 23 hours 16 min 40 sec
Validate state	Invalid
Credit	14,043.46
Device peak FLOPS	2.72 GFLOPS
Application version	HadCM3L Coupled Model Experiment Optimised File I/O v6.04 windows_intelx86
Stderr	<core_client_version>6.2.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN process is not running, exiting, bRetVal = 1, checkPID=2184, selfPID=2184, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error in converting file dataout/w2ppfo.pjl6c10 to netcdf format. Error in converting file dataout/w2ppfo.pil6c10 to netcdf format. Error in converting file dataout/w2ppfo.pfl6c10 to netcdf format. Error in converting file dataout/w2ppfa.phl6c10 to netcdf format. Error in converting file dataout/w2ppfa.pgl6c10 to netcdf format. Error in converting file dataout/w2ppfa.pel6c10 to netcdf format. Error in converting file dataout/w2ppfa.pdl6c10 to netcdf format. scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN process is not running, exiting, bRetVal = 1, checkPID=3112, selfPID=3112, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error in converting file dataout/w2ppfo.pjm1c10 to netcdf format. Error in converting file dataout/w2ppfo.pim1c10 to netcdf format. Error in converting file dataout/w2ppfo.pfm1c10 to netcdf format. Error in converting file dataout/w2ppfa.phm1c10 to netcdf format. Error in converting file dataout/w2ppfa.pgm1c10 to netcdf format. Error in converting file dataout/w2ppfa.pem1c10 to netcdf format. Error in converting file dataout/w2ppfa.pdm1c10 to netcdf format. scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... CPDN NetCDF Err #2 - No such file or directory CPDN NetCDF Err #2 - No such file or directory CPDN NetCDF Err #2 - No such file or directory CPDN NetCDF Err #2 - No such file or directory MainError: 02:39:38 PM No files match the supplied pattern. MainError: 02:39:38 PM No files match the supplied pattern. scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: boinc_ufs_cpdnout3.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: boinc_ufs_cpdnout3.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: boinc_ufs_cpdnout3.zip scan: boinc_ufs_cpdnout4.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz CPDN Monitor - Quit request from BOINC... scan: 0a8q_01_2000_atmos.gz scan: 0a8q_01_2000_ocean.gz scan: 1040_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: boinc_ufs_cpdnout3.zip scan: boinc_ufs_cpdnout4.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: fo8phdck_0208_nickfluxcorr.anc.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w2pp_2000_80_06759540.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_sca13.gz error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/jobs/yafbg.PRESM_O error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/datain/ancil/basin.index error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/jobs/yafbg.namelists forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3976, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/jobs/yafbg.PRESM_O error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/datain/ancil/basin.index error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/jobs/yafbg.namelists forrtl: Access is denied. No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/jobs/yafbg.PRESM_O error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/datain/ancil/basin.index error: cannot delete old hadcm3igeo_w2pp_2000_80_06759540/jobs/yafbg.namelists forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... forrtl: Access is denied. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3212, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Jan 2011 07:34:10	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	1,114,560	1,859,869	1.6687
24 Dec 2010 12:25:02	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	1,088,640	1,816,257	1.6684
23 Dec 2010 19:06:09	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	1,062,720	1,773,179	1.6685
23 Dec 2010 11:03:39	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	1,036,800	1,730,351	1.6689
22 Dec 2010 10:36:06	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	1,010,880	1,687,007	1.6688
21 Dec 2010 15:11:17	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	984,960	1,643,484	1.6686
20 Dec 2010 21:58:19	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	959,040	1,600,781	1.6691
20 Dec 2010 10:47:17	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	933,120	1,557,635	1.6693
19 Dec 2010 11:33:53	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	907,200	1,515,301	1.6703
18 Dec 2010 19:24:30	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	881,280	1,473,116	1.6716
18 Dec 2010 09:22:55	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	855,360	1,430,263	1.6721
17 Dec 2010 10:45:01	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	829,440	1,386,916	1.6721
16 Dec 2010 13:52:28	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	803,520	1,343,279	1.6717
15 Dec 2010 20:16:57	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	777,600	1,299,504	1.6712
15 Dec 2010 10:24:48	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	751,680	1,255,808	1.6707
14 Dec 2010 09:24:51	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	725,760	1,212,625	1.6708
13 Dec 2010 13:41:39	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	699,840	1,169,213	1.6707
12 Dec 2010 20:40:30	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	673,920	1,126,703	1.6719
12 Dec 2010 09:10:46	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	648,000	1,083,526	1.6721
11 Dec 2010 09:46:04	1062099	12008941	hadcm3igeo_w2pp_2000_80_06759540_4	622,080	1,040,473	1.6726