Task 15867917

Name	hadcm3n_4gvc_1980_40_008334877_2
Workunit	8485738
Created	26 Jun 2013, 16:47:55 UTC
Sent	28 Jun 2013, 23:41:04 UTC
Report deadline	28 Sep 2013, 7:08:15 UTC
Received	30 Aug 2013, 23:34:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1209810
Run time	13 days 17 hours 34 min 34 sec
CPU time	12 days 18 hours 59 min 49 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.72 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5004, iMonCtr=1BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/4gvcko.pji6c10 Error converting file to netcdf: dataout/4gvcko.pii6c10 Error converting file to netcdf: dataout/4gvcko.pfi6c10 Error converting file to netcdf: dataout/4gvcka.phi6c10 Error converting file to netcdf: dataout/4gvcka.pgi6c10 Error converting file to netcdf: dataout/4gvcka.pei6c10 Error converting file to netcdf: dataout/4gvcka.pdi6c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4436, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on 4gvcka.dai81j0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on 4gvcka.dai81k0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on 4gvcka.dai81l0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on 4gvcka.dai81m0 Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Restart file copy failed on 4gvcka.dai81n0 18:09:57 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3416, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5008, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3236, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:10:22 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:42:49 (2424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Aug 2013 23:30:44	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	777,600	1,105,183	1.4213
30 Aug 2013 01:13:07	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	751,680	1,066,846	1.4193
28 Aug 2013 15:10:14	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	725,760	1,029,663	1.4187
27 Aug 2013 00:23:59	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	699,840	991,349	1.4165
25 Aug 2013 02:26:53	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	673,920	953,384	1.4147
24 Aug 2013 15:54:47	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	648,000	920,138	1.4200
24 Aug 2013 14:04:25	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	622,080	883,425	1.4201
17 Aug 2013 10:14:52	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	596,160	845,888	1.4189
16 Aug 2013 23:32:50	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	570,240	808,993	1.4187
15 Aug 2013 03:53:51	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	544,320	772,638	1.4195
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	518,400	734,522	1.4169
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	492,480	697,083	1.4155
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	466,560	658,854	1.4122
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	440,640	621,334	1.4101
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	414,720	582,382	1.4043
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	388,800	546,067	1.4045
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	362,880	509,703	1.4046
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	336,960	472,705	1.4029
14 Aug 2013 15:59:38	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	311,040	436,107	1.4021
23 Jul 2013 20:42:36	1209810	15867917	hadcm3n_4gvc_1980_40_008334877_2	285,120	399,305	1.4005