Task 15636821

Name	hadcm3n_n2aq_1920_40_008321571_0
Workunit	8472706
Created	24 Feb 2013, 19:58:38 UTC
Sent	24 Feb 2013, 20:20:45 UTC
Report deadline	27 May 2013, 3:47:56 UTC
Received	14 Apr 2013, 19:58:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1227307
Run time	8 days 7 hours 5 min 49 sec
CPU time	7 days 18 hours 11 min 51 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5492, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1160, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5520, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5664, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5152, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4480, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5756, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5648, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/n2aqko.pjd1c10 Error converting file to netcdf: dataout/n2aqko.pid1c10 Error converting file to netcdf: dataout/n2aqko.pfd1c10 Error converting file to netcdf: dataout/n2aqka.phd1c10 Error converting file to netcdf: dataout/n2aqka.pgd1c10 Error converting file to netcdf: dataout/n2aqka.ped1c10 Error converting file to netcdf: dataout/n2aqka.pdd1c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5352, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5136, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5892, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3488, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5352, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6052, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5896, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5788, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5868, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Apr 2013 18:58:47	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	777,600	670,308	0.8620
13 Apr 2013 18:37:39	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	751,680	648,156	0.8623
11 Apr 2013 19:22:34	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	725,760	626,258	0.8629
08 Apr 2013 20:34:17	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	699,840	604,130	0.8632
07 Apr 2013 17:36:31	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	673,920	582,049	0.8637
07 Apr 2013 11:03:38	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	648,000	559,996	0.8642
06 Apr 2013 11:54:47	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	622,080	537,751	0.8644
05 Apr 2013 21:42:24	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	596,160	515,773	0.8652
01 Apr 2013 22:54:51	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	570,240	494,058	0.8664
01 Apr 2013 17:52:50	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	544,320	472,662	0.8684
01 Apr 2013 10:40:02	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	518,400	450,744	0.8695
30 Mar 2013 21:40:40	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	492,480	427,842	0.8688
29 Mar 2013 21:19:30	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	466,560	404,879	0.8678
26 Mar 2013 20:28:40	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	440,640	381,951	0.8668
24 Mar 2013 18:20:41	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	414,720	359,135	0.8660
23 Mar 2013 23:18:41	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	388,800	336,213	0.8647
23 Mar 2013 16:35:55	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	362,880	313,115	0.8629
22 Mar 2013 23:13:29	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	336,960	290,320	0.8616
20 Mar 2013 21:50:52	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	311,040	267,571	0.8602
19 Mar 2013 17:18:33	1227307	15636821	hadcm3n_n2aq_1920_40_008321571_0	285,120	244,658	0.8581