Task 13022314

Name	hadcm3n_t2qe_1940_40_007314793_0
Workunit	7512223
Created	28 Jun 2011, 17:58:46 UTC
Sent	28 Jun 2011, 18:08:18 UTC
Report deadline	28 Sep 2011, 1:35:29 UTC
Received	14 Sep 2011, 12:45:12 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1104596
Run time	48 days 14 hours 36 min 41 sec
CPU time	36 days 16 hours 34 min
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.70 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4528, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2124, iMonCtr=1 Model crash detected, will try to restart... 17:17:34 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on t2qeko.dag92k0 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8708, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8708, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4492, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4492, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2116, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Sep 2011 11:43:17	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	1,036,800	3,169,423	3.0569
13 Sep 2011 23:07:25	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	1,010,880	3,128,104	3.0944
13 Sep 2011 06:50:51	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	984,960	3,084,283	3.1314
12 Sep 2011 02:42:30	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	959,040	3,040,154	3.1700
11 Sep 2011 02:52:01	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	933,120	2,996,027	3.2108
10 Sep 2011 04:44:05	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	907,200	2,954,109	3.2563
09 Sep 2011 14:57:30	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	881,280	2,912,467	3.3048
09 Sep 2011 01:15:26	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	855,360	2,870,705	3.3561
08 Sep 2011 06:37:41	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	829,440	2,825,884	3.4070
07 Sep 2011 13:23:35	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	803,520	2,781,360	3.4615
06 Sep 2011 21:55:02	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	777,600	2,738,198	3.5213
06 Sep 2011 06:10:33	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	751,680	2,694,944	3.5852
10 Aug 2011 12:33:41	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	725,760	1,315,627	1.8128
27 Jul 2011 22:31:29	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	699,840	1,267,831	1.8116
25 Jul 2011 23:04:36	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	673,920	1,221,493	1.8125
25 Jul 2011 22:24:14	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	648,000	1,177,847	1.8177
25 Jul 2011 21:43:59	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	622,080	1,134,214	1.8233
25 Jul 2011 20:46:34	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	596,160	1,089,868	1.8281
25 Jul 2011 19:47:12	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	570,240	1,042,293	1.8278
25 Jul 2011 19:40:29	1104596	13022314	hadcm3n_t2qe_1940_40_007314793_0	544,320	994,717	1.8274