Task 13390139

Name	hadcm3n_o6wx_1900_40_007440674_3
Workunit	7638177
Created	15 Sep 2011, 20:41:11 UTC
Sent	20 Sep 2011, 3:41:19 UTC
Report deadline	20 Dec 2011, 11:08:30 UTC
Received	28 Oct 2011, 19:41:55 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1169893
Run time	21 days 11 hours 21 min 47 sec
CPU time	19 days 0 hours 59 min 37 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4304, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4232, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:50 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:51 (3772): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4208, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4208, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3660, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6208, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6208, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish 16:11:10 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:51:58 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 05:31:42 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:08 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:09:04 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:30:31 (11124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:32 (11124): No heartbeat from core client for 30 sec - exiting 21:30:33 (11124): No heartbeat from core client for 30 sec - exiting 21:30:34 (11124): No heartbeat from core client for 30 sec - exiting 21:30:35 (11124): No heartbeat from core client for 30 sec - exiting 21:30:36 (11124): No heartbeat from core client for 30 sec - exiting 21:30:37 (11124): No heartbeat from core client for 30 sec - exiting 21:30:38 (11124): No heartbeat from core client for 30 sec - exiting 21:30:39 (11124): No heartbeat from core client for 30 sec - exiting 21:30:40 (11124): No heartbeat from core client for 30 sec - exiting 21:30:41 (11124): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:13:20 (10416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13764, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:35:02 (29992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:03 (29992): No heartbeat from core client for 30 sec - exiting 12:35:04 (29992): No heartbeat from core client for 30 sec - exiting 12:35:05 (29992): No heartbeat from core client for 30 sec - exiting 12:35:06 (29992): No heartbeat from core client for 30 sec - exiting 12:35:07 (29992): No heartbeat from core client for 30 sec - exiting 12:35:08 (29992): No heartbeat from core client for 30 sec - exiting 12:35:09 (29992): No heartbeat from core client for 30 sec - exiting 12:35:10 (29992): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:38:34 (28200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:39:51 (1168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:50:51 (12684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:21:44 (9520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:31 (12876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 18:12:44	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	1,036,800	1,644,712	1.5863
31 Oct 2011 17:30:15	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	1,010,880	1,606,131	1.5888
31 Oct 2011 17:15:15	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	984,960	1,568,453	1.5924
31 Oct 2011 16:53:25	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	959,040	1,530,706	1.5961
31 Oct 2011 16:32:29	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	933,120	1,492,419	1.5994
31 Oct 2011 15:26:19	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	907,200	1,453,960	1.6027
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	881,280	1,415,047	1.6057
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	855,360	1,376,306	1.6090
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	829,440	1,336,945	1.6119
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	803,520	1,298,388	1.6159
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	777,600	1,259,737	1.6200
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	751,680	1,221,088	1.6245
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	725,760	1,182,379	1.6292
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	699,840	1,143,777	1.6343
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	673,920	1,104,828	1.6394
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	648,000	1,065,794	1.6447
31 Oct 2011 14:25:27	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	622,080	1,026,875	1.6507
19 Oct 2011 09:07:24	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	596,160	988,027	1.6573
18 Oct 2011 19:47:48	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	570,240	949,042	1.6643
18 Oct 2011 07:35:10	1169893	13390139	hadcm3n_o6wx_1900_40_007440674_3	544,320	910,014	1.6718