Task 16603543

Name	hadcm3n_8d9j_1980_40_008726610_2
Workunit	8872588
Created	29 Apr 2014, 6:58:47 UTC
Sent	29 Apr 2014, 7:18:59 UTC
Report deadline	29 Jul 2014, 14:46:10 UTC
Received	23 Jun 2014, 12:25:09 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1290798
Run time	30 days 5 hours 45 min 19 sec
CPU time	27 days 19 hours 54 min 9 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5484, iMonCtr=1 Model crash detected, will try to restart... 20:44:46 (1528): No heartbeat from core client for 30 sec - exiting 20:44:47 (1528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:16:05 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:14:55 (252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7132, iMonCtr=1 Model crash detected, will try to restart... 20:11:25 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:28 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:59 (6356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6572, iMonCtr=1 Model crash detected, will try to restart... 19:47:43 (6372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2212, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3420, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4788, iMonCtr=1 Model crash detected, will try to restart... 02:34:31 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20896, iMonCtr=1 Model crash detected, will try to restart... 19:16:28 (1968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:19 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:09:41 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:19:55 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:13 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:07:22 (7748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:05 (5256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:22 (5220): No heartbeat from core client for 30 sec - exiting 21:11:23 (5220): No heartbeat from core client for 30 sec - exiting 21:11:25 (5220): No heartbeat from core client for 30 sec - exiting 21:11:26 (5220): No heartbeat from core client for 30 sec - exiting 21:11:27 (5220): No heartbeat from core client for 30 sec - exiting 21:11:28 (5220): No heartbeat from core client for 30 sec - exiting 21:11:29 (5220): No heartbeat from core client for 30 sec - exiting 21:11:30 (5220): No heartbeat from core client for 30 sec - exiting 21:11:31 (5220): No heartbeat from core client for 30 sec - exiting 21:11:32 (5220): No heartbeat from core client for 30 sec - exiting 21:11:33 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4836, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... 20:30:44 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4396, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4520, iMonCtr=1 Model crash detected, will try to restart... 19:56:32 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:45:00 (5324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:49 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:50 (5164): No heartbeat from core client for 30 sec - exiting 21:41:51 (5164): No heartbeat from core client for 30 sec - exiting 21:41:53 (5164): No heartbeat from core client for 30 sec - exiting 21:41:54 (5164): No heartbeat from core client for 30 sec - exiting 21:41:55 (5164): No heartbeat from core client for 30 sec - exiting 21:41:56 (5164): No heartbeat from core client for 30 sec - exiting 21:41:57 (5164): No heartbeat from core client for 30 sec - exiting 18:14:09 (5220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:40 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:41 (3924): No heartbeat from core client for 30 sec - exiting 03:50:42 (3924): No heartbeat from core client for 30 sec - exiting 03:50:43 (3924): No heartbeat from core client for 30 sec - exiting 03:50:44 (3924): No heartbeat from core client for 30 sec - exiting 03:50:45 (3924): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2200, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5584, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=420, iMonCtr=1 Model crash detected, will try to restart... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jun 2014 12:25:30	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	1,036,800	2,403,593	2.3183
20 Jun 2014 06:05:57	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	1,010,880	2,343,496	2.3183
18 Jun 2014 23:14:37	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	984,960	2,282,308	2.3172
17 Jun 2014 05:25:26	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	959,040	2,223,158	2.3181
16 Jun 2014 01:27:43	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	933,120	2,166,251	2.3215
15 Jun 2014 00:55:37	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	907,200	2,106,587	2.3221
14 Jun 2014 07:43:58	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	881,280	2,047,218	2.3230
12 Jun 2014 07:04:13	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	855,360	1,987,596	2.3237
10 Jun 2014 23:31:06	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	829,440	1,924,036	2.3197
10 Jun 2014 09:03:02	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	803,520	1,866,123	2.3224
10 Jun 2014 09:01:36	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	777,600	1,808,408	2.3256
10 Jun 2014 02:15:15	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	751,680	1,746,998	2.3241
06 Jun 2014 05:52:20	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	725,760	1,681,394	2.3167
05 Jun 2014 02:28:52	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	699,840	1,622,810	2.3188
03 Jun 2014 20:28:47	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	673,920	1,561,698	2.3173
02 Jun 2014 01:35:52	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	648,000	1,497,861	2.3115
31 May 2014 13:30:00	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	622,080	1,439,556	2.3141
30 May 2014 05:51:20	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	596,160	1,379,816	2.3145
29 May 2014 02:05:13	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	570,240	1,319,588	2.3141
28 May 2014 08:16:15	1290798	16603543	hadcm3n_8d9j_1980_40_008726610_2	544,320	1,258,128	2.3114