Task 16201723

Name	hadcm3n_oa1u_1900_40_008468149_1
Workunit	8618988
Created	4 Jan 2014, 19:06:44 UTC
Sent	4 Jan 2014, 19:06:50 UTC
Report deadline	6 Apr 2014, 2:34:01 UTC
Received	8 Mar 2014, 21:39:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1263143
Run time	12 days 8 hours 37 min 17 sec
CPU time	11 days 13 hours 42 min 29 sec
Validate state	Invalid
Credit	9,020.16
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:18:45 (300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:38:46 (6872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8568, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8568, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8568, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8568, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8568, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8568, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8052, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2014 12:46:05	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	751,680	998,856	1.3288
07 Mar 2014 17:22:23	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	725,760	965,614	1.3305
04 Mar 2014 00:12:37	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	699,840	932,037	1.3318
03 Mar 2014 13:53:38	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	673,920	898,220	1.3328
02 Mar 2014 11:38:15	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	648,000	864,040	1.3334
01 Mar 2014 11:39:36	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	622,080	829,407	1.3333
26 Feb 2014 22:08:29	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	596,160	791,465	1.3276
25 Feb 2014 02:13:31	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	570,240	754,005	1.3223
24 Feb 2014 11:29:16	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	544,320	718,994	1.3209
23 Feb 2014 22:12:38	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	518,400	683,821	1.3191
23 Feb 2014 22:12:38	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	492,480	649,590	1.3190
23 Feb 2014 22:12:38	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	466,560	615,568	1.3194
21 Feb 2014 19:30:40	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	440,640	581,836	1.3204
21 Feb 2014 19:30:40	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	414,720	547,300	1.3197
18 Feb 2014 12:01:45	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	388,800	513,549	1.3209
15 Feb 2014 19:46:34	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	362,880	479,516	1.3214
14 Feb 2014 22:10:06	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	336,960	445,758	1.3229
12 Feb 2014 11:42:02	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	311,040	412,609	1.3265
09 Feb 2014 15:02:13	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	285,120	379,606	1.3314
09 Feb 2014 05:35:00	1263143	16201723	hadcm3n_oa1u_1900_40_008468149_1	259,200	346,248	1.3358