Task 13123887

Name	hadcm3n_yky6_1900_40_007360008_0
Workunit	7557438
Created	6 Jul 2011, 15:09:55 UTC
Sent	7 Jul 2011, 20:50:16 UTC
Report deadline	7 Oct 2011, 4:17:27 UTC
Received	27 Aug 2011, 23:33:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	833883
Run time	26 days 19 hours 22 min 59 sec
CPU time	21 days 1 hours 16 min 30 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:18:21 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:18:22 (6004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:47:02 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:03 (3420): No heartbeat from core client for 30 sec - exiting 05:47:04 (3420): No heartbeat from core client for 30 sec - exiting 05:47:05 (3420): No heartbeat from core client for 30 sec - exiting 05:47:06 (3420): No heartbeat from core client for 30 sec - exiting 05:47:07 (3420): No heartbeat from core client for 30 sec - exiting 05:47:08 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:19:36 (2992): No heartbeat from core client for 30 sec - exiting 03:19:37 (2992): No heartbeat from core client for 30 sec - exiting 03:19:38 (2992): No heartbeat from core client for 30 sec - exiting 03:19:39 (2992): No heartbeat from core client for 30 sec - exiting 03:19:40 (2992): No heartbeat from core client for 30 sec - exiting 03:19:41 (2992): No heartbeat from core client for 30 sec - exiting 03:19:42 (2992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4196, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5416, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5140, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=1 Model crash detected, will try to restart... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yky6ko.pja4c10 Error converting file to netcdf: dataout/yky6ko.pia4c10 Error converting file to netcdf: dataout/yky6ko.pfa4c10 Error converting file to netcdf: dataout/yky6ka.pha4c10 Error converting file to netcdf: dataout/yky6ka.pga4c10 Error converting file to netcdf: dataout/yky6ka.pea4c10 Error converting file to netcdf: dataout/yky6ka.pda4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:47:41 (6208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8020, iMonCtr=1 Model crash detected, will try to restart... 13:28:48 (884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2788, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6772, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5972, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6228, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6196, iMonCtr=1 Model crash detected, will try to restart... 09:23:38 (1296): No heartbeat from core client for 30 sec - exiting 09:23:40 (1296): No heartbeat from core client for 30 sec - exiting 09:23:41 (1296): No heartbeat from core client for 30 sec - exiting 09:23:42 (1296): No heartbeat from core client for 30 sec - exiting 09:23:43 (1296): No heartbeat from core client for 30 sec - exiting 09:23:44 (1296): No heartbeat from core client for 30 sec - exiting 09:23:45 (1296): No heartbeat from core client for 30 sec - exiting 09:23:46 (1296): No heartbeat from core client for 30 sec - exiting 09:23:47 (1296): No heartbeat from core client for 30 sec - exiting 09:23:48 (1296): No heartbeat from core client for 30 sec - exiting 09:23:49 (1296): No heartbeat from core client for 30 sec - exiting 09:23:51 (1296): No heartbeat from core client for 30 sec - exiting 09:23:52 (1296): No heartbeat from core client for 30 sec - exiting 09:23:53 (1296): No heartbeat from core client for 30 sec - exiting 09:23:54 (1296): No heartbeat from core client for 30 sec - exiting 09:23:55 (1296): No heartbeat from core client for 30 sec - exiting 09:23:56 (1296): No heartbeat from core client for 30 sec - exiting 09:23:57 (1296): No heartbeat from core client for 30 sec - exiting 09:23:58 (1296): No heartbeat from core client for 30 sec - exiting 09:23:59 (1296): No heartbeat from core client for 30 sec - exiting 09:24:00 (1296): No heartbeat from core client for 30 sec - exiting 09:24:02 (1296): No heartbeat from core client for 30 sec - exiting 09:24:03 (1296): No heartbeat from core client for 30 sec - exiting 09:24:04 (1296): No heartbeat from core client for 30 sec - exiting 09:24:05 (1296): No heartbeat from core client for 30 sec - exiting 09:24:06 (1296): No heartbeat from core client for 30 sec - exiting 09:24:07 (1296): No heartbeat from core client for 30 sec - exiting 09:24:08 (1296): No heartbeat from core client for 30 sec - exiting 09:24:09 (1296): No heartbeat from core client for 30 sec - exiting 09:24:10 (1296): No heartbeat from core client for 30 sec - exiting 09:24:11 (1296): No heartbeat from core client for 30 sec - exiting 09:24:12 (1296): No heartbeat from core client for 30 sec - exiting 09:24:14 (1296): No heartbeat from core client for 30 sec - exiting 09:24:15 (1296): No heartbeat from core client for 30 sec - exiting 09:24:16 (1296): No heartbeat from core client for 30 sec - exiting 09:24:17 (1296): No heartbeat from core client for 30 sec - exiting 09:24:18 (1296): No heartbeat from core client for 30 sec - exiting 09:24:19 (1296): No heartbeat from core client for 30 sec - exiting 09:24:20 (1296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... 05:24:30 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:31 (5200): No heartbeat from core client for 30 sec - exiting 05:24:32 (5200): No heartbeat from core client for 30 sec - exiting 05:24:33 (5200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6336, iMonCtr=1 Model crash detected, will try to restart... 09:14:29 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Aug 2011 22:31:28	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	518,400	1,818,970	3.5088
25 Aug 2011 16:14:58	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	492,480	1,727,793	3.5084
22 Aug 2011 20:27:56	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	466,560	1,633,143	3.5004
20 Aug 2011 17:21:13	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	440,640	1,545,930	3.5084
17 Aug 2011 20:23:01	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	414,720	1,454,865	3.5081
15 Aug 2011 14:02:52	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	388,800	1,363,976	3.5082
13 Aug 2011 01:37:45	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	362,880	1,271,095	3.5028
11 Aug 2011 01:10:32	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	336,960	1,181,027	3.5049
09 Aug 2011 01:21:11	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	311,040	1,092,063	3.5110
05 Aug 2011 22:14:07	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	285,120	996,406	3.4947
03 Aug 2011 12:46:13	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	259,200	896,990	3.4606
01 Aug 2011 11:29:28	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	233,280	804,290	3.4477
29 Jul 2011 23:47:11	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	207,360	716,157	3.4537
27 Jul 2011 20:59:36	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	181,440	627,902	3.4607
25 Jul 2011 22:46:50	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	155,520	542,180	3.4862
25 Jul 2011 21:03:00	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	129,600	449,496	3.4683
25 Jul 2011 18:01:39	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	103,680	359,694	3.4693
25 Jul 2011 15:42:11	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	77,760	267,155	3.4356
25 Jul 2011 14:07:10	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	51,840	176,825	3.4110
10 Jul 2011 20:28:40	833883	13123887	hadcm3n_yky6_1900_40_007360008_0	25,920	87,275	3.3671