Task 19325465

Name	hadcm3n_xbaf_198012_480_351_010332671_1
Workunit	10332671
Created	6 Mar 2016, 6:54:33 UTC
Sent	6 Mar 2016, 6:54:55 UTC
Report deadline	16 Feb 2017, 12:14:55 UTC
Received	30 Mar 2016, 6:48:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1376512
Run time	5 days 2 hours 16 min 12 sec
CPU time	3 days 17 hours 52 min 23 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6624, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4736, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/xbafko.pji5c10 Error converting file to netcdf: dataout/xbafko.pii5c10 Error converting file to netcdf: dataout/xbafko.pfi5c10 Error converting file to netcdf: dataout/xbafka.phi5c10 Error converting file to netcdf: dataout/xbafka.pgi5c10 Error converting file to netcdf: dataout/xbafka.pei5c10 Error converting file to netcdf: dataout/xbafka.pdi5c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8772, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:57:09 (7632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:57:11 (7632): No heartbeat from core client for 30 sec - exiting 16:57:12 (7632): No heartbeat from core client for 30 sec - exiting 16:57:13 (7632): No heartbeat from core client for 30 sec - exiting 16:57:14 (7632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C11:07:53 (4440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1168, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:39:16 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:21 (5656): No heartbeat from core client for 30 sec - exiting 14:39:24 (5656): No heartbeat from core client for 30 sec - exiting 14:39:25 (5656): No heartbeat from core client for 30 sec - exiting 14:39:26 (5656): No heartbeat from core client for 30 sec - exiting 14:39:27 (5656): No heartbeat from core client for 30 sec - exiting 14:39:28 (5656): No heartbeat from core client for 30 sec - exiting 14:39:29 (5656): No heartbeat from core client for 30 sec - exiting 14:39:30 (5656): No heartbeat from core client for 30 sec - exiting 14:39:31 (5656): No heartbeat from core client for 30 sec - exiting 14:39:32 (5656): No heartbeat from core client for 30 sec - exiting 14:39:33 (5656): No heartbeat from core client for 30 sec - exiting 14:39:34 (5656): No heartbeat from core client for 30 sec - exiting 14:39:35 (5656): No heartbeat from core client for 30 sec - exiting 14:39:36 (5656): No heartbeat from core client for 30 sec - exiting 14:39:37 (5656): No heartbeat from core client for 30 sec - exiting 14:39:38 (5656): No heartbeat from core client for 30 sec - exiting 14:39:39 (5656): No heartbeat from core client for 30 sec - exiting 14:39:40 (5656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Mar 2016 05:50:45	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	259,200	323,540	1.2482
27 Mar 2016 16:59:03	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	233,280	293,368	1.2576
25 Mar 2016 11:53:17	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	207,360	263,465	1.2706
22 Mar 2016 12:33:12	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	181,440	233,610	1.2875
20 Mar 2016 09:01:34	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	155,520	203,762	1.3102
18 Mar 2016 08:42:44	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	129,600	173,576	1.3393
15 Mar 2016 04:56:14	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	103,680	143,578	1.3848
15 Mar 2016 04:56:14	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	77,760	113,473	1.4593
15 Mar 2016 04:56:14	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	51,840	83,536	1.6114
15 Mar 2016 04:56:14	1376512	19325465	hadcm3n_xbaf_198012_480_351_010332671_1	25,920	53,517	2.0647