Task 15472352

Name	hadcm3n_zay8_1880_40_008255180_0
Workunit	8410304
Created	6 Dec 2012, 18:58:09 UTC
Sent	6 Dec 2012, 18:59:01 UTC
Report deadline	8 Mar 2013, 2:26:12 UTC
Received	1 Jan 2013, 2:15:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1254694
Run time	5 days 7 hours 0 min 15 sec
CPU time	4 days 23 hours 19 min 8 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:30:12 (4788): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/zay8ko.pj84c10 Error converting file to netcdf: dataout/zay8ko.pi84c10 Error converting file to netcdf: dataout/zay8ko.pf84c10 Error converting file to netcdf: dataout/zay8ka.ph84c10 Error converting file to netcdf: dataout/zay8ka.pg84c10 Error converting file to netcdf: dataout/zay8ka.pe84c10 Error converting file to netcdf: dataout/zay8ka.pd84c10 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:41:12 (824): No heartbeat from core client for 30 sec - exiting 08:41:13 (824): No heartbeat from core client for 30 sec - exiting 08:41:14 (824): No heartbeat from core client for 30 sec - exiting 08:41:15 (824): No heartbeat from core client for 30 sec - exiting 08:41:16 (824): No heartbeat from core client for 30 sec - exiting 08:41:17 (824): No heartbeat from core client for 30 sec - exiting 08:41:18 (824): No heartbeat from core client for 30 sec - exiting 08:41:19 (824): No heartbeat from core client for 30 sec - exiting 08:41:20 (824): No heartbeat from core client for 30 sec - exiting 08:41:21 (824): No heartbeat from core client for 30 sec - exiting 08:41:22 (824): No heartbeat from core client for 30 sec - exiting 08:41:23 (824): No heartbeat from core client for 30 sec - exiting 08:41:24 (824): No heartbeat from core client for 30 sec - exiting 08:41:25 (824): No heartbeat from core client for 30 sec - exiting 08:41:26 (824): No heartbeat from core client for 30 sec - exiting 08:41:27 (824): No heartbeat from core client for 30 sec - exiting 08:41:28 (824): No heartbeat from core client for 30 sec - exiting 08:41:29 (824): No heartbeat from core client for 30 sec - exiting 08:41:30 (824): No heartbeat from core client for 30 sec - exiting 08:41:31 (824): No heartbeat from core client for 30 sec - exiting 08:41:32 (824): No heartbeat from core client for 30 sec - exiting 08:41:33 (824): No heartbeat from core client for 30 sec - exiting 08:41:34 (824): No heartbeat from core client for 30 sec - exiting 08:41:35 (824): No heartbeat from core client for 30 sec - exiting 08:41:36 (824): No heartbeat from core client for 30 sec - exiting 08:41:37 (824): No heartbeat from core client for 30 sec - exiting 08:41:38 (824): No heartbeat from core client for 30 sec - exiting 08:41:39 (824): No heartbeat from core client for 30 sec - exiting 08:41:40 (824): No heartbeat from core client for 30 sec - exiting 08:41:41 (824): No heartbeat from core client for 30 sec - exiting 08:41:42 (824): No heartbeat from core client for 30 sec - exiting 08:41:43 (824): No heartbeat from core client for 30 sec - exiting 08:41:44 (824): No heartbeat from core client for 30 sec - exiting 08:41:45 (824): No heartbeat from core client for 30 sec - exiting 08:41:46 (824): No heartbeat from core client for 30 sec - exiting 08:41:47 (824): No heartbeat from core client for 30 sec - exiting 08:41:48 (824): No heartbeat from core client for 30 sec - exiting 08:41:49 (824): No heartbeat from core client for 30 sec - exiting 08:41:50 (824): No heartbeat from core client for 30 sec - exiting 08:41:51 (824): No heartbeat from core client for 30 sec - exiting 08:41:52 (824): No heartbeat from core client for 30 sec - exiting 08:41:53 (824): No heartbeat from core client for 30 sec - exiting 08:41:54 (824): No heartbeat from core client for 30 sec - exiting 08:41:55 (824): No heartbeat from core client for 30 sec - exiting 08:41:56 (824): No heartbeat from core client for 30 sec - exiting 08:41:57 (824): No heartbeat from core client for 30 sec - exiting 08:41:58 (824): No heartbeat from core client for 30 sec - exiting 08:41:59 (824): No heartbeat from core client for 30 sec - exiting 08:42:00 (824): No heartbeat from core client for 30 sec - exiting 08:42:01 (824): No heartbeat from core client for 30 sec - exiting 08:42:02 (824): No heartbeat from core client for 30 sec - exiting 08:42:03 (824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Jan 2013 01:19:46	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	233,280	425,505	1.8240
31 Dec 2012 03:52:27	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	207,360	392,936	1.8949
30 Dec 2012 19:48:31	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	181,440	360,305	1.9858
26 Dec 2012 23:32:22	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	155,520	308,624	1.9845
19 Dec 2012 12:37:39	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	129,600	256,671	1.9805
18 Dec 2012 00:35:15	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	103,680	204,899	1.9763
15 Dec 2012 21:57:00	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	77,760	158,057	2.0326
14 Dec 2012 18:34:35	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	51,840	103,513	1.9968
14 Dec 2012 18:34:35	1254694	15472352	hadcm3n_zay8_1880_40_008255180_0	25,920	51,643	1.9924