Task 15603942

Name	hadcm3n_zjan_1960_40_008282859_2
Workunit	8433994
Created	10 Feb 2013, 17:26:17 UTC
Sent	10 Feb 2013, 17:26:39 UTC
Report deadline	13 May 2013, 0:53:50 UTC
Received	17 Mar 2013, 18:30:10 UTC
Server state	Over
Outcome	Computation error
Client state	Aborted by user
Exit status	203 (0x000000CB) EXIT_ABORTED_VIA_GUI
Computer ID	1168062
Run time	4 days 0 hours 27 min 3 sec
CPU time	3 days 21 hours 42 min 51 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.66 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> aborted by user </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2816, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2932, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2936, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4532, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2572, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2924, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2924, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3008, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2988, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2956, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3000, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2876, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2920, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 09:57:00 (2952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:01 (2952): No heartbeat from core client for 30 sec - exiting 09:57:02 (2952): No heartbeat from core client for 30 sec - exiting 09:57:03 (2952): No heartbeat from core client for 30 sec - exiting 09:57:04 (2952): No heartbeat from core client for 30 sec - exiting 09:57:05 (2952): No heartbeat from core client for 30 sec - exiting 09:57:06 (2952): No heartbeat from core client for 30 sec - exiting 09:57:07 (2952): No heartbeat from core client for 30 sec - exiting 09:57:08 (2952): No heartbeat from core client for 30 sec - exiting 09:57:09 (2952): No heartbeat from core client for 30 sec - exiting 09:57:10 (2952): No heartbeat from core client for 30 sec - exiting BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 18:32:55 (2904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:56 (2904): No heartbeat from core client for 30 sec - exiting 18:32:57 (2904): No heartbeat from core client for 30 sec - exiting 18:32:58 (2904): No heartbeat from core client for 30 sec - exiting 18:32:59 (2904): No heartbeat from core client for 30 sec - exiting 18:33:00 (2904): No heartbeat from core client for 30 sec - exiting 18:34:31 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:26 (3012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:38:39 (6140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:38:40 (6140): No heartbeat from core client for 30 sec - exiting 18:38:41 (6140): No heartbeat from core client for 30 sec - exiting 18:38:42 (6140): No heartbeat from core client for 30 sec - exiting 18:38:43 (6140): No heartbeat from core client for 30 sec - exiting 18:38:44 (6140): No heartbeat from core client for 30 sec - exiting 18:38:45 (6140): No heartbeat from core client for 30 sec - exiting 18:38:46 (6140): No heartbeat from core client for 30 sec - exiting 18:38:47 (6140): No heartbeat from core client for 30 sec - exiting 18:38:48 (6140): No heartbeat from core client for 30 sec - exiting 18:38:49 (6140): No heartbeat from core client for 30 sec - exiting 18:40:18 (5904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:19 (5904): No heartbeat from core client for 30 sec - exiting 18:40:20 (5904): No heartbeat from core client for 30 sec - exiting 18:40:21 (5904): No heartbeat from core client for 30 sec - exiting 18:40:22 (5904): No heartbeat from core client for 30 sec - exiting 18:40:23 (5904): No heartbeat from core client for 30 sec - exiting 18:40:24 (5904): No heartbeat from core client for 30 sec - exiting 18:40:25 (5904): No heartbeat from core client for 30 sec - exiting 18:40:26 (5904): No heartbeat from core client for 30 sec - exiting 18:40:27 (5904): No heartbeat from core client for 30 sec - exiting 18:40:28 (5904): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2916, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Abort request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Mar 2013 17:31:11	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	233,280	337,304	1.4459
15 Mar 2013 19:24:40	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	207,360	300,385	1.4486
09 Mar 2013 17:10:49	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	181,440	263,077	1.4499
08 Mar 2013 11:12:17	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	155,520	227,993	1.4660
28 Feb 2013 17:54:29	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	129,600	189,288	1.4606
24 Feb 2013 10:56:15	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	103,680	148,779	1.4350
22 Feb 2013 13:50:17	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	77,760	112,624	1.4484
17 Feb 2013 17:31:22	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	51,840	75,502	1.4564
16 Feb 2013 11:24:28	1168062	15603942	hadcm3n_zjan_1960_40_008282859_2	25,920	38,093	1.4696