Task 19038960

Name	hadcm3n_xdf6_1940_40_010021177_2
Workunit	10019248
Created	26 Oct 2015, 17:29:34 UTC
Sent	26 Oct 2015, 17:29:39 UTC
Report deadline	26 Jan 2016, 0:56:50 UTC
Received	8 Nov 2015, 6:13:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1356861
Run time	6 days 1 hours 51 min 51 sec
CPU time	4 days 21 hours 4 min 43 sec
Validate state	Invalid
Credit	3,732.48
Device peak FLOPS	3.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.4.42</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2556, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6184, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6360, iMonCtr=1 Model crash detected, will try to restart... 19:57:51 (6720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:07:14 (13572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:39 (11200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:40 (11200): No heartbeat from core client for 30 sec - exiting 13:52:41 (11200): No heartbeat from core client for 30 sec - exiting 13:52:45 (24588): Can't acquire lockfile (32) - waiting 35s Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=24588, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3692, iMonCtr=1 Model crash detected, will try to restart... 10:18:09 (8684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4252, iMonCtr=1 Model crash detected, will try to restart... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Nov 2015 05:13:43	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	311,040	435,105	1.3989
05 Nov 2015 22:42:51	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	285,120	393,332	1.3795
05 Nov 2015 22:42:51	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	259,200	355,620	1.3720
05 Nov 2015 22:42:51	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	233,280	318,194	1.3640
05 Nov 2015 14:24:14	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	207,360	282,830	1.3640
05 Nov 2015 14:23:31	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	181,440	248,472	1.3694
05 Nov 2015 14:21:45	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	155,520	211,664	1.3610
05 Nov 2015 14:20:23	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	129,600	176,543	1.3622
05 Nov 2015 14:19:25	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	103,680	141,595	1.3657
05 Nov 2015 14:18:08	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	77,760	107,325	1.3802
05 Nov 2015 14:13:59	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	51,840	72,757	1.4035
05 Nov 2015 14:10:45	1356861	19038960	hadcm3n_xdf6_1940_40_010021177_2	25,920	37,990	1.4657