Task 14909600

Name	hadcm3n_o0k6_2060_40_008049310_3
Workunit	8204424
Created	13 Jul 2012, 1:16:45 UTC
Sent	13 Jul 2012, 1:24:48 UTC
Report deadline	12 Oct 2012, 8:51:59 UTC
Received	13 Aug 2012, 13:51:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1041512
Run time	24 days 14 hours 58 min 17 sec
CPU time	18 days 22 hours 18 min 57 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	2.77 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:26:08 (5624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:50 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:52 (6112): No heartbeat from core client for 30 sec - exiting 17:37:51 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:09:52 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:57:39 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0k6_2060_40_008049310/dataout/atmos_restart.day after 11 attempts forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0k6_2060_40_008049310/dataout/atmos_restart.day after 11 attempts forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0k6_2060_40_008049310/dataout/atmos_restart.day after 11 attempts forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0k6_2060_40_008049310/dataout/atmos_restart.day after 11 attempts forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0k6_2060_40_008049310/dataout/atmos_restart.day after 11 attempts forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o0k6_2060_40_008049310/dataout/atmos_restart.day after 11 attempts forrtl: Access is denied. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... Sorr </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Aug 2012 09:56:42	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	959,040	1,601,003	1.6694
08 Aug 2012 20:49:25	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	933,120	1,556,277	1.6678
08 Aug 2012 06:51:16	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	907,200	1,511,132	1.6657
07 Aug 2012 17:05:47	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	881,280	1,468,481	1.6663
07 Aug 2012 03:48:43	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	855,360	1,426,526	1.6677
06 Aug 2012 15:24:47	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	829,440	1,385,352	1.6702
06 Aug 2012 02:57:54	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	803,520	1,344,631	1.6734
05 Aug 2012 14:42:25	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	777,600	1,304,168	1.6772
05 Aug 2012 02:30:35	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	751,680	1,263,604	1.6810
04 Aug 2012 14:21:16	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	725,760	1,223,149	1.6853
03 Aug 2012 20:58:31	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	699,840	1,181,271	1.6879
03 Aug 2012 04:10:39	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	673,920	1,138,291	1.6891
02 Aug 2012 08:11:45	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	648,000	1,095,397	1.6904
01 Aug 2012 12:41:06	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	622,080	1,051,744	1.6907
31 Jul 2012 14:58:53	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	596,160	1,007,805	1.6905
29 Jul 2012 03:23:27	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	570,240	962,301	1.6875
28 Jul 2012 05:43:36	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	544,320	916,489	1.6837
27 Jul 2012 13:57:06	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	518,400	869,165	1.6766
26 Jul 2012 23:03:10	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	492,480	822,839	1.6708
26 Jul 2012 07:30:13	1041512	14909600	hadcm3n_o0k6_2060_40_008049310_3	466,560	776,831	1.6650