Task 13014734

Name	hadcm3n_t25g_1940_40_007311582_2
Workunit	7509012
Created	28 Jun 2011, 0:48:21 UTC
Sent	28 Jun 2011, 0:48:28 UTC
Report deadline	27 Sep 2011, 8:15:39 UTC
Received	18 Jul 2011, 12:30:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1059489
Run time	7 days 22 hours 40 min 42 sec
CPU time	7 days 18 hours 25 min 4 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	2.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 21:00:16 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:45:17 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CreateFile error 32 when trying set file time cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35708, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35708, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35708, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35708, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35708, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file E:\Application Data\BOINC/projects/climateprediction.net/hadcm3n_t25g_1940_40_007311582/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=35708, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 16:42:51	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	388,800	640,350	1.6470
25 Jul 2011 16:13:48	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	362,880	596,500	1.6438
25 Jul 2011 14:55:36	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	336,960	552,920	1.6409
08 Jul 2011 03:41:52	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	311,040	509,748	1.6389
07 Jul 2011 18:32:02	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	285,120	475,302	1.6670
07 Jul 2011 15:39:15	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	259,200	441,119	1.7018
07 Jul 2011 15:39:15	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	233,280	404,348	1.7333
05 Jul 2011 04:57:23	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	207,360	364,928	1.7599
03 Jul 2011 23:46:57	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	181,440	318,242	1.7540
03 Jul 2011 01:57:29	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	155,520	270,580	1.7398
01 Jul 2011 11:59:57	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	129,600	225,117	1.7370
30 Jun 2011 23:24:23	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	103,680	180,610	1.7420
30 Jun 2011 11:41:31	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	77,760	136,323	1.7531
29 Jun 2011 03:01:28	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	51,840	90,901	1.7535
28 Jun 2011 14:12:22	1059489	13014734	hadcm3n_t25g_1940_40_007311582_2	25,920	45,450	1.7535