Task 13287701

Name	hadcm3n_p2ak_1940_40_007420002_1
Workunit	7617637
Created	24 Aug 2011, 20:51:06 UTC
Sent	24 Aug 2011, 20:51:23 UTC
Report deadline	24 Nov 2011, 4:18:34 UTC
Received	21 Sep 2011, 18:34:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1088309
Run time	15 days 1 hours 14 min 5 sec
CPU time	11 days 14 hours 12 min 45 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/p2akko.pje3c10 Error converting file to netcdf: dataout/p2akko.pie3c10 Error converting file to netcdf: dataout/p2akko.pfe3c10 Error converting file to netcdf: dataout/p2akka.phe3c10 Error converting file to netcdf: dataout/p2akka.pge3c10 Error converting file to netcdf: dataout/p2akka.pee3c10 Error converting file to netcdf: dataout/p2akka.pde3c10 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/p2akko.pje4c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3808, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4576, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3860, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3248, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1524, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Sep 2011 18:31:47	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	518,400	1,001,553	1.9320
20 Sep 2011 11:40:04	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	492,480	951,905	1.9329
19 Sep 2011 00:11:42	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	466,560	902,674	1.9347
17 Sep 2011 20:42:14	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	440,640	853,065	1.9360
16 Sep 2011 16:04:07	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	414,720	803,362	1.9371
15 Sep 2011 13:33:08	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	388,800	754,299	1.9401
13 Sep 2011 18:44:23	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	362,880	703,064	1.9375
12 Sep 2011 14:53:48	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	336,960	651,871	1.9346
11 Sep 2011 11:51:22	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	311,040	602,878	1.9383
10 Sep 2011 01:30:28	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	285,120	551,943	1.9358
09 Sep 2011 01:50:48	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	259,200	501,363	1.9343
07 Sep 2011 01:30:24	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	233,280	454,321	1.9475
03 Sep 2011 12:52:10	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	207,360	405,381	1.9550
02 Sep 2011 02:34:32	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	181,440	356,990	1.9675
01 Sep 2011 01:35:41	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	155,520	307,034	1.9742
30 Aug 2011 15:36:53	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	129,600	256,010	1.9754
29 Aug 2011 12:24:28	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	103,680	207,620	2.0025
28 Aug 2011 02:03:18	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	77,760	157,370	2.0238
27 Aug 2011 03:29:54	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	51,840	106,896	2.0620
25 Aug 2011 22:18:13	1088309	13287701	hadcm3n_p2ak_1940_40_007420002_1	25,920	54,200	2.0910