Task 15768197

Name	hadcm3n_4n1p_1980_40_008361202_0
Workunit	8512061
Created	9 May 2013, 13:57:50 UTC
Sent	9 May 2013, 13:57:54 UTC
Report deadline	8 Aug 2013, 21:25:05 UTC
Received	17 Jun 2013, 21:23:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	825037
Run time	13 days 7 hours 34 min 7 sec
CPU time	11 days 5 hours 31 min 48 sec
Validate state	Invalid
Credit	7,464.96
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:33:57 (28478): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jun 2013 08:20:48	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	622,080	954,988	1.5352
16 Jun 2013 11:57:09	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	596,160	915,903	1.5363
15 Jun 2013 19:42:55	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	570,240	876,747	1.5375
15 Jun 2013 04:22:59	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	544,320	837,925	1.5394
14 Jun 2013 14:00:45	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	518,400	798,508	1.5403
14 Jun 2013 01:34:03	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	492,480	758,973	1.5411
13 Jun 2013 13:10:34	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	466,560	719,569	1.5423
12 Jun 2013 21:07:54	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	440,640	680,050	1.5433
12 Jun 2013 03:38:46	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	414,720	640,249	1.5438
11 Jun 2013 09:18:26	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	388,800	600,119	1.5435
10 Jun 2013 15:20:39	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	362,880	561,104	1.5463
09 Jun 2013 16:58:20	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	336,960	523,406	1.5533
09 Jun 2013 04:38:04	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	311,040	485,194	1.5599
08 Jun 2013 16:42:25	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	285,120	446,074	1.5645
07 Jun 2013 22:18:07	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	259,200	408,293	1.5752
04 Jun 2013 20:38:42	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	233,280	369,666	1.5846
03 Jun 2013 01:07:32	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	207,360	330,178	1.5923
02 Jun 2013 12:55:10	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	181,440	290,194	1.5994
02 Jun 2013 00:25:38	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	155,520	250,540	1.6110
01 Jun 2013 11:30:23	825037	15768197	hadcm3n_4n1p_1980_40_008361202_0	129,600	211,263	1.6301