Task 19527028

Name	hadcm3n_sb1m_198012_480_375_010415082_1
Workunit	10415082
Created	9 Apr 2016, 20:52:08 UTC
Sent	9 Apr 2016, 20:52:20 UTC
Report deadline	23 Mar 2017, 2:12:20 UTC
Received	16 Apr 2016, 9:08:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1282816
Run time	3 days 15 hours 46 min 38 sec
CPU time	3 days 13 hours 10 min 11 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	4.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: severe (17): syntax error in NAMELIST input, unit 5, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_sb1m_198012_480_375_010415082/jobs/climate.cpdc, line 393, position 19 Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003CACB0 Unknown Unknown Unknown hadcm3n_um_6.07_i 00261D1E Unknown Unknown Unknown hadcm3n_um_6.07_i 0016269A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=78232, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Apr 2016 22:09:37	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	518,400	301,245	0.5811
15 Apr 2016 18:11:13	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	492,480	287,015	0.5828
15 Apr 2016 14:07:26	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	466,560	272,782	0.5847
15 Apr 2016 12:17:17	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	440,640	258,675	0.5870
15 Apr 2016 12:16:17	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	414,720	244,622	0.5898
15 Apr 2016 12:15:57	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	388,800	230,565	0.5930
15 Apr 2016 12:15:07	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	362,880	216,677	0.5971
15 Apr 2016 12:14:03	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	336,960	202,637	0.6014
15 Apr 2016 12:13:37	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	311,040	188,619	0.6064
15 Apr 2016 12:13:11	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	285,120	174,555	0.6122
15 Apr 2016 12:12:45	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	259,200	160,539	0.6194
15 Apr 2016 12:11:31	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	233,280	146,503	0.6280
15 Apr 2016 12:10:54	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	207,360	132,546	0.6392
15 Apr 2016 12:09:13	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	181,440	118,468	0.6529
15 Apr 2016 12:06:47	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	155,520	104,447	0.6716
11 Apr 2016 16:40:05	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	129,600	90,445	0.6979
11 Apr 2016 12:16:27	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	103,680	76,379	0.7367
11 Apr 2016 00:16:20	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	77,760	61,557	0.7916
10 Apr 2016 18:57:15	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	51,840	43,962	0.8480
10 Apr 2016 12:39:36	1282816	19527028	hadcm3n_sb1m_198012_480_375_010415082_1	25,920	22,633	0.8732