Task 16274499

Name	hadcm3n_odmd_1900_40_008472776_2
Workunit	8623615
Created	21 Jan 2014, 4:53:39 UTC
Sent	21 Jan 2014, 4:53:49 UTC
Report deadline	22 Apr 2014, 12:21:00 UTC
Received	7 Feb 2014, 19:17:07 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1194844
Run time	12 days 11 hours 46 min 19 sec
CPU time	12 days 0 hours 21 min 27 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.78 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <stderr_txt> 11:45:59 (333248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:01 (333248): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:57:53 (332004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:32:50 (359916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:19 (394132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:00 (395436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:02 (398844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:55 (398904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:03 (399752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:55:24 (398964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:38 (403420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:11 (403104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:57 (403336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:01 (397864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:26:35 (402440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:22:12 (408464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:26 (398632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:39 (411408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:36:00 (412192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:23 (406756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:56 (410976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:55 (412544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:21 (413492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:00 (412772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:28 (412048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:36 (415028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:28 (414832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:58 (415624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:17:25 (415488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:24:52 (415904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:45 (413592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=414876, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=414876, iMonCtr=1 Model crash detected, will try to restart... 19:47:24 (6828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:13:05 (12136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:02:46 (15440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:02:49 (15440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:27:50 (57032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:09:01 (194036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:03 (194036): No heartbeat from core client for 30 sec - exiting 20:09:04 (194036): No heartbeat from core client for 30 sec - exiting 05:03:39 (250320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:41 (250320): No heartbeat from core client for 30 sec - exiting 05:03:43 (250320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:25:32 (136236): No heartbeat from core client for 30 sec - exiting 12:25:35 (136236): No heartbeat from core client for 30 sec - exiting 12:25:38 (136236): No heartbeat from core client for 30 sec - exiting 12:25:40 (136236): No heartbeat from core client for 30 sec - exiting 12:25:42 (136236): No heartbeat from core client for 30 sec - exiting 12:25:45 (136236): No heartbeat from core client for 30 sec - exiting 12:25:47 (136236): No heartbeat from core client for 30 sec - exiting 12:25:50 (136236): No heartbeat from core client for 30 sec - exiting 12:25:52 (136236): No heartbeat from core client for 30 sec - exiting 12:25:54 (136236): No heartbeat from core client for 30 sec - exiting 12:25:56 (136236): No heartbeat from core client for 30 sec - exiting 12:25:59 (136236): No heartbeat from core client for 30 sec - exiting 12:26:02 (136236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:04 (136236): No heartbeat from core client for 30 sec - exiting 12:26:05 (136236): No heartbeat from core client for 30 sec - exiting 12:26:08 (136236): No heartbeat from core client for 30 sec - exiting 12:26:10 (136236): No heartbeat from core client for 30 sec - exiting 12:26:13 (136236): No heartbeat from core client for 30 sec - exiting 12:26:15 (136236): No heartbeat from core client for 30 sec - exiting 12:26:17 (136236): No heartbeat from core client for 30 sec - exiting 12:26:20 (136236): No heartbeat from core client for 30 sec - exiting 12:26:22 (136236): No heartbeat from core client for 30 sec - exiting 12:26:24 (136236): No heartbeat from core client for 30 sec - exiting 12:26:26 (136236): No heartbeat from core client for 30 sec - exiting BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/odmdko.pjd6c10 Error converting file to netcdf: dataout/odmdko.pid6c10 Error converting file to netcdf: dataout/odmdko.pfd6c10 Error converting file to netcdf: dataout/odmdka.phd6c10 Error converting file to netcdf: dataout/odmdka.pgd6c10 Error converting file to netcdf: dataout/odmdka.ped6c10 Error converting file to netcdf: dataout/odmdka.pdd6c10 Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Feb 2014 18:17:25	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	1,036,800	1,037,692	1.0009
07 Feb 2014 11:05:40	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	1,010,880	1,011,410	1.0005
07 Feb 2014 02:59:17	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	984,960	985,254	1.0003
06 Feb 2014 20:07:58	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	959,040	959,156	1.0001
06 Feb 2014 11:41:00	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	933,120	933,032	0.9999
06 Feb 2014 04:44:44	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	907,200	906,977	0.9998
05 Feb 2014 20:17:54	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	881,280	880,938	0.9996
05 Feb 2014 12:36:38	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	855,360	854,855	0.9994
04 Feb 2014 17:12:18	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	829,440	829,636	1.0002
04 Feb 2014 09:49:15	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	803,520	804,335	1.0010
04 Feb 2014 02:22:53	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	777,600	778,622	1.0013
03 Feb 2014 19:01:22	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	751,680	752,846	1.0016
03 Feb 2014 11:31:41	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	725,760	726,956	1.0016
03 Feb 2014 04:00:20	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	699,840	700,930	1.0016
02 Feb 2014 20:33:50	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	673,920	675,082	1.0017
31 Jan 2014 18:08:42	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	648,000	649,215	1.0019
31 Jan 2014 10:34:29	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	622,080	623,043	1.0015
31 Jan 2014 08:03:38	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	596,160	597,046	1.0015
31 Jan 2014 08:03:38	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	570,240	571,358	1.0020
31 Jan 2014 08:03:38	1194844	16274499	hadcm3n_odmd_1900_40_008472776_2	544,320	545,728	1.0026