Task 17813769

Name	hadcm3n_sa2b_1940_40_009107446_1
Workunit	9237782
Created	21 Jan 2015, 21:11:28 UTC
Sent	21 Jan 2015, 22:39:50 UTC
Report deadline	23 Apr 2015, 6:07:01 UTC
Received	25 Feb 2015, 13:05:06 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1239305
Run time	9 days 20 hours 19 min 3 sec
CPU time	9 days 13 hours 50 min 45 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.21 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.47</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 20:15:06 (10948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:57 (10472): No heartbeat from core client for 30 sec - exiting 20:20:58 (10472): No heartbeat from core client for 30 sec - exiting 20:20:59 (10472): No heartbeat from core client for 30 sec - exiting 20:21:00 (10472): No heartbeat from core client for 30 sec - exiting 20:21:01 (10472): No heartbeat from core client for 30 sec - exiting 20:21:02 (10472): No heartbeat from core client for 30 sec - exiting 20:21:03 (10472): No heartbeat from core client for 30 sec - exiting 20:21:04 (10472): No heartbeat from core client for 30 sec - exiting 20:21:05 (10472): No heartbeat from core client for 30 sec - exiting 20:21:06 (10472): No heartbeat from core client for 30 sec - exiting 20:21:07 (10472): No heartbeat from core client for 30 sec - exiting 20:21:08 (10472): No heartbeat from core client for 30 sec - exiting 20:21:09 (10472): No heartbeat from core client for 30 sec - exiting 20:21:10 (10472): No heartbeat from core client for 30 sec - exiting 20:21:11 (10472): No heartbeat from core client for 30 sec - exiting 20:21:12 (10472): No heartbeat from core client for 30 sec - exiting 20:21:13 (10472): No heartbeat from core client for 30 sec - exiting 20:21:14 (10472): No heartbeat from core client for 30 sec - exiting 20:21:15 (10472): No heartbeat from core client for 30 sec - exiting 20:21:16 (10472): No heartbeat from core client for 30 sec - exiting 20:21:17 (10472): No heartbeat from core client for 30 sec - exiting 20:21:18 (10472): No heartbeat from core client for 30 sec - exiting 20:21:19 (10472): No heartbeat from core client for 30 sec - exiting 20:21:20 (10472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:48 (9860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:45:33 (9240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:25:24 (6504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:04 (3900): Can't acquire lockfile (32) - waiting 35s 22:36:39 (3900): Can't acquire lockfile (32) - exiting 22:36:44 (3900): Error: The process cannot access the file because it is being used by another process. (0x20) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9080, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6940, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6940, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3472, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:49:23 (6660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:08:39 (7448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:38:20 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:51 (18392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:09 (13988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:39 (16620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:56:38 (17352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:56:39 (17352): No heartbeat from core client for 30 sec - exiting 18:56:40 (17352): No heartbeat from core client for 30 sec - exiting 18:56:41 (17352): No heartbeat from core client for 30 sec - exiting 18:56:42 (17352): No heartbeat from core client for 30 sec - exiting 18:56:43 (17352): No heartbeat from core client for 30 sec - exiting 18:56:44 (17352): No heartbeat from core client for 30 sec - exiting 18:56:45 (17352): No heartbeat from core client for 30 sec - exiting 18:56:47 (17352): No heartbeat from core client for 30 sec - exiting 18:56:48 (17352): No heartbeat from core client for 30 sec - exiting 18:56:49 (17352): No heartbeat from core client for 30 sec - exiting 18:56:50 (17352): No heartbeat from core client for 30 sec - exiting 18:56:51 (17352): No heartbeat from core client for 30 sec - exiting 18:56:52 (17352): No heartbeat from core client for 30 sec - exiting 18:56:53 (17352): No heartbeat from core client for 30 sec - exiting 18:56:54 (17352): No heartbeat from core client for 30 sec - exiting 18:56:55 (17352): No heartbeat from core client for 30 sec - exiting 18:56:56 (17352): No heartbeat from core client for 30 sec - exiting 18:56:57 (17352): No heartbeat from core client for 30 sec - exiting 18:56:59 (17352): No heartbeat from core client for 30 sec - exiting 18:57:00 (17352): No heartbeat from core client for 30 sec - exiting 19:13:01 (9552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:21:46 (15292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:40 (15232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:40:05 (12776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:51:42 (2256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:03 (13572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:45:52 (7416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:45:53 (7416): No heartbeat from core client for 30 sec - exiting 15:45:54 (7416): No heartbeat from core client for 30 sec - exiting 15:45:55 (7416): No heartbeat from core client for 30 sec - exiting 15:45:56 (7416): No heartbeat from core client for 30 sec - exiting 15:45:57 (7416): No heartbeat from core client for 30 sec - exiting 15:45:58 (7416): No heartbeat from core client for 30 sec - exiting 15:45:59 (7416): No heartbeat from core client for 30 sec - exiting 15:46:01 (7416): No heartbeat from core client for 30 sec - exiting 15:46:02 (7416): No heartbeat from core client for 30 sec - exiting 15:46:03 (7416): No heartbeat from core client for 30 sec - exiting 15:46:04 (7416): No heartbeat from core client for 30 sec - exiting 15:56:54 (11520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:10:29 (25452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:16:29 (8796): No heartbeat from core client for 30 sec - exiting 16:16:30 (8796): No heartbeat from core client for 30 sec - exiting 16:16:31 (8796): No heartbeat from core client for 30 sec - exiting 16:16:33 (8796): No heartbeat from core client for 30 sec - exiting 16:16:34 (8796): No heartbeat from core client for 30 sec - exiting 16:16:35 (8796): No heartbeat from core client for 30 sec - exiting 16:16:36 (8796): No heartbeat from core client for 30 sec - exiting 16:16:37 (8796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:21:57 (24608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:33:55 (16972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:41:12 (12672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 16:43:55 (21692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:44:54 (21052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 16:57:53 (9620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:05:36 (7600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:14:09 (22648): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:06:44 (5732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:25 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:59:28 (10124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:26 (9620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:29:10 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 00:32:01 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:27:14 (5748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:19 (2916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... 01:42:29 (7116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:50:18 (440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:59:41 (8976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	1,036,800	827,138	0.7978
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	1,010,880	807,435	0.7987
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	984,960	787,739	0.7998
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	959,040	768,013	0.8008
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	933,120	748,345	0.8020
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	907,200	728,643	0.8032
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	881,280	708,933	0.8044
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	855,360	689,243	0.8058
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	829,440	669,565	0.8072
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	803,520	649,879	0.8088
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	777,600	630,419	0.8107
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	751,680	610,652	0.8124
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	725,760	590,843	0.8141
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	699,840	570,971	0.8159
24 Feb 2015 19:31:51	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	673,920	550,836	0.8174
19 Feb 2015 18:15:25	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	648,000	530,116	0.8181
19 Feb 2015 11:53:55	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	622,080	508,986	0.8182
19 Feb 2015 06:02:07	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	596,160	488,420	0.8193
19 Feb 2015 00:15:59	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	570,240	467,827	0.8204
18 Feb 2015 18:24:38	1239305	17813769	hadcm3n_sa2b_1940_40_009107446_1	544,320	447,115	0.8214