Task 15855261

Name	hadcm3n_zlwd_1960_40_008393579_0
Workunit	8544438
Created	21 Jun 2013, 22:56:01 UTC
Sent	22 Jun 2013, 23:03:03 UTC
Report deadline	22 Sep 2013, 6:30:14 UTC
Received	14 Aug 2013, 20:40:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1377383
Run time	7 days 18 hours 0 min 12 sec
CPU time	5 days 13 hours 34 min 19 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	2.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zlwdko.dag3aj0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zlwdko.dag6250 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... 02:52:43 (13416): No heartbeat from core client for 30 sec - exiting 02:52:44 (13416): No heartbeat from core client for 30 sec - exiting 02:52:45 (13416): No heartbeat from core client for 30 sec - exiting 02:52:46 (13416): No heartbeat from core client for 30 sec - exiting 02:52:47 (13416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:51:48 (4748): No heartbeat from core client for 30 sec - exiting 05:51:49 (4748): No heartbeat from core client for 30 sec - exiting 05:51:50 (4748): No heartbeat from core client for 30 sec - exiting 05:51:51 (4748): No heartbeat from core client for 30 sec - exiting 05:51:52 (4748): No heartbeat from core client for 30 sec - exiting 05:51:53 (4748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:06:59 (11236): No heartbeat from core client for 30 sec - exiting 17:07:01 (11236): No heartbeat from core client for 30 sec - exiting 17:07:02 (11236): No heartbeat from core client for 30 sec - exiting 17:07:03 (11236): No heartbeat from core client for 30 sec - exiting 17:07:04 (11236): No heartbeat from core client for 30 sec - exiting 17:07:05 (11236): No heartbeat from core client for 30 sec - exiting 17:07:06 (11236): No heartbeat from core client for 30 sec - exiting 17:07:07 (11236): No heartbeat from core client for 30 sec - exiting 17:07:08 (11236): No heartbeat from core client for 30 sec - exiting 17:07:09 (11236): No heartbeat from core client for 30 sec - exiting 17:07:10 (11236): No heartbeat from core client for 30 sec - exiting 17:07:11 (11236): No heartbeat from core client for 30 sec - exiting 17:07:12 (11236): No heartbeat from core client for 30 sec - exiting 17:07:13 (11236): No heartbeat from core client for 30 sec - exiting 17:07:14 (11236): No heartbeat from core client for 30 sec - exiting 17:07:15 (11236): No heartbeat from core client for 30 sec - exiting 17:07:16 (11236): No heartbeat from core client for 30 sec - exiting 17:07:17 (11236): No heartbeat from core client for 30 sec - exiting 17:07:18 (11236): No heartbeat from core client for 30 sec - exiting 17:07:19 (11236): No heartbeat from core client for 30 sec - exiting 17:07:20 (11236): No heartbeat from core client for 30 sec - exiting 17:07:21 (11236): No heartbeat from core client for 30 sec - exiting 17:07:22 (11236): No heartbeat from core client for 30 sec - exiting 17:07:23 (11236): No heartbeat from core client for 30 sec - exiting 17:07:24 (11236): No heartbeat from core client for 30 sec - exiting 17:07:25 (11236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:02:03 (7856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4388, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4388, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2732, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4064, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:16:15 (11404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:10:55 (9676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:10:56 (9676): No heartbeat from core client for 30 sec - exiting 07:46:01 (9044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:02 (9044): No heartbeat from core client for 30 sec - exiting 07:48:53 (4324): No heartbeat from core client for 30 sec - exiting 07:48:54 (4324): No heartbeat from core client for 30 sec - exiting 07:48:55 (4324): No heartbeat from core client for 30 sec - exiting 07:48:57 (4324): No heartbeat from core client for 30 sec - exiting 07:48:58 (4324): No heartbeat from core client for 30 sec - exiting 07:48:59 (4324): No heartbeat from core client for 30 sec - exiting 07:49:00 (4324): No heartbeat from core client for 30 sec - exiting 07:49:01 (4324): No heartbeat from core client for 30 sec - exiting 07:49:02 (4324): No heartbeat from core client for 30 sec - exiting 07:49:03 (4324): No heartbeat from core client for 30 sec - exiting 07:49:04 (4324): No heartbeat from core client for 30 sec - exiting 07:49:05 (4324): No heartbeat from core client for 30 sec - exiting 07:49:06 (4324): No heartbeat from core client for 30 sec - exiting 07:49:07 (4324): No heartbeat from core client for 30 sec - exiting 07:49:08 (4324): No heartbeat from core client for 30 sec - exiting 07:49:09 (4324): No heartbeat from core client for 30 sec - exiting 07:49:10 (4324): No heartbeat from core client for 30 sec - exiting 07:49:11 (4324): No heartbeat from core client for 30 sec - exiting 07:49:12 (4324): No heartbeat from core client for 30 sec - exiting 07:49:13 (4324): No heartbeat from core client for 30 sec - exiting 07:49:14 (4324): No heartbeat from core client for 30 sec - exiting 07:49:15 (4324): No heartbeat from core client for 30 sec - exiting 07:49:16 (4324): No heartbeat from core client for 30 sec - exiting 07:49:17 (4324): No heartbeat from core client for 30 sec - exiting 07:49:18 (4324): No heartbeat from core client for 30 sec - exiting 07:49:19 (4324): No heartbeat from core client for 30 sec - exiting 07:49:20 (4324): No heartbeat from core client for 30 sec - exiting 07:49:21 (4324): No heartbeat from core client for 30 sec - exiting 07:49:22 (4324): No heartbeat from core client for 30 sec - exiting 07:49:23 (4324): No heartbeat from core client for 30 sec - exiting 07:49:24 (4324): No heartbeat from core client for 30 sec - exiting 07:49:25 (4324): No heartbeat from core client for 30 sec - exiting 07:49:26 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:27 (4324): No heartbeat from core client for 30 sec - exiting 03:52:00 (10156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:52:01 (10156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:52:46 (9424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:13:51 (11644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:15:15 (7032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:17:08 (4192): No heartbeat from core client for 30 sec - exiting 06:17:09 (4192): No heartbeat from core client for 30 sec - exiting 06:17:10 (4192): No heartbeat from core client for 30 sec - exiting 06:17:11 (4192): No heartbeat from core client for 30 sec - exiting 06:17:12 (4192): No heartbeat from core client for 30 sec - exiting 06:17:13 (4192): No heartbeat from core client for 30 sec - exiting 06:17:14 (4192): No heartbeat from core client for 30 sec - exiting 06:17:15 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:14:58 (11084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:15:41 (10484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:51:26 (10212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:38:49 (4516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:04:24 (10588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:17:34 (12280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:42 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:19:43 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:42:22 (1652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:32:50 (4680): No heartbeat from core client for 30 sec - exiting 03:32:51 (4680): No heartbeat from core client for 30 sec - exiting 03:32:52 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:34:38 (9716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:08:31 (11780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:09:41 (4868): No heartbeat from core client for 30 sec - exiting 06:09:42 (4868): No heartbeat from core client for 30 sec - exiting 06:09:43 (4868): No heartbeat from core client for 30 sec - exiting 06:09:44 (4868): No heartbeat from core client for 30 sec - exiting 06:09:45 (4868): No heartbeat from core client for 30 sec - exiting 06:09:46 (4868): No heartbeat from core client for 30 sec - exiting 06:09:47 (4868): No heartbeat from core client for 30 sec - exiting 06:09:48 (4868): No heartbeat from core client for 30 sec - exiting 06:09:49 (4868): No heartbeat from core client for 30 sec - exiting 06:09:50 (4868): No heartbeat from core client for 30 sec - exiting 06:09:51 (4868): No heartbeat from core client for 30 sec - exiting 06:09:52 (4868): No heartbeat from core client for 30 sec - exiting 06:09:53 (4868): No heartbeat from core client for 30 sec - exiting 06:09:54 (4868): No heartbeat from core client for 30 sec - exiting 06:09:56 (4868): No heartbeat from core client for 30 sec - exiting 06:09:58 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:15 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:16:51 (6268): No heartbeat from core client for 30 sec - exiting 09:16:52 (6268): No heartbeat from core client for 30 sec - exiting 09:16:53 (6268): No heartbeat from core client for 30 sec - exiting 09:16:54 (6268): No heartbeat from core client for 30 sec - exiting 09:16:55 (6268): No heartbeat from core client for 30 sec - exiting 09:16:56 (6268): No heartbeat from core client for 30 sec - exiting 09:16:57 (6268): No heartbeat from core client for 30 sec - exiting 09:16:58 (6268): No heartbeat from core client for 30 sec - exiting 09:16:59 (6268): No heartbeat from core client for 30 sec - exiting 09:17:00 (6268): No heartbeat from core client for 30 sec - exiting 09:17:01 (6268): No heartbeat from core client for 30 sec - exiting 09:17:02 (6268): No heartbeat from core client for 30 sec - exiting 09:17:03 (6268): No heartbeat from core client for 30 sec - exiting 09:17:04 (6268): No heartbeat from core client for 30 sec - exiting 09:17:05 (6268): No heartbeat from core client for 30 sec - exiting 09:17:06 (6268): No heartbeat from core client for 30 sec - exiting 09:17:07 (6268): No heartbeat from core client for 30 sec - exiting 09:17:08 (6268): No heartbeat from core client for 30 sec - exiting 09:17:09 (6268): No heartbeat from core client for 30 sec - exiting 09:17:10 (6268): No heartbeat from core client for 30 sec - exiting 09:17:11 (6268): No heartbeat from core client for 30 sec - exiting 09:17:12 (6268): No heartbeat from core client for 30 sec - exiting 09:17:13 (6268): No heartbeat from core client for 30 sec - exiting 09:17:14 (6268): No heartbeat from core client for 30 sec - exiting 09:17:15 (6268): No heartbeat from core client for 30 sec - exiting 09:17:16 (6268): No heartbeat from core client for 30 sec - exiting 09:17:17 (6268): No heartbeat from core client for 30 sec - exiting 09:17:18 (6268): No heartbeat from core client for 30 sec - exiting 09:17:19 (6268): No heartbeat from core client for 30 sec - exiting 09:17:20 (6268): No heartbeat from core client for 30 sec - exiting 09:17:21 (6268): No heartbeat from core client for 30 sec - exiting 09:17:22 (6268): No heartbeat from core client for 30 sec - exiting 09:17:23 (6268): No heartbeat from core client for 30 sec - exiting 09:17:24 (6268): No heartbeat from core client for 30 sec - exiting 09:17:25 (6268): No heartbeat from core client for 30 sec - exiting 09:17:26 (6268): No heartbeat from core client for 30 sec - exiting 09:17:27 (6268): No heartbeat from core client for 30 sec - exiting 09:17:28 (6268): No heartbeat from core client for 30 sec - exiting 09:17:29 (6268): No heartbeat from core client for 30 sec - exiting 09:17:30 (6268): No heartbeat from core client for 30 sec - exiting 09:17:31 (6268): No heartbeat from core client for 30 sec - exiting 09:17:32 (6268): No heartbeat from core client for 30 sec - exiting 09:17:33 (6268): No heartbeat from core client for 30 sec - exiting 09:17:34 (6268): No heartbeat from core client for 30 sec - exiting 09:17:35 (6268): No heartbeat from core client for 30 sec - exiting 09:17:36 (6268): No heartbeat from core client for 30 sec - exiting 09:17:37 (6268): No heartbeat from core client for 30 sec - exiting 09:17:38 (6268): No heartbeat from core client for 30 sec - exiting 09:17:39 (6268): No heartbeat from core client for 30 sec - exiting 09:17:40 (6268): No heartbeat from core client for 30 sec - exiting 09:17:41 (6268): No heartbeat from core client for 30 sec - exiting 09:17:42 (6268): No heartbeat from core client for 30 sec - exiting 09:17:43 (6268): No heartbeat from core client for 30 sec - exiting 09:17:45 (6268): No heartbeat from core client for 30 sec - exiting 09:17:46 (6268): No heartbeat from core client for 30 sec - exiting 09:17:47 (6268): No heartbeat from core client for 30 sec - exiting 09:17:48 (6268): No heartbeat from core client for 30 sec - exiting 09:17:49 (6268): No heartbeat from core client for 30 sec - exiting 09:17:50 (6268): No heartbeat from core client for 30 sec - exiting 09:17:51 (6268): No heartbeat from core client for 30 sec - exiting 09:17:52 (6268): No heartbeat from core client for 30 sec - exiting 09:17:53 (6268): No heartbeat from core client for 30 sec - exiting 09:17:54 (6268): No heartbeat from core client for 30 sec - exiting 09:17:55 (6268): No heartbeat from core client for 30 sec - exiting 09:17:56 (6268): No heartbeat from core client for 30 sec - exiting 09:17:57 (6268): No heartbeat from core client for 30 sec - exiting 09:17:58 (6268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:17:59 (6268): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9460, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9460, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jul 2013 13:03:44	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	233,280	444,727	1.9064
06 Jul 2013 05:16:40	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	207,360	396,050	1.9100
06 Jul 2013 04:13:45	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	181,440	348,377	1.9201
04 Jul 2013 14:11:58	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	155,520	300,368	1.9314
03 Jul 2013 09:47:38	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	129,600	252,147	1.9456
02 Jul 2013 12:08:18	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	103,680	201,862	1.9470
02 Jul 2013 12:08:18	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	77,760	150,328	1.9332
02 Jul 2013 10:56:25	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	51,840	99,401	1.9175
02 Jul 2013 10:19:36	859807	15855261	hadcm3n_zlwd_1960_40_008393579_0	25,920	49,633	1.9149