climateprediction.net home page
Task 18901869

Task 18901869

Name hadam3p_anz_w020_1991_1_010174228_0
Workunit 10128384
Created 12 Sep 2015, 19:40:46 UTC
Sent 13 Sep 2015, 8:02:15 UTC
Report deadline 25 Aug 2016, 13:22:15 UTC
Received 27 Sep 2015, 12:35:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1117572
Run time 4 days 12 hours 38 min 1 sec
CPU time 4 days 10 hours 48 min 3 sec
Validate state Invalid
Credit 4,484.28
Device peak FLOPS 3.32 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10
windows_intelx86
Stderr
<core_client_version>7.4.42</core_client_version>
<![CDATA[
<stderr_txt>
09:02:37 (7976): start_timer_thread(): CreateThread() failed, errno 0
09:02:39 (6940): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:10:12 (6384): start_timer_thread(): CreateThread() failed, errno 0
13:10:13 (1184): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:13:01 (352): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:53:01 (6908): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:55:09 (9164): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:26:58 (2072): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:29:36 (7992): start_timer_thread(): CreateThread() failed, errno 0
09:29:38 (4756): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:40:16 (980): start_timer_thread(): CreateThread() failed, errno 0
10:40:18 (8236): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:04:29 (2100): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:38:33 (404): start_timer_thread(): CreateThread() failed, errno 0
18:38:35 (6656): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:59:05 (9032): start_timer_thread(): CreateThread() failed, errno 0
18:59:06 (6152): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:23:44 (1420): start_timer_thread(): CreateThread() failed, errno 0
00:23:45 (8920): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:24:42 (6696): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:11:18 (3196): start_timer_thread(): CreateThread() failed, errno 0
05:11:19 (8212): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:39:12 (1288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:55:28 (8612): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:35:29 (8512): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:48:46 (7540): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:03:25 (7676): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:45:48 (7124): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:36:34 (7488): start_timer_thread(): CreateThread() failed, errno 0
08:36:35 (7916): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:42:46 (464): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:12:29 (7700): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:12:59 (648): start_timer_thread(): CreateThread() failed, errno 0
11:13:00 (6984): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:18:51 (5632): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:28:15 (8788): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:58:45 (8888): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:46:03 (6640): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:33:44 (8472): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:50:37 (7448): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:54:28 (7732): start_timer_thread(): CreateThread() failed, errno 0
01:54:30 (2880): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:14:15 (7944): start_timer_thread(): CreateThread() failed, errno 0
03:14:17 (8972): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:34:55 (8280): start_timer_thread(): CreateThread() failed, errno 0
04:34:57 (3312): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:18:29 (7028): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:48:51 (8808): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:38:59 (6500): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:55:32 (6028): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:03:07 (5172): start_timer_thread(): CreateThread() failed, errno 0
04:03:08 (7204): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:22:27 (2284): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:55:38 (3496): start_timer_thread(): CreateThread() failed, errno 0
09:55:39 (2168): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:57:34 (6576): start_timer_thread(): CreateThread() failed, errno 0
13:57:36 (8112): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:58:11 (6984): start_timer_thread(): CreateThread() failed, errno 0
19:58:13 (5976): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:42:42 (2016): start_timer_thread(): CreateThread() failed, errno 0
17:42:44 (6204): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:58:13 (1460): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:22:06 (8472): start_timer_thread(): CreateThread() failed, errno 0
04:22:08 (4012): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:20:09 (6620): start_timer_thread(): CreateThread() failed, errno 0
06:20:11 (8348): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:36:53 (6080): start_timer_thread(): CreateThread() failed, errno 0
06:36:55 (800): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:31:12 (2148): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:39:23 (2320): start_timer_thread(): CreateThread() failed, errno 0
12:39:24 (5428): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:03:44 (552): start_timer_thread(): CreateThread() failed, errno 0
13:03:46 (400): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:11:42 (5488): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:41:48 (1244): start_timer_thread(): CreateThread() failed, errno 0
14:41:50 (1552): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:55:50 (1496): start_timer_thread(): CreateThread() failed, errno 0
16:55:52 (8376): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:43:31 (3576): start_timer_thread(): CreateThread() failed, errno 0
02:43:33 (6888): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:47:01 (1556): start_timer_thread(): CreateThread() failed, errno 0
02:47:03 (4480): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:55:03 (1852): start_timer_thread(): CreateThread() failed, errno 0
02:55:05 (8060): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:00:40 (3972): start_timer_thread(): CreateThread() failed, errno 0
03:00:42 (7596): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:04:54 (1416): start_timer_thread(): CreateThread() failed, errno 0
03:04:56 (7828): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:10:00 (3244): start_timer_thread(): CreateThread() failed, errno 0
03:10:02 (6408): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:16:38 (4468): start_timer_thread(): CreateThread() failed, errno 0
03:16:40 (4056): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:23:56 (1884): start_timer_thread(): CreateThread() failed, errno 0
03:23:58 (2940): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:16:56 (2792): start_timer_thread(): CreateThread() failed, errno 0
05:16:58 (116): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:32:42 (6440): start_timer_thread(): CreateThread() failed, errno 0
05:32:43 (4480): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:52:51 (5808): start_timer_thread(): CreateThread() failed, errno 0
05:52:52 (5416): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:21:24 (3636): start_timer_thread(): CreateThread() failed, errno 0
06:21:26 (6024): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:25:09 (5036): start_timer_thread(): CreateThread() failed, errno 0
08:25:11 (7412): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:22:34 (3144): start_timer_thread(): CreateThread() failed, errno 0
10:22:35 (7996): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:41:13 (6408): start_timer_thread(): CreateThread() failed, errno 0
10:41:15 (7688): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:44:57 (5396): start_timer_thread(): CreateThread() failed, errno 0
12:44:58 (2400): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:54:55 (4872): start_timer_thread(): CreateThread() failed, errno 0
13:54:56 (6288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:16:18 (7104): start_timer_thread(): CreateThread() failed, errno 0
14:16:19 (3148): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:09:11 (3872): start_timer_thread(): CreateThread() failed, errno 0
18:09:12 (5420): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:11:53 (2952): start_timer_thread(): CreateThread() failed, errno 0
19:11:55 (6204): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:36:46 (6504): start_timer_thread(): CreateThread() failed, errno 0
22:36:47 (848): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:14:35 (4292): start_timer_thread(): CreateThread() failed, errno 0
01:14:36 (6976): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:02:23 (276): start_timer_thread(): CreateThread() failed, errno 0
04:02:24 (5884): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:25:40 (6764): start_timer_thread(): CreateThread() failed, errno 0
04:25:42 (5560): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:33:03 (4128): start_timer_thread(): CreateThread() failed, errno 0
04:33:04 (2124): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:36:41 (6508): start_timer_thread(): CreateThread() failed, errno 0
07:36:42 (7672): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:52:40 (1988): start_timer_thread(): CreateThread() failed, errno 0
07:52:42 (204): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:11:37 (7316): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7316, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3148, selfPID=7036, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Called boinc_finish

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>hadam3p_anz_w020_1991_1_010174228_0_10.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_w020_1991_1_010174228_0_11.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_anz_w020_1991_1_010174228_0_12.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Sep 2015 00:31:54 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 103,979 356,249 3.4262
26 Sep 2015 11:23:03 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 92,459 317,766 3.4368
25 Sep 2015 14:02:41 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 80,939 279,487 3.4531
22 Sep 2015 20:01:02 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 69,419 239,899 3.4558
16 Sep 2015 17:12:28 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 57,899 200,263 3.4588
15 Sep 2015 22:35:28 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 46,379 160,309 3.4565
15 Sep 2015 11:03:05 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 34,859 119,158 3.4183
14 Sep 2015 19:02:19 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 23,339 79,695 3.4147
14 Sep 2015 06:13:41 1117572 18901869 hadam3p_anz_w020_1991_1_010174228_0 11,819 40,608 3.4358


©2024 climateprediction.net