climateprediction.net home page
Task 20805982

Task 20805982

Name wah2_pnw25_rlq8_200412_24_666_011289779_1
Workunit 11289779
Created 7 Oct 2017, 8:12:32 UTC
Sent 18 Oct 2017, 7:30:58 UTC
Report deadline 30 Sep 2018, 12:50:58 UTC
Received 30 Oct 2017, 1:20:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1411769
Run time 3 days 4 hours 33 min 46 sec
CPU time 2 days 17 hours 59 min 9 sec
Validate state Invalid
Credit 14,458.52
Device peak FLOPS 4.47 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 179.90 MB
Peak swap size 166.14 MB
Peak disk usage 0.03 MB
Stderr
<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:17:21 (12912): start_timer_thread(): CreateThread() failed, errno 0
20:17:23 (4560): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:12:31 (12000): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:47:52 (5592): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:58:29 (13228): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:21:51 (25076): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:15:29 (33912): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:17:30 (24928): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:05:15 (29980): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:28:25 (36060): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:06:00 (29800): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:19:29 (14288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:26:40 (43768): start_timer_thread(): CreateThread() failed, errno 0
07:26:42 (43080): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:22:20 (38672): start_timer_thread(): CreateThread() failed, errno 0
13:22:21 (42864): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:23:39 (43460): start_timer_thread(): CreateThread() failed, errno 0
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16

CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:47:17 (26564): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:06:58 (24580): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:15:19 (23700): start_timer_thread(): CreateThread() failed, errno 0
11:15:20 (30328): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:31:14 (31872): start_timer_thread(): CreateThread() failed, errno 0
11:31:16 (32320): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:54:58 (5252): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:05:16 (1728): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:07:11 (10176): start_timer_thread(): CreateThread() failed, errno 0
13:07:13 (3152): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:24:01 (29360): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:36:26 (10440): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:56:46 (7688): start_timer_thread(): CreateThread() failed, errno 0
13:56:48 (22940): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:06:13 (41684): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:16:02 (9516): start_timer_thread(): CreateThread() failed, errno 0
14:16:04 (17544): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:21:31 (13932): start_timer_thread(): CreateThread() failed, errno 0
14:21:32 (21332): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:35:42 (41488): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:38:54 (41672): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:55:25 (912): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:58:55 (37400): start_timer_thread(): CreateThread() failed, errno 0
14:58:56 (32332): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:02:39 (7184): start_timer_thread(): CreateThread() failed, errno 0
15:02:40 (37504): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:36:32 (21592): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:52:14 (15468): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:59:03 (17004): start_timer_thread(): CreateThread() failed, errno 0
15:59:05 (40256): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:02:34 (28804): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:07:43 (24992): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:11:47 (41792): start_timer_thread(): CreateThread() failed, errno 0
16:11:48 (42200): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:49:47 (12216): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:04:33 (14568): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:09:15 (29612): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:13:20 (2748): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:22:46 (35676): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:28:37 (28408): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:38:05 (42148): start_timer_thread(): CreateThread() failed, errno 0
17:38:07 (8392): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:46:06 (41992): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:54:56 (11164): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:03:00 (13292): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:07:25 (20212): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:58:15 (16836): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:07:18 (31436): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:19:24 (38564): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:27:03 (38600): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:36:52 (12880): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:47:58 (38284): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:55:38 (6812): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:02:10 (13680): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:05:57 (25248): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:12:46 (20600): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:15:51 (11120): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:21:34 (25620): start_timer_thread(): CreateThread() failed, errno 0
22:21:35 (33768): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:38:00 (4864): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:48:47 (42280): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:53:08 (40840): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:57:05 (37812): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:42:48 (18452): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:55:15 (4092): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:28:22 (16512): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:01:23 (11032): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:10:22 (12340): start_timer_thread(): CreateThread() failed, errno 0
09:10:23 (5780): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:25:20 (24988): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:18:39 (10288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:32:29 (1240): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:59:50 (23084): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:23:08 (37164): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:35:26 (21516): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:04:06 (28304): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:23:03 (42504): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:38:53 (14648): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:46:07 (39276): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:01:57 (31904): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:05:34 (38696): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:25:36 (30116): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:40:12 (34028): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:47:42 (25048): start_timer_thread(): CreateThread() failed, errno 0
16:47:43 (20108): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:00:02 (31696): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:08:28 (21536): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:23:49 (26588): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:49:49 (39796): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:55:58 (16576): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:01:02 (26108): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:57:10 (18436): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:02:50 (13680): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:29:29 (23524): start_timer_thread(): CreateThread() failed, errno 0
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16

CPDN Monitor - Quit request from BOINC...
20:51:40 (9108): start_timer_thread(): CreateThread() failed, errno 0
20:51:41 (23500): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:00:34 (15628): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:24:19 (22796): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:30:38 (39324): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:09:24 (14404): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:11:04 (21072): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:35:07 (19388): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:13:43 (29460): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:17:37 (35104): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:21:15 (16604): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:34:11 (8488): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15144, selfPID=15144, iMonCtr=2
01:28:26 (36024): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:36:13 (3352): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:15:22 (27984): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:31:14 (25940): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:09:02 (15860): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:03:38 (1032): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:55:55 (11216): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:49:56 (37980): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:37:46 (34432): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:52:45 (3516): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:24:35 (19992): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:28:21 (28560): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:47:02 (7224): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:34:45 (41280): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:10:45 (17464): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:23:19 (33340): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:05:31 (37340): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 63 - Return code = 16

GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
GCM : BUFFIN: C I/O Error feof - Unit 64 - Return code = 16

RCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16
RCM : BUFFIN: C I/O Error feof - Unit 61 - Return code = 16


Model crashed: 
Leaving CPDN_ain::Monitor...
19:57:31 (31356): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_pnw25_rlq8_200412_24_666_011289779_1_r1193282691_20.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_rlq8_200412_24_666_011289779_1_r1193282691_21.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_rlq8_200412_24_666_011289779_1_r1193282691_22.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_rlq8_200412_24_666_011289779_1_r1193282691_23.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_rlq8_200412_24_666_011289779_1_r1193282691_24.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_pnw25_rlq8_200412_24_666_011289779_1_r1193282691_restart.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Oct 2017 01:22:11 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 219,179 237,154 1.0820
29 Oct 2017 20:36:24 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 207,659 223,833 1.0779
29 Oct 2017 13:27:14 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 196,139 210,726 1.0744
29 Oct 2017 09:16:53 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 184,619 198,388 1.0746
29 Oct 2017 03:50:24 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 173,099 186,043 1.0748
28 Oct 2017 23:17:30 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 161,579 173,269 1.0723
28 Oct 2017 17:29:52 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 150,059 160,506 1.0696
28 Oct 2017 11:00:52 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 138,539 148,019 1.0684
27 Oct 2017 17:16:10 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 127,019 135,869 1.0697
27 Oct 2017 11:23:20 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 115,499 123,391 1.0683
26 Oct 2017 23:45:10 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 103,979 110,997 1.0675
26 Oct 2017 11:40:18 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 92,459 99,067 1.0715
25 Oct 2017 17:41:13 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 80,939 87,091 1.0760
24 Oct 2017 18:28:35 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 69,419 74,815 1.0777
22 Oct 2017 12:52:59 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 57,899 62,204 1.0744
21 Oct 2017 12:01:38 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 46,379 49,422 1.0656
19 Oct 2017 10:42:58 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 34,859 36,902 1.0586
19 Oct 2017 05:20:04 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 23,339 24,914 1.0675
18 Oct 2017 13:14:07 1411769 20805982 wah2_pnw25_rlq8_200412_24_666_011289779_1 11,819 12,702 1.0747


©2024 climateprediction.net