climateprediction.net home page
Task 21533285

Task 21533285

Name wah2_anz50_n2gh_201612_20_794_011765571_0
Workunit 11765571
Created 9 Mar 2019, 9:30:12 UTC
Sent 19 Mar 2019, 7:56:55 UTC
Report deadline 29 Feb 2020, 13:16:55 UTC
Received 20 Apr 2019, 2:00:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1476713
Run time 6 days 6 hours 39 min 22 sec
CPU time 5 days 23 hours 3 min 18 sec
Validate state Invalid
Credit 9,898.90
Device peak FLOPS 4.32 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 232.64 MB
Peak swap size 197.44 MB
Peak disk usage 44.01 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
00:55:40 (5752): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
00:55:41 (24156): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:28:05 (14980): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
12:28:06 (14980): called boinc_finish(193)
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:28:07 (8812): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
10:35:17 (8460): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
10:35:18 (9516): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
10:46:19 (2064): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
10:46:20 (5528): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
10:48:24 (5528): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
11:32:21 (9092): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
11:32:22 (6400): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
11:34:51 (6400): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
11:57:36 (9580): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
11:57:39 (11092): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
11:59:50 (11092): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:10:55 (14000): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:10:56 (10976): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:19:28 (5008): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:19:30 (3588): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:57:57 (13892): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:57:59 (16796): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
13:05:19 (16796): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
11:13:14 (20240): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
11:13:16 (19752): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:08:36 (16028): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:08:38 (20988): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:22:57 (3268): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:22:59 (17952): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:29:18 (18268): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:29:18 (17344): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:41:54 (16264): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
13:41:54 (16264): called boinc_finish(193)
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:41:55 (18316): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:46:38 (18056): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:46:39 (20840): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:22:03 (3536): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:22:04 (11380): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
14:03:05 (21432): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
14:03:06 (20328): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
14:05:22 (20328): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
14:11:32 (22280): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
14:11:33 (13788): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
14:36:25 (20288): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
14:36:26 (20288): called boinc_finish(193)
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
14:36:27 (17976): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
15:12:40 (5540): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
15:12:41 (15476): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
15:20:30 (16980): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
15:20:32 (21572): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:53:33 (11984): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:53:34 (17572): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
15:33:28 (18296): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
15:33:30 (19876): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:32:58 (18788): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
12:33:02 (6380): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
16:43:38 (13740): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
16:43:40 (15964): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:03:15 (9360): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
13:03:17 (16812): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
13:09:51 (16812): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
16:13:39 (18716): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
16:13:40 (224): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
16:20:48 (224): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
16:30:02 (19396): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
16:30:04 (13844): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
20:22:17 (12252): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
20:22:19 (22372): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22372, selfPID=22372, iMonCtr=2
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
17:00:08 (14424): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
17:00:10 (16516): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
20:55:54 (22452): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
20:55:55 (13440): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
21:57:40 (11196): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
21:57:42 (11624): start_timer_thread(): CreateThread() failed, errno 0
Signal 11 received: Segment violation
Signal 11 received: Software termination signal from kill 
Signal 11 received: Abnormal termination triggered by abort call
Signal 11 received, exiting...
22:04:53 (11624): called boinc_finish(193)
CPDN Monitor - Quit request from BOINC...
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
17:58:46 (6228): start_timer_thread(): CreateThread() failed, errno 0
diagnostics_init_unhandled_exception_monitor(): Creating hExceptionMonitorThread failed, errno 12
WARNING: BOINC Windows Runtime Debugger has been disabled.
17:58:57 (6776): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=6228, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6776, selfPID=6776, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6776, selfPID=17824, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
17:59:08 (17824): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_14.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_15.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_16.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_17.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_18.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_19.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_20.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_anz50_n2gh_201612_20_794_011765571_0_r767436216_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Apr 2019 19:12:14 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 150,059 485,319 3.2342
04 Apr 2019 06:25:41 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 138,539 442,258 3.1923
03 Apr 2019 16:12:23 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 127,019 399,480 3.1450
03 Apr 2019 03:47:02 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 115,499 357,133 3.0921
01 Apr 2019 11:37:40 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 103,979 320,407 3.0815
01 Apr 2019 01:41:53 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 92,459 285,654 3.0895
31 Mar 2019 11:55:12 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 80,939 244,977 3.0267
30 Mar 2019 23:19:26 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 69,419 202,088 2.9111
30 Mar 2019 11:39:25 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 57,899 166,762 2.8802
29 Mar 2019 23:42:56 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 46,379 126,102 2.7189
29 Mar 2019 14:17:35 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 34,859 102,442 2.9388
29 Mar 2019 00:45:47 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 23,339 56,461 2.4192
28 Mar 2019 11:21:20 1476713 21533285 wah2_anz50_n2gh_201612_20_794_011765571_0 11,819 36,584 3.0954


©2024 climateprediction.net