climateprediction.net home page
Task 20084365

Task 20084365

Name wah2_wus25_t1co_19959_25_479_010796578_0
Workunit 10796578
Created 1 Dec 2016, 10:29:58 UTC
Sent 1 Dec 2016, 10:33:18 UTC
Report deadline 13 Nov 2017, 15:53:18 UTC
Received 16 Jan 2017, 22:49:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 1401332
Run time 7 days 15 hours 54 min 5 sec
CPU time 7 days 12 hours 52 min 30 sec
Validate state Invalid
Credit 17,498.26
Device peak FLOPS 2.86 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 190.21 MB
Peak swap size 166.29 MB
Peak disk usage 11.28 MB
Stderr 
<core_client_version>7.6.9</core_client_version>
<![CDATA[
<message>
too many exit(0)s
</message>
<stderr_txt>
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=11380, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15344, selfPID=19772, iMonCtr=1
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14292, selfPID=9312, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12512, selfPID=21976, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19932, selfPID=7264, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19584, selfPID=20796, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8036, selfPID=8036, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8036, selfPID=13224, iMonCtr=1
14:28:59 (16228): start_timer_thread(): CreateThread() failed, errno 0
14:29:01 (14968): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16228, selfPID=14968, iMonCtr=1
17:43:36 (8024): start_timer_thread(): CreateThread() failed, errno 0
17:43:38 (21556): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8024, selfPID=21556, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2420, selfPID=17144, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13060, selfPID=17776, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10552, selfPID=10552, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10552, selfPID=16464, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24120, selfPID=24120, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24120, selfPID=12860, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
20:21:46 (19272): start_timer_thread(): CreateThread() failed, errno 0
20:21:48 (19540): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16848, selfPID=17004, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16848, selfPID=16848, iMonCtr=1
13:53:50 (23528): start_timer_thread(): CreateThread() failed, errno 0
13:53:52 (19188): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23528, selfPID=19188, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23528, selfPID=23528, iMonCtr=1
18:09:55 (12816): start_timer_thread(): CreateThread() failed, errno 0
18:09:57 (25940): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:39:51 (24720): start_timer_thread(): CreateThread() failed, errno 0
19:39:53 (20248): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24720, selfPID=24720, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24720, selfPID=20248, iMonCtr=1
12:33:59 (14276): start_timer_thread(): CreateThread() failed, errno 0
12:34:01 (10840): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14276, selfPID=14276, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14276, selfPID=10840, iMonCtr=1
20:09:58 (20760): start_timer_thread(): CreateThread() failed, errno 0
20:09:59 (9076): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20760, selfPID=9076, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20760, selfPID=20760, iMonCtr=1
09:07:37 (11388): start_timer_thread(): CreateThread() failed, errno 0
09:07:39 (24212): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11388, selfPID=24212, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11388, selfPID=11388, iMonCtr=1
21:50:18 (10332): start_timer_thread(): CreateThread() failed, errno 0
21:50:20 (696): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10332, selfPID=10332, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10332, selfPID=696, iMonCtr=1
06:04:21 (4948): start_timer_thread(): CreateThread() failed, errno 0
06:04:23 (25764): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4948, selfPID=25764, iMonCtr=1
20:00:30 (19900): start_timer_thread(): CreateThread() failed, errno 0
20:00:31 (11484): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19900, selfPID=11484, iMonCtr=1
11:40:01 (21128): start_timer_thread(): CreateThread() failed, errno 0
11:40:03 (25372): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
21:30:55 (9916): start_timer_thread(): CreateThread() failed, errno 0
21:30:57 (5992): start_timer_thread(): CreateThread() failed, errno 0
12:36:42 (23228): start_timer_thread(): CreateThread() failed, errno 0
12:36:44 (9860): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23228, selfPID=9860, iMonCtr=1
15:30:14 (15120): start_timer_thread(): CreateThread() failed, errno 0
15:30:15 (12044): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15120, selfPID=15120, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15120, selfPID=12044, iMonCtr=1
18:35:16 (13680): start_timer_thread(): CreateThread() failed, errno 0
18:35:18 (31668): start_timer_thread(): CreateThread() failed, errno 0
07:50:55 (23728): start_timer_thread(): CreateThread() failed, errno 0
07:50:56 (27696): start_timer_thread(): CreateThread() failed, errno 0
11:14:55 (11400): start_timer_thread(): CreateThread() failed, errno 0
11:14:57 (22092): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11400, selfPID=22092, iMonCtr=1
12:19:37 (8884): start_timer_thread(): CreateThread() failed, errno 0
12:19:38 (22708): start_timer_thread(): CreateThread() failed, errno 0
10:50:51 (5704): start_timer_thread(): CreateThread() failed, errno 0
10:50:53 (21076): start_timer_thread(): CreateThread() failed, errno 0
11:37:16 (24176): start_timer_thread(): CreateThread() failed, errno 0
11:37:17 (19852): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=24176, selfPID=19852, iMonCtr=1
14:48:48 (13428): start_timer_thread(): CreateThread() failed, errno 0
14:48:49 (23492): start_timer_thread(): CreateThread() failed, errno 0
19:47:40 (19644): start_timer_thread(): CreateThread() failed, errno 0
19:47:41 (15460): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19644, selfPID=15460, iMonCtr=1
21:56:22 (2828): start_timer_thread(): CreateThread() failed, errno 0
21:56:23 (27112): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2828, selfPID=27112, iMonCtr=1
08:26:21 (14644): start_timer_thread(): CreateThread() failed, errno 0
08:26:23 (21920): start_timer_thread(): CreateThread() failed, errno 0
14:33:01 (9248): start_timer_thread(): CreateThread() failed, errno 0
14:33:02 (5192): start_timer_thread(): CreateThread() failed, errno 0
21:05:46 (7428): start_timer_thread(): CreateThread() failed, errno 0
21:05:47 (17004): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7428, selfPID=17004, iMonCtr=1
17:20:21 (29972): start_timer_thread(): CreateThread() failed, errno 0
17:20:23 (18808): start_timer_thread(): CreateThread() failed, errno 0
17:26:11 (16788): start_timer_thread(): CreateThread() failed, errno 0
17:26:12 (15596): start_timer_thread(): CreateThread() failed, errno 0
09:03:11 (17956): start_timer_thread(): CreateThread() failed, errno 0
09:03:12 (14632): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
17:24:16 (11400): start_timer_thread(): CreateThread() failed, errno 0
17:24:17 (15680): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11400, selfPID=11400, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11400, selfPID=15680, iMonCtr=1
21:32:33 (17696): start_timer_thread(): CreateThread() failed, errno 0
21:32:34 (15532): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17696, selfPID=15532, iMonCtr=1
07:25:26 (14384): start_timer_thread(): CreateThread() failed, errno 0
07:25:28 (13152): start_timer_thread(): CreateThread() failed, errno 0
17:04:05 (14928): start_timer_thread(): CreateThread() failed, errno 0
17:04:06 (19568): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9204, selfPID=15648, iMonCtr=1
07:48:15 (13232): start_timer_thread(): CreateThread() failed, errno 0
07:48:16 (14644): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13232, selfPID=14644, iMonCtr=1
10:01:24 (8204): start_timer_thread(): CreateThread() failed, errno 0
10:01:26 (20560): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8204, selfPID=20560, iMonCtr=1
20:35:00 (17500): start_timer_thread(): CreateThread() failed, errno 0
20:35:01 (20452): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17500, selfPID=20452, iMonCtr=1
07:38:50 (19740): start_timer_thread(): CreateThread() failed, errno 0
07:38:52 (11360): start_timer_thread(): CreateThread() failed, errno 0
20:53:43 (4248): start_timer_thread(): CreateThread() failed, errno 0
20:53:44 (20532): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4248, selfPID=4248, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4248, selfPID=20532, iMonCtr=1
08:17:32 (13424): start_timer_thread(): CreateThread() failed, errno 0
08:17:34 (18008): start_timer_thread(): CreateThread() failed, errno 0
10:43:11 (23832): start_timer_thread(): CreateThread() failed, errno 0
10:43:13 (17632): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23832, selfPID=17632, iMonCtr=1
16:08:16 (22292): start_timer_thread(): CreateThread() failed, errno 0
16:08:17 (1548): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22292, selfPID=1548, iMonCtr=1
17:35:33 (12372): start_timer_thread(): CreateThread() failed, errno 0
17:35:35 (20376): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12372, selfPID=20376, iMonCtr=1
09:50:21 (18864): start_timer_thread(): CreateThread() failed, errno 0
09:50:22 (12196): start_timer_thread(): CreateThread() failed, errno 0
19:07:34 (6324): start_timer_thread(): CreateThread() failed, errno 0
19:07:36 (5652): start_timer_thread(): CreateThread() failed, errno 0
09:31:15 (11492): start_timer_thread(): CreateThread() failed, errno 0
09:31:17 (9704): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11492, selfPID=9704, iMonCtr=1
11:12:16 (1372): start_timer_thread(): CreateThread() failed, errno 0
11:12:17 (11380): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1372, selfPID=11380, iMonCtr=1
10:27:44 (16248): start_timer_thread(): CreateThread() failed, errno 0
10:27:45 (16940): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:39:35 (8360): start_timer_thread(): CreateThread() failed, errno 0
10:39:37 (13780): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8360, selfPID=8360, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8360, selfPID=13780, iMonCtr=1
16:23:06 (9908): start_timer_thread(): CreateThread() failed, errno 0
16:23:08 (13824): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9908, selfPID=13824, iMonCtr=1
20:37:33 (13984): start_timer_thread(): CreateThread() failed, errno 0
20:37:35 (15556): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13984, selfPID=15556, iMonCtr=1
09:01:37 (13296): start_timer_thread(): CreateThread() failed, errno 0
09:01:39 (6252): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13296, selfPID=6252, iMonCtr=1
15:08:52 (14628): start_timer_thread(): CreateThread() failed, errno 0
15:08:54 (19008): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
17:49:26 (15800): start_timer_thread(): CreateThread() failed, errno 0
17:49:27 (16592): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15800, selfPID=15800, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15800, selfPID=16592, iMonCtr=1
09:32:13 (3844): start_timer_thread(): CreateThread() failed, errno 0
09:32:15 (2252): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3844, selfPID=2252, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3844, selfPID=3844, iMonCtr=1
21:10:53 (14036): start_timer_thread(): CreateThread() failed, errno 0
21:10:55 (16516): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14036, selfPID=16516, iMonCtr=1
22:17:58 (15672): start_timer_thread(): CreateThread() failed, errno 0
22:18:00 (16092): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
22:59:06 (13996): start_timer_thread(): CreateThread() failed, errno 0
22:59:07 (2696): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13996, selfPID=2696, iMonCtr=1
11:12:56 (14212): start_timer_thread(): CreateThread() failed, errno 0
11:12:57 (16696): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=14212, selfPID=16696, iMonCtr=1
18:53:56 (6524): start_timer_thread(): CreateThread() failed, errno 0
18:53:58 (14540): start_timer_thread(): CreateThread() failed, errno 0
21:15:02 (20668): start_timer_thread(): CreateThread() failed, errno 0
21:15:04 (23504): start_timer_thread(): CreateThread() failed, errno 0
08:56:29 (21684): start_timer_thread(): CreateThread() failed, errno 0
08:56:31 (10564): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=21684, selfPID=10564, iMonCtr=1
14:04:12 (1028): start_timer_thread(): CreateThread() failed, errno 0
14:04:13 (204): start_timer_thread(): CreateThread() failed, errno 0
15:39:05 (3256): start_timer_thread(): CreateThread() failed, errno 0
15:39:06 (22100): start_timer_thread(): CreateThread() failed, errno 0
19:33:16 (6440): start_timer_thread(): CreateThread() failed, errno 0
19:33:18 (3444): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:38:36 (16328): start_timer_thread(): CreateThread() failed, errno 0
15:38:37 (19948): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16328, selfPID=16328, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16328, selfPID=19948, iMonCtr=1
23:16:42 (22976): start_timer_thread(): CreateThread() failed, errno 0
23:16:44 (23664): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22976, selfPID=23664, iMonCtr=1
16:25:47 (21016): start_timer_thread(): CreateThread() failed, errno 0
16:25:48 (15192): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=20528, selfPID=20916, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4948, selfPID=9828, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4948, selfPID=4948, iMonCtr=1
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19080, selfPID=19080, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=19080, selfPID=19464, iMonCtr=1
00:24:03 (17344): start_timer_thread(): CreateThread() failed, errno 0
00:24:05 (2496): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=17344, selfPID=2496, iMonCtr=1
06:16:40 (16444): start_timer_thread(): CreateThread() failed, errno 0
06:16:41 (9880): start_timer_thread(): CreateThread() failed, errno 0
06:42:56 (10444): start_timer_thread(): CreateThread() failed, errno 0
06:42:57 (20436): start_timer_thread(): CreateThread() failed, errno 0
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10444, selfPID=0, iMonCtr=1
06:43:02 (16468): start_timer_thread(): CreateThread() failed, errno 0
06:43:39 (22428): start_timer_thread(): CreateThread() failed, errno 0
06:44:28 (13968): start_timer_thread(): CreateThread() failed, errno 0
06:45:30 (13764): start_timer_thread(): CreateThread() failed, errno 0
06:45:39 (12168): start_timer_thread(): CreateThread() failed, errno 0
06:46:55 (14964): start_timer_thread(): CreateThread() failed, errno 0

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Jan 2017 12:37:12 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 265,259 624,187 2.3531
08 Jan 2017 06:37:30 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 253,739 595,682 2.3476
06 Jan 2017 03:42:38 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 242,219 567,669 2.3436
04 Jan 2017 01:17:57 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 230,699 540,368 2.3423
01 Jan 2017 01:05:41 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 219,179 513,005 2.3406
28 Dec 2016 11:43:07 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 207,659 485,826 2.3395
27 Dec 2016 02:17:10 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 196,139 459,514 2.3428
25 Dec 2016 10:52:26 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 184,619 432,759 2.3441
24 Dec 2016 10:52:55 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 173,099 406,255 2.3470
23 Dec 2016 09:03:28 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 161,579 379,266 2.3472
22 Dec 2016 14:23:03 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 150,059 352,283 2.3476
21 Dec 2016 12:36:01 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 138,539 324,989 2.3458
20 Dec 2016 13:49:03 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 127,019 297,858 2.3450
18 Dec 2016 14:08:45 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 115,499 271,789 2.3532
18 Dec 2016 05:46:16 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 103,979 245,618 2.3622
16 Dec 2016 05:38:18 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 92,459 219,665 2.3758
13 Dec 2016 11:14:51 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 80,939 192,254 2.3753
11 Dec 2016 14:22:55 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 69,419 164,889 2.3753
11 Dec 2016 07:29:51 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 57,899 138,475 2.3917
10 Dec 2016 14:54:33 1401332 20084365 wah2_wus25_t1co_19959_25_479_010796578_0 46,379 110,832 2.3897


©2024 climateprediction.net