climateprediction.net home page
Task 16922994

Task 16922994

Name hadam3p_pnw_f0cs_2010_1_008895569_2
Workunit 9041352
Created 24 Aug 2014, 4:00:18 UTC
Sent 24 Aug 2014, 4:00:25 UTC
Report deadline 6 Aug 2015, 9:20:25 UTC
Received 1 Oct 2014, 12:30:00 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1233907
Run time 6 days 8 hours 40 min 37 sec
CPU time 6 days 2 hours 20 min 34 sec
Validate state Workunit error - check skipped
Credit 3,010.29
Device peak FLOPS 2.29 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v7.22
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3740, selfPID=3740, iMonCtr=2
23:28:59 (4936): No heartbeat from client for 30 sec - exiting
23:28:59 (4936): timer handler: client dead, exiting
23:29:00 (4936): No heartbeat from client for 30 sec - exiting
23:29:00 (4936): timer handler: client dead, exiting
23:29:01 (4936): No heartbeat from client for 30 sec - exiting
23:29:01 (4936): timer handler: client dead, exiting
23:29:02 (4936): No heartbeat from client for 30 sec - exiting
23:29:02 (4936): timer handler: client dead, exiting
23:29:03 (4936): No heartbeat from client for 30 sec - exiting
23:29:03 (4936): timer handler: client dead, exiting
23:29:04 (4936): No heartbeat from client for 30 sec - exiting
23:29:04 (4936): timer handler: client dead, exiting
23:29:05 (4936): No heartbeat from client for 30 sec - exiting
23:29:05 (4936): timer handler: client dead, exiting
23:29:06 (4936): No heartbeat from client for 30 sec - exiting
23:29:06 (4936): timer handler: client dead, exiting
23:29:07 (4936): No heartbeat from client for 30 sec - exiting
23:29:07 (4936): timer handler: client dead, exiting
23:29:08 (4936): No heartbeat from client for 30 sec - exiting
23:29:08 (4936): timer handler: client dead, exiting
23:29:09 (4936): No heartbeat from client for 30 sec - exiting
23:29:09 (4936): timer handler: client dead, exiting
23:29:10 (4936): No heartbeat from client for 30 sec - exiting
23:29:10 (4936): timer handler: client dead, exiting
23:29:11 (4936): No heartbeat from client for 30 sec - exiting
23:29:11 (4936): timer handler: client dead, exiting
23:29:12 (4936): No heartbeat from client for 30 sec - exiting
23:29:12 (4936): timer handler: client dead, exiting
23:29:13 (4936): No heartbeat from client for 30 sec - exiting
23:29:13 (4936): timer handler: client dead, exiting
23:29:14 (4936): No heartbeat from client for 30 sec - exiting
23:29:14 (4936): timer handler: client dead, exiting
23:29:15 (4936): No heartbeat from client for 30 sec - exiting
23:29:15 (4936): timer handler: client dead, exiting
23:29:16 (4936): No heartbeat from client for 30 sec - exiting
23:29:16 (4936): timer handler: client dead, exiting
23:29:17 (4936): No heartbeat from client for 30 sec - exiting
23:29:17 (4936): timer handler: client dead, exiting
23:29:18 (4936): No heartbeat from client for 30 sec - exiting
23:29:18 (4936): timer handler: client dead, exiting
23:29:19 (4936): No heartbeat from client for 30 sec - exiting
23:29:19 (4936): timer handler: client dead, exiting
23:29:20 (4936): No heartbeat from client for 30 sec - exiting
23:29:20 (4936): timer handler: client dead, exiting
23:29:21 (4936): No heartbeat from client for 30 sec - exiting
23:29:21 (4936): timer handler: client dead, exiting
23:29:22 (4936): No heartbeat from client for 30 sec - exiting
23:29:22 (4936): timer handler: client dead, exiting
23:29:23 (4936): No heartbeat from client for 30 sec - exiting
23:29:23 (4936): timer handler: client dead, exiting
23:29:24 (4936): No heartbeat from client for 30 sec - exiting
23:29:24 (4936): timer handler: client dead, exiting
23:29:25 (4936): No heartbeat from client for 30 sec - exiting
23:29:25 (4936): timer handler: client dead, exiting
23:29:26 (4936): No heartbeat from client for 30 sec - exiting
23:29:26 (4936): timer handler: client dead, exiting
23:29:27 (4936): No heartbeat from client for 30 sec - exiting
23:29:27 (4936): timer handler: client dead, exiting
23:29:28 (4936): No heartbeat from client for 30 sec - exiting
23:29:28 (4936): timer handler: client dead, exiting
23:29:29 (4936): No heartbeat from client for 30 sec - exiting
23:29:29 (4936): timer handler: client dead, exiting
23:29:30 (4936): No heartbeat from client for 30 sec - exiting
23:29:30 (4936): timer handler: client dead, exiting
23:29:31 (4936): No heartbeat from client for 30 sec - exiting
23:29:31 (4936): timer handler: client dead, exiting
23:29:32 (4936): No heartbeat from client for 30 sec - exiting
23:29:32 (4936): timer handler: client dead, exiting
23:29:33 (4936): No heartbeat from client for 30 sec - exiting
23:29:33 (4936): timer handler: client dead, exiting
23:29:34 (4936): No heartbeat from client for 30 sec - exiting
23:29:34 (4936): timer handler: client dead, exiting
23:29:35 (4936): No heartbeat from client for 30 sec - exiting
23:29:35 (4936): timer handler: client dead, exiting
23:29:36 (4936): No heartbeat from client for 30 sec - exiting
23:29:36 (4936): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4740, selfPID=336, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5492, selfPID=5492, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:52:11 (4588): No heartbeat from client for 30 sec - exiting
23:52:11 (4588): timer handler: client dead, exiting
23:52:12 (4588): No heartbeat from client for 30 sec - exiting
23:52:12 (4588): timer handler: client dead, exiting
23:52:13 (4588): No heartbeat from client for 30 sec - exiting
23:52:13 (4588): timer handler: client dead, exiting
23:52:14 (4588): No heartbeat from client for 30 sec - exiting
23:52:14 (4588): timer handler: client dead, exiting
23:52:15 (4588): No heartbeat from client for 30 sec - exiting
23:52:15 (4588): timer handler: client dead, exiting
23:52:16 (4588): No heartbeat from client for 30 sec - exiting
23:52:16 (4588): timer handler: client dead, exiting
23:52:17 (4588): No heartbeat from client for 30 sec - exiting
23:52:17 (4588): timer handler: client dead, exiting
23:52:18 (4588): No heartbeat from client for 30 sec - exiting
23:52:18 (4588): timer handler: client dead, exiting
23:52:19 (4588): No heartbeat from client for 30 sec - exiting
23:52:19 (4588): timer handler: client dead, exiting
23:52:20 (4588): No heartbeat from client for 30 sec - exiting
23:52:20 (4588): timer handler: client dead, exiting
23:52:21 (4588): No heartbeat from client for 30 sec - exiting
23:52:21 (4588): timer handler: client dead, exiting
23:52:22 (4588): No heartbeat from client for 30 sec - exiting
23:52:22 (4588): timer handler: client dead, exiting
23:52:23 (4588): No heartbeat from client for 30 sec - exiting
23:52:23 (4588): timer handler: client dead, exiting
23:52:24 (4588): No heartbeat from client for 30 sec - exiting
23:52:24 (4588): timer handler: client dead, exiting
23:52:25 (4588): No heartbeat from client for 30 sec - exiting
23:52:25 (4588): timer handler: client dead, exiting
23:52:26 (4588): No heartbeat from client for 30 sec - exiting
23:52:26 (4588): timer handler: client dead, exiting
23:52:27 (4588): No heartbeat from client for 30 sec - exiting
23:52:27 (4588): timer handler: client dead, exiting
23:52:28 (4588): No heartbeat from client for 30 sec - exiting
23:52:28 (4588): timer handler: client dead, exiting
23:52:29 (4588): No heartbeat from client for 30 sec - exiting
23:52:29 (4588): timer handler: client dead, exiting
23:52:30 (4588): No heartbeat from client for 30 sec - exiting
23:52:30 (4588): timer handler: client dead, exiting
23:52:31 (4588): No heartbeat from client for 30 sec - exiting
23:52:31 (4588): timer handler: client dead, exiting
23:52:32 (4588): No heartbeat from client for 30 sec - exiting
23:52:32 (4588): timer handler: client dead, exiting
23:52:33 (4588): No heartbeat from client for 30 sec - exiting
23:52:33 (4588): timer handler: client dead, exiting
23:52:34 (4588): No heartbeat from client for 30 sec - exiting
23:52:34 (4588): timer handler: client dead, exiting
23:52:35 (4588): No heartbeat from client for 30 sec - exiting
23:52:35 (4588): timer handler: client dead, exiting
23:52:36 (4588): No heartbeat from client for 30 sec - exiting
23:52:36 (4588): timer handler: client dead, exiting
23:52:37 (4588): No heartbeat from client for 30 sec - exiting
23:52:37 (4588): timer handler: client dead, exiting
23:52:38 (4588): No heartbeat from client for 30 sec - exiting
23:52:38 (4588): timer handler: client dead, exiting
23:52:39 (4588): No heartbeat from client for 30 sec - exiting
23:52:39 (4588): timer handler: client dead, exiting
23:52:40 (4588): No heartbeat from client for 30 sec - exiting
23:52:40 (4588): timer handler: client dead, exiting
23:52:41 (4588): No heartbeat from client for 30 sec - exiting
23:52:41 (4588): timer handler: client dead, exiting
23:52:42 (4588): No heartbeat from client for 30 sec - exiting
23:52:42 (4588): timer handler: client dead, exiting
23:52:43 (4588): No heartbeat from client for 30 sec - exiting
23:52:43 (4588): timer handler: client dead, exiting
23:52:44 (4588): No heartbeat from client for 30 sec - exiting
23:52:44 (4588): timer handler: client dead, exiting
23:52:45 (4588): No heartbeat from client for 30 sec - exiting
23:52:45 (4588): timer handler: client dead, exiting
23:52:46 (4588): No heartbeat from client for 30 sec - exiting
23:52:46 (4588): timer handler: client dead, exiting
23:52:47 (4588): No heartbeat from client for 30 sec - exiting
23:52:47 (4588): timer handler: client dead, exiting
23:52:48 (4588): No heartbeat from client for 30 sec - exiting
23:52:48 (4588): timer handler: client dead, exiting
23:52:49 (4588): No heartbeat from client for 30 sec - exiting
23:52:49 (4588): timer handler: client dead, exiting
23:52:50 (4588): No heartbeat from client for 30 sec - exiting
23:52:50 (4588): timer handler: client dead, exiting
23:52:51 (4588): No heartbeat from client for 30 sec - exiting
23:52:51 (4588): timer handler: client dead, exiting
23:52:52 (4588): No heartbeat from client for 30 sec - exiting
23:52:52 (4588): timer handler: client dead, exiting
23:52:53 (4588): No heartbeat from client for 30 sec - exiting
23:52:53 (4588): timer handler: client dead, exiting
23:52:54 (4588): No heartbeat from client for 30 sec - exiting
23:52:54 (4588): timer handler: client dead, exiting
23:52:55 (4588): No heartbeat from client for 30 sec - exiting
23:52:55 (4588): timer handler: client dead, exiting
23:52:56 (4588): No heartbeat from client for 30 sec - exiting
23:52:56 (4588): timer handler: client dead, exiting
23:52:57 (4588): No heartbeat from client for 30 sec - exiting
23:52:57 (4588): timer handler: client dead, exiting
23:52:58 (4588): No heartbeat from client for 30 sec - exiting
23:52:58 (4588): timer handler: client dead, exiting
23:52:59 (4588): No heartbeat from client for 30 sec - exiting
23:52:59 (4588): timer handler: client dead, exiting
23:53:00 (4588): No heartbeat from client for 30 sec - exiting
23:53:00 (4588): timer handler: client dead, exiting
23:53:01 (4588): No heartbeat from client for 30 sec - exiting
23:53:01 (4588): timer handler: client dead, exiting
23:53:02 (4588): No heartbeat from client for 30 sec - exiting
23:53:02 (4588): timer handler: client dead, exiting
23:53:03 (4588): No heartbeat from client for 30 sec - exiting
23:53:03 (4588): timer handler: client dead, exiting
23:53:04 (4588): No heartbeat from client for 30 sec - exiting
23:53:04 (4588): timer handler: client dead, exiting
23:53:05 (4588): No heartbeat from client for 30 sec - exiting
23:53:05 (4588): timer handler: client dead, exiting
23:53:06 (4588): No heartbeat from client for 30 sec - exiting
23:53:06 (4588): timer handler: client dead, exiting
23:53:07 (4588): No heartbeat from client for 30 sec - exiting
23:53:07 (4588): timer handler: client dead, exiting
23:53:08 (4588): No heartbeat from client for 30 sec - exiting
23:53:08 (4588): timer handler: client dead, exiting
23:53:09 (4588): No heartbeat from client for 30 sec - exiting
23:53:09 (4588): timer handler: client dead, exiting
23:53:10 (4588): No heartbeat from client for 30 sec - exiting
23:53:10 (4588): timer handler: client dead, exiting
23:53:11 (4588): No heartbeat from client for 30 sec - exiting
23:53:11 (4588): timer handler: client dead, exiting
23:53:12 (4588): No heartbeat from client for 30 sec - exiting
23:53:12 (4588): timer handler: client dead, exiting
23:53:13 (4588): No heartbeat from client for 30 sec - exiting
23:53:13 (4588): timer handler: client dead, exiting
23:53:14 (4588): No heartbeat from client for 30 sec - exiting
23:53:14 (4588): timer handler: client dead, exiting
23:53:15 (4588): No heartbeat from client for 30 sec - exiting
23:53:15 (4588): timer handler: client dead, exiting
23:53:16 (4588): No heartbeat from client for 30 sec - exiting
23:53:16 (4588): timer handler: client dead, exiting
23:53:17 (4588): No heartbeat from client for 30 sec - exiting
23:53:17 (4588): timer handler: client dead, exiting
23:53:18 (4588): No heartbeat from client for 30 sec - exiting
23:53:18 (4588): timer handler: client dead, exiting
23:53:19 (4588): No heartbeat from client for 30 sec - exiting
23:53:19 (4588): timer handler: client dead, exiting
23:53:20 (4588): No heartbeat from client for 30 sec - exiting
23:53:20 (4588): timer handler: client dead, exiting
23:53:21 (4588): No heartbeat from client for 30 sec - exiting
23:53:21 (4588): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3908, selfPID=3908, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2072, selfPID=2072, iMonCtr=2
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7252, selfPID=7252, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Leaving CPDN_Main::Monitor...
01:02:41 (7808): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Oct 2014 06:00:04 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 138,539 533,701 3.8524
29 Sep 2014 10:43:39 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 127,019 491,257 3.8676
28 Sep 2014 07:38:10 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 115,499 449,007 3.8875
25 Sep 2014 07:02:58 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 103,979 407,325 3.9174
22 Sep 2014 08:28:02 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 92,459 367,187 3.9713
20 Sep 2014 09:58:51 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 80,939 322,409 3.9834
19 Sep 2014 05:43:22 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 69,419 275,954 3.9752
17 Sep 2014 10:03:22 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 57,899 229,916 3.9710
16 Sep 2014 06:27:10 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 46,379 183,974 3.9668
14 Sep 2014 08:12:44 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 34,859 139,132 3.9913
31 Aug 2014 11:52:33 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 23,339 92,653 3.9699
25 Aug 2014 09:37:08 1233907 16922994 hadam3p_pnw_f0cs_2010_1_008895569_2 11,819 46,822 3.9616


©2024 climateprediction.net