climateprediction.net home page
Task 11051894

Task 11051894

Name hadsm3dhet2_jrsm_006599016_6
Workunit 6802389
Created 15 Mar 2010, 12:05:52 UTC
Sent 24 Jun 2010, 14:13:27 UTC
Report deadline 6 Jun 2011, 19:33:27 UTC
Received 10 Aug 2010, 20:54:27 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1067097
Run time 15 days 18 hours 18 min 19 sec
CPU time 15 days 15 hours 0 min 11 sec
Validate state Invalid
Credit 6,252.33
Device peak FLOPS 1.65 GFLOPS
Application version UK Met Office HadSM3 Slab Model v6.08
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.56</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
MainError:	06:31:08 AM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
MainError:	05:38:58 PM	No files match the supplied pattern.
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: 
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_se_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/yabsd.ihist
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.spin
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.cont
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.doub
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/dataout/restart.day
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/heatflux.ph1
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/phase3.start
Could not change to slots dir /home/phusem-ion/kingba3/BOINC/slots/5
execl(/home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu, 117120) failed!
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25483, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_se_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/yabsd.ihist
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.spin
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.cont
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.doub
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/dataout/restart.day
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/heatflux.ph1
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/phase3.start
Could not change to slots dir /home/phusem-ion/kingba3/BOINC/slots/5
execl(/home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu, 117120) failed!
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25483, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_se_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/yabsd.ihist
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.spin
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.cont
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.doub
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/dataout/restart.day
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/heatflux.ph1
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/phase3.start
Could not change to slots dir /home/phusem-ion/kingba3/BOINC/slots/5
execl(/home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu, 117120) failed!
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25483, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_se_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/yabsd.ihist
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.spin
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.cont
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.doub
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/dataout/restart.day
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/heatflux.ph1
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/phase3.start
Could not change to slots dir /home/phusem-ion/kingba3/BOINC/slots/5
execl(/home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu, 117120) failed!
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25483, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_se_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/yabsd.ihist
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.spin
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.cont
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/jobs/climate.doub
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/dataout/restart.day
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/heatflux.ph1
cpdnmonitor: cannot open input file /home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3dhet2_jrsm_006599016/datain/phase3.start
Could not change to slots dir /home/phusem-ion/kingba3/BOINC/slots/5
execl(/home/phusem-ion/kingba3/BOINC/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu, 117120) failed!
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25483, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Aug 2010 14:44:33 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 162,030 1,337,628 1.9656
10 Aug 2010 08:41:15 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 151,228 1,316,056 1.9651
10 Aug 2010 02:47:38 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 140,426 1,294,809 1.9650
09 Aug 2010 21:36:25 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 129,624 1,272,697 1.9637
09 Aug 2010 15:36:54 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 118,822 1,251,110 1.9631
09 Aug 2010 08:25:56 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 108,020 1,229,671 1.9627
09 Aug 2010 01:59:08 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 97,218 1,208,192 1.9623
08 Aug 2010 17:14:09 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 86,416 1,186,708 1.9618
08 Aug 2010 09:02:41 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 75,614 1,164,930 1.9608
08 Aug 2010 03:42:40 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 64,812 1,143,486 1.9603
07 Aug 2010 16:25:49 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 54,010 1,121,852 1.9595
07 Aug 2010 08:10:36 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 43,208 1,099,586 1.9576
06 Aug 2010 21:07:45 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 32,406 1,078,432 1.9576
06 Aug 2010 11:53:21 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 21,604 1,056,607 1.9563
06 Aug 2010 05:55:12 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 10,802 1,035,135 1.9557
05 Aug 2010 17:42:38 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 259,248 1,013,624 1.9549
05 Aug 2010 11:14:34 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 248,446 993,137 1.9562
05 Aug 2010 04:06:43 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 237,644 972,989 1.9581
04 Aug 2010 19:03:20 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 226,842 952,589 1.9597
04 Aug 2010 11:40:19 1067097 11051894 hadsm3dhet2_jrsm_006599016_6 216,040 931,988 1.9609


©2024 climateprediction.net