climateprediction.net home page
Task 13012938

Task 13012938

Name hadcm3n_t191_1940_40_007311139_0
Workunit 7508569
Created 27 Jun 2011, 21:56:05 UTC
Sent 27 Jun 2011, 21:56:09 UTC
Report deadline 27 Sep 2011, 5:23:20 UTC
Received 21 Aug 2011, 15:44:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1147019
Run time 22 days 14 hours 5 min 12 sec
CPU time 8 days 12 hours 53 min 22 sec
Validate state Invalid
Credit 11,819.52
Device peak FLOPS 2.13 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.56</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD Suspended CPDN Monitor - Suspend request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so
dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /usr/local/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so)

Model crashed: TEMPHIST: Write ERROR on history file for namelistNLCFILES                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
SIGABRT: abort called
Stack trace (10 frames):
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xffffe500]
[0xffffe402]
/lib/libc.so.6(gsignal+0x50)[0x901df0]
/lib/libc.so.6(abort+0x101)[0x903701]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xdc)[0x8eee9c]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xffffe500]
[0xffffe402]
/lib/libc.so.6(gsignal+0x50)[0x901df0]
/lib/libc.so.6(abort+0x101)[0x903701]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xdc)[0x8eee9c]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xffffe500]
[0xffffe402]
/lib/libc.so.6(gsignal+0x50)[0x901df0]
/lib/libc.so.6(abort+0x101)[0x903701]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xdc)[0x8eee9c]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xffffe500]
[0xffffe402]
/lib/libc.so.6(gsignal+0x50)[0x901df0]
/lib/libc.so.6(abort+0x101)[0x903701]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xdc)[0x8eee9c]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2099, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xffffe500]
[0xffffe402]
/lib/libc.so.6(gsignal+0x50)[0x901df0]
/lib/libc.so.6(abort+0x101)[0x903701]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xdc)[0x8eee9c]
/usr/local/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2099, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Aug 2011 15:47:59 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 984,960 733,646 0.7448
21 Aug 2011 15:47:59 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 959,040 1,801,985 1.8789
21 Aug 2011 15:47:59 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 933,120 1,752,281 1.8779
21 Aug 2011 15:47:59 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 907,200 1,702,993 1.8772
21 Aug 2011 15:47:59 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 881,280 1,654,330 1.8772
25 Jul 2011 18:56:21 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 855,360 1,605,570 1.8771
25 Jul 2011 18:13:41 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 829,440 1,556,971 1.8771
25 Jul 2011 17:39:32 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 803,520 1,508,793 1.8777
25 Jul 2011 17:16:05 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 777,600 1,460,284 1.8779
25 Jul 2011 16:19:12 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 751,680 1,411,634 1.8780
25 Jul 2011 15:44:18 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 725,760 1,362,707 1.8776
25 Jul 2011 14:59:26 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 699,840 1,314,297 1.8780
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 673,920 1,265,196 1.8774
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 648,000 1,216,289 1.8770
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 622,080 1,167,885 1.8774
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 596,160 1,119,432 1.8777
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 570,240 1,071,273 1.8786
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 544,320 1,022,844 1.8791
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 518,400 973,763 1.8784
25 Jul 2011 13:22:01 1147019 13012938 hadcm3n_t191_1940_40_007311139_0 492,480 924,952 1.8782


©2024 climateprediction.net