climateprediction.net home page
Task 14687788

Task 14687788

Name hadcm3n_yn2w_1980_40_007956657_2
Workunit 8111769
Created 16 May 2012, 17:20:38 UTC
Sent 16 May 2012, 17:23:15 UTC
Report deadline 16 Aug 2012, 0:50:26 UTC
Received 4 Jun 2012, 0:27:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1070358
Run time 17 days 22 hours 48 min
CPU time 17 days 20 hours 10 min 17 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 3.34 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09546068 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6be01)[0xf74b0e01]
/lib32/libc.so.6(+0x6d688)[0xf74b2688]
/lib32/libc.so.6(cfree+0x6d)[0xf74b576d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf769ea91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf769eaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf745bbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:03 381749                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:03 381749                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
094f0000-09554000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fc8000-f7443000 rw-s 00000000 08:03 287061                             /var/lib/boinc-client/slots/2/139430
f7443000-f7445000 rw-p 00000000 00:00 0 
f7445000-f7598000 r-xp 00000000 08:03 1607368                            /lib32/libc-2.11.1.so
f7598000-f759a000 r--p 00153000 08:03 1607368                            /lib32/libc-2.11.1.so
f759a000-f759b000 rw-p 00155000 08:03 1607368                            /lib32/libc-2.11.1.so
f759b000-f759e000 rw-p 00000000 00:00 0 
f759e000-f75bb000 r-xp 00000000 08:03 29985                              /usr/lib32/libgcc_s.so.1
f75bb000-f75bc000 r--p 0001c000 08:03 29985                              /usr/lib32/libgcc_s.so.1
f75bc000-f75bd000 rw-p 0001d000 08:03 29985                              /usr/lib32/libgcc_s.so.1
f75bd000-f75e1000 r-xp 00000000 08:03 1607351                            /lib32/libm-2.11.1.so
f75e1000-f75e2000 r--p 00023000 08:03 1607351                            /lib32/libm-2.11.1.so
f75e2000-f75e3000 rw-p 00024000 08:03 1607351                            /lib32/libm-2.11.1.so
f75e3000-f76cc000 r-xp 00000000 08:03 10886                              /usr/lib32/libstdc++.so.6.0.13
f76cc000-f76d0000 r--p 000e9000 08:03 10886                              /usr/lib32/libstdc++.so.6.0.13
f76d0000-f76d1000 rw-p 000ed000 08:03 10886                              /usr/lib32/libstdc++.so.6.0.13
f76d1000-f76d8000 rw-p 00000000 00:00 0 
f76d8000-f76da000 r-xp 00000000 08:03 1607372                            /lib32/libdl-2.11.1.so
f76da000-f76db000 r--p 00001000 08:03 1607372                            /lib32/libdl-2.11.1.so
f76db000-f76dc000 rw-p 00002000 08:03 1607372                            /lib32/libdl-2.11.1.so
f76dc000-f76dd000 rw-p 00000000 00:00 0 
f76dd000-f76f2000 r-xp 00000000 08:03 1607366                            /lib32/libpthread-2.11.1.so
f76f2000-f76f3000 r--p 00014000 08:03 1607366                            /lib32/libpthread-2.11.1.so
f76f3000-f76f4000 rw-p 00015000 08:03 1607366                            /lib32/libpthread-2.11.1.so
f76f4000-f76f6000 rw-p 00000000 00:00 0 
f772d000-f772e000 rw-p 00000000 00:00 0 
f772e000-f772f000 ---p 00000000 00:00 0 
f772f000-f7732000 rw-p 00000000 00:00 0 
f7732000-f7734000 rw-s 00000000 08:03 159976                             /var/lib/boinc-client/slots/2/boinc_mmap_file
f7734000-f7736000 rw-p 00000000 00:00 0 
f7736000-f7737000 r-xp 00000000 00:00 0                                  [vdso]
f7737000-f7753000 r-xp 00000000 08:03 1607353                            /lib32/ld-2.11.1.so
f7753000-f7754000 r--p 0001b000 08:03 1607353                            /lib32/ld-2.11.1.so
f7754000-f7755000 rw-p 0001c000 08:03 1607353                            /lib32/ld-2.11.1.so
ff8ec000-ff95b000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7736400]
[0xf7736430]
/lib32/libc.so.6(gsignal+0x51)[0xf746f921]
/lib32/libc.so.6(abort+0x182)[0xf7472d52]
/lib32/libc.so.6(+0x61d0d)[0xf74a6d0d]
/lib32/libc.so.6(+0x6be01)[0xf74b0e01]
/lib32/libc.so.6(+0x6d688)[0xf74b2688]
/lib32/libc.so.6(cfree+0x6d)[0xf74b576d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf769ea91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf769eaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf745bbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
04 Jun 2012 00:28:27 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 1,036,800 1,541,415 1.4867
03 Jun 2012 13:28:51 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 1,010,880 1,502,234 1.4861
03 Jun 2012 02:39:20 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 984,960 1,463,369 1.4857
02 Jun 2012 15:42:20 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 959,040 1,424,496 1.4853
02 Jun 2012 04:37:33 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 933,120 1,385,223 1.4845
01 Jun 2012 17:30:32 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 907,200 1,345,401 1.4830
01 Jun 2012 06:28:57 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 881,280 1,306,280 1.4823
31 May 2012 19:32:22 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 855,360 1,267,517 1.4819
31 May 2012 08:34:59 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 829,440 1,229,312 1.4821
30 May 2012 21:54:23 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 803,520 1,191,214 1.4825
30 May 2012 10:51:48 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 777,600 1,152,373 1.4820
30 May 2012 00:06:46 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 751,680 1,114,141 1.4822
29 May 2012 13:00:57 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 725,760 1,075,815 1.4823
29 May 2012 02:10:56 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 699,840 1,037,578 1.4826
28 May 2012 15:22:39 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 673,920 998,962 1.4823
28 May 2012 04:28:14 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 648,000 960,707 1.4826
27 May 2012 17:37:42 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 622,080 922,538 1.4830
27 May 2012 06:41:27 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 596,160 883,747 1.4824
26 May 2012 19:44:52 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 570,240 845,228 1.4822
26 May 2012 08:50:15 1070358 14687788 hadcm3n_yn2w_1980_40_007956657_2 544,320 806,820 1.4823


©2024 climateprediction.net