climateprediction.net home page
Task 12466797

Task 12466797

Name famous_xab8_999_200_007075195_2
Workunit 7278495
Created 7 Jan 2011, 11:11:22 UTC
Sent 7 Jan 2011, 11:12:36 UTC
Report deadline 8 Apr 2011, 18:39:47 UTC
Received 8 Jan 2011, 13:47:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 867722
Run time 20 hours 3 min
CPU time 19 hours 31 min 17 sec
Validate state Invalid
Credit 1,358.88
Device peak FLOPS 3.28 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-apple-darwin
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Fri Jan  7 09:23:05 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd   11  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd49c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4d8 esp: 0xbfffd49c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20074, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Fri Jan  7 12:18:53 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd   11  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd49c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4d8 esp: 0xbfffd49c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=22256, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Fri Jan  7 12:59:50 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd   12  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=23241, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Fri Jan  7 13:32:22 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd   12  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=23600, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Fri Jan  7 13:57:11 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd   11  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd49c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4d8 esp: 0xbfffd49c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=23885, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Fri Jan  7 17:08:50 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd   12  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27014, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Sat Jan  8 00:09:51 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd   12  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=31835, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.6 build 10J567
Sat Jan  8 00:20:43 2011

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x97e5b46b    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd   12  0x00000003  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc40c edx: 0x97df50fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc448 esp: 0xbfffc40c
   ss: 0x0000001f efl: 0x00000206 eip: 0x97df50fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_xab8_999_200_007075195/lib/libirc.dylib
0x9000c000 - 0x9000ffff /usr/lib/system/libmathCommon.A.dylib
0x93815000 - 0x93823fff /usr/lib/libz.1.dylib
0x97df4000 - 0x97f9bfff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=31942, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (34112): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jan 2011 12:36:42 867722 12466797 famous_xab8_999_200_007075195_2 411,866 68,792 0.1670
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 402,506 67,230 0.1670
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 393,146 65,668 0.1670
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 383,786 64,103 0.1670
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 374,426 62,540 0.1670
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 365,066 60,979 0.1670
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 355,706 59,419 0.1670
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 346,346 57,859 0.1671
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 336,986 56,297 0.1671
08 Jan 2011 12:20:09 867722 12466797 famous_xab8_999_200_007075195_2 327,626 54,735 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 318,266 53,172 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 308,906 51,610 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 299,546 50,049 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 290,186 48,489 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 280,826 46,927 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 271,466 45,366 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 262,106 43,805 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 252,746 42,242 0.1671
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 243,386 40,683 0.1672
08 Jan 2011 12:20:08 867722 12466797 famous_xab8_999_200_007075195_2 234,026 39,123 0.1672


©2024 climateprediction.net