climateprediction.net home page
Task 11728173

Task 11728173

Name famous_v63u_599_200_006693680_4
Workunit 6896933
Created 26 Aug 2010, 16:03:41 UTC
Sent 14 Dec 2010, 15:19:52 UTC
Report deadline 15 Mar 2011, 22:47:03 UTC
Received 15 Dec 2010, 17:33:32 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1120726
Run time 21 hours 10 min 29 sec
CPU time 20 hours 53 min 56 sec
Validate state Invalid
Credit 957.42
Device peak FLOPS 2.45 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-apple-darwin
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Tue Dec 14 20:23:26 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd4cc edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd508 esp: 0xbfffd4cc
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=59111, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Tue Dec 14 20:28:31 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=60324, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Wed Dec 15 09:06:12 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=85030, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Wed Dec 15 09:10:01 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=85271, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Wed Dec 15 09:13:12 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=85477, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Wed Dec 15 09:22:44 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd4cc edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd508 esp: 0xbfffd4cc
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=86078, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Wed Dec 15 09:30:55 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=86565, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.5 build 10H574
Wed Dec 15 09:31:26 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x9175046b    3  0xffffffff    4  0x013596b3    5  0x0135844f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x916ea0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c
   ss: 0x0000001f efl: 0x00000206 eip: 0x916ea0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12b4000 -  0x12cffff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libsvml.dylib
 0x1327000 -  0x13befff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libifcoremt.dylib
 0x1407000 -  0x1561fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libimf.dylib
 0x1674000 -  0x16a2fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v63u_599_200_006693680/lib/libirc.dylib
0x90003000 - 0x90006fff /usr/lib/system/libmathCommon.A.dylib
0x916e9000 - 0x91890fff /usr/lib/libSystem.B.dylib
0x91a84000 - 0x91a92fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=86590, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
 (86590): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Dec 2010 14:34:14 1120726 11728173 famous_v63u_599_200_006693680_4 290,186 74,850 0.2579
15 Dec 2010 13:51:26 1120726 11728173 famous_v63u_599_200_006693680_4 280,826 72,418 0.2579
15 Dec 2010 13:10:31 1120726 11728173 famous_v63u_599_200_006693680_4 271,466 69,994 0.2578
15 Dec 2010 12:32:21 1120726 11728173 famous_v63u_599_200_006693680_4 262,106 67,555 0.2577
15 Dec 2010 12:09:14 1120726 11728173 famous_v63u_599_200_006693680_4 252,746 65,109 0.2576
15 Dec 2010 12:09:14 1120726 11728173 famous_v63u_599_200_006693680_4 243,386 62,670 0.2575
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 234,026 60,245 0.2574
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 224,666 57,812 0.2573
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 215,306 55,377 0.2572
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 205,946 52,929 0.2570
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 196,586 50,507 0.2569
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 187,226 48,082 0.2568
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 177,866 45,667 0.2567
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 168,506 43,240 0.2566
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 159,146 40,815 0.2565
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 149,786 38,386 0.2563
15 Dec 2010 10:42:03 1120726 11728173 famous_v63u_599_200_006693680_4 140,426 35,963 0.2561
15 Dec 2010 08:35:00 1120726 11728173 famous_v63u_599_200_006693680_4 131,066 33,549 0.2560
15 Dec 2010 00:20:29 1120726 11728173 famous_v63u_599_200_006693680_4 121,706 31,134 0.2558
14 Dec 2010 23:38:35 1120726 11728173 famous_v63u_599_200_006693680_4 112,346 28,722 0.2557


©2024 climateprediction.net