climateprediction.net home page
Task 11938043

Task 11938043

Name famous_v304_1999_200_006731267_1
Workunit 6934608
Created 14 Oct 2010, 10:18:53 UTC
Sent 22 Oct 2010, 17:23:07 UTC
Report deadline 22 Jan 2011, 0:50:18 UTC
Received 8 Dec 2010, 9:07:59 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1264721
Run time 6 days 5 hours 14 min
CPU time 6 days 4 hours 21 min 18 sec
Validate state Invalid
Credit 4,447.04
Device peak FLOPS 2.91 GFLOPS
Application version UK Met Office FAMOUS v6.11
windows_intelx86
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
00:54:54 (7992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
10:52:30 (7244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:24:21 (1628): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:23:17 (3996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:12:40 (2128): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:11:38 (3736): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:52:06 (2388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:09:43 (2460): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Signal 11 received, exiting...
04:01:55 (1212): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3040, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
01:31:26 (680): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1340, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
03:36:12 (1020): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
03:40:02 (480): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
03:40:54 (2284): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
03:43:03 (1076): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
03:51:25 (2328): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:00:47 (2452): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:02:50 (2412): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:03:54 (2596): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:05:00 (2732): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:05:45 (2752): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:09:51 (2784): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:09:59 (2864): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:21:18 (2884): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:26:09 (2640): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:26:18 (1616): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:31:15 (620): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:32:41 (468): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:32:47 (1936): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:33:01 (644): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:34:29 (852): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
04:47:19 (584): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
05:00:49 (1244): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
05:12:20 (2220): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
05:16:56 (2472): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
05:50:52 (2544): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
06:53:11 (1904): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
06:53:37 (2696): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
07:07:44 (408): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
07:20:08 (2332): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
07:31:48 (2492): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
07:34:30 (1536): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
07:50:19 (2320): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
07:52:24 (2872): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
07:59:25 (2616): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
08:04:32 (2544): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
08:11:20 (2124): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
08:14:29 (1836): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3024, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
08:50:49 (2288): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
08:56:30 (588): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
09:03:34 (2552): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
09:06:38 (2592): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
09:07:39 (1080): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
09:30:51 (2880): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
09:32:35 (1296): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
09:45:06 (608): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
09:46:11 (1128): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
10:02:36 (1404): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
10:09:33 (1616): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Signal 11 received, exiting...
10:10:58 (2548): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 60 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 61 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Signal 11 received, exiting...
10:19:39 (2696): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
10:26:51 (2488): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
10:38:38 (2576): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
11:08:07 (1348): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
11:21:11 (2328): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
11:43:06 (1840): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
11:55:09 (1012): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
11:56:06 (1048): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
12:01:49 (912): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
12:30:11 (2584): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
12:40:02 (1600): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
12:51:10 (1864): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
12:55:05 (2524): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:02:38 (2664): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:08:21 (1592): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:11:10 (2812): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:13:14 (2540): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:14:01 (2616): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:15:26 (1664): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:16:12 (392): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Signal 11 received, exiting...
13:16:58 (2652): called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1284, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
13:17:02 (1284): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Dec 2010 09:12:08 1008312 11938043 famous_v304_1999_200_006731267_1 1,347,866 530,342 0.3935
08 Dec 2010 09:12:08 1008312 11938043 famous_v304_1999_200_006731267_1 1,338,506 526,717 0.3935
08 Dec 2010 09:12:08 1008312 11938043 famous_v304_1999_200_006731267_1 1,329,146 522,814 0.3933
08 Dec 2010 01:00:51 1008312 11938043 famous_v304_1999_200_006731267_1 1,319,786 518,749 0.3931
07 Dec 2010 23:46:59 1008312 11938043 famous_v304_1999_200_006731267_1 1,310,426 514,637 0.3927
07 Dec 2010 22:43:05 1008312 11938043 famous_v304_1999_200_006731267_1 1,301,066 510,868 0.3927
07 Dec 2010 21:47:53 1008312 11938043 famous_v304_1999_200_006731267_1 1,291,706 507,418 0.3928
07 Dec 2010 20:44:52 1008312 11938043 famous_v304_1999_200_006731267_1 1,282,346 503,604 0.3927
07 Dec 2010 19:21:04 1008312 11938043 famous_v304_1999_200_006731267_1 1,272,986 498,794 0.3918
07 Dec 2010 17:15:46 1008312 11938043 famous_v304_1999_200_006731267_1 1,263,626 495,250 0.3919
06 Dec 2010 20:17:12 1008312 11938043 famous_v304_1999_200_006731267_1 1,254,266 491,834 0.3921
06 Dec 2010 19:17:58 1008312 11938043 famous_v304_1999_200_006731267_1 1,244,906 488,360 0.3923
06 Dec 2010 18:20:42 1008312 11938043 famous_v304_1999_200_006731267_1 1,235,546 484,925 0.3925
06 Dec 2010 17:19:08 1008312 11938043 famous_v304_1999_200_006731267_1 1,226,186 481,491 0.3927
06 Dec 2010 16:25:13 1008312 11938043 famous_v304_1999_200_006731267_1 1,216,826 478,054 0.3929
06 Dec 2010 15:26:15 1008312 11938043 famous_v304_1999_200_006731267_1 1,207,466 474,593 0.3930
05 Dec 2010 18:46:08 1008312 11938043 famous_v304_1999_200_006731267_1 1,198,106 471,131 0.3932
05 Dec 2010 17:48:45 1008312 11938043 famous_v304_1999_200_006731267_1 1,188,746 467,683 0.3934
05 Dec 2010 16:51:11 1008312 11938043 famous_v304_1999_200_006731267_1 1,179,386 464,247 0.3936
05 Dec 2010 15:53:35 1008312 11938043 famous_v304_1999_200_006731267_1 1,170,026 460,815 0.3939


©2024 climateprediction.net