 |
|
| Name | famous_xu01_699_200_007100712_0 |
| Workunit | 7304012 |
| Created | 18 Dec 2010, 17:57:39 UTC |
| Sent | 20 Dec 2010, 0:05:12 UTC |
| Report deadline | 21 Mar 2011, 7:32:23 UTC |
| Received | 31 Dec 2010, 17:00:04 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 22 (0x00000016) Unknown error code |
| Computer ID | 1114237 |
| Run time | 6 days 2 hours 11 min 42 sec |
| CPU time | 4 days 23 hours 53 min 58 sec |
| Validate state | Invalid |
| Credit | 1,822.10 |
| Device peak FLOPS | 2.21 GFLOPS |
| Application version | UK Met Office FAMOUS v6.11 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1
BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Suspended CPDN Monitor - Suspend request from BOINC...
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy
Sorry, too many model crashes! :-(
(18299): called boinc_finish
</stderr_txt>
]]>
|
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 27 Dec 2010 17:06:18 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 552,266 | 425,118 | 0.7698 |
| 27 Dec 2010 17:06:18 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 542,906 | 417,942 | 0.7698 |
| 27 Dec 2010 17:06:18 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 533,546 | 411,116 | 0.7705 |
| 27 Dec 2010 17:06:17 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 524,186 | 404,239 | 0.7712 |
| 27 Dec 2010 17:06:18 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 514,826 | 397,457 | 0.7720 |
| 27 Dec 2010 17:06:18 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 505,466 | 390,673 | 0.7729 |
| 26 Dec 2010 23:34:06 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 496,106 | 383,897 | 0.7738 |
| 26 Dec 2010 21:34:45 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 486,746 | 377,124 | 0.7748 |
| 26 Dec 2010 19:30:28 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 477,386 | 370,086 | 0.7752 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 468,026 | 363,382 | 0.7764 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 458,666 | 356,681 | 0.7776 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 449,306 | 349,951 | 0.7789 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 439,946 | 343,216 | 0.7801 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 430,586 | 336,480 | 0.7814 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 421,226 | 329,745 | 0.7828 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 411,866 | 323,005 | 0.7842 |
| 26 Dec 2010 17:03:07 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 402,506 | 316,268 | 0.7857 |
| 26 Dec 2010 00:19:51 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 393,146 | 309,366 | 0.7869 |
| 25 Dec 2010 21:57:03 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 383,786 | 302,625 | 0.7885 |
| 25 Dec 2010 20:02:01 | 1114237 | 12432480 | famous_xu01_699_200_007100712_0 | 374,426 | 295,889 | 0.7902 |
©2024 climateprediction.net