 |
|
| Name | famous_u3ox_799_200_006637628_1 |
| Workunit | 6841000 |
| Created | 10 Jun 2010, 11:42:53 UTC |
| Sent | 21 Jul 2010, 23:39:57 UTC |
| Report deadline | 21 Oct 2010, 7:07:08 UTC |
| Received | 26 Jul 2010, 22:16:51 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 22 (0x00000016) Unknown error code |
| Computer ID | 1134514 |
| Run time | 4 days 20 hours 1 min 1 sec |
| CPU time | 4 days 7 hours 52 min 24 sec |
| Validate state | Invalid |
| Credit | 2,686.79 |
| Device peak FLOPS | 2.67 GFLOPS |
| Application version | UK Met Office FAMOUS v6.11 windows_intelx86 |
| Stderr | <core_client_version>6.10.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 17:46:59 (2104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:01 (2104): No heartbeat from core client for 30 sec - exiting 17:47:02 (2104): No heartbeat from core client for 30 sec - exiting 20:52:56 (1416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:58 (1416): No heartbeat from core client for 30 sec - exiting 21:50:15 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:27 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:29 (3144): No heartbeat from core client for 30 sec - exiting 01:10:46 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:10:48 (4896): No heartbeat from core client for 30 sec - exiting 01:10:49 (4896): No heartbeat from core client for 30 sec - exiting 04:09:30 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:09:32 (3524): No heartbeat from core client for 30 sec - exiting 04:10:54 (3468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:17 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:19 (3116): No heartbeat from core client for 30 sec - exiting 16:27:34 (772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:35 (772): No heartbeat from core client for 30 sec - exiting 16:27:36 (772): No heartbeat from core client for 30 sec - exiting 18:54:58 (1252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:59 (1252): No heartbeat from core client for 30 sec - exiting 18:56:27 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:53 (3820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:55 (3820): No heartbeat from core client for 30 sec - exiting 00:57:56 (3820): No heartbeat from core client for 30 sec - exiting 00:57:57 (3820): No heartbeat from core client for 30 sec - exiting 02:00:04 (4772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:45 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:10:50 (1536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:25 (1980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:42 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:02 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:24:57 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:29:32 (3136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:27 (260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:38 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:46:04 (4996): No heartbeat from core client for 30 sec - exiting 03:48:00 (4156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:29 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:49 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:28 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:29 (4868): No heartbeat from core client for 30 sec - exiting 10:34:30 (4868): No heartbeat from core client for 30 sec - exiting 10:34:31 (4868): No heartbeat from core client for 30 sec - exiting 10:34:32 (4868): No heartbeat from core client for 30 sec - exiting 10:34:33 (4868): No heartbeat from core client for 30 sec - exiting 10:34:35 (4868): No heartbeat from core client for 30 sec - exiting 10:34:36 (4868): No heartbeat from core client for 30 sec - exiting 10:34:37 (4868): No heartbeat from core client for 30 sec - exiting 10:34:38 (4868): No heartbeat from core client for 30 sec - exiting 10:34:39 (4868): No heartbeat from core client for 30 sec - exiting 11:36:49 (132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:30 (692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:12 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:31 (4720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:55:40 (2836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:15 (1912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:17 (1912): No heartbeat from core client for 30 sec - exiting 19:12:18 (1912): No heartbeat from core client for 30 sec - exiting 19:12:19 (1912): No heartbeat from core client for 30 sec - exiting 19:12:20 (1912): No heartbeat from core client for 30 sec - exiting 19:12:21 (1912): No heartbeat from core client for 30 sec - exiting 19:12:22 (1912): No heartbeat from core client for 30 sec - exiting 19:12:23 (1912): No heartbeat from core client for 30 sec - exiting 19:12:24 (1912): No heartbeat from core client for 30 sec - exiting 19:12:25 (1912): No heartbeat from core client for 30 sec - exiting 19:12:26 (1912): No heartbeat from core client for 30 sec - exiting 19:39:13 (1856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:40 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:27 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:52:42 (4588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:12 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:22:50 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:57:23 (2700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:25:51 (4244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:55 (3068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:28 (3080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:28 (724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:48 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:56 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:57 (4128): No heartbeat from core client for 30 sec - exiting 10:21:58 (4128): No heartbeat from core client for 30 sec - exiting 10:21:59 (4128): No heartbeat from core client for 30 sec - exiting 10:22:00 (4128): No heartbeat from core client for 30 sec - exiting 10:22:02 (4128): No heartbeat from core client for 30 sec - exiting 10:22:03 (4128): No heartbeat from core client for 30 sec - exiting 10:22:04 (4128): No heartbeat from core client for 30 sec - exiting 10:22:05 (4128): No heartbeat from core client for 30 sec - exiting 10:22:06 (4128): No heartbeat from core client for 30 sec - exiting 10:22:07 (4128): No heartbeat from core client for 30 sec - exiting 12:13:48 (1212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:24 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:43 (1644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:44 (1644): No heartbeat from core client for 30 sec - exiting 18:13:45 (1644): No heartbeat from core client for 30 sec - exiting 18:13:46 (1644): No heartbeat from core client for 30 sec - exiting 18:13:47 (1644): No heartbeat from core client for 30 sec - exiting 18:13:48 (1644): No heartbeat from core client for 30 sec - exiting 18:13:50 (1644): No heartbeat from core client for 30 sec - exiting 18:13:51 (1644): No heartbeat from core client for 30 sec - exiting 18:13:52 (1644): No heartbeat from core client for 30 sec - exiting 18:13:53 (1644): No heartbeat from core client for 30 sec - exiting 18:13:54 (1644): No heartbeat from core client for 30 sec - exiting 18:51:13 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:25 (3096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:50:13 (2216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:22:24 (2592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:31:04 (2008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:42 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:48 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 03:48:18 (3268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:48:19 (3268): No heartbeat from core client for 30 sec - exiting 03:48:20 (3268): No heartbeat from core client for 30 sec - exiting 03:48:21 (3268): No heartbeat from core client for 30 sec - exiting 03:48:22 (3268): No heartbeat from core client for 30 sec - exiting 03:48:23 (3268): No heartbeat from core client for 30 sec - exiting 03:48:24 (3268): No heartbeat from core client for 30 sec - exiting 03:48:25 (3268): No heartbeat from core client for 30 sec - exiting 03:48:27 (3268): No heartbeat from core client for 30 sec - exiting 03:48:28 (3268): No heartbeat from core client for 30 sec - exiting 03:48:29 (3268): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 06:21:06 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:36 (2668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:37:53 (3296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:38 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:46 (1668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:14 (4624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:46 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 17:09:06 (4784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:59 (1640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:40:24 (1020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:07 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:41 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:28 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:19 (3252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:19:39 (864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:54:48 (3124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:32 (4084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:37 (1656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:39:16 (2796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:46:59 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:00 (4080): No heartbeat from core client for 30 sec - exiting 04:47:01 (4080): No heartbeat from core client for 30 sec - exiting 04:47:02 (4080): No heartbeat from core client for 30 sec - exiting 04:47:03 (4080): No heartbeat from core client for 30 sec - exiting 04:47:04 (4080): No heartbeat from core client for 30 sec - exiting 04:47:06 (4080): No heartbeat from core client for 30 sec - exiting 04:47:07 (4080): No heartbeat from core client for 30 sec - exiting 04:47:08 (4080): No heartbeat from core client for 30 sec - exiting 04:47:09 (4080): No heartbeat from core client for 30 sec - exiting 04:47:10 (4080): No heartbeat from core client for 30 sec - exiting 05:36:14 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:57:01 (1448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:38 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:33:56 (2328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:16:14 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:41 (5064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:51 (1332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:07 (2680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 08:57:54 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:54 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:57 (3596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:08 (5104): No heartbeat from core client for 30 sec - exiting 10:42:36 (5104): No heartbeat from core client for 30 sec - exiting 10:42:37 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:42:47 (4976): Can't acquire lockfile (32) - waiting 35s BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 12:04:09 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... 12:18:56 (1608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:58 (1608): No heartbeat from core client for 30 sec - exiting 12:18:59 (1608): No heartbeat from core client for 30 sec - exiting 12:19:00 (1608): No heartbeat from core client for 30 sec - exiting 12:19:01 (1608): No heartbeat from core client for 30 sec - exiting 12:19:02 (1608): No heartbeat from core client for 30 sec - exiting 12:19:03 (1608): No heartbeat from core client for 30 sec - exiting 12:19:04 (1608): No heartbeat from core client for 30 sec - exiting 12:19:05 (1608): No heartbeat from core client for 30 sec - exiting 12:19:06 (1608): No heartbeat from core client for 30 sec - exiting 12:19:07 (1608): No heartbeat from core client for 30 sec - exiting 12:23:08 (4300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:24 (1332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:50 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:15 (4884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:29 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:42:55 (3388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:59 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:00 (4420): No heartbeat from core client for 30 sec - exiting 15:49:01 (4420): No heartbeat from core client for 30 sec - exiting 15:49:03 (4420): No heartbeat from core client for 30 sec - exiting 15:49:04 (4420): No heartbeat from core client for 30 sec - exiting 15:49:05 (4420): No heartbeat from core client for 30 sec - exiting 15:49:06 (4420): No heartbeat from core client for 30 sec - exiting 15:49:07 (4420): No heartbeat from core client for 30 sec - exiting 15:49:08 (4420): No heartbeat from core client for 30 sec - exiting 15:49:09 (4420): No heartbeat from core client for 30 sec - exiting 15:49:10 (4420): No heartbeat from core client for 30 sec - exiting 16:15:00 (1584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Sorry, too many model crashes! :-( 16:15:44 (3940): called boinc_finish </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 26 Jul 2010 20:57:50 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 814,346 | 370,195 | 0.4546 |
| 26 Jul 2010 19:34:30 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 804,986 | 366,101 | 0.4548 |
| 26 Jul 2010 18:05:01 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 795,626 | 361,829 | 0.4548 |
| 26 Jul 2010 16:46:45 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 786,266 | 357,565 | 0.4548 |
| 26 Jul 2010 15:26:45 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 776,906 | 353,341 | 0.4548 |
| 26 Jul 2010 14:02:00 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 767,546 | 349,255 | 0.4550 |
| 26 Jul 2010 12:42:14 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 758,186 | 344,957 | 0.4550 |
| 26 Jul 2010 11:19:50 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 748,826 | 340,737 | 0.4550 |
| 26 Jul 2010 09:56:49 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 739,466 | 336,424 | 0.4550 |
| 26 Jul 2010 08:55:38 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 730,106 | 332,185 | 0.4550 |
| 26 Jul 2010 07:09:53 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 720,746 | 327,898 | 0.4549 |
| 26 Jul 2010 05:51:21 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 711,386 | 323,604 | 0.4549 |
| 26 Jul 2010 04:42:46 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 702,026 | 319,316 | 0.4548 |
| 26 Jul 2010 03:09:06 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 692,666 | 315,065 | 0.4549 |
| 26 Jul 2010 02:42:41 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 683,306 | 310,802 | 0.4549 |
| 26 Jul 2010 01:41:34 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 673,946 | 306,711 | 0.4551 |
| 26 Jul 2010 00:04:27 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 664,586 | 302,467 | 0.4551 |
| 25 Jul 2010 21:44:33 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 655,226 | 298,187 | 0.4551 |
| 25 Jul 2010 20:26:42 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 645,866 | 293,900 | 0.4550 |
| 25 Jul 2010 19:07:59 | 1048971 | 11438948 | famous_u3ox_799_200_006637628_1 | 636,506 | 289,623 | 0.4550 |
©2024 climateprediction.net