|
Name | hadcm3n_4h6v_1940_40_008303064_1 |
Workunit | 8454199 |
Created | 9 May 2013, 4:55:19 UTC |
Sent | 9 May 2013, 4:55:25 UTC |
Report deadline | 8 Aug 2013, 12:22:36 UTC |
Received | 1 Jun 2013, 4:59:51 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1131315 |
Run time | 13 days 3 hours 36 min 18 sec |
CPU time | 12 days 13 hours 46 min 44 sec |
Validate state | Invalid |
Credit | 8,087.04 |
Device peak FLOPS | 3.02 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 01:44:56 (52220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:21:12 (5132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:47:49 (15680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:47:52 (15680): No heartbeat from core client for 30 sec - exiting 03:47:53 (15680): No heartbeat from core client for 30 sec - exiting 03:47:54 (15680): No heartbeat from core client for 30 sec - exiting 03:47:55 (15680): No heartbeat from core client for 30 sec - exiting 03:47:56 (15680): No heartbeat from core client for 30 sec - exiting 03:47:57 (15680): No heartbeat from core client for 30 sec - exiting 03:47:58 (15680): No heartbeat from core client for 30 sec - exiting 03:47:59 (15680): No heartbeat from core client for 30 sec - exiting 03:48:00 (15680): No heartbeat from core client for 30 sec - exiting 03:48:01 (15680): No heartbeat from core client for 30 sec - exiting 03:48:02 (15680): No heartbeat from core client for 30 sec - exiting 06:03:05 (47068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:25:22 (29856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:10 (43224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:22 (11844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:41 (21436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:59 (38920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:56:25 (37004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:58 (39964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:59:37 (45880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:20 (26948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:04:26 (40076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:02 (27564): No heartbeat from core client for 30 sec - exiting 09:08:20 (27564): No heartbeat from core client for 30 sec - exiting 09:08:21 (27564): No heartbeat from core client for 30 sec - exiting 09:08:22 (27564): No heartbeat from core client for 30 sec - exiting 09:08:23 (27564): No heartbeat from core client for 30 sec - exiting 09:08:24 (27564): No heartbeat from core client for 30 sec - exiting 09:08:25 (27564): No heartbeat from core client for 30 sec - exiting 09:08:26 (27564): No heartbeat from core client for 30 sec - exiting 09:08:27 (27564): No heartbeat from core client for 30 sec - exiting 09:08:28 (27564): No heartbeat from core client for 30 sec - exiting 09:08:29 (27564): No heartbeat from core client for 30 sec - exiting 09:08:30 (27564): No heartbeat from core client for 30 sec - exiting 09:08:31 (27564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:05 (34096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:07 (12196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:20 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:22 (32884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:35 (24960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:36 (24960): No heartbeat from core client for 30 sec - exiting 09:40:37 (24960): No heartbeat from core client for 30 sec - exiting 09:40:38 (24960): No heartbeat from core client for 30 sec - exiting 09:40:39 (24960): No heartbeat from core client for 30 sec - exiting 09:40:40 (24960): No heartbeat from core client for 30 sec - exiting 09:40:41 (24960): No heartbeat from core client for 30 sec - exiting 09:40:42 (24960): No heartbeat from core client for 30 sec - exiting 09:40:43 (24960): No heartbeat from core client for 30 sec - exiting 09:40:44 (24960): No heartbeat from core client for 30 sec - exiting 09:40:45 (24960): No heartbeat from core client for 30 sec - exiting 09:59:16 (29944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:09 (38244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:10:19 (3588): No heartbeat from core client for 30 sec - exiting 14:10:20 (3588): No heartbeat from core client for 30 sec - exiting 14:10:21 (3588): No heartbeat from core client for 30 sec - exiting 14:10:22 (3588): No heartbeat from core client for 30 sec - exiting 14:10:23 (3588): No heartbeat from core client for 30 sec - exiting 14:10:24 (3588): No heartbeat from core client for 30 sec - exiting 14:10:25 (3588): No heartbeat from core client for 30 sec - exiting 14:10:26 (3588): No heartbeat from core client for 30 sec - exiting 14:10:27 (3588): No heartbeat from core client for 30 sec - exiting 14:10:28 (3588): No heartbeat from core client for 30 sec - exiting 14:10:29 (3588): No heartbeat from core client for 30 sec - exiting 14:10:30 (3588): No heartbeat from core client for 30 sec - exiting 14:10:31 (3588): No heartbeat from core client for 30 sec - exiting 14:10:32 (3588): No heartbeat from core client for 30 sec - exiting 14:10:33 (3588): No heartbeat from core client for 30 sec - exiting 14:10:34 (3588): No heartbeat from core client for 30 sec - exiting 14:10:35 (3588): No heartbeat from core client for 30 sec - exiting 14:10:36 (3588): No heartbeat from core client for 30 sec - exiting 14:10:37 (3588): No heartbeat from core client for 30 sec - exiting 14:10:38 (3588): No heartbeat from core client for 30 sec - exiting 14:10:39 (3588): No heartbeat from core client for 30 sec - exiting 14:10:40 (3588): No heartbeat from core client for 30 sec - exiting 14:10:41 (3588): No heartbeat from core client for 30 sec - exiting 14:10:42 (3588): No heartbeat from core client for 30 sec - exiting 14:10:43 (3588): No heartbeat from core client for 30 sec - exiting 14:10:44 (3588): No heartbeat from core client for 30 sec - exiting 14:10:45 (3588): No heartbeat from core client for 30 sec - exiting 14:10:46 (3588): No heartbeat from core client for 30 sec - exiting 14:10:47 (3588): No heartbeat from core client for 30 sec - exiting 14:10:48 (3588): No heartbeat from core client for 30 sec - exiting 14:10:49 (3588): No heartbeat from core client for 30 sec - exiting 14:10:50 (3588): No heartbeat from core client for 30 sec - exiting 14:10:51 (3588): No heartbeat from core client for 30 sec - exiting 14:10:52 (3588): No heartbeat from core client for 30 sec - exiting 14:10:53 (3588): No heartbeat from core client for 30 sec - exiting 14:10:54 (3588): No heartbeat from core client for 30 sec - exiting 14:10:55 (3588): No heartbeat from core client for 30 sec - exiting 14:10:56 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:50:41 (33784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
31 May 2013 21:43:45 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 673,920 | 1,066,446 | 1.5825 |
31 May 2013 09:06:24 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 648,000 | 1,024,898 | 1.5816 |
30 May 2013 21:05:16 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 622,080 | 982,881 | 1.5800 |
30 May 2013 09:14:21 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 596,160 | 941,936 | 1.5800 |
29 May 2013 20:03:37 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 570,240 | 900,798 | 1.5797 |
29 May 2013 03:00:58 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 544,320 | 859,835 | 1.5796 |
28 May 2013 07:08:05 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 518,400 | 818,604 | 1.5791 |
27 May 2013 16:16:52 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 492,480 | 777,798 | 1.5793 |
27 May 2013 03:42:09 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 466,560 | 736,849 | 1.5793 |
26 May 2013 13:31:30 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 440,640 | 696,052 | 1.5796 |
25 May 2013 20:36:06 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 414,720 | 655,105 | 1.5796 |
25 May 2013 07:56:53 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 388,800 | 614,384 | 1.5802 |
24 May 2013 18:43:30 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 362,880 | 572,902 | 1.5788 |
24 May 2013 05:16:45 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 336,960 | 531,380 | 1.5770 |
23 May 2013 16:26:38 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 311,040 | 489,907 | 1.5751 |
23 May 2013 02:15:48 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 285,120 | 448,273 | 1.5722 |
22 May 2013 09:13:32 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 259,200 | 408,633 | 1.5765 |
21 May 2013 20:12:08 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 233,280 | 366,835 | 1.5725 |
21 May 2013 07:42:36 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 207,360 | 325,793 | 1.5711 |
20 May 2013 19:20:46 | 1131315 | 15766655 | hadcm3n_4h6v_1940_40_008303064_1 | 181,440 | 284,918 | 1.5703 |
©2024 climateprediction.net