|
Name | hadcm3n_p55y_1940_40_007420980_0 |
Workunit | 7618615 |
Created | 25 Aug 2011, 0:46:07 UTC |
Sent | 25 Aug 2011, 0:50:31 UTC |
Report deadline | 24 Nov 2011, 8:17:42 UTC |
Received | 5 Oct 2011, 8:04:06 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 1130839 |
Run time | 29 days 5 hours 2 min 50 sec |
CPU time | 23 days 5 hours 28 min 28 sec |
Validate state | Invalid |
Credit | 12,441.60 |
Device peak FLOPS | 2.57 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 16:13:18 (17596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:14:48 (17609): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:48 (17624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:20:12 (17641): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:22:06 (17652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:01 (17661): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:24:42 (2281): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:46 (21286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:41 (21301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:37 (21316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:33 (21335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:27 (21348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:22 (21365): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:19 (21381): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:16 (21396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:08 (21412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:05 (21428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:02 (21444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:54 (21460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:01:50 (21474): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:45 (21490): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:42 (21504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:10:38 (21523): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:33 (21536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:16:27 (21551): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:19:21 (21570): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:22:16 (21586): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:11 (21599): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:07 (21614): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:31:02 (21628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:59 (21644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:36:55 (21661): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:39:49 (21674): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:42:44 (21689): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:38 (21702): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:33 (21718): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:44 (21731): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:38 (21744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:55:32 (21757): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:58:30 (21771): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:01:24 (21788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:21 (21804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:07:15 (21818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:10:11 (21833): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:05 (21849): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:00 (21866): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:00 (21885): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:52 (21899): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:46 (21912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:27:42 (21929): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:39 (21943): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:33:34 (21958): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:29 (21974): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:26 (21987): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:42:18 (22003): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:16:47 (23200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:24 (13836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:20 (13920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:16 (13936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:11 (13956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:04:08 (13973): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:01 (13987): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:57 (14001): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:53 (14017): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:49 (14034): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:43 (14053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:37 (14069): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:33 (14083): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:27:30 (14100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:26 (14115): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:21 (14130): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x094fdb48 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6c231)[0xf74b3231] /lib32/libc.so.6(+0x6dab8)[0xf74b4ab8] /lib32/libc.so.6(cfree+0x6d)[0xf74b7b9d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a1a91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a1aed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf745dbd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:03 1466926 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:03 1466926 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 094a8000-0950d000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6fca000-f7445000 rw-s 00000000 08:03 1439759 /var/lib/boinc-client/slots/1/134520 f7445000-f7447000 rw-p 00000000 00:00 0 f7447000-f759a000 r-xp 00000000 08:03 1197207 /lib32/libc-2.11.1.so f759a000-f759b000 ---p 00153000 08:03 1197207 /lib32/libc-2.11.1.so f759b000-f759d000 r--p 00153000 08:03 1197207 /lib32/libc-2.11.1.so f759d000-f759e000 rw-p 00155000 08:03 1197207 /lib32/libc-2.11.1.so f759e000-f75a1000 rw-p 00000000 00:00 0 f75a1000-f75be000 r-xp 00000000 08:03 1839044 /usr/lib32/libgcc_s.so.1 f75be000-f75bf000 r--p 0001c000 08:03 1839044 /usr/lib32/libgcc_s.so.1 f75bf000-f75c0000 rw-p 0001d000 08:03 1839044 /usr/lib32/libgcc_s.so.1 f75c0000-f75e4000 r-xp 00000000 08:03 1197211 /lib32/libm-2.11.1.so f75e4000-f75e5000 r--p 00023000 08:03 1197211 /lib32/libm-2.11.1.so f75e5000-f75e6000 rw-p 00024000 08:03 1197211 /lib32/libm-2.11.1.so f75e6000-f76cf000 r-xp 00000000 08:03 1839047 /usr/lib32/libstdc++.so.6.0.13 f76cf000-f76d0000 ---p 000e9000 08:03 1839047 /usr/lib32/libstdc++.so.6.0.13 f76d0000-f76d4000 r--p 000e9000 08:03 1839047 /usr/lib32/libstdc++.so.6.0.13 f76d4000-f76d5000 rw-p 000ed000 08:03 1839047 /usr/lib32/libstdc++.so.6.0.13 f76d5000-f76dc000 rw-p 00000000 00:00 0 f76dc000-f76de000 r-xp 00000000 08:03 1197210 /lib32/libdl-2.11.1.so f76de000-f76df000 r--p 00001000 08:03 1197210 /lib32/libdl-2.11.1.so f76df000-f76e0000 rw-p 00002000 08:03 1197210 /lib32/libdl-2.11.1.so f76e0000-f76e1000 rw-p 00000000 00:00 0 f76e1000-f76f6000 r-xp 00000000 08:03 1197221 /lib32/libpthread-2.11.1.so f76f6000-f76f7000 r--p 00014000 08:03 1197221 /lib32/libpthread-2.11.1.so f76f7000-f76f8000 rw-p 00015000 08:03 1197221 /lib32/libpthread-2.11.1.so f76f8000-f76fa000 rw-p 00000000 00:00 0 f771a000-f771b000 rw-p 00000000 00:00 0 f771b000-f771c000 ---p 00000000 00:00 0 f771c000-f771f000 rw-p 00000000 00:00 0 f771f000-f7721000 rw-s 00000000 08:03 1467483 /var/lib/boinc-client/slots/1/boinc_mmap_file f7721000-f7723000 rw-p 00000000 00:00 0 f7723000-f7724000 r-xp 00000000 00:00 0 [vdso] f7724000-f7740000 r-xp 00000000 08:03 1197039 /lib32/ld-2.11.1.so f7740000-f7741000 r--p 0001b000 08:03 1197039 /lib32/ld-2.11.1.so f7741000-f7742000 rw-p 0001c000 08:03 1197039 /lib32/ld-2.11.1.so ffe8e000-ffefe000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7723400] [0xf7723430] /lib32/libc.so.6(gsignal+0x51)[0xf7471921] /lib32/libc.so.6(abort+0x182)[0xf7474d52] /lib32/libc.so.6(+0x6213d)[0xf74a913d] /lib32/libc.so.6(+0x6c231)[0xf74b3231] /lib32/libc.so.6(+0x6dab8)[0xf74b4ab8] /lib32/libc.so.6(cfree+0x6d)[0xf74b7b9d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a1a91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a1aed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf745dbd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
05 Oct 2011 08:04:06 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 1,036,800 | 2,006,900 | 1.9357 |
04 Oct 2011 14:57:35 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 1,010,880 | 1,956,088 | 1.9350 |
03 Oct 2011 21:36:04 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 984,960 | 1,905,450 | 1.9345 |
03 Oct 2011 04:32:59 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 959,040 | 1,854,227 | 1.9334 |
02 Oct 2011 13:04:20 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 933,120 | 1,801,719 | 1.9309 |
01 Oct 2011 22:01:30 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 907,200 | 1,748,775 | 1.9277 |
01 Oct 2011 07:07:03 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 881,280 | 1,695,998 | 1.9245 |
30 Sep 2011 12:44:47 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 855,360 | 1,644,956 | 1.9231 |
29 Sep 2011 14:36:00 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 829,440 | 1,592,681 | 1.9202 |
28 Sep 2011 16:21:59 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 803,520 | 1,538,620 | 1.9148 |
27 Sep 2011 06:31:30 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 777,600 | 1,489,338 | 1.9153 |
25 Sep 2011 15:39:54 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 751,680 | 1,440,653 | 1.9166 |
24 Sep 2011 19:24:19 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 725,760 | 1,392,514 | 1.9187 |
24 Sep 2011 02:32:31 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 699,840 | 1,343,174 | 1.9193 |
22 Sep 2011 23:07:48 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 673,920 | 1,288,609 | 1.9121 |
21 Sep 2011 09:01:37 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 648,000 | 1,231,940 | 1.9011 |
20 Sep 2011 07:17:28 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 622,080 | 1,179,892 | 1.8967 |
19 Sep 2011 14:32:10 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 596,160 | 1,130,452 | 1.8962 |
18 Sep 2011 20:22:49 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 570,240 | 1,081,196 | 1.8960 |
18 Sep 2011 02:21:08 | 1130839 | 13290061 | hadcm3n_p55y_1940_40_007420980_0 | 544,320 | 1,032,140 | 1.8962 |
©2024 climateprediction.net