Name | hadam4h_21j3_210008_4_925_012127575_2 |
Workunit | 12127575 |
Created | 10 Dec 2021, 19:51:41 UTC |
Sent | 14 Dec 2021, 21:57:36 UTC |
Report deadline | 27 Nov 2022, 3:17:36 UTC |
Received | 16 Jan 2022, 10:33:18 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 1520317 |
Run time | 16 days 17 hours 4 min 21 sec |
CPU time | 16 days 6 hours 6 min 21 sec |
Validate state | Valid |
Credit | 27,115.14 |
Device peak FLOPS | 8.32 GFLOPS |
Application version | UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu |
Peak working set size | 1,377.42 MB |
Peak swap size | 1,398.98 MB |
Peak disk usage | 160.01 MB |
Stderr | <core_client_version>7.16.17</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:55:58 (2340310): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:55:59 (2340310): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f84560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a1de3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7aafcfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7ab006f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aadd8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f84560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f84549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7aba61b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7ac0cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7afbe35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a054ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a055aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f15560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79aee3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a40cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a4106f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a3ed8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f15560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f15549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a4b61b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a51cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a8ce35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79964ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79965aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ec9560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7962e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf79f4cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf79f506f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf79f2d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ec9560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ec9549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf79ff61b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a05cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a40e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf794a4ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf794a5aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 16:28:40 (117969): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3d560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79d6e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a68cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a6906f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a66d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3d560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3d549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a7361b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a79cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab4e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79be4ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79be5aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 17:35:15 (8015): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6f560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a08e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a9acfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a9b06f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a98d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6f560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f6f549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7aa561b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7aabcf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae6e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79f04ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79f05aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 09:47:58 (4149): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2d560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79c6e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a58cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a5906f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a56d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f2d560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f2d549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a6361b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a69cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aa4e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79ae4ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79ae5aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 11:47:03 (3974): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 11:47:03 (3974): called boinc_finish(193) CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efa560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7993e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a25cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a2606f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a23d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efa560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7efa549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a3061b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a36cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a71e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf797b4ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf797b5aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc1560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a5ae3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7aeccfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7aed06f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aead8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc1560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc1549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7af761b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7afdcf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b38e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a424ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a425aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 3 received, exiting... 20:53:28 (4038): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3777, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed6560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf796fe3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a01cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a0206f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf79ffd8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed6560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed6549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a0c61b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a12cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a4de35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79574ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79575aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 13:46:22 (4159): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc4560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a5de3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7aefcfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7af006f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aedd8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc4560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc4549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7afa61b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7b00cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b3be35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a454ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a455aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f41560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79dae3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a6ccfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a6d06f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a6ad8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f41560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f41549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a7761b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a7dcf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab8e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79c24ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79c25aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 20:42:13 (6051): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ec8560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7961e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf79f3cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf79f406f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf79f1d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ec8560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ec8549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf79fe61b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a04cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a3fe35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79494ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79495aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eda560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7973e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a05cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a0606f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a03d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eda560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7eda549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a1061b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a16cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a51e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf795b4ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf795b5aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (22 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9e560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a37e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7ac9cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7aca06f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ac7d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9e560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f9e549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7ad461b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7adacf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b15e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a1f4ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a1f5aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3f560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79d8e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a6acfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a6b06f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a68d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3f560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3f549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a7561b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a7bcf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab6e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79c04ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79c05aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 00:17:23 (4080): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 00:17:24 (4080): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed4560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf796de3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf79ffcfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a0006f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf79fdd8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed4560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed4549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a0a61b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a10cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a4be35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79554ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79555aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f1f560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79b8e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a4acfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a4b06f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a48d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f1f560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f1f549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a5561b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a5bcf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a96e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79a04ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79a05aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (21 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4a560] /lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79e3e3a] /lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a75cfd] /lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a7606f] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a73d8b] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f4a560] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f4a549] /lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a8061b] /lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a86cf2] /lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ac1e35] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79cb4ca] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79cb5aa] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... 20:32:56 (3925): called boinc_finish(0) </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
16 Jan 2022 08:31:14 | 1520317 | 22174269 | hadam4h_21j3_210008_4_925_012127575_2 | 34,763 | 1,400,549 | 40.2885 |
09 Jan 2022 16:48:37 | 1520317 | 22174269 | hadam4h_21j3_210008_4_925_012127575_2 | 26,123 | 1,074,522 | 41.1332 |
01 Jan 2022 21:18:44 | 1520317 | 22174269 | hadam4h_21j3_210008_4_925_012127575_2 | 17,483 | 752,746 | 43.0559 |
27 Dec 2021 04:56:37 | 1520317 | 22174269 | hadam4h_21j3_210008_4_925_012127575_2 | 8,843 | 428,327 | 48.4368 |
©2024 climateprediction.net