climateprediction.net home page
Task 22173007

Task 22173007

Name hadam4h_20ww_209608_4_925_012126860_0
Workunit 12126860
Created 9 Dec 2021, 12:51:46 UTC
Sent 10 Dec 2021, 2:06:34 UTC
Report deadline 22 Nov 2022, 7:26:34 UTC
Received 9 Jan 2022, 4:52:41 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1520317
Run time 15 days 1 hours 32 min 20 sec
CPU time 15 days 1 hours 32 min 20 sec
Validate state Valid
Credit 27,115.14
Device peak FLOPS 8.32 GFLOPS
Application version UK Met Office HadAM4 at N216 resolution v8.52
i686-pc-linux-gnu
Peak working set size 1,377.46 MB
Peak swap size 1,398.97 MB
Peak disk usage 164.88 MB
Stderr
<core_client_version>7.16.17</core_client_version>
<![CDATA[
<stderr_txt>
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
16:49:36 (296455): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
16:49:37 (296455): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (24 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6a560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a03e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a95cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a9606f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a93d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6a560]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0580]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6a560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f6a549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7aa061b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7aa6cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae1e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79eb4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79eb5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbd560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a56e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7ae8cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7ae906f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ae6d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fbd560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fbd549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7af361b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7af9cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b34e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a3e4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a3e5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6c560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a05e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a97cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a9806f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a95d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f6c560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f6c549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7aa261b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7aa8cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ae3e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79ed4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79ed5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:52:15 (5505): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
22:52:16 (5505): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efb560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7994e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a26cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a2706f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a24d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efb560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7efb549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a3161b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a37cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a72e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf797c4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf797c5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9e560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a37e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7ac9cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7aca06f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ac7d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f9e560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f9e549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7ad461b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7adacf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b15e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a1f4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a1f5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f83560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a1ce3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7aaecfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7aaf06f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aacd8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f83560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f83549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7ab961b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7abfcf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7afae35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a044ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a045aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:35:15 (8000): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7b560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a14e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7aa6cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7aa706f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aa4d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f7b560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f7b549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7ab161b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7ab7cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7af2e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79fc4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79fc5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
09:47:58 (4146): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc0560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a59e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7aebcfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7aec06f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ae9d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc0560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc0549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7af661b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7afccf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b37e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a414ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a415aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
11:47:03 (3979): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb5560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a4ee3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7ae0cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7ae106f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aded8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fb5560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fb5549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7aeb61b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7af1cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b2ce35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a364ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a365aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 3 received, exiting...
09:04:42 (3770): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:01:19 (4525): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:01:20 (4525): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f58560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79f1e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a83cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a8406f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a81d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f58560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f58549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a8e61b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a94cf2]
/lib/i386-linux-gnu/libc.so.6(sleep+0x75)[0xf7a94b45]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e7831]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79d94ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79d95aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f35560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79cee3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a60cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a6106f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a5ed8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f35560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f35549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a6b61b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a71cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7aace35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79b64ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79b65aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ec9560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7962e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf79f4cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf79f506f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf79f2d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ec9560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ec9549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf79ff61b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a05cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a40e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf794a4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf794a5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa0560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a39e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7acbcfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7acc06f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7ac9d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa0560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa0549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7ad661b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7adccf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b17e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a214ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a215aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
20:22:11 (3962): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
10:24:37 (7507): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eed560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7986e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a18cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a1906f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a16d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7eed560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7eed549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a2361b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a29cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a64e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf796e4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf796e5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f02560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf799be3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a2dcfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a2e06f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a2bd8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f02560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f02549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a3861b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a3ecf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a79e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79834ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79835aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3b560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf79d4e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a66cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a6706f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a64d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f3b560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f3b549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a7161b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a77cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7ab2e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf79bc4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf79bc5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (22 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc1560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7a5ae3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7aeccfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7aed06f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7aead8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fc1560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fc1549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7af761b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7afdcf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7b38e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804fca4]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503d7]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf7a424ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf7a425aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
17:57:34 (75336): called boinc_finish(193)
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edb560]
/lib/i386-linux-gnu/libc.so.6(getenv+0x9a)[0xf7974e3a]
/lib/i386-linux-gnu/libc.so.6(+0xcfcfd)[0xf7a06cfd]
/lib/i386-linux-gnu/libc.so.6(+0xd006f)[0xf7a0706f]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x1b)[0xf7a04d8b]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7edb560]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7edb549]
/lib/i386-linux-gnu/libc.so.6(__clock_nanosleep_time64+0x1ab)[0xf7a1161b]
/lib/i386-linux-gnu/libc.so.6(__nanosleep+0x62)[0xf7a17cf2]
/lib/i386-linux-gnu/libc.so.6(usleep+0x45)[0xf7a52e35]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b]
/lib/i386-linux-gnu/libc.so.6(+0x254ca)[0xf795c4ca]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0x9a)[0xf795c5aa]
../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
15:07:47 (3738): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jan 2022 03:22:45 1520317 22173007 hadam4h_20ww_209608_4_925_012126860_0 34,763 1,297,417 37.3218
29 Dec 2021 03:41:21 1520317 22173007 hadam4h_20ww_209608_4_925_012126860_0 17,483 742,455 42.4673
20 Dec 2021 23:15:38 1520317 22173007 hadam4h_20ww_209608_4_925_012126860_0 8,843 390,535 44.1632


©2024 climateprediction.net