Task 21744887

Name	hadcm3s_c742_191512_240_835_011893179_0
Workunit	11893179
Created	25 Sep 2019, 10:47:09 UTC
Sent	25 Sep 2019, 23:51:32 UTC
Report deadline	7 Sep 2020, 5:11:32 UTC
Received	1 Nov 2019, 13:28:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1489844
Run time	22 days 10 hours 15 min 54 sec
CPU time	22 days 4 hours 54 min 8 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.86 GFLOPS
Application version	UK Met Office HadCM3 short v8.36 i686-pc-linux-gnu
Peak working set size	167.34 MB
Peak swap size	215.71 MB
Peak disk usage	99.01 MB
Stderr	<core_client_version>7.16.3</core_client_version> <![CDATA[ <stderr_txt> Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 10:41:49 (10212): called boinc_finish(193) Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Unable to load library hadcm3s_se_8.36_i686-pc-linux-gnu.so dlopen error: libz.so.1: cannot open shared object file: No such file or directory Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bc177] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f86950] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7aa50c9] /lib/i386-linux-gnu/libc.so.6(+0xb538d)[0xf7b2538d] /lib/i386-linux-gnu/libc.so.6(+0xb571b)[0xf7b2571b] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x17)[0xf7b23857] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7632] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7d80] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7e71] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f86950] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f86939] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b3561b] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b68cd1] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80cead5] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804fe8b] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80515bd] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80517bd] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a8e751] ../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804c7a1] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... MainError: 02:58:13 PM No files match the supplied pattern. Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... MainError: 02:58:13 PM No files match the supplied pattern. MainError: 09:03:28 PM No files match the supplied pattern. MainError: 09:03:28 PM No files match the supplied pattern. MainError: 04:58:55 AM No files match the supplied pattern. MainError: 04:58:55 AM No files match the supplied pattern. MainError: 08:15:12 PM No files match the supplied pattern. MainError: 08:15:12 PM No files match the supplied pattern. MainError: 12:39:42 AM No files match the supplied pattern. MainError: 12:39:42 AM No files match the supplied pattern. MainError: 05:04:30 AM No files match the supplied pattern. MainError: 05:04:30 AM No files match the supplied pattern. MainError: 01:19:50 AM No files match the supplied pattern. MainError: 01:19:50 AM No files match the supplied pattern. MainError: 07:27:34 PM No files match the supplied pattern. MainError: 07:27:34 PM No files match the supplied pattern. MainError: 09:36:38 AM No files match the supplied pattern. MainError: 09:36:38 AM No files match the supplied pattern. MainError: 01:17:23 PM No files match the supplied pattern. MainError: 01:17:23 PM No files match the supplied pattern. MainError: 10:24:08 PM No files match the supplied pattern. MainError: 10:24:08 PM No files match the supplied pattern. MainError: 07:25:53 AM No files match the supplied pattern. MainError: 07:25:53 AM No files match the supplied pattern. Processing restart Year 1935 Month 12 Day 1 MainError: 12:27:22 AM No files match the supplied pattern. MainError: 12:27:22 AM No files match the supplied pattern. 07:27:48 (1831): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadcm3s_c742_191512_240_835_011893179_0_r339015339_1.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadcm3s_c742_191512_240_835_011893179_0_r339015339_2.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadcm3s_c742_191512_240_835_011893179_0_r339015339_3.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadcm3s_c742_191512_240_835_011893179_0_r339015339_4.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadcm3s_c742_191512_240_835_011893179_0_r339015339_5.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadcm3s_c742_191512_240_835_011893179_0_r339015339_6.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadcm3s_c742_191512_240_835_011893179_0_r339015339_7.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Nov 2019 12:30:14	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	518,400	1,918,432	3.7007
31 Oct 2019 07:52:40	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	492,480	1,817,701	3.6909
30 Oct 2019 10:57:41	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	466,560	1,699,328	3.6422
30 Oct 2019 10:55:13	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	440,640	1,580,696	3.5873
27 Oct 2019 09:38:49	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	414,720	1,481,593	3.5725
25 Oct 2019 20:21:38	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	388,800	1,344,828	3.4589
25 Oct 2019 01:22:32	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	362,880	1,279,984	3.5273
24 Oct 2019 05:07:35	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	336,960	1,208,121	3.5854
23 Oct 2019 12:42:31	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	311,040	1,149,417	3.6954
22 Oct 2019 20:15:54	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	285,120	1,090,729	3.8255
21 Oct 2019 05:03:40	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	259,200	950,734	3.6680
19 Oct 2019 21:16:34	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	233,280	836,276	3.5849
19 Oct 2019 13:30:13	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	226,800	807,901	3.5622
19 Oct 2019 10:28:57	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	224,640	797,033	3.5480
19 Oct 2019 07:28:03	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	222,480	786,208	3.5338
19 Oct 2019 04:27:06	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	220,320	775,573	3.5202
19 Oct 2019 01:26:00	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	218,160	765,097	3.5070
18 Oct 2019 23:21:44	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	216,000	756,278	3.5013
18 Oct 2019 20:20:48	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	213,840	747,796	3.4970
18 Oct 2019 18:16:41	1489844	21744887	hadcm3s_c742_191512_240_835_011893179_0	211,680	739,440	3.4932