climateprediction.net home page
Task 22312093

Task 22312093

Name oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0
Workunit 12211843
Created 13 Feb 2023, 21:18:59 UTC
Sent 14 Feb 2023, 2:15:42 UTC
Report deadline 15 Apr 2023, 2:15:42 UTC
Received 18 Feb 2023, 14:39:37 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537334
Run time 13 hours 50 min 47 sec
CPU time 13 hours 50 min 47 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 3.47 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,075.95 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,357.60 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
1f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2802:2802] [20230218:095246:1676710366:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3wg
(argv4) batchid: 991
(argv5) wuid: 12211843
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_811f8d0eab8af88dc17bb8d544f53dd8 to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a3wg_2016092300_15_991_12211843.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a3wg_2016092300_15_991_12211843.zip
ic_ancil_file: ic_ancil_12211843
ifsdata_file: ifsdata_12211843
climate_data_file: clim_data_12211843
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/3/ic_ancil_12211843.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12211843.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_6af1932d3ee2d8c393e85ba9b61a708c to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12211843.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12211843.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12211843.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12211843.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12211843.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12211843.xml
-- Model is restarting --
Adjusting last_iter, 960, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12211843.xml
last_cpu_time: 33303
upload_file_number: 10
last_iter: 961
last_upload: 864000
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0_r1447071482
The child process has been launched with process id: 2808
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:egon-VirtualBox:1:1:2808:2808] [20230218:095629:1676710589:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  09:57:31 STEP  960 H= 240:00 +CPU= 44.459
  09:58:05 STEP  961 H= 240:15 +CPU= 32.913
  09:58:38 STEP  962 H= 240:30 +CPU= 33.144
  09:59:12 STEP  963 H= 240:45 +CPU= 33.460
  09:59:46 STEP  964 H= 241:00 +CPU= 34.102
  10:00:20 STEP  965 H= 241:15 +CPU= 33.282
  10:00:54 STEP  966 H= 241:30 +CPU= 33.302
  10:01:28 STEP  967 H= 241:45 +CPU= 33.380
  10:02:02 STEP  968 H= 242:00 +CPU= 34.192
  10:02:36 STEP  969 H= 242:15 +CPU= 33.259
  10:03:10 STEP  970 H= 242:30 +CPU= 33.170
  10:03:43 STEP  971 H= 242:45 +CPU= 33.116
  10:04:25 STEP  972 H= 243:00 +CPU= 41.374
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000972
  10:05:00 STEP  973 H= 243:15 +CPU= 34.182
  10:05:34 STEP  974 H= 243:30 +CPU= 33.635
  10:06:08 STEP  975 H= 243:45 +CPU= 33.840
  10:06:44 STEP  976 H= 244:00 +CPU= 34.708
  10:07:20 STEP  977 H= 244:15 +CPU= 33.000
  10:07:54 STEP  978 H= 244:30 +CPU= 33.778
  10:08:29 STEP  979 H= 244:45 +CPU= 34.818
  10:09:03 STEP  980 H= 245:00 +CPU= 33.910
  10:09:38 STEP  981 H= 245:15 +CPU= 34.409
  10:10:11 STEP  982 H= 245:30 +CPU= 32.972
  10:10:44 STEP  983 H= 245:45 +CPU= 32.567
  10:11:26 STEP  984 H= 246:00 +CPU= 41.382
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000984
  10:12:03 STEP  985 H= 246:15 +CPU= 35.732
  10:12:36 STEP  986 H= 246:30 +CPU= 32.807
  10:13:09 STEP  987 H= 246:45 +CPU= 32.829
  10:13:43 STEP  988 H= 247:00 +CPU= 33.783
  10:14:17 STEP  989 H= 247:15 +CPU= 33.241
  10:14:52 STEP  990 H= 247:30 +CPU= 35.106
  10:15:27 STEP  991 H= 247:45 +CPU= 34.280
  10:16:01 STEP  992 H= 248:00 +CPU= 33.759
  10:16:34 STEP  993 H= 248:15 +CPU= 32.929
  10:17:07 STEP  994 H= 248:30 +CPU= 32.937
  10:17:40 STEP  995 H= 248:45 +CPU= 32.650
  10:18:22 STEP  996 H= 249:00 +CPU= 41.132
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000996
  10:18:55 STEP  997 H= 249:15 +CPU= 32.941
  10:19:28 STEP  998 H= 249:30 +CPU= 32.978
  10:20:02 STEP  999 H= 249:45 +CPU= 32.956
  10:20:36 STEP 1000 H= 250:00 +CPU= 33.725
  10:21:09 STEP 1001 H= 250:15 +CPU= 32.909
  10:21:42 STEP 1002 H= 250:30 +CPU= 32.928
  10:22:16 STEP 1003 H= 250:45 +CPU= 33.153
  10:22:50 STEP 1004 H= 251:00 +CPU= 33.284
  10:23:23 STEP 1005 H= 251:15 +CPU= 32.934
  10:23:56 STEP 1006 H= 251:30 +CPU= 32.774
  10:24:30 STEP 1007 H= 251:45 +CPU= 32.942
  10:25:16 STEP 1008 H= 252:00 +CPU= 45.445
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001008
  10:25:52 STEP 1009 H= 252:15 +CPU= 32.653
  10:26:25 STEP 1010 H= 252:30 +CPU= 33.253
  10:26:59 STEP 1011 H= 252:45 +CPU= 33.280
  10:27:33 STEP 1012 H= 253:00 +CPU= 33.735
  10:28:06 STEP 1013 H= 253:15 +CPU= 32.862
  10:28:40 STEP 1014 H= 253:30 +CPU= 32.948
  10:29:13 STEP 1015 H= 253:45 +CPU= 32.798
  10:29:47 STEP 1016 H= 254:00 +CPU= 33.693
  10:30:20 STEP 1017 H= 254:15 +CPU= 32.970
  10:30:53 STEP 1018 H= 254:30 +CPU= 32.903
  10:31:26 STEP 1019 H= 254:45 +CPU= 32.860
  10:32:08 STEP 1020 H= 255:00 +CPU= 40.976
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001020
  10:32:41 STEP 1021 H= 255:15 +CPU= 32.720
  10:33:14 STEP 1022 H= 255:30 +CPU= 32.761
  10:33:47 STEP 1023 H= 255:45 +CPU= 32.921
  10:34:21 STEP 1024 H= 256:00 +CPU= 33.629
  10:34:55 STEP 1025 H= 256:15 +CPU= 32.896
  10:35:28 STEP 1026 H= 256:30 +CPU= 32.970
  10:36:01 STEP 1027 H= 256:45 +CPU= 32.862
  10:36:35 STEP 1028 H= 257:00 +CPU= 33.687
  10:37:08 STEP 1029 H= 257:15 +CPU= 32.873
  10:37:42 STEP 1030 H= 257:30 +CPU= 32.945
  10:38:15 STEP 1031 H= 257:45 +CPU= 32.934
  10:38:57 STEP 1032 H= 258:00 +CPU= 41.389
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001032
  10:39:30 STEP 1033 H= 258:15 +CPU= 33.084
  10:40:03 STEP 1034 H= 258:30 +CPU= 33.032
  10:40:37 STEP 1035 H= 258:45 +CPU= 32.898
  10:41:11 STEP 1036 H= 259:00 +CPU= 33.692
  10:41:44 STEP 1037 H= 259:15 +CPU= 33.066
  10:42:18 STEP 1038 H= 259:30 +CPU= 33.066
  10:42:51 STEP 1039 H= 259:45 +CPU= 32.925
  10:43:25 STEP 1040 H= 260:00 +CPU= 33.711
  10:43:58 STEP 1041 H= 260:15 +CPU= 32.870
  10:44:32 STEP 1042 H= 260:30 +CPU= 33.049
  10:45:05 STEP 1043 H= 260:45 +CPU= 32.838
  10:45:46 STEP 1044 H= 261:00 +CPU= 41.006
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001044
  10:46:19 STEP 1045 H= 261:15 +CPU= 32.741
  10:46:53 STEP 1046 H= 261:30 +CPU= 32.953
  10:47:26 STEP 1047 H= 261:45 +CPU= 32.800
  10:48:00 STEP 1048 H= 262:00 +CPU= 33.905
  10:48:34 STEP 1049 H= 262:15 +CPU= 33.774
  10:49:09 STEP 1050 H= 262:30 +CPU= 33.985
  10:49:43 STEP 1051 H= 262:45 +CPU= 33.224
  10:50:18 STEP 1052 H= 263:00 +CPU= 34.853
  10:50:51 STEP 1053 H= 263:15 +CPU= 32.967
  10:51:24 STEP 1054 H= 263:30 +CPU= 32.629
  10:51:58 STEP 1055 H= 263:45 +CPU= 33.686
  10:52:46 STEP 1056 H= 264:00 +CPU= 46.889
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0_r1447071482_10.zip
Uploading the intermediate file: upload_file_10.zip
  10:53:29 STEP 1057 H= 264:15 +CPU= 32.824
  10:54:06 STEP 1058 H= 264:30 +CPU= 33.762
  10:54:40 STEP 1059 H= 264:45 +CPU= 33.724
  10:55:15 STEP 1060 H= 265:00 +CPU= 35.303
  10:55:51 STEP 1061 H= 265:15 +CPU= 34.895
  10:56:25 STEP 1062 H= 265:30 +CPU= 33.778
  10:56:59 STEP 1063 H= 265:45 +CPU= 33.764
  10:57:34 STEP 1064 H= 266:00 +CPU= 35.060
  10:58:08 STEP 1065 H= 266:15 +CPU= 33.386
  10:58:43 STEP 1066 H= 266:30 +CPU= 34.391
  10:59:17 STEP 1067 H= 266:45 +CPU= 33.495
  10:59:59 STEP 1068 H= 267:00 +CPU= 41.618
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001068
  11:00:33 STEP 1069 H= 267:15 +CPU= 33.717
  11:01:07 STEP 1070 H= 267:30 +CPU= 33.255
  11:01:40 STEP 1071 H= 267:45 +CPU= 33.098
  11:02:14 STEP 1072 H= 268:00 +CPU= 33.807
  11:02:47 STEP 1073 H= 268:15 +CPU= 33.079
  11:03:21 STEP 1074 H= 268:30 +CPU= 33.123
  11:03:54 STEP 1075 H= 268:45 +CPU= 33.101
  11:04:28 STEP 1076 H= 269:00 +CPU= 33.703
  11:05:02 STEP 1077 H= 269:15 +CPU= 33.042
  11:05:36 STEP 1078 H= 269:30 +CPU= 33.925
  11:06:10 STEP 1079 H= 269:45 +CPU= 33.691
  11:06:53 STEP 1080 H= 270:00 +CPU= 42.218
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001080
  11:07:26 STEP 1081 H= 270:15 +CPU= 33.065
  11:08:01 STEP 1082 H= 270:30 +CPU= 34.055
  11:08:34 STEP 1083 H= 270:45 +CPU= 32.956
  11:09:09 STEP 1084 H= 271:00 +CPU= 34.046
  11:09:43 STEP 1085 H= 271:15 +CPU= 34.433
  11:10:17 STEP 1086 H= 271:30 +CPU= 33.233
  11:10:50 STEP 1087 H= 271:45 +CPU= 32.995
  11:11:26 STEP 1088 H= 272:00 +CPU= 35.428
  11:12:02 STEP 1089 H= 272:15 +CPU= 35.193
  11:12:38 STEP 1090 H= 272:30 +CPU= 35.627
  11:13:10 STEP 1091 H= 272:45 +CPU= 32.369
  11:13:52 STEP 1092 H= 273:00 +CPU= 41.247
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001092
  11:14:26 STEP 1093 H= 273:15 +CPU= 32.868
  11:14:59 STEP 1094 H= 273:30 +CPU= 32.938
  11:15:32 STEP 1095 H= 273:45 +CPU= 32.705
  11:16:07 STEP 1096 H= 274:00 +CPU= 34.953
  11:16:41 STEP 1097 H= 274:15 +CPU= 33.746
  11:17:14 STEP 1098 H= 274:30 +CPU= 32.744
  11:17:48 STEP 1099 H= 274:45 +CPU= 33.300
  11:18:24 STEP 1100 H= 275:00 +CPU= 35.047
  11:18:58 STEP 1101 H= 275:15 +CPU= 33.831
  11:19:31 STEP 1102 H= 275:30 +CPU= 32.913
  11:20:04 STEP 1103 H= 275:45 +CPU= 32.949
  11:20:52 STEP 1104 H= 276:00 +CPU= 46.271
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001104
  11:21:28 STEP 1105 H= 276:15 +CPU= 34.185
  11:22:03 STEP 1106 H= 276:30 +CPU= 33.985
  11:22:37 STEP 1107 H= 276:45 +CPU= 33.630
  11:23:11 STEP 1108 H= 277:00 +CPU= 34.022
  11:23:45 STEP 1109 H= 277:15 +CPU= 33.144
  11:24:18 STEP 1110 H= 277:30 +CPU= 33.201
  11:24:52 STEP 1111 H= 277:45 +CPU= 33.078
  11:25:26 STEP 1112 H= 278:00 +CPU= 33.913
  11:26:00 STEP 1113 H= 278:15 +CPU= 33.200
  11:26:33 STEP 1114 H= 278:30 +CPU= 33.170
  11:27:06 STEP 1115 H= 278:45 +CPU= 32.983
  11:27:48 STEP 1116 H= 279:00 +CPU= 41.159
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001116
  11:28:21 STEP 1117 H= 279:15 +CPU= 33.067
  11:28:55 STEP 1118 H= 279:30 +CPU= 33.240
  11:29:29 STEP 1119 H= 279:45 +CPU= 33.839
  11:30:03 STEP 1120 H= 280:00 +CPU= 33.435
  11:30:37 STEP 1121 H= 280:15 +CPU= 33.278
  11:31:10 STEP 1122 H= 280:30 +CPU= 33.146
  11:31:44 STEP 1123 H= 280:45 +CPU= 33.206
  11:32:18 STEP 1124 H= 281:00 +CPU= 34.060
  11:32:52 STEP 1125 H= 281:15 +CPU= 33.243
  11:33:25 STEP 1126 H= 281:30 +CPU= 33.224
  11:33:59 STEP 1127 H= 281:45 +CPU= 33.033
  11:34:41 STEP 1128 H= 282:00 +CPU= 41.294
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001128
  11:35:14 STEP 1129 H= 282:15 +CPU= 33.063
  11:35:47 STEP 1130 H= 282:30 +CPU= 33.005
  11:36:21 STEP 1131 H= 282:45 +CPU= 32.996
  11:36:55 STEP 1132 H= 283:00 +CPU= 33.942
  11:37:28 STEP 1133 H= 283:15 +CPU= 33.034
  11:38:02 STEP 1134 H= 283:30 +CPU= 33.079
  11:38:35 STEP 1135 H= 283:45 +CPU= 33.095
  11:39:09 STEP 1136 H= 284:00 +CPU= 33.737
  11:39:43 STEP 1137 H= 284:15 +CPU= 33.100
  11:40:16 STEP 1138 H= 284:30 +CPU= 33.125
  11:40:51 STEP 1139 H= 284:45 +CPU= 34.312
  11:41:36 STEP 1140 H= 285:00 +CPU= 44.866
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001140
  11:42:11 STEP 1141 H= 285:15 +CPU= 33.934
  11:42:44 STEP 1142 H= 285:30 +CPU= 33.132
  11:43:18 STEP 1143 H= 285:45 +CPU= 32.933
  11:43:52 STEP 1144 H= 286:00 +CPU= 33.657
  11:44:25 STEP 1145 H= 286:15 +CPU= 32.941
  11:44:58 STEP 1146 H= 286:30 +CPU= 33.012
  11:45:32 STEP 1147 H= 286:45 +CPU= 32.942
  11:46:06 STEP 1148 H= 287:00 +CPU= 33.748
  11:46:40 STEP 1149 H= 287:15 +CPU= 34.256
  11:47:15 STEP 1150 H= 287:30 +CPU= 34.195
  11:47:49 STEP 1151 H= 287:45 +CPU= 32.732
  11:48:36 STEP 1152 H= 288:00 +CPU= 45.635
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0_r1447071482_11.zip
Uploading the intermediate file: upload_file_11.zip
  11:49:19 STEP 1153 H= 288:15 +CPU= 31.648
  11:49:53 STEP 1154 H= 288:30 +CPU= 32.958
  11:50:28 STEP 1155 H= 288:45 +CPU= 34.481
  11:51:06 STEP 1156 H= 289:00 +CPU= 35.179
  11:51:40 STEP 1157 H= 289:15 +CPU= 33.398
  11:52:14 STEP 1158 H= 289:30 +CPU= 33.823
  11:52:48 STEP 1159 H= 289:45 +CPU= 33.914
  11:53:22 STEP 1160 H= 290:00 +CPU= 33.855
  11:53:57 STEP 1161 H= 290:15 +CPU= 33.828
  11:54:33 STEP 1162 H= 290:30 +CPU= 35.482
  11:55:06 STEP 1163 H= 290:45 +CPU= 33.288
  11:55:50 STEP 1164 H= 291:00 +CPU= 42.644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001164
  11:56:23 STEP 1165 H= 291:15 +CPU= 33.348
  11:56:58 STEP 1166 H= 291:30 +CPU= 33.505
  11:57:34 STEP 1167 H= 291:45 +CPU= 35.280
  11:58:08 STEP 1168 H= 292:00 +CPU= 33.828
  11:58:43 STEP 1169 H= 292:15 +CPU= 34.538
  11:59:18 STEP 1170 H= 292:30 +CPU= 34.174
  11:59:51 STEP 1171 H= 292:45 +CPU= 33.142
  12:00:27 STEP 1172 H= 293:00 +CPU= 35.375
  12:01:01 STEP 1173 H= 293:15 +CPU= 33.500
  12:01:35 STEP 1174 H= 293:30 +CPU= 33.810
  12:02:09 STEP 1175 H= 293:45 +CPU= 33.927
  12:02:52 STEP 1176 H= 294:00 +CPU= 42.047
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001176
  12:03:29 STEP 1177 H= 294:15 +CPU= 36.068
  12:04:04 STEP 1178 H= 294:30 +CPU= 34.895
  12:04:40 STEP 1179 H= 294:45 +CPU= 36.124
  12:05:14 STEP 1180 H= 295:00 +CPU= 33.553
  12:05:48 STEP 1181 H= 295:15 +CPU= 33.561
  12:06:23 STEP 1182 H= 295:30 +CPU= 34.038
  12:06:56 STEP 1183 H= 295:45 +CPU= 32.850
  12:07:31 STEP 1184 H= 296:00 +CPU= 33.449
  12:08:04 STEP 1185 H= 296:15 +CPU= 32.888
  12:08:38 STEP 1186 H= 296:30 +CPU= 32.896
  12:09:10 STEP 1187 H= 296:45 +CPU= 32.589
  12:09:52 STEP 1188 H= 297:00 +CPU= 41.435
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001188
  12:10:26 STEP 1189 H= 297:15 +CPU= 32.956
  12:10:59 STEP 1190 H= 297:30 +CPU= 33.046
  12:11:32 STEP 1191 H= 297:45 +CPU= 33.022
  12:12:06 STEP 1192 H= 298:00 +CPU= 33.669
  12:12:40 STEP 1193 H= 298:15 +CPU= 33.057
  12:13:13 STEP 1194 H= 298:30 +CPU= 33.010
  12:13:47 STEP 1195 H= 298:45 +CPU= 33.105
  12:14:21 STEP 1196 H= 299:00 +CPU= 33.693
  12:14:54 STEP 1197 H= 299:15 +CPU= 33.016
  12:15:27 STEP 1198 H= 299:30 +CPU= 33.123
  12:16:01 STEP 1199 H= 299:45 +CPU= 32.784
  12:16:48 STEP 1200 H= 300:00 +CPU= 46.426
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001200
  12:17:24 STEP 1201 H= 300:15 +CPU= 33.525
  12:18:01 STEP 1202 H= 300:30 +CPU= 36.499
  12:18:35 STEP 1203 H= 300:45 +CPU= 33.427
  12:19:09 STEP 1204 H= 301:00 +CPU= 33.446
  12:19:44 STEP 1205 H= 301:15 +CPU= 34.974
  12:20:19 STEP 1206 H= 301:30 +CPU= 33.906
  12:20:52 STEP 1207 H= 301:45 +CPU= 32.736
  12:21:27 STEP 1208 H= 302:00 +CPU= 34.964
  12:22:01 STEP 1209 H= 302:15 +CPU= 33.211
  12:22:34 STEP 1210 H= 302:30 +CPU= 33.160
  12:23:07 STEP 1211 H= 302:45 +CPU= 32.898
  12:23:49 STEP 1212 H= 303:00 +CPU= 41.448
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001212
  12:24:23 STEP 1213 H= 303:15 +CPU= 33.119
  12:24:57 STEP 1214 H= 303:30 +CPU= 33.304
  12:25:30 STEP 1215 H= 303:45 +CPU= 33.337
  12:26:04 STEP 1216 H= 304:00 +CPU= 33.772
  12:26:38 STEP 1217 H= 304:15 +CPU= 33.109
  12:27:12 STEP 1218 H= 304:30 +CPU= 34.101
  12:27:46 STEP 1219 H= 304:45 +CPU= 33.123
  12:28:20 STEP 1220 H= 305:00 +CPU= 33.629
  12:28:53 STEP 1221 H= 305:15 +CPU= 32.995
  12:29:28 STEP 1222 H= 305:30 +CPU= 34.301
  12:30:02 STEP 1223 H= 305:45 +CPU= 33.218
  12:30:44 STEP 1224 H= 306:00 +CPU= 42.303
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001224
  12:31:18 STEP 1225 H= 306:15 +CPU= 33.315
  12:31:51 STEP 1226 H= 306:30 +CPU= 33.103
  12:32:25 STEP 1227 H= 306:45 +CPU= 33.406
  12:32:59 STEP 1228 H= 307:00 +CPU= 33.623
  12:33:35 STEP 1229 H= 307:15 +CPU= 35.816
  12:34:11 STEP 1230 H= 307:30 +CPU= 35.495
  12:34:48 STEP 1231 H= 307:45 +CPU= 35.931
  12:35:22 STEP 1232 H= 308:00 +CPU= 34.123
  12:35:56 STEP 1233 H= 308:15 +CPU= 33.333
  12:36:29 STEP 1234 H= 308:30 +CPU= 33.037
  12:37:04 STEP 1235 H= 308:45 +CPU= 34.421
  12:37:48 STEP 1236 H= 309:00 +CPU= 43.517
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001236
  12:38:23 STEP 1237 H= 309:15 +CPU= 34.549
  12:38:59 STEP 1238 H= 309:30 +CPU= 35.315
  12:39:32 STEP 1239 H= 309:45 +CPU= 33.020
  12:40:06 STEP 1240 H= 310:00 +CPU= 33.814
  12:40:40 STEP 1241 H= 310:15 +CPU= 33.108
  12:41:13 STEP 1242 H= 310:30 +CPU= 33.024
  12:41:47 STEP 1243 H= 310:45 +CPU= 33.078
  12:42:21 STEP 1244 H= 311:00 +CPU= 33.761
  12:42:54 STEP 1245 H= 311:15 +CPU= 32.914
  12:43:27 STEP 1246 H= 311:30 +CPU= 33.069
  12:44:01 STEP 1247 H= 311:45 +CPU= 32.922
  12:44:51 STEP 1248 H= 312:00 +CPU= 45.179
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0_r1447071482_12.zip
Uploading the intermediate file: upload_file_12.zip
  12:45:31 STEP 1249 H= 312:15 +CPU= 31.791
  12:46:05 STEP 1250 H= 312:30 +CPU= 33.237
  12:46:39 STEP 1251 H= 312:45 +CPU= 33.189
  12:47:14 STEP 1252 H= 313:00 +CPU= 34.601
  12:47:51 STEP 1253 H= 313:15 +CPU= 34.559
  12:48:25 STEP 1254 H= 313:30 +CPU= 33.739
  12:48:59 STEP 1255 H= 313:45 +CPU= 33.523
  12:49:34 STEP 1256 H= 314:00 +CPU= 34.974
  12:50:08 STEP 1257 H= 314:15 +CPU= 33.790
  12:50:42 STEP 1258 H= 314:30 +CPU= 33.617
  12:51:16 STEP 1259 H= 314:45 +CPU= 33.656
  12:51:59 STEP 1260 H= 315:00 +CPU= 41.751
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001260
  12:52:33 STEP 1261 H= 315:15 +CPU= 33.478
  12:53:06 STEP 1262 H= 315:30 +CPU= 33.365
  12:53:40 STEP 1263 H= 315:45 +CPU= 33.402
  12:54:15 STEP 1264 H= 316:00 +CPU= 34.003
  12:54:48 STEP 1265 H= 316:15 +CPU= 33.277
  12:55:22 STEP 1266 H= 316:30 +CPU= 33.269
  12:55:55 STEP 1267 H= 316:45 +CPU= 33.160
  12:56:30 STEP 1268 H= 317:00 +CPU= 33.797
  12:57:03 STEP 1269 H= 317:15 +CPU= 32.980
  12:57:37 STEP 1270 H= 317:30 +CPU= 33.250
  12:58:10 STEP 1271 H= 317:45 +CPU= 33.099
  12:58:52 STEP 1272 H= 318:00 +CPU= 41.296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001272
  12:59:25 STEP 1273 H= 318:15 +CPU= 32.884
  12:59:59 STEP 1274 H= 318:30 +CPU= 33.377
  13:00:34 STEP 1275 H= 318:45 +CPU= 34.659
  13:01:08 STEP 1276 H= 319:00 +CPU= 33.724
  13:01:43 STEP 1277 H= 319:15 +CPU= 34.807
  13:02:17 STEP 1278 H= 319:30 +CPU= 33.832
  13:02:51 STEP 1279 H= 319:45 +CPU= 33.306
  13:03:26 STEP 1280 H= 320:00 +CPU= 34.560
  13:04:00 STEP 1281 H= 320:15 +CPU= 32.995
  13:04:33 STEP 1282 H= 320:30 +CPU= 33.259
  13:05:07 STEP 1283 H= 320:45 +CPU= 33.335
  13:05:49 STEP 1284 H= 321:00 +CPU= 41.780
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001284
  13:06:24 STEP 1285 H= 321:15 +CPU= 34.515
  13:06:59 STEP 1286 H= 321:30 +CPU= 34.249
  13:07:32 STEP 1287 H= 321:45 +CPU= 33.005
  13:08:07 STEP 1288 H= 322:00 +CPU= 34.038
  13:08:40 STEP 1289 H= 322:15 +CPU= 32.939
  13:09:14 STEP 1290 H= 322:30 +CPU= 34.023
  13:09:48 STEP 1291 H= 322:45 +CPU= 33.463
  13:10:23 STEP 1292 H= 323:00 +CPU= 34.218
  13:10:57 STEP 1293 H= 323:15 +CPU= 33.527
  13:11:31 STEP 1294 H= 323:30 +CPU= 33.478
  13:12:04 STEP 1295 H= 323:45 +CPU= 33.115
  13:12:52 STEP 1296 H= 324:00 +CPU= 46.308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001296
  13:13:27 STEP 1297 H= 324:15 +CPU= 33.004
  13:14:01 STEP 1298 H= 324:30 +CPU= 33.705
  13:14:35 STEP 1299 H= 324:45 +CPU= 33.653
  13:15:10 STEP 1300 H= 325:00 +CPU= 34.154
  13:15:44 STEP 1301 H= 325:15 +CPU= 33.496
  13:16:18 STEP 1302 H= 325:30 +CPU= 33.352
  13:16:52 STEP 1303 H= 325:45 +CPU= 33.521
  13:17:26 STEP 1304 H= 326:00 +CPU= 34.160
  13:18:00 STEP 1305 H= 326:15 +CPU= 33.471
  13:18:34 STEP 1306 H= 326:30 +CPU= 33.424
  13:19:07 STEP 1307 H= 326:45 +CPU= 33.234
  13:19:50 STEP 1308 H= 327:00 +CPU= 41.796
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001308
  13:20:23 STEP 1309 H= 327:15 +CPU= 33.262
  13:20:57 STEP 1310 H= 327:30 +CPU= 33.464
  13:21:32 STEP 1311 H= 327:45 +CPU= 34.669
  13:22:08 STEP 1312 H= 328:00 +CPU= 35.518
  13:22:42 STEP 1313 H= 328:15 +CPU= 33.136
  13:23:15 STEP 1314 H= 328:30 +CPU= 33.040
  13:23:49 STEP 1315 H= 328:45 +CPU= 33.123
  13:24:23 STEP 1316 H= 329:00 +CPU= 34.319
  13:24:58 STEP 1317 H= 329:15 +CPU= 34.100
  13:25:32 STEP 1318 H= 329:30 +CPU= 34.218
  13:26:07 STEP 1319 H= 329:45 +CPU= 34.487
  13:26:50 STEP 1320 H= 330:00 +CPU= 41.657
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001320
  13:27:23 STEP 1321 H= 330:15 +CPU= 33.338
  13:27:57 STEP 1322 H= 330:30 +CPU= 33.263
  13:28:30 STEP 1323 H= 330:45 +CPU= 33.135
  13:29:05 STEP 1324 H= 331:00 +CPU= 33.833
  13:29:38 STEP 1325 H= 331:15 +CPU= 33.044
  13:30:12 STEP 1326 H= 331:30 +CPU= 33.079
  13:30:45 STEP 1327 H= 331:45 +CPU= 33.110
  13:31:19 STEP 1328 H= 332:00 +CPU= 33.892
  13:31:53 STEP 1329 H= 332:15 +CPU= 33.134
  13:32:26 STEP 1330 H= 332:30 +CPU= 33.038
  13:32:59 STEP 1331 H= 332:45 +CPU= 32.876
  13:33:41 STEP 1332 H= 333:00 +CPU= 41.283
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001332
  13:34:15 STEP 1333 H= 333:15 +CPU= 33.180
  13:34:48 STEP 1334 H= 333:30 +CPU= 33.128
  13:35:22 STEP 1335 H= 333:45 +CPU= 33.141
  13:35:56 STEP 1336 H= 334:00 +CPU= 33.959
  13:36:29 STEP 1337 H= 334:15 +CPU= 32.914
  13:37:03 STEP 1338 H= 334:30 +CPU= 33.010
  13:37:36 STEP 1339 H= 334:45 +CPU= 33.236
  13:38:11 STEP 1340 H= 335:00 +CPU= 33.956
  13:38:44 STEP 1341 H= 335:15 +CPU= 33.027
  13:39:18 STEP 1342 H= 335:30 +CPU= 33.123
  13:39:51 STEP 1343 H= 335:45 +CPU= 32.891
  13:40:39 STEP 1344 H= 336:00 +CPU= 46.041
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0_r1447071482_13.zip
Uploading the intermediate file: upload_file_13.zip
  13:41:19 STEP 1345 H= 336:15 +CPU= 32.345
  13:41:55 STEP 1346 H= 336:30 +CPU= 33.053
  13:42:29 STEP 1347 H= 336:45 +CPU= 33.604
  13:43:05 STEP 1348 H= 337:00 +CPU= 34.897
  13:43:40 STEP 1349 H= 337:15 +CPU= 34.609
  13:44:15 STEP 1350 H= 337:30 +CPU= 34.536
  13:44:51 STEP 1351 H= 337:45 +CPU= 33.628
  13:45:26 STEP 1352 H= 338:00 +CPU= 34.531
  13:46:00 STEP 1353 H= 338:15 +CPU= 33.659
  13:46:34 STEP 1354 H= 338:30 +CPU= 33.628
  13:47:08 STEP 1355 H= 338:45 +CPU= 33.390
  13:47:50 STEP 1356 H= 339:00 +CPU= 41.903
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001356
  13:48:24 STEP 1357 H= 339:15 +CPU= 33.514
  13:48:58 STEP 1358 H= 339:30 +CPU= 33.303
  13:49:31 STEP 1359 H= 339:45 +CPU= 33.152
  13:50:06 STEP 1360 H= 340:00 +CPU= 34.554
  13:50:40 STEP 1361 H= 340:15 +CPU= 33.411
  13:51:14 STEP 1362 H= 340:30 +CPU= 33.409
  13:51:49 STEP 1363 H= 340:45 +CPU= 34.166
  13:52:23 STEP 1364 H= 341:00 +CPU= 33.914
  13:52:58 STEP 1365 H= 341:15 +CPU= 34.756
  13:53:31 STEP 1366 H= 341:30 +CPU= 33.086
  13:54:05 STEP 1367 H= 341:45 +CPU= 33.647
  13:54:49 STEP 1368 H= 342:00 +CPU= 43.463
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001368
  13:55:23 STEP 1369 H= 342:15 +CPU= 32.962
  13:55:56 STEP 1370 H= 342:30 +CPU= 33.225
  13:56:30 STEP 1371 H= 342:45 +CPU= 33.158
  13:57:07 STEP 1372 H= 343:00 +CPU= 35.885
  13:57:41 STEP 1373 H= 343:15 +CPU= 34.036
  13:58:17 STEP 1374 H= 343:30 +CPU= 34.938
  13:58:51 STEP 1375 H= 343:45 +CPU= 34.239
  13:59:27 STEP 1376 H= 344:00 +CPU= 35.336
  14:00:01 STEP 1377 H= 344:15 +CPU= 33.340
  14:00:35 STEP 1378 H= 344:30 +CPU= 34.053
  14:01:09 STEP 1379 H= 344:45 +CPU= 33.489
  14:01:51 STEP 1380 H= 345:00 +CPU= 41.191
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001380
  14:02:25 STEP 1381 H= 345:15 +CPU= 33.571
  14:03:00 STEP 1382 H= 345:30 +CPU= 34.084
  14:03:34 STEP 1383 H= 345:45 +CPU= 34.422
  14:04:09 STEP 1384 H= 346:00 +CPU= 34.042
  14:04:44 STEP 1385 H= 346:15 +CPU= 34.679
  14:05:17 STEP 1386 H= 346:30 +CPU= 33.313
  14:05:51 STEP 1387 H= 346:45 +CPU= 33.742
  14:06:27 STEP 1388 H= 347:00 +CPU= 35.214
  14:07:01 STEP 1389 H= 347:15 +CPU= 33.404
  14:07:36 STEP 1390 H= 347:30 +CPU= 33.220
  14:08:09 STEP 1391 H= 347:45 +CPU= 32.655
  14:08:58 STEP 1392 H= 348:00 +CPU= 46.978
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001392
  14:09:33 STEP 1393 H= 348:15 +CPU= 33.180
  14:10:07 STEP 1394 H= 348:30 +CPU= 33.707
  14:10:41 STEP 1395 H= 348:45 +CPU= 33.218
  14:11:16 STEP 1396 H= 349:00 +CPU= 34.851
  14:11:50 STEP 1397 H= 349:15 +CPU= 33.122
  14:12:23 STEP 1398 H= 349:30 +CPU= 33.423
  14:12:58 STEP 1399 H= 349:45 +CPU= 34.419
  14:13:34 STEP 1400 H= 350:00 +CPU= 35.609
  14:14:08 STEP 1401 H= 350:15 +CPU= 33.029
  14:14:41 STEP 1402 H= 350:30 +CPU= 33.015
  14:15:14 STEP 1403 H= 350:45 +CPU= 32.865
  14:15:56 STEP 1404 H= 351:00 +CPU= 41.236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001404
  14:16:31 STEP 1405 H= 351:15 +CPU= 34.256
  14:17:08 STEP 1406 H= 351:30 +CPU= 36.373
  14:17:43 STEP 1407 H= 351:45 +CPU= 35.284
  14:18:19 STEP 1408 H= 352:00 +CPU= 35.677
  14:18:54 STEP 1409 H= 352:15 +CPU= 34.113
  14:19:29 STEP 1410 H= 352:30 +CPU= 35.075
  14:20:03 STEP 1411 H= 352:45 +CPU= 32.960
  14:20:37 STEP 1412 H= 353:00 +CPU= 33.688
  14:21:11 STEP 1413 H= 353:15 +CPU= 34.218
  14:21:45 STEP 1414 H= 353:30 +CPU= 33.556
  14:22:18 STEP 1415 H= 353:45 +CPU= 32.729
  14:23:02 STEP 1416 H= 354:00 +CPU= 42.798
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001416
  14:23:37 STEP 1417 H= 354:15 +CPU= 34.513
  14:24:10 STEP 1418 H= 354:30 +CPU= 33.126
  14:24:44 STEP 1419 H= 354:45 +CPU= 32.996
  14:25:18 STEP 1420 H= 355:00 +CPU= 33.561
  14:25:51 STEP 1421 H= 355:15 +CPU= 33.341
  14:26:26 STEP 1422 H= 355:30 +CPU= 34.525
  14:27:00 STEP 1423 H= 355:45 +CPU= 33.079
  14:27:34 STEP 1424 H= 356:00 +CPU= 33.765
  14:28:08 STEP 1425 H= 356:15 +CPU= 33.206
  14:28:41 STEP 1426 H= 356:30 +CPU= 33.197
  14:29:14 STEP 1427 H= 356:45 +CPU= 32.928
  14:29:56 STEP 1428 H= 357:00 +CPU= 41.461
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001428
  14:30:30 STEP 1429 H= 357:15 +CPU= 33.117
  14:31:03 STEP 1430 H= 357:30 +CPU= 33.119
  14:31:37 STEP 1431 H= 357:45 +CPU= 33.337
  14:32:11 STEP 1432 H= 358:00 +CPU= 33.936
  14:32:45 STEP 1433 H= 358:15 +CPU= 33.221
  14:33:18 STEP 1434 H= 358:30 +CPU= 33.174
  14:33:52 STEP 1435 H= 358:45 +CPU= 33.241
  14:34:27 STEP 1436 H= 359:00 +CPU= 34.020
  14:35:00 STEP 1437 H= 359:15 +CPU= 33.147
  14:35:34 STEP 1438 H= 359:30 +CPU= 33.291
  14:36:07 STEP 1439 H= 359:45 +CPU= 33.040
  14:36:53 STEP 1440 H= 360:00 +CPU= 43.739
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.5379606186E-21      I       0.1159677841E-06      I
ICloud fractionI      0.0000000000E+00      I       0.8380537837E-03      I
I  Relat. Hum. I      0.1952767376E-01      I       0.5940391551E-01      I
I  PASS 01     I      0.0000000000E+00      I       0.1139493036E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    295565377 BYTES IN      7 RECORDS TRANSFERRED IN    0.0008 SECONDS369456.7 Mbytes/s, TOTAL TIME=    0.0160( 5.0%)
 14:36:53 STEP 1440 H= 360:00 +CPU= 43.739
 END CNT3
 NSTEP =  1440 CNT0   000000000  31.581  31.581  32.634   0.968               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        14180/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    253    0       34      1044068    14180 ************    46.8     8.9    37.9    10.6    71.6
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.92      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  521    5331.3    5331.3     16.51      0.00
   9 SPCM     - SPECTRAL COMP.                     480     736.6     736.6      2.10      0.00
  10 SCAN2M - PHYSICS                              481   16921.0   16921.0     48.38      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 40    1268.4    1268.4      0.30      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 21      35.6      35.6      0.00      0.00
  17 GRIDFPOS IN CNT4                               40      38.5      38.5      0.01      0.00
  27 RESTART FILES - WRITING                        10    5073.5    5073.5      0.30      0.00
  28 RESTART FILES - READING                         1   11368.3   11368.3      0.07      0.00
  29 SU4FPOS IN CNT4                                40       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                40    7579.2    7579.2      1.80      0.00
  31 POSDDH IN STEPO                                 3       1.5       1.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    481    7907.0    7907.0     22.61      0.00
  39 SU0YOMB                                         1     881.0     881.0      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    481      22.6      22.6      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              480     368.3     368.3      1.05      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              480      67.3      67.3      0.19      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 21       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1044     480.7     480.7      2.98      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1000     273.3     273.3      1.62      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1000      92.1      92.1      0.55      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1044     129.5     129.5      0.80      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     162.0     162.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1044      64.0      64.0      0.40      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1000      35.4      35.4      0.21      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1044      56.9      56.9      0.35      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1000      29.6      29.6      0.18      0.00
 400 GSTATS                                      56453       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 52473       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    16823.6 CPU TIME   16544.2 VECTOR TIME    16544.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       77.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/3/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/3/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211843/ICMSHh7zg+001404
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0_r1447071482_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
14:40:26 (1992): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:52:12 1537334 22312093 oifs_43r3_bl_a3wg_2016092300_15_991_12211843_0 1,295,100 49,847 0.0385


©2024 climateprediction.net