climateprediction.net home page
Task 22442429

Task 22442429

Name oifs_43r3_bl_a0ev_2016092300_20_1018_12288862_0
Workunit 12288862
Created 12 Jun 2024, 20:45:03 UTC
Sent 13 Jun 2024, 12:17:42 UTC
Report deadline 12 Aug 2024, 12:17:42 UTC
Received 14 Jun 2024, 15:25:13 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1550999
Run time 12 hours 1 min 47 sec
CPU time 11 hours 22 min 7 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 7.29 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,018.87 MB
Peak swap size 5,981.13 MB
Peak disk usage 2,026.50 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
ient/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ev_2016092300_20_1018_12288862_0_r674344116_17.zip
Uploading the intermediate file: upload_file_17.zip
  14:51:43 STEP 1729 H= 432:15 +CPU= 21.457
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0ev
(argv4) batchid: 1018
(argv5) wuid: 12288862
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/23
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/23/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/23/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d6f6aa4fdcaac424fa4acbfd49773a59 to: /var/lib/boinc-client/slots/23/oifs_43r3_bl_a0ev_2016092300_20_1018_12288862.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/23/oifs_43r3_bl_a0ev_2016092300_20_1018_12288862.zip
ic_ancil_file: ic_ancil_12288862
ifsdata_file: ifsdata_12288862
climate_data_file: clim_data_12288862
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/23/ic_ancil_12288862.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/23/ic_ancil_12288862.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_841aa3788958720b7d2a4ba55534216a to: /var/lib/boinc-client/slots/23/ifsdata/ifsdata_12288862.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/23/ifsdata/ifsdata_12288862.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/23/159l_2/clim_data_12288862.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/23/159l_2/clim_data_12288862.zip
Checking for progress XML file: /var/lib/boinc-client/slots/23/progress_file_12288862.xml
Opened progress file ok : /var/lib/boinc-client/slots/23/progress_file_12288862.xml
-- Model is restarting --
Adjusting last_iter, 1729, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/23/progress_file_12288862.xml
last_cpu_time: 36714
upload_file_number: 18
last_iter: 1729
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a0ev_2016092300_20_1018_12288862_0_r674344116
The child process has been launched with process id: 173888
Executing the command: /var/lib/boinc-client/slots/23/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:kalisek:1:1:173888:173888] [20240614:145333:1718369613:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:54:02 STEP 1728 H= 432:00 +CPU= 21.206
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:54:38 STEP 1729 H= 432:15 +CPU= 21.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:55:02 STEP 1730 H= 432:30 +CPU= 22.043
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:55:29 STEP 1731 H= 432:45 +CPU= 23.876
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:56:00 STEP 1732 H= 433:00 +CPU= 25.522
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:56:24 STEP 1733 H= 433:15 +CPU= 21.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:56:55 STEP 1734 H= 433:30 +CPU= 25.457
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:57:21 STEP 1735 H= 433:45 +CPU= 23.049
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:57:47 STEP 1736 H= 434:00 +CPU= 23.426
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:58:25 STEP 1737 H= 434:15 +CPU= 22.334
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:59:05 STEP 1738 H= 434:30 +CPU= 23.786
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:01:33 STEP 1739 H= 434:45 +CPU= 23.961
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:02:56 STEP 1740 H= 435:00 +CPU= 32.406
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:03:19 STEP 1741 H= 435:15 +CPU= 20.714
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:03:44 STEP 1742 H= 435:30 +CPU= 20.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:04:05 STEP 1743 H= 435:45 +CPU= 19.708
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:04:27 STEP 1744 H= 436:00 +CPU= 19.828
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:04:50 STEP 1745 H= 436:15 +CPU= 20.279
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:05:12 STEP 1746 H= 436:30 +CPU= 19.959
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:05:33 STEP 1747 H= 436:45 +CPU= 18.545
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:05:55 STEP 1748 H= 437:00 +CPU= 19.897
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:06:17 STEP 1749 H= 437:15 +CPU= 19.629
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:06:41 STEP 1750 H= 437:30 +CPU= 20.194
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:07:06 STEP 1751 H= 437:45 +CPU= 22.478
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:07:37 STEP 1752 H= 438:00 +CPU= 28.178
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:08:05 STEP 1753 H= 438:15 +CPU= 22.781
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:08:42 STEP 1754 H= 438:30 +CPU= 22.354
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:09:06 STEP 1755 H= 438:45 +CPU= 21.680
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:09:34 STEP 1756 H= 439:00 +CPU= 23.099
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:09:58 STEP 1757 H= 439:15 +CPU= 21.610
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:10:21 STEP 1758 H= 439:30 +CPU= 20.935
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:10:44 STEP 1759 H= 439:45 +CPU= 20.397
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:11:07 STEP 1760 H= 440:00 +CPU= 21.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:11:29 STEP 1761 H= 440:15 +CPU= 19.643
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:11:54 STEP 1762 H= 440:30 +CPU= 20.468
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:12:18 STEP 1763 H= 440:45 +CPU= 21.716
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:12:48 STEP 1764 H= 441:00 +CPU= 27.520
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001764
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:13:13 STEP 1765 H= 441:15 +CPU= 20.465
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:13:36 STEP 1766 H= 441:30 +CPU= 20.181
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:14:00 STEP 1767 H= 441:45 +CPU= 21.977
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:14:24 STEP 1768 H= 442:00 +CPU= 21.593
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:14:47 STEP 1769 H= 442:15 +CPU= 20.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:15:13 STEP 1770 H= 442:30 +CPU= 20.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:15:37 STEP 1771 H= 442:45 +CPU= 21.740
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:16:02 STEP 1772 H= 443:00 +CPU= 22.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:16:27 STEP 1773 H= 443:15 +CPU= 22.346
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:16:55 STEP 1774 H= 443:30 +CPU= 22.289
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:19:25 STEP 1775 H= 443:45 +CPU= 24.714
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:20:03 STEP 1776 H= 444:00 +CPU= 32.527
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:22:06 STEP 1777 H= 444:15 +CPU= 25.091
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:22:43 STEP 1778 H= 444:30 +CPU= 23.321
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:23:22 STEP 1779 H= 444:45 +CPU= 23.692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:23:49 STEP 1780 H= 445:00 +CPU= 23.824
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:24:16 STEP 1781 H= 445:15 +CPU= 23.521
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:24:46 STEP 1782 H= 445:30 +CPU= 24.950
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:25:13 STEP 1783 H= 445:45 +CPU= 24.303
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:25:54 STEP 1784 H= 446:00 +CPU= 25.589
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:26:22 STEP 1785 H= 446:15 +CPU= 24.924
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:27:03 STEP 1786 H= 446:30 +CPU= 25.187
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:27:43 STEP 1787 H= 446:45 +CPU= 24.237
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:28:14 STEP 1788 H= 447:00 +CPU= 27.385
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:28:39 STEP 1789 H= 447:15 +CPU= 22.011
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:29:06 STEP 1790 H= 447:30 +CPU= 22.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:29:44 STEP 1791 H= 447:45 +CPU= 22.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:30:08 STEP 1792 H= 448:00 +CPU= 21.105
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:30:31 STEP 1793 H= 448:15 +CPU= 21.165
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:30:56 STEP 1794 H= 448:30 +CPU= 21.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:31:21 STEP 1795 H= 448:45 +CPU= 20.873
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:31:47 STEP 1796 H= 449:00 +CPU= 23.450
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:33:48 STEP 1797 H= 449:15 +CPU= 23.046
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:34:26 STEP 1798 H= 449:30 +CPU= 21.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:34:49 STEP 1799 H= 449:45 +CPU= 20.570
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:35:19 STEP 1800 H= 450:00 +CPU= 25.558
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:35:42 STEP 1801 H= 450:15 +CPU= 20.694
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:36:05 STEP 1802 H= 450:30 +CPU= 20.893
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:36:28 STEP 1803 H= 450:45 +CPU= 20.251
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:36:52 STEP 1804 H= 451:00 +CPU= 20.457
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:37:15 STEP 1805 H= 451:15 +CPU= 20.153
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:37:37 STEP 1806 H= 451:30 +CPU= 19.890
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:37:59 STEP 1807 H= 451:45 +CPU= 20.005
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:38:22 STEP 1808 H= 452:00 +CPU= 20.383
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:38:44 STEP 1809 H= 452:15 +CPU= 19.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:39:05 STEP 1810 H= 452:30 +CPU= 19.225
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:39:26 STEP 1811 H= 452:45 +CPU= 18.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:39:55 STEP 1812 H= 453:00 +CPU= 24.387
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001812
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:40:16 STEP 1813 H= 453:15 +CPU= 19.555
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:40:38 STEP 1814 H= 453:30 +CPU= 19.964
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:01 STEP 1815 H= 453:45 +CPU= 19.959
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:23 STEP 1816 H= 454:00 +CPU= 20.008
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:41:45 STEP 1817 H= 454:15 +CPU= 19.595
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:42:07 STEP 1818 H= 454:30 +CPU= 19.757
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:42:29 STEP 1819 H= 454:45 +CPU= 19.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:42:53 STEP 1820 H= 455:00 +CPU= 20.102
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:43:15 STEP 1821 H= 455:15 +CPU= 19.479
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:43:38 STEP 1822 H= 455:30 +CPU= 20.424
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:00 STEP 1823 H= 455:45 +CPU= 20.171
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:44:33 STEP 1824 H= 456:00 +CPU= 28.631
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ev_2016092300_20_1018_12288862_0_r674344116_18.zip
Uploading the intermediate file: upload_file_18.zip
  15:44:53 STEP 1825 H= 456:15 +CPU= 19.377
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:16 STEP 1826 H= 456:30 +CPU= 20.525
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:45:38 STEP 1827 H= 456:45 +CPU= 20.361
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:02 STEP 1828 H= 457:00 +CPU= 21.223
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:25 STEP 1829 H= 457:15 +CPU= 20.556
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:46:48 STEP 1830 H= 457:30 +CPU= 20.779
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:13 STEP 1831 H= 457:45 +CPU= 20.299
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:47:37 STEP 1832 H= 458:00 +CPU= 21.947
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:00 STEP 1833 H= 458:15 +CPU= 20.226
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:23 STEP 1834 H= 458:30 +CPU= 21.061
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:48:45 STEP 1835 H= 458:45 +CPU= 20.086
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:15 STEP 1836 H= 459:00 +CPU= 25.131
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001836
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:49:37 STEP 1837 H= 459:15 +CPU= 20.304
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:00 STEP 1838 H= 459:30 +CPU= 20.002
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:22 STEP 1839 H= 459:45 +CPU= 19.863
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:50:45 STEP 1840 H= 460:00 +CPU= 20.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:08 STEP 1841 H= 460:15 +CPU= 20.926
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:33 STEP 1842 H= 460:30 +CPU= 20.133
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:51:56 STEP 1843 H= 460:45 +CPU= 21.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:19 STEP 1844 H= 461:00 +CPU= 21.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:52:42 STEP 1845 H= 461:15 +CPU= 20.542
  15:53:07 STEP 1846 H= 461:30 +CPU= 23.748
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:54:54 STEP 1847 H= 461:45 +CPU= 24.477
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:55:52 STEP 1848 H= 462:00 +CPU= 28.528
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001848
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:14 STEP 1849 H= 462:15 +CPU= 20.106
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:56:37 STEP 1850 H= 462:30 +CPU= 20.121
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:57:03 STEP 1851 H= 462:45 +CPU= 23.311
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:21 STEP 1852 H= 463:00 +CPU= 25.161
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:58:57 STEP 1853 H= 463:15 +CPU= 22.437
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:24 STEP 1854 H= 463:30 +CPU= 21.750
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  15:59:51 STEP 1855 H= 463:45 +CPU= 24.067
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:00:45 STEP 1856 H= 464:00 +CPU= 25.652
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:34 STEP 1857 H= 464:15 +CPU= 22.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:01:56 STEP 1858 H= 464:30 +CPU= 19.247
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:02:18 STEP 1859 H= 464:45 +CPU= 20.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:02:49 STEP 1860 H= 465:00 +CPU= 26.121
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001860
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:12 STEP 1861 H= 465:15 +CPU= 21.089
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:36 STEP 1862 H= 465:30 +CPU= 21.353
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:03:58 STEP 1863 H= 465:45 +CPU= 20.299
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:23 STEP 1864 H= 466:00 +CPU= 20.744
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:04:46 STEP 1865 H= 466:15 +CPU= 20.451
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:09 STEP 1866 H= 466:30 +CPU= 20.792
  16:05:31 STEP 1867 H= 466:45 +CPU= 20.903
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:05:54 STEP 1868 H= 467:00 +CPU= 21.197
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:06:18 STEP 1869 H= 467:15 +CPU= 21.239
  16:06:39 STEP 1870 H= 467:30 +CPU= 20.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:04 STEP 1871 H= 467:45 +CPU= 21.070
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:36 STEP 1872 H= 468:00 +CPU= 28.796
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:07:59 STEP 1873 H= 468:15 +CPU= 20.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:23 STEP 1874 H= 468:30 +CPU= 20.292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:08:46 STEP 1875 H= 468:45 +CPU= 20.302
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:10 STEP 1876 H= 469:00 +CPU= 21.438
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:32 STEP 1877 H= 469:15 +CPU= 20.069
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:09:54 STEP 1878 H= 469:30 +CPU= 20.006
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:16 STEP 1879 H= 469:45 +CPU= 19.760
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:10:39 STEP 1880 H= 470:00 +CPU= 20.377
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:03 STEP 1881 H= 470:15 +CPU= 20.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:26 STEP 1882 H= 470:30 +CPU= 20.908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:11:49 STEP 1883 H= 470:45 +CPU= 20.577
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:18 STEP 1884 H= 471:00 +CPU= 26.408
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:12:42 STEP 1885 H= 471:15 +CPU= 20.471
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:06 STEP 1886 H= 471:30 +CPU= 20.902
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:28 STEP 1887 H= 471:45 +CPU= 20.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:13:52 STEP 1888 H= 472:00 +CPU= 20.946
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:15 STEP 1889 H= 472:15 +CPU= 20.436
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:14:38 STEP 1890 H= 472:30 +CPU= 21.043
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:17 STEP 1891 H= 472:45 +CPU= 22.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:15:44 STEP 1892 H= 473:00 +CPU= 22.417
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:06 STEP 1893 H= 473:15 +CPU= 19.378
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:29 STEP 1894 H= 473:30 +CPU= 20.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:16:52 STEP 1895 H= 473:45 +CPU= 20.720
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:19 STEP 1896 H= 474:00 +CPU= 25.292
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:17:44 STEP 1897 H= 474:15 +CPU= 20.650
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:18:06 STEP 1898 H= 474:30 +CPU= 19.425
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:18:27 STEP 1899 H= 474:45 +CPU= 19.268
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:18:50 STEP 1900 H= 475:00 +CPU= 20.551
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:14 STEP 1901 H= 475:15 +CPU= 21.202
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:19:39 STEP 1902 H= 475:30 +CPU= 22.609
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:04 STEP 1903 H= 475:45 +CPU= 21.205
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:29 STEP 1904 H= 476:00 +CPU= 22.326
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:20:52 STEP 1905 H= 476:15 +CPU= 21.204
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:16 STEP 1906 H= 476:30 +CPU= 21.048
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:21:39 STEP 1907 H= 476:45 +CPU= 20.661
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:22:10 STEP 1908 H= 477:00 +CPU= 26.749
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001908
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:22:33 STEP 1909 H= 477:15 +CPU= 20.674
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:22:56 STEP 1910 H= 477:30 +CPU= 20.393
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:18 STEP 1911 H= 477:45 +CPU= 20.598
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:23:44 STEP 1912 H= 478:00 +CPU= 21.054
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:07 STEP 1913 H= 478:15 +CPU= 21.140
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:30 STEP 1914 H= 478:30 +CPU= 20.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:24:53 STEP 1915 H= 478:45 +CPU= 20.813
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:25:17 STEP 1916 H= 479:00 +CPU= 21.291
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:25:42 STEP 1917 H= 479:15 +CPU= 20.263
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:04 STEP 1918 H= 479:30 +CPU= 20.276
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:29 STEP 1919 H= 479:45 +CPU= 21.510
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  16:26:58 STEP 1920 H= 480:00 +CPU= 26.702
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1475567049E-20      I       0.5857584264E-06      I
ICloud fractionI      0.0000000000E+00      I       0.3441902341E-01      I
I  Relat. Hum. I      0.7808881371E-01      I       0.1939249354E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3769450478E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    306999844 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS511666.4 Mbytes/s, TOTAL TIME=    0.0054(11.1%)
 16:26:58 STEP 1920 H= 480:00 +CPU= 26.702
 END CNT3
 NSTEP =  1920 CNT0   000000000  18.155  18.155  20.535   0.884               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         5720/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    103    0       46      1044068     5720 ************    14.0     1.1    12.8     1.8    21.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 5604923.9 5604923.9    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 5601923.9 5601923.9     99.95      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  209    5139.6    5139.6     19.16      0.00
   9 SPCM     - SPECTRAL COMP.                     192     803.4     803.4      2.75      0.00
  10 SCAN2M - PHYSICS                              193   13286.9   13286.9     45.75      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 16     903.3     903.3      0.26      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  9      46.2      46.2      0.01      0.00
  17 GRIDFPOS IN CNT4                               16      22.1      22.1      0.01      0.00
  27 RESTART FILES - WRITING                         4    3613.2    3613.2      0.26      0.00
  28 RESTART FILES - READING                         1    2447.2    2447.2      0.04      0.00
  29 SU4FPOS IN CNT4                                16       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                16    6497.3    6497.3      1.85      0.00
  31 POSDDH IN STEPO                                 1      10.9      10.9      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    193    6152.0    6152.0     21.18      0.00
  39 SU0YOMB                                         1     333.5     333.5      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    193      14.8      14.8      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              192     440.3     440.3      1.51      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              192      58.8      58.8      0.20      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  9       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      420     387.9     387.9      2.91      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       400     225.5     225.5      1.61      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        400      70.1      70.1      0.50      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       420     117.1     117.1      0.88      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      39.1      39.1      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            420      64.5      64.5      0.48      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            400      28.1      28.1      0.20      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            420      84.9      84.9      0.64      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            400      41.8      41.8      0.30      0.00
 400 GSTATS                                      23311       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 21635       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     5604.9 CPU TIME    4213.7 VECTOR TIME     4213.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      308.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/23/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/23/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/23/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12288862/ICMUAh7zg+001860
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ev_2016092300_20_1018_12288862_0_r674344116_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
16:30:29 (173845): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jun 2024 15:25:23 1550999 22442429 oifs_43r3_bl_a0ev_2016092300_20_1018_12288862_0 1,727,100 40,927 0.0237
14 Jun 2024 08:23:56 1550999 22442429 oifs_43r3_bl_a0ev_2016092300_20_1018_12288862_0 864,000 20,084 0.0232


©2024 climateprediction.net