climateprediction.net home page
Task 22294079

Task 22294079

Name oifs_43r3_ps_0318_2000050100_123_969_12185962_1
Workunit 12185962
Created 28 Dec 2022, 17:42:49 UTC
Sent 15 Jan 2023, 3:50:33 UTC
Report deadline 14 Feb 2023, 3:50:33 UTC
Received 15 Jan 2023, 7:20:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1538137
Run time 51 min 37 sec
CPU time 48 min 20 sec
Validate state Invalid
Credit 1,330.56
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,078.97 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,039.50 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0318
(argv4) batchid: 969
(argv5) wuid: 12185962
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ae305a224e06437cb560df237e326c7c to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0318_2000050100_123_969_12185962.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0318_2000050100_123_969_12185962.zip
ic_ancil_file: ic_ancil_12185962
ifsdata_file: ifsdata_12185962
climate_data_file: clim_data_12185962
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_beaf2ac5fa0ae1d5805c201a439f08b8 to: /var/lib/boinc-client/slots/7/ic_ancil_12185962.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12185962.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a09c86675ec165aca45d518230ea597b to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12185962.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12185962.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12185962.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12185962.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12185962.xml
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12185962.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094
The child process has been launched with process id: 2002
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2002:2002] [20230114:220233:1673755353:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  22:02:45 STEP    0 H=   0:00 +CPU= 11.392
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000000
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000000
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000000
  22:02:54 STEP    1 H=   1:00 +CPU=  8.496
  22:03:00 STEP    2 H=   2:00 +CPU=  6.908
  22:03:11 STEP    3 H=   3:00 +CPU= 10.521
  22:03:18 STEP    4 H=   4:00 +CPU=  7.148
  22:03:25 STEP    5 H=   5:00 +CPU=  6.452
  22:03:36 STEP    6 H=   6:00 +CPU= 10.976
  22:03:43 STEP    7 H=   7:00 +CPU=  6.819
  22:03:50 STEP    8 H=   8:00 +CPU=  6.746
  22:04:00 STEP    9 H=   9:00 +CPU= 10.603
  22:04:07 STEP   10 H=  10:00 +CPU=  6.954
  22:04:14 STEP   11 H=  11:00 +CPU=  6.413
  22:04:26 STEP   12 H=  12:00 +CPU= 11.807
  22:04:32 STEP   13 H=  13:00 +CPU=  6.591
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000012
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000012
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000012
  22:04:39 STEP   14 H=  14:00 +CPU=  6.846
  22:04:50 STEP   15 H=  15:00 +CPU= 10.637
  22:04:57 STEP   16 H=  16:00 +CPU=  6.718
  22:05:03 STEP   17 H=  17:00 +CPU=  6.462
  22:05:14 STEP   18 H=  18:00 +CPU= 10.638
  22:05:20 STEP   19 H=  19:00 +CPU=  6.594
  22:05:27 STEP   20 H=  20:00 +CPU=  6.837
  22:05:38 STEP   21 H=  21:00 +CPU= 10.596
  22:05:45 STEP   22 H=  22:00 +CPU=  6.997
  22:05:52 STEP   23 H=  23:00 +CPU=  6.820
  22:06:04 STEP   24 H=  24:00 +CPU= 12.551
  22:06:11 STEP   25 H=  25:00 +CPU=  6.520
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000024
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000024
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_0.zip
Uploading the intermediate file: upload_file_0.zip
  22:06:18 STEP   26 H=  26:00 +CPU=  6.920
  22:06:28 STEP   27 H=  27:00 +CPU= 10.469
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0318
(argv4) batchid: 969
(argv5) wuid: 12185962
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ae305a224e06437cb560df237e326c7c to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0318_2000050100_123_969_12185962.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0318_2000050100_123_969_12185962.zip
ic_ancil_file: ic_ancil_12185962
ifsdata_file: ifsdata_12185962
climate_data_file: clim_data_12185962
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_beaf2ac5fa0ae1d5805c201a439f08b8 to: /var/lib/boinc-client/slots/7/ic_ancil_12185962.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12185962.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_a09c86675ec165aca45d518230ea597b to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12185962.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12185962.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12185962.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12185962.zip
Checking for progress XML file: /var/lib/boinc-client/slots/7/progress_file_12185962.xml
Opened progress file ok : /var/lib/boinc-client/slots/7/progress_file_12185962.xml
-- Model is restarting --
Adjusting last_iter, 26, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/7/progress_file_12185962.xml
last_cpu_time: 217
upload_file_number: 1
last_iter: 23
last_upload: 86400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094
The child process has been launched with process id: 2017
Executing the command: /var/lib/boinc-client/slots/7/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:moi-desktop:1:1:2017:2017] [20230114:220716:1673755636:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  22:07:29 STEP   24 H=  24:00 +CPU= 11.792
  22:07:36 STEP   25 H=  25:00 +CPU=  6.625
  22:07:43 STEP   26 H=  26:00 +CPU=  6.692
  22:07:53 STEP   27 H=  27:00 +CPU= 10.686
  22:08:00 STEP   28 H=  28:00 +CPU=  6.524
  22:08:07 STEP   29 H=  29:00 +CPU=  6.712
  22:08:17 STEP   30 H=  30:00 +CPU= 10.608
  22:08:24 STEP   31 H=  31:00 +CPU=  6.562
  22:08:30 STEP   32 H=  32:00 +CPU=  6.664
  22:08:41 STEP   33 H=  33:00 +CPU= 10.459
  22:08:48 STEP   34 H=  34:00 +CPU=  6.919
  22:08:55 STEP   35 H=  35:00 +CPU=  6.651
  22:09:09 STEP   36 H=  36:00 +CPU= 12.007
  22:09:15 STEP   37 H=  37:00 +CPU=  6.521
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000036
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000036
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000036
  22:09:26 STEP   38 H=  38:00 +CPU=  6.912
  22:09:37 STEP   39 H=  39:00 +CPU= 10.465
  22:09:44 STEP   40 H=  40:00 +CPU=  6.740
  22:09:51 STEP   41 H=  41:00 +CPU=  6.740
  22:10:01 STEP   42 H=  42:00 +CPU= 10.469
  22:10:08 STEP   43 H=  43:00 +CPU=  6.642
  22:10:14 STEP   44 H=  44:00 +CPU=  6.724
  22:10:25 STEP   45 H=  45:00 +CPU= 10.321
  22:10:31 STEP   46 H=  46:00 +CPU=  6.489
  22:10:38 STEP   47 H=  47:00 +CPU=  6.911
  22:10:52 STEP   48 H=  48:00 +CPU= 12.689
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000048
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000048
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_1.zip
  22:10:59 STEP   49 H=  49:00 +CPU=  6.595
Uploading the intermediate file: upload_file_1.zip
  22:11:05 STEP   50 H=  50:00 +CPU=  6.644
  22:11:16 STEP   51 H=  51:00 +CPU= 10.566
  22:11:22 STEP   52 H=  52:00 +CPU=  6.511
  22:11:29 STEP   53 H=  53:00 +CPU=  6.781
  22:11:40 STEP   54 H=  54:00 +CPU= 10.760
  22:11:46 STEP   55 H=  55:00 +CPU=  6.628
  22:11:53 STEP   56 H=  56:00 +CPU=  6.787
  22:12:04 STEP   57 H=  57:00 +CPU= 10.601
  22:12:10 STEP   58 H=  58:00 +CPU=  6.505
  22:12:17 STEP   59 H=  59:00 +CPU=  6.866
  22:12:29 STEP   60 H=  60:00 +CPU= 11.714
  22:12:36 STEP   61 H=  61:00 +CPU=  6.636
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000060
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000060
  22:12:42 STEP   62 H=  62:00 +CPU=  6.796
  22:12:53 STEP   63 H=  63:00 +CPU= 10.075
  22:12:59 STEP   64 H=  64:00 +CPU=  6.784
  22:13:09 STEP   65 H=  65:00 +CPU=  6.546
  22:13:20 STEP   66 H=  66:00 +CPU= 10.773
  22:13:27 STEP   67 H=  67:00 +CPU=  6.529
  22:13:34 STEP   68 H=  68:00 +CPU=  6.777
  22:13:45 STEP   69 H=  69:00 +CPU= 10.761
  22:13:51 STEP   70 H=  70:00 +CPU=  6.878
  22:13:58 STEP   71 H=  71:00 +CPU=  6.704
  22:14:11 STEP   72 H=  72:00 +CPU= 12.343
  22:14:18 STEP   73 H=  73:00 +CPU=  6.454
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000072
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000072
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000060
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_2.zip
Uploading the intermediate file: upload_file_2.zip
  22:14:24 STEP   74 H=  74:00 +CPU=  6.552
  22:14:35 STEP   75 H=  75:00 +CPU= 11.203
  22:14:42 STEP   76 H=  76:00 +CPU=  6.801
  22:14:49 STEP   77 H=  77:00 +CPU=  6.570
  22:15:00 STEP   78 H=  78:00 +CPU= 10.905
  22:15:06 STEP   79 H=  79:00 +CPU=  6.580
  22:15:13 STEP   80 H=  80:00 +CPU=  6.730
  22:15:24 STEP   81 H=  81:00 +CPU= 10.749
  22:15:31 STEP   82 H=  82:00 +CPU=  6.856
  22:15:37 STEP   83 H=  83:00 +CPU=  6.490
  22:15:49 STEP   84 H=  84:00 +CPU= 11.801
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000084
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000084
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000084
  22:15:55 STEP   85 H=  85:00 +CPU=  6.411
  22:16:02 STEP   86 H=  86:00 +CPU=  6.916
  22:16:13 STEP   87 H=  87:00 +CPU= 10.784
  22:16:21 STEP   88 H=  88:00 +CPU=  6.874
  22:16:28 STEP   89 H=  89:00 +CPU=  6.556
  22:16:39 STEP   90 H=  90:00 +CPU= 10.546
  22:16:45 STEP   91 H=  91:00 +CPU=  6.494
  22:16:52 STEP   92 H=  92:00 +CPU=  6.700
  22:17:02 STEP   93 H=  93:00 +CPU= 10.547
  22:17:09 STEP   94 H=  94:00 +CPU=  6.514
  22:17:15 STEP   95 H=  95:00 +CPU=  6.587
  22:17:29 STEP   96 H=  96:00 +CPU= 12.561
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000096
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000096
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_3.zip
Uploading the intermediate file: upload_file_3.zip
  22:17:36 STEP   97 H=  97:00 +CPU=  6.467
  22:17:42 STEP   98 H=  98:00 +CPU=  6.544
  22:17:53 STEP   99 H=  99:00 +CPU= 10.574
  22:17:59 STEP  100 H= 100:00 +CPU=  6.560
  22:18:06 STEP  101 H= 101:00 +CPU=  6.711
  22:18:17 STEP  102 H= 102:00 +CPU= 10.795
  22:18:24 STEP  103 H= 103:00 +CPU=  6.681
  22:18:43 STEP  104 H= 104:00 +CPU=  7.531
  22:18:54 STEP  105 H= 105:00 +CPU= 10.776
  22:19:01 STEP  106 H= 106:00 +CPU=  6.717
  22:19:08 STEP  107 H= 107:00 +CPU=  6.710
  22:19:19 STEP  108 H= 108:00 +CPU= 11.604
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000108
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000108
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000108
  22:19:26 STEP  109 H= 109:00 +CPU=  6.759
  22:19:37 STEP  110 H= 110:00 +CPU=  6.756
  22:19:48 STEP  111 H= 111:00 +CPU= 10.615
  22:19:54 STEP  112 H= 112:00 +CPU=  6.612
  22:20:00 STEP  113 H= 113:00 +CPU=  6.314
  22:20:11 STEP  114 H= 114:00 +CPU= 10.872
  22:20:18 STEP  115 H= 115:00 +CPU=  6.377
  22:20:25 STEP  116 H= 116:00 +CPU=  6.831
  22:20:35 STEP  117 H= 117:00 +CPU= 10.671
  22:20:42 STEP  118 H= 118:00 +CPU=  6.780
  22:20:49 STEP  119 H= 119:00 +CPU=  6.538
  22:21:03 STEP  120 H= 120:00 +CPU= 12.471
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000120
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000120
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000108
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000108
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_4.zip
Uploading the intermediate file: upload_file_4.zip
  22:21:09 STEP  121 H= 121:00 +CPU=  6.456
  22:21:16 STEP  122 H= 122:00 +CPU=  6.859
  22:21:27 STEP  123 H= 123:00 +CPU= 10.409
  22:21:33 STEP  124 H= 124:00 +CPU=  6.811
  22:21:40 STEP  125 H= 125:00 +CPU=  6.393
  22:21:51 STEP  126 H= 126:00 +CPU= 10.771
  22:21:58 STEP  127 H= 127:00 +CPU=  6.742
  22:22:05 STEP  128 H= 128:00 +CPU=  6.706
  22:22:17 STEP  129 H= 129:00 +CPU= 10.769
  22:22:25 STEP  130 H= 130:00 +CPU=  7.340
  22:22:31 STEP  131 H= 131:00 +CPU=  6.621
  22:22:48 STEP  132 H= 132:00 +CPU= 11.807
  22:22:54 STEP  133 H= 133:00 +CPU=  6.314
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000132
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000132
  22:23:01 STEP  134 H= 134:00 +CPU=  6.615
  22:23:12 STEP  135 H= 135:00 +CPU= 10.813
  22:23:19 STEP  136 H= 136:00 +CPU=  6.650
  22:23:25 STEP  137 H= 137:00 +CPU=  6.640
  22:23:36 STEP  138 H= 138:00 +CPU= 10.826
  22:23:43 STEP  139 H= 139:00 +CPU=  6.562
  22:23:49 STEP  140 H= 140:00 +CPU=  6.714
  22:24:00 STEP  141 H= 141:00 +CPU= 10.571
  22:24:07 STEP  142 H= 142:00 +CPU=  6.812
  22:24:13 STEP  143 H= 143:00 +CPU=  6.720
  22:24:27 STEP  144 H= 144:00 +CPU= 12.481
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000144
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000120
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000132
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000132
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_5.zip
Uploading the intermediate file: upload_file_5.zip
  22:24:33 STEP  145 H= 145:00 +CPU=  6.331
  22:24:40 STEP  146 H= 146:00 +CPU=  6.639
  22:24:50 STEP  147 H= 147:00 +CPU= 10.123
  22:24:57 STEP  148 H= 148:00 +CPU=  6.721
  22:25:03 STEP  149 H= 149:00 +CPU=  6.571
  22:25:14 STEP  150 H= 150:00 +CPU= 10.732
  22:25:21 STEP  151 H= 151:00 +CPU=  6.505
  22:25:27 STEP  152 H= 152:00 +CPU=  6.624
  22:25:38 STEP  153 H= 153:00 +CPU= 10.619
  22:25:45 STEP  154 H= 154:00 +CPU=  6.960
  22:25:52 STEP  155 H= 155:00 +CPU=  6.752
  22:26:04 STEP  156 H= 156:00 +CPU= 11.842
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000156
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000156
  22:26:10 STEP  157 H= 157:00 +CPU=  6.618
  22:26:17 STEP  158 H= 158:00 +CPU=  6.874
  22:26:28 STEP  159 H= 159:00 +CPU= 10.350
  22:26:35 STEP  160 H= 160:00 +CPU=  6.996
  22:26:41 STEP  161 H= 161:00 +CPU=  6.403
  22:26:52 STEP  162 H= 162:00 +CPU= 10.670
  22:26:59 STEP  163 H= 163:00 +CPU=  6.691
  22:27:05 STEP  164 H= 164:00 +CPU=  6.838
  22:27:16 STEP  165 H= 165:00 +CPU= 10.627
  22:27:23 STEP  166 H= 166:00 +CPU=  6.707
  22:27:30 STEP  167 H= 167:00 +CPU=  6.687
  22:27:44 STEP  168 H= 168:00 +CPU= 12.887
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000168
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000144
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000156
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000156
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_6.zip
Uploading the intermediate file: upload_file_6.zip
  22:27:51 STEP  169 H= 169:00 +CPU=  6.591
  22:27:58 STEP  170 H= 170:00 +CPU=  6.909
  22:28:08 STEP  171 H= 171:00 +CPU= 10.506
  22:28:15 STEP  172 H= 172:00 +CPU=  7.014
  22:28:22 STEP  173 H= 173:00 +CPU=  6.340
  22:28:32 STEP  174 H= 174:00 +CPU= 10.795
  22:28:39 STEP  175 H= 175:00 +CPU=  6.393
  22:28:45 STEP  176 H= 176:00 +CPU=  6.561
  22:28:56 STEP  177 H= 177:00 +CPU= 10.784
  22:29:03 STEP  178 H= 178:00 +CPU=  6.591
  22:29:09 STEP  179 H= 179:00 +CPU=  6.562
  22:29:21 STEP  180 H= 180:00 +CPU= 11.478
  22:29:28 STEP  181 H= 181:00 +CPU=  6.867
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000180
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000180
  22:29:35 STEP  182 H= 182:00 +CPU=  6.748
  22:29:50 STEP  183 H= 183:00 +CPU= 11.010
  22:29:56 STEP  184 H= 184:00 +CPU=  6.528
  22:30:02 STEP  185 H= 185:00 +CPU=  6.383
  22:30:13 STEP  186 H= 186:00 +CPU= 10.729
  22:30:20 STEP  187 H= 187:00 +CPU=  6.386
  22:30:27 STEP  188 H= 188:00 +CPU=  6.775
  22:30:37 STEP  189 H= 189:00 +CPU= 10.618
  22:30:44 STEP  190 H= 190:00 +CPU=  6.710
  22:30:51 STEP  191 H= 191:00 +CPU=  6.513
  22:31:06 STEP  192 H= 192:00 +CPU= 12.733
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000192
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000168
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000180
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000180
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_7.zip
Uploading the intermediate file: upload_file_7.zip
  22:31:12 STEP  193 H= 193:00 +CPU=  6.503
  22:31:19 STEP  194 H= 194:00 +CPU=  6.940
  22:31:30 STEP  195 H= 195:00 +CPU= 10.685
  22:31:37 STEP  196 H= 196:00 +CPU=  7.006
  22:31:44 STEP  197 H= 197:00 +CPU=  6.490
  22:31:55 STEP  198 H= 198:00 +CPU= 11.097
  22:32:01 STEP  199 H= 199:00 +CPU=  6.507
  22:32:08 STEP  200 H= 200:00 +CPU=  6.841
  22:32:19 STEP  201 H= 201:00 +CPU= 10.855
  22:32:27 STEP  202 H= 202:00 +CPU=  6.702
  22:32:34 STEP  203 H= 203:00 +CPU=  6.810
  22:32:45 STEP  204 H= 204:00 +CPU= 11.738
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000204
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000204
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000204
  22:32:52 STEP  205 H= 205:00 +CPU=  6.578
  22:32:59 STEP  206 H= 206:00 +CPU=  6.702
  22:33:10 STEP  207 H= 207:00 +CPU= 10.467
  22:33:17 STEP  208 H= 208:00 +CPU=  6.695
  22:33:23 STEP  209 H= 209:00 +CPU=  6.614
  22:33:34 STEP  210 H= 210:00 +CPU= 10.516
  22:33:40 STEP  211 H= 211:00 +CPU=  6.534
  22:33:47 STEP  212 H= 212:00 +CPU=  6.831
  22:33:58 STEP  213 H= 213:00 +CPU= 10.618
  22:34:05 STEP  214 H= 214:00 +CPU=  6.651
  22:34:11 STEP  215 H= 215:00 +CPU=  6.564
  22:34:25 STEP  216 H= 216:00 +CPU= 12.520
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000216
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000216
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000192
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000204
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000204
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_8.zip
Uploading the intermediate file: upload_file_8.zip
  22:34:31 STEP  217 H= 217:00 +CPU=  6.575
  22:34:38 STEP  218 H= 218:00 +CPU=  6.541
  22:34:48 STEP  219 H= 219:00 +CPU= 10.540
  22:34:55 STEP  220 H= 220:00 +CPU=  6.763
  22:35:02 STEP  221 H= 221:00 +CPU=  6.650
  22:35:13 STEP  222 H= 222:00 +CPU= 10.924
  22:35:19 STEP  223 H= 223:00 +CPU=  6.422
  22:35:26 STEP  224 H= 224:00 +CPU=  6.811
  22:35:36 STEP  225 H= 225:00 +CPU= 10.652
  22:35:43 STEP  226 H= 226:00 +CPU=  6.791
  22:35:50 STEP  227 H= 227:00 +CPU=  6.533
  22:36:02 STEP  228 H= 228:00 +CPU= 11.983
  22:36:08 STEP  229 H= 229:00 +CPU=  6.516
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000228
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000228
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000228
  22:36:15 STEP  230 H= 230:00 +CPU=  6.810
  22:36:26 STEP  231 H= 231:00 +CPU= 10.634
  22:36:32 STEP  232 H= 232:00 +CPU=  6.630
  22:36:39 STEP  233 H= 233:00 +CPU=  6.381
  22:36:50 STEP  234 H= 234:00 +CPU= 10.810
  22:36:56 STEP  235 H= 235:00 +CPU=  6.475
  22:37:03 STEP  236 H= 236:00 +CPU=  6.712
  22:37:13 STEP  237 H= 237:00 +CPU= 10.594
  22:37:20 STEP  238 H= 238:00 +CPU=  6.682
  22:37:27 STEP  239 H= 239:00 +CPU=  6.748
  22:37:41 STEP  240 H= 240:00 +CPU= 12.853
  22:37:48 STEP  241 H= 241:00 +CPU=  6.613
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000240
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000240
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000216
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000228
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000228
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_9.zip
Uploading the intermediate file: upload_file_9.zip
  22:37:55 STEP  242 H= 242:00 +CPU=  6.786
  22:38:05 STEP  243 H= 243:00 +CPU= 10.609
  22:38:12 STEP  244 H= 244:00 +CPU=  6.749
  22:38:18 STEP  245 H= 245:00 +CPU=  6.349
  22:38:29 STEP  246 H= 246:00 +CPU= 10.928
  22:38:36 STEP  247 H= 247:00 +CPU=  6.629
  22:38:42 STEP  248 H= 248:00 +CPU=  6.515
  22:38:53 STEP  249 H= 249:00 +CPU= 10.546
  22:39:00 STEP  250 H= 250:00 +CPU=  6.839
  22:39:06 STEP  251 H= 251:00 +CPU=  6.546
  22:39:18 STEP  252 H= 252:00 +CPU= 11.595
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000252
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000252
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000252
  22:39:25 STEP  253 H= 253:00 +CPU=  6.881
  22:39:32 STEP  254 H= 254:00 +CPU=  6.875
  22:39:43 STEP  255 H= 255:00 +CPU= 10.965
  22:39:50 STEP  256 H= 256:00 +CPU=  6.739
  22:39:57 STEP  257 H= 257:00 +CPU=  6.623
  22:40:08 STEP  258 H= 258:00 +CPU= 10.872
  22:40:14 STEP  259 H= 259:00 +CPU=  6.444
  22:40:21 STEP  260 H= 260:00 +CPU=  6.749
  22:40:31 STEP  261 H= 261:00 +CPU= 10.584
  22:40:38 STEP  262 H= 262:00 +CPU=  6.561
  22:40:45 STEP  263 H= 263:00 +CPU=  6.667
  22:40:57 STEP  264 H= 264:00 +CPU= 12.289
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000264
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000264
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000240
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000252
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000252
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_10.zip
Uploading the intermediate file: upload_file_10.zip
  22:41:04 STEP  265 H= 265:00 +CPU=  6.664
  22:41:10 STEP  266 H= 266:00 +CPU=  6.598
  22:41:21 STEP  267 H= 267:00 +CPU= 10.297
Uploading trickle at timestep: 950400
  22:41:27 STEP  268 H= 268:00 +CPU=  6.537
  22:41:34 STEP  269 H= 269:00 +CPU=  6.415
  22:41:44 STEP  270 H= 270:00 +CPU= 10.666
  22:41:51 STEP  271 H= 271:00 +CPU=  6.496
  22:41:57 STEP  272 H= 272:00 +CPU=  6.662
  22:42:08 STEP  273 H= 273:00 +CPU= 10.668
  22:42:15 STEP  274 H= 274:00 +CPU=  6.851
  22:42:22 STEP  275 H= 275:00 +CPU=  6.652
  22:42:33 STEP  276 H= 276:00 +CPU= 11.524
  22:42:40 STEP  277 H= 277:00 +CPU=  6.762
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000276
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000276
  22:42:47 STEP  278 H= 278:00 +CPU=  6.918
  22:42:57 STEP  279 H= 279:00 +CPU= 10.574
  22:43:04 STEP  280 H= 280:00 +CPU=  6.857
  22:43:11 STEP  281 H= 281:00 +CPU=  6.553
  22:43:22 STEP  282 H= 282:00 +CPU= 10.847
  22:43:28 STEP  283 H= 283:00 +CPU=  6.445
  22:43:35 STEP  284 H= 284:00 +CPU=  6.659
  22:43:45 STEP  285 H= 285:00 +CPU= 10.321
  22:43:52 STEP  286 H= 286:00 +CPU=  6.564
  22:43:58 STEP  287 H= 287:00 +CPU=  6.563
  22:44:11 STEP  288 H= 288:00 +CPU= 12.452
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000288
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000264
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000276
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000276
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_11.zip
Uploading the intermediate file: upload_file_11.zip
  22:44:18 STEP  289 H= 289:00 +CPU=  6.379
  22:44:24 STEP  290 H= 290:00 +CPU=  6.607
  22:44:35 STEP  291 H= 291:00 +CPU= 10.797
  22:44:42 STEP  292 H= 292:00 +CPU=  6.696
  22:44:49 STEP  293 H= 293:00 +CPU=  7.175
  22:45:00 STEP  294 H= 294:00 +CPU= 10.855
  22:45:07 STEP  295 H= 295:00 +CPU=  6.790
  22:45:15 STEP  296 H= 296:00 +CPU=  7.000
  22:45:25 STEP  297 H= 297:00 +CPU= 10.770
  22:45:32 STEP  298 H= 298:00 +CPU=  6.588
  22:45:39 STEP  299 H= 299:00 +CPU=  6.683
  22:45:51 STEP  300 H= 300:00 +CPU= 11.640
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000300
  22:45:57 STEP  301 H= 301:00 +CPU=  6.731
  22:46:04 STEP  302 H= 302:00 +CPU=  6.633
  22:46:15 STEP  303 H= 303:00 +CPU= 10.731
  22:46:22 STEP  304 H= 304:00 +CPU=  6.885
  22:46:28 STEP  305 H= 305:00 +CPU=  6.513
  22:46:39 STEP  306 H= 306:00 +CPU= 10.704
  22:46:45 STEP  307 H= 307:00 +CPU=  6.518
  22:46:52 STEP  308 H= 308:00 +CPU=  6.931
  22:47:03 STEP  309 H= 309:00 +CPU= 10.464
  22:47:10 STEP  310 H= 310:00 +CPU=  6.935
  22:47:16 STEP  311 H= 311:00 +CPU=  6.622
  22:47:30 STEP  312 H= 312:00 +CPU= 12.884
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_12.zip
Uploading the intermediate file: upload_file_12.zip
  22:47:36 STEP  313 H= 313:00 +CPU=  6.331
  22:47:44 STEP  314 H= 314:00 +CPU=  7.198
  22:47:54 STEP  315 H= 315:00 +CPU= 10.419
  22:48:01 STEP  316 H= 316:00 +CPU=  6.866
  22:48:08 STEP  317 H= 317:00 +CPU=  6.553
  22:48:19 STEP  318 H= 318:00 +CPU= 11.049
  22:48:26 STEP  319 H= 319:00 +CPU=  6.370
  22:48:33 STEP  320 H= 320:00 +CPU=  6.971
  22:48:44 STEP  321 H= 321:00 +CPU= 10.711
  22:48:51 STEP  322 H= 322:00 +CPU=  6.857
  22:48:57 STEP  323 H= 323:00 +CPU=  6.529
  22:49:09 STEP  324 H= 324:00 +CPU= 11.703
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000324
  22:49:15 STEP  325 H= 325:00 +CPU=  6.416
  22:49:22 STEP  326 H= 326:00 +CPU=  6.477
  22:49:33 STEP  327 H= 327:00 +CPU= 10.653
  22:49:39 STEP  328 H= 328:00 +CPU=  6.881
  22:49:46 STEP  329 H= 329:00 +CPU=  6.637
  22:49:57 STEP  330 H= 330:00 +CPU= 10.673
  22:50:03 STEP  331 H= 331:00 +CPU=  6.410
  22:50:10 STEP  332 H= 332:00 +CPU=  6.926
  22:50:21 STEP  333 H= 333:00 +CPU= 10.370
  22:50:27 STEP  334 H= 334:00 +CPU=  6.614
  22:50:34 STEP  335 H= 335:00 +CPU=  6.860
  22:50:48 STEP  336 H= 336:00 +CPU= 12.619
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMGGhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMSHhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12185962/ICMUAhq0f+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0318_2000050100_123_969_12185962_1_r327466094_13.zip
Uploading the intermediate file: upload_file_13.zip
  22:50:55 STEP  337 H= 337:00 +CPU=  6.511
  22:51:02 STEP  338 H= 338:00 +CPU=  7.002
  22:51:12 STEP  339 H= 339:00 +CPU= 10.442
  22:51:20 STEP  340 H= 340:00 +CPU=  7.284
  22:51:26 STEP  341 H= 341:00 +CPU=  6.661
  22:51:43 STEP  342 H= 342:00 +CPU= 11.485
  22:51:50 STEP  343 H= 343:00 +CPU=  6.758
  22:52:05 STEP  344 H= 344:00 +CPU=  7.443
  22:52:38 STEP  345 H= 345:00 +CPU= 12.266
  22:52:51 STEP  346 H= 346:00 +CPU=  7.448
  22:52:57 STEP  347 H= 347:00 +CPU=  6.440
  22:53:09 STEP  348 H= 348:00 +CPU= 12.031
  22:53:16 STEP  349 H= 349:00 +CPU=  6.843
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhq0f+000348
  22:53:30 STEP  350 H= 350:00 +CPU=  7.150
  22:53:40 STEP  351 H= 351:00 +CPU= 10.432
  22:53:56 STEP  352 H= 352:00 +CPU=  7.647
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:20:12 1538137 22294079 oifs_43r3_ps_0318_2000050100_123_969_12185962_1 950,400 2,182 0.0023


©2024 climateprediction.net