climateprediction.net home page
Task 22445632

Task 22445632

Name oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0
Workunit 12292029
Created 13 Jun 2024, 1:23:27 UTC
Sent 13 Jun 2024, 1:49:18 UTC
Report deadline 12 Aug 2024, 1:49:18 UTC
Received 19 Jun 2024, 16:00:42 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1548832
Run time 11 hours 41 min 33 sec
CPU time 11 hours 41 min 33 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 10.67 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,300.13 MB
Peak swap size 5,981.08 MB
Peak disk usage 1,676.23 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
 1456 H= 364:00 +CPU= 21.797
  06:43:37 STEP 1457 H= 364:15 +CPU= 21.595
  06:43:59 STEP 1458 H= 364:30 +CPU= 21.667
  06:44:20 STEP 1459 H= 364:45 +CPU= 20.823
  06:44:42 STEP 1460 H= 365:00 +CPU= 21.553
  06:45:03 STEP 1461 H= 365:15 +CPU= 21.433
  06:45:25 STEP 1462 H= 365:30 +CPU= 21.393
  06:45:47 STEP 1463 H= 365:45 +CPU= 21.607
  06:46:16 STEP 1464 H= 366:00 +CPU= 28.889
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMGGh7zg+001464
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMSHh7zg+001464
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMUAh7zg+001464
  06:46:39 STEP 1465 H= 366:15 +CPU= 23.124
  06:47:04 STEP 1466 H= 366:30 +CPU= 24.118
  06:47:27 STEP 1467 H= 366:45 +CPU= 23.519
  06:47:51 STEP 1468 H= 367:00 +CPU= 23.805
  06:48:15 STEP 1469 H= 367:15 +CPU= 23.225
  06:48:39 STEP 1470 H= 367:30 +CPU= 24.428
  06:49:03 STEP 1471 H= 367:45 +CPU= 23.196
  06:49:28 STEP 1472 H= 368:00 +CPU= 24.440
  06:49:51 STEP 1473 H= 368:15 +CPU= 23.450
  06:50:15 STEP 1474 H= 368:30 +CPU= 23.516
  06:50:39 STEP 1475 H= 368:45 +CPU= 23.733
  06:51:08 STEP 1476 H= 369:00 +CPU= 28.996
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMGGh7zg+001476
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMSHh7zg+001476
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMUAh7zg+001476
  06:51:31 STEP 1477 H= 369:15 +CPU= 22.557
  06:51:54 STEP 1478 H= 369:30 +CPU= 22.959
  06:52:18 STEP 1479 H= 369:45 +CPU= 23.094
  06:52:42 STEP 1480 H= 370:00 +CPU= 24.536
  06:53:07 STEP 1481 H= 370:15 +CPU= 24.077
  06:53:31 STEP 1482 H= 370:30 +CPU= 23.812
  06:53:54 STEP 1483 H= 370:45 +CPU= 22.754
  06:54:18 STEP 1484 H= 371:00 +CPU= 23.501
  06:54:41 STEP 1485 H= 371:15 +CPU= 23.170
  06:55:05 STEP 1486 H= 371:30 +CPU= 23.527
  06:55:28 STEP 1487 H= 371:45 +CPU= 23.302
  06:56:01 STEP 1488 H= 372:00 +CPU= 31.835
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMGGh7zg+001488
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMSHh7zg+001488
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMUAh7zg+001488
  06:56:22 STEP 1489 H= 372:15 +CPU= 21.685
  06:56:46 STEP 1490 H= 372:30 +CPU= 23.010
  06:57:09 STEP 1491 H= 372:45 +CPU= 23.376
  06:57:33 STEP 1492 H= 373:00 +CPU= 23.690
  06:57:59 STEP 1493 H= 373:15 +CPU= 22.234
  06:58:23 STEP 1494 H= 373:30 +CPU= 23.657
  06:58:48 STEP 1495 H= 373:45 +CPU= 24.746
  06:59:14 STEP 1496 H= 374:00 +CPU= 23.754
  06:59:38 STEP 1497 H= 374:15 +CPU= 23.881
  07:00:02 STEP 1498 H= 374:30 +CPU= 23.176
  07:00:26 STEP 1499 H= 374:45 +CPU= 23.302
  07:00:55 STEP 1500 H= 375:00 +CPU= 27.962
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMGGh7zg+001500
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMSHh7zg+001500
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMUAh7zg+001500
  07:01:18 STEP 1501 H= 375:15 +CPU= 23.038
  07:01:42 STEP 1502 H= 375:30 +CPU= 23.947
  07:02:06 STEP 1503 H= 375:45 +CPU= 23.480
  07:02:30 STEP 1504 H= 376:00 +CPU= 24.183
  07:02:54 STEP 1505 H= 376:15 +CPU= 23.691
  07:03:18 STEP 1506 H= 376:30 +CPU= 23.298
  07:03:41 STEP 1507 H= 376:45 +CPU= 23.207
  07:04:05 STEP 1508 H= 377:00 +CPU= 23.970
  07:04:29 STEP 1509 H= 377:15 +CPU= 23.523
  07:04:53 STEP 1510 H= 377:30 +CPU= 23.481
  07:05:17 STEP 1511 H= 377:45 +CPU= 23.774
  07:05:46 STEP 1512 H= 378:00 +CPU= 28.749
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMGGh7zg+001512
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMSHh7zg+001512
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMUAh7zg+001512
  07:06:09 STEP 1513 H= 378:15 +CPU= 22.225
  07:06:32 STEP 1514 H= 378:30 +CPU= 23.499
  07:06:56 STEP 1515 H= 378:45 +CPU= 23.167
  07:07:19 STEP 1516 H= 379:00 +CPU= 23.074
  07:07:43 STEP 1517 H= 379:15 +CPU= 23.168
  07:08:06 STEP 1518 H= 379:30 +CPU= 23.482
  07:08:30 STEP 1519 H= 379:45 +CPU= 23.156
  07:08:54 STEP 1520 H= 380:00 +CPU= 23.818
  07:09:17 STEP 1521 H= 380:15 +CPU= 23.026
  07:09:41 STEP 1522 H= 380:30 +CPU= 23.668
  07:10:04 STEP 1523 H= 380:45 +CPU= 23.084
  07:10:33 STEP 1524 H= 381:00 +CPU= 28.450
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMGGh7zg+001524
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMSHh7zg+001524
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/4/ICMUAh7zg+001524
  07:10:56 STEP 1525 H= 381:15 +CPU= 23.227
  07:11:20 STEP 1526 H= 381:30 +CPU= 23.238
  07:11:44 STEP 1527 H= 381:45 +CPU= 23.429
  07:12:07 STEP 1528 H= 382:00 +CPU= 23.341
  07:12:31 STEP 1529 H= 382:15 +CPU= 23.489
  07:12:55 STEP 1530 H= 382:30 +CPU= 23.342
  07:13:19 STEP 1531 H= 382:45 +CPU= 23.379
  07:13:42 STEP 1532 H= 383:00 +CPU= 23.401
  07:14:06 STEP 1533 H= 383:15 +CPU= 22.937
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a2uu
(argv4) batchid: 1018
(argv5) wuid: 12292029
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/multiboinc/boinc301/slots/4
Project directory is: /var/lib/multiboinc/boinc301/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029
..mkdir for temp folder for results failed
Copying: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/multiboinc/boinc301/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/multiboinc/boinc301/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3b81f6c3f53297ef022c900971e30278 to: /var/lib/multiboinc/boinc301/slots/4/oifs_43r3_bl_a2uu_2016092300_20_1018_12292029.zip
Unzipping the namelist zip file: /var/lib/multiboinc/boinc301/slots/4/oifs_43r3_bl_a2uu_2016092300_20_1018_12292029.zip
ic_ancil_file: ic_ancil_12292029
ifsdata_file: ifsdata_12292029
climate_data_file: clim_data_12292029
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/multiboinc/boinc301/slots/4/ic_ancil_12292029.zip
Unzipping the IC ancils zip file: /var/lib/multiboinc/boinc301/slots/4/ic_ancil_12292029.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_cd27a35f45bfa284564cb8eb362701f5 to: /var/lib/multiboinc/boinc301/slots/4/ifsdata/ifsdata_12292029.zip
Unzipping the ifsdata_zip file: /var/lib/multiboinc/boinc301/slots/4/ifsdata/ifsdata_12292029.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/multiboinc/boinc301/slots/4/159l_2/clim_data_12292029.zip
Unzipping the climate data zip file: /var/lib/multiboinc/boinc301/slots/4/159l_2/clim_data_12292029.zip
Checking for progress XML file: /var/lib/multiboinc/boinc301/slots/4/progress_file_12292029.xml
Opened progress file ok : /var/lib/multiboinc/boinc301/slots/4/progress_file_12292029.xml
-- Model is restarting --
Adjusting last_iter, 1534, to previous model restart step.
Creating progress file: /var/lib/multiboinc/boinc301/slots/4/progress_file_12292029.xml
last_cpu_time: 36130
upload_file_number: 15
last_iter: 1489
last_upload: 1296000
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0_r1708139427
The child process has been launched with process id: 10689
Executing the command: /var/lib/multiboinc/boinc301/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:epyc:1:1:10689:10689] [20240619:065013:1718805013:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:50:31 STEP 1488 H= 372:00 +CPU= 14.910
  06:50:45 STEP 1489 H= 372:15 +CPU= 13.835
  06:50:59 STEP 1490 H= 372:30 +CPU= 14.152
  06:51:13 STEP 1491 H= 372:45 +CPU= 14.006
  06:51:28 STEP 1492 H= 373:00 +CPU= 14.584
  06:51:42 STEP 1493 H= 373:15 +CPU= 13.969
  06:51:56 STEP 1494 H= 373:30 +CPU= 14.012
  06:52:09 STEP 1495 H= 373:45 +CPU= 13.630
  06:52:24 STEP 1496 H= 374:00 +CPU= 14.565
  06:52:38 STEP 1497 H= 374:15 +CPU= 14.350
  06:52:53 STEP 1498 H= 374:30 +CPU= 14.224
  06:53:07 STEP 1499 H= 374:45 +CPU= 14.187
  06:53:25 STEP 1500 H= 375:00 +CPU= 18.368
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001500
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001500
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001500
  06:53:39 STEP 1501 H= 375:15 +CPU= 13.918
  06:53:53 STEP 1502 H= 375:30 +CPU= 13.936
  06:54:08 STEP 1503 H= 375:45 +CPU= 14.318
  06:54:22 STEP 1504 H= 376:00 +CPU= 14.202
  06:54:35 STEP 1505 H= 376:15 +CPU= 13.113
  06:54:48 STEP 1506 H= 376:30 +CPU= 13.177
  06:55:01 STEP 1507 H= 376:45 +CPU= 13.085
  06:55:15 STEP 1508 H= 377:00 +CPU= 13.765
  06:55:28 STEP 1509 H= 377:15 +CPU= 12.970
  06:55:41 STEP 1510 H= 377:30 +CPU= 13.062
  06:55:55 STEP 1511 H= 377:45 +CPU= 13.302
  06:56:12 STEP 1512 H= 378:00 +CPU= 17.122
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001512
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001512
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001512
  06:56:24 STEP 1513 H= 378:15 +CPU= 12.468
  06:56:37 STEP 1514 H= 378:30 +CPU= 12.312
  06:56:49 STEP 1515 H= 378:45 +CPU= 12.334
  06:57:02 STEP 1516 H= 379:00 +CPU= 12.845
  06:57:14 STEP 1517 H= 379:15 +CPU= 12.382
  06:57:27 STEP 1518 H= 379:30 +CPU= 13.123
  06:57:40 STEP 1519 H= 379:45 +CPU= 13.098
  06:57:54 STEP 1520 H= 380:00 +CPU= 13.547
  06:58:07 STEP 1521 H= 380:15 +CPU= 13.072
  06:58:20 STEP 1522 H= 380:30 +CPU= 13.067
  06:58:33 STEP 1523 H= 380:45 +CPU= 13.037
  06:58:50 STEP 1524 H= 381:00 +CPU= 17.032
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001524
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001524
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001524
  06:59:03 STEP 1525 H= 381:15 +CPU= 13.068
  06:59:16 STEP 1526 H= 381:30 +CPU= 13.110
  06:59:30 STEP 1527 H= 381:45 +CPU= 13.097
  06:59:43 STEP 1528 H= 382:00 +CPU= 13.524
  06:59:56 STEP 1529 H= 382:15 +CPU= 13.048
  07:00:09 STEP 1530 H= 382:30 +CPU= 13.051
  07:00:22 STEP 1531 H= 382:45 +CPU= 13.059
  07:00:36 STEP 1532 H= 383:00 +CPU= 13.551
  07:00:49 STEP 1533 H= 383:15 +CPU= 13.215
  07:01:02 STEP 1534 H= 383:30 +CPU= 13.174
  07:01:16 STEP 1535 H= 383:45 +CPU= 13.241
  07:01:35 STEP 1536 H= 384:00 +CPU= 18.967
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001536
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001536
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001440
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001440
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001440
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001452
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001452
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001452
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001464
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001464
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001464
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001476
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001476
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001476
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001488
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001488
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001488
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001500
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001500
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001500
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001512
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001512
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001512
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001524
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001524
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0_r1708139427_15.zip
  07:01:48 STEP 1537 H= 384:15 +CPU= 13.256
Uploading the intermediate file: upload_file_15.zip
  07:02:02 STEP 1538 H= 384:30 +CPU= 13.524
  07:02:15 STEP 1539 H= 384:45 +CPU= 13.222
  07:02:28 STEP 1540 H= 385:00 +CPU= 13.663
  07:02:42 STEP 1541 H= 385:15 +CPU= 13.177
  07:02:55 STEP 1542 H= 385:30 +CPU= 13.185
  07:03:08 STEP 1543 H= 385:45 +CPU= 13.245
  07:03:22 STEP 1544 H= 386:00 +CPU= 13.676
  07:03:35 STEP 1545 H= 386:15 +CPU= 13.137
  07:03:48 STEP 1546 H= 386:30 +CPU= 13.293
  07:04:01 STEP 1547 H= 386:45 +CPU= 13.079
  07:04:19 STEP 1548 H= 387:00 +CPU= 17.215
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001548
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001548
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001548
  07:04:32 STEP 1549 H= 387:15 +CPU= 13.195
  07:04:45 STEP 1550 H= 387:30 +CPU= 13.220
  07:04:58 STEP 1551 H= 387:45 +CPU= 13.352
  07:05:12 STEP 1552 H= 388:00 +CPU= 13.738
  07:05:26 STEP 1553 H= 388:15 +CPU= 13.269
  07:05:39 STEP 1554 H= 388:30 +CPU= 13.301
  07:05:52 STEP 1555 H= 388:45 +CPU= 13.293
  07:06:06 STEP 1556 H= 389:00 +CPU= 13.830
  07:06:20 STEP 1557 H= 389:15 +CPU= 13.355
  07:06:33 STEP 1558 H= 389:30 +CPU= 13.411
  07:06:46 STEP 1559 H= 389:45 +CPU= 13.212
  07:07:04 STEP 1560 H= 390:00 +CPU= 17.586
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001560
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001560
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001560
  07:07:18 STEP 1561 H= 390:15 +CPU= 13.454
  07:07:31 STEP 1562 H= 390:30 +CPU= 13.491
  07:07:44 STEP 1563 H= 390:45 +CPU= 13.326
  07:07:58 STEP 1564 H= 391:00 +CPU= 13.861
  07:08:12 STEP 1565 H= 391:15 +CPU= 13.275
  07:08:25 STEP 1566 H= 391:30 +CPU= 13.309
  07:08:39 STEP 1567 H= 391:45 +CPU= 13.572
  07:08:53 STEP 1568 H= 392:00 +CPU= 14.056
  07:09:07 STEP 1569 H= 392:15 +CPU= 13.620
  07:09:20 STEP 1570 H= 392:30 +CPU= 13.487
  07:09:34 STEP 1571 H= 392:45 +CPU= 13.421
  07:09:51 STEP 1572 H= 393:00 +CPU= 17.481
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001572
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001572
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001572
  07:10:05 STEP 1573 H= 393:15 +CPU= 13.570
  07:10:19 STEP 1574 H= 393:30 +CPU= 13.537
  07:10:33 STEP 1575 H= 393:45 +CPU= 13.598
  07:10:47 STEP 1576 H= 394:00 +CPU= 13.970
  07:11:00 STEP 1577 H= 394:15 +CPU= 13.502
  07:11:14 STEP 1578 H= 394:30 +CPU= 13.543
  07:11:28 STEP 1579 H= 394:45 +CPU= 13.575
  07:11:42 STEP 1580 H= 395:00 +CPU= 14.212
  07:11:56 STEP 1581 H= 395:15 +CPU= 13.657
  07:12:10 STEP 1582 H= 395:30 +CPU= 13.672
  07:12:24 STEP 1583 H= 395:45 +CPU= 13.624
  07:12:44 STEP 1584 H= 396:00 +CPU= 19.803
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001584
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001584
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001584
  07:12:58 STEP 1585 H= 396:15 +CPU= 13.512
  07:13:12 STEP 1586 H= 396:30 +CPU= 13.847
  07:13:25 STEP 1587 H= 396:45 +CPU= 13.702
  07:13:40 STEP 1588 H= 397:00 +CPU= 14.082
  07:13:53 STEP 1589 H= 397:15 +CPU= 13.682
  07:14:07 STEP 1590 H= 397:30 +CPU= 13.766
  07:14:21 STEP 1591 H= 397:45 +CPU= 13.668
  07:14:36 STEP 1592 H= 398:00 +CPU= 14.100
  07:14:49 STEP 1593 H= 398:15 +CPU= 13.429
  07:15:03 STEP 1594 H= 398:30 +CPU= 13.480
  07:15:16 STEP 1595 H= 398:45 +CPU= 13.269
  07:15:33 STEP 1596 H= 399:00 +CPU= 17.273
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001596
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001596
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001596
  07:15:46 STEP 1597 H= 399:15 +CPU= 13.265
  07:16:00 STEP 1598 H= 399:30 +CPU= 13.284
  07:16:13 STEP 1599 H= 399:45 +CPU= 13.302
  07:16:27 STEP 1600 H= 400:00 +CPU= 13.814
  07:16:40 STEP 1601 H= 400:15 +CPU= 13.277
  07:16:54 STEP 1602 H= 400:30 +CPU= 13.327
  07:17:07 STEP 1603 H= 400:45 +CPU= 13.327
  07:17:21 STEP 1604 H= 401:00 +CPU= 13.768
  07:17:34 STEP 1605 H= 401:15 +CPU= 13.295
  07:17:48 STEP 1606 H= 401:30 +CPU= 13.277
  07:18:01 STEP 1607 H= 401:45 +CPU= 13.286
  07:18:18 STEP 1608 H= 402:00 +CPU= 17.261
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001608
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001608
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001608
  07:18:32 STEP 1609 H= 402:15 +CPU= 13.265
  07:18:45 STEP 1610 H= 402:30 +CPU= 13.287
  07:18:58 STEP 1611 H= 402:45 +CPU= 13.226
  07:19:12 STEP 1612 H= 403:00 +CPU= 13.749
  07:19:25 STEP 1613 H= 403:15 +CPU= 13.359
  07:19:39 STEP 1614 H= 403:30 +CPU= 13.268
  07:19:52 STEP 1615 H= 403:45 +CPU= 13.193
  07:20:06 STEP 1616 H= 404:00 +CPU= 13.757
  07:20:19 STEP 1617 H= 404:15 +CPU= 13.262
  07:20:32 STEP 1618 H= 404:30 +CPU= 13.183
  07:20:45 STEP 1619 H= 404:45 +CPU= 13.057
  07:21:03 STEP 1620 H= 405:00 +CPU= 17.305
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001620
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001620
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001620
  07:21:16 STEP 1621 H= 405:15 +CPU= 13.151
  07:21:29 STEP 1622 H= 405:30 +CPU= 13.175
  07:21:42 STEP 1623 H= 405:45 +CPU= 13.140
  07:21:56 STEP 1624 H= 406:00 +CPU= 13.745
  07:22:09 STEP 1625 H= 406:15 +CPU= 13.197
  07:22:22 STEP 1626 H= 406:30 +CPU= 13.191
  07:22:36 STEP 1627 H= 406:45 +CPU= 13.194
  07:22:49 STEP 1628 H= 407:00 +CPU= 13.719
  07:23:03 STEP 1629 H= 407:15 +CPU= 13.199
  07:23:16 STEP 1630 H= 407:30 +CPU= 13.239
  07:23:29 STEP 1631 H= 407:45 +CPU= 13.190
  07:23:48 STEP 1632 H= 408:00 +CPU= 19.075
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001632
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001632
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001548
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001548
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001548
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001560
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001560
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001560
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001572
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001572
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001572
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001584
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001584
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001584
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001596
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001596
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001596
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001608
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001608
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001608
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001620
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001620
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0_r1708139427_16.zip
Uploading the intermediate file: upload_file_16.zip
  07:24:01 STEP 1633 H= 408:15 +CPU= 13.220
  07:24:15 STEP 1634 H= 408:30 +CPU= 13.247
  07:24:28 STEP 1635 H= 408:45 +CPU= 13.276
  07:24:42 STEP 1636 H= 409:00 +CPU= 13.764
  07:24:55 STEP 1637 H= 409:15 +CPU= 13.238
  07:25:08 STEP 1638 H= 409:30 +CPU= 13.225
  07:25:22 STEP 1639 H= 409:45 +CPU= 13.187
  07:25:35 STEP 1640 H= 410:00 +CPU= 13.746
  07:25:49 STEP 1641 H= 410:15 +CPU= 13.230
  07:26:02 STEP 1642 H= 410:30 +CPU= 13.104
  07:26:15 STEP 1643 H= 410:45 +CPU= 13.227
  07:26:32 STEP 1644 H= 411:00 +CPU= 17.205
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001644
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001644
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001644
  07:26:45 STEP 1645 H= 411:15 +CPU= 13.196
  07:26:59 STEP 1646 H= 411:30 +CPU= 13.269
  07:27:12 STEP 1647 H= 411:45 +CPU= 13.243
  07:27:26 STEP 1648 H= 412:00 +CPU= 13.804
  07:27:39 STEP 1649 H= 412:15 +CPU= 13.247
  07:27:52 STEP 1650 H= 412:30 +CPU= 13.287
  07:28:06 STEP 1651 H= 412:45 +CPU= 13.246
  07:28:19 STEP 1652 H= 413:00 +CPU= 13.769
  07:28:33 STEP 1653 H= 413:15 +CPU= 13.342
  07:28:46 STEP 1654 H= 413:30 +CPU= 13.278
  07:28:59 STEP 1655 H= 413:45 +CPU= 13.217
  07:29:17 STEP 1656 H= 414:00 +CPU= 17.317
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001656
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001656
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001656
  07:29:30 STEP 1657 H= 414:15 +CPU= 13.280
  07:29:43 STEP 1658 H= 414:30 +CPU= 13.324
  07:29:57 STEP 1659 H= 414:45 +CPU= 13.346
  07:30:11 STEP 1660 H= 415:00 +CPU= 13.948
  07:30:24 STEP 1661 H= 415:15 +CPU= 13.348
  07:30:37 STEP 1662 H= 415:30 +CPU= 13.357
  07:30:51 STEP 1663 H= 415:45 +CPU= 13.393
  07:31:05 STEP 1664 H= 416:00 +CPU= 13.838
  07:31:18 STEP 1665 H= 416:15 +CPU= 13.344
  07:31:32 STEP 1666 H= 416:30 +CPU= 13.324
  07:31:45 STEP 1667 H= 416:45 +CPU= 13.314
  07:32:02 STEP 1668 H= 417:00 +CPU= 17.416
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001668
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001668
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001668
  07:32:16 STEP 1669 H= 417:15 +CPU= 13.443
  07:32:29 STEP 1670 H= 417:30 +CPU= 13.425
  07:32:43 STEP 1671 H= 417:45 +CPU= 13.488
  07:32:57 STEP 1672 H= 418:00 +CPU= 13.927
  07:33:10 STEP 1673 H= 418:15 +CPU= 13.301
  07:33:23 STEP 1674 H= 418:30 +CPU= 13.299
  07:33:37 STEP 1675 H= 418:45 +CPU= 13.408
  07:33:51 STEP 1676 H= 419:00 +CPU= 13.825
  07:34:04 STEP 1677 H= 419:15 +CPU= 13.241
  07:34:17 STEP 1678 H= 419:30 +CPU= 13.196
  07:34:31 STEP 1679 H= 419:45 +CPU= 13.356
  07:34:50 STEP 1680 H= 420:00 +CPU= 19.186
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001680
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001680
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001680
  07:35:03 STEP 1681 H= 420:15 +CPU= 13.319
  07:35:17 STEP 1682 H= 420:30 +CPU= 13.369
  07:35:30 STEP 1683 H= 420:45 +CPU= 13.313
  07:35:44 STEP 1684 H= 421:00 +CPU= 13.867
  07:35:57 STEP 1685 H= 421:15 +CPU= 13.298
  07:36:11 STEP 1686 H= 421:30 +CPU= 13.320
  07:36:24 STEP 1687 H= 421:45 +CPU= 13.324
  07:36:38 STEP 1688 H= 422:00 +CPU= 13.856
  07:36:51 STEP 1689 H= 422:15 +CPU= 13.167
  07:37:04 STEP 1690 H= 422:30 +CPU= 13.313
  07:37:18 STEP 1691 H= 422:45 +CPU= 13.390
  07:37:35 STEP 1692 H= 423:00 +CPU= 17.254
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001692
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001692
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001692
  07:37:48 STEP 1693 H= 423:15 +CPU= 13.213
  07:38:02 STEP 1694 H= 423:30 +CPU= 13.256
  07:38:15 STEP 1695 H= 423:45 +CPU= 13.289
  07:38:29 STEP 1696 H= 424:00 +CPU= 13.748
  07:38:42 STEP 1697 H= 424:15 +CPU= 13.225
  07:38:55 STEP 1698 H= 424:30 +CPU= 13.243
  07:39:08 STEP 1699 H= 424:45 +CPU= 13.247
  07:39:22 STEP 1700 H= 425:00 +CPU= 13.725
  07:39:35 STEP 1701 H= 425:15 +CPU= 13.213
  07:39:49 STEP 1702 H= 425:30 +CPU= 13.231
  07:40:02 STEP 1703 H= 425:45 +CPU= 13.255
  07:40:19 STEP 1704 H= 426:00 +CPU= 17.279
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001704
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001704
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001704
  07:40:33 STEP 1705 H= 426:15 +CPU= 13.270
  07:40:46 STEP 1706 H= 426:30 +CPU= 13.314
  07:40:59 STEP 1707 H= 426:45 +CPU= 13.312
  07:41:13 STEP 1708 H= 427:00 +CPU= 13.810
  07:41:26 STEP 1709 H= 427:15 +CPU= 13.241
  07:41:40 STEP 1710 H= 427:30 +CPU= 13.242
  07:41:53 STEP 1711 H= 427:45 +CPU= 13.229
  07:42:07 STEP 1712 H= 428:00 +CPU= 13.732
  07:42:20 STEP 1713 H= 428:15 +CPU= 13.192
  07:42:33 STEP 1714 H= 428:30 +CPU= 13.187
  07:42:46 STEP 1715 H= 428:45 +CPU= 13.194
  07:43:03 STEP 1716 H= 429:00 +CPU= 17.258
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001716
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001716
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001716
  07:43:17 STEP 1717 H= 429:15 +CPU= 13.242
  07:43:30 STEP 1718 H= 429:30 +CPU= 13.317
  07:43:43 STEP 1719 H= 429:45 +CPU= 13.327
  07:43:57 STEP 1720 H= 430:00 +CPU= 13.812
  07:44:11 STEP 1721 H= 430:15 +CPU= 13.372
  07:44:24 STEP 1722 H= 430:30 +CPU= 13.354
  07:44:37 STEP 1723 H= 430:45 +CPU= 13.376
  07:44:51 STEP 1724 H= 431:00 +CPU= 13.840
  07:45:05 STEP 1725 H= 431:15 +CPU= 13.286
  07:45:18 STEP 1726 H= 431:30 +CPU= 13.252
  07:45:31 STEP 1727 H= 431:45 +CPU= 13.263
  07:45:50 STEP 1728 H= 432:00 +CPU= 19.150
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001728
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001728
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001644
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001644
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001644
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001656
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001656
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001656
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001668
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001668
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001668
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001680
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001680
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001680
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001692
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001692
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001692
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001704
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001704
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001704
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001716
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001716
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0_r1708139427_17.zip
  07:46:04 STEP 1729 H= 432:15 +CPU= 13.141
Uploading the intermediate file: upload_file_17.zip
  07:46:17 STEP 1730 H= 432:30 +CPU= 13.303
  07:46:30 STEP 1731 H= 432:45 +CPU= 13.324
  07:46:44 STEP 1732 H= 433:00 +CPU= 13.766
  07:46:57 STEP 1733 H= 433:15 +CPU= 13.186
  07:47:11 STEP 1734 H= 433:30 +CPU= 13.253
  07:47:24 STEP 1735 H= 433:45 +CPU= 13.229
  07:47:37 STEP 1736 H= 434:00 +CPU= 13.637
  07:47:51 STEP 1737 H= 434:15 +CPU= 13.165
  07:48:04 STEP 1738 H= 434:30 +CPU= 13.298
  07:48:17 STEP 1739 H= 434:45 +CPU= 13.347
  07:48:35 STEP 1740 H= 435:00 +CPU= 17.405
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001740
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001740
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001740
  07:48:48 STEP 1741 H= 435:15 +CPU= 13.223
  07:49:01 STEP 1742 H= 435:30 +CPU= 13.293
  07:49:15 STEP 1743 H= 435:45 +CPU= 13.283
  07:49:28 STEP 1744 H= 436:00 +CPU= 13.759
  07:49:42 STEP 1745 H= 436:15 +CPU= 13.216
  07:49:55 STEP 1746 H= 436:30 +CPU= 13.228
  07:50:08 STEP 1747 H= 436:45 +CPU= 13.231
  07:50:22 STEP 1748 H= 437:00 +CPU= 13.602
  07:50:35 STEP 1749 H= 437:15 +CPU= 13.253
  07:50:48 STEP 1750 H= 437:30 +CPU= 13.198
  07:51:02 STEP 1751 H= 437:45 +CPU= 13.206
  07:51:19 STEP 1752 H= 438:00 +CPU= 17.307
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001752
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001752
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001752
  07:51:32 STEP 1753 H= 438:15 +CPU= 13.179
  07:51:45 STEP 1754 H= 438:30 +CPU= 13.226
  07:51:59 STEP 1755 H= 438:45 +CPU= 13.238
  07:52:12 STEP 1756 H= 439:00 +CPU= 13.780
  07:52:26 STEP 1757 H= 439:15 +CPU= 13.213
  07:52:39 STEP 1758 H= 439:30 +CPU= 13.241
  07:52:52 STEP 1759 H= 439:45 +CPU= 13.266
  07:53:06 STEP 1760 H= 440:00 +CPU= 13.606
  07:53:19 STEP 1761 H= 440:15 +CPU= 13.222
  07:53:32 STEP 1762 H= 440:30 +CPU= 13.247
  07:53:46 STEP 1763 H= 440:45 +CPU= 13.275
  07:54:03 STEP 1764 H= 441:00 +CPU= 17.253
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001764
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001764
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001764
  07:54:16 STEP 1765 H= 441:15 +CPU= 13.156
  07:54:29 STEP 1766 H= 441:30 +CPU= 13.192
  07:54:43 STEP 1767 H= 441:45 +CPU= 13.187
  07:54:56 STEP 1768 H= 442:00 +CPU= 13.666
  07:55:09 STEP 1769 H= 442:15 +CPU= 13.167
  07:55:23 STEP 1770 H= 442:30 +CPU= 13.201
  07:55:36 STEP 1771 H= 442:45 +CPU= 13.257
  07:55:50 STEP 1772 H= 443:00 +CPU= 13.722
  07:56:03 STEP 1773 H= 443:15 +CPU= 13.194
  07:56:16 STEP 1774 H= 443:30 +CPU= 13.249
  07:56:30 STEP 1775 H= 443:45 +CPU= 13.290
  07:56:49 STEP 1776 H= 444:00 +CPU= 19.064
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001776
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001776
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001776
  07:57:02 STEP 1777 H= 444:15 +CPU= 13.294
  07:57:15 STEP 1778 H= 444:30 +CPU= 13.257
  07:57:29 STEP 1779 H= 444:45 +CPU= 13.228
  07:57:42 STEP 1780 H= 445:00 +CPU= 13.682
  07:57:56 STEP 1781 H= 445:15 +CPU= 13.219
  07:58:09 STEP 1782 H= 445:30 +CPU= 13.284
  07:58:22 STEP 1783 H= 445:45 +CPU= 13.372
  07:58:36 STEP 1784 H= 446:00 +CPU= 13.730
  07:58:49 STEP 1785 H= 446:15 +CPU= 13.280
  07:59:03 STEP 1786 H= 446:30 +CPU= 13.409
  07:59:16 STEP 1787 H= 446:45 +CPU= 13.317
  07:59:34 STEP 1788 H= 447:00 +CPU= 17.369
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001788
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001788
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001788
  07:59:47 STEP 1789 H= 447:15 +CPU= 13.244
  08:00:00 STEP 1790 H= 447:30 +CPU= 13.267
  08:00:14 STEP 1791 H= 447:45 +CPU= 13.359
  08:00:27 STEP 1792 H= 448:00 +CPU= 13.796
  08:00:41 STEP 1793 H= 448:15 +CPU= 13.343
  08:00:54 STEP 1794 H= 448:30 +CPU= 13.347
  08:01:07 STEP 1795 H= 448:45 +CPU= 13.311
  08:01:21 STEP 1796 H= 449:00 +CPU= 13.614
  08:01:34 STEP 1797 H= 449:15 +CPU= 13.239
  08:01:48 STEP 1798 H= 449:30 +CPU= 13.234
  08:02:01 STEP 1799 H= 449:45 +CPU= 13.272
  08:02:18 STEP 1800 H= 450:00 +CPU= 17.345
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001800
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001800
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001800
  08:02:32 STEP 1801 H= 450:15 +CPU= 13.298
  08:02:45 STEP 1802 H= 450:30 +CPU= 13.271
  08:02:58 STEP 1803 H= 450:45 +CPU= 13.352
  08:03:12 STEP 1804 H= 451:00 +CPU= 13.748
  08:03:25 STEP 1805 H= 451:15 +CPU= 13.260
  08:03:39 STEP 1806 H= 451:30 +CPU= 13.270
  08:03:52 STEP 1807 H= 451:45 +CPU= 13.281
  08:04:06 STEP 1808 H= 452:00 +CPU= 13.858
  08:04:19 STEP 1809 H= 452:15 +CPU= 13.293
  08:04:33 STEP 1810 H= 452:30 +CPU= 13.236
  08:04:46 STEP 1811 H= 452:45 +CPU= 13.202
  08:05:03 STEP 1812 H= 453:00 +CPU= 17.232
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001812
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001812
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001812
  08:05:16 STEP 1813 H= 453:15 +CPU= 13.267
  08:05:30 STEP 1814 H= 453:30 +CPU= 13.260
  08:05:43 STEP 1815 H= 453:45 +CPU= 13.235
  08:05:57 STEP 1816 H= 454:00 +CPU= 13.711
  08:06:10 STEP 1817 H= 454:15 +CPU= 13.250
  08:06:23 STEP 1818 H= 454:30 +CPU= 13.242
  08:06:36 STEP 1819 H= 454:45 +CPU= 13.122
  08:06:50 STEP 1820 H= 455:00 +CPU= 13.704
  08:07:03 STEP 1821 H= 455:15 +CPU= 13.237
  08:07:17 STEP 1822 H= 455:30 +CPU= 13.259
  08:07:30 STEP 1823 H= 455:45 +CPU= 13.250
  08:07:49 STEP 1824 H= 456:00 +CPU= 18.985
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001824
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001824
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001740
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001740
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001740
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001752
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001752
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001752
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001764
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001764
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001764
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001776
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001776
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001776
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001788
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001788
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001788
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001800
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001800
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001800
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001812
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001812
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0_r1708139427_18.zip
Uploading the intermediate file: upload_file_18.zip
  08:08:02 STEP 1825 H= 456:15 +CPU= 13.332
  08:08:16 STEP 1826 H= 456:30 +CPU= 13.295
  08:08:29 STEP 1827 H= 456:45 +CPU= 13.372
  08:08:43 STEP 1828 H= 457:00 +CPU= 13.835
  08:08:57 STEP 1829 H= 457:15 +CPU= 13.508
  08:09:10 STEP 1830 H= 457:30 +CPU= 13.390
  08:09:23 STEP 1831 H= 457:45 +CPU= 13.347
  08:09:37 STEP 1832 H= 458:00 +CPU= 13.782
  08:09:51 STEP 1833 H= 458:15 +CPU= 13.331
  08:10:04 STEP 1834 H= 458:30 +CPU= 13.343
  08:10:17 STEP 1835 H= 458:45 +CPU= 13.283
  08:10:35 STEP 1836 H= 459:00 +CPU= 17.317
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001836
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001836
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001836
  08:10:48 STEP 1837 H= 459:15 +CPU= 13.331
  08:11:01 STEP 1838 H= 459:30 +CPU= 13.286
  08:11:15 STEP 1839 H= 459:45 +CPU= 13.314
  08:11:29 STEP 1840 H= 460:00 +CPU= 13.861
  08:11:42 STEP 1841 H= 460:15 +CPU= 13.382
  08:11:56 STEP 1842 H= 460:30 +CPU= 13.493
  08:12:09 STEP 1843 H= 460:45 +CPU= 13.278
  08:12:23 STEP 1844 H= 461:00 +CPU= 13.801
  08:12:36 STEP 1845 H= 461:15 +CPU= 13.280
  08:12:49 STEP 1846 H= 461:30 +CPU= 13.301
  08:13:03 STEP 1847 H= 461:45 +CPU= 13.301
  08:13:21 STEP 1848 H= 462:00 +CPU= 17.668
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001848
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001848
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001848
  08:13:34 STEP 1849 H= 462:15 +CPU= 13.446
  08:13:47 STEP 1850 H= 462:30 +CPU= 13.268
  08:14:01 STEP 1851 H= 462:45 +CPU= 13.269
  08:14:14 STEP 1852 H= 463:00 +CPU= 13.869
  08:14:28 STEP 1853 H= 463:15 +CPU= 13.247
  08:14:41 STEP 1854 H= 463:30 +CPU= 13.187
  08:14:54 STEP 1855 H= 463:45 +CPU= 13.112
  08:15:08 STEP 1856 H= 464:00 +CPU= 13.784
  08:15:21 STEP 1857 H= 464:15 +CPU= 13.317
  08:15:35 STEP 1858 H= 464:30 +CPU= 13.340
  08:15:48 STEP 1859 H= 464:45 +CPU= 13.293
  08:16:05 STEP 1860 H= 465:00 +CPU= 17.350
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001860
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001860
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001860
  08:16:19 STEP 1861 H= 465:15 +CPU= 13.306
  08:16:32 STEP 1862 H= 465:30 +CPU= 13.281
  08:16:45 STEP 1863 H= 465:45 +CPU= 13.278
  08:16:59 STEP 1864 H= 466:00 +CPU= 13.784
  08:17:12 STEP 1865 H= 466:15 +CPU= 13.278
  08:17:26 STEP 1866 H= 466:30 +CPU= 13.410
  08:17:39 STEP 1867 H= 466:45 +CPU= 13.182
  08:17:53 STEP 1868 H= 467:00 +CPU= 13.860
  08:18:07 STEP 1869 H= 467:15 +CPU= 13.431
  08:18:20 STEP 1870 H= 467:30 +CPU= 13.388
  08:18:33 STEP 1871 H= 467:45 +CPU= 13.398
  08:18:53 STEP 1872 H= 468:00 +CPU= 19.141
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001872
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001872
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001872
  08:19:06 STEP 1873 H= 468:15 +CPU= 13.287
  08:19:19 STEP 1874 H= 468:30 +CPU= 13.332
  08:19:33 STEP 1875 H= 468:45 +CPU= 13.267
  08:19:46 STEP 1876 H= 469:00 +CPU= 13.735
  08:20:00 STEP 1877 H= 469:15 +CPU= 13.265
  08:20:13 STEP 1878 H= 469:30 +CPU= 13.158
  08:20:26 STEP 1879 H= 469:45 +CPU= 13.317
  08:20:40 STEP 1880 H= 470:00 +CPU= 13.813
  08:20:53 STEP 1881 H= 470:15 +CPU= 13.277
  08:21:07 STEP 1882 H= 470:30 +CPU= 13.298
  08:21:20 STEP 1883 H= 470:45 +CPU= 13.272
  08:21:37 STEP 1884 H= 471:00 +CPU= 17.381
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001884
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001884
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001884
  08:21:51 STEP 1885 H= 471:15 +CPU= 13.371
  08:22:04 STEP 1886 H= 471:30 +CPU= 13.299
  08:22:17 STEP 1887 H= 471:45 +CPU= 13.368
  08:22:31 STEP 1888 H= 472:00 +CPU= 13.859
  08:22:45 STEP 1889 H= 472:15 +CPU= 13.363
  08:22:58 STEP 1890 H= 472:30 +CPU= 13.292
  08:23:11 STEP 1891 H= 472:45 +CPU= 13.327
  08:23:25 STEP 1892 H= 473:00 +CPU= 13.851
  08:23:39 STEP 1893 H= 473:15 +CPU= 13.358
  08:23:52 STEP 1894 H= 473:30 +CPU= 13.409
  08:24:05 STEP 1895 H= 473:45 +CPU= 13.382
  08:24:23 STEP 1896 H= 474:00 +CPU= 17.465
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001896
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001896
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001896
  08:24:37 STEP 1897 H= 474:15 +CPU= 13.504
  08:24:50 STEP 1898 H= 474:30 +CPU= 13.459
  08:25:03 STEP 1899 H= 474:45 +CPU= 13.424
  08:25:17 STEP 1900 H= 475:00 +CPU= 13.913
  08:25:31 STEP 1901 H= 475:15 +CPU= 13.338
  08:25:44 STEP 1902 H= 475:30 +CPU= 13.136
  08:25:57 STEP 1903 H= 475:45 +CPU= 13.280
  08:26:11 STEP 1904 H= 476:00 +CPU= 13.751
  08:26:24 STEP 1905 H= 476:15 +CPU= 13.315
  08:26:38 STEP 1906 H= 476:30 +CPU= 13.288
  08:26:51 STEP 1907 H= 476:45 +CPU= 13.313
  08:27:08 STEP 1908 H= 477:00 +CPU= 17.336
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001908
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001908
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001908
  08:27:22 STEP 1909 H= 477:15 +CPU= 13.310
  08:27:35 STEP 1910 H= 477:30 +CPU= 13.439
  08:27:49 STEP 1911 H= 477:45 +CPU= 13.353
  08:28:03 STEP 1912 H= 478:00 +CPU= 13.787
  08:28:16 STEP 1913 H= 478:15 +CPU= 13.494
  08:28:29 STEP 1914 H= 478:30 +CPU= 13.098
  08:28:43 STEP 1915 H= 478:45 +CPU= 13.286
  08:28:57 STEP 1916 H= 479:00 +CPU= 13.781
  08:29:10 STEP 1917 H= 479:15 +CPU= 13.323
  08:29:23 STEP 1918 H= 479:30 +CPU= 13.309
  08:29:37 STEP 1919 H= 479:45 +CPU= 13.371
  08:29:55 STEP 1920 H= 480:00 +CPU= 17.978
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1972264611E-21      I       0.2955583391E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1615776765E-01      I
I  Relat. Hum. I      0.4636993456E+00      I       0.4903849011E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1701615169E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    402364676 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS******** Mbytes/s, TOTAL TIME=    0.0066( 6.1%)
 08:29:55 STEP 1920 H= 480:00 +CPU= 17.978
 END CNT3
 NSTEP =  1920 CNT0   000000000  12.780  12.780  12.800   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        12870/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    228    0       46      1044068    12870 ************    13.6     1.6    12.0     2.1    23.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 5981664.7 5981664.7    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 5978716.8 5978716.8     99.95      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  469    1768.7    1768.7     13.87      0.00
   9 SPCM     - SPECTRAL COMP.                     432     431.3     431.3      3.12      0.00
  10 SCAN2M - PHYSICS                              433    7308.9    7308.9     52.91      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 36     430.8     430.8      0.26      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 19      37.1      37.1      0.01      0.00
  17 GRIDFPOS IN CNT4                               36      16.7      16.7      0.01      0.00
  27 RESTART FILES - WRITING                         9    1723.1    1723.1      0.26      0.00
  28 RESTART FILES - READING                         1    2592.7    2592.7      0.04      0.00
  29 SU4FPOS IN CNT4                                36       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                36    3407.6    3407.6      2.05      0.00
  31 POSDDH IN STEPO                                 2       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    433    2686.7    2686.7     19.45      0.00
  39 SU0YOMB                                         1     237.7     237.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    433       8.0       8.0      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              432     108.3     108.3      0.78      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              432      23.5      23.5      0.17      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 19       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      940     173.9     173.9      2.73      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       900     115.1     115.1      1.73      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        900      40.1      40.1      0.60      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       940      67.2      67.2      1.06      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      25.1      25.1      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            940      17.6      17.6      0.28      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            900      10.6      10.6      0.16      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            940      36.6      36.6      0.58      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            900      21.3      21.3      0.32      0.00
 400 GSTATS                                      51056       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 47450       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     5981.7 CPU TIME    5963.2 VECTOR TIME     5963.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      289.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMGGh7zg+001920
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMSHh7zg+001920
Moving to projects directory: /var/lib/multiboinc/boinc301/slots/4/ICMUAh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc301/slots/4/NODE.001_01
Adding to the zip: /var/lib/multiboinc/boinc301/slots/4/ifs.stat
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001896
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001860
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001884
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001872
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001836
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001848
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001848
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001908
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001860
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001884
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001836
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001860
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001848
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001872
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001884
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001836
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001908
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMSHh7zg+001872
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMUAh7zg+001896
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001908
Adding to the zip: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_12292029/ICMGGh7zg+001896
Zipping up the final file: /var/lib/multiboinc/boinc301/projects/climateprediction.net/oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0_r1708139427_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
08:33:22 (10641): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Jun 2024 16:01:31 1548832 22445632 oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0 1,727,100 42,093 0.0244
14 Jun 2024 10:39:17 1548832 22445632 oifs_43r3_bl_a2uu_2016092300_20_1018_12292029_0 864,000 22,615 0.0262


©2024 climateprediction.net