climateprediction.net home page
Task 22443819

Task 22443819

Name oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0
Workunit 12290228
Created 12 Jun 2024, 22:42:40 UTC
Sent 12 Jun 2024, 22:47:19 UTC
Report deadline 11 Aug 2024, 22:47:19 UTC
Received 13 Jun 2024, 22:29:10 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1548832
Run time 11 hours 36 min 39 sec
CPU time 11 hours 26 min 26 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 10.67 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,014.13 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,368.75 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
inc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001248
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001248
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001248
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001260
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001260
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001260
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001272
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001272
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001272
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001284
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001284
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001284
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001296
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001296
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001296
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001308
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001308
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001308
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001320
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001320
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001320
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001332
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001332
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0_r728641614_13.zip
  12:01:21 STEP 1345 H= 336:15 +CPU= 21.210
  12:01:41 STEP 1346 H= 336:30 +CPU= 20.097
Uploading the intermediate file: upload_file_13.zip
  12:02:01 STEP 1347 H= 336:45 +CPU= 19.963
  12:02:22 STEP 1348 H= 337:00 +CPU= 20.759
  12:02:43 STEP 1349 H= 337:15 +CPU= 20.901
  12:03:07 STEP 1350 H= 337:30 +CPU= 22.965
  12:03:30 STEP 1351 H= 337:45 +CPU= 22.804
  12:03:51 STEP 1352 H= 338:00 +CPU= 20.582
  12:04:11 STEP 1353 H= 338:15 +CPU= 19.938
  12:04:30 STEP 1354 H= 338:30 +CPU= 19.055
  12:04:49 STEP 1355 H= 338:45 +CPU= 18.420
  12:05:14 STEP 1356 H= 339:00 +CPU= 23.378
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001356
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001356
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001356
  12:05:32 STEP 1357 H= 339:15 +CPU= 17.896
  12:05:50 STEP 1358 H= 339:30 +CPU= 18.075
  12:06:09 STEP 1359 H= 339:45 +CPU= 18.327
  12:06:28 STEP 1360 H= 340:00 +CPU= 19.051
  12:06:47 STEP 1361 H= 340:15 +CPU= 18.464
  12:07:05 STEP 1362 H= 340:30 +CPU= 18.555
  12:07:24 STEP 1363 H= 340:45 +CPU= 18.593
  12:07:43 STEP 1364 H= 341:00 +CPU= 19.012
  12:08:02 STEP 1365 H= 341:15 +CPU= 18.679
  12:08:21 STEP 1366 H= 341:30 +CPU= 18.678
  12:08:40 STEP 1367 H= 341:45 +CPU= 18.847
  12:09:04 STEP 1368 H= 342:00 +CPU= 24.012
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001368
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001368
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001368
  12:09:23 STEP 1369 H= 342:15 +CPU= 18.843
  12:09:42 STEP 1370 H= 342:30 +CPU= 18.589
  12:10:00 STEP 1371 H= 342:45 +CPU= 18.144
  12:10:20 STEP 1372 H= 343:00 +CPU= 19.118
  12:10:39 STEP 1373 H= 343:15 +CPU= 19.018
  12:10:58 STEP 1374 H= 343:30 +CPU= 18.914
  12:11:17 STEP 1375 H= 343:45 +CPU= 19.038
  12:11:36 STEP 1376 H= 344:00 +CPU= 19.233
  12:11:55 STEP 1377 H= 344:15 +CPU= 18.642
  12:12:14 STEP 1378 H= 344:30 +CPU= 18.999
  12:12:33 STEP 1379 H= 344:45 +CPU= 18.851
  12:12:57 STEP 1380 H= 345:00 +CPU= 23.372
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001380
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001380
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001380
  12:13:16 STEP 1381 H= 345:15 +CPU= 18.518
  12:13:34 STEP 1382 H= 345:30 +CPU= 18.080
  12:13:53 STEP 1383 H= 345:45 +CPU= 18.756
  12:14:11 STEP 1384 H= 346:00 +CPU= 18.392
  12:14:30 STEP 1385 H= 346:15 +CPU= 18.450
  12:14:49 STEP 1386 H= 346:30 +CPU= 18.789
  12:15:07 STEP 1387 H= 346:45 +CPU= 18.419
  12:15:25 STEP 1388 H= 347:00 +CPU= 17.115
  12:15:45 STEP 1389 H= 347:15 +CPU= 18.053
  12:16:03 STEP 1390 H= 347:30 +CPU= 18.133
  12:16:23 STEP 1391 H= 347:45 +CPU= 18.661
  12:16:49 STEP 1392 H= 348:00 +CPU= 25.877
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001392
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001392
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001392
  12:17:09 STEP 1393 H= 348:15 +CPU= 18.877
  12:17:28 STEP 1394 H= 348:30 +CPU= 18.941
  12:17:47 STEP 1395 H= 348:45 +CPU= 18.634
  12:18:06 STEP 1396 H= 349:00 +CPU= 19.030
  12:18:27 STEP 1397 H= 349:15 +CPU= 18.935
  12:18:46 STEP 1398 H= 349:30 +CPU= 18.737
  12:19:05 STEP 1399 H= 349:45 +CPU= 18.839
  12:19:24 STEP 1400 H= 350:00 +CPU= 19.275
  12:19:42 STEP 1401 H= 350:15 +CPU= 17.913
  12:20:03 STEP 1402 H= 350:30 +CPU= 18.453
  12:20:22 STEP 1403 H= 350:45 +CPU= 18.818
  12:20:45 STEP 1404 H= 351:00 +CPU= 23.617
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001404
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001404
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001404
  12:21:04 STEP 1405 H= 351:15 +CPU= 18.735
  12:21:23 STEP 1406 H= 351:30 +CPU= 18.760
  12:21:42 STEP 1407 H= 351:45 +CPU= 18.352
  12:22:00 STEP 1408 H= 352:00 +CPU= 18.423
  12:22:19 STEP 1409 H= 352:15 +CPU= 18.322
  12:22:38 STEP 1410 H= 352:30 +CPU= 18.597
  12:22:57 STEP 1411 H= 352:45 +CPU= 18.824
  12:23:16 STEP 1412 H= 353:00 +CPU= 18.936
  12:23:34 STEP 1413 H= 353:15 +CPU= 18.071
  12:23:53 STEP 1414 H= 353:30 +CPU= 18.654
  12:24:12 STEP 1415 H= 353:45 +CPU= 19.254
  12:24:36 STEP 1416 H= 354:00 +CPU= 23.410
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001416
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001416
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001416
  12:24:54 STEP 1417 H= 354:15 +CPU= 18.243
  12:25:13 STEP 1418 H= 354:30 +CPU= 18.481
  12:25:31 STEP 1419 H= 354:45 +CPU= 17.989
  12:25:49 STEP 1420 H= 355:00 +CPU= 18.222
  12:26:08 STEP 1421 H= 355:15 +CPU= 18.608
  12:26:27 STEP 1422 H= 355:30 +CPU= 18.847
  12:26:46 STEP 1423 H= 355:45 +CPU= 19.011
  12:27:06 STEP 1424 H= 356:00 +CPU= 19.204
  12:27:24 STEP 1425 H= 356:15 +CPU= 18.733
  12:27:43 STEP 1426 H= 356:30 +CPU= 18.760
  12:28:03 STEP 1427 H= 356:45 +CPU= 19.186
  12:28:28 STEP 1428 H= 357:00 +CPU= 22.921
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001428
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001428
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001428
  12:28:46 STEP 1429 H= 357:15 +CPU= 18.496
  12:29:05 STEP 1430 H= 357:30 +CPU= 18.924
  12:29:25 STEP 1431 H= 357:45 +CPU= 19.049
  12:29:43 STEP 1432 H= 358:00 +CPU= 18.287
  12:30:02 STEP 1433 H= 358:15 +CPU= 18.521
  12:30:20 STEP 1434 H= 358:30 +CPU= 18.280
  12:30:39 STEP 1435 H= 358:45 +CPU= 18.690
  12:30:57 STEP 1436 H= 359:00 +CPU= 18.062
  12:31:18 STEP 1437 H= 359:15 +CPU= 18.744
  12:31:37 STEP 1438 H= 359:30 +CPU= 19.049
  12:31:56 STEP 1439 H= 359:45 +CPU= 18.608
  12:32:24 STEP 1440 H= 360:00 +CPU= 25.829
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001440
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001440
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001440
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001344
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001344
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001344
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001356
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001356
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001356
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001368
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001368
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001368
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001380
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001380
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001380
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001392
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001392
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001392
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001404
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001404
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001404
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001416
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001416
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001416
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001428
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001428
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0_r728641614_14.zip
  12:32:42 STEP 1441 H= 360:15 +CPU= 17.795
  12:33:01 STEP 1442 H= 360:30 +CPU= 18.729
Uploading the intermediate file: upload_file_14.zip
  12:33:20 STEP 1443 H= 360:45 +CPU= 18.689
  12:33:39 STEP 1444 H= 361:00 +CPU= 18.941
  12:33:58 STEP 1445 H= 361:15 +CPU= 18.539
  12:34:16 STEP 1446 H= 361:30 +CPU= 18.260
  12:34:34 STEP 1447 H= 361:45 +CPU= 18.007
  12:34:54 STEP 1448 H= 362:00 +CPU= 19.200
  12:35:13 STEP 1449 H= 362:15 +CPU= 18.629
  12:35:31 STEP 1450 H= 362:30 +CPU= 18.395
  12:35:50 STEP 1451 H= 362:45 +CPU= 18.851
  12:36:14 STEP 1452 H= 363:00 +CPU= 23.450
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001452
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001452
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001452
  12:36:33 STEP 1453 H= 363:15 +CPU= 18.645
  12:36:52 STEP 1454 H= 363:30 +CPU= 18.873
  12:37:10 STEP 1455 H= 363:45 +CPU= 18.486
  12:37:30 STEP 1456 H= 364:00 +CPU= 19.353
  12:37:49 STEP 1457 H= 364:15 +CPU= 18.716
  12:38:08 STEP 1458 H= 364:30 +CPU= 18.777
  12:38:26 STEP 1459 H= 364:45 +CPU= 18.490
  12:38:45 STEP 1460 H= 365:00 +CPU= 18.478
  12:39:03 STEP 1461 H= 365:15 +CPU= 18.223
  12:39:22 STEP 1462 H= 365:30 +CPU= 18.485
  12:39:40 STEP 1463 H= 365:45 +CPU= 18.249
  12:40:04 STEP 1464 H= 366:00 +CPU= 23.305
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001464
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001464
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001464
  12:40:23 STEP 1465 H= 366:15 +CPU= 18.761
  12:40:41 STEP 1466 H= 366:30 +CPU= 18.622
  12:40:59 STEP 1467 H= 366:45 +CPU= 17.140
  12:41:18 STEP 1468 H= 367:00 +CPU= 18.794
  12:41:36 STEP 1469 H= 367:15 +CPU= 18.600
  12:41:55 STEP 1470 H= 367:30 +CPU= 18.656
  12:42:14 STEP 1471 H= 367:45 +CPU= 18.602
  12:42:33 STEP 1472 H= 368:00 +CPU= 19.153
  12:42:52 STEP 1473 H= 368:15 +CPU= 18.572
  12:43:11 STEP 1474 H= 368:30 +CPU= 19.043
  12:43:30 STEP 1475 H= 368:45 +CPU= 18.600
  12:43:53 STEP 1476 H= 369:00 +CPU= 22.744
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001476
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001476
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001476
  12:44:12 STEP 1477 H= 369:15 +CPU= 18.923
  12:44:31 STEP 1478 H= 369:30 +CPU= 18.654
  12:44:50 STEP 1479 H= 369:45 +CPU= 18.723
  12:45:09 STEP 1480 H= 370:00 +CPU= 18.622
  12:45:27 STEP 1481 H= 370:15 +CPU= 18.550
  12:45:45 STEP 1482 H= 370:30 +CPU= 17.726
  12:46:04 STEP 1483 H= 370:45 +CPU= 18.320
  12:46:23 STEP 1484 H= 371:00 +CPU= 18.772
  12:46:41 STEP 1485 H= 371:15 +CPU= 18.666
  12:47:00 STEP 1486 H= 371:30 +CPU= 18.437
  12:47:18 STEP 1487 H= 371:45 +CPU= 17.624
  12:47:46 STEP 1488 H= 372:00 +CPU= 26.268
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001488
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001488
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001488
  12:48:05 STEP 1489 H= 372:15 +CPU= 18.681
  12:48:24 STEP 1490 H= 372:30 +CPU= 18.238
  12:48:43 STEP 1491 H= 372:45 +CPU= 19.025
  12:49:02 STEP 1492 H= 373:00 +CPU= 19.104
  12:49:21 STEP 1493 H= 373:15 +CPU= 18.920
  12:49:40 STEP 1494 H= 373:30 +CPU= 18.922
  12:50:00 STEP 1495 H= 373:45 +CPU= 19.251
  12:50:19 STEP 1496 H= 374:00 +CPU= 19.321
  12:50:38 STEP 1497 H= 374:15 +CPU= 19.039
  12:50:59 STEP 1498 H= 374:30 +CPU= 20.100
  12:51:18 STEP 1499 H= 374:45 +CPU= 19.378
  12:51:43 STEP 1500 H= 375:00 +CPU= 24.185
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001500
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001500
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001500
  12:52:02 STEP 1501 H= 375:15 +CPU= 19.130
  12:52:22 STEP 1502 H= 375:30 +CPU= 19.879
  12:52:42 STEP 1503 H= 375:45 +CPU= 19.550
  12:53:02 STEP 1504 H= 376:00 +CPU= 19.667
  12:53:22 STEP 1505 H= 376:15 +CPU= 19.755
  12:53:42 STEP 1506 H= 376:30 +CPU= 19.280
  12:54:01 STEP 1507 H= 376:45 +CPU= 19.379
  12:54:22 STEP 1508 H= 377:00 +CPU= 19.876
  12:54:42 STEP 1509 H= 377:15 +CPU= 19.793
  12:55:03 STEP 1510 H= 377:30 +CPU= 19.707
  12:55:24 STEP 1511 H= 377:45 +CPU= 20.574
  12:55:49 STEP 1512 H= 378:00 +CPU= 24.311
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001512
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001512
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001512
  12:56:09 STEP 1513 H= 378:15 +CPU= 19.316
  12:56:28 STEP 1514 H= 378:30 +CPU= 19.503
  12:56:49 STEP 1515 H= 378:45 +CPU= 20.760
  12:57:09 STEP 1516 H= 379:00 +CPU= 19.569
  12:57:29 STEP 1517 H= 379:15 +CPU= 19.663
  12:57:49 STEP 1518 H= 379:30 +CPU= 19.649
  12:58:08 STEP 1519 H= 379:45 +CPU= 18.341
  12:58:27 STEP 1520 H= 380:00 +CPU= 18.983
  12:58:45 STEP 1521 H= 380:15 +CPU= 18.237
  12:59:05 STEP 1522 H= 380:30 +CPU= 18.294
  12:59:24 STEP 1523 H= 380:45 +CPU= 18.493
  12:59:47 STEP 1524 H= 381:00 +CPU= 22.785
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001524
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001524
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001524
  13:00:06 STEP 1525 H= 381:15 +CPU= 19.009
  13:00:26 STEP 1526 H= 381:30 +CPU= 19.709
  13:00:45 STEP 1527 H= 381:45 +CPU= 19.418
  13:01:04 STEP 1528 H= 382:00 +CPU= 17.975
  13:01:23 STEP 1529 H= 382:15 +CPU= 18.822
  13:01:43 STEP 1530 H= 382:30 +CPU= 19.808
  13:02:03 STEP 1531 H= 382:45 +CPU= 19.941
  13:02:23 STEP 1532 H= 383:00 +CPU= 19.875
  13:02:42 STEP 1533 H= 383:15 +CPU= 19.135
  13:03:02 STEP 1534 H= 383:30 +CPU= 19.645
  13:03:23 STEP 1535 H= 383:45 +CPU= 20.162
  13:03:51 STEP 1536 H= 384:00 +CPU= 27.620
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001536
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001536
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001440
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001440
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001440
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001452
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001452
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001452
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001464
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001464
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001464
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001476
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001476
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001476
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001488
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001488
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001488
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001500
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001500
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001500
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001512
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001512
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001512
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001524
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001524
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001524
Zipping up the intermediate file: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0_r728641614_15.zip
  13:04:11 STEP 1537 H= 384:15 +CPU= 20.033
  13:04:31 STEP 1538 H= 384:30 +CPU= 19.651
Uploading the intermediate file: upload_file_15.zip
  13:04:52 STEP 1539 H= 384:45 +CPU= 20.507
Uploading trickle at timestep: 1382400
  13:05:13 STEP 1540 H= 385:00 +CPU= 21.148
  13:05:32 STEP 1541 H= 385:15 +CPU= 18.766
  13:05:53 STEP 1542 H= 385:30 +CPU= 19.932
  13:06:14 STEP 1543 H= 385:45 +CPU= 20.354
  13:06:35 STEP 1544 H= 386:00 +CPU= 20.326
  13:06:55 STEP 1545 H= 386:15 +CPU= 19.843
  13:07:15 STEP 1546 H= 386:30 +CPU= 19.783
  13:07:35 STEP 1547 H= 386:45 +CPU= 19.739
  13:08:01 STEP 1548 H= 387:00 +CPU= 25.317
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001548
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001548
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001548
  13:08:20 STEP 1549 H= 387:15 +CPU= 19.540
  13:08:40 STEP 1550 H= 387:30 +CPU= 19.404
  13:08:59 STEP 1551 H= 387:45 +CPU= 18.975
  13:09:21 STEP 1552 H= 388:00 +CPU= 21.246
  13:09:40 STEP 1553 H= 388:15 +CPU= 19.087
  13:09:59 STEP 1554 H= 388:30 +CPU= 19.037
  13:10:19 STEP 1555 H= 388:45 +CPU= 19.188
  13:10:39 STEP 1556 H= 389:00 +CPU= 19.954
  13:10:59 STEP 1557 H= 389:15 +CPU= 19.489
  13:11:18 STEP 1558 H= 389:30 +CPU= 19.416
  13:11:38 STEP 1559 H= 389:45 +CPU= 19.193
  13:12:02 STEP 1560 H= 390:00 +CPU= 23.682
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001560
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001560
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001560
  13:12:21 STEP 1561 H= 390:15 +CPU= 18.939
  13:12:40 STEP 1562 H= 390:30 +CPU= 18.782
  13:12:58 STEP 1563 H= 390:45 +CPU= 18.368
  13:13:17 STEP 1564 H= 391:00 +CPU= 18.901
  13:13:37 STEP 1565 H= 391:15 +CPU= 19.150
  13:13:56 STEP 1566 H= 391:30 +CPU= 18.915
  13:14:15 STEP 1567 H= 391:45 +CPU= 18.922
  13:14:34 STEP 1568 H= 392:00 +CPU= 19.511
  13:14:55 STEP 1569 H= 392:15 +CPU= 19.291
  13:15:14 STEP 1570 H= 392:30 +CPU= 18.981
  13:15:33 STEP 1571 H= 392:45 +CPU= 18.989
  13:15:57 STEP 1572 H= 393:00 +CPU= 23.342
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001572
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001572
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001572
  13:16:16 STEP 1573 H= 393:15 +CPU= 18.963
  13:16:35 STEP 1574 H= 393:30 +CPU= 18.771
  13:16:53 STEP 1575 H= 393:45 +CPU= 18.166
  13:17:12 STEP 1576 H= 394:00 +CPU= 19.046
  13:17:31 STEP 1577 H= 394:15 +CPU= 18.870
  13:17:52 STEP 1578 H= 394:30 +CPU= 18.602
  13:18:10 STEP 1579 H= 394:45 +CPU= 18.576
  13:18:30 STEP 1580 H= 395:00 +CPU= 19.485
  13:18:49 STEP 1581 H= 395:15 +CPU= 19.020
  13:19:09 STEP 1582 H= 395:30 +CPU= 19.072
  13:19:28 STEP 1583 H= 395:45 +CPU= 18.945
  13:19:55 STEP 1584 H= 396:00 +CPU= 26.555
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001584
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001584
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001584
  13:20:13 STEP 1585 H= 396:15 +CPU= 18.519
  13:20:32 STEP 1586 H= 396:30 +CPU= 18.378
  13:20:51 STEP 1587 H= 396:45 +CPU= 18.868
  13:21:11 STEP 1588 H= 397:00 +CPU= 19.581
  13:21:30 STEP 1589 H= 397:15 +CPU= 19.133
  13:21:49 STEP 1590 H= 397:30 +CPU= 18.739
  13:22:07 STEP 1591 H= 397:45 +CPU= 18.474
  13:22:28 STEP 1592 H= 398:00 +CPU= 20.080
  13:22:47 STEP 1593 H= 398:15 +CPU= 18.999
  13:23:06 STEP 1594 H= 398:30 +CPU= 18.368
  13:23:25 STEP 1595 H= 398:45 +CPU= 18.736
  13:23:48 STEP 1596 H= 399:00 +CPU= 23.400
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001596
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001596
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001596
  13:24:07 STEP 1597 H= 399:15 +CPU= 18.981
  13:24:26 STEP 1598 H= 399:30 +CPU= 18.675
  13:24:45 STEP 1599 H= 399:45 +CPU= 18.862
  13:25:05 STEP 1600 H= 400:00 +CPU= 19.258
  13:25:24 STEP 1601 H= 400:15 +CPU= 18.699
  13:25:42 STEP 1602 H= 400:30 +CPU= 18.569
  13:26:01 STEP 1603 H= 400:45 +CPU= 18.734
  13:26:21 STEP 1604 H= 401:00 +CPU= 19.281
  13:26:39 STEP 1605 H= 401:15 +CPU= 18.487
  13:26:58 STEP 1606 H= 401:30 +CPU= 18.628
  13:27:17 STEP 1607 H= 401:45 +CPU= 18.559
  13:27:40 STEP 1608 H= 402:00 +CPU= 23.183
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001608
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001608
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001608
  13:27:59 STEP 1609 H= 402:15 +CPU= 19.082
  13:28:19 STEP 1610 H= 402:30 +CPU= 19.048
  13:28:37 STEP 1611 H= 402:45 +CPU= 18.495
  13:28:56 STEP 1612 H= 403:00 +CPU= 18.366
  13:29:15 STEP 1613 H= 403:15 +CPU= 18.319
  13:29:35 STEP 1614 H= 403:30 +CPU= 19.405
  13:29:58 STEP 1615 H= 403:45 +CPU= 19.299
  13:30:18 STEP 1616 H= 404:00 +CPU= 19.736
  13:30:38 STEP 1617 H= 404:15 +CPU= 19.600
  13:30:57 STEP 1618 H= 404:30 +CPU= 19.150
  13:31:16 STEP 1619 H= 404:45 +CPU= 19.119
  13:31:41 STEP 1620 H= 405:00 +CPU= 24.147
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001620
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001620
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001620
  13:32:00 STEP 1621 H= 405:15 +CPU= 18.563
  13:32:19 STEP 1622 H= 405:30 +CPU= 19.241
  13:32:37 STEP 1623 H= 405:45 +CPU= 18.211
  13:32:57 STEP 1624 H= 406:00 +CPU= 19.063
  13:33:14 STEP 1625 H= 406:15 +CPU= 17.507
  13:33:34 STEP 1626 H= 406:30 +CPU= 19.363
  13:33:53 STEP 1627 H= 406:45 +CPU= 19.331
  13:34:13 STEP 1628 H= 407:00 +CPU= 19.723
  13:34:32 STEP 1629 H= 407:15 +CPU= 18.891
  13:34:52 STEP 1630 H= 407:30 +CPU= 19.010
  13:35:11 STEP 1631 H= 407:45 +CPU= 18.773
  13:35:37 STEP 1632 H= 408:00 +CPU= 26.106
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001632
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001632
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001536
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001548
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001548
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001548
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001560
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001560
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001560
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001572
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001572
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001572
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001584
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001584
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001584
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001596
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001596
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001596
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001608
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001608
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001608
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001620
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001620
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0_r728641614_16.zip
Uploading the intermediate file: upload_file_16.zip
  13:35:56 STEP 1633 H= 408:15 +CPU= 18.813
  13:36:15 STEP 1634 H= 408:30 +CPU= 19.066
  13:36:34 STEP 1635 H= 408:45 +CPU= 18.712
  13:36:53 STEP 1636 H= 409:00 +CPU= 19.248
  13:37:12 STEP 1637 H= 409:15 +CPU= 18.340
  13:37:31 STEP 1638 H= 409:30 +CPU= 18.618
  13:37:49 STEP 1639 H= 409:45 +CPU= 18.591
  13:38:09 STEP 1640 H= 410:00 +CPU= 19.110
  13:38:27 STEP 1641 H= 410:15 +CPU= 18.530
  13:38:47 STEP 1642 H= 410:30 +CPU= 19.169
  13:39:06 STEP 1643 H= 410:45 +CPU= 18.998
  13:39:32 STEP 1644 H= 411:00 +CPU= 24.330
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001644
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001644
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001644
  13:39:53 STEP 1645 H= 411:15 +CPU= 21.353
  13:40:12 STEP 1646 H= 411:30 +CPU= 18.692
  13:40:31 STEP 1647 H= 411:45 +CPU= 18.707
  13:40:50 STEP 1648 H= 412:00 +CPU= 18.945
  13:41:09 STEP 1649 H= 412:15 +CPU= 18.835
  13:41:28 STEP 1650 H= 412:30 +CPU= 19.072
  13:41:48 STEP 1651 H= 412:45 +CPU= 19.123
  13:42:07 STEP 1652 H= 413:00 +CPU= 19.495
  13:42:26 STEP 1653 H= 413:15 +CPU= 18.735
  13:42:45 STEP 1654 H= 413:30 +CPU= 18.782
  13:43:04 STEP 1655 H= 413:45 +CPU= 18.886
  13:43:28 STEP 1656 H= 414:00 +CPU= 23.391
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001656
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001656
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001656
  13:43:47 STEP 1657 H= 414:15 +CPU= 19.229
  13:44:06 STEP 1658 H= 414:30 +CPU= 18.672
  13:44:26 STEP 1659 H= 414:45 +CPU= 19.244
  13:44:45 STEP 1660 H= 415:00 +CPU= 19.264
  13:45:04 STEP 1661 H= 415:15 +CPU= 18.669
  13:45:23 STEP 1662 H= 415:30 +CPU= 19.058
  13:45:42 STEP 1663 H= 415:45 +CPU= 19.121
  13:46:02 STEP 1664 H= 416:00 +CPU= 19.399
  13:46:21 STEP 1665 H= 416:15 +CPU= 19.116
  13:46:40 STEP 1666 H= 416:30 +CPU= 19.055
  13:47:00 STEP 1667 H= 416:45 +CPU= 19.390
  13:47:24 STEP 1668 H= 417:00 +CPU= 24.131
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001668
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001668
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001668
  13:47:43 STEP 1669 H= 417:15 +CPU= 18.602
  13:48:02 STEP 1670 H= 417:30 +CPU= 18.756
  13:48:21 STEP 1671 H= 417:45 +CPU= 18.965
  13:48:41 STEP 1672 H= 418:00 +CPU= 19.521
  13:49:00 STEP 1673 H= 418:15 +CPU= 19.116
  13:49:18 STEP 1674 H= 418:30 +CPU= 18.037
  13:49:36 STEP 1675 H= 418:45 +CPU= 17.831
  13:49:56 STEP 1676 H= 419:00 +CPU= 19.095
  13:50:15 STEP 1677 H= 419:15 +CPU= 18.958
  13:50:34 STEP 1678 H= 419:30 +CPU= 18.571
  13:50:52 STEP 1679 H= 419:45 +CPU= 18.621
  13:51:19 STEP 1680 H= 420:00 +CPU= 26.148
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001680
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001680
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001680
  13:51:37 STEP 1681 H= 420:15 +CPU= 18.435
  13:51:56 STEP 1682 H= 420:30 +CPU= 18.691
  13:52:15 STEP 1683 H= 420:45 +CPU= 18.422
  13:52:35 STEP 1684 H= 421:00 +CPU= 19.467
  13:52:53 STEP 1685 H= 421:15 +CPU= 18.725
  13:53:12 STEP 1686 H= 421:30 +CPU= 18.290
  13:53:31 STEP 1687 H= 421:45 +CPU= 18.513
  13:53:50 STEP 1688 H= 422:00 +CPU= 19.087
  13:54:09 STEP 1689 H= 422:15 +CPU= 18.562
  13:54:29 STEP 1690 H= 422:30 +CPU= 18.440
  13:54:47 STEP 1691 H= 422:45 +CPU= 18.542
  13:55:10 STEP 1692 H= 423:00 +CPU= 22.995
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001692
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001692
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001692
  13:55:29 STEP 1693 H= 423:15 +CPU= 17.965
  13:55:48 STEP 1694 H= 423:30 +CPU= 19.036
  13:56:07 STEP 1695 H= 423:45 +CPU= 18.688
  13:56:26 STEP 1696 H= 424:00 +CPU= 19.090
  13:56:45 STEP 1697 H= 424:15 +CPU= 18.526
  13:57:03 STEP 1698 H= 424:30 +CPU= 18.400
  13:57:22 STEP 1699 H= 424:45 +CPU= 19.017
  13:57:42 STEP 1700 H= 425:00 +CPU= 19.091
  13:58:00 STEP 1701 H= 425:15 +CPU= 18.321
  13:58:19 STEP 1702 H= 425:30 +CPU= 18.563
  13:58:38 STEP 1703 H= 425:45 +CPU= 18.540
  13:59:01 STEP 1704 H= 426:00 +CPU= 23.185
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001704
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001704
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001704
  13:59:20 STEP 1705 H= 426:15 +CPU= 19.277
  13:59:39 STEP 1706 H= 426:30 +CPU= 18.795
  13:59:58 STEP 1707 H= 426:45 +CPU= 18.441
  14:00:17 STEP 1708 H= 427:00 +CPU= 18.934
  14:00:36 STEP 1709 H= 427:15 +CPU= 18.651
  14:00:55 STEP 1710 H= 427:30 +CPU= 18.946
  14:01:14 STEP 1711 H= 427:45 +CPU= 19.013
  14:01:34 STEP 1712 H= 428:00 +CPU= 19.362
  14:01:53 STEP 1713 H= 428:15 +CPU= 19.246
  14:02:12 STEP 1714 H= 428:30 +CPU= 18.880
  14:02:32 STEP 1715 H= 428:45 +CPU= 18.971
  14:02:56 STEP 1716 H= 429:00 +CPU= 24.130
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001716
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001716
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001716
  14:03:15 STEP 1717 H= 429:15 +CPU= 19.161
  14:03:37 STEP 1718 H= 429:30 +CPU= 19.481
  14:03:56 STEP 1719 H= 429:45 +CPU= 19.112
  14:04:16 STEP 1720 H= 430:00 +CPU= 19.209
  14:04:35 STEP 1721 H= 430:15 +CPU= 19.671
  14:04:55 STEP 1722 H= 430:30 +CPU= 19.481
  14:05:15 STEP 1723 H= 430:45 +CPU= 19.711
  14:05:35 STEP 1724 H= 431:00 +CPU= 19.883
  14:05:55 STEP 1725 H= 431:15 +CPU= 19.520
  14:06:15 STEP 1726 H= 431:30 +CPU= 19.726
  14:06:35 STEP 1727 H= 431:45 +CPU= 19.729
  14:07:04 STEP 1728 H= 432:00 +CPU= 27.523
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001728
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001728
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001632
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001644
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001644
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001644
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001656
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001656
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001656
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001668
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001668
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001668
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001680
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001680
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001680
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001692
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001692
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001692
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001704
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001704
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001704
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001716
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001716
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0_r728641614_17.zip
Uploading the intermediate file: upload_file_17.zip
  14:07:24 STEP 1729 H= 432:15 +CPU= 19.746
  14:07:44 STEP 1730 H= 432:30 +CPU= 19.695
  14:08:05 STEP 1731 H= 432:45 +CPU= 20.413
  14:08:25 STEP 1732 H= 433:00 +CPU= 20.257
  14:08:45 STEP 1733 H= 433:15 +CPU= 19.850
  14:09:05 STEP 1734 H= 433:30 +CPU= 19.516
  14:09:25 STEP 1735 H= 433:45 +CPU= 19.601
  14:09:46 STEP 1736 H= 434:00 +CPU= 20.594
  14:10:06 STEP 1737 H= 434:15 +CPU= 20.027
  14:10:26 STEP 1738 H= 434:30 +CPU= 19.933
  14:10:46 STEP 1739 H= 434:45 +CPU= 19.903
  14:11:12 STEP 1740 H= 435:00 +CPU= 24.019
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001740
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001740
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001740
  14:11:33 STEP 1741 H= 435:15 +CPU= 20.277
  14:11:53 STEP 1742 H= 435:30 +CPU= 19.792
  14:12:13 STEP 1743 H= 435:45 +CPU= 19.318
  14:12:33 STEP 1744 H= 436:00 +CPU= 20.186
  14:12:53 STEP 1745 H= 436:15 +CPU= 19.415
  14:13:13 STEP 1746 H= 436:30 +CPU= 19.557
  14:13:32 STEP 1747 H= 436:45 +CPU= 19.426
  14:13:53 STEP 1748 H= 437:00 +CPU= 20.026
  14:14:12 STEP 1749 H= 437:15 +CPU= 19.425
  14:14:32 STEP 1750 H= 437:30 +CPU= 19.197
  14:14:51 STEP 1751 H= 437:45 +CPU= 19.126
  14:15:16 STEP 1752 H= 438:00 +CPU= 24.323
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001752
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001752
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001752
  14:15:34 STEP 1753 H= 438:15 +CPU= 18.724
  14:15:53 STEP 1754 H= 438:30 +CPU= 18.402
  14:16:12 STEP 1755 H= 438:45 +CPU= 18.775
  14:16:31 STEP 1756 H= 439:00 +CPU= 19.276
  14:16:52 STEP 1757 H= 439:15 +CPU= 18.901
  14:17:11 STEP 1758 H= 439:30 +CPU= 18.748
  14:17:31 STEP 1759 H= 439:45 +CPU= 19.367
  14:17:51 STEP 1760 H= 440:00 +CPU= 20.035
  14:18:10 STEP 1761 H= 440:15 +CPU= 19.347
  14:18:30 STEP 1762 H= 440:30 +CPU= 19.360
  14:18:49 STEP 1763 H= 440:45 +CPU= 19.005
  14:19:12 STEP 1764 H= 441:00 +CPU= 23.022
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001764
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001764
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001764
  14:19:31 STEP 1765 H= 441:15 +CPU= 18.471
  14:19:50 STEP 1766 H= 441:30 +CPU= 18.442
  14:20:10 STEP 1767 H= 441:45 +CPU= 16.871
  14:20:29 STEP 1768 H= 442:00 +CPU= 19.255
  14:20:49 STEP 1769 H= 442:15 +CPU= 19.492
  14:21:08 STEP 1770 H= 442:30 +CPU= 18.773
  14:21:27 STEP 1771 H= 442:45 +CPU= 19.438
  14:21:47 STEP 1772 H= 443:00 +CPU= 19.997
  14:22:07 STEP 1773 H= 443:15 +CPU= 19.310
  14:22:26 STEP 1774 H= 443:30 +CPU= 18.665
  14:22:44 STEP 1775 H= 443:45 +CPU= 18.432
  14:23:11 STEP 1776 H= 444:00 +CPU= 26.020
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001776
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001776
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001776
  14:23:29 STEP 1777 H= 444:15 +CPU= 18.384
  14:23:48 STEP 1778 H= 444:30 +CPU= 18.600
  14:24:07 STEP 1779 H= 444:45 +CPU= 18.652
  14:24:25 STEP 1780 H= 445:00 +CPU= 18.361
  14:24:46 STEP 1781 H= 445:15 +CPU= 18.719
  14:25:05 STEP 1782 H= 445:30 +CPU= 18.993
  14:25:23 STEP 1783 H= 445:45 +CPU= 18.443
  14:25:46 STEP 1784 H= 446:00 +CPU= 19.079
  14:26:04 STEP 1785 H= 446:15 +CPU= 18.339
  14:26:23 STEP 1786 H= 446:30 +CPU= 18.964
  14:26:43 STEP 1787 H= 446:45 +CPU= 19.000
  14:27:06 STEP 1788 H= 447:00 +CPU= 23.042
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001788
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001788
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001788
  14:27:25 STEP 1789 H= 447:15 +CPU= 19.058
  14:27:45 STEP 1790 H= 447:30 +CPU= 19.343
  14:28:03 STEP 1791 H= 447:45 +CPU= 18.392
  14:28:24 STEP 1792 H= 448:00 +CPU= 19.492
  14:28:43 STEP 1793 H= 448:15 +CPU= 18.615
  14:29:02 STEP 1794 H= 448:30 +CPU= 18.915
  14:29:21 STEP 1795 H= 448:45 +CPU= 18.995
  14:29:41 STEP 1796 H= 449:00 +CPU= 20.004
  14:30:01 STEP 1797 H= 449:15 +CPU= 19.176
  14:30:19 STEP 1798 H= 449:30 +CPU= 18.639
  14:30:38 STEP 1799 H= 449:45 +CPU= 18.811
  14:31:03 STEP 1800 H= 450:00 +CPU= 23.763
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001800
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001800
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001800
  14:31:21 STEP 1801 H= 450:15 +CPU= 18.158
  14:31:40 STEP 1802 H= 450:30 +CPU= 19.270
  14:31:58 STEP 1803 H= 450:45 +CPU= 17.551
  14:32:19 STEP 1804 H= 451:00 +CPU= 19.309
  14:32:38 STEP 1805 H= 451:15 +CPU= 18.703
  14:32:57 STEP 1806 H= 451:30 +CPU= 18.949
  14:33:16 STEP 1807 H= 451:45 +CPU= 18.574
  14:33:35 STEP 1808 H= 452:00 +CPU= 19.036
  14:33:54 STEP 1809 H= 452:15 +CPU= 18.808
  14:34:13 STEP 1810 H= 452:30 +CPU= 19.044
  14:34:32 STEP 1811 H= 452:45 +CPU= 18.897
  14:34:56 STEP 1812 H= 453:00 +CPU= 23.526
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001812
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001812
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001812
  14:35:15 STEP 1813 H= 453:15 +CPU= 18.890
  14:35:37 STEP 1814 H= 453:30 +CPU= 18.783
  14:35:56 STEP 1815 H= 453:45 +CPU= 18.353
  14:36:15 STEP 1816 H= 454:00 +CPU= 18.443
  14:36:34 STEP 1817 H= 454:15 +CPU= 19.190
  14:36:53 STEP 1818 H= 454:30 +CPU= 18.757
  14:37:12 STEP 1819 H= 454:45 +CPU= 18.853
  14:37:31 STEP 1820 H= 455:00 +CPU= 18.943
  14:37:50 STEP 1821 H= 455:15 +CPU= 18.410
  14:38:09 STEP 1822 H= 455:30 +CPU= 18.593
  14:38:28 STEP 1823 H= 455:45 +CPU= 18.604
  14:38:54 STEP 1824 H= 456:00 +CPU= 25.989
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001824
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001824
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001728
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001740
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001740
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001740
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001752
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001752
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001752
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001764
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001764
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001764
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001776
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001776
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001776
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001788
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001788
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001788
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001800
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001800
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001800
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001812
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001812
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0_r728641614_18.zip
  14:39:12 STEP 1825 H= 456:15 +CPU= 18.244
Uploading the intermediate file: upload_file_18.zip
  14:39:31 STEP 1826 H= 456:30 +CPU= 18.894
  14:39:50 STEP 1827 H= 456:45 +CPU= 18.922
  14:40:10 STEP 1828 H= 457:00 +CPU= 19.243
  14:40:30 STEP 1829 H= 457:15 +CPU= 19.852
  14:40:49 STEP 1830 H= 457:30 +CPU= 19.110
  14:41:08 STEP 1831 H= 457:45 +CPU= 18.863
  14:41:28 STEP 1832 H= 458:00 +CPU= 19.338
  14:41:47 STEP 1833 H= 458:15 +CPU= 18.874
  14:42:06 STEP 1834 H= 458:30 +CPU= 19.077
  14:42:25 STEP 1835 H= 458:45 +CPU= 18.872
  14:42:48 STEP 1836 H= 459:00 +CPU= 22.976
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001836
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001836
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001836
  14:43:07 STEP 1837 H= 459:15 +CPU= 18.954
  14:43:27 STEP 1838 H= 459:30 +CPU= 19.197
  14:43:46 STEP 1839 H= 459:45 +CPU= 18.875
  14:44:06 STEP 1840 H= 460:00 +CPU= 19.653
  14:44:25 STEP 1841 H= 460:15 +CPU= 18.998
  14:44:44 STEP 1842 H= 460:30 +CPU= 19.255
  14:45:03 STEP 1843 H= 460:45 +CPU= 18.595
  14:45:24 STEP 1844 H= 461:00 +CPU= 19.210
  14:45:42 STEP 1845 H= 461:15 +CPU= 18.613
  14:46:01 STEP 1846 H= 461:30 +CPU= 18.366
  14:46:20 STEP 1847 H= 461:45 +CPU= 18.622
  14:46:44 STEP 1848 H= 462:00 +CPU= 23.553
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001848
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001848
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001848
  14:47:02 STEP 1849 H= 462:15 +CPU= 16.822
  14:47:21 STEP 1850 H= 462:30 +CPU= 18.512
  14:47:42 STEP 1851 H= 462:45 +CPU= 18.727
  14:48:01 STEP 1852 H= 463:00 +CPU= 19.292
  14:48:20 STEP 1853 H= 463:15 +CPU= 18.962
  14:48:39 STEP 1854 H= 463:30 +CPU= 18.393
  14:48:57 STEP 1855 H= 463:45 +CPU= 18.515
  14:49:17 STEP 1856 H= 464:00 +CPU= 19.518
  14:49:36 STEP 1857 H= 464:15 +CPU= 19.109
  14:49:57 STEP 1858 H= 464:30 +CPU= 18.822
  14:50:15 STEP 1859 H= 464:45 +CPU= 18.371
  14:50:38 STEP 1860 H= 465:00 +CPU= 22.988
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001860
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001860
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001860
  14:50:56 STEP 1861 H= 465:15 +CPU= 15.547
  14:51:15 STEP 1862 H= 465:30 +CPU= 18.971
  14:51:34 STEP 1863 H= 465:45 +CPU= 18.816
  14:51:54 STEP 1864 H= 466:00 +CPU= 19.531
  14:52:14 STEP 1865 H= 466:15 +CPU= 18.645
  14:52:34 STEP 1866 H= 466:30 +CPU= 19.426
  14:52:53 STEP 1867 H= 466:45 +CPU= 19.067
  14:53:12 STEP 1868 H= 467:00 +CPU= 18.917
  14:53:31 STEP 1869 H= 467:15 +CPU= 18.852
  14:53:49 STEP 1870 H= 467:30 +CPU= 18.262
  14:54:08 STEP 1871 H= 467:45 +CPU= 18.831
  14:54:36 STEP 1872 H= 468:00 +CPU= 27.697
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001872
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001872
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001872
  14:54:57 STEP 1873 H= 468:15 +CPU= 20.443
  14:55:17 STEP 1874 H= 468:30 +CPU= 20.152
  14:55:38 STEP 1875 H= 468:45 +CPU= 20.150
  14:55:59 STEP 1876 H= 469:00 +CPU= 20.490
  14:56:19 STEP 1877 H= 469:15 +CPU= 20.139
  14:56:39 STEP 1878 H= 469:30 +CPU= 19.961
  14:56:59 STEP 1879 H= 469:45 +CPU= 20.039
  14:57:20 STEP 1880 H= 470:00 +CPU= 20.069
  14:57:40 STEP 1881 H= 470:15 +CPU= 19.749
  14:58:00 STEP 1882 H= 470:30 +CPU= 19.875
  14:58:20 STEP 1883 H= 470:45 +CPU= 19.859
  14:58:45 STEP 1884 H= 471:00 +CPU= 24.476
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001884
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001884
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001884
  14:59:05 STEP 1885 H= 471:15 +CPU= 19.946
  14:59:25 STEP 1886 H= 471:30 +CPU= 19.979
  14:59:45 STEP 1887 H= 471:45 +CPU= 20.005
  15:00:06 STEP 1888 H= 472:00 +CPU= 20.261
  15:00:26 STEP 1889 H= 472:15 +CPU= 19.970
  15:00:46 STEP 1890 H= 472:30 +CPU= 19.748
  15:01:06 STEP 1891 H= 472:45 +CPU= 19.716
  15:01:27 STEP 1892 H= 473:00 +CPU= 20.192
  15:01:46 STEP 1893 H= 473:15 +CPU= 18.986
  15:02:04 STEP 1894 H= 473:30 +CPU= 17.531
  15:02:21 STEP 1895 H= 473:45 +CPU= 17.185
  15:02:43 STEP 1896 H= 474:00 +CPU= 21.449
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001896
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001896
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001896
  15:02:59 STEP 1897 H= 474:15 +CPU= 16.356
  15:03:15 STEP 1898 H= 474:30 +CPU= 16.127
  15:03:31 STEP 1899 H= 474:45 +CPU= 15.898
  15:03:48 STEP 1900 H= 475:00 +CPU= 16.821
  15:04:05 STEP 1901 H= 475:15 +CPU= 16.290
  15:04:21 STEP 1902 H= 475:30 +CPU= 16.477
  15:04:38 STEP 1903 H= 475:45 +CPU= 16.380
  15:04:55 STEP 1904 H= 476:00 +CPU= 16.978
  15:05:11 STEP 1905 H= 476:15 +CPU= 16.291
  15:05:29 STEP 1906 H= 476:30 +CPU= 16.639
  15:05:47 STEP 1907 H= 476:45 +CPU= 18.051
  15:06:10 STEP 1908 H= 477:00 +CPU= 22.770
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001908
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001908
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001908
  15:06:28 STEP 1909 H= 477:15 +CPU= 17.972
  15:06:47 STEP 1910 H= 477:30 +CPU= 18.848
  15:07:07 STEP 1911 H= 477:45 +CPU= 19.527
  15:07:28 STEP 1912 H= 478:00 +CPU= 21.061
  15:07:49 STEP 1913 H= 478:15 +CPU= 20.754
  15:08:10 STEP 1914 H= 478:30 +CPU= 20.571
  15:08:32 STEP 1915 H= 478:45 +CPU= 20.977
  15:08:55 STEP 1916 H= 479:00 +CPU= 23.046
  15:09:16 STEP 1917 H= 479:15 +CPU= 21.062
  15:09:38 STEP 1918 H= 479:30 +CPU= 21.488
  15:09:58 STEP 1919 H= 479:45 +CPU= 19.612
  15:10:25 STEP 1920 H= 480:00 +CPU= 26.547
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.7130596447E-21      I       0.2917072596E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1757778500E-01      I
I  Relat. Hum. I      0.2752303798E+00      I       0.3459317880E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3442546597E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    412301572 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS******** Mbytes/s, TOTAL TIME=    0.0069( 5.8%)
 15:10:25 STEP 1920 H= 480:00 +CPU= 26.547
 END CNT3
 NSTEP =  1920 CNT0   000000000  19.051  19.051  19.382   0.983               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        40040/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    703    0       46      1044068    40040 ************   112.6    11.3   101.3    11.6   174.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.96      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1457    3576.3    3576.3     18.58      0.00
   9 SPCM     - SPECTRAL COMP.                    1344     805.2     805.2      3.86      0.00
  10 SCAN2M - PHYSICS                             1345    9229.9    9229.9     44.27      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                112    1640.9    1640.9      0.66      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 57      58.9      58.9      0.01      0.00
  17 GRIDFPOS IN CNT4                              112      65.8      65.8      0.03      0.00
  27 RESTART FILES - WRITING                        28    6304.9    6304.9      0.63      0.00
  28 RESTART FILES - READING                         1   11978.9   11978.9      0.04      0.00
  29 SU4FPOS IN CNT4                               112       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               112    4378.4    4378.4      1.75      0.00
  31 POSDDH IN STEPO                                 6    1316.1    1316.1      0.03      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1345    4327.2    4327.2     20.75      0.00
  39 SU0YOMB                                         1     221.6     221.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1345      22.5      22.5      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1344     335.3     335.3      1.61      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1344      57.5      57.5      0.28      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 57       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2916     241.8     241.8      2.51      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2800     148.6     148.6      1.48      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2800      62.2      62.2      0.62      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2916      87.2      87.2      0.91      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      20.6      20.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2916      63.7      63.7      0.66      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2800      37.9      37.9      0.38      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2916      77.2      77.2      0.80      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2800      40.6      40.6      0.41      0.00
 400 GSTATS                                     156488       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                145548       0.0       0.0      0.01      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    28043.6 CPU TIME   27343.9 VECTOR TIME    27343.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       61.6
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMGGh7zg+001920
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMSHh7zg+001920
Moving to projects directory: /var/lib/multiboinc/boinc501/slots/1/ICMUAh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc501/slots/1/NODE.001_01
Adding to the zip: /var/lib/multiboinc/boinc501/slots/1/ifs.stat
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001872
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001860
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001896
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001860
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001908
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001920
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001884
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001836
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001908
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001860
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001872
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001836
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001884
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMSHh7zg+001848
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001896
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001848
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001884
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001848
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001872
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001824
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001836
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMUAh7zg+001908
Adding to the zip: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_12290228/ICMGGh7zg+001896
Zipping up the final file: /var/lib/multiboinc/boinc501/projects/climateprediction.net/oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0_r728641614_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
15:13:52 (5037): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Jun 2024 22:30:17 1548832 22443819 oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0 1,727,100 41,186 0.0238
13 Jun 2024 20:28:56 1548832 22443819 oifs_43r3_bl_a1gt_2016092300_20_1018_12290228_0 1,382,400 33,715 0.0244


©2024 climateprediction.net