climateprediction.net home page
Task 22309109

Task 22309109

Name oifs_43r3_bl_a1ni_2016092300_15_991_12208929_0
Workunit 12208929
Created 13 Feb 2023, 15:57:24 UTC
Sent 14 Feb 2023, 1:00:54 UTC
Report deadline 15 Apr 2023, 1:00:54 UTC
Received 14 Feb 2023, 8:05:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1535276
Run time 3 hours 40 min 24 sec
CPU time 3 hours 39 min 10 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5.05 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,580.11 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,991.71 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
tory: /var/lib/boinc/slots/3/ICMSHh7zg+000456
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000456
  06:46:08 STEP  457 H= 114:15 +CPU= 13.672
  06:46:22 STEP  458 H= 114:30 +CPU= 13.754
  06:46:35 STEP  459 H= 114:45 +CPU= 13.607
  06:46:50 STEP  460 H= 115:00 +CPU= 14.346
  06:47:03 STEP  461 H= 115:15 +CPU= 13.631
  06:47:17 STEP  462 H= 115:30 +CPU= 13.825
  06:47:31 STEP  463 H= 115:45 +CPU= 13.689
  06:47:45 STEP  464 H= 116:00 +CPU= 14.303
  06:47:59 STEP  465 H= 116:15 +CPU= 13.864
  06:48:13 STEP  466 H= 116:30 +CPU= 13.754
  06:48:27 STEP  467 H= 116:45 +CPU= 13.817
  06:48:45 STEP  468 H= 117:00 +CPU= 18.131
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000468
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000468
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000468
  06:48:59 STEP  469 H= 117:15 +CPU= 13.919
  06:49:13 STEP  470 H= 117:30 +CPU= 13.746
  06:49:26 STEP  471 H= 117:45 +CPU= 13.892
  06:49:41 STEP  472 H= 118:00 +CPU= 14.453
  06:49:55 STEP  473 H= 118:15 +CPU= 13.804
  06:50:09 STEP  474 H= 118:30 +CPU= 13.888
  06:50:22 STEP  475 H= 118:45 +CPU= 13.528
  06:50:37 STEP  476 H= 119:00 +CPU= 14.868
  06:50:52 STEP  477 H= 119:15 +CPU= 14.817
  06:51:06 STEP  478 H= 119:30 +CPU= 14.563
  06:51:21 STEP  479 H= 119:45 +CPU= 14.804
  06:51:42 STEP  480 H= 120:00 +CPU= 20.767
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000480
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000480
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000468
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000468
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000468
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1ni_2016092300_15_991_12208929_0_r417020657_4.zip
Uploading the intermediate file: upload_file_4.zip
  06:51:57 STEP  481 H= 120:15 +CPU= 14.986
  06:52:12 STEP  482 H= 120:30 +CPU= 15.091
  06:52:27 STEP  483 H= 120:45 +CPU= 14.887
  06:52:42 STEP  484 H= 121:00 +CPU= 15.345
  06:52:57 STEP  485 H= 121:15 +CPU= 14.776
  06:53:12 STEP  486 H= 121:30 +CPU= 14.803
  06:53:27 STEP  487 H= 121:45 +CPU= 14.878
  06:53:42 STEP  488 H= 122:00 +CPU= 15.354
  06:53:57 STEP  489 H= 122:15 +CPU= 14.754
  06:54:12 STEP  490 H= 122:30 +CPU= 14.706
  06:54:26 STEP  491 H= 122:45 +CPU= 13.942
  06:54:44 STEP  492 H= 123:00 +CPU= 18.013
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000492
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000492
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000492
  06:54:57 STEP  493 H= 123:15 +CPU= 13.707
  06:55:11 STEP  494 H= 123:30 +CPU= 13.538
  06:55:24 STEP  495 H= 123:45 +CPU= 13.512
  06:55:39 STEP  496 H= 124:00 +CPU= 14.209
  06:55:52 STEP  497 H= 124:15 +CPU= 13.745
  06:56:06 STEP  498 H= 124:30 +CPU= 13.585
  06:56:20 STEP  499 H= 124:45 +CPU= 13.660
  06:56:34 STEP  500 H= 125:00 +CPU= 14.638
  06:56:49 STEP  501 H= 125:15 +CPU= 14.372
  06:57:02 STEP  502 H= 125:30 +CPU= 13.535
  06:57:16 STEP  503 H= 125:45 +CPU= 13.753
  06:57:34 STEP  504 H= 126:00 +CPU= 18.240
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000504
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000504
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000504
  06:57:48 STEP  505 H= 126:15 +CPU= 13.830
  06:58:03 STEP  506 H= 126:30 +CPU= 14.871
  06:58:18 STEP  507 H= 126:45 +CPU= 15.165
  06:58:34 STEP  508 H= 127:00 +CPU= 15.434
  06:58:49 STEP  509 H= 127:15 +CPU= 15.189
  06:59:04 STEP  510 H= 127:30 +CPU= 15.026
  06:59:18 STEP  511 H= 127:45 +CPU= 13.932
  06:59:32 STEP  512 H= 128:00 +CPU= 14.492
  06:59:46 STEP  513 H= 128:15 +CPU= 14.007
  07:00:00 STEP  514 H= 128:30 +CPU= 14.000
  07:00:14 STEP  515 H= 128:45 +CPU= 13.807
  07:00:33 STEP  516 H= 129:00 +CPU= 18.522
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000516
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000516
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000516
  07:00:47 STEP  517 H= 129:15 +CPU= 13.938
  07:01:00 STEP  518 H= 129:30 +CPU= 13.661
  07:01:14 STEP  519 H= 129:45 +CPU= 13.814
  07:01:29 STEP  520 H= 130:00 +CPU= 14.552
  07:01:43 STEP  521 H= 130:15 +CPU= 13.900
  07:01:57 STEP  522 H= 130:30 +CPU= 13.987
  07:02:10 STEP  523 H= 130:45 +CPU= 13.728
  07:02:25 STEP  524 H= 131:00 +CPU= 14.501
  07:02:39 STEP  525 H= 131:15 +CPU= 13.992
  07:02:53 STEP  526 H= 131:30 +CPU= 13.895
  07:03:07 STEP  527 H= 131:45 +CPU= 13.776
  07:03:26 STEP  528 H= 132:00 +CPU= 19.667
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000528
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000528
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000528
  07:03:40 STEP  529 H= 132:15 +CPU= 13.918
  07:03:54 STEP  530 H= 132:30 +CPU= 13.865
  07:04:08 STEP  531 H= 132:45 +CPU= 13.807
  07:04:22 STEP  532 H= 133:00 +CPU= 14.338
  07:04:36 STEP  533 H= 133:15 +CPU= 13.976
  07:04:50 STEP  534 H= 133:30 +CPU= 13.789
  07:05:04 STEP  535 H= 133:45 +CPU= 13.994
  07:05:18 STEP  536 H= 134:00 +CPU= 14.491
  07:05:32 STEP  537 H= 134:15 +CPU= 13.784
  07:05:46 STEP  538 H= 134:30 +CPU= 13.798
  07:06:00 STEP  539 H= 134:45 +CPU= 13.970
  07:06:18 STEP  540 H= 135:00 +CPU= 18.376
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000540
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000540
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000540
  07:06:32 STEP  541 H= 135:15 +CPU= 13.926
  07:06:46 STEP  542 H= 135:30 +CPU= 13.716
  07:07:00 STEP  543 H= 135:45 +CPU= 13.774
  07:07:14 STEP  544 H= 136:00 +CPU= 14.532
  07:07:28 STEP  545 H= 136:15 +CPU= 13.799
  07:07:42 STEP  546 H= 136:30 +CPU= 13.787
  07:07:56 STEP  547 H= 136:45 +CPU= 14.110
  07:08:11 STEP  548 H= 137:00 +CPU= 14.360
  07:08:24 STEP  549 H= 137:15 +CPU= 13.868
  07:08:38 STEP  550 H= 137:30 +CPU= 13.806
  07:08:52 STEP  551 H= 137:45 +CPU= 13.832
  07:09:11 STEP  552 H= 138:00 +CPU= 18.567
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000552
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000552
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000552
  07:09:25 STEP  553 H= 138:15 +CPU= 13.897
  07:09:38 STEP  554 H= 138:30 +CPU= 13.915
  07:09:54 STEP  555 H= 138:45 +CPU= 15.070
  07:10:09 STEP  556 H= 139:00 +CPU= 15.657
  07:10:24 STEP  557 H= 139:15 +CPU= 14.928
  07:10:39 STEP  558 H= 139:30 +CPU= 15.155
  07:10:54 STEP  559 H= 139:45 +CPU= 14.451
  07:11:08 STEP  560 H= 140:00 +CPU= 14.516
  07:11:22 STEP  561 H= 140:15 +CPU= 13.906
  07:11:36 STEP  562 H= 140:30 +CPU= 14.147
  07:11:50 STEP  563 H= 140:45 +CPU= 13.924
  07:12:09 STEP  564 H= 141:00 +CPU= 18.310
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000564
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000564
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000564
  07:12:23 STEP  565 H= 141:15 +CPU= 13.926
  07:12:36 STEP  566 H= 141:30 +CPU= 13.884
  07:12:50 STEP  567 H= 141:45 +CPU= 14.010
  07:13:06 STEP  568 H= 142:00 +CPU= 15.041
  07:13:21 STEP  569 H= 142:15 +CPU= 15.003
  07:13:36 STEP  570 H= 142:30 +CPU= 14.983
  07:13:50 STEP  571 H= 142:45 +CPU= 14.356
  07:14:05 STEP  572 H= 143:00 +CPU= 14.606
  07:14:19 STEP  573 H= 143:15 +CPU= 14.068
  07:14:33 STEP  574 H= 143:30 +CPU= 13.921
  07:14:47 STEP  575 H= 143:45 +CPU= 14.130
  07:15:07 STEP  576 H= 144:00 +CPU= 20.562
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000576
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000576
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000492
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000492
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000492
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000504
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000504
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000504
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000516
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000516
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000516
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000528
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000528
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000528
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000540
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000540
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000540
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000552
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000552
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000552
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000564
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000564
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000564
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1ni_2016092300_15_991_12208929_0_r417020657_5.zip
Uploading the intermediate file: upload_file_5.zip
  07:15:22 STEP  577 H= 144:15 +CPU= 14.992
  07:15:37 STEP  578 H= 144:30 +CPU= 15.052
  07:15:53 STEP  579 H= 144:45 +CPU= 15.524
  07:16:08 STEP  580 H= 145:00 +CPU= 15.462
  07:16:23 STEP  581 H= 145:15 +CPU= 15.112
  07:16:39 STEP  582 H= 145:30 +CPU= 15.056
  07:16:54 STEP  583 H= 145:45 +CPU= 15.180
  07:17:09 STEP  584 H= 146:00 +CPU= 15.407
  07:17:24 STEP  585 H= 146:15 +CPU= 14.977
  07:17:39 STEP  586 H= 146:30 +CPU= 15.141
  07:17:54 STEP  587 H= 146:45 +CPU= 14.969
  07:18:14 STEP  588 H= 147:00 +CPU= 19.739
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000588
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000588
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000588
  07:18:29 STEP  589 H= 147:15 +CPU= 15.195
  07:18:44 STEP  590 H= 147:30 +CPU= 15.117
  07:18:59 STEP  591 H= 147:45 +CPU= 14.361
  07:19:13 STEP  592 H= 148:00 +CPU= 14.715
  07:19:27 STEP  593 H= 148:15 +CPU= 14.067
  07:19:42 STEP  594 H= 148:30 +CPU= 14.007
  07:19:55 STEP  595 H= 148:45 +CPU= 13.883
  07:20:10 STEP  596 H= 149:00 +CPU= 14.410
  07:20:24 STEP  597 H= 149:15 +CPU= 14.124
  07:20:38 STEP  598 H= 149:30 +CPU= 13.973
  07:20:52 STEP  599 H= 149:45 +CPU= 13.981
  07:21:11 STEP  600 H= 150:00 +CPU= 19.347
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000600
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000600
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000600
  07:21:27 STEP  601 H= 150:15 +CPU= 15.578
  07:21:42 STEP  602 H= 150:30 +CPU= 15.220
  07:21:57 STEP  603 H= 150:45 +CPU= 15.065
  07:22:12 STEP  604 H= 151:00 +CPU= 15.178
  07:22:28 STEP  605 H= 151:15 +CPU= 15.666
  07:22:42 STEP  606 H= 151:30 +CPU= 14.119
  07:22:56 STEP  607 H= 151:45 +CPU= 14.053
  07:23:11 STEP  608 H= 152:00 +CPU= 14.486
  07:23:25 STEP  609 H= 152:15 +CPU= 14.350
  07:23:40 STEP  610 H= 152:30 +CPU= 14.627
  07:23:55 STEP  611 H= 152:45 +CPU= 15.288
  07:24:15 STEP  612 H= 153:00 +CPU= 19.730
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000612
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000612
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000612
  07:24:30 STEP  613 H= 153:15 +CPU= 15.265
  07:24:45 STEP  614 H= 153:30 +CPU= 15.049
  07:24:59 STEP  615 H= 153:45 +CPU= 14.145
  07:25:14 STEP  616 H= 154:00 +CPU= 14.644
  07:25:28 STEP  617 H= 154:15 +CPU= 14.008
  07:25:42 STEP  618 H= 154:30 +CPU= 14.100
  07:25:57 STEP  619 H= 154:45 +CPU= 15.023
  07:26:13 STEP  620 H= 155:00 +CPU= 15.663
  07:26:28 STEP  621 H= 155:15 +CPU= 15.136
  07:26:43 STEP  622 H= 155:30 +CPU= 15.227
  07:26:58 STEP  623 H= 155:45 +CPU= 15.150
  07:27:19 STEP  624 H= 156:00 +CPU= 21.176
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000624
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000624
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000624
  07:27:34 STEP  625 H= 156:15 +CPU= 14.059
  07:27:48 STEP  626 H= 156:30 +CPU= 14.174
  07:28:02 STEP  627 H= 156:45 +CPU= 14.179
  07:28:16 STEP  628 H= 157:00 +CPU= 14.541
  07:28:31 STEP  629 H= 157:15 +CPU= 14.148
  07:28:45 STEP  630 H= 157:30 +CPU= 14.143
  07:28:59 STEP  631 H= 157:45 +CPU= 14.237
  07:29:14 STEP  632 H= 158:00 +CPU= 14.753
  07:29:28 STEP  633 H= 158:15 +CPU= 14.180
  07:29:42 STEP  634 H= 158:30 +CPU= 14.125
  07:29:56 STEP  635 H= 158:45 +CPU= 13.975
  07:30:16 STEP  636 H= 159:00 +CPU= 19.543
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000636
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000636
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000636
  07:30:31 STEP  637 H= 159:15 +CPU= 15.220
  07:30:46 STEP  638 H= 159:30 +CPU= 15.322
  07:31:01 STEP  639 H= 159:45 +CPU= 15.249
  07:31:17 STEP  640 H= 160:00 +CPU= 15.687
  07:31:32 STEP  641 H= 160:15 +CPU= 15.029
  07:31:47 STEP  642 H= 160:30 +CPU= 15.226
  07:32:03 STEP  643 H= 160:45 +CPU= 15.197
  07:32:18 STEP  644 H= 161:00 +CPU= 15.773
  07:32:34 STEP  645 H= 161:15 +CPU= 15.239
  07:32:49 STEP  646 H= 161:30 +CPU= 15.185
  07:33:04 STEP  647 H= 161:45 +CPU= 15.091
  07:33:24 STEP  648 H= 162:00 +CPU= 19.741
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000648
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000648
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000648
  07:33:39 STEP  649 H= 162:15 +CPU= 15.176
  07:33:54 STEP  650 H= 162:30 +CPU= 15.115
  07:34:09 STEP  651 H= 162:45 +CPU= 15.311
  07:34:25 STEP  652 H= 163:00 +CPU= 15.775
  07:34:40 STEP  653 H= 163:15 +CPU= 15.173
  07:34:55 STEP  654 H= 163:30 +CPU= 14.820
  07:35:10 STEP  655 H= 163:45 +CPU= 15.052
  07:35:26 STEP  656 H= 164:00 +CPU= 15.723
  07:35:41 STEP  657 H= 164:15 +CPU= 15.074
  07:35:56 STEP  658 H= 164:30 +CPU= 15.092
  07:36:11 STEP  659 H= 164:45 +CPU= 15.288
  07:36:31 STEP  660 H= 165:00 +CPU= 19.704
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000660
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000660
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000660
  07:36:46 STEP  661 H= 165:15 +CPU= 15.256
  07:37:02 STEP  662 H= 165:30 +CPU= 15.262
  07:37:17 STEP  663 H= 165:45 +CPU= 15.188
  07:37:33 STEP  664 H= 166:00 +CPU= 15.732
  07:37:47 STEP  665 H= 166:15 +CPU= 14.155
  07:38:01 STEP  666 H= 166:30 +CPU= 14.151
  07:38:15 STEP  667 H= 166:45 +CPU= 14.443
  07:38:31 STEP  668 H= 167:00 +CPU= 15.589
  07:38:46 STEP  669 H= 167:15 +CPU= 15.168
  07:39:01 STEP  670 H= 167:30 +CPU= 15.145
  07:39:17 STEP  671 H= 167:45 +CPU= 15.157
  07:39:38 STEP  672 H= 168:00 +CPU= 21.154
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000672
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000672
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000588
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000588
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000588
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000600
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000600
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000600
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000612
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000612
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000612
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000624
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000624
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000624
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000636
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000636
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000636
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000648
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000648
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000648
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000660
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000660
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000660
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1ni_2016092300_15_991_12208929_0_r417020657_6.zip
Uploading the intermediate file: upload_file_6.zip
  07:39:53 STEP  673 H= 168:15 +CPU= 15.410
  07:40:08 STEP  674 H= 168:30 +CPU= 15.176
  07:40:24 STEP  675 H= 168:45 +CPU= 15.298
  07:40:40 STEP  676 H= 169:00 +CPU= 15.845
  07:40:54 STEP  677 H= 169:15 +CPU= 14.205
  07:41:08 STEP  678 H= 169:30 +CPU= 14.336
  07:41:22 STEP  679 H= 169:45 +CPU= 14.252
  07:41:37 STEP  680 H= 170:00 +CPU= 14.841
  07:41:52 STEP  681 H= 170:15 +CPU= 14.326
  07:42:06 STEP  682 H= 170:30 +CPU= 14.154
  07:42:20 STEP  683 H= 170:45 +CPU= 14.355
  07:42:39 STEP  684 H= 171:00 +CPU= 18.904
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000684
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000684
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000684
  07:42:53 STEP  685 H= 171:15 +CPU= 14.304
  07:43:08 STEP  686 H= 171:30 +CPU= 14.357
  07:43:22 STEP  687 H= 171:45 +CPU= 14.355
  07:43:37 STEP  688 H= 172:00 +CPU= 14.748
  07:43:51 STEP  689 H= 172:15 +CPU= 14.223
  07:44:05 STEP  690 H= 172:30 +CPU= 14.046
  07:44:19 STEP  691 H= 172:45 +CPU= 14.299
  07:44:34 STEP  692 H= 173:00 +CPU= 14.769
  07:44:48 STEP  693 H= 173:15 +CPU= 14.269
  07:45:03 STEP  694 H= 173:30 +CPU= 14.414
  07:45:17 STEP  695 H= 173:45 +CPU= 14.198
  07:45:36 STEP  696 H= 174:00 +CPU= 18.752
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000696
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000696
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000696
  07:45:50 STEP  697 H= 174:15 +CPU= 14.217
  07:46:04 STEP  698 H= 174:30 +CPU= 14.254
  07:46:18 STEP  699 H= 174:45 +CPU= 14.184
  07:46:33 STEP  700 H= 175:00 +CPU= 14.749
  07:46:47 STEP  701 H= 175:15 +CPU= 14.202
  07:47:02 STEP  702 H= 175:30 +CPU= 14.267
  07:47:16 STEP  703 H= 175:45 +CPU= 14.255
  07:47:31 STEP  704 H= 176:00 +CPU= 14.831
  07:47:45 STEP  705 H= 176:15 +CPU= 14.332
  07:48:00 STEP  706 H= 176:30 +CPU= 14.905
  07:48:15 STEP  707 H= 176:45 +CPU= 15.325
  07:48:34 STEP  708 H= 177:00 +CPU= 18.733
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000708
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000708
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000708
  07:48:48 STEP  709 H= 177:15 +CPU= 14.237
  07:49:03 STEP  710 H= 177:30 +CPU= 14.113
  07:49:17 STEP  711 H= 177:45 +CPU= 14.107
  07:49:31 STEP  712 H= 178:00 +CPU= 14.764
  07:49:46 STEP  713 H= 178:15 +CPU= 14.185
  07:50:00 STEP  714 H= 178:30 +CPU= 14.284
  07:50:14 STEP  715 H= 178:45 +CPU= 14.321
  07:50:29 STEP  716 H= 179:00 +CPU= 14.650
  07:50:43 STEP  717 H= 179:15 +CPU= 14.372
  07:50:58 STEP  718 H= 179:30 +CPU= 14.229
  07:51:12 STEP  719 H= 179:45 +CPU= 14.337
  07:51:32 STEP  720 H= 180:00 +CPU= 20.120
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000720
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000720
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000720
  07:51:46 STEP  721 H= 180:15 +CPU= 14.104
  07:52:00 STEP  722 H= 180:30 +CPU= 14.362
  07:52:15 STEP  723 H= 180:45 +CPU= 14.358
  07:52:30 STEP  724 H= 181:00 +CPU= 14.727
  07:52:44 STEP  725 H= 181:15 +CPU= 14.441
  07:52:58 STEP  726 H= 181:30 +CPU= 14.222
  07:53:13 STEP  727 H= 181:45 +CPU= 14.356
  07:53:28 STEP  728 H= 182:00 +CPU= 14.900
  07:53:42 STEP  729 H= 182:15 +CPU= 14.339
  07:53:56 STEP  730 H= 182:30 +CPU= 14.134
  07:54:10 STEP  731 H= 182:45 +CPU= 14.318
  07:54:29 STEP  732 H= 183:00 +CPU= 18.666
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000732
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000732
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000732
  07:54:44 STEP  733 H= 183:15 +CPU= 15.314
  07:54:59 STEP  734 H= 183:30 +CPU= 14.331
  07:55:13 STEP  735 H= 183:45 +CPU= 14.338
  07:55:28 STEP  736 H= 184:00 +CPU= 14.693
  07:55:42 STEP  737 H= 184:15 +CPU= 14.315
  07:55:56 STEP  738 H= 184:30 +CPU= 14.170
  07:56:11 STEP  739 H= 184:45 +CPU= 14.230
  07:56:25 STEP  740 H= 185:00 +CPU= 14.709
  07:56:40 STEP  741 H= 185:15 +CPU= 14.347
  07:56:55 STEP  742 H= 185:30 +CPU= 15.276
  07:57:10 STEP  743 H= 185:45 +CPU= 15.321
  07:57:30 STEP  744 H= 186:00 +CPU= 19.998
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000744
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000744
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000744
  07:57:45 STEP  745 H= 186:15 +CPU= 15.247
  07:58:00 STEP  746 H= 186:30 +CPU= 14.161
  07:58:14 STEP  747 H= 186:45 +CPU= 14.570
  07:58:29 STEP  748 H= 187:00 +CPU= 14.733
  07:58:43 STEP  749 H= 187:15 +CPU= 14.493
  07:58:58 STEP  750 H= 187:30 +CPU= 14.319
  07:59:12 STEP  751 H= 187:45 +CPU= 14.304
  07:59:27 STEP  752 H= 188:00 +CPU= 14.815
  07:59:41 STEP  753 H= 188:15 +CPU= 14.260
  07:59:56 STEP  754 H= 188:30 +CPU= 14.331
  08:00:10 STEP  755 H= 188:45 +CPU= 14.257
  08:00:29 STEP  756 H= 189:00 +CPU= 18.785
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000756
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000756
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000756
  08:00:43 STEP  757 H= 189:15 +CPU= 14.458
  08:00:57 STEP  758 H= 189:30 +CPU= 14.087
  08:01:12 STEP  759 H= 189:45 +CPU= 14.495
  08:01:26 STEP  760 H= 190:00 +CPU= 14.823
  08:01:41 STEP  761 H= 190:15 +CPU= 14.251
  08:01:55 STEP  762 H= 190:30 +CPU= 14.303
  08:02:09 STEP  763 H= 190:45 +CPU= 14.399
  08:02:24 STEP  764 H= 191:00 +CPU= 14.966
  08:02:39 STEP  765 H= 191:15 +CPU= 14.429
  08:02:53 STEP  766 H= 191:30 +CPU= 14.366
  08:03:08 STEP  767 H= 191:45 +CPU= 14.312
  08:03:28 STEP  768 H= 192:00 +CPU= 20.139
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000768
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000768
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000684
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000684
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000684
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000696
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000696
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000696
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000708
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000708
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000708
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000720
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000720
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000720
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000732
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000732
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000732
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000744
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000744
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000744
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000756
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000756
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000756
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1ni_2016092300_15_991_12208929_0_r417020657_7.zip
Uploading the intermediate file: upload_file_7.zip
  08:03:42 STEP  769 H= 192:15 +CPU= 14.573
  08:03:57 STEP  770 H= 192:30 +CPU= 14.351
  08:04:11 STEP  771 H= 192:45 +CPU= 14.466
  08:04:26 STEP  772 H= 193:00 +CPU= 14.807
  08:04:40 STEP  773 H= 193:15 +CPU= 14.229
  08:04:55 STEP  774 H= 193:30 +CPU= 14.469
  08:05:09 STEP  775 H= 193:45 +CPU= 14.418
  08:05:24 STEP  776 H= 194:00 +CPU= 14.836
  08:05:39 STEP  777 H= 194:15 +CPU= 14.627
  08:05:53 STEP  778 H= 194:30 +CPU= 14.433
  08:06:07 STEP  779 H= 194:45 +CPU= 14.342
  08:06:26 STEP  780 H= 195:00 +CPU= 18.811
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000780
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000780
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000780
  08:06:41 STEP  781 H= 195:15 +CPU= 14.343
  08:06:55 STEP  782 H= 195:30 +CPU= 14.339
  08:07:09 STEP  783 H= 195:45 +CPU= 14.475
  08:07:24 STEP  784 H= 196:00 +CPU= 14.881
  08:07:39 STEP  785 H= 196:15 +CPU= 14.389
  08:07:53 STEP  786 H= 196:30 +CPU= 14.468
  08:08:07 STEP  787 H= 196:45 +CPU= 14.215
  08:08:22 STEP  788 H= 197:00 +CPU= 14.879
  08:08:37 STEP  789 H= 197:15 +CPU= 14.530
  08:08:51 STEP  790 H= 197:30 +CPU= 14.390
  08:09:07 STEP  791 H= 197:45 +CPU= 15.345
  08:09:27 STEP  792 H= 198:00 +CPU= 20.022
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000792
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000792
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000792
  08:09:42 STEP  793 H= 198:15 +CPU= 15.704
  08:09:58 STEP  794 H= 198:30 +CPU= 15.673
  08:10:13 STEP  795 H= 198:45 +CPU= 15.444
  08:10:29 STEP  796 H= 199:00 +CPU= 15.839
  08:10:45 STEP  797 H= 199:15 +CPU= 15.489
  08:11:00 STEP  798 H= 199:30 +CPU= 15.525
  08:11:16 STEP  799 H= 199:45 +CPU= 15.377
  08:11:32 STEP  800 H= 200:00 +CPU= 16.181
  08:11:47 STEP  801 H= 200:15 +CPU= 15.263
  08:12:03 STEP  802 H= 200:30 +CPU= 15.348
  08:12:18 STEP  803 H= 200:45 +CPU= 15.408
  08:12:38 STEP  804 H= 201:00 +CPU= 20.080
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000804
  08:12:54 STEP  805 H= 201:15 +CPU= 15.695
  08:13:09 STEP  806 H= 201:30 +CPU= 15.563
  08:13:25 STEP  807 H= 201:45 +CPU= 15.289
  08:13:41 STEP  808 H= 202:00 +CPU= 15.929
  08:13:56 STEP  809 H= 202:15 +CPU= 15.526
  08:14:12 STEP  810 H= 202:30 +CPU= 15.608
  08:14:27 STEP  811 H= 202:45 +CPU= 15.508
  08:14:43 STEP  812 H= 203:00 +CPU= 15.924
  08:14:59 STEP  813 H= 203:15 +CPU= 15.448
  08:15:14 STEP  814 H= 203:30 +CPU= 15.574
  08:15:30 STEP  815 H= 203:45 +CPU= 15.232
  08:15:50 STEP  816 H= 204:00 +CPU= 20.410
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000816
  08:16:04 STEP  817 H= 204:15 +CPU= 14.306
  08:16:19 STEP  818 H= 204:30 +CPU= 14.703
  08:16:34 STEP  819 H= 204:45 +CPU= 14.619
  08:16:49 STEP  820 H= 205:00 +CPU= 14.941
  08:17:03 STEP  821 H= 205:15 +CPU= 14.533
  08:17:18 STEP  822 H= 205:30 +CPU= 14.550
  08:17:32 STEP  823 H= 205:45 +CPU= 14.214
  08:17:47 STEP  824 H= 206:00 +CPU= 15.247
  08:18:02 STEP  825 H= 206:15 +CPU= 14.512
  08:18:16 STEP  826 H= 206:30 +CPU= 14.461
  08:18:31 STEP  827 H= 206:45 +CPU= 15.211
  08:18:51 STEP  828 H= 207:00 +CPU= 20.139
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000828
  08:19:07 STEP  829 H= 207:15 +CPU= 15.746
  08:19:23 STEP  830 H= 207:30 +CPU= 15.538
  08:19:38 STEP  831 H= 207:45 +CPU= 15.644
  08:19:55 STEP  832 H= 208:00 +CPU= 16.146
  08:20:10 STEP  833 H= 208:15 +CPU= 15.575
  08:20:26 STEP  834 H= 208:30 +CPU= 15.727
  08:20:41 STEP  835 H= 208:45 +CPU= 15.532
  08:20:57 STEP  836 H= 209:00 +CPU= 15.902
  08:21:13 STEP  837 H= 209:15 +CPU= 15.272
  08:21:28 STEP  838 H= 209:30 +CPU= 15.631
  08:21:44 STEP  839 H= 209:45 +CPU= 15.639
  08:22:05 STEP  840 H= 210:00 +CPU= 20.601
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000840
  08:22:19 STEP  841 H= 210:15 +CPU= 14.523
  08:22:34 STEP  842 H= 210:30 +CPU= 14.551
  08:22:48 STEP  843 H= 210:45 +CPU= 14.499
  08:23:03 STEP  844 H= 211:00 +CPU= 15.004
  08:23:18 STEP  845 H= 211:15 +CPU= 14.990
  08:23:34 STEP  846 H= 211:30 +CPU= 15.543
  08:23:49 STEP  847 H= 211:45 +CPU= 15.064
  08:24:04 STEP  848 H= 212:00 +CPU= 14.805
  08:24:18 STEP  849 H= 212:15 +CPU= 14.571
  08:24:33 STEP  850 H= 212:30 +CPU= 14.405
  08:24:47 STEP  851 H= 212:45 +CPU= 14.541
  08:25:06 STEP  852 H= 213:00 +CPU= 19.198
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000852
  08:25:21 STEP  853 H= 213:15 +CPU= 14.595
  08:25:35 STEP  854 H= 213:30 +CPU= 14.295
  08:25:50 STEP  855 H= 213:45 +CPU= 14.327
  08:26:04 STEP  856 H= 214:00 +CPU= 14.789
  08:26:19 STEP  857 H= 214:15 +CPU= 14.359
  08:26:33 STEP  858 H= 214:30 +CPU= 14.380
  08:26:49 STEP  859 H= 214:45 +CPU= 15.453
  08:27:03 STEP  860 H= 215:00 +CPU= 14.753
  08:27:18 STEP  861 H= 215:15 +CPU= 14.394
  08:27:32 STEP  862 H= 215:30 +CPU= 14.293
  08:27:46 STEP  863 H= 215:45 +CPU= 14.347
  08:28:07 STEP  864 H= 216:00 +CPU= 20.082
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208929/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1ni_2016092300_15_991_12208929_0_r417020657_8.zip
Uploading the intermediate file: upload_file_8.zip
  08:28:21 STEP  865 H= 216:15 +CPU= 14.200
  08:28:35 STEP  866 H= 216:30 +CPU= 14.397
  08:28:49 STEP  867 H= 216:45 +CPU= 14.171
  08:29:04 STEP  868 H= 217:00 +CPU= 14.857
  08:29:19 STEP  869 H= 217:15 +CPU= 14.692
  08:29:33 STEP  870 H= 217:30 +CPU= 14.353
  08:29:48 STEP  871 H= 217:45 +CPU= 14.237
  08:30:02 STEP  872 H= 218:00 +CPU= 14.907
  08:30:17 STEP  873 H= 218:15 +CPU= 14.475
  08:30:31 STEP  874 H= 218:30 +CPU= 14.472
  08:30:46 STEP  875 H= 218:45 +CPU= 14.317
  08:31:05 STEP  876 H= 219:00 +CPU= 18.856
Moving to projects directory: /var/lib/boinc/slots/3/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/3/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/3/ICMUAh7zg+000876
  08:31:20 STEP  877 H= 219:15 +CPU= 14.991
  MAX V WIND=   250.467604117224     
  08:31:35 STEP  878 H= 219:30 +CPU= 15.549
  MAX U WIND=   250.546546670240     
  MAX V WIND=   256.458092270993     
  MAX V WIND=   255.191671007115     
  08:31:51 STEP  879 H= 219:45 +CPU= 15.683
  MAX U WIND=   258.548167870755     
  MAX V WIND=   256.379253910828     
  MAX V WIND=   256.291274052330     
  08:32:07 STEP  880 H= 220:00 +CPU= 16.024
  MAX U WIND=   256.682406915411     
  MAX V WIND=   255.090678194767     
  MAX V WIND=   253.825893407296     
  08:32:22 STEP  881 H= 220:15 +CPU= 15.451
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 3940MB (heap), 5598MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 3940 MB (maxheap), 5598 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :            CPG_DRV 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :             >OMP-CPG                  (1025) 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :              CPG 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :               CPG_DIA 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083224:1676359944:13159.238] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                GPRH 
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffdba06b810
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 22) with addr2line-cmd
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc/slots/3/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x144b066 0x143e1ec 0x1435fbf 0x1433058 0xe5f4b8 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x144b066] : gprh_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x143e1ec] : cpg_dia_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x1435fbf] : cpg_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1433058] : cpg_drv_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xe5f4b8] : gp_model_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x15c1e62] : gp_model_heap_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x15ac40e] : scan2m_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x6620b4] : stepo_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x4a0e7c] : cnt4_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x49dc29] : cnt3_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x49ce72] : cnt2_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49cd68] : cnt1_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x4078ad] : cnt0_() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x40276f] : MAIN__() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x40270d] : main() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x1d840d7] : __libc_start_main_impl() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x4025e5] : _start() at ??:?
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.241] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffdba06b720
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 23) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc/slots/3/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x144b066 0x143e1ec 0x1435fbf 0x1433058 0xe5f4b8 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x144b066] : gprh_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x143e1ec] : cpg_dia_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1435fbf] : cpg_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x1433058] : cpg_drv_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xe5f4b8] : gp_model_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x15c1e62] : gp_model_heap_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x15ac40e] : scan2m_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x6620b4] : stepo_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x4a0e7c] : cnt4_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x49dc29] : cnt3_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49ce72] : cnt2_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49cd68] : cnt1_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x4078ad] : cnt0_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x40276f] : MAIN__() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40270d] : main() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1d840d7] : __libc_start_main_impl() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x4025e5] : _start() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.338] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:k6:1:1:20905:20905] [20230214:083225:1676359945:13160.338] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC4A8F  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000144B066  gprh_                     128  gprh.F90
oifs_43r3_model.e  000000000143E1EC  cpg_dia_                  600  cpg_dia.F90
oifs_43r3_model.e  0000000001435FBF  cpg_                      718  cpg.F90
oifs_43r3_model.e  0000000001433058  cpg_drv_                  351  cpg_drv.F90
oifs_43r3_model.e  0000000000E5F4B8  gp_model_                 419  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.187351570527120E-05 0.000000000000000E+00 0.100306669395669E-01
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.164861832234513E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.180003773982833E-05 0.000000000000000E+00 0.167795769294572E-01
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.130717923672708E-04 0.000000000000000E+00 0.199264942606780E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.164431042033465E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.645837997562576E-05 0.000000000000000E+00 0.267058082810095E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.638407428319555E-05 0.000000000000000E+00 0.678486787946009E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.203055468433769E-05 0.000000000000000E+00 0.185547661180435E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.749540804221287E-06 0.000000000000000E+00 0.107079458061258E-01
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.105504916160549E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   876 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   876 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000876 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000876
 MPI-TASK:   1 -    311438730 BYTES IN      6 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0062( 1.6%)
 NSTEP =   876 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000876 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000876
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0027 SECONDS262135.3 Mbytes/s, TOTAL TIME=    0.1626( 1.7%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000876 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000876
 MPI-TASK:   1 -   4983019671 BYTES IN    125 RECORDS TRANSFERRED IN    0.0017 SECONDS******** Mbytes/s, TOTAL TIME=    0.1292( 1.3%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000876 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000876
 MPI-TASK:   1 -    302865097 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0028( 3.6%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000876 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000876
 MPI-TASK:   1 -    311438730 BYTES IN      4 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0042( 4.8%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   876 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   876 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000876 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000876
 MPI-TASK:   1 -    311438721 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0075( 4.0%)
 08:31:05 STEP  876 H= 219:00 +CPU= 18.856
 NSTEP =   877 STEPO   0AAA00AAA
 08:31:20 STEP  877 H= 219:15 +CPU= 14.991
 NSTEP =   878 STEPO   0AAA00AAA
 08:31:35 STEP  878 H= 219:30 +CPU= 15.549
 NSTEP =   879 STEPO   0AAA00AAA
 08:31:51 STEP  879 H= 219:45 +CPU= 15.683
ISTEP=     880 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=     880 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =   880 STEPO   0AAA00AAA
 08:32:07 STEP  880 H= 220:00 +CPU= 16.024
 NSTEP =   881 STEPO   0AAA00AAA
 08:32:22 STEP  881 H= 220:15 +CPU= 15.451
 NSTEP =   882 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 08:30:50 0AAA00AAA STEPO      876     0.472    0.472    0.472    217:35    217:45 0.20127197236116E-04       2GB       0MB
 08:31:05 0AAA00AAA STEPO      877    15.001   15.001   15.010    217:50    218:00 0.20127197236116E-04       2GB       0MB
 08:31:20 0AAA00AAA STEPO      878    14.991   14.991   15.001    218:05    218:15 0.20127197236116E-04       2GB       0MB
 08:31:35 0AAA00AAA STEPO      879    15.550   15.550   15.560    218:21    218:30 0.20127197236116E-04       2GB       0MB
 08:31:51 0AAA00AAA STEPO      880    15.683   15.683   15.693    218:37    218:46 0.20127197236116E-04       2GB       0MB
 08:32:07 0AAA00AAA STEPO      881    16.024   16.024   16.035    218:53    219:02 0.20127197236116E-04       2GB       0MB
 08:32:22 0AAA00AAA STEPO      882    15.452   15.452   15.463    219:08    219:17 0.20127197236116E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     864",
 CTIME   = "00090000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         852, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/3/progress_file_12208929.xml

<running_values>
  <last_cpu_time>13142.690000</last_cpu_time>
  <upload_file_number>9</upload_file_number>
  <last_iter>881</last_iter>
  <last_upload>777600</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net