climateprediction.net home page
Task 22307996

Task 22307996

Name oifs_43r3_bl_a0sq_2016092300_15_991_12207821_0
Workunit 12207821
Created 13 Feb 2023, 13:55:15 UTC
Sent 14 Feb 2023, 2:49:26 UTC
Report deadline 15 Apr 2023, 2:49:26 UTC
Received 15 Feb 2023, 13:36:51 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1513725
Run time 2 hours 31 min 42 sec
CPU time 2 hours 30 min 9 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 8.33 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,073.89 MB
Peak swap size 5,930.78 MB
Peak disk usage 1,377.65 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
g+000324
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000324
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000324
  12:50:20 STEP  325 H=  81:15 +CPU= 12.125
  12:50:31 STEP  326 H=  81:30 +CPU= 11.399
  12:50:44 STEP  327 H=  81:45 +CPU= 12.485
  12:50:57 STEP  328 H=  82:00 +CPU= 12.883
  12:51:09 STEP  329 H=  82:15 +CPU= 12.407
  12:51:22 STEP  330 H=  82:30 +CPU= 12.411
  12:51:33 STEP  331 H=  82:45 +CPU= 11.488
  12:51:45 STEP  332 H=  83:00 +CPU= 12.124
  12:51:58 STEP  333 H=  83:15 +CPU= 12.817
  12:52:12 STEP  334 H=  83:30 +CPU= 13.367
  12:52:25 STEP  335 H=  83:45 +CPU= 13.660
  12:52:43 STEP  336 H=  84:00 +CPU= 17.487
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000336
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000336
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000336
  12:52:54 STEP  337 H=  84:15 +CPU= 11.375
  12:53:06 STEP  338 H=  84:30 +CPU= 11.482
  12:53:17 STEP  339 H=  84:45 +CPU= 11.495
  12:53:29 STEP  340 H=  85:00 +CPU= 11.698
  12:53:41 STEP  341 H=  85:15 +CPU= 11.948
  12:53:53 STEP  342 H=  85:30 +CPU= 11.456
  12:54:05 STEP  343 H=  85:45 +CPU= 12.719
  12:54:18 STEP  344 H=  86:00 +CPU= 12.994
  12:54:31 STEP  345 H=  86:15 +CPU= 12.713
  12:54:43 STEP  346 H=  86:30 +CPU= 12.089
  12:54:54 STEP  347 H=  86:45 +CPU= 10.807
  12:55:08 STEP  348 H=  87:00 +CPU= 14.113
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000348
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000348
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000348
  12:55:19 STEP  349 H=  87:15 +CPU= 11.143
  12:55:31 STEP  350 H=  87:30 +CPU= 11.415
  12:55:42 STEP  351 H=  87:45 +CPU= 11.007
  12:55:53 STEP  352 H=  88:00 +CPU= 11.298
  12:56:05 STEP  353 H=  88:15 +CPU= 11.483
  12:56:16 STEP  354 H=  88:30 +CPU= 11.510
  12:56:27 STEP  355 H=  88:45 +CPU= 10.977
  12:56:38 STEP  356 H=  89:00 +CPU= 10.538
  12:56:48 STEP  357 H=  89:15 +CPU= 10.319
  12:56:59 STEP  358 H=  89:30 +CPU= 10.331
  12:57:09 STEP  359 H=  89:45 +CPU= 10.464
  12:57:23 STEP  360 H=  90:00 +CPU= 13.620
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000360
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000360
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000360
  12:57:33 STEP  361 H=  90:15 +CPU= 10.704
  12:57:44 STEP  362 H=  90:30 +CPU= 10.703
  12:57:55 STEP  363 H=  90:45 +CPU= 10.204
  12:58:06 STEP  364 H=  91:00 +CPU= 11.294
  12:58:16 STEP  365 H=  91:15 +CPU= 10.162
  12:58:26 STEP  366 H=  91:30 +CPU= 10.236
  12:58:38 STEP  367 H=  91:45 +CPU= 11.697
  12:58:49 STEP  368 H=  92:00 +CPU= 10.685
  12:59:01 STEP  369 H=  92:15 +CPU= 12.352
  12:59:13 STEP  370 H=  92:30 +CPU= 11.703
  12:59:24 STEP  371 H=  92:45 +CPU= 11.373
  12:59:38 STEP  372 H=  93:00 +CPU= 13.984
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000372
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000372
  12:59:49 STEP  373 H=  93:15 +CPU= 10.278
  12:59:59 STEP  374 H=  93:30 +CPU= 10.399
  13:00:10 STEP  375 H=  93:45 +CPU= 10.507
  13:00:21 STEP  376 H=  94:00 +CPU= 11.105
  13:00:31 STEP  377 H=  94:15 +CPU= 10.424
  13:00:42 STEP  378 H=  94:30 +CPU= 10.364
  13:00:52 STEP  379 H=  94:45 +CPU= 10.625
  13:01:03 STEP  380 H=  95:00 +CPU= 10.860
  13:01:13 STEP  381 H=  95:15 +CPU= 10.286
  13:01:24 STEP  382 H=  95:30 +CPU= 10.210
  13:01:34 STEP  383 H=  95:45 +CPU= 10.631
  13:01:50 STEP  384 H=  96:00 +CPU= 15.459
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000384
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0sq_2016092300_15_991_12207821_0_r280341524_3.zip
  13:02:00 STEP  385 H=  96:15 +CPU= 10.395
Uploading the intermediate file: upload_file_3.zip
  13:02:11 STEP  386 H=  96:30 +CPU= 10.462
  13:02:21 STEP  387 H=  96:45 +CPU= 10.271
  13:02:32 STEP  388 H=  97:00 +CPU= 10.638
  13:02:42 STEP  389 H=  97:15 +CPU= 10.493
  13:02:53 STEP  390 H=  97:30 +CPU= 10.534
  13:03:03 STEP  391 H=  97:45 +CPU= 10.200
  13:03:13 STEP  392 H=  98:00 +CPU= 10.528
  13:03:24 STEP  393 H=  98:15 +CPU= 10.217
  13:03:34 STEP  394 H=  98:30 +CPU= 10.178
  13:03:44 STEP  395 H=  98:45 +CPU= 10.257
  13:03:58 STEP  396 H=  99:00 +CPU= 13.600
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000396
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000396
  13:04:08 STEP  397 H=  99:15 +CPU= 10.296
  13:04:18 STEP  398 H=  99:30 +CPU= 10.195
  13:04:29 STEP  399 H=  99:45 +CPU= 10.570
  13:04:40 STEP  400 H= 100:00 +CPU= 11.157
  13:04:51 STEP  401 H= 100:15 +CPU= 10.343
  13:05:01 STEP  402 H= 100:30 +CPU= 10.727
  13:05:14 STEP  403 H= 100:45 +CPU= 12.281
  13:05:26 STEP  404 H= 101:00 +CPU= 12.206
  13:05:38 STEP  405 H= 101:15 +CPU= 12.126
  13:05:50 STEP  406 H= 101:30 +CPU= 12.300
  13:06:02 STEP  407 H= 101:45 +CPU= 11.877
  13:06:18 STEP  408 H= 102:00 +CPU= 15.865
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000408
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000408
  13:06:30 STEP  409 H= 102:15 +CPU= 11.732
  13:06:42 STEP  410 H= 102:30 +CPU= 12.316
  13:06:55 STEP  411 H= 102:45 +CPU= 12.193
  13:07:08 STEP  412 H= 103:00 +CPU= 13.033
  13:07:19 STEP  413 H= 103:15 +CPU= 11.633
  13:07:31 STEP  414 H= 103:30 +CPU= 11.582
  13:07:44 STEP  415 H= 103:45 +CPU= 13.418
  13:07:56 STEP  416 H= 104:00 +CPU= 12.017
  13:08:10 STEP  417 H= 104:15 +CPU= 13.399
  13:08:22 STEP  418 H= 104:30 +CPU= 12.243
  13:08:36 STEP  419 H= 104:45 +CPU= 13.637
  13:08:51 STEP  420 H= 105:00 +CPU= 15.648
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000420
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000420
  13:09:03 STEP  421 H= 105:15 +CPU= 11.666
  13:09:15 STEP  422 H= 105:30 +CPU= 12.029
  13:09:27 STEP  423 H= 105:45 +CPU= 11.598
  13:09:39 STEP  424 H= 106:00 +CPU= 12.468
  13:09:51 STEP  425 H= 106:15 +CPU= 11.631
  13:10:03 STEP  426 H= 106:30 +CPU= 11.972
  13:10:15 STEP  427 H= 106:45 +CPU= 12.024
  13:10:28 STEP  428 H= 107:00 +CPU= 12.805
  13:10:41 STEP  429 H= 107:15 +CPU= 12.684
  13:10:53 STEP  430 H= 107:30 +CPU= 12.369
  13:11:05 STEP  431 H= 107:45 +CPU= 11.765
  13:11:24 STEP  432 H= 108:00 +CPU= 19.561
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000432
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000432
  13:11:37 STEP  433 H= 108:15 +CPU= 12.048
  13:11:48 STEP  434 H= 108:30 +CPU= 11.709
  13:12:00 STEP  435 H= 108:45 +CPU= 11.667
  13:12:13 STEP  436 H= 109:00 +CPU= 12.489
  13:12:25 STEP  437 H= 109:15 +CPU= 12.632
  13:12:38 STEP  438 H= 109:30 +CPU= 12.281
  13:12:49 STEP  439 H= 109:45 +CPU= 11.705
  13:13:02 STEP  440 H= 110:00 +CPU= 12.258
  13:13:14 STEP  441 H= 110:15 +CPU= 11.944
  13:13:25 STEP  442 H= 110:30 +CPU= 11.730
  13:13:37 STEP  443 H= 110:45 +CPU= 11.645
  13:13:53 STEP  444 H= 111:00 +CPU= 15.552
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000444
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000444
  13:14:05 STEP  445 H= 111:15 +CPU= 12.056
  13:14:17 STEP  446 H= 111:30 +CPU= 12.482
  13:14:29 STEP  447 H= 111:45 +CPU= 11.646
  13:14:41 STEP  448 H= 112:00 +CPU= 12.239
  13:14:53 STEP  449 H= 112:15 +CPU= 11.543
  13:15:04 STEP  450 H= 112:30 +CPU= 11.282
  13:15:16 STEP  451 H= 112:45 +CPU= 12.070
  13:15:30 STEP  452 H= 113:00 +CPU= 13.927
  13:15:42 STEP  453 H= 113:15 +CPU= 11.983
  13:15:54 STEP  454 H= 113:30 +CPU= 11.746
  13:16:06 STEP  455 H= 113:45 +CPU= 12.286
  13:16:22 STEP  456 H= 114:00 +CPU= 16.130
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000456
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000456
  13:16:35 STEP  457 H= 114:15 +CPU= 12.485
  13:16:47 STEP  458 H= 114:30 +CPU= 11.868
  13:16:59 STEP  459 H= 114:45 +CPU= 11.692
  13:17:11 STEP  460 H= 115:00 +CPU= 12.539
  13:17:24 STEP  461 H= 115:15 +CPU= 12.396
  13:17:36 STEP  462 H= 115:30 +CPU= 12.094
  13:17:48 STEP  463 H= 115:45 +CPU= 11.850
  13:18:00 STEP  464 H= 116:00 +CPU= 12.571
  13:18:12 STEP  465 H= 116:15 +CPU= 11.592
  13:18:24 STEP  466 H= 116:30 +CPU= 11.670
  13:18:35 STEP  467 H= 116:45 +CPU= 11.503
  13:18:51 STEP  468 H= 117:00 +CPU= 16.280
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000468
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000468
  13:19:04 STEP  469 H= 117:15 +CPU= 12.328
  13:19:16 STEP  470 H= 117:30 +CPU= 11.809
  13:19:27 STEP  471 H= 117:45 +CPU= 11.710
  13:19:40 STEP  472 H= 118:00 +CPU= 12.618
  13:19:53 STEP  473 H= 118:15 +CPU= 12.627
  13:20:05 STEP  474 H= 118:30 +CPU= 12.890
  13:20:19 STEP  475 H= 118:45 +CPU= 13.087
  13:20:30 STEP  476 H= 119:00 +CPU= 11.786
  13:20:42 STEP  477 H= 119:15 +CPU= 12.020
  13:20:54 STEP  478 H= 119:30 +CPU= 11.419
  13:21:05 STEP  479 H= 119:45 +CPU= 11.442
  13:21:24 STEP  480 H= 120:00 +CPU= 18.094
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000480
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0sq_2016092300_15_991_12207821_0_r280341524_4.zip
  13:21:36 STEP  481 H= 120:15 +CPU= 12.066
Uploading the intermediate file: upload_file_4.zip
  13:21:49 STEP  482 H= 120:30 +CPU= 12.752
  13:22:00 STEP  483 H= 120:45 +CPU= 11.655
  13:22:13 STEP  484 H= 121:00 +CPU= 13.218
  13:22:26 STEP  485 H= 121:15 +CPU= 12.204
  13:22:38 STEP  486 H= 121:30 +CPU= 12.235
  13:22:50 STEP  487 H= 121:45 +CPU= 11.688
  13:23:02 STEP  488 H= 122:00 +CPU= 12.358
  13:23:15 STEP  489 H= 122:15 +CPU= 13.042
  13:23:28 STEP  490 H= 122:30 +CPU= 12.424
  13:23:39 STEP  491 H= 122:45 +CPU= 11.828
  13:23:55 STEP  492 H= 123:00 +CPU= 15.471
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000492
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000492
  13:24:07 STEP  493 H= 123:15 +CPU= 12.113
  13:24:20 STEP  494 H= 123:30 +CPU= 13.195
  13:24:32 STEP  495 H= 123:45 +CPU= 11.819
  13:24:44 STEP  496 H= 124:00 +CPU= 12.031
  13:24:56 STEP  497 H= 124:15 +CPU= 12.001
  13:25:08 STEP  498 H= 124:30 +CPU= 12.100
  13:25:21 STEP  499 H= 124:45 +CPU= 12.799
  13:25:34 STEP  500 H= 125:00 +CPU= 12.765
  13:25:46 STEP  501 H= 125:15 +CPU= 11.617
  13:25:58 STEP  502 H= 125:30 +CPU= 11.838
  13:26:10 STEP  503 H= 125:45 +CPU= 12.396
  13:26:26 STEP  504 H= 126:00 +CPU= 15.514
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000504
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000504
  13:26:38 STEP  505 H= 126:15 +CPU= 12.586
  13:26:50 STEP  506 H= 126:30 +CPU= 12.151
  13:27:02 STEP  507 H= 126:45 +CPU= 11.822
  13:27:15 STEP  508 H= 127:00 +CPU= 12.404
  13:27:27 STEP  509 H= 127:15 +CPU= 12.465
  13:27:39 STEP  510 H= 127:30 +CPU= 11.861
  13:27:51 STEP  511 H= 127:45 +CPU= 11.743
  13:28:03 STEP  512 H= 128:00 +CPU= 12.025
  13:28:15 STEP  513 H= 128:15 +CPU= 11.705
  13:28:27 STEP  514 H= 128:30 +CPU= 11.950
  13:28:39 STEP  515 H= 128:45 +CPU= 12.029
  13:28:55 STEP  516 H= 129:00 +CPU= 15.884
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000516
  13:29:06 STEP  517 H= 129:15 +CPU= 11.595
  13:29:18 STEP  518 H= 129:30 +CPU= 11.381
  13:29:29 STEP  519 H= 129:45 +CPU= 11.534
  13:29:42 STEP  520 H= 130:00 +CPU= 12.817
  13:29:55 STEP  521 H= 130:15 +CPU= 12.577
  13:30:07 STEP  522 H= 130:30 +CPU= 11.797
  13:30:19 STEP  523 H= 130:45 +CPU= 12.675
  13:30:32 STEP  524 H= 131:00 +CPU= 12.953
  13:30:44 STEP  525 H= 131:15 +CPU= 11.614
  13:30:55 STEP  526 H= 131:30 +CPU= 11.543
  13:31:08 STEP  527 H= 131:45 +CPU= 12.588
  13:31:27 STEP  528 H= 132:00 +CPU= 18.245
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000528
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000528
  13:31:40 STEP  529 H= 132:15 +CPU= 13.248
  13:31:52 STEP  530 H= 132:30 +CPU= 12.323
  13:32:04 STEP  531 H= 132:45 +CPU= 12.068
  13:32:18 STEP  532 H= 133:00 +CPU= 13.333
  13:32:30 STEP  533 H= 133:15 +CPU= 12.657
  13:32:43 STEP  534 H= 133:30 +CPU= 13.133
  13:32:56 STEP  535 H= 133:45 +CPU= 12.562
  13:33:08 STEP  536 H= 134:00 +CPU= 12.140
  13:33:20 STEP  537 H= 134:15 +CPU= 11.927
  13:33:33 STEP  538 H= 134:30 +CPU= 12.461
  13:33:45 STEP  539 H= 134:45 +CPU= 12.275
  13:34:00 STEP  540 H= 135:00 +CPU= 15.237
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000540
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000540
  13:34:12 STEP  541 H= 135:15 +CPU= 11.567
  13:34:24 STEP  542 H= 135:30 +CPU= 11.807
  13:34:36 STEP  543 H= 135:45 +CPU= 12.382
  13:34:49 STEP  544 H= 136:00 +CPU= 12.816
  13:35:01 STEP  545 H= 136:15 +CPU= 11.878
  13:35:13 STEP  546 H= 136:30 +CPU= 12.136
  13:35:26 STEP  547 H= 136:45 +CPU= 12.588
  13:35:39 STEP  548 H= 137:00 +CPU= 12.915
  13:35:51 STEP  549 H= 137:15 +CPU= 12.036
  13:36:03 STEP  550 H= 137:30 +CPU= 12.069
  13:36:15 STEP  551 H= 137:45 +CPU= 11.945
  13:36:30 STEP  552 H= 138:00 +CPU= 15.463
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000552
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000552
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000552
  13:36:43 STEP  553 H= 138:15 +CPU= 12.946
  13:36:55 STEP  554 H= 138:30 +CPU= 11.764
  13:37:08 STEP  555 H= 138:45 +CPU= 13.115
  13:37:21 STEP  556 H= 139:00 +CPU= 12.601
  13:37:33 STEP  557 H= 139:15 +CPU= 12.235
  13:37:45 STEP  558 H= 139:30 +CPU= 12.257
  13:37:58 STEP  559 H= 139:45 +CPU= 12.465
  13:38:10 STEP  560 H= 140:00 +CPU= 12.455
  13:38:23 STEP  561 H= 140:15 +CPU= 12.344
  13:38:35 STEP  562 H= 140:30 +CPU= 12.104
  13:38:47 STEP  563 H= 140:45 +CPU= 12.419
  13:39:05 STEP  564 H= 141:00 +CPU= 18.113
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000564
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000564
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000564
  13:39:18 STEP  565 H= 141:15 +CPU= 12.451
  13:39:31 STEP  566 H= 141:30 +CPU= 13.062
  13:39:43 STEP  567 H= 141:45 +CPU= 11.647
  13:39:56 STEP  568 H= 142:00 +CPU= 13.097
  13:40:08 STEP  569 H= 142:15 +CPU= 12.422
  13:40:21 STEP  570 H= 142:30 +CPU= 12.826
  13:40:33 STEP  571 H= 142:45 +CPU= 12.120
  13:40:47 STEP  572 H= 143:00 +CPU= 13.499
  13:40:59 STEP  573 H= 143:15 +CPU= 12.342
  13:41:11 STEP  574 H= 143:30 +CPU= 11.972
  13:41:24 STEP  575 H= 143:45 +CPU= 13.221
  13:41:43 STEP  576 H= 144:00 +CPU= 18.253
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000576
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000576
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0sq_2016092300_15_991_12207821_0_r280341524_5.zip
  13:41:56 STEP  577 H= 144:15 +CPU= 12.699
Uploading the intermediate file: upload_file_5.zip
  13:42:09 STEP  578 H= 144:30 +CPU= 13.591
  13:42:21 STEP  579 H= 144:45 +CPU= 11.830
  13:42:35 STEP  580 H= 145:00 +CPU= 13.405
  13:42:47 STEP  581 H= 145:15 +CPU= 12.205
  13:43:00 STEP  582 H= 145:30 +CPU= 12.814
  13:43:13 STEP  583 H= 145:45 +CPU= 13.407
  13:43:26 STEP  584 H= 146:00 +CPU= 12.599
  13:43:37 STEP  585 H= 146:15 +CPU= 11.406
  13:43:50 STEP  586 H= 146:30 +CPU= 12.952
  13:44:03 STEP  587 H= 146:45 +CPU= 12.884
  13:44:19 STEP  588 H= 147:00 +CPU= 16.297
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000588
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000588
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000588
  13:44:33 STEP  589 H= 147:15 +CPU= 13.106
  13:44:45 STEP  590 H= 147:30 +CPU= 12.054
  13:44:57 STEP  591 H= 147:45 +CPU= 12.283
  13:45:10 STEP  592 H= 148:00 +CPU= 12.792
  13:45:22 STEP  593 H= 148:15 +CPU= 11.740
  13:45:34 STEP  594 H= 148:30 +CPU= 12.220
  13:45:46 STEP  595 H= 148:45 +CPU= 12.466
  13:45:59 STEP  596 H= 149:00 +CPU= 12.372
  13:46:10 STEP  597 H= 149:15 +CPU= 11.644
  13:46:22 STEP  598 H= 149:30 +CPU= 11.716
  13:46:34 STEP  599 H= 149:45 +CPU= 12.019
  13:46:50 STEP  600 H= 150:00 +CPU= 15.642
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000600
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000600
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000600
  13:47:02 STEP  601 H= 150:15 +CPU= 12.020
  13:47:14 STEP  602 H= 150:30 +CPU= 11.903
  13:47:26 STEP  603 H= 150:45 +CPU= 11.857
  13:47:41 STEP  604 H= 151:00 +CPU= 15.143
  13:47:53 STEP  605 H= 151:15 +CPU= 12.322
  13:48:07 STEP  606 H= 151:30 +CPU= 13.377
  13:48:18 STEP  607 H= 151:45 +CPU= 11.700
  13:48:31 STEP  608 H= 152:00 +CPU= 12.384
  13:48:43 STEP  609 H= 152:15 +CPU= 12.071
  13:48:55 STEP  610 H= 152:30 +CPU= 11.635
  13:49:07 STEP  611 H= 152:45 +CPU= 11.911
  13:49:22 STEP  612 H= 153:00 +CPU= 15.668
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000612
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000612
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000612
  13:49:34 STEP  613 H= 153:15 +CPU= 12.052
  13:49:47 STEP  614 H= 153:30 +CPU= 12.500
  13:49:58 STEP  615 H= 153:45 +CPU= 11.604
  13:50:11 STEP  616 H= 154:00 +CPU= 12.371
  13:50:23 STEP  617 H= 154:15 +CPU= 11.995
  13:50:34 STEP  618 H= 154:30 +CPU= 11.337
  13:50:46 STEP  619 H= 154:45 +CPU= 11.522
  13:51:00 STEP  620 H= 155:00 +CPU= 13.692
  13:51:12 STEP  621 H= 155:15 +CPU= 12.032
  13:51:25 STEP  622 H= 155:30 +CPU= 12.941
  13:51:37 STEP  623 H= 155:45 +CPU= 12.094
  13:51:55 STEP  624 H= 156:00 +CPU= 18.085
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000624
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000624
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000624
  13:52:07 STEP  625 H= 156:15 +CPU= 12.144
  13:52:19 STEP  626 H= 156:30 +CPU= 11.861
  13:52:31 STEP  627 H= 156:45 +CPU= 11.972
  13:52:43 STEP  628 H= 157:00 +CPU= 11.991
  13:52:55 STEP  629 H= 157:15 +CPU= 11.571
  13:53:06 STEP  630 H= 157:30 +CPU= 10.904
  13:53:16 STEP  631 H= 157:45 +CPU= 10.803
  13:53:28 STEP  632 H= 158:00 +CPU= 11.607
  13:53:40 STEP  633 H= 158:15 +CPU= 11.697
  13:53:51 STEP  634 H= 158:30 +CPU= 11.300
  13:54:02 STEP  635 H= 158:45 +CPU= 10.962
  13:54:16 STEP  636 H= 159:00 +CPU= 13.710
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000636
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000636
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000636
  13:54:27 STEP  637 H= 159:15 +CPU= 10.706
  13:54:38 STEP  638 H= 159:30 +CPU= 11.048
  13:54:48 STEP  639 H= 159:45 +CPU= 10.538
  13:54:59 STEP  640 H= 160:00 +CPU= 11.169
  13:55:11 STEP  641 H= 160:15 +CPU= 11.011
  13:55:21 STEP  642 H= 160:30 +CPU= 10.704
  13:55:32 STEP  643 H= 160:45 +CPU= 10.534
  13:55:43 STEP  644 H= 161:00 +CPU= 10.759
  13:55:53 STEP  645 H= 161:15 +CPU= 10.446
  13:56:03 STEP  646 H= 161:30 +CPU= 10.374
  13:56:14 STEP  647 H= 161:45 +CPU= 10.624
  13:56:29 STEP  648 H= 162:00 +CPU= 15.313
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000648
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000648
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000648
  13:56:40 STEP  649 H= 162:15 +CPU= 10.766
  13:56:53 STEP  650 H= 162:30 +CPU= 12.241
  13:57:04 STEP  651 H= 162:45 +CPU= 11.812
  13:57:17 STEP  652 H= 163:00 +CPU= 12.068
  13:57:27 STEP  653 H= 163:15 +CPU= 10.866
  13:57:38 STEP  654 H= 163:30 +CPU= 10.677
  13:57:49 STEP  655 H= 163:45 +CPU= 10.684
  13:58:00 STEP  656 H= 164:00 +CPU= 11.078
  13:58:11 STEP  657 H= 164:15 +CPU= 10.866
  13:58:21 STEP  658 H= 164:30 +CPU= 10.446
  13:58:32 STEP  659 H= 164:45 +CPU= 10.506
  13:58:46 STEP  660 H= 165:00 +CPU= 13.929
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000660
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000660
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000660
  13:58:56 STEP  661 H= 165:15 +CPU= 10.584
  13:59:07 STEP  662 H= 165:30 +CPU= 10.601
  13:59:17 STEP  663 H= 165:45 +CPU= 10.401
  13:59:28 STEP  664 H= 166:00 +CPU= 10.772
  13:59:39 STEP  665 H= 166:15 +CPU= 10.567
  13:59:49 STEP  666 H= 166:30 +CPU= 10.554
  14:00:00 STEP  667 H= 166:45 +CPU= 10.465
  14:00:11 STEP  668 H= 167:00 +CPU= 10.943
  14:00:21 STEP  669 H= 167:15 +CPU= 10.414
  14:00:32 STEP  670 H= 167:30 +CPU= 10.567
  14:00:42 STEP  671 H= 167:45 +CPU= 10.714
  14:00:58 STEP  672 H= 168:00 +CPU= 15.557
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000672
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000672
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMGGh7zg+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMSHh7zg+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207821/ICMUAh7zg+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0sq_2016092300_15_991_12207821_0_r280341524_6.zip
  14:01:09 STEP  673 H= 168:15 +CPU= 10.657
Uploading the intermediate file: upload_file_6.zip
  14:01:20 STEP  674 H= 168:30 +CPU= 10.874
  14:01:30 STEP  675 H= 168:45 +CPU= 10.460
  14:01:41 STEP  676 H= 169:00 +CPU= 10.921
  14:01:52 STEP  677 H= 169:15 +CPU= 10.698
  14:02:02 STEP  678 H= 169:30 +CPU= 10.554
  14:02:13 STEP  679 H= 169:45 +CPU= 10.691
  14:02:24 STEP  680 H= 170:00 +CPU= 11.374
  14:02:36 STEP  681 H= 170:15 +CPU= 11.219
  14:02:47 STEP  682 H= 170:30 +CPU= 10.985
  14:02:58 STEP  683 H= 170:45 +CPU= 11.803
  14:03:16 STEP  684 H= 171:00 +CPU= 16.935
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000684
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000684
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000684
  14:03:28 STEP  685 H= 171:15 +CPU= 12.396
  14:03:40 STEP  686 H= 171:30 +CPU= 12.150
  14:03:52 STEP  687 H= 171:45 +CPU= 12.073
  14:04:06 STEP  688 H= 172:00 +CPU= 13.452
  14:04:19 STEP  689 H= 172:15 +CPU= 13.048
  14:04:31 STEP  690 H= 172:30 +CPU= 12.170
  14:04:44 STEP  691 H= 172:45 +CPU= 12.507
  14:04:57 STEP  692 H= 173:00 +CPU= 12.939
  14:05:10 STEP  693 H= 173:15 +CPU= 12.810
  14:05:22 STEP  694 H= 173:30 +CPU= 12.230
  14:05:35 STEP  695 H= 173:45 +CPU= 12.804
  14:05:50 STEP  696 H= 174:00 +CPU= 15.798
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000696
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000696
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000696
  14:06:03 STEP  697 H= 174:15 +CPU= 12.331
  14:06:15 STEP  698 H= 174:30 +CPU= 12.104
  14:06:27 STEP  699 H= 174:45 +CPU= 12.317
  14:06:40 STEP  700 H= 175:00 +CPU= 12.753
  14:06:52 STEP  701 H= 175:15 +CPU= 12.341
  14:07:04 STEP  702 H= 175:30 +CPU= 11.790
  14:07:17 STEP  703 H= 175:45 +CPU= 12.625
  14:07:30 STEP  704 H= 176:00 +CPU= 13.524
  14:07:44 STEP  705 H= 176:15 +CPU= 13.354
  14:07:56 STEP  706 H= 176:30 +CPU= 12.055
  14:08:08 STEP  707 H= 176:45 +CPU= 12.338
  14:08:25 STEP  708 H= 177:00 +CPU= 16.462
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000708
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000708
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000708
  14:08:37 STEP  709 H= 177:15 +CPU= 12.525
  14:08:50 STEP  710 H= 177:30 +CPU= 12.669
  14:09:03 STEP  711 H= 177:45 +CPU= 12.532
  14:09:16 STEP  712 H= 178:00 +CPU= 13.213
  14:09:28 STEP  713 H= 178:15 +CPU= 12.226
  14:09:40 STEP  714 H= 178:30 +CPU= 12.306
  14:09:52 STEP  715 H= 178:45 +CPU= 11.802
  14:10:05 STEP  716 H= 179:00 +CPU= 12.694
  14:10:17 STEP  717 H= 179:15 +CPU= 11.791
  14:10:29 STEP  718 H= 179:30 +CPU= 12.153
  14:10:41 STEP  719 H= 179:45 +CPU= 11.924
  14:10:59 STEP  720 H= 180:00 +CPU= 18.161
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000720
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000720
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000720
  14:11:13 STEP  721 H= 180:15 +CPU= 13.740
  14:11:26 STEP  722 H= 180:30 +CPU= 13.117
  14:11:40 STEP  723 H= 180:45 +CPU= 14.230
  14:11:55 STEP  724 H= 181:00 +CPU= 14.221
  14:12:07 STEP  725 H= 181:15 +CPU= 12.447
  14:12:20 STEP  726 H= 181:30 +CPU= 12.489
  14:12:33 STEP  727 H= 181:45 +CPU= 13.489
  14:12:46 STEP  728 H= 182:00 +CPU= 12.673
  14:12:59 STEP  729 H= 182:15 +CPU= 12.474
  14:13:11 STEP  730 H= 182:30 +CPU= 12.186
  14:13:23 STEP  731 H= 182:45 +CPU= 11.790
  14:13:38 STEP  732 H= 183:00 +CPU= 15.602
  MAX V WIND=   257.324937077892     
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000732
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000732
  14:13:51 STEP  733 H= 183:15 +CPU= 12.788
  MAX V WIND=   251.557195493742     
  14:14:03 STEP  734 H= 183:30 +CPU= 11.983
  MAX U WIND=   260.973743444210     
  MAX V WIND=   252.807196628791     
  14:14:16 STEP  735 H= 183:45 +CPU= 12.727
  MAX U WIND=   251.661622758791     
  MAX U WIND=   260.930238436492     
  MAX U WIND=   250.002235990047     
  MAX V WIND=   252.922654163485     
  MAX V WIND=   254.754042024788     
  14:14:29 STEP  736 H= 184:00 +CPU= 13.220
  MAX U WIND=   265.346190826979     
  MAX U WIND=   255.464167189957     
  MAX V WIND=   250.944247875242     
  MAX V WIND=   259.852923058118     
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.402] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 4362MB (heap), 5076MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.402] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.402] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.402] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.402] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4362 MB (maxheap), 5076 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141437:1676466877:9032.403] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/5/oifs_43r3_model.exe' : sigcontextptr=0x7fff2ac198d0
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 24) with addr2line-cmd
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/5/oifs_43r3_model.exe' 0x838803 0x838e09 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x12d283b] : vdfmain_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12ba8d9] : vdfouter_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12b0762] : turbulence_layer_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x1163fc3] : callpar_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x10b682f] : ec_phys_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10a915c] : ec_phys_drv_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xe680c3] : gp_model_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x15c1e62] : gp_model_heap_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15ac40e] : scan2m_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x6620b4] : stepo_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4a0e7c] : cnt4_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49dc29] : cnt3_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49ce72] : cnt2_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49cd68] : cnt1_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x4078ad] : cnt0_() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x40276f] : MAIN__() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40270d] : main() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d840d7] : __libc_start_main_impl() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x4025e5] : _start() at ??:?
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.403] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/5/oifs_43r3_model.exe' : sigcontextptr=0x7fff2ac197e0
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 25) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/5/oifs_43r3_model.exe' 0x838803 0x838e09 0x820d70 0x1d8bb20 0x1cc4a8f 0x12d283b 0x12ba8d9 0x12b0762 0x1163fc3 0x10b682f 0x10a915c 0xe680c3 0x15c1e62 0x15ac40e 0x6620b4 0x4a0e7c 0x49dc29 0x49ce72 0x49cd68 0x4078ad 0x40276f 0x40270d 0x1d8287a 0x1d840d7 0x4025e5
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x838803] : LinuxTraceBack() at linuxtrbk.c:264
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x838e09] : LinuxTraceBack() at linuxtrbk.c:236
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x820d70] : signal_drhook() at drhook.c:1734
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1d8bb20] : __restore_rt() at libc_sigaction.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0x1cc4a8f] : __libm_exp_e7() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0x12d283b] : vdfmain_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0x12ba8d9] : vdfouter_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0x12b0762] : turbulence_layer_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x1163fc3] : callpar_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x10b682f] : ec_phys_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x10a915c] : ec_phys_drv_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0xe680c3] : gp_model_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x15c1e62] : gp_model_heap_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x15ac40e] : scan2m_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x6620b4] : stepo_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x4a0e7c] : cnt4_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x49dc29] : cnt3_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x49ce72] : cnt2_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x49cd68] : cnt1_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x4078ad] : cnt0_() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x40276f] : MAIN__() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x40270d] : main() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [22]: [0x1d8287a] : __libc_start_call_main() at libc-start.o:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [23]: [0x1d840d7] : __libc_start_main_impl() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:319] [24]: [0x4025e5] : _start() at ??:?
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.489] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:Ryze:1:1:2322678:2322678] [20230215:141438:1676466878:9033.489] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC4A8F  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000012D283B  vdfmain_                  874  vdfmain.F90
oifs_43r3_model.e  00000000012BA8D9  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  00000000012B0762  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000001163FC3  callpar_                  869  callpar.F90
oifs_43r3_model.e  00000000010B682F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  00000000010A915C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000E680C3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.203724761598655E-04 0.000000000000000E+00 0.260925233494871E-01
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.145276149155213E-05 0.000000000000000E+00 0.930712370159562E-02
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.199409490174974E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.162296016227767E-05 0.000000000000000E+00 0.155200336149771E-01
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.967116699392798E-05 0.000000000000000E+00 0.195414112063293E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.198792421562882E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.519175192240352E-05 0.000000000000000E+00 0.269856264007553E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.574983082483435E-05 0.000000000000000E+00 0.704071438365821E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.277033166600799E-05 0.000000000000000E+00 0.106329444785601E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.153958926581278E-05 0.000000000000000E+00 0.690267700302336E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.145460580531045E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   732 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   732 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000732 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000732
 MPI-TASK:   1 -    324617674 BYTES IN      6 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0048( 4.2%)
 NSTEP =   732 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000732
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0043 SECONDS164596.6 Mbytes/s, TOTAL TIME=    0.1307( 3.3%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000732
 MPI-TASK:   1 -   5193882775 BYTES IN    125 RECORDS TRANSFERRED IN    0.0031 SECONDS******** Mbytes/s, TOTAL TIME=    0.1038( 3.0%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000732
 MPI-TASK:   1 -    316044041 BYTES IN      2 RECORDS TRANSFERRED IN    0.0004 SECONDS790110.1 Mbytes/s, TOTAL TIME=    0.0025(16.0%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000732 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000732
 MPI-TASK:   1 -    324617674 BYTES IN      4 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0033( 6.1%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =   732 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =   732 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000732 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000732
 MPI-TASK:   1 -    324617665 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0057( 5.3%)
 14:13:38 STEP  732 H= 183:00 +CPU= 15.602
 NSTEP =   733 STEPO   0AAA00AAA
 14:13:51 STEP  733 H= 183:15 +CPU= 12.788
 NSTEP =   734 STEPO   0AAA00AAA
 14:14:03 STEP  734 H= 183:30 +CPU= 11.983
ISTEP=     735 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=     735 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =   735 STEPO   0AAA00AAA
 14:14:16 STEP  735 H= 183:45 +CPU= 12.727
 NSTEP =   736 STEPO   0AAA00AAA
 14:14:29 STEP  736 H= 184:00 +CPU= 13.220
 NSTEP =   737 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 14:13:25 FULLPOS-T DYNFPOS    732     0.372    0.372    0.372    148:55    149:20 0.19653806857795E-04       2GB       0MB
 14:13:26 0AAA00AAA STEPO      732     0.433    0.433    0.434    148:55    149:20 0.19653806857795E-04       2GB       0MB
 14:13:38 0AAA00AAA STEPO      733    12.460   12.460   12.495    149:08    149:33 0.19653806857795E-04       2GB       0MB
 14:13:51 0AAA00AAA STEPO      734    12.788   12.788   12.809    149:20    149:45 0.19653806857795E-04       2GB       0MB
 14:14:03 0AAA00AAA STEPO      735    11.983   11.983   12.005    149:32    149:57 0.19653806857795E-04       2GB       0MB
 14:14:16 0AAA00AAA STEPO      736    12.727   12.727   12.749    149:45    150:10 0.19653806857795E-04       2GB       0MB
 14:14:29 0AAA00AAA STEPO      737    13.220   13.220   13.242    149:58    150:23 0.19653806857795E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     720",
 CTIME   = "00071200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,         708, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/5/progress_file_12207821.xml

<running_values>
  <last_cpu_time>9009.180000</last_cpu_time>
  <upload_file_number>7</upload_file_number>
  <last_iter>737</last_iter>
  <last_upload>604800</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net