Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.296 sec
: Elapsed time for training with 1000 events: 0.3 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00302 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.00119 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00575 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000296 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000321 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31579.8
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33124.6 31213.9 0.00415166 0.000487662 218341 0
: 2 Minimum Test error found - save the configuration
: 2 | 32666.8 30699.1 0.00420547 0.0004754 214473 0
: 3 Minimum Test error found - save the configuration
: 3 | 32042.2 30113.4 0.00434194 0.000492171 207805 0
: 4 Minimum Test error found - save the configuration
: 4 | 31406.3 29561.6 0.0044227 0.00048514 203172 0
: 5 Minimum Test error found - save the configuration
: 5 | 30754.4 28970.5 0.00448702 0.000504371 200871 0
: 6 Minimum Test error found - save the configuration
: 6 | 30043.1 28143.2 0.00438832 0.000478452 204610 0
: 7 Minimum Test error found - save the configuration
: 7 | 29263.9 27384.3 0.00454624 0.000524551 198921 0
: 8 Minimum Test error found - save the configuration
: 8 | 28726.7 26966.1 0.00418964 0.000455741 214253 0
: 9 Minimum Test error found - save the configuration
: 9 | 28352 26631.1 0.00418658 0.000449631 214078 0
: 10 Minimum Test error found - save the configuration
: 10 | 28018.8 26325.6 0.00428661 0.000465112 209342 0
: 11 Minimum Test error found - save the configuration
: 11 | 27712.2 26032.6 0.00442281 0.000484491 203132 0
: 12 Minimum Test error found - save the configuration
: 12 | 27416.9 25754.2 0.00442177 0.000470402 202462 0
: 13 Minimum Test error found - save the configuration
: 13 | 27130.1 25490.7 0.00568451 0.000655351 159072 0
: 14 Minimum Test error found - save the configuration
: 14 | 26856.2 25234.6 0.00504472 0.000660102 182456 0
: 15 Minimum Test error found - save the configuration
: 15 | 26592.9 24980.8 0.00551062 0.000699081 166267 0
: 16 Minimum Test error found - save the configuration
: 16 | 26330.4 24736.5 0.00515211 0.000542201 173539 0
: 17 Minimum Test error found - save the configuration
: 17 | 26079.4 24492.8 0.00534738 0.00069185 171839 0
: 18 Minimum Test error found - save the configuration
: 18 | 25830.1 24254.6 0.00467928 0.000519432 192315 0
: 19 Minimum Test error found - save the configuration
: 19 | 25582.7 24025.1 0.00508554 0.000498842 174417 0
: 20 Minimum Test error found - save the configuration
: 20 | 25343.2 23798.7 0.00418932 0.000447792 213816 0
: 21 Minimum Test error found - save the configuration
: 21 | 25108.1 23574.4 0.0041871 0.00046801 215106 0
: 22 Minimum Test error found - save the configuration
: 22 | 24875.2 23354 0.00418061 0.0004593 214978 0
: 23 Minimum Test error found - save the configuration
: 23 | 24646.6 23136.3 0.00413824 0.000462331 217633 0
: 24 Minimum Test error found - save the configuration
: 24 | 24420.1 22922.7 0.00446724 0.000465741 199925 0
: 25 Minimum Test error found - save the configuration
: 25 | 24198.1 22710.9 0.0041726 0.0004536 215112 0
: 26 Minimum Test error found - save the configuration
: 26 | 23978.2 22502.3 0.00445431 0.000492371 201921 0
: 27 Minimum Test error found - save the configuration
: 27 | 23759.9 22298.2 0.00441421 0.000489231 203823 0
: 28 Minimum Test error found - save the configuration
: 28 | 23546.4 22095.6 0.00424849 0.000450801 210654 0
: 29 Minimum Test error found - save the configuration
: 29 | 23334.7 21895.5 0.00422293 0.000473161 213347 0
: 30 Minimum Test error found - save the configuration
: 30 | 23126.4 21696.5 0.00424635 0.000465141 211573 0
: 31 Minimum Test error found - save the configuration
: 31 | 22918.9 21501.1 0.00438869 0.000517931 206678 0
: 32 Minimum Test error found - save the configuration
: 32 | 22716.1 21305.8 0.00432883 0.000470931 207367 0
: 33 Minimum Test error found - save the configuration
: 33 | 22513.7 21113.7 0.00427024 0.000518851 213254 0
: 34 Minimum Test error found - save the configuration
: 34 | 22313.3 20925 0.00462944 0.000510212 194211 0
: 35 Minimum Test error found - save the configuration
: 35 | 22111.7 20744.4 0.00463253 0.000484281 192852 0
: 36 Minimum Test error found - save the configuration
: 36 | 21922.2 20556.8 0.00486625 0.000513872 183808 0
: 37 Minimum Test error found - save the configuration
: 37 | 21727.3 20373.8 0.00520066 0.000516841 170801 0
: 38 Minimum Test error found - save the configuration
: 38 | 21536 20193.2 0.00452439 0.000505202 199045 0
: 39 Minimum Test error found - save the configuration
: 39 | 21347.6 20013.2 0.00456524 0.000488612 196241 0
: 40 Minimum Test error found - save the configuration
: 40 | 21159.3 19836.7 0.00594242 0.000690421 152323 0
: 41 Minimum Test error found - save the configuration
: 41 | 20972.2 19663.3 0.00516205 0.000470121 170506 0
: 42 Minimum Test error found - save the configuration
: 42 | 20787.9 19489.4 0.0046076 0.000526951 196047 0
: 43 Minimum Test error found - save the configuration
: 43 | 20605.2 19311.4 0.0044868 0.000494141 200368 0
: 44 Minimum Test error found - save the configuration
: 44 | 20424.6 19142.2 0.00479023 0.000621942 191925 0
: 45 Minimum Test error found - save the configuration
: 45 | 20247.2 18973.6 0.00527464 0.00070025 174887 0
: 46 Minimum Test error found - save the configuration
: 46 | 20064.4 18807.4 0.00621888 0.000709921 145218 0
: 47 Minimum Test error found - save the configuration
: 47 | 19892.4 18635.8 0.00623483 0.000711281 144834 0
: 48 Minimum Test error found - save the configuration
: 48 | 19712.6 18476.7 0.00623054 0.000701251 144684 0
: 49 Minimum Test error found - save the configuration
: 49 | 19542.4 18312.4 0.00496058 0.000481011 178589 0
: 50 Minimum Test error found - save the configuration
: 50 | 19374.2 18149.6 0.00427399 0.000480562 210891 0
: 51 Minimum Test error found - save the configuration
: 51 | 19200.4 17992.2 0.00424393 0.000469401 211947 0
: 52 Minimum Test error found - save the configuration
: 52 | 19035.2 17831.1 0.0042374 0.000459881 211779 0
: 53 Minimum Test error found - save the configuration
: 53 | 18866.7 17672.2 0.00426126 0.000471821 211113 0
: 54 Minimum Test error found - save the configuration
: 54 | 18700.7 17516.4 0.00428206 0.000480051 210415 0
: 55 Minimum Test error found - save the configuration
: 55 | 18538.1 17360.9 0.00426824 0.000470181 210634 0
: 56 Minimum Test error found - save the configuration
: 56 | 18375.4 17205.3 0.00426509 0.000466329 210595 0
: 57 Minimum Test error found - save the configuration
: 57 | 18210.8 17054 0.00430833 0.000479911 208964 0
: 58 Minimum Test error found - save the configuration
: 58 | 18053.5 16901 0.00477424 0.000696001 196163 0
: 59 Minimum Test error found - save the configuration
: 59 | 17893 16749.3 0.00452733 0.000498371 198562 0
: 60 Minimum Test error found - save the configuration
: 60 | 17733.5 16601.1 0.00441615 0.000475452 203010 0
: 61 Minimum Test error found - save the configuration
: 61 | 17578.8 16448.4 0.00453015 0.000525091 199747 0
: 62 Minimum Test error found - save the configuration
: 62 | 17420.8 16302.7 0.00454067 0.000491311 197562 0
: 63 Minimum Test error found - save the configuration
: 63 | 17268.7 16155.3 0.00448836 0.00056369 203839 0
: 64 Minimum Test error found - save the configuration
: 64 | 17114.5 16005.8 0.00481739 0.00057377 188518 0
: 65 Minimum Test error found - save the configuration
: 65 | 16959.9 15865.8 0.0046074 0.000527131 196066 0
: 66 Minimum Test error found - save the configuration
: 66 | 16812.7 15717 0.00450264 0.000498411 199789 0
: 67 Minimum Test error found - save the configuration
: 67 | 16658.3 15576.2 0.0048186 0.000532271 186640 0
: 68 Minimum Test error found - save the configuration
: 68 | 16512.9 15436.9 0.00447622 0.000500761 201235 0
: 69 Minimum Test error found - save the configuration
: 69 | 16365.5 15294.1 0.00464237 0.00054402 195201 0
: 70 Minimum Test error found - save the configuration
: 70 | 16217.1 15157 0.00486097 0.000516071 184124 0
: 71 Minimum Test error found - save the configuration
: 71 | 16071.7 15020.6 0.00465438 0.000538421 194365 0
: 72 Minimum Test error found - save the configuration
: 72 | 15929.9 14884.6 0.00463812 0.00052724 194606 0
: 73 Minimum Test error found - save the configuration
: 73 | 15785.6 14750.2 0.00464186 0.000509782 193607 0
: 74 Minimum Test error found - save the configuration
: 74 | 15645.8 14616.1 0.00463481 0.000518161 194333 0
: 75 Minimum Test error found - save the configuration
: 75 | 15505.8 14482.9 0.00502345 0.000652361 183021 0
: 76 Minimum Test error found - save the configuration
: 76 | 15365.3 14353.9 0.00454574 0.000521332 198787 0
: 77 Minimum Test error found - save the configuration
: 77 | 15230.6 14222.3 0.00456623 0.000546921 199039 0
: 78 Minimum Test error found - save the configuration
: 78 | 15093.4 14093.7 0.00462124 0.000492151 193747 0
: 79 Minimum Test error found - save the configuration
: 79 | 14957.7 13967.5 0.00475689 0.000553381 190317 0
: 80 Minimum Test error found - save the configuration
: 80 | 14824.8 13841.5 0.00464624 0.000513591 193580 0
: 81 Minimum Test error found - save the configuration
: 81 | 14694.3 13713.8 0.00478851 0.000572471 189752 0
: 82 Minimum Test error found - save the configuration
: 82 | 14559.8 13591.7 0.00479969 0.000563382 188844 0
: 83 Minimum Test error found - save the configuration
: 83 | 14431 13468.8 0.00459276 0.000526801 196756 0
: 84 Minimum Test error found - save the configuration
: 84 | 14303.2 13345.8 0.00462712 0.00050909 194268 0
: 85 Minimum Test error found - save the configuration
: 85 | 14172.3 13228.1 0.00471239 0.000509151 190329 0
: 86 Minimum Test error found - save the configuration
: 86 | 14048.3 13107.6 0.00472507 0.000507541 189685 0
: 87 Minimum Test error found - save the configuration
: 87 | 13921.3 12990 0.004763 0.000587462 191592 0
: 88 Minimum Test error found - save the configuration
: 88 | 13798 12872 0.00476559 0.000523911 188605 0
: 89 Minimum Test error found - save the configuration
: 89 | 13673.6 12756.5 0.00495701 0.000575201 182573 0
: 90 Minimum Test error found - save the configuration
: 90 | 13552.2 12640.3 0.00478633 0.000564432 189488 0
: 91 Minimum Test error found - save the configuration
: 91 | 13430.2 12526.5 0.00481481 0.000504841 185616 0
: 92 Minimum Test error found - save the configuration
: 92 | 13310.2 12413.4 0.00574378 0.00052703 153352 0
: 93 Minimum Test error found - save the configuration
: 93 | 13189.7 12303.2 0.00472626 0.000547851 191460 0
: 94 Minimum Test error found - save the configuration
: 94 | 13073.3 12191.5 0.00495959 0.000512151 179879 0
: 95 Minimum Test error found - save the configuration
: 95 | 12956.7 12079.8 0.00485913 0.00052678 184657 0
: 96 Minimum Test error found - save the configuration
: 96 | 12839.8 11970.7 0.00521526 0.000567891 172140 0
: 97 Minimum Test error found - save the configuration
: 97 | 12723.8 11863.7 0.00572717 0.000718021 159708 0
: 98 Minimum Test error found - save the configuration
: 98 | 12611 11755.6 0.00460758 0.000503331 194920 0
: 99 Minimum Test error found - save the configuration
: 99 | 12497.5 11649.1 0.00447732 0.000505471 201418 0
: 100 Minimum Test error found - save the configuration
: 100 | 12385.4 11543.8 0.00452952 0.000549871 201023 0
: 101 Minimum Test error found - save the configuration
: 101 | 12274.4 11439.1 0.00535488 0.000722822 172709 0
: 102 Minimum Test error found - save the configuration
: 102 | 12165 11334.6 0.00535074 0.000509202 165237 0
: 103 Minimum Test error found - save the configuration
: 103 | 12053.4 11234.5 0.00432904 0.000468682 207235 0
: 104 Minimum Test error found - save the configuration
: 104 | 11947.9 11131 0.00432159 0.000477892 208133 0
: 105 Minimum Test error found - save the configuration
: 105 | 11839.8 11029.8 0.00501496 0.000505071 177388 0
: 106 Minimum Test error found - save the configuration
: 106 | 11733 10930.1 0.00452415 0.000509272 199259 0
: 107 Minimum Test error found - save the configuration
: 107 | 11628.3 10830.4 0.00582912 0.000720262 156591 0
: 108 Minimum Test error found - save the configuration
: 108 | 11521.1 10735.4 0.00630154 0.000716952 143251 0
: 109 Minimum Test error found - save the configuration
: 109 | 11420.6 10636.8 0.00631738 0.000703401 142501 0
: 110 Minimum Test error found - save the configuration
: 110 | 11316 10541.8 0.0063159 0.000727992 143166 0
: 111 Minimum Test error found - save the configuration
: 111 | 11214.7 10446.7 0.00623344 0.000668942 143768 0
: 112 Minimum Test error found - save the configuration
: 112 | 11115.8 10349.7 0.00611023 0.000676921 147240 0
: 113 Minimum Test error found - save the configuration
: 113 | 11013.4 10256.7 0.00609379 0.000668172 147449 0
: 114 Minimum Test error found - save the configuration
: 114 | 10914.3 10164.5 0.00612516 0.000705341 147606 0
: 115 Minimum Test error found - save the configuration
: 115 | 10817.2 10071.5 0.00497602 0.000485212 178142 0
: 116 Minimum Test error found - save the configuration
: 116 | 10718.6 9981.06 0.004818 0.000689133 193758 0
: 117 Minimum Test error found - save the configuration
: 117 | 10622.7 9889.72 0.00640596 0.000721581 140737 0
: 118 Minimum Test error found - save the configuration
: 118 | 10527 9799.61 0.00572745 0.000564532 154951 0
: 119 Minimum Test error found - save the configuration
: 119 | 10432.1 9709.93 0.00511371 0.000667701 179937 0
: 120 Minimum Test error found - save the configuration
: 120 | 10337.8 9621.18 0.00449606 0.000554051 202942 0
: 121 Minimum Test error found - save the configuration
: 121 | 10244.9 9533.41 0.00472441 0.000527571 190620 0
: 122 Minimum Test error found - save the configuration
: 122 | 10150.5 9448.5 0.00470365 0.000526641 191525 0
: 123 Minimum Test error found - save the configuration
: 123 | 10059.6 9363.54 0.0052775 0.000597492 170940 0
: 124 Minimum Test error found - save the configuration
: 124 | 9970.35 9276.88 0.00453241 0.000527251 199742 0
: 125 Minimum Test error found - save the configuration
: 125 | 9879.24 9191.98 0.00621205 0.000640242 143580 0
: 126 Minimum Test error found - save the configuration
: 126 | 9788.84 9110.05 0.00451375 0.000519721 200299 0
: 127 Minimum Test error found - save the configuration
: 127 | 9701.14 9027.16 0.00518046 0.000706733 178822 0
: 128 Minimum Test error found - save the configuration
: 128 | 9614.08 8944.04 0.00528403 0.000732532 175766 0
: 129 Minimum Test error found - save the configuration
: 129 | 9525.17 8864.62 0.00598708 0.000669512 150445 0
: 130 Minimum Test error found - save the configuration
: 130 | 9440.87 8783.11 0.00484132 0.000707182 193511 0
: 131 Minimum Test error found - save the configuration
: 131 | 9355.39 8702.36 0.00538428 0.000553491 165604 0
: 132 Minimum Test error found - save the configuration
: 132 | 9270.65 8621.74 0.00590985 0.000644212 151928 0
: 133 Minimum Test error found - save the configuration
: 133 | 9186.6 8542.66 0.00488086 0.00069542 191139 0
: 134 Minimum Test error found - save the configuration
: 134 | 9102.91 8464.82 0.00632311 0.000715321 142659 0
: 135 Minimum Test error found - save the configuration
: 135 | 9020.01 8387.93 0.00635534 0.000708562 141674 0
: 136 Minimum Test error found - save the configuration
: 136 | 8937.81 8312.47 0.00634817 0.000723081 142220 0
: 137 Minimum Test error found - save the configuration
: 137 | 8858.61 8235.02 0.00550068 0.000629191 164221 0
: 138 Minimum Test error found - save the configuration
: 138 | 8778.1 8158.64 0.00563829 0.000735562 163174 0
: 139 Minimum Test error found - save the configuration
: 139 | 8697.3 8084.74 0.00623726 0.000529951 140171 0
: 140 Minimum Test error found - save the configuration
: 140 | 8618.87 8010.26 0.00505696 0.000500851 175588 0
: 141 Minimum Test error found - save the configuration
: 141 | 8539.91 7938.3 0.00443004 0.00049623 203365 0
: 142 Minimum Test error found - save the configuration
: 142 | 8462.56 7865.78 0.00459343 0.000484042 194676 0
: 143 Minimum Test error found - save the configuration
: 143 | 8386.04 7793.86 0.00525497 0.000509981 168599 0
: 144 Minimum Test error found - save the configuration
: 144 | 8310.48 7721.18 0.00452438 0.00049786 198683 0
: 145 Minimum Test error found - save the configuration
: 145 | 8233.08 7652.39 0.00492662 0.000615922 185585 0
: 146 Minimum Test error found - save the configuration
: 146 | 8159.69 7581.41 0.00520577 0.000508421 170309 0
: 147 Minimum Test error found - save the configuration
: 147 | 8085.63 7511.04 0.00447103 0.000500511 201485 0
: 148 Minimum Test error found - save the configuration
: 148 | 8010.56 7443.44 0.00448359 0.000503121 200981 0
: 149 Minimum Test error found - save the configuration
: 149 | 7939.1 7374 0.00486698 0.000492601 182883 0
: 150 Minimum Test error found - save the configuration
: 150 | 7866.32 7306.03 0.00452959 0.000537251 200384 0
: 151 Minimum Test error found - save the configuration
: 151 | 7794.81 7238.07 0.00475399 0.000557992 190658 0
: 152 Minimum Test error found - save the configuration
: 152 | 7722.37 7173.53 0.00494154 0.000519781 180923 0
: 153 Minimum Test error found - save the configuration
: 153 | 7652.99 7107.51 0.0046314 0.000533651 195229 0
: 154 Minimum Test error found - save the configuration
: 154 | 7583.52 7041.41 0.00492482 0.000652361 187246 0
: 155 Minimum Test error found - save the configuration
: 155 | 7514.09 6977.06 0.00459176 0.000539171 197405 0
: 156 Minimum Test error found - save the configuration
: 156 | 7445.6 6912.21 0.00477601 0.000561601 189825 0
: 157 Minimum Test error found - save the configuration
: 157 | 7376.96 6849.88 0.00594598 0.000698401 152451 0
: 158 Minimum Test error found - save the configuration
: 158 | 7310.53 6785.68 0.00561636 0.000564711 158364 0
: 159 Minimum Test error found - save the configuration
: 159 | 7243.82 6722.78 0.00510699 0.000592551 177209 0
: 160 Minimum Test error found - save the configuration
: 160 | 7177.14 6660.87 0.00483099 0.000522621 185685 0
: 161 Minimum Test error found - save the configuration
: 161 | 7112.49 6598.58 0.00455758 0.000504791 197395 0
: 162 Minimum Test error found - save the configuration
: 162 | 7046.35 6537.73 0.00492518 0.000592101 184626 0
: 163 Minimum Test error found - save the configuration
: 163 | 6981.5 6479.32 0.00446524 0.000508751 202199 0
: 164 Minimum Test error found - save the configuration
: 164 | 6919.57 6417.24 0.00458798 0.000522591 196783 0
: 165 Minimum Test error found - save the configuration
: 165 | 6855.07 6359.05 0.00444527 0.000508 203187 0
: 166 Minimum Test error found - save the configuration
: 166 | 6792.08 6300.19 0.00441662 0.000492481 203866 0
: 167 Minimum Test error found - save the configuration
: 167 | 6730.71 6241.32 0.00481925 0.000504131 185395 0
: 168 Minimum Test error found - save the configuration
: 168 | 6668.74 6184.08 0.00446667 0.000513942 202392 0
: 169 Minimum Test error found - save the configuration
: 169 | 6606.96 6127.42 0.00445632 0.000485461 201468 0
: 170 Minimum Test error found - save the configuration
: 170 | 6546.84 6070.8 0.00437402 0.000484392 205675 0
: 171 Minimum Test error found - save the configuration
: 171 | 6487.24 6013.89 0.00439823 0.000483872 204376 0
: 172 Minimum Test error found - save the configuration
: 172 | 6427.76 5958.66 0.00443194 0.000497071 203311 0
: 173 Minimum Test error found - save the configuration
: 173 | 6368.6 5902.67 0.00453029 0.000514391 199208 0
: 174 Minimum Test error found - save the configuration
: 174 | 6311 5846.64 0.00451821 0.000600771 204215 0
: 175 Minimum Test error found - save the configuration
: 175 | 6251.77 5793.33 0.00454699 0.000494301 197400 0
: 176 Minimum Test error found - save the configuration
: 176 | 6193.82 5741.28 0.00438977 0.000478001 204511 0
: 177 Minimum Test error found - save the configuration
: 177 | 6138.1 5687.35 0.00441506 0.000501601 204423 0
: 178 Minimum Test error found - save the configuration
: 178 | 6081.82 5634.06 0.00437826 0.000476992 205062 0
: 179 Minimum Test error found - save the configuration
: 179 | 6025.63 5581.77 0.00440363 0.000494991 204675 0
: 180 Minimum Test error found - save the configuration
: 180 | 5970.39 5529.62 0.00440757 0.000502911 204884 0
: 181 Minimum Test error found - save the configuration
: 181 | 5915.48 5477.68 0.00444035 0.000488791 202452 0
: 182 Minimum Test error found - save the configuration
: 182 | 5860.6 5427.12 0.00438978 0.00049136 205211 0
: 183 Minimum Test error found - save the configuration
: 183 | 5806.91 5376.47 0.00440612 0.000498641 204736 0
: 184 Minimum Test error found - save the configuration
: 184 | 5753.3 5326.88 0.00455303 0.000504371 197596 0
: 185 Minimum Test error found - save the configuration
: 185 | 5701.35 5276.95 0.00444093 0.00049194 202583 0
: 186 Minimum Test error found - save the configuration
: 186 | 5647.24 5228.48 0.00456437 0.000513782 197502 0
: 187 Minimum Test error found - save the configuration
: 187 | 5597.13 5177.77 0.00442345 0.00048099 202919 0
: 188 Minimum Test error found - save the configuration
: 188 | 5543.72 5131.11 0.00455049 0.000522102 198591 0
: 189 Minimum Test error found - save the configuration
: 189 | 5493.27 5083.2 0.0044784 0.00048498 200330 0
: 190 Minimum Test error found - save the configuration
: 190 | 5443.01 5036 0.00451496 0.000521451 200325 0
: 191 Minimum Test error found - save the configuration
: 191 | 5393.11 4987.88 0.00449004 0.000503521 200676 0
: 192 Minimum Test error found - save the configuration
: 192 | 5341.88 4943.27 0.00460507 0.000624602 200981 0
: 193 Minimum Test error found - save the configuration
: 193 | 5293.83 4897.38 0.00461087 0.000512062 195179 0
: 194 Minimum Test error found - save the configuration
: 194 | 5245.84 4850.41 0.00446607 0.000481191 200759 0
: 195 Minimum Test error found - save the configuration
: 195 | 5196.62 4804.98 0.00523723 0.000520452 169607 0
: 196 Minimum Test error found - save the configuration
: 196 | 5148.25 4760.37 0.00481104 0.000501412 185631 0
: 197 Minimum Test error found - save the configuration
: 197 | 5101.34 4716.05 0.00501648 0.000535581 178536 0
: 198 Minimum Test error found - save the configuration
: 198 | 5054.14 4671.93 0.00495486 0.00049509 179381 0
: 199 Minimum Test error found - save the configuration
: 199 | 5007.61 4629.66 0.00472813 0.000584861 193084 0
: 200 Minimum Test error found - save the configuration
: 200 | 4961.61 4586.04 0.00460551 0.00050099 194907 0
: 201 Minimum Test error found - save the configuration
: 201 | 4915.58 4543.13 0.00500677 0.000563611 180052 0
: 202 Minimum Test error found - save the configuration
: 202 | 4869.87 4501.57 0.00473452 0.000507341 189252 0
: 203 Minimum Test error found - save the configuration
: 203 | 4826.53 4458.55 0.00459126 0.000548241 197872 0
: 204 Minimum Test error found - save the configuration
: 204 | 4780.88 4416.88 0.00465652 0.000513121 193078 0
: 205 Minimum Test error found - save the configuration
: 205 | 4736.97 4376.02 0.00463031 0.000490652 193253 0
: 206 Minimum Test error found - save the configuration
: 206 | 4693.65 4334.92 0.00446524 0.000518291 202688 0
: 207 Minimum Test error found - save the configuration
: 207 | 4649.42 4295.69 0.0049367 0.000730122 190178 0
: 208 Minimum Test error found - save the configuration
: 208 | 4607.22 4256.19 0.00567177 0.000579011 157086 0
: 209 Minimum Test error found - save the configuration
: 209 | 4565.44 4216.1 0.00481981 0.000512081 185713 0
: 210 Minimum Test error found - save the configuration
: 210 | 4524.16 4175.17 0.00468839 0.000506021 191279 0
: 211 Minimum Test error found - save the configuration
: 211 | 4480.38 4138.72 0.00472296 0.000596361 193864 0
: 212 Minimum Test error found - save the configuration
: 212 | 4439.94 4100.95 0.00496438 0.000513441 179737 0
: 213 Minimum Test error found - save the configuration
: 213 | 4399.8 4062.88 0.00459253 0.000507832 195853 0
: 214 Minimum Test error found - save the configuration
: 214 | 4360.11 4023.38 0.00451401 0.000511732 199886 0
: 215 Minimum Test error found - save the configuration
: 215 | 4318.59 3986.54 0.00452525 0.00048099 197811 0
: 216 Minimum Test error found - save the configuration
: 216 | 4279.96 3948.96 0.00461388 0.000525641 195683 0
: 217 Minimum Test error found - save the configuration
: 217 | 4240.01 3912.03 0.00455871 0.00049121 196681 0
: 218 Minimum Test error found - save the configuration
: 218 | 4202.07 3874.81 0.00461029 0.000646281 201816 0
: 219 Minimum Test error found - save the configuration
: 219 | 4162.03 3840.06 0.00503635 0.00056886 179071 0
: 220 Minimum Test error found - save the configuration
: 220 | 4124.87 3804.1 0.00469165 0.000548292 193080 0
: 221 Minimum Test error found - save the configuration
: 221 | 4087.09 3767.95 0.00460004 0.000494411 194854 0
: 222 Minimum Test error found - save the configuration
: 222 | 4049.84 3732.66 0.00499048 0.000550211 180169 0
: 223 Minimum Test error found - save the configuration
: 223 | 4011.88 3699.28 0.0048276 0.000525711 185965 0
: 224 Minimum Test error found - save the configuration
: 224 | 3976.41 3663.62 0.00461974 0.000542621 196217 0
: 225 Minimum Test error found - save the configuration
: 225 | 3939.52 3629.21 0.00465646 0.000500181 192480 0
: 226 Minimum Test error found - save the configuration
: 226 | 3903.7 3595.39 0.00448244 0.00050794 201283 0
: 227 Minimum Test error found - save the configuration
: 227 | 3867.48 3562.74 0.0043702 0.00047577 205422 0
: 228 Minimum Test error found - save the configuration
: 228 | 3832.67 3529.71 0.00438496 0.000490111 205399 0
: 229 Minimum Test error found - save the configuration
: 229 | 3797.33 3497.87 0.00436025 0.000473601 205833 0
: 230 Minimum Test error found - save the configuration
: 230 | 3764.31 3463.95 0.00483212 0.000512141 185186 0
: 231 Minimum Test error found - save the configuration
: 231 | 3728.95 3432.04 0.00467116 0.000532311 193290 0
: 232 Minimum Test error found - save the configuration
: 232 | 3694.95 3400.86 0.0045494 0.000506811 197893 0
: 233 Minimum Test error found - save the configuration
: 233 | 3661.34 3368.25 0.00470452 0.000503471 190429 0
: 234 Minimum Test error found - save the configuration
: 234 | 3628.08 3337.18 0.00476583 0.00053404 189045 0
: 235 Minimum Test error found - save the configuration
: 235 | 3594.71 3306.61 0.00450261 0.0004854 199143 0
: 236 Minimum Test error found - save the configuration
: 236 | 3562.2 3276.72 0.00446532 0.000503061 201905 0
: 237 Minimum Test error found - save the configuration
: 237 | 3530.22 3245.47 0.00501343 0.000589071 180817 0
: 238 Minimum Test error found - save the configuration
: 238 | 3497.73 3215.25 0.00488201 0.000497551 182463 0
: 239 Minimum Test error found - save the configuration
: 239 | 3466.14 3185.91 0.00549592 0.000653952 165222 0
: 240 Minimum Test error found - save the configuration
: 240 | 3435.07 3155.05 0.00498101 0.000617111 183322 0
: 241 Minimum Test error found - save the configuration
: 241 | 3403.17 3126.17 0.00466967 0.000498051 191772 0
: 242 Minimum Test error found - save the configuration
: 242 | 3373.3 3095.9 0.00448938 0.000514411 201259 0
: 243 Minimum Test error found - save the configuration
: 243 | 3341.44 3067.73 0.00532539 0.000524951 166651 0
: 244 Minimum Test error found - save the configuration
: 244 | 3311.55 3039.6 0.00453105 0.00050384 198649 0
: 245 Minimum Test error found - save the configuration
: 245 | 3281.56 3011.4 0.00473927 0.000528181 189975 0
: 246 Minimum Test error found - save the configuration
: 246 | 3251.37 2983.67 0.00533895 0.000503551 165446 0
: 247 Minimum Test error found - save the configuration
: 247 | 3221.97 2956.51 0.00534318 0.000599231 168636 0
: 248 Minimum Test error found - save the configuration
: 248 | 3192.86 2928.71 0.00459948 0.000484632 194418 0
: 249 Minimum Test error found - save the configuration
: 249 | 3163.61 2902.05 0.00448092 0.000496701 200792 0
: 250 Minimum Test error found - save the configuration
: 250 | 3135.72 2874.14 0.00459526 0.000512062 195925 0
: 251 Minimum Test error found - save the configuration
: 251 | 3106.6 2847.81 0.00451297 0.000514921 200098 0
: 252 Minimum Test error found - save the configuration
: 252 | 3078.29 2822.33 0.00466762 0.000604291 196883 0
: 253 Minimum Test error found - save the configuration
: 253 | 3051.35 2795.45 0.00473869 0.00049608 188563 0
: 254 Minimum Test error found - save the configuration
: 254 | 3023.47 2770.06 0.00471578 0.000497512 189651 0
: 255 Minimum Test error found - save the configuration
: 255 | 2995.92 2744.52 0.00450151 0.000497801 199815 0
: 256 Minimum Test error found - save the configuration
: 256 | 2968.9 2718.34 0.00442385 0.000527992 205346 0
: 257 Minimum Test error found - save the configuration
: 257 | 2941.45 2693.36 0.00452218 0.000513932 199588 0
: 258 Minimum Test error found - save the configuration
: 258 | 2915.12 2668.1 0.00469978 0.00049659 190332 0
: 259 Minimum Test error found - save the configuration
: 259 | 2888.61 2643.22 0.00439732 0.000493701 204938 0
: 260 Minimum Test error found - save the configuration
: 260 | 2862.41 2619.12 0.00466341 0.000493831 191866 0
: 261 Minimum Test error found - save the configuration
: 261 | 2836.71 2594.12 0.00438604 0.000489651 205318 0
: 262 Minimum Test error found - save the configuration
: 262 | 2810.58 2570.35 0.00441105 0.000487131 203878 0
: 263 Minimum Test error found - save the configuration
: 263 | 2785.08 2546.88 0.00438556 0.000483572 205024 0
: 264 Minimum Test error found - save the configuration
: 264 | 2760.12 2523.51 0.00440038 0.000506221 205436 0
: 265 Minimum Test error found - save the configuration
: 265 | 2734.78 2500.79 0.00441687 0.00048154 203287 0
: 266 Minimum Test error found - save the configuration
: 266 | 2710.87 2477.06 0.00486339 0.000511581 183832 0
: 267 Minimum Test error found - save the configuration
: 267 | 2685.92 2454.42 0.0045781 0.00052577 197417 0
: 268 Minimum Test error found - save the configuration
: 268 | 2661.47 2431.99 0.00480219 0.000557772 188483 0
: 269 Minimum Test error found - save the configuration
: 269 | 2637.29 2409.76 0.0049993 0.000589991 181434 0
: 270 Minimum Test error found - save the configuration
: 270 | 2613.48 2387.51 0.00484371 0.000609521 188938 0
: 271 Minimum Test error found - save the configuration
: 271 | 2590.54 2364.98 0.00500243 0.000525141 178680 0
: 272 Minimum Test error found - save the configuration
: 272 | 2567.03 2343 0.00473699 0.000536691 190463 0
: 273 Minimum Test error found - save the configuration
: 273 | 2543.35 2322.57 0.00443919 0.00049523 202842 0
: 274 Minimum Test error found - save the configuration
: 274 | 2520.14 2300.77 0.00439238 0.000478051 204377 0
: 275 Minimum Test error found - save the configuration
: 275 | 2497.32 2279.25 0.0044484 0.000490281 202116 0
: 276 Minimum Test error found - save the configuration
: 276 | 2474.57 2258.38 0.00451177 0.000481711 198508 0
: 277 Minimum Test error found - save the configuration
: 277 | 2452.36 2237.68 0.00479977 0.000527181 187240 0
: 278 Minimum Test error found - save the configuration
: 278 | 2429.59 2216.99 0.00467724 0.000523632 192604 0
: 279 Minimum Test error found - save the configuration
: 279 | 2407.94 2196.5 0.00482912 0.00068042 192832 0
: 280 Minimum Test error found - save the configuration
: 280 | 2385.78 2176.65 0.00482451 0.000503821 185156 0
: 281 Minimum Test error found - save the configuration
: 281 | 2364.24 2156.54 0.00476042 0.000536832 189412 0
: 282 Minimum Test error found - save the configuration
: 282 | 2342.81 2136.56 0.00457134 0.000525111 197715 0
: 283 Minimum Test error found - save the configuration
: 283 | 2320.92 2117.34 0.0044875 0.000490071 200129 0
: 284 Minimum Test error found - save the configuration
: 284 | 2299.98 2097.85 0.00460273 0.000645121 202142 0
: 285 Minimum Test error found - save the configuration
: 285 | 2279.09 2078.79 0.00443669 0.000491351 202771 0
: 286 Minimum Test error found - save the configuration
: 286 | 2258.09 2059.93 0.00450388 0.000504632 200038 0
: 287 Minimum Test error found - save the configuration
: 287 | 2237.49 2040.73 0.00446144 0.000505442 202225 0
: 288 Minimum Test error found - save the configuration
: 288 | 2217.17 2021.39 0.00521793 0.000564751 171925 0
: 289 Minimum Test error found - save the configuration
: 289 | 2196.29 2003.02 0.0045583 0.000510121 197620 0
: 290 Minimum Test error found - save the configuration
: 290 | 2176.37 1985.16 0.0046226 0.000525761 195273 0
: 291 Minimum Test error found - save the configuration
: 291 | 2156.33 1966.99 0.00449019 0.000496961 200339 0
: 292 Minimum Test error found - save the configuration
: 292 | 2136.31 1948.78 0.00457134 0.000509511 196956 0
: 293 Minimum Test error found - save the configuration
: 293 | 2116.99 1930.54 0.00514485 0.000576421 175115 0
: 294 Minimum Test error found - save the configuration
: 294 | 2097.18 1912.94 0.005346 0.000535852 166315 0
: 295 Minimum Test error found - save the configuration
: 295 | 2077.83 1895.3 0.00490266 0.000537111 183253 0
: 296 Minimum Test error found - save the configuration
: 296 | 2058.35 1878.85 0.00470791 0.000525652 191284 0
: 297 Minimum Test error found - save the configuration
: 297 | 2040.13 1860.6 0.00487095 0.000518271 183795 0
: 298 Minimum Test error found - save the configuration
: 298 | 2020.94 1843.32 0.00455871 0.000489772 196611 0
: 299 Minimum Test error found - save the configuration
: 299 | 2002.02 1826.64 0.00460325 0.00052547 196185 0
: 300 Minimum Test error found - save the configuration
: 300 | 1983.48 1810.05 0.00466782 0.000549891 194272 0
: 301 Minimum Test error found - save the configuration
: 301 | 1964.81 1793.62 0.00459279 0.000512041 196042 0
: 302 Minimum Test error found - save the configuration
: 302 | 1946.8 1777.31 0.00478581 0.000544662 188628 0
: 303 Minimum Test error found - save the configuration
: 303 | 1928.79 1761.31 0.0045833 0.000499221 195883 0
: 304 Minimum Test error found - save the configuration
: 304 | 1910.46 1745.32 0.00452241 0.000492221 198502 0
: 305 Minimum Test error found - save the configuration
: 305 | 1892.96 1729.06 0.00453046 0.000551822 201074 0
: 306 Minimum Test error found - save the configuration
: 306 | 1875.4 1712.76 0.00463404 0.000494272 193247 0
: 307 Minimum Test error found - save the configuration
: 307 | 1857.78 1697.04 0.00455248 0.000569132 200836 0
: 308 Minimum Test error found - save the configuration
: 308 | 1839.89 1681.65 0.004634 0.000535311 195184 0
: 309 Minimum Test error found - save the configuration
: 309 | 1823.14 1666.14 0.00461101 0.000558471 197407 0
: 310 Minimum Test error found - save the configuration
: 310 | 1805.77 1651.1 0.00453351 0.00050342 198507 0
: 311 Minimum Test error found - save the configuration
: 311 | 1788.46 1636.34 0.00471603 0.000495192 189536 0
: 312 Minimum Test error found - save the configuration
: 312 | 1772.22 1621.14 0.00451736 0.000506612 199464 0
: 313 Minimum Test error found - save the configuration
: 313 | 1755.72 1606.53 0.00453177 0.000523551 199590 0
: 314 Minimum Test error found - save the configuration
: 314 | 1738.49 1591.8 0.00452265 0.000498261 198788 0
: 315 Minimum Test error found - save the configuration
: 315 | 1722.46 1576.96 0.0047555 0.000536881 189636 0
: 316 Minimum Test error found - save the configuration
: 316 | 1706.18 1562.32 0.00469244 0.000538241 192576 0
: 317 Minimum Test error found - save the configuration
: 317 | 1689.41 1549.04 0.00460343 0.000503671 195133 0
: 318 Minimum Test error found - save the configuration
: 318 | 1673.95 1534.45 0.00455481 0.000504061 197494 0
: 319 Minimum Test error found - save the configuration
: 319 | 1658.06 1520.42 0.00507528 0.000713402 183407 0
: 320 Minimum Test error found - save the configuration
: 320 | 1642.09 1506.49 0.00512441 0.000505561 173203 0
: 321 Minimum Test error found - save the configuration
: 321 | 1626.91 1492.45 0.00444726 0.000485501 201931 0
: 322 Minimum Test error found - save the configuration
: 322 | 1611.34 1478.89 0.00501005 0.000503099 177504 0
: 323 Minimum Test error found - save the configuration
: 323 | 1595.76 1465.01 0.00476868 0.000508041 187765 0
: 324 Minimum Test error found - save the configuration
: 324 | 1580.53 1451.71 0.00494708 0.000515211 180511 0
: 325 Minimum Test error found - save the configuration
: 325 | 1566.1 1438.17 0.00453252 0.000536222 200185 0
: 326 Minimum Test error found - save the configuration
: 326 | 1549.94 1425.49 0.00446729 0.000483892 200834 0
: 327 Minimum Test error found - save the configuration
: 327 | 1535.83 1412.5 0.00470742 0.00056761 193246 0
: 328 Minimum Test error found - save the configuration
: 328 | 1521.26 1399.32 0.00508573 0.000585121 177754 0
: 329 Minimum Test error found - save the configuration
: 329 | 1506.5 1386.3 0.00464541 0.000525902 194198 0
: 330 Minimum Test error found - save the configuration
: 330 | 1492.06 1373.52 0.00457645 0.000487941 195670 0
: 331 Minimum Test error found - save the configuration
: 331 | 1477.66 1360.77 0.00465551 0.000501741 192596 0
: 332 Minimum Test error found - save the configuration
: 332 | 1463.52 1348.21 0.00493493 0.000594591 184317 0
: 333 Minimum Test error found - save the configuration
: 333 | 1449.45 1336.09 0.00467498 0.000641111 198321 0
: 334 Minimum Test error found - save the configuration
: 334 | 1436.02 1323.09 0.00461286 0.000505921 194792 0
: 335 Minimum Test error found - save the configuration
: 335 | 1421.59 1311.27 0.004659 0.000513391 192975 0
: 336 Minimum Test error found - save the configuration
: 336 | 1408.15 1299.12 0.00453894 0.000498792 198013 0
: 337 Minimum Test error found - save the configuration
: 337 | 1394.81 1287.16 0.00464657 0.00049456 192678 0
: 338 Minimum Test error found - save the configuration
: 338 | 1381.06 1275.45 0.00466696 0.000522421 193025 0
: 339 Minimum Test error found - save the configuration
: 339 | 1368.13 1263.05 0.00538069 0.000548231 165547 0
: 340 Minimum Test error found - save the configuration
: 340 | 1355.19 1251.59 0.00488147 0.000701651 191396 0
: 341 Minimum Test error found - save the configuration
: 341 | 1341.65 1239.75 0.00526382 0.000657562 173677 0
: 342 Minimum Test error found - save the configuration
: 342 | 1328.49 1229.04 0.00624586 0.000709633 144503 0
: 343 Minimum Test error found - save the configuration
: 343 | 1316.06 1217.21 0.00575386 0.000494041 152096 0
: 344 Minimum Test error found - save the configuration
: 344 | 1303.45 1205.89 0.0046204 0.000605762 199271 0
: 345 Minimum Test error found - save the configuration
: 345 | 1290.76 1194.52 0.00495695 0.000612521 184144 0
: 346 Minimum Test error found - save the configuration
: 346 | 1278.03 1183.69 0.00463539 0.00049585 193258 0
: 347 Minimum Test error found - save the configuration
: 347 | 1266.13 1172.27 0.00458461 0.000530572 197334 0
: 348 Minimum Test error found - save the configuration
: 348 | 1253.79 1161.43 0.00462919 0.000557791 196493 0
: 349 Minimum Test error found - save the configuration
: 349 | 1241.63 1150.53 0.00466222 0.000489661 191729 0
: 350 Minimum Test error found - save the configuration
: 350 | 1229.38 1140.01 0.00450506 0.000499461 199720 0
: 351 Minimum Test error found - save the configuration
: 351 | 1218.12 1129.1 0.00438337 0.000488871 205418 0
: 352 Minimum Test error found - save the configuration
: 352 | 1205.79 1118.68 0.00451632 0.000515511 199960 0
: 353 Minimum Test error found - save the configuration
: 353 | 1194.51 1107.44 0.00464205 0.000497471 193023 0
: 354 Minimum Test error found - save the configuration
: 354 | 1182.55 1097.38 0.00484419 0.00055245 186405 0
: 355 Minimum Test error found - save the configuration
: 355 | 1171.74 1086.81 0.00489064 0.000490212 181800 0
: 356 Minimum Test error found - save the configuration
: 356 | 1159.71 1076.54 0.00481449 0.000505321 185651 0
: 357 Minimum Test error found - save the configuration
: 357 | 1148.61 1066.59 0.00488742 0.000513152 182888 0
: 358 Minimum Test error found - save the configuration
: 358 | 1137.3 1056.89 0.00476202 0.000521512 188657 0
: 359 Minimum Test error found - save the configuration
: 359 | 1126.56 1046.58 0.00455913 0.000513961 197767 0
: 360 Minimum Test error found - save the configuration
: 360 | 1115.38 1036.51 0.0046144 0.000606871 199624 0
: 361 Minimum Test error found - save the configuration
: 361 | 1104.92 1027.14 0.00464455 0.000510381 193509 0
: 362 Minimum Test error found - save the configuration
: 362 | 1093.76 1017.42 0.00455934 0.000490011 196593 0
: 363 Minimum Test error found - save the configuration
: 363 | 1083.57 1007.48 0.0044189 0.000495211 203890 0
: 364 Minimum Test error found - save the configuration
: 364 | 1072.39 998.631 0.0044191 0.000491252 203674 0
: 365 Minimum Test error found - save the configuration
: 365 | 1062.45 988.067 0.00436536 0.000477231 205755 0
: 366 Minimum Test error found - save the configuration
: 366 | 1051.51 979.205 0.0044033 0.000497061 204801 0
: 367 Minimum Test error found - save the configuration
: 367 | 1041.52 969.59 0.00449631 0.000488571 199614 0
: 368 Minimum Test error found - save the configuration
: 368 | 1031.07 960.458 0.00445869 0.000503881 202285 0
: 369 Minimum Test error found - save the configuration
: 369 | 1021.4 950.957 0.00453628 0.000540001 200186 0
: 370 Minimum Test error found - save the configuration
: 370 | 1011.15 941.977 0.00506681 0.000501501 175235 0
: 371 Minimum Test error found - save the configuration
: 371 | 1001.11 933.462 0.00446011 0.000499711 202000 0
: 372 Minimum Test error found - save the configuration
: 372 | 991.56 924.398 0.00460493 0.000557801 197671 0
: 373 Minimum Test error found - save the configuration
: 373 | 982.446 914.833 0.00462666 0.000488041 193301 0
: 374 Minimum Test error found - save the configuration
: 374 | 972.027 906.24 0.00447241 0.000493571 201064 0
: 375 Minimum Test error found - save the configuration
: 375 | 962.644 897.702 0.00439188 0.00048254 204638 0
: 376 Minimum Test error found - save the configuration
: 376 | 953.008 889.047 0.00474852 0.000679521 196609 0
: 377 Minimum Test error found - save the configuration
: 377 | 944.074 880.263 0.00461013 0.000494651 194388 0
: 378 Minimum Test error found - save the configuration
: 378 | 934.368 872.085 0.00445227 0.000507141 202782 0
: 379 Minimum Test error found - save the configuration
: 379 | 925.17 863.663 0.00474363 0.000563561 191384 0
: 380 Minimum Test error found - save the configuration
: 380 | 916.173 855.023 0.00526176 0.000537342 169333 0
: 381 Minimum Test error found - save the configuration
: 381 | 906.884 847.221 0.00461256 0.000517602 195362 0
: 382 Minimum Test error found - save the configuration
: 382 | 898.671 838.002 0.00537869 0.000723842 171864 0
: 383 Minimum Test error found - save the configuration
: 383 | 888.987 830.103 0.00635972 0.000716471 141762 0
: 384 Minimum Test error found - save the configuration
: 384 | 880.115 822.132 0.00640886 0.000729351 140857 0
: 385 Minimum Test error found - save the configuration
: 385 | 871.648 814.145 0.00646073 0.000738742 139811 0
: 386 Minimum Test error found - save the configuration
: 386 | 862.85 806.46 0.00632553 0.000726051 142870 0
: 387 Minimum Test error found - save the configuration
: 387 | 854.722 798.212 0.00643535 0.000751741 140756 0
: 388 Minimum Test error found - save the configuration
: 388 | 846.113 790.652 0.00599045 0.000657702 150016 0
: 389 Minimum Test error found - save the configuration
: 389 | 837.519 782.35 0.00474297 0.000519622 189423 0
: 390 Minimum Test error found - save the configuration
: 390 | 829.13 775.109 0.00446344 0.000491171 201396 0
: 391 Minimum Test error found - save the configuration
: 391 | 821.123 767.469 0.00463099 0.000513221 194280 0
: 392 Minimum Test error found - save the configuration
: 392 | 812.797 759.459 0.00441293 0.000478141 203315 0
: 393 Minimum Test error found - save the configuration
: 393 | 804.856 751.87 0.00443082 0.000500201 203530 0
: 394 Minimum Test error found - save the configuration
: 394 | 796.493 744.649 0.00439137 0.000482811 204679 0
: 395 Minimum Test error found - save the configuration
: 395 | 788.786 737.089 0.00440318 0.000482831 204063 0
: 396 Minimum Test error found - save the configuration
: 396 | 780.796 730.206 0.00437579 0.000488591 205804 0
: 397 Minimum Test error found - save the configuration
: 397 | 773.038 722.629 0.00449158 0.000486871 199765 0
: 398 Minimum Test error found - save the configuration
: 398 | 765.176 715.602 0.00454284 0.000507101 198229 0
: 399 Minimum Test error found - save the configuration
: 399 | 757.541 708.058 0.00473266 0.000523721 190072 0
: 400 Minimum Test error found - save the configuration
: 400 | 750.153 701.082 0.00454813 0.000511182 198170 0
: 401 Minimum Test error found - save the configuration
: 401 | 742.296 693.97 0.00469318 0.000529841 192154 0
: 402 Minimum Test error found - save the configuration
: 402 | 735.007 687.383 0.00482159 0.000568491 188098 0
: 403 Minimum Test error found - save the configuration
: 403 | 727.597 679.875 0.00469686 0.000547502 192801 0
: 404 Minimum Test error found - save the configuration
: 404 | 720.252 672.829 0.00483261 0.000494361 184406 0
: 405 Minimum Test error found - save the configuration
: 405 | 712.711 666.831 0.00476608 0.000514681 188173 0
: 406 Minimum Test error found - save the configuration
: 406 | 706.004 659.374 0.00543565 0.000609462 165762 0
: 407 Minimum Test error found - save the configuration
: 407 | 698.392 652.858 0.00527362 0.000594801 170983 0
: 408 Minimum Test error found - save the configuration
: 408 | 691.369 646.48 0.00452386 0.000488441 198245 0
: 409 Minimum Test error found - save the configuration
: 409 | 684.948 640.215 0.00487646 0.000552751 185026 0
: 410 Minimum Test error found - save the configuration
: 410 | 677.902 632.801 0.00484752 0.000525771 185110 0
: 411 Minimum Test error found - save the configuration
: 411 | 670.587 626.539 0.00529403 0.000509072 167191 0
: 412 Minimum Test error found - save the configuration
: 412 | 663.778 620.225 0.00450526 0.000512401 200358 0
: 413 Minimum Test error found - save the configuration
: 413 | 657.01 614.434 0.00491287 0.000503411 181428 0
: 414 Minimum Test error found - save the configuration
: 414 | 650.625 607.506 0.00445486 0.000475572 201041 0
: 415 Minimum Test error found - save the configuration
: 415 | 643.659 601.563 0.00443793 0.000495101 202900 0
: 416 Minimum Test error found - save the configuration
: 416 | 637.296 596.207 0.00504368 0.000680742 183363 0
: 417 Minimum Test error found - save the configuration
: 417 | 631.191 589.37 0.00620416 0.000535931 141138 0
: 418 Minimum Test error found - save the configuration
: 418 | 624.444 582.482 0.00552258 0.00050842 159548 0
: 419 Minimum Test error found - save the configuration
: 419 | 617.676 576.64 0.00555797 0.000688401 164286 0
: 420 Minimum Test error found - save the configuration
: 420 | 611.494 570.518 0.0045045 0.000507821 200166 0
: 421 Minimum Test error found - save the configuration
: 421 | 605.206 565.68 0.00461799 0.000485191 193573 0
: 422 Minimum Test error found - save the configuration
: 422 | 599.509 558.839 0.00453224 0.000601892 203544 0
: 423 Minimum Test error found - save the configuration
: 423 | 592.88 553.013 0.0053115 0.000495191 166102 0
: 424 Minimum Test error found - save the configuration
: 424 | 586.74 547.235 0.00494373 0.000692271 188171 0
: 425 Minimum Test error found - save the configuration
: 425 | 580.98 541.311 0.00538278 0.000497751 163766 0
: 426 Minimum Test error found - save the configuration
: 426 | 574.586 536.015 0.00467203 0.000495091 191528 0
: 427 Minimum Test error found - save the configuration
: 427 | 569.321 530.005 0.00504201 0.000521641 176977 0
: 428 Minimum Test error found - save the configuration
: 428 | 562.836 524.486 0.0052285 0.000701522 176718 0
: 429 Minimum Test error found - save the configuration
: 429 | 557.207 519.003 0.00570916 0.000485332 153144 0
: 430 Minimum Test error found - save the configuration
: 430 | 551.248 513.648 0.00552276 0.000712611 166315 0
: 431 Minimum Test error found - save the configuration
: 431 | 545.633 508.222 0.0063401 0.000720242 142352 0
: 432 Minimum Test error found - save the configuration
: 432 | 539.996 502.941 0.00590391 0.000622341 151470 0
: 433 Minimum Test error found - save the configuration
: 433 | 534.589 497.236 0.00552343 0.000712491 166288 0
: 434 Minimum Test error found - save the configuration
: 434 | 528.997 492.028 0.00474237 0.000488142 188048 0
: 435 Minimum Test error found - save the configuration
: 435 | 523.413 486.787 0.00503748 0.00067534 183396 0
: 436 Minimum Test error found - save the configuration
: 436 | 517.888 481.755 0.00580348 0.000651971 155294 0
: 437 Minimum Test error found - save the configuration
: 437 | 512.493 476.735 0.00536187 0.000633631 169196 0
: 438 Minimum Test error found - save the configuration
: 438 | 507.423 471.394 0.00518848 0.000533332 171853 0
: 439 Minimum Test error found - save the configuration
: 439 | 502.051 466.666 0.00541826 0.00055086 164359 0
: 440 Minimum Test error found - save the configuration
: 440 | 496.818 461.435 0.00609299 0.000697431 148270 0
: 441 Minimum Test error found - save the configuration
: 441 | 491.683 456.534 0.00466467 0.000558201 194815 0
: 442 Minimum Test error found - save the configuration
: 442 | 486.557 451.355 0.00502008 0.000505092 177188 0
: 443 Minimum Test error found - save the configuration
: 443 | 481.287 446.82 0.00462029 0.000531601 195662 0
: 444 Minimum Test error found - save the configuration
: 444 | 476.396 441.979 0.00546722 0.000702421 167898 0
: 445 Minimum Test error found - save the configuration
: 445 | 471.721 437.124 0.00519697 0.000515261 170878 0
: 446 Minimum Test error found - save the configuration
: 446 | 466.471 432.347 0.00457509 0.000505752 196592 0
: 447 Minimum Test error found - save the configuration
: 447 | 461.743 427.358 0.00488869 0.000533481 183688 0
: 448 Minimum Test error found - save the configuration
: 448 | 456.728 423.279 0.00456253 0.000513031 197555 0
: 449 Minimum Test error found - save the configuration
: 449 | 452.232 418.51 0.00507427 0.000569401 177586 0
: 450 Minimum Test error found - save the configuration
: 450 | 447.373 413.884 0.0054098 0.0005715 165347 0
: 451 Minimum Test error found - save the configuration
: 451 | 442.552 409.958 0.00618376 0.000718831 146388 0
: 452 Minimum Test error found - save the configuration
: 452 | 438.936 405.218 0.00554446 0.000529712 159529 0
: 453 Minimum Test error found - save the configuration
: 453 | 433.594 400.483 0.0048364 0.000491652 184130 0
: 454 Minimum Test error found - save the configuration
: 454 | 429.009 395.884 0.00472915 0.000648562 196050 0
: 455 Minimum Test error found - save the configuration
: 455 | 424.309 391.484 0.00468499 0.000537821 192903 0
: 456 Minimum Test error found - save the configuration
: 456 | 419.786 387.464 0.00482139 0.000543142 186992 0
: 457 Minimum Test error found - save the configuration
: 457 | 415.482 383.045 0.00528272 0.000589721 170467 0
: 458 Minimum Test error found - save the configuration
: 458 | 410.963 378.626 0.00533436 0.000571561 167968 0
: 459 Minimum Test error found - save the configuration
: 459 | 406.672 374.612 0.00497281 0.000629001 184170 0
: 460 Minimum Test error found - save the configuration
: 460 | 402.446 371.118 0.00463104 0.000498311 193577 0
: 461 Minimum Test error found - save the configuration
: 461 | 398.396 366.348 0.00550096 0.000710841 167010 0
: 462 Minimum Test error found - save the configuration
: 462 | 393.764 362.994 0.00527785 0.000618521 171698 0
: 463 Minimum Test error found - save the configuration
: 463 | 389.621 358.294 0.00483851 0.000553432 186694 0
: 464 Minimum Test error found - save the configuration
: 464 | 385.574 354.328 0.00458233 0.000500102 195971 0
: 465 Minimum Test error found - save the configuration
: 465 | 381.577 350.594 0.00442843 0.000497991 203540 0
: 466 Minimum Test error found - save the configuration
: 466 | 377.488 347.359 0.00527408 0.000645711 172847 0
: 467 Minimum Test error found - save the configuration
: 467 | 373.838 342.575 0.0058106 0.000705721 156713 0
: 468 Minimum Test error found - save the configuration
: 468 | 369.392 339.17 0.00638819 0.000755742 142034 0
: 469 Minimum Test error found - save the configuration
: 469 | 365.552 335.194 0.00629787 0.000675081 142278 0
: 470 Minimum Test error found - save the configuration
: 470 | 361.743 331.233 0.004724 0.000563871 192302 0
: 471 Minimum Test error found - save the configuration
: 471 | 357.994 327.287 0.00501221 0.000571252 180141 0
: 472 Minimum Test error found - save the configuration
: 472 | 353.878 323.676 0.00579532 0.000749632 158551 0
: 473 Minimum Test error found - save the configuration
: 473 | 350.336 319.92 0.00597417 0.000586871 148497 0
: 474 Minimum Test error found - save the configuration
: 474 | 346.601 316.614 0.005891 0.000721183 154744 0
: 475 Minimum Test error found - save the configuration
: 475 | 342.64 312.896 0.00524989 0.000586731 171558 0
: 476 Minimum Test error found - save the configuration
: 476 | 339.328 309.469 0.00576269 0.000610551 155275 0
: 477 Minimum Test error found - save the configuration
: 477 | 335.612 305.808 0.00518633 0.000709871 178713 0
: 478 Minimum Test error found - save the configuration
: 478 | 331.838 302.259 0.00525904 0.000590121 171346 0
: 479 Minimum Test error found - save the configuration
: 479 | 328.278 299.179 0.00575375 0.000752912 159973 0
: 480 Minimum Test error found - save the configuration
: 480 | 325.08 295.409 0.00600946 0.0005254 145877 0
: 481 Minimum Test error found - save the configuration
: 481 | 321.178 292.072 0.00492935 0.000551491 182738 0
: 482 Minimum Test error found - save the configuration
: 482 | 317.75 289.303 0.00598252 0.000734162 152429 0
: 483 Minimum Test error found - save the configuration
: 483 | 314.569 285.504 0.00556491 0.000538241 159151 0
: 484 Minimum Test error found - save the configuration
: 484 | 310.976 282.617 0.00471612 0.00051944 190627 0
: 485 Minimum Test error found - save the configuration
: 485 | 307.749 279.474 0.00463263 0.000517401 194400 0
: 486 Minimum Test error found - save the configuration
: 486 | 304.508 275.866 0.00469152 0.000551022 193213 0
: 487 Minimum Test error found - save the configuration
: 487 | 300.85 273.05 0.00464059 0.000640912 200016 0
: 488 Minimum Test error found - save the configuration
: 488 | 297.809 269.316 0.00496115 0.000515372 179946 0
: 489 Minimum Test error found - save the configuration
: 489 | 294.218 266.488 0.00451222 0.000521491 200465 0
: 490 Minimum Test error found - save the configuration
: 490 | 291.183 263.436 0.00450304 0.000507951 200246 0
: 491 Minimum Test error found - save the configuration
: 491 | 288.027 260.584 0.00448581 0.000525011 201980 0
: 492 Minimum Test error found - save the configuration
: 492 | 284.929 257.811 0.0045048 0.000492902 199407 0
: 493 Minimum Test error found - save the configuration
: 493 | 281.876 254.405 0.00447469 0.000500191 201283 0
: 494 Minimum Test error found - save the configuration
: 494 | 278.786 251.59 0.00456078 0.000505161 197257 0
: 495 Minimum Test error found - save the configuration
: 495 | 275.826 248.558 0.00464308 0.000522001 194124 0
: 496 Minimum Test error found - save the configuration
: 496 | 272.794 245.913 0.0045917 0.000531222 197021 0
: 497 Minimum Test error found - save the configuration
: 497 | 269.871 242.989 0.00480129 0.000662642 193300 0
: 498 Minimum Test error found - save the configuration
: 498 | 266.797 239.937 0.004746 0.000613341 193580 0
: 499 Minimum Test error found - save the configuration
: 499 | 264.003 237.431 0.00495522 0.000493122 179288 0
: 500 Minimum Test error found - save the configuration
: 500 | 261.243 234.616 0.00448341 0.000517671 201728 0
: 501 Minimum Test error found - save the configuration
: 501 | 258.159 231.774 0.00454194 0.000508341 198334 0
: 502 Minimum Test error found - save the configuration
: 502 | 255.405 229.023 0.00501276 0.00049981 177268 0
: 503 Minimum Test error found - save the configuration
: 503 | 252.596 226.408 0.0046023 0.000532292 196560 0
: 504 Minimum Test error found - save the configuration
: 504 | 249.815 223.747 0.00512052 0.000544121 174810 0
: 505 Minimum Test error found - save the configuration
: 505 | 247.14 221.41 0.00588592 0.000731181 155197 0
: 506 Minimum Test error found - save the configuration
: 506 | 244.328 219.394 0.00512576 0.000499161 172913 0
: 507 Minimum Test error found - save the configuration
: 507 | 241.859 215.843 0.00544908 0.000733322 169644 0
: 508 Minimum Test error found - save the configuration
: 508 | 239.153 213.438 0.00636693 0.000734232 142028 0
: 509 Minimum Test error found - save the configuration
: 509 | 236.321 210.872 0.00638269 0.000716321 141184 0
: 510 Minimum Test error found - save the configuration
: 510 | 233.687 208.607 0.00555659 0.000676632 163936 0
: 511 Minimum Test error found - save the configuration
: 511 | 231.326 206.026 0.00517667 0.000602311 174888 0
: 512 Minimum Test error found - save the configuration
: 512 | 228.827 203.996 0.00534503 0.000543021 166597 0
: 513 Minimum Test error found - save the configuration
: 513 | 226.25 201.691 0.00453591 0.000518422 199129 0
: 514 Minimum Test error found - save the configuration
: 514 | 223.963 200.027 0.00463825 0.000574432 196859 0
: 515 Minimum Test error found - save the configuration
: 515 | 221.372 196.81 0.00453607 0.00049176 197809 0
: 516 Minimum Test error found - save the configuration
: 516 | 218.957 195.276 0.00452773 0.00051052 199143 0
: 517 Minimum Test error found - save the configuration
: 517 | 216.317 192.223 0.00443733 0.000486982 202514 0
: 518 Minimum Test error found - save the configuration
: 518 | 213.906 190.004 0.00461597 0.00050494 194598 0
: 519 Minimum Test error found - save the configuration
: 519 | 211.482 187.599 0.00446547 0.000490161 201242 0
: 520 Minimum Test error found - save the configuration
: 520 | 209.276 185.409 0.00475423 0.000500842 188085 0
: 521 Minimum Test error found - save the configuration
: 521 | 206.835 182.948 0.00494785 0.000589962 183575 0
: 522 Minimum Test error found - save the configuration
: 522 | 204.747 180.837 0.00505853 0.00048984 175105 0
: 523 Minimum Test error found - save the configuration
: 523 | 202.661 178.476 0.00444499 0.000500642 202822 0
: 524 Minimum Test error found - save the configuration
: 524 | 200.263 176.703 0.00444653 0.000476181 201494 0
: 525 Minimum Test error found - save the configuration
: 525 | 198.008 174.258 0.00445074 0.000503431 202670 0
: 526 Minimum Test error found - save the configuration
: 526 | 195.919 173.8 0.00441637 0.00048627 203557 0
: 527 Minimum Test error found - save the configuration
: 527 | 193.767 170.601 0.00438898 0.000474731 204381 0
: 528 Minimum Test error found - save the configuration
: 528 | 191.797 168.884 0.0044361 0.000492621 202867 0
: 529 Minimum Test error found - save the configuration
: 529 | 189.15 166.767 0.00451903 0.000570782 202622 0
: 530 Minimum Test error found - save the configuration
: 530 | 187.135 164.248 0.00459292 0.000510811 195977 0
: 531 Minimum Test error found - save the configuration
: 531 | 185.12 162.858 0.00449309 0.00055283 203032 0
: 532 Minimum Test error found - save the configuration
: 532 | 182.948 161.41 0.00469885 0.000545502 192616 0
: 533 Minimum Test error found - save the configuration
: 533 | 180.771 158.422 0.00466188 0.000518231 193067 0
: 534 Minimum Test error found - save the configuration
: 534 | 178.727 157.129 0.00445556 0.000479111 201185 0
: 535 Minimum Test error found - save the configuration
: 535 | 176.716 154.946 0.00457696 0.000530411 197699 0
: 536 Minimum Test error found - save the configuration
: 536 | 174.797 153.348 0.00438853 0.000479571 204658 0
: 537 Minimum Test error found - save the configuration
: 537 | 172.613 151.859 0.0044984 0.000502922 200226 0
: 538 Minimum Test error found - save the configuration
: 538 | 170.812 150.319 0.00465214 0.000527501 193956 0
: 539 Minimum Test error found - save the configuration
: 539 | 168.782 147.657 0.00481561 0.00050847 185738 0
: 540 Minimum Test error found - save the configuration
: 540 | 166.818 145.959 0.0044529 0.000495772 202167 0
: 541 Minimum Test error found - save the configuration
: 541 | 164.8 144.023 0.00459281 0.000555561 198155 0
: 542 Minimum Test error found - save the configuration
: 542 | 163.055 142.511 0.00506545 0.000541192 176825 0
: 543 Minimum Test error found - save the configuration
: 543 | 161.105 140.366 0.00463645 0.000559622 196231 0
: 544 Minimum Test error found - save the configuration
: 544 | 159.326 138.683 0.00471187 0.000539211 191724 0
: 545 Minimum Test error found - save the configuration
: 545 | 157.757 137.254 0.00459361 0.00052519 196637 0
: 546 Minimum Test error found - save the configuration
: 546 | 155.63 135.749 0.00460623 0.000517522 195661 0
: 547 Minimum Test error found - save the configuration
: 547 | 153.871 134.309 0.0049913 0.000716771 187155 0
: 548 Minimum Test error found - save the configuration
: 548 | 152.082 132.998 0.00465708 0.000505032 192676 0
: 549 Minimum Test error found - save the configuration
: 549 | 150.271 131.158 0.00453069 0.000489492 197961 0
: 550 Minimum Test error found - save the configuration
: 550 | 148.405 129.293 0.00465735 0.000605291 197431 0
: 551 Minimum Test error found - save the configuration
: 551 | 146.889 127.767 0.00514654 0.000581791 175256 0
: 552 Minimum Test error found - save the configuration
: 552 | 145.237 126.045 0.00498178 0.000537971 180026 0
: 553 Minimum Test error found - save the configuration
: 553 | 143.135 124.567 0.00472711 0.000527951 190514 0
: 554 Minimum Test error found - save the configuration
: 554 | 141.506 123.138 0.00485793 0.000578671 186948 0
: 555 Minimum Test error found - save the configuration
: 555 | 140.152 122.698 0.00457561 0.000517601 197141 0
: 556 Minimum Test error found - save the configuration
: 556 | 138.523 120.965 0.00469146 0.000523192 191926 0
: 557 Minimum Test error found - save the configuration
: 557 | 136.691 118.819 0.0047286 0.000507181 189510 0
: 558 Minimum Test error found - save the configuration
: 558 | 134.811 117.224 0.00493899 0.000643472 186241 0
: 559 Minimum Test error found - save the configuration
: 559 | 133.744 115.896 0.0047357 0.000505831 189131 0
: 560 Minimum Test error found - save the configuration
: 560 | 131.825 114.428 0.00446827 0.000492071 201197 0
: 561 Minimum Test error found - save the configuration
: 561 | 130.511 112.963 0.00464479 0.000620581 198797 0
: 562 Minimum Test error found - save the configuration
: 562 | 128.915 111.532 0.00489541 0.000552971 184228 0
: 563 Minimum Test error found - save the configuration
: 563 | 127.216 110.412 0.00441323 0.000493952 204119 0
: 564 Minimum Test error found - save the configuration
: 564 | 125.861 108.742 0.00460896 0.00050174 194779 0
: 565 Minimum Test error found - save the configuration
: 565 | 124.318 108.26 0.00469201 0.000531141 192268 0
: 566 Minimum Test error found - save the configuration
: 566 | 122.925 107.166 0.00467174 0.00052102 192738 0
: 567 Minimum Test error found - save the configuration
: 567 | 121.531 104.818 0.00468 0.000526802 192623 0
: 568 Minimum Test error found - save the configuration
: 568 | 119.938 103.926 0.00520785 0.000667511 176198 0
: 569 Minimum Test error found - save the configuration
: 569 | 118.626 102.639 0.0057982 0.000582532 153384 0
: 570 Minimum Test error found - save the configuration
: 570 | 117.107 101.521 0.00492045 0.000598052 185082 0
: 571 Minimum Test error found - save the configuration
: 571 | 115.745 99.8176 0.00554831 0.000554221 160189 0
: 572 Minimum Test error found - save the configuration
: 572 | 114.378 98.8784 0.00518642 0.000495642 170547 0
: 573 Minimum Test error found - save the configuration
: 573 | 113.283 97.3191 0.00448334 0.000498651 200769 0
: 574 Minimum Test error found - save the configuration
: 574 | 111.814 96.3905 0.00435309 0.00048338 206734 0
: 575 Minimum Test error found - save the configuration
: 575 | 110.268 96.2108 0.00445319 0.000518071 203298 0
: 576 Minimum Test error found - save the configuration
: 576 | 109.148 94.3653 0.00475402 0.000526781 189249 0
: 577 Minimum Test error found - save the configuration
: 577 | 107.877 92.6427 0.00478883 0.000508021 186881 0
: 578 Minimum Test error found - save the configuration
: 578 | 106.48 91.6173 0.00461918 0.000547311 196470 0
: 579 Minimum Test error found - save the configuration
: 579 | 105.209 90.9012 0.00448433 0.000483101 199939 0
: 580 Minimum Test error found - save the configuration
: 580 | 103.979 89.8753 0.00445875 0.000499332 202050 0
: 581 Minimum Test error found - save the configuration
: 581 | 102.924 89.0239 0.00468979 0.000498901 190890 0
: 582 Minimum Test error found - save the configuration
: 582 | 102.009 87.0425 0.00466268 0.000562201 195099 0
: 583 Minimum Test error found - save the configuration
: 583 | 100.343 85.8752 0.00500144 0.000498471 177661 0
: 584 Minimum Test error found - save the configuration
: 584 | 98.9854 84.7728 0.00444843 0.000496311 202423 0
: 585 Minimum Test error found - save the configuration
: 585 | 97.8111 83.3917 0.0046025 0.000523331 196118 0
: 586 Minimum Test error found - save the configuration
: 586 | 96.8918 82.4702 0.00474595 0.000619352 193864 0
: 587 Minimum Test error found - save the configuration
: 587 | 95.7484 81.4268 0.00471073 0.000559611 192719 0
: 588 Minimum Test error found - save the configuration
: 588 | 94.3745 80.3253 0.00451184 0.000484631 198649 0
: 589 Minimum Test error found - save the configuration
: 589 | 93.0934 79.3885 0.0045232 0.000505551 199121 0
: 590 Minimum Test error found - save the configuration
: 590 | 92.1218 78.3141 0.00448054 0.000483451 200146 0
: 591 Minimum Test error found - save the configuration
: 591 | 90.9935 77.391 0.00445603 0.000500851 202266 0
: 592 Minimum Test error found - save the configuration
: 592 | 89.967 76.3054 0.00441327 0.000489811 203902 0
: 593 Minimum Test error found - save the configuration
: 593 | 88.9996 75.3617 0.00455447 0.000563151 200435 0
: 594 Minimum Test error found - save the configuration
: 594 | 87.8962 74.2245 0.00473274 0.000501121 189053 0
: 595 Minimum Test error found - save the configuration
: 595 | 86.7584 73.3785 0.00480552 0.000500841 185844 0
: 596 Minimum Test error found - save the configuration
: 596 | 85.7645 72.6922 0.00496837 0.000511022 179479 0
: 597 | 84.8683 72.7436 0.00443308 0.000463961 201556 1
: 598 Minimum Test error found - save the configuration
: 598 | 83.7663 70.6421 0.00444091 0.000483471 202151 0
: 599 Minimum Test error found - save the configuration
: 599 | 82.8151 69.9252 0.00447327 0.000501561 201425 0
: 600 Minimum Test error found - save the configuration
: 600 | 81.8275 69.0892 0.00441396 0.0004948 204125 0
: 601 Minimum Test error found - save the configuration
: 601 | 80.9182 68.2397 0.00440585 0.000485812 204080 0
: 602 Minimum Test error found - save the configuration
: 602 | 80.1079 67.7196 0.00453032 0.000522721 199621 0
: 603 Minimum Test error found - save the configuration
: 603 | 79.1512 66.2257 0.00492594 0.00050372 180905 0
: 604 Minimum Test error found - save the configuration
: 604 | 78.0889 65.6184 0.00459803 0.00054121 197199 0
: 605 Minimum Test error found - save the configuration
: 605 | 76.96 64.6 0.00466108 0.000523942 193370 0
: 606 Minimum Test error found - save the configuration
: 606 | 76.2424 63.9557 0.00488913 0.0005006 182293 0
: 607 Minimum Test error found - save the configuration
: 607 | 75.4794 63.3459 0.00458925 0.000586931 199884 0
: 608 Minimum Test error found - save the configuration
: 608 | 74.5712 62.0916 0.00496025 0.000509041 179726 0
: 609 Minimum Test error found - save the configuration
: 609 | 73.594 61.8809 0.00486561 0.00061978 188420 0
: 610 Minimum Test error found - save the configuration
: 610 | 72.7927 60.3295 0.00489152 0.000536081 183678 0
: 611 Minimum Test error found - save the configuration
: 611 | 71.697 59.8766 0.00465276 0.000524402 193782 0
: 612 Minimum Test error found - save the configuration
: 612 | 71.1023 58.8015 0.0050286 0.000631521 181939 0
: 613 Minimum Test error found - save the configuration
: 613 | 70.2171 57.5983 0.00585757 0.000722212 155783 0
: 614 | 69.3989 57.8053 0.00524034 0.00044856 166953 1
: 615 Minimum Test error found - save the configuration
: 615 | 68.397 56.3056 0.00565681 0.000755111 163209 0
: 616 Minimum Test error found - save the configuration
: 616 | 67.5917 55.6028 0.00490459 0.00051778 182365 0
: 617 Minimum Test error found - save the configuration
: 617 | 66.9851 55.2782 0.00466259 0.000515752 192918 0
: 618 Minimum Test error found - save the configuration
: 618 | 66.1514 54.3527 0.00618687 0.000740312 146882 0
: 619 Minimum Test error found - save the configuration
: 619 | 65.0967 53.397 0.00623568 0.000646601 143136 0
: 620 Minimum Test error found - save the configuration
: 620 | 64.5256 53.0644 0.00559791 0.000663362 162122 0
: 621 Minimum Test error found - save the configuration
: 621 | 63.8699 52.304 0.00607289 0.00072679 149642 0
: 622 Minimum Test error found - save the configuration
: 622 | 63.3041 51.4285 0.00573017 0.000501242 152995 0
: 623 | 62.1292 51.4607 0.00465155 0.000461402 190924 1
: 624 Minimum Test error found - save the configuration
: 624 | 61.5999 49.7824 0.00440201 0.000489601 204478 0
: 625 Minimum Test error found - save the configuration
: 625 | 60.7007 49.2753 0.0043722 0.000477561 205411 0
: 626 Minimum Test error found - save the configuration
: 626 | 59.9295 48.5205 0.00437232 0.000472631 205145 0
: 627 Minimum Test error found - save the configuration
: 627 | 59.3713 47.8707 0.00439316 0.000491221 205026 0
: 628 Minimum Test error found - save the configuration
: 628 | 58.5367 47.2863 0.005796 0.000743262 158330 0
: 629 Minimum Test error found - save the configuration
: 629 | 58.0923 47.1037 0.00600162 0.000721232 151504 0
: 630 Minimum Test error found - save the configuration
: 630 | 57.1056 45.9438 0.00614598 0.000727101 147632 0
: 631 Minimum Test error found - save the configuration
: 631 | 56.6221 45.6758 0.00636803 0.000725251 141774 0
: 632 Minimum Test error found - save the configuration
: 632 | 55.709 45.4084 0.00481915 0.000684851 193503 0
: 633 Minimum Test error found - save the configuration
: 633 | 55.3249 44.1474 0.0063482 0.000707592 141829 0
: 634 Minimum Test error found - save the configuration
: 634 | 54.7133 44.0249 0.00511636 0.000507051 173562 0
: 635 Minimum Test error found - save the configuration
: 635 | 53.8593 42.6796 0.00563897 0.000781511 164695 0
: 636 Minimum Test error found - save the configuration
: 636 | 53.0388 42.531 0.00650612 0.000739291 138724 0
: 637 Minimum Test error found - save the configuration
: 637 | 52.4991 41.6316 0.00635966 0.000729162 142083 0
: 638 | 51.6994 41.6789 0.00615173 0.000504481 141662 1
: 639 Minimum Test error found - save the configuration
: 639 | 51.2897 40.5552 0.00636175 0.000724541 141914 0
: 640 Minimum Test error found - save the configuration
: 640 | 50.8093 40.1795 0.00632288 0.000719932 142782 0
: 641 Minimum Test error found - save the configuration
: 641 | 50.2854 39.6175 0.00632032 0.000706672 142510 0
: 642 Minimum Test error found - save the configuration
: 642 | 49.5168 39.1557 0.00635903 0.000724331 141977 0
: 643 Minimum Test error found - save the configuration
: 643 | 48.97 38.6852 0.00636532 0.000739522 142202 0
: 644 Minimum Test error found - save the configuration
: 644 | 48.3722 37.6427 0.00587482 0.000529691 149669 0
: 645 Minimum Test error found - save the configuration
: 645 | 47.6366 37.2553 0.00482053 0.000569921 188208 0
: 646 Minimum Test error found - save the configuration
: 646 | 46.9596 36.7299 0.00575074 0.000716971 158927 0
: 647 Minimum Test error found - save the configuration
: 647 | 46.39 36.5846 0.00503733 0.000616931 180979 0
: 648 Minimum Test error found - save the configuration
: 648 | 45.9041 35.899 0.00512753 0.000577681 175830 0
: 649 Minimum Test error found - save the configuration
: 649 | 45.4639 35.24 0.0049211 0.00054002 182603 0
: 650 Minimum Test error found - save the configuration
: 650 | 44.8401 34.4164 0.00528613 0.000701911 174512 0
: 651 Minimum Test error found - save the configuration
: 651 | 44.1331 33.9973 0.00491212 0.000520081 182148 0
: 652 Minimum Test error found - save the configuration
: 652 | 43.7188 33.4964 0.00555458 0.000639481 162764 0
: 653 Minimum Test error found - save the configuration
: 653 | 43.1178 33.3355 0.0045741 0.000494331 196090 0
: 654 Minimum Test error found - save the configuration
: 654 | 42.6342 32.8162 0.00485676 0.000588701 187439 0
: 655 Minimum Test error found - save the configuration
: 655 | 42.1803 32.714 0.00456751 0.000537811 198526 0
: 656 Minimum Test error found - save the configuration
: 656 | 41.8413 31.8635 0.00483661 0.000501721 184549 0
: 657 Minimum Test error found - save the configuration
: 657 | 41.172 31.1278 0.00474639 0.000671892 196343 0
: 658 Minimum Test error found - save the configuration
: 658 | 40.6513 30.9286 0.00531829 0.000551781 167838 0
: 659 Minimum Test error found - save the configuration
: 659 | 40.0911 30.0872 0.00612805 0.000643001 145851 0
: 660 Minimum Test error found - save the configuration
: 660 | 39.5698 29.8648 0.00525292 0.000736332 177125 0
: 661 Minimum Test error found - save the configuration
: 661 | 39.3114 29.7726 0.00486531 0.000514031 183854 0
: 662 Minimum Test error found - save the configuration
: 662 | 39.1045 29.1057 0.00535544 0.000545691 166329 0
: 663 Minimum Test error found - save the configuration
: 663 | 38.3176 28.5706 0.00500633 0.000522892 178434 0
: 664 Minimum Test error found - save the configuration
: 664 | 37.7272 28.251 0.00544162 0.000657822 167231 0
: 665 Minimum Test error found - save the configuration
: 665 | 37.3708 27.8239 0.00501849 0.000521171 177884 0
: 666 Minimum Test error found - save the configuration
: 666 | 36.8192 27.364 0.00521923 0.000548291 171272 0
: 667 Minimum Test error found - save the configuration
: 667 | 36.4973 26.8504 0.00452888 0.000514981 199308 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.9527 26.8016 0.00471395 0.000536511 191505 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.6286 25.8043 0.00470298 0.000514301 190991 0
: 670 | 35.5052 26.513 0.00630126 0.000650542 141575 1
: 671 Minimum Test error found - save the configuration
: 671 | 34.7499 25.2119 0.00466476 0.000585142 196097 0
: 672 Minimum Test error found - save the configuration
: 672 | 34.244 24.9975 0.0051527 0.000552071 173889 0
: 673 Minimum Test error found - save the configuration
: 673 | 33.8511 24.3507 0.00455969 0.000504851 197295 0
: 674 Minimum Test error found - save the configuration
: 674 | 33.6022 24.3287 0.00481175 0.000506361 185814 0
: 675 Minimum Test error found - save the configuration
: 675 | 33.536 24.2099 0.00495165 0.000719582 189033 0
: 676 Minimum Test error found - save the configuration
: 676 | 32.7062 23.4926 0.00585726 0.000498242 149281 0
: 677 Minimum Test error found - save the configuration
: 677 | 32.2445 22.9466 0.00451398 0.000507121 199658 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.684 22.7493 0.00450048 0.000481341 199048 0
: 679 Minimum Test error found - save the configuration
: 679 | 31.4929 22.6686 0.00441193 0.000493682 204173 0
: 680 Minimum Test error found - save the configuration
: 680 | 31.153 22.0389 0.00473423 0.000610871 194017 0
: 681 Minimum Test error found - save the configuration
: 681 | 30.8122 21.4464 0.00546107 0.000652251 166361 0
: 682 Minimum Test error found - save the configuration
: 682 | 30.3239 21.414 0.00515296 0.000583542 175077 0
: 683 Minimum Test error found - save the configuration
: 683 | 30.0103 21.1952 0.00455331 0.000511782 197945 0
: 684 Minimum Test error found - save the configuration
: 684 | 29.5678 20.6784 0.00444929 0.000491371 202126 0
: 685 Minimum Test error found - save the configuration
: 685 | 29.2109 20.6661 0.00445642 0.000492001 201795 0
: 686 | 28.7589 20.7117 0.00509823 0.000510671 174385 1
: 687 Minimum Test error found - save the configuration
: 687 | 28.4665 20.0908 0.00459303 0.00049777 195348 0
: 688 Minimum Test error found - save the configuration
: 688 | 28.5487 19.6207 0.00453539 0.00049904 198199 0
: 689 Minimum Test error found - save the configuration
: 689 | 28.0688 19.2976 0.00446192 0.000496732 201756 0
: 690 | 27.5432 19.3095 0.00478698 0.000460752 184919 1
: 691 Minimum Test error found - save the configuration
: 691 | 26.9743 18.414 0.00448292 0.000500811 200899 0
: 692 | 26.5759 19.0475 0.00457993 0.000444261 193439 1
: 693 Minimum Test error found - save the configuration
: 693 | 26.1847 18.0168 0.00502643 0.000528851 177873 0
: 694 Minimum Test error found - save the configuration
: 694 | 25.9727 18.0068 0.00480832 0.000518891 186505 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.5472 17.4401 0.00480744 0.000575071 189019 0
: 696 Minimum Test error found - save the configuration
: 696 | 25.1247 17.0187 0.00454486 0.000490302 197309 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.8601 16.9694 0.00452962 0.000505642 198808 0
: 698 | 24.76 17.0484 0.00449868 0.000487211 199428 1
: 699 Minimum Test error found - save the configuration
: 699 | 24.3591 16.6091 0.00483893 0.000511131 184851 0
: 700 | 24.2938 17.1339 0.00584969 0.00053809 150614 1
: 701 Minimum Test error found - save the configuration
: 701 | 23.6588 16.1958 0.00447481 0.000504531 201497 0
: 702 Minimum Test error found - save the configuration
: 702 | 23.2808 15.7893 0.00483463 0.000677532 192442 0
: 703 Minimum Test error found - save the configuration
: 703 | 23.1425 15.7199 0.00569105 0.0005065 154305 0
: 704 Minimum Test error found - save the configuration
: 704 | 22.9475 15.3101 0.00457534 0.000511711 196868 0
: 705 Minimum Test error found - save the configuration
: 705 | 22.3903 14.9009 0.00442767 0.000482992 202805 0
: 706 Minimum Test error found - save the configuration
: 706 | 21.9414 14.6645 0.00441154 0.0004919 204100 0
: 707 Minimum Test error found - save the configuration
: 707 | 21.6856 14.5317 0.00435456 0.000479862 206468 0
: 708 Minimum Test error found - save the configuration
: 708 | 21.4511 14.4905 0.00435858 0.000474562 205972 0
: 709 Minimum Test error found - save the configuration
: 709 | 21.2083 14.3256 0.0043801 0.000488821 205588 0
: 710 Minimum Test error found - save the configuration
: 710 | 20.8361 13.7991 0.00454996 0.000489131 197004 0
: 711 | 20.7032 14.0627 0.00506879 0.000576401 178079 1
: 712 Minimum Test error found - save the configuration
: 712 | 20.4901 13.4276 0.00562419 0.000752772 164223 0
: 713 Minimum Test error found - save the configuration
: 713 | 20.0292 13.409 0.00522658 0.000513951 169757 0
: 714 Minimum Test error found - save the configuration
: 714 | 19.684 13.0296 0.00447782 0.000504771 201357 0
: 715 | 19.6498 13.2203 0.00453037 0.000482251 197623 1
: 716 Minimum Test error found - save the configuration
: 716 | 19.3224 12.8973 0.00465581 0.000506151 192787 0
: 717 Minimum Test error found - save the configuration
: 717 | 18.9574 12.1583 0.0045467 0.000549082 200119 0
: 718 Minimum Test error found - save the configuration
: 718 | 18.8509 12.0939 0.00464612 0.000586632 197069 0
: 719 | 18.6149 12.1544 0.00461844 0.00048615 193597 1
: 720 Minimum Test error found - save the configuration
: 720 | 18.4286 11.8275 0.0047119 0.000526681 191149 0
: 721 Minimum Test error found - save the configuration
: 721 | 17.9449 11.2733 0.00474195 0.000513431 189192 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.8272 11.2132 0.00460727 0.000497712 194668 0
: 723 Minimum Test error found - save the configuration
: 723 | 17.5485 10.6943 0.00465489 0.000510392 193027 0
: 724 | 17.2555 10.698 0.00459597 0.000463131 193572 1
: 725 | 17.0354 10.9944 0.00470962 0.000467761 188597 2
: 726 | 16.9398 10.8224 0.00468865 0.00046822 189554 3
: 727 Minimum Test error found - save the configuration
: 727 | 16.8392 10.0656 0.00544239 0.000658172 167216 0
: 728 | 16.5225 10.4149 0.00448323 0.000463291 199008 1
: 729 Minimum Test error found - save the configuration
: 729 | 16.0866 10.0207 0.00448336 0.000524502 202078 0
: 730 Minimum Test error found - save the configuration
: 730 | 16.0626 9.66077 0.00530275 0.000513972 167057 0
: 731 Minimum Test error found - save the configuration
: 731 | 15.7683 9.45943 0.00453466 0.000502501 198405 0
: 732 Minimum Test error found - save the configuration
: 732 | 15.5067 9.28098 0.00441691 0.000504932 204500 0
: 733 | 15.3137 9.3108 0.00437551 0.000486621 205714 1
: 734 | 15.2197 9.35401 0.00438395 0.000444222 203060 2
: 735 Minimum Test error found - save the configuration
: 735 | 15.1485 9.2789 0.00516235 0.000510151 171962 0
: 736 Minimum Test error found - save the configuration
: 736 | 15.0211 8.15802 0.00442722 0.000498202 203613 0
: 737 Minimum Test error found - save the configuration
: 737 | 14.6775 8.13052 0.00446179 0.00049034 201438 0
: 738 | 14.4054 8.24656 0.00488096 0.000501671 182678 1
: 739 Minimum Test error found - save the configuration
: 739 | 14.1375 8.03286 0.00497298 0.000499162 178818 0
: 740 Minimum Test error found - save the configuration
: 740 | 14.032 7.7088 0.00501077 0.000492591 177062 0
: 741 Minimum Test error found - save the configuration
: 741 | 13.7415 7.57125 0.00476729 0.000558182 190064 0
: 742 | 13.7488 8.02013 0.00445581 0.000473 200863 1
: 743 | 13.4292 8.03246 0.00501557 0.00049402 176930 2
: 744 Minimum Test error found - save the configuration
: 744 | 13.26 7.2932 0.00483324 0.00051593 185301 0
: 745 Minimum Test error found - save the configuration
: 745 | 13.0842 7.20315 0.00649555 0.000754891 139357 0
: 746 Minimum Test error found - save the configuration
: 746 | 12.9135 6.92757 0.00651798 0.000743701 138545 0
: 747 Minimum Test error found - save the configuration
: 747 | 12.6685 6.57791 0.00646734 0.000736991 139607 0
: 748 Minimum Test error found - save the configuration
: 748 | 12.5945 6.5624 0.00649541 0.000740281 139006 0
: 749 | 12.3367 6.61358 0.00603519 0.000481411 144046 1
: 750 | 12.1857 6.85115 0.00500413 0.00050574 177841 2
: 751 Minimum Test error found - save the configuration
: 751 | 12.3799 6.50301 0.00469211 0.000508472 191221 0
: 752 Minimum Test error found - save the configuration
: 752 | 12.0668 5.98966 0.00474917 0.000528841 189559 0
: 753 | 11.9838 6.27867 0.00476028 0.000562571 190580 1
: 754 | 11.7585 6.13364 0.00460941 0.000483341 193889 2
: 755 Minimum Test error found - save the configuration
: 755 | 11.6228 5.51533 0.005047 0.000601631 179963 0
: 756 | 11.2813 5.90182 0.00537721 0.000584321 166914 1
: 757 Minimum Test error found - save the configuration
: 757 | 11.1035 5.35902 0.00455629 0.000512042 197812 0
: 758 Minimum Test error found - save the configuration
: 758 | 10.9376 5.25393 0.00450278 0.000494892 199606 0
: 759 | 10.7649 5.28338 0.00442264 0.000453561 201558 1
: 760 Minimum Test error found - save the configuration
: 760 | 10.7928 4.91378 0.0046516 0.00050448 192905 0
: 761 | 10.4532 5.11996 0.00529406 0.000480171 166186 1
: 762 Minimum Test error found - save the configuration
: 762 | 10.3747 4.8397 0.00551791 0.000587442 162256 0
: 763 Minimum Test error found - save the configuration
: 763 | 10.1998 4.79451 0.00483765 0.000718253 194203 0
: 764 Minimum Test error found - save the configuration
: 764 | 10.1793 4.53673 0.00601594 0.000721692 151107 0
: 765 | 10.2171 5.01544 0.00620957 0.000508992 140337 1
: 766 | 9.95607 5.39411 0.00438089 0.000451181 203577 2
: 767 Minimum Test error found - save the configuration
: 767 | 9.88638 4.49381 0.00441165 0.000493491 204178 0
: 768 Minimum Test error found - save the configuration
: 768 | 9.75182 4.40781 0.00437647 0.000486302 205647 0
: 769 Minimum Test error found - save the configuration
: 769 | 9.39654 4.258 0.00469568 0.000501081 190721 0
: 770 Minimum Test error found - save the configuration
: 770 | 9.30952 4.1818 0.00524021 0.000533541 169972 0
: 771 Minimum Test error found - save the configuration
: 771 | 9.21241 4.09315 0.00459361 0.000499981 195426 0
: 772 | 9.08853 4.30171 0.00555344 0.00053572 159435 1
: 773 | 9.07637 4.27552 0.00509577 0.000452352 172287 2
: 774 | 8.96117 4.1278 0.00455165 0.000589721 201922 3
: 775 Minimum Test error found - save the configuration
: 775 | 8.77364 3.85409 0.00465607 0.000522151 193521 0
: 776 | 8.77861 4.21611 0.00464211 0.000513161 193754 1
: 777 Minimum Test error found - save the configuration
: 777 | 8.81741 3.79566 0.00519267 0.000514041 170990 0
: 778 | 8.49256 3.85005 0.00470728 0.000553631 192602 1
: 779 | 8.54544 3.85768 0.00545307 0.000587041 164405 2
: 780 Minimum Test error found - save the configuration
: 780 | 8.18363 3.32341 0.00532872 0.000552122 167483 0
: 781 | 8.16948 3.87278 0.00483864 0.000441131 181921 1
: 782 | 7.9883 3.33658 0.00480473 0.000579391 189334 2
: 783 | 7.94233 3.361 0.00450153 0.000448991 197407 3
: 784 Minimum Test error found - save the configuration
: 784 | 7.80017 3.03622 0.00578687 0.00055564 152928 0
: 785 Minimum Test error found - save the configuration
: 785 | 7.64806 3.03588 0.00478926 0.000541011 188313 0
: 786 | 7.50601 3.09933 0.00483527 0.000658262 191525 1
: 787 | 7.45084 3.26305 0.00626703 0.000649882 142421 2
: 788 | 7.33055 3.24283 0.00527423 0.00047214 166594 3
: 789 Minimum Test error found - save the configuration
: 789 | 7.35327 2.64249 0.00446647 0.000494831 201428 0
: 790 | 7.25968 3.11255 0.00447204 0.000461701 199484 1
: 791 | 6.98989 3.08008 0.0057277 0.000523541 153723 2
: 792 | 7.00959 2.95749 0.00453369 0.00050408 198530 3
: 793 Minimum Test error found - save the configuration
: 793 | 6.83152 2.57929 0.00455513 0.000552161 199852 0
: 794 | 6.82822 3.13567 0.00460928 0.000481091 193790 1
: 795 | 6.6728 2.81513 0.00502967 0.000665622 183316 2
: 796 Minimum Test error found - save the configuration
: 796 | 6.56772 2.56989 0.00486045 0.000509441 183865 0
: 797 | 6.59543 3.11829 0.00476123 0.000458831 185943 1
: 798 | 6.47642 2.72609 0.0050075 0.00066262 184125 2
: 799 Minimum Test error found - save the configuration
: 799 | 6.41891 2.48687 0.0052783 0.000570742 169939 0
: 800 | 6.35832 2.50978 0.00466846 0.000463932 190271 1
: 801 | 6.18942 2.73808 0.00475409 0.000524552 189146 2
: 802 Minimum Test error found - save the configuration
: 802 | 6.38846 2.29635 0.00596582 0.000543401 147536 0
: 803 Minimum Test error found - save the configuration
: 803 | 6.17383 2.24736 0.00521965 0.000735862 178421 0
: 804 | 6.07871 3.13231 0.00513563 0.000550721 174485 1
: 805 | 6.10206 2.96627 0.00540924 0.000519842 163619 2
: 806 | 5.96225 2.97838 0.00491023 0.000444831 179155 3
: 807 | 5.79176 2.35837 0.00447011 0.000459591 199475 4
: 808 | 5.89881 3.0419 0.0056649 0.000637141 159117 5
: 809 | 5.68512 3.05279 0.00548391 0.000522021 161229 6
: 810 | 5.68195 2.33829 0.00537242 0.000471762 163243 7
: 811 | 5.44906 2.404 0.00608015 0.000645891 147214 8
: 812 | 5.46078 2.62845 0.00621157 0.000650671 143862 9
: 813 | 5.39198 2.7082 0.00623549 0.000677402 143934 10
: 814 | 5.45917 2.66819 0.00627233 0.000645161 142167 11
: 815 Minimum Test error found - save the configuration
: 815 | 5.19722 2.09341 0.00581467 0.000536051 151555 0
: 816 | 5.18463 2.29757 0.00537805 0.000640093 168849 1
: 817 | 5.18568 2.52774 0.00493927 0.000480581 179425 2
: 818 | 5.16046 2.37411 0.00580005 0.000659052 155612 3
: 819 | 5.18998 3.02101 0.00535946 0.000543372 166110 4
: 820 | 4.9846 2.55546 0.00521786 0.00048433 169007 5
: 821 Minimum Test error found - save the configuration
: 821 | 4.93436 2.02862 0.00480716 0.000646441 192274 0
: 822 | 4.83375 2.75001 0.00533498 0.00045353 163886 1
: 823 | 4.73927 2.87133 0.00560534 0.000592661 159595 2
: 824 | 4.82497 2.23991 0.0049962 0.000455381 176180 3
: 825 | 4.80949 2.54698 0.00501536 0.000576502 180226 4
: 826 | 4.67 2.13548 0.00548275 0.000488981 160200 5
: 827 | 4.61822 2.88522 0.00542815 0.000662911 167882 6
: 828 | 4.58419 2.14775 0.00544041 0.000534261 163061 7
: 829 | 4.64069 2.63455 0.00569109 0.000643711 158498 8
: 830 Minimum Test error found - save the configuration
: 830 | 4.65648 1.89607 0.00458728 0.0005201 196697 0
: 831 | 4.46096 2.14693 0.00544775 0.000597872 164953 1
: 832 | 4.25945 2.6924 0.00488649 0.000554331 184665 2
: 833 | 4.19691 2.63718 0.00561199 0.000476602 155782 3
: 834 | 4.3086 2.2202 0.00540345 0.000550291 164841 4
: 835 | 4.18615 2.18539 0.00544148 0.0004582 160537 5
: 836 | 4.095 2.74261 0.00438805 0.000441521 202710 6
: 837 | 4.15797 2.27675 0.00446173 0.000464731 200150 7
: 838 | 4.04195 2.19453 0.00473559 0.000479431 187963 8
: 839 | 4.01918 2.52441 0.00582847 0.000631081 153923 9
: 840 | 4.19554 2.15307 0.00549083 0.000463522 159131 10
: 841 | 4.46306 2.82408 0.00438648 0.00045794 203638 11
: 842 | 4.23959 2.53262 0.00442087 0.000465152 202239 12
: 843 | 4.02121 2.78666 0.00440486 0.000440571 201802 13
: 844 | 3.79318 2.37715 0.00440067 0.00045054 202525 14
: 845 | 3.6883 2.76083 0.00440058 0.000447521 202375 15
: 846 | 3.89383 2.02773 0.00434815 0.00044074 204739 16
: 847 | 3.74423 1.97783 0.00443813 0.000458481 201023 17
: 848 | 3.71657 2.64172 0.00435538 0.00044036 204341 18
: 849 | 3.52347 2.39031 0.00432696 0.000445591 206113 19
: 850 | 3.58633 2.55829 0.00470335 0.000496181 190152 20
: 851 | 3.52225 2.29223 0.00491065 0.000461951 179828 21
:
: Elapsed time for training with 1000 events: 4.19 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00633 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.912 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.193 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.33827e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.11104e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0457 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.04 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00144 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0534 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.997 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0219 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00389 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0426 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.0048 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0024 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000487 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0608 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00637 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 1.05 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.115 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.413 0.361 5.53 1.56 | 3.236 3.226
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.238 0.419 1.98 1.11 | 3.378 3.366
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.