Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.263 sec
: Elapsed time for training with 1000 events: 0.266 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00244 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000794 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00406 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000199 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000393 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31502.8
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33037 31112.9 0.00433277 0.000510621 209307 0
: 2 Minimum Test error found - save the configuration
: 2 | 32509.1 30535.6 0.00428758 0.00048646 210465 0
: 3 Minimum Test error found - save the configuration
: 3 | 31828.9 29920.6 0.00438853 0.000488181 205110 0
: 4 Minimum Test error found - save the configuration
: 4 | 31166.7 29372.1 0.00438229 0.00049075 205574 0
: 5 Minimum Test error found - save the configuration
: 5 | 30540.5 28758.8 0.00435493 0.00047722 206308 0
: 6 Minimum Test error found - save the configuration
: 6 | 29822.5 28007.2 0.00444492 0.000487241 202139 0
: 7 Minimum Test error found - save the configuration
: 7 | 29088.8 27240.1 0.00430096 0.00047489 209092 0
: 8 Minimum Test error found - save the configuration
: 8 | 28553.1 26782.8 0.00421407 0.000468171 213567 0
: 9 Minimum Test error found - save the configuration
: 9 | 28166.7 26451.4 0.00416575 0.000449641 215279 0
: 10 Minimum Test error found - save the configuration
: 10 | 27838.7 26147.5 0.00409546 0.000447511 219302 0
: 11 Minimum Test error found - save the configuration
: 11 | 27532.3 25860.4 0.00412607 0.000449 217565 0
: 12 Minimum Test error found - save the configuration
: 12 | 27236.2 25591 0.00408969 0.000446391 219582 0
: 13 Minimum Test error found - save the configuration
: 13 | 26961 25323.1 0.00412405 0.000450571 217777 0
: 14 Minimum Test error found - save the configuration
: 14 | 26685.8 25068.1 0.00410186 0.000448462 218974 0
: 15 Minimum Test error found - save the configuration
: 15 | 26425 24815.5 0.00407923 0.00044615 220199 0
: 16 Minimum Test error found - save the configuration
: 16 | 26162.8 24574.9 0.00407423 0.000449651 220715 0
: 17 Minimum Test error found - save the configuration
: 17 | 25913.3 24335.4 0.00411541 0.00044832 218156 0
: 18 Minimum Test error found - save the configuration
: 18 | 25665.5 24101.7 0.0040815 0.000437051 219512 0
: 19 Minimum Test error found - save the configuration
: 19 | 25421.1 23874.7 0.0040838 0.000444921 219848 0
: 20 Minimum Test error found - save the configuration
: 20 | 25185.9 23647 0.00410992 0.000447821 218454 0
: 21 Minimum Test error found - save the configuration
: 21 | 24949 23426.1 0.00407949 0.000445231 220128 0
: 22 Minimum Test error found - save the configuration
: 22 | 24719.3 23206.5 0.00406098 0.00044169 221038 0
: 23 Minimum Test error found - save the configuration
: 23 | 24494.4 22986.8 0.00408869 0.000444932 219554 0
: 24 Minimum Test error found - save the configuration
: 24 | 24266.7 22775.9 0.00406718 0.00044693 220980 0
: 25 Minimum Test error found - save the configuration
: 25 | 24043.7 22570 0.00405125 0.000441882 221646 0
: 26 Minimum Test error found - save the configuration
: 26 | 23827.2 22364 0.00405027 0.00044578 221945 0
: 27 Minimum Test error found - save the configuration
: 27 | 23614.4 22156.5 0.00411065 0.000448431 218447 0
: 28 Minimum Test error found - save the configuration
: 28 | 23397.1 21958 0.00421444 0.000445032 212235 0
: 29 Minimum Test error found - save the configuration
: 29 | 23189.6 21757.5 0.00412989 0.000446411 217186 0
: 30 Minimum Test error found - save the configuration
: 30 | 22980.4 21561.5 0.00411743 0.000448641 218056 0
: 31 Minimum Test error found - save the configuration
: 31 | 22774.4 21368.5 0.00411139 0.000444771 218185 0
: 32 Minimum Test error found - save the configuration
: 32 | 22573.9 21174.1 0.00409531 0.000446161 219229 0
: 33 Minimum Test error found - save the configuration
: 33 | 22372.1 20983.6 0.00408714 0.000443281 219548 0
: 34 Minimum Test error found - save the configuration
: 34 | 22174.4 20794.2 0.00409303 0.00044675 219402 0
: 35 Minimum Test error found - save the configuration
: 35 | 21975.5 20610.9 0.00412072 0.000450171 217951 0
: 36 Minimum Test error found - save the configuration
: 36 | 21783.3 20426.8 0.00409904 0.000444191 218888 0
: 37 Minimum Test error found - save the configuration
: 37 | 21591.1 20245.1 0.00413989 0.000455741 217147 0
: 38 Minimum Test error found - save the configuration
: 38 | 21399.4 20067.8 0.00413063 0.000446352 217139 0
: 39 Minimum Test error found - save the configuration
: 39 | 21213.6 19889 0.00414573 0.000465141 217357 0
: 40 Minimum Test error found - save the configuration
: 40 | 21028.7 19710.7 0.00411514 0.00044407 217920 0
: 41 Minimum Test error found - save the configuration
: 41 | 20840.7 19539.9 0.00416765 0.00048712 217360 0
: 42 Minimum Test error found - save the configuration
: 42 | 20658.3 19370.9 0.00410777 0.00044881 218642 0
: 43 Minimum Test error found - save the configuration
: 43 | 20481.3 19198.1 0.00415524 0.000455091 216208 0
: 44 Minimum Test error found - save the configuration
: 44 | 20302 19027.5 0.00411579 0.00044348 217847 0
: 45 Minimum Test error found - save the configuration
: 45 | 20123.1 18858.9 0.00415422 0.000473462 217347 0
: 46 Minimum Test error found - save the configuration
: 46 | 19942.7 18694.3 0.004211 0.000457872 213156 0
: 47 Minimum Test error found - save the configuration
: 47 | 19770.1 18525.4 0.00422194 0.000467112 213059 0
: 48 Minimum Test error found - save the configuration
: 48 | 19598.4 18362.4 0.004197 0.000468731 214577 0
: 49 Minimum Test error found - save the configuration
: 49 | 19422.5 18203.6 0.00418176 0.000454251 214621 0
: 50 Minimum Test error found - save the configuration
: 50 | 19256.5 18039.3 0.0042739 0.00046442 210002 0
: 51 Minimum Test error found - save the configuration
: 51 | 19083.3 17883 0.00423684 0.000465331 212117 0
: 52 Minimum Test error found - save the configuration
: 52 | 18918.6 17725.6 0.00424742 0.000467551 211648 0
: 53 Minimum Test error found - save the configuration
: 53 | 18757 17561.5 0.00423929 0.000459181 211634 0
: 54 Minimum Test error found - save the configuration
: 54 | 18596.9 17421.3 0.00422113 0.00045859 212623 0
: 55 Minimum Test error found - save the configuration
: 55 | 18429.6 17263.4 0.00425182 0.000468051 211430 0
: 56 Minimum Test error found - save the configuration
: 56 | 18263.1 17102.2 0.00427075 0.000470361 210505 0
: 57 Minimum Test error found - save the configuration
: 57 | 18103 16950.7 0.00428155 0.000466281 209684 0
: 58 Minimum Test error found - save the configuration
: 58 | 17944.2 16799.4 0.00426651 0.000466551 210529 0
: 59 Minimum Test error found - save the configuration
: 59 | 17783.9 16645 0.00427095 0.000469729 210459 0
: 60 Minimum Test error found - save the configuration
: 60 | 17623.9 16495 0.00427316 0.000472761 210504 0
: 61 Minimum Test error found - save the configuration
: 61 | 17469.4 16343.3 0.00432329 0.00047472 207870 0
: 62 Minimum Test error found - save the configuration
: 62 | 17314.5 16199.8 0.00429551 0.000476861 209498 0
: 63 Minimum Test error found - save the configuration
: 63 | 17157.9 16049.7 0.00430207 0.000474022 208984 0
: 64 Minimum Test error found - save the configuration
: 64 | 17006.3 15900.7 0.00439534 0.00048079 204366 0
: 65 Minimum Test error found - save the configuration
: 65 | 16851.3 15757.9 0.00434936 0.00048137 206826 0
: 66 Minimum Test error found - save the configuration
: 66 | 16701.2 15611.9 0.00430619 0.00046836 208451 0
: 67 Minimum Test error found - save the configuration
: 67 | 16549 15471.8 0.00433324 0.000486082 207946 0
: 68 Minimum Test error found - save the configuration
: 68 | 16403.6 15328.9 0.00437204 0.000482921 205702 0
: 69 Minimum Test error found - save the configuration
: 69 | 16254.8 15189.7 0.00433045 0.000470061 207233 0
: 70 Minimum Test error found - save the configuration
: 70 | 16107.2 15054.1 0.00433207 0.00047595 207463 0
: 71 Minimum Test error found - save the configuration
: 71 | 15964.4 14916.2 0.00436988 0.000483101 205826 0
: 72 Minimum Test error found - save the configuration
: 72 | 15821.7 14779.1 0.00434209 0.00047677 206969 0
: 73 Minimum Test error found - save the configuration
: 73 | 15677.5 14646 0.00432135 0.000474771 207977 0
: 74 Minimum Test error found - save the configuration
: 74 | 15537.9 14513.2 0.00434208 0.000477491 207008 0
: 75 Minimum Test error found - save the configuration
: 75 | 15397.9 14382.6 0.00434297 0.00047582 206871 0
: 76 Minimum Test error found - save the configuration
: 76 | 15259.8 14253.3 0.00440375 0.000490951 204457 0
: 77 Minimum Test error found - save the configuration
: 77 | 15124.7 14123.1 0.00433315 0.000479531 207597 0
: 78 Minimum Test error found - save the configuration
: 78 | 14988.7 13994.2 0.00441197 0.0004838 203657 0
: 79 Minimum Test error found - save the configuration
: 79 | 14854.3 13867 0.00438669 0.000483862 204980 0
: 80 Minimum Test error found - save the configuration
: 80 | 14720.3 13742.7 0.0043385 0.00047577 207108 0
: 81 Minimum Test error found - save the configuration
: 81 | 14591.1 13615.5 0.00442533 0.00048738 203152 0
: 82 Minimum Test error found - save the configuration
: 82 | 14455.8 13496.5 0.0043989 0.00048984 204653 0
: 83 Minimum Test error found - save the configuration
: 83 | 14328.6 13374.8 0.00434509 0.000478691 206911 0
: 84 Minimum Test error found - save the configuration
: 84 | 14200.8 13253.6 0.00445619 0.000522531 203373 0
: 85 Minimum Test error found - save the configuration
: 85 | 14074.1 13132.6 0.00436861 0.00047528 205480 0
: 86 Minimum Test error found - save the configuration
: 86 | 13947.7 13013.5 0.00433688 0.00047542 207176 0
: 87 Minimum Test error found - save the configuration
: 87 | 13823.1 12895 0.00437063 0.000486231 205952 0
: 88 Minimum Test error found - save the configuration
: 88 | 13699.5 12777.4 0.00475568 0.000507371 188310 0
: 89 Minimum Test error found - save the configuration
: 89 | 13575.6 12662.4 0.00435568 0.00048244 206546 0
: 90 Minimum Test error found - save the configuration
: 90 | 13453.5 12548.9 0.00433835 0.000476 207128 0
: 91 Minimum Test error found - save the configuration
: 91 | 13333.9 12435.1 0.00437304 0.00048304 205656 0
: 92 Minimum Test error found - save the configuration
: 92 | 13213.8 12323.2 0.00446767 0.00049094 201170 0
: 93 Minimum Test error found - save the configuration
: 93 | 13096.9 12209.8 0.00444019 0.0005146 203791 0
: 94 Minimum Test error found - save the configuration
: 94 | 12978.1 12099.4 0.00441413 0.00047661 203174 0
: 95 Minimum Test error found - save the configuration
: 95 | 12861.3 11990.7 0.00441058 0.000483431 203710 0
: 96 Minimum Test error found - save the configuration
: 96 | 12747.6 11880.3 0.00436738 0.000479431 205764 0
: 97 Minimum Test error found - save the configuration
: 97 | 12631.5 11773.5 0.00435779 0.000478032 206199 0
: 98 Minimum Test error found - save the configuration
: 98 | 12517.2 11669 0.00437148 0.00048883 206045 0
: 99 Minimum Test error found - save the configuration
: 99 | 12407.2 11561.7 0.00440247 0.00049124 204539 0
: 100 Minimum Test error found - save the configuration
: 100 | 12294 11458 0.00441992 0.000491071 203622 0
: 101 Minimum Test error found - save the configuration
: 101 | 12184.6 11353.8 0.00439489 0.00048624 204674 0
: 102 Minimum Test error found - save the configuration
: 102 | 12075.6 11249.9 0.00443258 0.000500282 203444 0
: 103 Minimum Test error found - save the configuration
: 103 | 11965.6 11149.1 0.00439396 0.000482701 204538 0
: 104 Minimum Test error found - save the configuration
: 104 | 11859.5 11046.8 0.00435521 0.00047762 206314 0
: 105 Minimum Test error found - save the configuration
: 105 | 11751.2 10947.9 0.0043995 0.000480072 204112 0
: 106 Minimum Test error found - save the configuration
: 106 | 11647.1 10847.6 0.00440603 0.00048703 204134 0
: 107 Minimum Test error found - save the configuration
: 107 | 11542.2 10748.4 0.00443528 0.00048957 202752 0
: 108 Minimum Test error found - save the configuration
: 108 | 11437.6 10651.2 0.00442681 0.00050859 204175 0
: 109 Minimum Test error found - save the configuration
: 109 | 11334.5 10555 0.00437726 0.00047657 205092 0
: 110 Minimum Test error found - save the configuration
: 110 | 11232.8 10459.1 0.00444222 0.000513491 203628 0
: 111 Minimum Test error found - save the configuration
: 111 | 11130.8 10365.3 0.00444242 0.00050775 203321 0
: 112 Minimum Test error found - save the configuration
: 112 | 11031.6 10270.8 0.00441814 0.000483172 203305 0
: 113 Minimum Test error found - save the configuration
: 113 | 10932.3 10176.9 0.00446391 0.00053423 203579 0
: 114 Minimum Test error found - save the configuration
: 114 | 10832 10086.5 0.00440633 0.000483501 203935 0
: 115 Minimum Test error found - save the configuration
: 115 | 10736.8 9993.01 0.00444593 0.00049269 202366 0
: 116 Minimum Test error found - save the configuration
: 116 | 10639.3 9901.43 0.00440125 0.000481731 204107 0
: 117 Minimum Test error found - save the configuration
: 117 | 10542.1 9812.32 0.00447605 0.000491061 200754 0
: 118 Minimum Test error found - save the configuration
: 118 | 10447.8 9722.59 0.0043975 0.000477331 204073 0
: 119 Minimum Test error found - save the configuration
: 119 | 10353.4 9633.87 0.00438847 0.000482531 204816 0
: 120 Minimum Test error found - save the configuration
: 120 | 10259.7 9546.03 0.00437594 0.00048525 205619 0
: 121 Minimum Test error found - save the configuration
: 121 | 10165.7 9461.12 0.00437904 0.000481311 205248 0
: 122 Minimum Test error found - save the configuration
: 122 | 10076.7 9372.62 0.00436604 0.000482591 206003 0
: 123 Minimum Test error found - save the configuration
: 123 | 9983.64 9288.05 0.00441544 0.000479601 203261 0
: 124 Minimum Test error found - save the configuration
: 124 | 9894.39 9202.19 0.00446097 0.000493802 201655 0
: 125 Minimum Test error found - save the configuration
: 125 | 9803.01 9120.12 0.00448883 0.00049232 200175 0
: 126 Minimum Test error found - save the configuration
: 126 | 9715.72 9036.53 0.00441531 0.000485833 203590 0
: 127 Minimum Test error found - save the configuration
: 127 | 9627.51 8954.05 0.00441324 0.000502501 204565 0
: 128 Minimum Test error found - save the configuration
: 128 | 9541.33 8870.94 0.0044254 0.000494841 203534 0
: 129 Minimum Test error found - save the configuration
: 129 | 9453.57 8790.61 0.00444489 0.00051015 203317 0
: 130 Minimum Test error found - save the configuration
: 130 | 9368.63 8709.82 0.00441755 0.00048269 203311 0
: 131 Minimum Test error found - save the configuration
: 131 | 9282.11 8632.2 0.00440933 0.000491101 204174 0
: 132 Minimum Test error found - save the configuration
: 132 | 9199.97 8552.25 0.00438951 0.000484581 204869 0
: 133 Minimum Test error found - save the configuration
: 133 | 9115.47 8474.52 0.00443704 0.000484241 202388 0
: 134 Minimum Test error found - save the configuration
: 134 | 9032.87 8397.34 0.00441477 0.000485171 203583 0
: 135 Minimum Test error found - save the configuration
: 135 | 8952.23 8318.96 0.00441373 0.000484771 203616 0
: 136 Minimum Test error found - save the configuration
: 136 | 8868.87 8244.39 0.00440031 0.000486661 204413 0
: 137 Minimum Test error found - save the configuration
: 137 | 8789.14 8169.22 0.0043945 0.00047541 204129 0
: 138 Minimum Test error found - save the configuration
: 138 | 8708.59 8095.85 0.00450915 0.000506341 199860 0
: 139 Minimum Test error found - save the configuration
: 139 | 8631.72 8019.45 0.00453612 0.000490571 197748 0
: 140 Minimum Test error found - save the configuration
: 140 | 8551.85 7945.9 0.00444666 0.000491271 202256 0
: 141 Minimum Test error found - save the configuration
: 141 | 8474.4 7872.53 0.00443344 0.0004908 202910 0
: 142 Minimum Test error found - save the configuration
: 142 | 8395.67 7802.47 0.00438929 0.00048363 204831 0
: 143 Minimum Test error found - save the configuration
: 143 | 8320.75 7730.52 0.00438694 0.00048393 204970 0
: 144 Minimum Test error found - save the configuration
: 144 | 8245.52 7658.42 0.0044165 0.000509691 204771 0
: 145 Minimum Test error found - save the configuration
: 145 | 8170.4 7587.08 0.00447779 0.00053607 202957 0
: 146 Minimum Test error found - save the configuration
: 146 | 8094.75 7518.14 0.00444247 0.000487082 202256 0
: 147 Minimum Test error found - save the configuration
: 147 | 8022.98 7447.15 0.0044716 0.000495421 201198 0
: 148 Minimum Test error found - save the configuration
: 148 | 7947.2 7380.64 0.00447394 0.000502981 201463 0
: 149 Minimum Test error found - save the configuration
: 149 | 7875.69 7313.17 0.00439926 0.000484841 204373 0
: 150 Minimum Test error found - save the configuration
: 150 | 7804.67 7245.08 0.00447132 0.000497252 201305 0
: 151 Minimum Test error found - save the configuration
: 151 | 7732.25 7179.4 0.00441523 0.000484441 203522 0
: 152 Minimum Test error found - save the configuration
: 152 | 7662.69 7112.76 0.00446308 0.000493602 201538 0
: 153 Minimum Test error found - save the configuration
: 153 | 7593.37 7045.88 0.00443773 0.00050721 203536 0
: 154 Minimum Test error found - save the configuration
: 154 | 7522.96 6981.15 0.00442534 0.00050105 203859 0
: 155 Minimum Test error found - save the configuration
: 155 | 7454.53 6916.56 0.0044301 0.000507951 203970 0
: 156 Minimum Test error found - save the configuration
: 156 | 7385.73 6853.58 0.0044603 0.000497481 201877 0
: 157 Minimum Test error found - save the configuration
: 157 | 7318.72 6790.62 0.00439412 0.000481331 204458 0
: 158 Minimum Test error found - save the configuration
: 158 | 7252.73 6726.64 0.00442542 0.00048849 203204 0
: 159 Minimum Test error found - save the configuration
: 159 | 7185.01 6665.52 0.00441106 0.000487071 203874 0
: 160 Minimum Test error found - save the configuration
: 160 | 7120.56 6603 0.00446865 0.00049246 201198 0
: 161 Minimum Test error found - save the configuration
: 161 | 7054.51 6542.37 0.00447683 0.000498952 201112 0
: 162 Minimum Test error found - save the configuration
: 162 | 6989.81 6482.6 0.00446777 0.000493101 201275 0
: 163 Minimum Test error found - save the configuration
: 163 | 6927.37 6421.06 0.00440655 0.000486891 204100 0
: 164 Minimum Test error found - save the configuration
: 164 | 6862.98 6361.45 0.00442038 0.00048742 203409 0
: 165 Minimum Test error found - save the configuration
: 165 | 6799.49 6303.35 0.00447607 0.000491421 200771 0
: 166 Minimum Test error found - save the configuration
: 166 | 6737.13 6246.01 0.00439274 0.00047818 204365 0
: 167 Minimum Test error found - save the configuration
: 167 | 6675.94 6188.27 0.00440966 0.000485891 203886 0
: 168 Minimum Test error found - save the configuration
: 168 | 6615.18 6130.24 0.00444678 0.0004881 202088 0
: 169 Minimum Test error found - save the configuration
: 169 | 6553.67 6074.2 0.00443771 0.000491372 202720 0
: 170 Minimum Test error found - save the configuration
: 170 | 6494.18 6017.36 0.00442327 0.00048967 203376 0
: 171 Minimum Test error found - save the configuration
: 171 | 6434.7 5961.19 0.00450433 0.000487031 199139 0
: 172 Minimum Test error found - save the configuration
: 172 | 6375.19 5906.14 0.00443643 0.000506251 203553 0
: 173 Minimum Test error found - save the configuration
: 173 | 6316.74 5851.38 0.00443289 0.00048643 202714 0
: 174 Minimum Test error found - save the configuration
: 174 | 6259.02 5796.85 0.00442416 0.0005035 204047 0
: 175 Minimum Test error found - save the configuration
: 175 | 6201.66 5742.4 0.00446071 0.000491701 201562 0
: 176 Minimum Test error found - save the configuration
: 176 | 6143.97 5689.63 0.00441645 0.00049436 203973 0
: 177 Minimum Test error found - save the configuration
: 177 | 6087.88 5636.9 0.00440895 0.000489381 204104 0
: 178 Minimum Test error found - save the configuration
: 178 | 6031.47 5585.19 0.00442872 0.000487061 202960 0
: 179 Minimum Test error found - save the configuration
: 179 | 5977.24 5531.91 0.0044041 0.000486091 204185 0
: 180 Minimum Test error found - save the configuration
: 180 | 5920.72 5481.71 0.00441641 0.00048504 203491 0
: 181 Minimum Test error found - save the configuration
: 181 | 5866.59 5431.62 0.00440701 0.000487661 204116 0
: 182 Minimum Test error found - save the configuration
: 182 | 5813.38 5380.11 0.00446979 0.000490811 201057 0
: 183 Minimum Test error found - save the configuration
: 183 | 5760.01 5329.42 0.00445189 0.000511701 203036 0
: 184 Minimum Test error found - save the configuration
: 184 | 5706.22 5279.97 0.00443524 0.00048458 202498 0
: 185 Minimum Test error found - save the configuration
: 185 | 5653.54 5231.07 0.00442485 0.00048637 203124 0
: 186 Minimum Test error found - save the configuration
: 186 | 5602.33 5181.9 0.00441976 0.000491831 203670 0
: 187 Minimum Test error found - save the configuration
: 187 | 5550.51 5133.18 0.00442356 0.000484272 203083 0
: 188 Minimum Test error found - save the configuration
: 188 | 5498.81 5085.77 0.00441496 0.00048981 203814 0
: 189 Minimum Test error found - save the configuration
: 189 | 5448.67 5038 0.00442017 0.00048515 203303 0
: 190 Minimum Test error found - save the configuration
: 190 | 5397.8 4991.55 0.00440885 0.00049106 204197 0
: 191 Minimum Test error found - save the configuration
: 191 | 5348.21 4945.22 0.00440777 0.000486011 203990 0
: 192 Minimum Test error found - save the configuration
: 192 | 5299.33 4898.59 0.00441382 0.000485051 203626 0
: 193 Minimum Test error found - save the configuration
: 193 | 5249.9 4853.4 0.00441424 0.00048836 203776 0
: 194 Minimum Test error found - save the configuration
: 194 | 5201.87 4808.45 0.00440824 0.00048605 203968 0
: 195 Minimum Test error found - save the configuration
: 195 | 5153.5 4764.48 0.00441336 0.00048761 203783 0
: 196 Minimum Test error found - save the configuration
: 196 | 5107.47 4718.27 0.00440897 0.00048218 203729 0
: 197 Minimum Test error found - save the configuration
: 197 | 5058.36 4675.72 0.00440927 0.000484572 203837 0
: 198 Minimum Test error found - save the configuration
: 198 | 5013.08 4631.98 0.00443696 0.000490441 202710 0
: 199 Minimum Test error found - save the configuration
: 199 | 4966.32 4588.76 0.00442972 0.000487252 202919 0
: 200 Minimum Test error found - save the configuration
: 200 | 4921.54 4544.67 0.00598212 0.000692521 151240 0
: 201 Minimum Test error found - save the configuration
: 201 | 4875.28 4502.59 0.00487241 0.000492812 182665 0
: 202 Minimum Test error found - save the configuration
: 202 | 4830.48 4460.68 0.00447737 0.00049453 200862 0
: 203 Minimum Test error found - save the configuration
: 203 | 4785.56 4419.72 0.00442669 0.000489631 203198 0
: 204 Minimum Test error found - save the configuration
: 204 | 4741.73 4378.94 0.00445806 0.000492691 201747 0
: 205 Minimum Test error found - save the configuration
: 205 | 4699.02 4338 0.00445285 0.000500042 202388 0
: 206 Minimum Test error found - save the configuration
: 206 | 4654.15 4298.25 0.00457727 0.000542951 198299 0
: 207 Minimum Test error found - save the configuration
: 207 | 4612.29 4258.25 0.00487776 0.00053631 184270 0
: 208 Minimum Test error found - save the configuration
: 208 | 4570.13 4218.02 0.00454977 0.000542191 199622 0
: 209 Minimum Test error found - save the configuration
: 209 | 4527.81 4178.63 0.00474884 0.00051873 189121 0
: 210 Minimum Test error found - save the configuration
: 210 | 4485.75 4140.45 0.00486043 0.000719282 193183 0
: 211 Minimum Test error found - save the configuration
: 211 | 4445.03 4101.71 0.00623552 0.000712181 144840 0
: 212 Minimum Test error found - save the configuration
: 212 | 4404.22 4062.87 0.00481325 0.00050214 185567 0
: 213 Minimum Test error found - save the configuration
: 213 | 4363.52 4025.07 0.00448578 0.00049872 200649 0
: 214 Minimum Test error found - save the configuration
: 214 | 4322.95 3988.6 0.00484051 0.00051199 184821 0
: 215 Minimum Test error found - save the configuration
: 215 | 4284.3 3950.71 0.00446302 0.000492661 201493 0
: 216 Minimum Test error found - save the configuration
: 216 | 4244.69 3913.74 0.00540517 0.00072625 170980 0
: 217 Minimum Test error found - save the configuration
: 217 | 4205.51 3877.09 0.0056702 0.000502112 154796 0
: 218 Minimum Test error found - save the configuration
: 218 | 4167.07 3841.03 0.00486871 0.00055414 185418 0
: 219 Minimum Test error found - save the configuration
: 219 | 4128.79 3805.3 0.00497908 0.00052714 179697 0
: 220 Minimum Test error found - save the configuration
: 220 | 4090.64 3770.46 0.00443005 0.000486071 202841 0
: 221 Minimum Test error found - save the configuration
: 221 | 4054.09 3734.8 0.00567978 0.000725231 161468 0
: 222 Minimum Test error found - save the configuration
: 222 | 4016.37 3700.31 0.00622715 0.000714151 145112 0
: 223 Minimum Test error found - save the configuration
: 223 | 3979.81 3666.05 0.00486139 0.00049552 183240 0
: 224 Minimum Test error found - save the configuration
: 224 | 3943.49 3631.86 0.00442403 0.00048898 203301 0
: 225 Minimum Test error found - save the configuration
: 225 | 3908.35 3597.36 0.00495332 0.00053559 181089 0
: 226 Minimum Test error found - save the configuration
: 226 | 3871.07 3564.63 0.00441701 0.000484921 203454 0
: 227 Minimum Test error found - save the configuration
: 227 | 3836.87 3531.5 0.0043591 0.000473331 205880 0
: 228 Minimum Test error found - save the configuration
: 228 | 3801.78 3498.44 0.00437827 0.00048368 205413 0
: 229 Minimum Test error found - save the configuration
: 229 | 3766.49 3466.22 0.00438097 0.00049432 205833 0
: 230 Minimum Test error found - save the configuration
: 230 | 3732.25 3434.62 0.00442282 0.0005015 204013 0
: 231 Minimum Test error found - save the configuration
: 231 | 3698.69 3402.46 0.00445925 0.00049908 202012 0
: 232 Minimum Test error found - save the configuration
: 232 | 3665.4 3370.43 0.00442403 0.000483721 203030 0
: 233 Minimum Test error found - save the configuration
: 233 | 3631.95 3339.06 0.00439065 0.000502081 205731 0
: 234 Minimum Test error found - save the configuration
: 234 | 3598.66 3307.92 0.0044012 0.000483162 204184 0
: 235 Minimum Test error found - save the configuration
: 235 | 3565.54 3277.84 0.00435378 0.000480951 206568 0
: 236 Minimum Test error found - save the configuration
: 236 | 3533.19 3247.77 0.00434327 0.00048051 207106 0
: 237 Minimum Test error found - save the configuration
: 237 | 3501.86 3217.02 0.00434767 0.000474941 206573 0
: 238 Minimum Test error found - save the configuration
: 238 | 3470 3186.63 0.00437687 0.000483882 205498 0
: 239 Minimum Test error found - save the configuration
: 239 | 3437.61 3157.88 0.00436688 0.00048355 206009 0
: 240 Minimum Test error found - save the configuration
: 240 | 3407.44 3127.75 0.00436816 0.00048154 205835 0
: 241 Minimum Test error found - save the configuration
: 241 | 3375.47 3099.66 0.00435172 0.000479081 206578 0
: 242 Minimum Test error found - save the configuration
: 242 | 3345.61 3070.49 0.00435461 0.00048109 206531 0
: 243 Minimum Test error found - save the configuration
: 243 | 3314.89 3042.47 0.00437741 0.000485911 205576 0
: 244 Minimum Test error found - save the configuration
: 244 | 3285.08 3014.41 0.00433773 0.00047883 207313 0
: 245 Minimum Test error found - save the configuration
: 245 | 3255.7 2985.64 0.00435173 0.00048025 206640 0
: 246 Minimum Test error found - save the configuration
: 246 | 3226.24 2957.75 0.00435685 0.000480081 206358 0
: 247 Minimum Test error found - save the configuration
: 247 | 3195.96 2930.33 0.0043488 0.00048015 206791 0
: 248 Minimum Test error found - save the configuration
: 248 | 3167.74 2902.69 0.00434699 0.000474421 206581 0
: 249 Minimum Test error found - save the configuration
: 249 | 3137.88 2877.04 0.00434198 0.000479931 207144 0
: 250 Minimum Test error found - save the configuration
: 250 | 3110.18 2850.62 0.00435897 0.000485432 206530 0
: 251 Minimum Test error found - save the configuration
: 251 | 3082.2 2823.64 0.00434889 0.000477751 206658 0
: 252 Minimum Test error found - save the configuration
: 252 | 3054.52 2796.71 0.00433603 0.00047791 207355 0
: 253 Minimum Test error found - save the configuration
: 253 | 3026.05 2771.32 0.00440041 0.000509401 205602 0
: 254 Minimum Test error found - save the configuration
: 254 | 2999.52 2745.07 0.00439567 0.00048064 204341 0
: 255 Minimum Test error found - save the configuration
: 255 | 2971.93 2719.65 0.00436136 0.000480471 206138 0
: 256 Minimum Test error found - save the configuration
: 256 | 2944.17 2695.55 0.0043614 0.00047622 205911 0
: 257 Minimum Test error found - save the configuration
: 257 | 2918.43 2670.39 0.0043818 0.000484441 205267 0
: 258 Minimum Test error found - save the configuration
: 258 | 2891.74 2646.12 0.00436238 0.00048162 206145 0
: 259 Minimum Test error found - save the configuration
: 259 | 2866.01 2620.96 0.00458612 0.000520272 196761 0
: 260 Minimum Test error found - save the configuration
: 260 | 2839.93 2596.53 0.00440394 0.000483361 204052 0
: 261 Minimum Test error found - save the configuration
: 261 | 2814.07 2572.48 0.00437971 0.000477912 205034 0
: 262 Minimum Test error found - save the configuration
: 262 | 2788.86 2548.61 0.00439134 0.000487261 204914 0
: 263 Minimum Test error found - save the configuration
: 263 | 2763.29 2526.04 0.00441873 0.00049027 203642 0
: 264 Minimum Test error found - save the configuration
: 264 | 2738.94 2502.28 0.00445735 0.00049105 201699 0
: 265 Minimum Test error found - save the configuration
: 265 | 2713.99 2479.44 0.00446421 0.00049868 201739 0
: 266 Minimum Test error found - save the configuration
: 266 | 2688.98 2456.76 0.00443163 0.000497171 203332 0
: 267 Minimum Test error found - save the configuration
: 267 | 2664.58 2434.52 0.00443094 0.000485391 202760 0
: 268 Minimum Test error found - save the configuration
: 268 | 2641.09 2412.1 0.00440103 0.000483362 204203 0
: 269 Minimum Test error found - save the configuration
: 269 | 2617.08 2389.32 0.00439137 0.00049096 205107 0
: 270 Minimum Test error found - save the configuration
: 270 | 2593.25 2367.29 0.0043748 0.000493641 206124 0
: 271 Minimum Test error found - save the configuration
: 271 | 2569.34 2346.08 0.00437241 0.000477492 205396 0
: 272 Minimum Test error found - save the configuration
: 272 | 2546.56 2324.09 0.00437271 0.000480901 205560 0
: 273 Minimum Test error found - save the configuration
: 273 | 2523.32 2302.7 0.00436414 0.00047431 205665 0
: 274 Minimum Test error found - save the configuration
: 274 | 2500.97 2280.9 0.00436691 0.000479141 205774 0
: 275 Minimum Test error found - save the configuration
: 275 | 2477.68 2260.3 0.00439054 0.000482271 204694 0
: 276 Minimum Test error found - save the configuration
: 276 | 2454.95 2240.28 0.00437927 0.00048131 205236 0
: 277 Minimum Test error found - save the configuration
: 277 | 2433.05 2219.5 0.00439205 0.00048399 204705 0
: 278 Minimum Test error found - save the configuration
: 278 | 2411.56 2198.55 0.00436966 0.00047388 205351 0
: 279 Minimum Test error found - save the configuration
: 279 | 2388.7 2179.07 0.00437007 0.00047889 205593 0
: 280 Minimum Test error found - save the configuration
: 280 | 2368.1 2158.68 0.0044098 0.000486841 203928 0
: 281 Minimum Test error found - save the configuration
: 281 | 2346.16 2139.18 0.00439403 0.000483641 204583 0
: 282 Minimum Test error found - save the configuration
: 282 | 2323.66 2120.43 0.00437411 0.000479721 205424 0
: 283 Minimum Test error found - save the configuration
: 283 | 2304.3 2099.42 0.00435861 0.000481971 206364 0
: 284 Minimum Test error found - save the configuration
: 284 | 2282.72 2079.53 0.00440066 0.000480611 204079 0
: 285 Minimum Test error found - save the configuration
: 285 | 2261.24 2060.84 0.00436731 0.00048312 205963 0
: 286 Minimum Test error found - save the configuration
: 286 | 2240.15 2042.9 0.00438083 0.00048177 205178 0
: 287 Minimum Test error found - save the configuration
: 287 | 2220.42 2023.96 0.00434582 0.000477211 206793 0
: 288 Minimum Test error found - save the configuration
: 288 | 2200.13 2005.61 0.00436298 0.00048031 206044 0
: 289 Minimum Test error found - save the configuration
: 289 | 2180.06 1986.86 0.00436206 0.000478311 205987 0
: 290 Minimum Test error found - save the configuration
: 290 | 2159.52 1968.8 0.00440045 0.000493801 204779 0
: 291 Minimum Test error found - save the configuration
: 291 | 2140.12 1950.43 0.00435222 0.000481282 206668 0
: 292 Minimum Test error found - save the configuration
: 292 | 2120.25 1932.5 0.0043891 0.00047988 204645 0
: 293 Minimum Test error found - save the configuration
: 293 | 2100.46 1915.07 0.0043728 0.00048009 205513 0
: 294 Minimum Test error found - save the configuration
: 294 | 2081.27 1897.9 0.00437248 0.000479881 205518 0
: 295 Minimum Test error found - save the configuration
: 295 | 2062.49 1879.89 0.0043578 0.00047976 206290 0
: 296 Minimum Test error found - save the configuration
: 296 | 2043.23 1862.93 0.00436172 0.00047934 206059 0
: 297 Minimum Test error found - save the configuration
: 297 | 2023.5 1847.11 0.00436288 0.00047907 205984 0
: 298 Minimum Test error found - save the configuration
: 298 | 2006.26 1829.18 0.00436016 0.000480632 206211 0
: 299 Minimum Test error found - save the configuration
: 299 | 1987 1812.67 0.00436294 0.00047846 205948 0
: 300 Minimum Test error found - save the configuration
: 300 | 1968.74 1796.31 0.00436246 0.00047811 205955 0
: 301 Minimum Test error found - save the configuration
: 301 | 1949.89 1780.71 0.00435808 0.000478801 206224 0
: 302 Minimum Test error found - save the configuration
: 302 | 1932.82 1764.55 0.00434721 0.000471232 206400 0
: 303 Minimum Test error found - save the configuration
: 303 | 1914.62 1747.61 0.00437046 0.000476311 205437 0
: 304 Minimum Test error found - save the configuration
: 304 | 1896.79 1731.81 0.00435111 0.00047828 206568 0
: 305 Minimum Test error found - save the configuration
: 305 | 1879.23 1715.57 0.00436361 0.000477651 205870 0
: 306 Minimum Test error found - save the configuration
: 306 | 1861.42 1699.96 0.0043533 0.00047836 206455 0
: 307 Minimum Test error found - save the configuration
: 307 | 1843.77 1684.68 0.00436144 0.00048009 206114 0
: 308 Minimum Test error found - save the configuration
: 308 | 1826.53 1669.4 0.0043596 0.000477461 206072 0
: 309 Minimum Test error found - save the configuration
: 309 | 1809.77 1654.02 0.00435748 0.000478271 206228 0
: 310 Minimum Test error found - save the configuration
: 310 | 1792.88 1638.98 0.00436077 0.00047908 206096 0
: 311 Minimum Test error found - save the configuration
: 311 | 1775.83 1623.71 0.00435854 0.000476011 206051 0
: 312 Minimum Test error found - save the configuration
: 312 | 1759.2 1608.95 0.00436215 0.000480111 206077 0
: 313 Minimum Test error found - save the configuration
: 313 | 1742.23 1594.8 0.00435287 0.000474111 206252 0
: 314 Minimum Test error found - save the configuration
: 314 | 1726.3 1580.06 0.00440141 0.0004804 204029 0
: 315 Minimum Test error found - save the configuration
: 315 | 1709.58 1566.03 0.00437085 0.000482891 205764 0
: 316 Minimum Test error found - save the configuration
: 316 | 1693.88 1551.25 0.00436544 0.000476662 205720 0
: 317 Minimum Test error found - save the configuration
: 317 | 1677.35 1537.55 0.00437143 0.000480861 205626 0
: 318 Minimum Test error found - save the configuration
: 318 | 1661.75 1523.81 0.00435734 0.00048044 206351 0
: 319 Minimum Test error found - save the configuration
: 319 | 1646.69 1509.04 0.00437137 0.00047956 205560 0
: 320 Minimum Test error found - save the configuration
: 320 | 1630.58 1495.06 0.00436668 0.000480342 205849 0
: 321 Minimum Test error found - save the configuration
: 321 | 1614.62 1481.91 0.00435602 0.000472881 206019 0
: 322 Minimum Test error found - save the configuration
: 322 | 1599.99 1467.56 0.00436449 0.000476611 205768 0
: 323 Minimum Test error found - save the configuration
: 323 | 1583.97 1454.57 0.00447879 0.00048939 200532 0
: 324 Minimum Test error found - save the configuration
: 324 | 1569.55 1441.08 0.00438632 0.000479461 204768 0
: 325 Minimum Test error found - save the configuration
: 325 | 1553.83 1428.26 0.0043869 0.000482041 204873 0
: 326 Minimum Test error found - save the configuration
: 326 | 1539.59 1414.75 0.0043781 0.00047581 205008 0
: 327 Minimum Test error found - save the configuration
: 327 | 1524.83 1401.68 0.00435374 0.00047752 206387 0
: 328 Minimum Test error found - save the configuration
: 328 | 1510.06 1388.94 0.00436558 0.00048031 205906 0
: 329 Minimum Test error found - save the configuration
: 329 | 1495.68 1375.99 0.00435607 0.000476442 206205 0
: 330 Minimum Test error found - save the configuration
: 330 | 1481.54 1363.13 0.00439853 0.00048824 204589 0
: 331 Minimum Test error found - save the configuration
: 331 | 1467.17 1350.53 0.00437616 0.00048022 205342 0
: 332 Minimum Test error found - save the configuration
: 332 | 1452.92 1338.44 0.00437075 0.000478332 205528 0
: 333 Minimum Test error found - save the configuration
: 333 | 1439.5 1325.58 0.00437381 0.000483511 205640 0
: 334 Minimum Test error found - save the configuration
: 334 | 1425.18 1313.72 0.00436946 0.00047716 205534 0
: 335 Minimum Test error found - save the configuration
: 335 | 1411.55 1301.81 0.00436815 0.0004809 205801 0
: 336 Minimum Test error found - save the configuration
: 336 | 1398.26 1289.27 0.00436232 0.000479141 206017 0
: 337 Minimum Test error found - save the configuration
: 337 | 1384.74 1277.27 0.00435357 0.00047576 206302 0
: 338 Minimum Test error found - save the configuration
: 338 | 1371.14 1265.95 0.00436119 0.000484101 206341 0
: 339 Minimum Test error found - save the configuration
: 339 | 1358.39 1253.83 0.00435182 0.000480391 206642 0
: 340 Minimum Test error found - save the configuration
: 340 | 1345.09 1242.22 0.00436132 0.000477271 205971 0
: 341 Minimum Test error found - save the configuration
: 341 | 1332.18 1230.89 0.0043599 0.00047783 206075 0
: 342 Minimum Test error found - save the configuration
: 342 | 1319.42 1219.4 0.00435195 0.000470571 206113 0
: 343 Minimum Test error found - save the configuration
: 343 | 1306.5 1208.13 0.00438211 0.000480822 205061 0
: 344 Minimum Test error found - save the configuration
: 344 | 1293.78 1197.18 0.00436332 0.000479991 206009 0
: 345 Minimum Test error found - save the configuration
: 345 | 1281.66 1185.78 0.00437417 0.00047866 205365 0
: 346 Minimum Test error found - save the configuration
: 346 | 1269.28 1174.41 0.00438936 0.000484562 204876 0
: 347 Minimum Test error found - save the configuration
: 347 | 1256.93 1163.56 0.00434993 0.000478282 206631 0
: 348 Minimum Test error found - save the configuration
: 348 | 1245.55 1152.22 0.00437267 0.000481051 205570 0
: 349 Minimum Test error found - save the configuration
: 349 | 1232.92 1142.06 0.00437002 0.00048005 205657 0
: 350 Minimum Test error found - save the configuration
: 350 | 1220.63 1131.41 0.00436455 0.000472021 205522 0
: 351 Minimum Test error found - save the configuration
: 351 | 1209.35 1120.34 0.00439616 0.000490331 204822 0
: 352 Minimum Test error found - save the configuration
: 352 | 1197.33 1109.92 0.00437347 0.00048126 205539 0
: 353 Minimum Test error found - save the configuration
: 353 | 1185.5 1099.86 0.00438518 0.000479811 204846 0
: 354 Minimum Test error found - save the configuration
: 354 | 1174.48 1089.16 0.00437615 0.00049443 206094 0
: 355 Minimum Test error found - save the configuration
: 355 | 1162.49 1079.31 0.00443898 0.000522601 204270 0
: 356 Minimum Test error found - save the configuration
: 356 | 1151.73 1068.8 0.00438504 0.000481591 204947 0
: 357 Minimum Test error found - save the configuration
: 357 | 1140.71 1058.32 0.0043767 0.000479351 205268 0
: 358 Minimum Test error found - save the configuration
: 358 | 1128.92 1048.74 0.00439535 0.00047777 204208 0
: 359 Minimum Test error found - save the configuration
: 359 | 1118.08 1039.04 0.00436922 0.000485951 206012 0
: 360 Minimum Test error found - save the configuration
: 360 | 1107.82 1029.01 0.00437201 0.000483371 205728 0
: 361 Minimum Test error found - save the configuration
: 361 | 1096.53 1019.73 0.00437768 0.000477761 205133 0
: 362 Minimum Test error found - save the configuration
: 362 | 1086.08 1009.74 0.0043714 0.000479042 205531 0
: 363 Minimum Test error found - save the configuration
: 363 | 1075.17 1000.44 0.00440276 0.00048586 204243 0
: 364 Minimum Test error found - save the configuration
: 364 | 1065.1 990.516 0.00435142 0.000479771 206630 0
: 365 Minimum Test error found - save the configuration
: 365 | 1054.58 981.028 0.00438186 0.000481631 205116 0
: 366 Minimum Test error found - save the configuration
: 366 | 1044.18 971.676 0.00439983 0.000494531 204850 0
: 367 Minimum Test error found - save the configuration
: 367 | 1033.78 962.658 0.00437973 0.000479851 205135 0
: 368 Minimum Test error found - save the configuration
: 368 | 1024.15 953.363 0.00436784 0.00047025 205255 0
: 369 Minimum Test error found - save the configuration
: 369 | 1013.96 944.467 0.00437797 0.000479832 205226 0
: 370 Minimum Test error found - save the configuration
: 370 | 1004.1 935.28 0.00436288 0.000478691 205963 0
: 371 Minimum Test error found - save the configuration
: 371 | 994.499 925.988 0.00438819 0.000491081 205281 0
: 372 Minimum Test error found - save the configuration
: 372 | 984.252 917.105 0.00437308 0.000485761 205798 0
: 373 Minimum Test error found - save the configuration
: 373 | 974.417 908.789 0.0043636 0.000481261 206062 0
: 374 Minimum Test error found - save the configuration
: 374 | 965.537 899.94 0.00439844 0.00048206 204270 0
: 375 Minimum Test error found - save the configuration
: 375 | 956.082 891.375 0.00437965 0.000482911 205300 0
: 376 Minimum Test error found - save the configuration
: 376 | 946.841 882.264 0.00436769 0.000472231 205368 0
: 377 Minimum Test error found - save the configuration
: 377 | 937.023 873.757 0.00434319 0.00047702 206923 0
: 378 Minimum Test error found - save the configuration
: 378 | 927.941 865.742 0.00435343 0.00047739 206396 0
: 379 Minimum Test error found - save the configuration
: 379 | 918.494 857.449 0.00437808 0.000477172 205081 0
: 380 Minimum Test error found - save the configuration
: 380 | 909.752 849.483 0.00435622 0.000486241 206720 0
: 381 Minimum Test error found - save the configuration
: 381 | 900.851 840.951 0.00445078 0.00049816 202398 0
: 382 Minimum Test error found - save the configuration
: 382 | 892.354 832.454 0.00437448 0.000479641 205400 0
: 383 Minimum Test error found - save the configuration
: 383 | 883.119 823.969 0.00438421 0.00048215 205020 0
: 384 Minimum Test error found - save the configuration
: 384 | 873.939 816.425 0.004383 0.000480411 204992 0
: 385 Minimum Test error found - save the configuration
: 385 | 865.66 807.969 0.00437454 0.000484782 205668 0
: 386 Minimum Test error found - save the configuration
: 386 | 857.105 800.262 0.00435846 0.000477131 206115 0
: 387 Minimum Test error found - save the configuration
: 387 | 848.371 792.227 0.00437342 0.00047823 205382 0
: 388 Minimum Test error found - save the configuration
: 388 | 840.073 784.693 0.00436655 0.000480772 205879 0
: 389 Minimum Test error found - save the configuration
: 389 | 831.704 776.928 0.00439004 0.00047205 204187 0
: 390 Minimum Test error found - save the configuration
: 390 | 823.352 769.287 0.00437681 0.00047951 205271 0
: 391 Minimum Test error found - save the configuration
: 391 | 815.117 761.929 0.00440444 0.000483331 204024 0
: 392 Minimum Test error found - save the configuration
: 392 | 807.319 754.025 0.00437963 0.000478091 205047 0
: 393 Minimum Test error found - save the configuration
: 393 | 798.908 746.37 0.00437861 0.000481 205254 0
: 394 Minimum Test error found - save the configuration
: 394 | 790.919 739.251 0.00436365 0.00047215 205576 0
: 395 Minimum Test error found - save the configuration
: 395 | 783.253 732.064 0.00438013 0.00047859 205047 0
: 396 Minimum Test error found - save the configuration
: 396 | 775.36 724.326 0.00440263 0.000482511 204076 0
: 397 Minimum Test error found - save the configuration
: 397 | 767.307 717.304 0.00437391 0.000476731 205277 0
: 398 Minimum Test error found - save the configuration
: 398 | 759.524 710.85 0.00438464 0.00048653 205228 0
: 399 Minimum Test error found - save the configuration
: 399 | 752.482 702.915 0.00436088 0.00047631 205943 0
: 400 Minimum Test error found - save the configuration
: 400 | 744.61 695.616 0.00436234 0.00047863 205989 0
: 401 Minimum Test error found - save the configuration
: 401 | 737.098 689.037 0.00436759 0.000480292 205799 0
: 402 Minimum Test error found - save the configuration
: 402 | 729.747 681.942 0.0043637 0.00047218 205575 0
: 403 Minimum Test error found - save the configuration
: 403 | 722.487 674.827 0.00438338 0.000479471 204923 0
: 404 Minimum Test error found - save the configuration
: 404 | 714.997 668.149 0.00437523 0.000479931 205376 0
: 405 Minimum Test error found - save the configuration
: 405 | 707.766 661.606 0.00439183 0.000497491 205427 0
: 406 Minimum Test error found - save the configuration
: 406 | 700.788 654.72 0.00438829 0.000479511 204668 0
: 407 Minimum Test error found - save the configuration
: 407 | 694.106 648.743 0.00437359 0.000480232 205478 0
: 408 Minimum Test error found - save the configuration
: 408 | 686.772 641.374 0.00438096 0.00047887 205019 0
: 409 Minimum Test error found - save the configuration
: 409 | 679.483 635.592 0.00439231 0.00048279 204629 0
: 410 Minimum Test error found - save the configuration
: 410 | 673.006 628.975 0.00438449 0.000482161 205006 0
: 411 Minimum Test error found - save the configuration
: 411 | 666.015 622.042 0.00435984 0.000478441 206111 0
: 412 Minimum Test error found - save the configuration
: 412 | 659.286 615.715 0.00436848 0.00048013 205743 0
: 413 Minimum Test error found - save the configuration
: 413 | 652.653 609.926 0.00438527 0.000477701 204731 0
: 414 Minimum Test error found - save the configuration
: 414 | 646.1 603.078 0.00438072 0.00048169 205179 0
: 415 Minimum Test error found - save the configuration
: 415 | 638.971 597.267 0.0043637 0.00047197 205564 0
: 416 Minimum Test error found - save the configuration
: 416 | 632.977 590.94 0.00437619 0.000476481 205144 0
: 417 Minimum Test error found - save the configuration
: 417 | 626.297 585.272 0.00436181 0.000478191 205994 0
: 418 Minimum Test error found - save the configuration
: 418 | 619.813 578.616 0.00435763 0.000473511 205967 0
: 419 Minimum Test error found - save the configuration
: 419 | 613.439 572.319 0.00437493 0.000487271 205780 0
: 420 Minimum Test error found - save the configuration
: 420 | 607 567.074 0.00436324 0.000480531 206042 0
: 421 Minimum Test error found - save the configuration
: 421 | 601.098 560.74 0.00438177 0.000480431 205058 0
: 422 Minimum Test error found - save the configuration
: 422 | 594.702 555.088 0.00439275 0.00048363 204650 0
: 423 Minimum Test error found - save the configuration
: 423 | 588.809 549.013 0.00437603 0.00047136 204883 0
: 424 Minimum Test error found - save the configuration
: 424 | 582.66 543.181 0.00437205 0.000478172 205451 0
: 425 Minimum Test error found - save the configuration
: 425 | 576.915 537.58 0.00438074 0.00047884 205029 0
: 426 Minimum Test error found - save the configuration
: 426 | 570.728 531.72 0.00445574 0.000495661 202016 0
: 427 Minimum Test error found - save the configuration
: 427 | 564.858 525.985 0.00439949 0.00048136 204179 0
: 428 Minimum Test error found - save the configuration
: 428 | 558.922 520.83 0.00440915 0.00048095 203656 0
: 429 Minimum Test error found - save the configuration
: 429 | 553.472 515.335 0.00439583 0.000489162 204778 0
: 430 Minimum Test error found - save the configuration
: 430 | 547.483 509.724 0.00438802 0.000481181 204769 0
: 431 Minimum Test error found - save the configuration
: 431 | 541.909 504.356 0.00438095 0.00047895 205023 0
: 432 Minimum Test error found - save the configuration
: 432 | 536.056 499.151 0.00442524 0.000496551 203630 0
: 433 Minimum Test error found - save the configuration
: 433 | 530.632 493.584 0.0044658 0.00048635 201033 0
: 434 Minimum Test error found - save the configuration
: 434 | 525.329 488.422 0.00441375 0.000482261 203485 0
: 435 Minimum Test error found - save the configuration
: 435 | 519.718 483.719 0.00438715 0.00047139 204303 0
: 436 Minimum Test error found - save the configuration
: 436 | 514.462 478.01 0.00440167 0.00048122 204058 0
: 437 Minimum Test error found - save the configuration
: 437 | 509.113 472.611 0.00438353 0.000481191 205005 0
: 438 Minimum Test error found - save the configuration
: 438 | 503.785 467.924 0.00438686 0.00047781 204654 0
: 439 Minimum Test error found - save the configuration
: 439 | 498.812 463.049 0.00440722 0.00048507 203970 0
: 440 Minimum Test error found - save the configuration
: 440 | 493.275 458.763 0.00438271 0.00047341 204640 0
: 441 Minimum Test error found - save the configuration
: 441 | 488.391 453.186 0.00439647 0.000480301 204281 0
: 442 Minimum Test error found - save the configuration
: 442 | 483.221 448.26 0.00439871 0.000491281 204738 0
: 443 Minimum Test error found - save the configuration
: 443 | 477.931 443.6 0.0043846 0.000479871 204880 0
: 444 Minimum Test error found - save the configuration
: 444 | 473.321 439.198 0.00441014 0.00048405 203765 0
: 445 Minimum Test error found - save the configuration
: 445 | 468.268 433.785 0.00438646 0.000472422 204393 0
: 446 Minimum Test error found - save the configuration
: 446 | 463.326 429.222 0.00441123 0.000480971 203549 0
: 447 Minimum Test error found - save the configuration
: 447 | 458.366 424.66 0.00439451 0.00048316 204533 0
: 448 Minimum Test error found - save the configuration
: 448 | 453.665 419.764 0.00440272 0.000480011 203941 0
: 449 Minimum Test error found - save the configuration
: 449 | 448.761 415.281 0.00438218 0.00048049 205040 0
: 450 Minimum Test error found - save the configuration
: 450 | 444.284 410.658 0.00456542 0.000502231 196890 0
: 451 Minimum Test error found - save the configuration
: 451 | 439.37 406.766 0.00443152 0.000491561 203048 0
: 452 Minimum Test error found - save the configuration
: 452 | 434.92 401.856 0.00438536 0.000473671 204515 0
: 453 Minimum Test error found - save the configuration
: 453 | 430.541 397.399 0.00441979 0.00048257 203189 0
: 454 Minimum Test error found - save the configuration
: 454 | 425.934 393.602 0.00445376 0.000498611 202268 0
: 455 Minimum Test error found - save the configuration
: 455 | 421.607 389.325 0.00444614 0.0004833 201876 0
: 456 Minimum Test error found - save the configuration
: 456 | 417.101 384.782 0.00444349 0.000493021 202508 0
: 457 Minimum Test error found - save the configuration
: 457 | 412.541 380.67 0.00444492 0.00048329 201937 0
: 458 Minimum Test error found - save the configuration
: 458 | 408.393 375.866 0.0044398 0.000484091 202240 0
: 459 Minimum Test error found - save the configuration
: 459 | 403.834 372.165 0.00445932 0.000494761 201788 0
: 460 Minimum Test error found - save the configuration
: 460 | 399.865 367.637 0.0044461 0.000485671 201999 0
: 461 Minimum Test error found - save the configuration
: 461 | 395.517 364.053 0.00447046 0.000492971 201132 0
: 462 Minimum Test error found - save the configuration
: 462 | 391.356 360.196 0.00445239 0.000490171 201907 0
: 463 Minimum Test error found - save the configuration
: 463 | 387.248 355.722 0.00459996 0.00049697 194980 0
: 464 Minimum Test error found - save the configuration
: 464 | 382.933 351.807 0.00449707 0.0004885 199573 0
: 465 Minimum Test error found - save the configuration
: 465 | 379.129 347.901 0.0043906 0.00047333 204224 0
: 466 Minimum Test error found - save the configuration
: 466 | 375.122 344.167 0.0044131 0.00048675 203752 0
: 467 Minimum Test error found - save the configuration
: 467 | 371.27 340.213 0.00446746 0.000487001 200982 0
: 468 Minimum Test error found - save the configuration
: 468 | 367.183 336.696 0.00438779 0.000480241 204732 0
: 469 Minimum Test error found - save the configuration
: 469 | 363.165 332.542 0.00442369 0.00048572 203151 0
: 470 Minimum Test error found - save the configuration
: 470 | 359.518 328.866 0.00445925 0.000487891 201443 0
: 471 Minimum Test error found - save the configuration
: 471 | 355.482 324.943 0.00441783 0.000485191 203426 0
: 472 Minimum Test error found - save the configuration
: 472 | 351.746 321.134 0.00444179 0.000481511 202006 0
: 473 Minimum Test error found - save the configuration
: 473 | 347.907 317.685 0.00438886 0.000486451 205002 0
: 474 Minimum Test error found - save the configuration
: 474 | 344.251 314.157 0.00444557 0.000475221 201494 0
: 475 Minimum Test error found - save the configuration
: 475 | 340.631 310.978 0.00438928 0.000478041 204539 0
: 476 Minimum Test error found - save the configuration
: 476 | 336.897 307.336 0.00439533 0.000482401 204451 0
: 477 Minimum Test error found - save the configuration
: 477 | 333.462 304.393 0.00437717 0.000479671 205260 0
: 478 Minimum Test error found - save the configuration
: 478 | 329.993 300.297 0.00438066 0.000479121 205048 0
: 479 Minimum Test error found - save the configuration
: 479 | 326.429 296.992 0.00456868 0.000502902 196764 0
: 480 Minimum Test error found - save the configuration
: 480 | 322.924 293.85 0.0044299 0.000483521 202718 0
: 481 Minimum Test error found - save the configuration
: 481 | 319.521 290.479 0.00443207 0.000492441 203065 0
: 482 Minimum Test error found - save the configuration
: 482 | 316.196 286.922 0.0044278 0.000483801 202840 0
: 483 Minimum Test error found - save the configuration
: 483 | 312.738 283.704 0.00493025 0.000497042 180456 0
: 484 Minimum Test error found - save the configuration
: 484 | 309.326 280.019 0.00438563 0.000483171 204999 0
: 485 Minimum Test error found - save the configuration
: 485 | 305.897 277.017 0.00459169 0.000539622 197430 0
: 486 Minimum Test error found - save the configuration
: 486 | 302.384 274.289 0.00452957 0.000485782 197834 0
: 487 Minimum Test error found - save the configuration
: 487 | 299.278 271.097 0.00439015 0.000484121 204812 0
: 488 Minimum Test error found - save the configuration
: 488 | 296.038 268.306 0.00443881 0.000487721 202476 0
: 489 Minimum Test error found - save the configuration
: 489 | 292.648 264.563 0.00444122 0.000498312 202896 0
: 490 Minimum Test error found - save the configuration
: 490 | 289.608 261.446 0.00448281 0.000496411 200683 0
: 491 Minimum Test error found - save the configuration
: 491 | 286.622 258.447 0.00454483 0.000496671 197621 0
: 492 Minimum Test error found - save the configuration
: 492 | 283.796 256.95 0.00446664 0.000497962 201579 0
: 493 Minimum Test error found - save the configuration
: 493 | 280.46 252.56 0.00446239 0.00050201 202001 0
: 494 Minimum Test error found - save the configuration
: 494 | 276.915 249.761 0.00450092 0.000514281 200670 0
: 495 Minimum Test error found - save the configuration
: 495 | 273.914 246.946 0.00450888 0.000498411 199478 0
: 496 Minimum Test error found - save the configuration
: 496 | 271.206 244.172 0.00453913 0.00049104 197624 0
: 497 Minimum Test error found - save the configuration
: 497 | 268.102 241.144 0.00448114 0.000512791 201595 0
: 498 Minimum Test error found - save the configuration
: 498 | 265.259 238.394 0.00454768 0.000505741 197925 0
: 499 Minimum Test error found - save the configuration
: 499 | 262.361 235.751 0.0045212 0.00048663 198287 0
: 500 Minimum Test error found - save the configuration
: 500 | 259.646 233.488 0.00439395 0.000483911 204602 0
: 501 Minimum Test error found - save the configuration
: 501 | 256.79 230.509 0.00439833 0.000479711 204154 0
: 502 Minimum Test error found - save the configuration
: 502 | 253.771 227.412 0.00438108 0.000486661 205422 0
: 503 Minimum Test error found - save the configuration
: 503 | 250.982 225.586 0.00438758 0.000481731 204821 0
: 504 Minimum Test error found - save the configuration
: 504 | 248.419 221.955 0.00444185 0.00048827 202348 0
: 505 Minimum Test error found - save the configuration
: 505 | 245.494 219.674 0.00438256 0.00048542 205279 0
: 506 Minimum Test error found - save the configuration
: 506 | 242.862 217.668 0.00438894 0.000481621 204744 0
: 507 Minimum Test error found - save the configuration
: 507 | 240.201 214.614 0.00442349 0.000491821 203476 0
: 508 Minimum Test error found - save the configuration
: 508 | 237.564 212.178 0.00437393 0.000479081 205400 0
: 509 Minimum Test error found - save the configuration
: 509 | 234.926 209.94 0.00437519 0.00048046 205406 0
: 510 Minimum Test error found - save the configuration
: 510 | 232.513 207.468 0.00445913 0.00049426 201772 0
: 511 Minimum Test error found - save the configuration
: 511 | 229.733 205.575 0.00440157 0.000480431 204023 0
: 512 Minimum Test error found - save the configuration
: 512 | 227.13 202.639 0.0043846 0.00048051 204914 0
: 513 Minimum Test error found - save the configuration
: 513 | 224.909 200.234 0.00439467 0.0005006 205441 0
: 514 Minimum Test error found - save the configuration
: 514 | 222.345 197.849 0.0043908 0.000490061 205090 0
: 515 Minimum Test error found - save the configuration
: 515 | 220.049 196.336 0.0043696 0.000480831 205721 0
: 516 Minimum Test error found - save the configuration
: 516 | 217.531 193.429 0.00436898 0.000479621 205690 0
: 517 Minimum Test error found - save the configuration
: 517 | 215.1 191.057 0.00434721 0.000483362 207048 0
: 518 Minimum Test error found - save the configuration
: 518 | 212.754 188.521 0.0043409 0.000476171 207000 0
: 519 Minimum Test error found - save the configuration
: 519 | 210.382 186.623 0.00436522 0.000479951 205906 0
: 520 Minimum Test error found - save the configuration
: 520 | 207.998 184.919 0.0043741 0.000479941 205436 0
: 521 Minimum Test error found - save the configuration
: 521 | 205.603 182.392 0.00435415 0.000469872 205959 0
: 522 Minimum Test error found - save the configuration
: 522 | 203.323 179.746 0.00436699 0.000478611 205741 0
: 523 Minimum Test error found - save the configuration
: 523 | 201.34 178.334 0.0043843 0.00048309 205065 0
: 524 Minimum Test error found - save the configuration
: 524 | 198.885 175.607 0.00436656 0.000478332 205749 0
: 525 Minimum Test error found - save the configuration
: 525 | 196.89 174.114 0.00435843 0.00048344 206452 0
: 526 Minimum Test error found - save the configuration
: 526 | 194.584 172.023 0.00439027 0.00049704 205485 0
: 527 Minimum Test error found - save the configuration
: 527 | 192.376 170.525 0.00442388 0.000490772 203402 0
: 528 Minimum Test error found - save the configuration
: 528 | 190.379 168.346 0.00444852 0.000492881 202243 0
: 529 Minimum Test error found - save the configuration
: 529 | 188.4 166.522 0.00443947 0.000494062 202767 0
: 530 Minimum Test error found - save the configuration
: 530 | 186.393 164.388 0.00441711 0.000481781 203287 0
: 531 Minimum Test error found - save the configuration
: 531 | 183.939 161.916 0.00441476 0.000472841 202947 0
: 532 Minimum Test error found - save the configuration
: 532 | 181.821 160.103 0.00443038 0.00049285 203173 0
: 533 Minimum Test error found - save the configuration
: 533 | 179.656 158.233 0.00443163 0.00048337 202621 0
: 534 Minimum Test error found - save the configuration
: 534 | 177.78 156.408 0.00441449 0.000481451 203405 0
: 535 Minimum Test error found - save the configuration
: 535 | 175.755 154.941 0.00443252 0.00049316 203079 0
: 536 Minimum Test error found - save the configuration
: 536 | 173.93 152.136 0.0044156 0.000482952 203425 0
: 537 Minimum Test error found - save the configuration
: 537 | 171.58 150.76 0.00441815 0.000490971 203709 0
: 538 Minimum Test error found - save the configuration
: 538 | 169.733 148.762 0.00440163 0.00048111 204055 0
: 539 Minimum Test error found - save the configuration
: 539 | 167.756 146.941 0.00441784 0.00047981 203147 0
: 540 Minimum Test error found - save the configuration
: 540 | 165.931 145.103 0.00441905 0.00049062 203644 0
: 541 Minimum Test error found - save the configuration
: 541 | 163.921 143.924 0.0044134 0.000488062 203804 0
: 542 Minimum Test error found - save the configuration
: 542 | 162.101 142.39 0.00443687 0.000483931 202381 0
: 543 Minimum Test error found - save the configuration
: 543 | 160.218 141.225 0.00442145 0.000491921 203587 0
: 544 Minimum Test error found - save the configuration
: 544 | 158.388 138.506 0.00442682 0.00048547 202976 0
: 545 Minimum Test error found - save the configuration
: 545 | 156.673 136.951 0.00441468 0.00049238 203962 0
: 546 Minimum Test error found - save the configuration
: 546 | 154.739 136.397 0.00444093 0.00049539 202761 0
: 547 Minimum Test error found - save the configuration
: 547 | 153.159 134.005 0.00442566 0.00048116 202814 0
: 548 Minimum Test error found - save the configuration
: 548 | 151.073 132.388 0.00444444 0.000490272 202318 0
: 549 Minimum Test error found - save the configuration
: 549 | 149.25 130.478 0.00441661 0.00049183 203833 0
: 550 Minimum Test error found - save the configuration
: 550 | 147.908 128.626 0.00442624 0.000480901 202771 0
: 551 Minimum Test error found - save the configuration
: 551 | 145.886 127.633 0.00442608 0.00049052 203275 0
: 552 Minimum Test error found - save the configuration
: 552 | 144.235 126.487 0.00440729 0.00048309 203863 0
: 553 Minimum Test error found - save the configuration
: 553 | 142.936 125.403 0.0044074 0.000480631 203730 0
: 554 Minimum Test error found - save the configuration
: 554 | 140.799 123.035 0.00442308 0.000495311 203678 0
: 555 Minimum Test error found - save the configuration
: 555 | 139.133 121.71 0.00445992 0.00048296 201159 0
: 556 Minimum Test error found - save the configuration
: 556 | 137.486 119.841 0.00443276 0.0004836 202575 0
: 557 Minimum Test error found - save the configuration
: 557 | 135.963 118.603 0.00443688 0.000490871 202737 0
: 558 Minimum Test error found - save the configuration
: 558 | 134.438 117.306 0.0044254 0.00048496 203023 0
: 559 Minimum Test error found - save the configuration
: 559 | 133.237 116.31 0.00443712 0.000489031 202630 0
: 560 Minimum Test error found - save the configuration
: 560 | 131.158 114.005 0.00441065 0.000491681 204135 0
: 561 Minimum Test error found - save the configuration
: 561 | 129.54 112.84 0.004436 0.000477021 202072 0
: 562 Minimum Test error found - save the configuration
: 562 | 128.322 111.345 0.00443115 0.000491061 203041 0
: 563 Minimum Test error found - save the configuration
: 563 | 126.562 110.032 0.00443421 0.000482591 202449 0
: 564 Minimum Test error found - save the configuration
: 564 | 125.051 109.708 0.00439717 0.00047922 204189 0
: 565 Minimum Test error found - save the configuration
: 565 | 123.665 107.591 0.00439743 0.00048833 204651 0
: 566 Minimum Test error found - save the configuration
: 566 | 122.205 106.118 0.00438886 0.000477671 204542 0
: 567 Minimum Test error found - save the configuration
: 567 | 120.688 104.919 0.00440806 0.000490311 204199 0
: 568 Minimum Test error found - save the configuration
: 568 | 119.152 103.724 0.00442761 0.0004892 203128 0
: 569 Minimum Test error found - save the configuration
: 569 | 117.839 102.082 0.00443198 0.000482261 202546 0
: 570 Minimum Test error found - save the configuration
: 570 | 116.457 100.797 0.00449844 0.00052531 201353 0
: 571 Minimum Test error found - save the configuration
: 571 | 115.095 100.296 0.00441701 0.000492781 203862 0
: 572 Minimum Test error found - save the configuration
: 572 | 113.67 98.2047 0.00442742 0.000483741 202856 0
: 573 Minimum Test error found - save the configuration
: 573 | 112.408 97.1831 0.00445446 0.000492442 201917 0
: 574 Minimum Test error found - save the configuration
: 574 | 111.015 96.3994 0.00442934 0.000492901 203230 0
: 575 Minimum Test error found - save the configuration
: 575 | 109.782 94.9384 0.00441325 0.000470902 202925 0
: 576 Minimum Test error found - save the configuration
: 576 | 108.376 93.4875 0.00443256 0.00049579 203212 0
: 577 Minimum Test error found - save the configuration
: 577 | 107.059 92.9041 0.00441831 0.000483211 203299 0
: 578 Minimum Test error found - save the configuration
: 578 | 105.777 91.1382 0.00441363 0.00047968 203358 0
: 579 Minimum Test error found - save the configuration
: 579 | 104.427 90.023 0.004431 0.000490171 203003 0
: 580 Minimum Test error found - save the configuration
: 580 | 103.239 89.1582 0.00442596 0.00048355 202922 0
: 581 Minimum Test error found - save the configuration
: 581 | 102.212 87.6056 0.0045082 0.00050538 199859 0
: 582 Minimum Test error found - save the configuration
: 582 | 101.095 86.9511 0.00447852 0.00048775 200463 0
: 583 Minimum Test error found - save the configuration
: 583 | 99.7178 85.8417 0.0044837 0.000494171 200525 0
: 584 Minimum Test error found - save the configuration
: 584 | 98.6575 85.1459 0.00448101 0.00049199 200551 0
: 585 Minimum Test error found - save the configuration
: 585 | 97.2128 84.4851 0.00443106 0.000482811 202622 0
: 586 Minimum Test error found - save the configuration
: 586 | 96.444 82.8384 0.00443503 0.000491151 202846 0
: 587 Minimum Test error found - save the configuration
: 587 | 95.3278 82.2198 0.00442581 0.00050242 203905 0
: 588 Minimum Test error found - save the configuration
: 588 | 94.0679 80.8514 0.00440247 0.000483671 204144 0
: 589 | 92.9687 80.94 0.00440938 0.000458161 202469 1
: 590 Minimum Test error found - save the configuration
: 590 | 91.945 78.7339 0.00440897 0.000484392 203844 0
: 591 Minimum Test error found - save the configuration
: 591 | 90.6401 78.1594 0.00442042 0.000480741 203062 0
: 592 Minimum Test error found - save the configuration
: 592 | 89.6089 77.1335 0.00443904 0.000493341 202753 0
: 593 Minimum Test error found - save the configuration
: 593 | 88.4841 75.3584 0.00443828 0.000485511 202390 0
: 594 Minimum Test error found - save the configuration
: 594 | 87.4479 74.2656 0.00446741 0.000498362 201560 0
: 595 Minimum Test error found - save the configuration
: 595 | 86.3297 73.3662 0.00442051 0.000484941 203274 0
: 596 Minimum Test error found - save the configuration
: 596 | 85.2543 72.3756 0.00444655 0.000493491 202375 0
: 597 | 84.2716 73.3095 0.00446668 0.000459072 199620 1
: 598 Minimum Test error found - save the configuration
: 598 | 83.3877 71.386 0.00448154 0.000489841 200416 0
: 599 Minimum Test error found - save the configuration
: 599 | 82.5619 70.5034 0.0044774 0.000499 201086 0
: 600 Minimum Test error found - save the configuration
: 600 | 81.5287 69.0625 0.00447974 0.000503521 201196 0
: 601 Minimum Test error found - save the configuration
: 601 | 80.735 67.9937 0.00447691 0.000492831 200799 0
: 602 Minimum Test error found - save the configuration
: 602 | 79.7184 67.4278 0.00449076 0.000494851 200205 0
: 603 Minimum Test error found - save the configuration
: 603 | 78.6038 66.5199 0.00446469 0.000484041 200972 0
: 604 Minimum Test error found - save the configuration
: 604 | 77.5114 65.2682 0.00444446 0.00048443 202019 0
: 605 | 76.8054 65.5835 0.00438946 0.000458941 203536 1
: 606 Minimum Test error found - save the configuration
: 606 | 76.0026 64.4146 0.00443838 0.00049675 202962 0
: 607 Minimum Test error found - save the configuration
: 607 | 75.0731 63.1365 0.00452258 0.000505481 199149 0
: 608 Minimum Test error found - save the configuration
: 608 | 74.4641 62.8786 0.00448299 0.00050006 200857 0
: 609 Minimum Test error found - save the configuration
: 609 | 73.6978 61.7982 0.00444908 0.000494611 202303 0
: 610 Minimum Test error found - save the configuration
: 610 | 72.4115 60.9433 0.00439279 0.000475341 204215 0
: 611 Minimum Test error found - save the configuration
: 611 | 71.5405 60.0173 0.0043809 0.00048122 205145 0
: 612 Minimum Test error found - save the configuration
: 612 | 70.839 59.0196 0.00437017 0.000477221 205500 0
: 613 Minimum Test error found - save the configuration
: 613 | 69.8151 57.9404 0.00440518 0.000492291 204453 0
: 614 Minimum Test error found - save the configuration
: 614 | 68.9894 57.0225 0.00442903 0.000479721 202567 0
: 615 Minimum Test error found - save the configuration
: 615 | 68.209 56.6219 0.00444756 0.000491731 202233 0
: 616 Minimum Test error found - save the configuration
: 616 | 67.2848 55.7327 0.00444296 0.00050556 203180 0
: 617 Minimum Test error found - save the configuration
: 617 | 66.422 54.7475 0.0044246 0.00048541 203088 0
: 618 Minimum Test error found - save the configuration
: 618 | 65.5663 54.7261 0.00442983 0.000494761 203300 0
: 619 Minimum Test error found - save the configuration
: 619 | 65.0131 53.9615 0.00449159 0.00049189 200015 0
: 620 Minimum Test error found - save the configuration
: 620 | 64.2008 52.8174 0.00448777 0.000495491 200387 0
: 621 | 63.8361 52.8491 0.00439656 0.000464041 203432 1
: 622 | 62.8873 52.9024 0.00440614 0.000451021 202270 2
: 623 Minimum Test error found - save the configuration
: 623 | 62.3449 51.4295 0.00442854 0.000493332 203293 0
: 624 Minimum Test error found - save the configuration
: 624 | 61.1111 49.8905 0.00441294 0.00048717 203782 0
: 625 Minimum Test error found - save the configuration
: 625 | 60.4249 49.7199 0.00446527 0.000505462 202030 0
: 626 Minimum Test error found - save the configuration
: 626 | 59.6618 48.9246 0.00445649 0.00048512 201442 0
: 627 Minimum Test error found - save the configuration
: 627 | 58.7807 48.4002 0.00443313 0.000482181 202483 0
: 628 Minimum Test error found - save the configuration
: 628 | 58.3064 47.6795 0.00442762 0.000480831 202697 0
: 629 Minimum Test error found - save the configuration
: 629 | 57.468 47.0295 0.00445414 0.000483852 201497 0
: 630 Minimum Test error found - save the configuration
: 630 | 56.855 46.1282 0.00438648 0.000482791 204935 0
: 631 Minimum Test error found - save the configuration
: 631 | 56.223 45.4624 0.00436255 0.00047702 205892 0
: 632 Minimum Test error found - save the configuration
: 632 | 55.5756 45.368 0.00438544 0.000488691 205300 0
: 633 Minimum Test error found - save the configuration
: 633 | 54.9343 44.5977 0.00437229 0.000480351 205553 0
: 634 Minimum Test error found - save the configuration
: 634 | 54.2364 43.9861 0.00443479 0.000482391 202409 0
: 635 Minimum Test error found - save the configuration
: 635 | 53.5883 43.0195 0.00442222 0.000481331 203000 0
: 636 Minimum Test error found - save the configuration
: 636 | 52.8318 42.3 0.00444843 0.00049284 202246 0
: 637 Minimum Test error found - save the configuration
: 637 | 52.2295 41.5327 0.00445364 0.000505811 202643 0
: 638 Minimum Test error found - save the configuration
: 638 | 51.5003 40.805 0.00443217 0.00047981 202411 0
: 639 Minimum Test error found - save the configuration
: 639 | 51.0154 40.4492 0.00442681 0.000492992 203365 0
: 640 Minimum Test error found - save the configuration
: 640 | 50.2885 40.304 0.00443048 0.000472961 202147 0
: 641 Minimum Test error found - save the configuration
: 641 | 50.1785 39.2856 0.00447126 0.000491091 200997 0
: 642 | 49.515 39.7798 0.00447567 0.00046444 199440 1
: 643 | 48.7275 40.1565 0.00440467 0.000450941 202341 2
: 644 Minimum Test error found - save the configuration
: 644 | 48.2608 38.2468 0.00442831 0.00048657 202956 0
: 645 Minimum Test error found - save the configuration
: 645 | 47.5784 37.8157 0.00444968 0.000488412 201956 0
: 646 Minimum Test error found - save the configuration
: 646 | 47.0825 36.5925 0.0044237 0.00048451 203088 0
: 647 | 46.5124 36.6809 0.004412 0.000460431 202451 1
: 648 Minimum Test error found - save the configuration
: 648 | 45.8005 35.9684 0.00442776 0.00050107 203734 0
: 649 Minimum Test error found - save the configuration
: 649 | 45.1444 34.9308 0.00443568 0.000475421 202007 0
: 650 Minimum Test error found - save the configuration
: 650 | 44.5763 34.6379 0.00444279 0.000493701 202579 0
: 651 Minimum Test error found - save the configuration
: 651 | 43.9324 34.172 0.00446237 0.000485251 201151 0
: 652 Minimum Test error found - save the configuration
: 652 | 43.6057 34.1415 0.00443196 0.00048301 202586 0
: 653 Minimum Test error found - save the configuration
: 653 | 43.2296 33.1077 0.00443732 0.000492011 202773 0
: 654 Minimum Test error found - save the configuration
: 654 | 42.6187 32.5506 0.00442291 0.000480501 202922 0
: 655 Minimum Test error found - save the configuration
: 655 | 42.082 32.4789 0.00444965 0.00049611 202351 0
: 656 Minimum Test error found - save the configuration
: 656 | 41.5805 31.4064 0.00445638 0.000499141 202161 0
: 657 | 40.9212 31.408 0.00440102 0.00045127 202545 1
: 658 Minimum Test error found - save the configuration
: 658 | 40.5565 31.1748 0.0044445 0.000489142 202257 0
: 659 Minimum Test error found - save the configuration
: 659 | 40.3162 30.1185 0.00445801 0.000491321 201680 0
: 660 | 39.9412 30.254 0.00440579 0.000450741 202273 1
: 661 Minimum Test error found - save the configuration
: 661 | 39.3595 29.1886 0.00445804 0.000494461 201838 0
: 662 Minimum Test error found - save the configuration
: 662 | 38.6824 29.102 0.0044257 0.00048132 202820 0
: 663 Minimum Test error found - save the configuration
: 663 | 38.1042 28.4742 0.00445716 0.00049185 201750 0
: 664 Minimum Test error found - save the configuration
: 664 | 37.6142 28.044 0.00442898 0.00049198 203201 0
: 665 | 37.4017 28.061 0.00440834 0.000449401 202074 1
: 666 Minimum Test error found - save the configuration
: 666 | 36.9134 27.536 0.00446099 0.00050302 202124 0
: 667 Minimum Test error found - save the configuration
: 667 | 36.4703 27.0168 0.0044262 0.000476732 202559 0
: 668 Minimum Test error found - save the configuration
: 668 | 36.0273 26.6166 0.00444074 0.000483241 202148 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.4125 26.4554 0.00445594 0.000494511 201947 0
: 670 Minimum Test error found - save the configuration
: 670 | 34.9623 25.9774 0.00443064 0.000480901 202545 0
: 671 Minimum Test error found - save the configuration
: 671 | 34.9017 25.2976 0.00444563 0.000491852 202338 0
: 672 Minimum Test error found - save the configuration
: 672 | 34.4789 24.8513 0.00443004 0.000491271 203109 0
: 673 Minimum Test error found - save the configuration
: 673 | 33.8693 24.6044 0.00447866 0.000485882 200362 0
: 674 Minimum Test error found - save the configuration
: 674 | 33.3939 24.3061 0.00446301 0.000496081 201668 0
: 675 Minimum Test error found - save the configuration
: 675 | 33.3689 23.4891 0.00445561 0.000485171 201489 0
: 676 Minimum Test error found - save the configuration
: 676 | 32.7037 23.4478 0.00445642 0.000495091 201953 0
: 677 Minimum Test error found - save the configuration
: 677 | 32.2869 22.9705 0.00442767 0.000498301 203595 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.6803 22.1309 0.00443292 0.000475481 202151 0
: 679 | 31.3341 22.1502 0.0044796 0.00047114 199578 1
: 680 Minimum Test error found - save the configuration
: 680 | 30.9531 21.639 0.00449052 0.000496111 200280 0
: 681 Minimum Test error found - save the configuration
: 681 | 30.611 21.3519 0.00452086 0.000502471 199085 0
: 682 Minimum Test error found - save the configuration
: 682 | 30.1594 21.3335 0.00447224 0.000477082 200243 0
: 683 Minimum Test error found - save the configuration
: 683 | 29.8554 20.7264 0.00448717 0.000485111 199897 0
: 684 Minimum Test error found - save the configuration
: 684 | 29.4967 20.2005 0.00444859 0.000494251 202310 0
: 685 Minimum Test error found - save the configuration
: 685 | 29.0173 20.0724 0.00444333 0.00048413 202061 0
: 686 | 28.7158 20.3404 0.00443694 0.000462621 201292 1
: 687 Minimum Test error found - save the configuration
: 687 | 28.3124 19.3452 0.00459963 0.000493182 194816 0
: 688 Minimum Test error found - save the configuration
: 688 | 27.9949 18.9842 0.00451873 0.00048683 198418 0
: 689 Minimum Test error found - save the configuration
: 689 | 27.5343 18.4503 0.00443762 0.000491781 202745 0
: 690 | 27.2452 18.7123 0.0044038 0.000461921 202949 1
: 691 Minimum Test error found - save the configuration
: 691 | 26.9435 18.0155 0.00445033 0.000484912 201744 0
: 692 Minimum Test error found - save the configuration
: 692 | 26.7057 17.6876 0.00445143 0.00048583 201735 0
: 693 | 26.5482 18.3141 0.00441273 0.000448951 201828 1
: 694 Minimum Test error found - save the configuration
: 694 | 26.0928 17.3563 0.00446599 0.00050507 201973 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.749 17.0257 0.00445229 0.000495782 202199 0
: 696 Minimum Test error found - save the configuration
: 696 | 25.1788 16.4754 0.00443465 0.000494811 203054 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.7593 16.2346 0.00446817 0.000477712 200478 0
: 698 | 24.5664 16.4199 0.00441908 0.00045268 201694 1
: 699 Minimum Test error found - save the configuration
: 699 | 24.1966 15.7495 0.00445213 0.000494281 202130 0
: 700 Minimum Test error found - save the configuration
: 700 | 24.1057 15.2809 0.00445142 0.000483861 201636 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.6404 15.1719 0.00449502 0.000505771 200539 0
: 702 Minimum Test error found - save the configuration
: 702 | 23.2537 14.9806 0.00449127 0.000486161 199745 0
: 703 Minimum Test error found - save the configuration
: 703 | 22.9829 14.6509 0.00446575 0.00049244 201344 0
: 704 | 22.6905 15.6695 0.00439495 0.00045214 202901 1
: 705 Minimum Test error found - save the configuration
: 705 | 22.2637 13.864 0.00444441 0.000497482 202689 0
: 706 | 21.9626 13.9512 0.0044259 0.000462081 201826 1
: 707 Minimum Test error found - save the configuration
: 707 | 21.7416 13.7485 0.00444223 0.000494862 202667 0
: 708 Minimum Test error found - save the configuration
: 708 | 21.3026 13.717 0.00443179 0.000476031 202237 0
: 709 Minimum Test error found - save the configuration
: 709 | 21.0496 13.0673 0.00445028 0.000493361 202178 0
: 710 Minimum Test error found - save the configuration
: 710 | 20.7526 12.9376 0.00444754 0.00047678 201473 0
: 711 Minimum Test error found - save the configuration
: 711 | 20.571 12.585 0.00445166 0.000493972 202138 0
: 712 Minimum Test error found - save the configuration
: 712 | 20.2273 12.2087 0.0044714 0.00051163 202032 0
: 713 | 19.9151 12.3693 0.00441265 0.000453372 202057 1
: 714 Minimum Test error found - save the configuration
: 714 | 19.6462 11.9414 0.00444116 0.00048711 202324 0
: 715 | 19.4252 12.1376 0.00442267 0.000452221 201489 1
: 716 Minimum Test error found - save the configuration
: 716 | 19.2618 11.6345 0.00444146 0.00048655 202280 0
: 717 Minimum Test error found - save the configuration
: 717 | 18.9622 11.3666 0.0044559 0.000490751 201758 0
: 718 Minimum Test error found - save the configuration
: 718 | 18.6512 11.0382 0.00443209 0.00049289 203087 0
: 719 | 18.3856 11.5836 0.00440817 0.000449821 202105 1
: 720 Minimum Test error found - save the configuration
: 720 | 18.3235 10.5965 0.00443889 0.00048266 202213 0
: 721 Minimum Test error found - save the configuration
: 721 | 17.9715 10.4664 0.00443389 0.00047972 202318 0
: 722 | 17.6054 10.7253 0.00446716 0.00045111 199201 1
: 723 Minimum Test error found - save the configuration
: 723 | 17.3711 10.0362 0.00445794 0.00049968 202109 0
: 724 | 17.2224 10.372 0.00443323 0.00046002 201349 1
: 725 Minimum Test error found - save the configuration
: 725 | 16.9842 9.8672 0.00444091 0.00048579 202270 0
: 726 Minimum Test error found - save the configuration
: 726 | 16.9177 9.65554 0.00445518 0.00049375 201947 0
: 727 Minimum Test error found - save the configuration
: 727 | 16.5504 9.47622 0.00444897 0.000485751 201856 0
: 728 Minimum Test error found - save the configuration
: 728 | 16.3192 9.23477 0.00446164 0.000491501 201504 0
: 729 Minimum Test error found - save the configuration
: 729 | 16.0584 9.05541 0.00443753 0.00050006 203176 0
: 730 | 15.8926 9.10714 0.00439414 0.000450831 202875 1
: 731 Minimum Test error found - save the configuration
: 731 | 15.6935 8.5567 0.00447001 0.000491301 201070 0
: 732 | 15.6768 10.1103 0.00442694 0.000451561 201239 1
: 733 Minimum Test error found - save the configuration
: 733 | 15.5406 8.50777 0.00447337 0.000486691 200668 0
: 734 Minimum Test error found - save the configuration
: 734 | 15.2 8.17193 0.00444429 0.000495152 202576 0
: 735 | 14.9806 9.44452 0.00441413 0.000459251 202282 1
: 736 Minimum Test error found - save the configuration
: 736 | 14.9855 7.89997 0.00443319 0.000494061 203091 0
: 737 | 14.611 7.98098 0.00443157 0.000448271 200839 1
: 738 Minimum Test error found - save the configuration
: 738 | 14.2047 7.73048 0.00444776 0.000485262 201893 0
: 739 Minimum Test error found - save the configuration
: 739 | 14.0758 7.5347 0.00442722 0.000478161 202580 0
: 740 | 14.1345 8.41906 0.00442081 0.000459961 201977 1
: 741 Minimum Test error found - save the configuration
: 741 | 13.8793 7.26047 0.00450557 0.000504791 199961 0
: 742 Minimum Test error found - save the configuration
: 742 | 13.507 7.19974 0.00449163 0.000496611 200250 0
: 743 Minimum Test error found - save the configuration
: 743 | 13.3355 6.89185 0.00447381 0.00048922 200774 0
: 744 Minimum Test error found - save the configuration
: 744 | 13.29 6.762 0.00445823 0.00049388 201799 0
: 745 Minimum Test error found - save the configuration
: 745 | 13.0647 6.51286 0.00444112 0.000486341 202287 0
: 746 Minimum Test error found - save the configuration
: 746 | 12.7843 6.42341 0.00445195 0.00048991 201916 0
: 747 | 12.5732 6.48992 0.00440994 0.000462771 202677 1
: 748 Minimum Test error found - save the configuration
: 748 | 12.4228 6.24064 0.00443975 0.000482462 202159 0
: 749 Minimum Test error found - save the configuration
: 749 | 12.264 6.09526 0.00445553 0.00050249 202376 0
: 750 | 12.148 6.10618 0.00441203 0.000444261 201625 1
: 751 | 11.8688 6.14221 0.00439302 0.00045017 202899 2
: 752 Minimum Test error found - save the configuration
: 752 | 11.7909 5.89573 0.00445739 0.000497651 202034 0
: 753 Minimum Test error found - save the configuration
: 753 | 11.5838 5.64336 0.00444469 0.000483061 201937 0
: 754 | 11.7308 6.2978 0.0044243 0.00045488 201541 1
: 755 Minimum Test error found - save the configuration
: 755 | 11.5334 5.48831 0.00445312 0.000492911 202010 0
: 756 | 11.2108 6.06484 0.00441165 0.000453361 202108 1
: 757 | 11.217 6.77567 0.00444116 0.000458561 200874 2
: 758 Minimum Test error found - save the configuration
: 758 | 11.1623 5.27608 0.00442469 0.00048704 203167 0
: 759 | 10.8668 5.50175 0.00440018 0.000442831 202156 1
: 760 Minimum Test error found - save the configuration
: 760 | 10.6372 5.04213 0.00444696 0.00049304 202331 0
: 761 Minimum Test error found - save the configuration
: 761 | 10.6627 4.9602 0.004429 0.000483911 202784 0
: 762 | 10.4255 5.04958 0.00441655 0.000451461 201761 1
: 763 | 10.0971 5.18479 0.00441467 0.000458192 202200 2
: 764 Minimum Test error found - save the configuration
: 764 | 10.0081 4.72031 0.00444992 0.00048418 201728 0
: 765 | 9.84938 5.41113 0.00442076 0.00046161 202064 1
: 766 Minimum Test error found - save the configuration
: 766 | 9.85489 4.47602 0.00443776 0.00049231 202765 0
: 767 Minimum Test error found - save the configuration
: 767 | 9.65874 4.37254 0.00444794 0.000490591 202156 0
: 768 | 9.67163 4.49597 0.00441928 0.000453771 201740 1
: 769 | 9.2847 4.51356 0.00442384 0.00045126 201381 2
: 770 Minimum Test error found - save the configuration
: 770 | 9.21384 4.2083 0.00445284 0.00048651 201698 0
: 771 Minimum Test error found - save the configuration
: 771 | 9.22578 4.0066 0.00446689 0.00049362 201346 0
: 772 | 9.21421 4.4426 0.00440957 0.00045037 202061 1
: 773 | 9.1655 4.22699 0.00443405 0.000464691 201544 2
: 774 Minimum Test error found - save the configuration
: 774 | 8.95093 3.83821 0.00445416 0.000494982 202062 0
: 775 | 8.8254 3.98311 0.00441762 0.000449111 201587 1
: 776 Minimum Test error found - save the configuration
: 776 | 8.70893 3.69105 0.00445197 0.000501371 202501 0
: 777 | 8.6675 3.71303 0.00440452 0.000443651 201976 1
: 778 Minimum Test error found - save the configuration
: 778 | 8.39817 3.57649 0.00442807 0.000485912 202935 0
: 779 | 8.35366 4.02624 0.00441699 0.000460991 202225 1
: 780 | 8.1394 4.2256 0.00440612 0.000452351 202339 2
: 781 | 8.12844 3.79306 0.00443526 0.000464141 201455 3
: 782 | 8.01152 3.88244 0.00443527 0.00046021 201255 4
: 783 | 7.86697 3.67976 0.00438707 0.000447951 203091 5
: 784 | 8.4559 5.01588 0.00439607 0.00044937 202701 6
: 785 | 8.00835 3.90155 0.00440761 0.000458481 202577 7
: 786 | 7.63164 3.82278 0.00438598 0.000449281 203216 8
: 787 | 7.49464 3.88209 0.00441716 0.000459661 202148 9
: 788 Minimum Test error found - save the configuration
: 788 | 7.50234 3.27028 0.00446479 0.000491472 201343 0
: 789 | 7.46779 4.51384 0.00442427 0.00044832 201210 1
: 790 | 7.22856 3.71601 0.00439777 0.000458622 203090 2
: 791 | 7.23093 3.64701 0.00440914 0.000442641 201689 3
: 792 Minimum Test error found - save the configuration
: 792 | 7.1149 3.1976 0.00446061 0.000492582 201612 0
: 793 | 7.04152 3.66186 0.00442154 0.000460651 201975 1
: 794 | 6.89481 4.24928 0.00447912 0.000459381 199018 2
: 795 | 6.87152 3.38291 0.00448755 0.000478671 199557 3
: 796 | 6.91356 4.08663 0.00445712 0.00045294 199791 4
: 797 Minimum Test error found - save the configuration
: 797 | 6.57798 3.15908 0.00448942 0.00049794 200427 0
: 798 | 6.5601 3.31923 0.0044656 0.00047011 200226 1
: 799 | 6.48338 3.18713 0.00449788 0.000461592 198202 2
: 800 Minimum Test error found - save the configuration
: 800 | 6.28672 3.13117 0.00453451 0.000508901 198728 0
: 801 Minimum Test error found - save the configuration
: 801 | 6.32693 2.98892 0.00445269 0.00048446 201601 0
: 802 Minimum Test error found - save the configuration
: 802 | 6.2294 2.95505 0.00445286 0.000493041 202030 0
: 803 | 6.13282 3.12195 0.00441518 0.00045118 201816 1
: 804 Minimum Test error found - save the configuration
: 804 | 6.07191 2.95292 0.0044481 0.0004841 201817 0
: 805 Minimum Test error found - save the configuration
: 805 | 6.14236 2.75985 0.00446693 0.000495901 201459 0
: 806 | 6.06274 2.92042 0.00441012 0.000444271 201722 1
: 807 | 5.90464 2.96672 0.00443913 0.000467291 201418 2
: 808 | 5.81496 3.7339 0.00439674 0.00046246 203341 3
: 809 | 5.67948 3.11666 0.00441875 0.00045025 201588 4
: 810 | 5.58964 3.06566 0.00442772 0.00046172 201715 5
: 811 Minimum Test error found - save the configuration
: 811 | 5.44626 2.69809 0.00445629 0.00048495 201444 0
: 812 | 5.43553 2.73509 0.00441357 0.00045142 201911 1
: 813 | 5.42953 2.88521 0.0044124 0.00045692 202251 2
: 814 | 5.45973 2.8917 0.00443905 0.000454791 200790 3
: 815 | 5.46768 3.52006 0.00438314 0.0004405 202910 4
: 816 Minimum Test error found - save the configuration
: 816 | 5.36734 2.59459 0.00445344 0.000498842 202296 0
: 817 | 5.42008 3.63076 0.00440094 0.00045147 202559 1
: 818 Minimum Test error found - save the configuration
: 818 | 5.34103 2.41662 0.00446074 0.000496441 201801 0
: 819 | 5.05792 2.89542 0.00442268 0.000461471 201959 1
: 820 | 4.99968 3.62776 0.00440837 0.000449321 202069 2
: 821 | 5.02436 2.83914 0.00441922 0.000462521 202189 3
: 822 | 5.06235 2.69658 0.00440074 0.000443631 202168 4
: 823 | 4.90617 3.50447 0.00441301 0.000448582 201795 5
: 824 | 4.75218 2.94795 0.00441623 0.00045846 202134 6
: 825 | 4.72072 3.25696 0.00441572 0.000451201 201790 7
: 826 | 4.80301 2.60753 0.00440964 0.000450881 202084 8
: 827 | 4.75285 2.89552 0.00443769 0.000461881 201217 9
: 828 | 4.53758 2.87352 0.00440267 0.00045235 202515 10
: 829 | 4.50903 3.18903 0.00453523 0.000453271 195985 11
: 830 | 4.39338 3.07717 0.0044694 0.000451461 199107 12
: 831 | 4.28927 2.82749 0.00441907 0.00045818 201975 13
: 832 | 4.25542 3.18112 0.00442531 0.00045411 201451 14
: 833 | 4.32996 2.54769 0.00437816 0.00045179 203751 15
: 834 | 4.48936 4.61295 0.00440837 0.000453191 202267 16
: 835 | 4.40942 3.65413 0.00433804 0.00044959 205738 17
: 836 | 4.27346 2.86729 0.00433486 0.0004404 205420 18
: 837 | 4.11596 2.57676 0.00434449 0.000447861 205306 19
: 838 | 4.06028 2.84186 0.00434613 0.000447852 205219 20
: 839 | 4.02205 4.76778 0.00433706 0.0004435 205468 21
:
: Elapsed time for training with 1000 events: 3.72 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00586 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.834 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.158 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.31515e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.08897e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.041 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0368 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00139 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0496 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.896 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0198 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00258 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0375 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00438 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00186 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000368 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.049 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00566 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.891 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.1 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -1.35 -0.186 10.0 2.21 | 3.066 3.080
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.195 0.0148 2.10 1.13 | 3.375 3.361
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.