Logo ROOT  
Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example:

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.279 sec
: Elapsed time for training with 1000 events: 0.282 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0027 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000826 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00433 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000234 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000343 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31496.7
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33066.5 31139.2 0.00445593 0.000550313 204833 0
: 2 Minimum Test error found - save the configuration
: 2 | 32561.8 30552.2 0.00420967 0.000470473 213950 0
: 3 Minimum Test error found - save the configuration
: 3 | 31785.1 29820.8 0.00459245 0.000521903 196534 0
: 4 Minimum Test error found - save the configuration
: 4 | 30992 29126.4 0.0044614 0.000490864 201484 0
: 5 Minimum Test error found - save the configuration
: 5 | 30206.6 28352.3 0.00439722 0.000482003 204331 0
: 6 Minimum Test error found - save the configuration
: 6 | 29361.3 27415.5 0.00451696 0.000474174 197883 0
: 7 Minimum Test error found - save the configuration
: 7 | 28631 26829 0.00434504 0.000462013 206025 0
: 8 Minimum Test error found - save the configuration
: 8 | 28186.9 26458.7 0.00445848 0.000485484 201359 0
: 9 Minimum Test error found - save the configuration
: 9 | 27834.4 26139 0.00414276 0.000443253 216245 0
: 10 Minimum Test error found - save the configuration
: 10 | 27517.1 25841.9 0.00437292 0.000479883 205495 0
: 11 Minimum Test error found - save the configuration
: 11 | 27214.5 25564.3 0.0046225 0.000454723 191949 0
: 12 Minimum Test error found - save the configuration
: 12 | 26931.5 25294.1 0.00416544 0.000443463 214940 0
: 13 Minimum Test error found - save the configuration
: 13 | 26654.8 25034.5 0.00430005 0.000466293 208673 0
: 14 Minimum Test error found - save the configuration
: 14 | 26385.2 24785.5 0.00434693 0.000490484 207445 0
: 15 Minimum Test error found - save the configuration
: 15 | 26128.8 24537.6 0.00420041 0.000448813 213243 0
: 16 Minimum Test error found - save the configuration
: 16 | 25872.3 24298.5 0.00423645 0.000539693 216406 0
: 17 Minimum Test error found - save the configuration
: 17 | 25624.3 24062.9 0.00457973 0.000463334 194345 0
: 18 Minimum Test error found - save the configuration
: 18 | 25381.4 23830.5 0.00406221 0.000434573 220529 0
: 19 Minimum Test error found - save the configuration
: 19 | 25141.1 23603.3 0.00409355 0.000439703 218947 0
: 20 Minimum Test error found - save the configuration
: 20 | 24905.6 23380 0.0041427 0.000437863 215934 0
: 21 Minimum Test error found - save the configuration
: 21 | 24671.1 23164.2 0.004086 0.000454113 220271 0
: 22 Minimum Test error found - save the configuration
: 22 | 24446.8 22946.1 0.00414636 0.000454054 216667 0
: 23 Minimum Test error found - save the configuration
: 23 | 24219.6 22734.3 0.0041211 0.000456394 218299 0
: 24 Minimum Test error found - save the configuration
: 24 | 23998.6 22524.1 0.00413512 0.000488723 219395 0
: 25 Minimum Test error found - save the configuration
: 25 | 23781 22315 0.00415757 0.000451653 215871 0
: 26 Minimum Test error found - save the configuration
: 26 | 23565 22108.9 0.00414042 0.000443203 216379 0
: 27 Minimum Test error found - save the configuration
: 27 | 23350.8 21907 0.00425765 0.000502194 213023 0
: 28 Minimum Test error found - save the configuration
: 28 | 23138.2 21710.5 0.0040926 0.000445503 219353 0
: 29 Minimum Test error found - save the configuration
: 29 | 22931 21515.2 0.00414351 0.000454373 216853 0
: 30 Minimum Test error found - save the configuration
: 30 | 22731.6 21313.9 0.00409207 0.000450813 219704 0
: 31 Minimum Test error found - save the configuration
: 31 | 22520.7 21126.4 0.00416931 0.000458273 215573 0
: 32 Minimum Test error found - save the configuration
: 32 | 22321.5 20938.6 0.00411171 0.000449943 218474 0
: 33 Minimum Test error found - save the configuration
: 33 | 22127.1 20747.2 0.00456251 0.000485573 196226 0
: 34 Minimum Test error found - save the configuration
: 34 | 21926.1 20564.7 0.00411074 0.000455463 218862 0
: 35 Minimum Test error found - save the configuration
: 35 | 21733.7 20381.6 0.00407978 0.000448503 220308 0
: 36 Minimum Test error found - save the configuration
: 36 | 21541.9 20200.1 0.00418453 0.000470903 215423 0
: 37 Minimum Test error found - save the configuration
: 37 | 21350.8 20022.2 0.00416034 0.000448113 215504 0
: 38 Minimum Test error found - save the configuration
: 38 | 21164.9 19843.2 0.00414255 0.000439673 216048 0
: 39 Minimum Test error found - save the configuration
: 39 | 20977.5 19668.3 0.00417461 0.000450064 214791 0
: 40 Minimum Test error found - save the configuration
: 40 | 20794.2 19494.2 0.00413115 0.000454833 217609 0
: 41 Minimum Test error found - save the configuration
: 41 | 20612.3 19321.8 0.00413854 0.000453434 217090 0
: 42 Minimum Test error found - save the configuration
: 42 | 20431.3 19152.3 0.00413936 0.000466733 217828 0
: 43 Minimum Test error found - save the configuration
: 43 | 20253.2 18984.3 0.00428151 0.000476554 210252 0
: 44 Minimum Test error found - save the configuration
: 44 | 20076.9 18817.7 0.00408714 0.000439222 219303 0
: 45 Minimum Test error found - save the configuration
: 45 | 19901.5 18653.9 0.00410523 0.000459243 219419 0
: 46 Minimum Test error found - save the configuration
: 46 | 19729.3 18490.6 0.00413831 0.000455063 217200 0
: 47 Minimum Test error found - save the configuration
: 47 | 19557.7 18329.7 0.00415218 0.000477684 217717 0
: 48 Minimum Test error found - save the configuration
: 48 | 19386.8 18172.7 0.00415339 0.000452424 216160 0
: 49 Minimum Test error found - save the configuration
: 49 | 19221.3 18013.9 0.00434642 0.000447763 205199 0
: 50 Minimum Test error found - save the configuration
: 50 | 19055 17857.1 0.00444936 0.000470323 201054 0
: 51 Minimum Test error found - save the configuration
: 51 | 18890.7 17701.9 0.00415618 0.000454754 216133 0
: 52 Minimum Test error found - save the configuration
: 52 | 18726 17551.1 0.00418908 0.000444203 213625 0
: 53 Minimum Test error found - save the configuration
: 53 | 18567.1 17398.5 0.00416771 0.000444463 214866 0
: 54 Minimum Test error found - save the configuration
: 54 | 18405.3 17250.7 0.00442781 0.000487932 203052 0
: 55 Minimum Test error found - save the configuration
: 55 | 18249.4 17101 0.00415617 0.000478993 217558 0
: 56 Minimum Test error found - save the configuration
: 56 | 18091.9 16952.4 0.00418163 0.000454223 214627 0
: 57 Minimum Test error found - save the configuration
: 57 | 17932 16798.4 0.00427532 0.000456064 209465 0
: 58 Minimum Test error found - save the configuration
: 58 | 17764.7 16638.9 0.00424194 0.000467984 211979 0
: 59 Minimum Test error found - save the configuration
: 59 | 17629.7 16500.7 0.004193 0.000485363 215771 0
: 60 Minimum Test error found - save the configuration
: 60 | 17468.3 16369.4 0.00440297 0.000465063 203154 0
: 61 Minimum Test error found - save the configuration
: 61 | 17315.7 16219.5 0.00454714 0.000657304 205664 0
: 62 Minimum Test error found - save the configuration
: 62 | 17159 16058.4 0.00421596 0.000466773 213380 0
: 63 Minimum Test error found - save the configuration
: 63 | 17002.8 15917.5 0.00421219 0.000455703 212965 0
: 64 Minimum Test error found - save the configuration
: 64 | 16850.9 15775.2 0.00561003 0.000512193 156929 0
: 65 Minimum Test error found - save the configuration
: 65 | 16704.2 15619 0.00433901 0.000468304 206681 0
: 66 Minimum Test error found - save the configuration
: 66 | 16550.1 15485.4 0.00432424 0.000474613 207812 0
: 67 Minimum Test error found - save the configuration
: 67 | 16401.3 15338 0.00430363 0.000491283 209845 0
: 68 Minimum Test error found - save the configuration
: 68 | 16251.3 15201.3 0.00432108 0.000466384 207539 0
: 69 Minimum Test error found - save the configuration
: 69 | 16107.2 15058.6 0.00426881 0.000473064 210762 0
: 70 Minimum Test error found - save the configuration
: 70 | 15960.8 14926 0.00429369 0.000478023 209662 0
: 71 Minimum Test error found - save the configuration
: 71 | 15817.2 14786.6 0.00451127 0.000504235 199649 0
: 72 Minimum Test error found - save the configuration
: 72 | 15674.8 14652.2 0.00444895 0.000490853 202117 0
: 73 Minimum Test error found - save the configuration
: 73 | 15534.1 14515.8 0.00432329 0.000480003 208155 0
: 74 Minimum Test error found - save the configuration
: 74 | 15391.2 14384.4 0.00456828 0.000487114 196022 0
: 75 Minimum Test error found - save the configuration
: 75 | 15254.9 14248 0.00437044 0.000477213 205485 0
: 76 Minimum Test error found - save the configuration
: 76 | 15114.1 14120.6 0.00431114 0.000481464 208895 0
: 77 Minimum Test error found - save the configuration
: 77 | 14977 13988.6 0.00456654 0.000484403 195976 0
: 78 Minimum Test error found - save the configuration
: 78 | 14842.7 13858 0.00442625 0.000480733 202762 0
: 79 Minimum Test error found - save the configuration
: 79 | 14706.2 13729.9 0.00436097 0.000487783 206548 0
: 80 Minimum Test error found - save the configuration
: 80 | 14571.3 13605.8 0.00439412 0.000472822 204014 0
: 81 Minimum Test error found - save the configuration
: 81 | 14441.5 13481.4 0.00433939 0.000473053 206914 0
: 82 Minimum Test error found - save the configuration
: 82 | 14310.2 13357.7 0.0043977 0.000491333 204794 0
: 83 Minimum Test error found - save the configuration
: 83 | 14182.9 13232.4 0.0043765 0.000470183 204796 0
: 84 Minimum Test error found - save the configuration
: 84 | 14051.6 13113.3 0.00435452 0.000486724 206836 0
: 85 Minimum Test error found - save the configuration
: 85 | 13926.1 12993.3 0.00457115 0.000475382 195324 0
: 86 Minimum Test error found - save the configuration
: 86 | 13799.5 12876 0.0043551 0.000473635 206108 0
: 87 Minimum Test error found - save the configuration
: 87 | 13676.3 12758 0.0044562 0.000481142 201255 0
: 88 Minimum Test error found - save the configuration
: 88 | 13552.7 12640.2 0.00437645 0.000484173 205535 0
: 89 Minimum Test error found - save the configuration
: 89 | 13430.5 12525.5 0.0044727 0.000491342 200937 0
: 90 Minimum Test error found - save the configuration
: 90 | 13307 12413.7 0.00443605 0.000476293 202033 0
: 91 Minimum Test error found - save the configuration
: 91 | 13189.2 12300 0.00433344 0.000481563 207691 0
: 92 Minimum Test error found - save the configuration
: 92 | 13071 12186.1 0.00463083 0.000506924 193991 0
: 93 Minimum Test error found - save the configuration
: 93 | 12950.8 12076.5 0.00436808 0.000485813 206065 0
: 94 Minimum Test error found - save the configuration
: 94 | 12834.6 11967.3 0.00452683 0.000504353 198882 0
: 95 Minimum Test error found - save the configuration
: 95 | 12719.5 11857.9 0.00446276 0.000502564 202010 0
: 96 Minimum Test error found - save the configuration
: 96 | 12605.1 11748.7 0.00442439 0.000477263 202679 0
: 97 Minimum Test error found - save the configuration
: 97 | 12490.3 11642.4 0.00455738 0.000496872 197020 0
: 98 Minimum Test error found - save the configuration
: 98 | 12378.5 11535.1 0.00436071 0.000481714 206239 0
: 99 Minimum Test error found - save the configuration
: 99 | 12265 11431.9 0.0044836 0.000482274 199934 0
: 100 Minimum Test error found - save the configuration
: 100 | 12156.7 11325.5 0.00435503 0.000480093 206455 0
: 101 Minimum Test error found - save the configuration
: 101 | 12045.5 11222.3 0.00457771 0.000512662 196800 0
: 102 Minimum Test error found - save the configuration
: 102 | 11936.6 11120.4 0.00444896 0.000506114 202899 0
: 103 Minimum Test error found - save the configuration
: 103 | 11829.1 11018.5 0.00449066 0.000489772 199956 0
: 104 Minimum Test error found - save the configuration
: 104 | 11721.3 10919.1 0.00452175 0.000490753 198462 0
: 105 Minimum Test error found - save the configuration
: 105 | 11616.9 10818.2 0.00435556 0.000472913 206045 0
: 106 Minimum Test error found - save the configuration
: 106 | 11511.1 10719.8 0.00440223 0.000484684 204209 0
: 107 Minimum Test error found - save the configuration
: 107 | 11406 10623 0.00433852 0.000471003 206851 0
: 108 Minimum Test error found - save the configuration
: 108 | 11303.8 10525.9 0.00463013 0.000516244 194463 0
: 109 Minimum Test error found - save the configuration
: 109 | 11200.5 10431.3 0.004451 0.000480433 201483 0
: 110 Minimum Test error found - save the configuration
: 110 | 11101.5 10333.8 0.00442942 0.000497083 203441 0
: 111 Minimum Test error found - save the configuration
: 111 | 10999.8 10239.1 0.00450382 0.000481424 198886 0
: 112 Minimum Test error found - save the configuration
: 112 | 10898.6 10147.8 0.00436543 0.000494213 206653 0
: 113 Minimum Test error found - save the configuration
: 113 | 10801.5 10055 0.00452902 0.000508824 198995 0
: 114 Minimum Test error found - save the configuration
: 114 | 10703.5 9963.07 0.00441629 0.000489532 203730 0
: 115 Minimum Test error found - save the configuration
: 115 | 10606.4 9872.32 0.00439567 0.000483043 204466 0
: 116 Minimum Test error found - save the configuration
: 116 | 10511.7 9780.26 0.00435253 0.000473753 206251 0
: 117 Minimum Test error found - save the configuration
: 117 | 10414.2 9692.22 0.00499155 0.000504684 178298 0
: 118 Minimum Test error found - save the configuration
: 118 | 10319.7 9605.33 0.00441038 0.000490705 204099 0
: 119 Minimum Test error found - save the configuration
: 119 | 10227.7 9516.62 0.00448032 0.000481513 200060 0
: 120 Minimum Test error found - save the configuration
: 120 | 10133.8 9430.33 0.00446951 0.000497494 201409 0
: 121 Minimum Test error found - save the configuration
: 121 | 10043 9342.96 0.00447177 0.000481294 200477 0
: 122 Minimum Test error found - save the configuration
: 122 | 9951.76 9256.59 0.00444142 0.000486894 202300 0
: 123 Minimum Test error found - save the configuration
: 123 | 9860.52 9172.37 0.00437609 0.000487983 205756 0
: 124 Minimum Test error found - save the configuration
: 124 | 9770.51 9089.51 0.00450651 0.000488673 199112 0
: 125 Minimum Test error found - save the configuration
: 125 | 9682.44 9006.68 0.00436383 0.000484223 206206 0
: 126 Minimum Test error found - save the configuration
: 126 | 9595.51 8922.51 0.00469894 0.000489734 190059 0
: 127 Minimum Test error found - save the configuration
: 127 | 9507.48 8840.74 0.00437977 0.000480134 205147 0
: 128 Minimum Test error found - save the configuration
: 128 | 9421.87 8758.74 0.00436352 0.000484174 206220 0
: 129 Minimum Test error found - save the configuration
: 129 | 9334.51 8679.44 0.004406 0.000490643 204324 0
: 130 Minimum Test error found - save the configuration
: 130 | 9249.08 8601.83 0.0043426 0.000474053 206796 0
: 131 Minimum Test error found - save the configuration
: 131 | 9167.1 8521.66 0.00439182 0.000480153 204516 0
: 132 Minimum Test error found - save the configuration
: 132 | 9082.06 8444.67 0.00436363 0.000487515 206392 0
: 133 Minimum Test error found - save the configuration
: 133 | 8999.68 8367.73 0.0045304 0.000521713 199567 0
: 134 Minimum Test error found - save the configuration
: 134 | 8918.92 8289.82 0.00480923 0.000733125 196266 0
: 135 Minimum Test error found - save the configuration
: 135 | 8836.2 8214.69 0.00481217 0.000514843 186162 0
: 136 Minimum Test error found - save the configuration
: 136 | 8756.93 8138.35 0.00454561 0.000509252 198198 0
: 137 Minimum Test error found - save the configuration
: 137 | 8675.51 8065.17 0.00449568 0.000491383 199785 0
: 138 Minimum Test error found - save the configuration
: 138 | 8598.33 7989.44 0.00457442 0.000511743 196914 0
: 139 Minimum Test error found - save the configuration
: 139 | 8518.89 7916.19 0.00484156 0.000537114 185854 0
: 140 Minimum Test error found - save the configuration
: 140 | 8441.45 7842.89 0.00466895 0.000503744 192067 0
: 141 Minimum Test error found - save the configuration
: 141 | 8365.08 7769.85 0.00448472 0.000500343 200784 0
: 142 Minimum Test error found - save the configuration
: 142 | 8287.3 7699.37 0.00497055 0.000530923 180195 0
: 143 Minimum Test error found - save the configuration
: 143 | 8211.45 7629.65 0.00458514 0.000519654 196778 0
: 144 Minimum Test error found - save the configuration
: 144 | 8138.85 7557.17 0.00462642 0.000521022 194865 0
: 145 Minimum Test error found - save the configuration
: 145 | 8062.55 7487.8 0.00444741 0.000479653 201625 0
: 146 Minimum Test error found - save the configuration
: 146 | 7988.94 7419.35 0.00441977 0.000494213 203793 0
: 147 Minimum Test error found - save the configuration
: 147 | 7915.37 7352.17 0.00453817 0.000487154 197481 0
: 148 Minimum Test error found - save the configuration
: 148 | 7843.37 7285.19 0.00547626 0.000700976 167529 0
: 149 Minimum Test error found - save the configuration
: 149 | 7771.88 7218.07 0.00586109 0.000513044 149587 0
: 150 Minimum Test error found - save the configuration
: 150 | 7701.41 7150.72 0.00463043 0.000489303 193184 0
: 151 Minimum Test error found - save the configuration
: 151 | 7631.33 7083.56 0.00469568 0.000509143 191089 0
: 152 Minimum Test error found - save the configuration
: 152 | 7560.4 7018.41 0.00439582 0.000479883 204293 0
: 153 Minimum Test error found - save the configuration
: 153 | 7490.73 6954.87 0.00443579 0.000494935 203002 0
: 154 Minimum Test error found - save the configuration
: 154 | 7423.46 6889.67 0.00452407 0.000527704 200182 0
: 155 Minimum Test error found - save the configuration
: 155 | 7354.69 6826.46 0.00453959 0.000509734 198518 0
: 156 Minimum Test error found - save the configuration
: 156 | 7287.2 6763.73 0.00448955 0.000491793 200112 0
: 157 Minimum Test error found - save the configuration
: 157 | 7220.55 6701.52 0.0048497 0.000485552 183312 0
: 158 Minimum Test error found - save the configuration
: 158 | 7155.61 6638.2 0.00447127 0.000498195 201355 0
: 159 Minimum Test error found - save the configuration
: 159 | 7088.33 6577.89 0.00452679 0.000534832 200403 0
: 160 Minimum Test error found - save the configuration
: 160 | 7023.59 6517.38 0.00460866 0.000522284 195772 0
: 161 Minimum Test error found - save the configuration
: 161 | 6959.67 6457.58 0.00450698 0.000496033 199454 0
: 162 Minimum Test error found - save the configuration
: 162 | 6895.31 6397.91 0.00445524 0.000488742 201689 0
: 163 Minimum Test error found - save the configuration
: 163 | 6832.35 6339.48 0.00445511 0.000487093 201612 0
: 164 Minimum Test error found - save the configuration
: 164 | 6770.95 6278.93 0.00444959 0.000504924 202805 0
: 165 Minimum Test error found - save the configuration
: 165 | 6706.36 6222.59 0.00441763 0.000479213 203127 0
: 166 Minimum Test error found - save the configuration
: 166 | 6646.41 6163.74 0.00446011 0.000493713 201694 0
: 167 Minimum Test error found - save the configuration
: 167 | 6585.25 6106.05 0.00479169 0.000491912 186056 0
: 168 Minimum Test error found - save the configuration
: 168 | 6523.95 6050.23 0.00455259 0.000525455 198652 0
: 169 Minimum Test error found - save the configuration
: 169 | 6464.48 5993.05 0.00454644 0.000555013 200430 0
: 170 Minimum Test error found - save the configuration
: 170 | 6404.2 5939.5 0.00448538 0.000488614 200162 0
: 171 Minimum Test error found - save the configuration
: 171 | 6345.85 5884.2 0.00445286 0.000499092 202339 0
: 172 Minimum Test error found - save the configuration
: 172 | 6287.5 5830.67 0.00449432 0.000488294 199699 0
: 173 Minimum Test error found - save the configuration
: 173 | 6229.65 5775.55 0.00447179 0.000516473 202259 0
: 174 Minimum Test error found - save the configuration
: 174 | 6173.01 5721.19 0.00447389 0.000486824 200649 0
: 175 Minimum Test error found - save the configuration
: 175 | 6115.43 5667.81 0.00446352 0.000492793 201474 0
: 176 Minimum Test error found - save the configuration
: 176 | 6059.1 5615.63 0.00448008 0.000492574 200627 0
: 177 Minimum Test error found - save the configuration
: 177 | 6003.44 5563.07 0.00443436 0.000491394 202893 0
: 178 Minimum Test error found - save the configuration
: 178 | 5947.47 5512.61 0.00457085 0.000545175 198724 0
: 179 Minimum Test error found - save the configuration
: 179 | 5893.19 5461.2 0.00457041 0.000508352 196945 0
: 180 Minimum Test error found - save the configuration
: 180 | 5839.74 5409.06 0.00457068 0.000487203 195911 0
: 181 Minimum Test error found - save the configuration
: 181 | 5784.6 5359.21 0.00448089 0.000499934 200957 0
: 182 Minimum Test error found - save the configuration
: 182 | 5731.18 5310.31 0.00453367 0.000552875 200965 0
: 183 Minimum Test error found - save the configuration
: 183 | 5679.18 5260.42 0.00485536 0.000566884 186546 0
: 184 Minimum Test error found - save the configuration
: 184 | 5625.98 5212.15 0.00454881 0.000542785 199699 0
: 185 Minimum Test error found - save the configuration
: 185 | 5575.05 5162.54 0.00450882 0.000488515 198990 0
: 186 Minimum Test error found - save the configuration
: 186 | 5524.11 5113.17 0.0046026 0.000532593 196560 0
: 187 Minimum Test error found - save the configuration
: 187 | 5471.58 5067.54 0.0046068 0.000505693 195069 0
: 188 Minimum Test error found - save the configuration
: 188 | 5421.75 5019.17 0.00448778 0.000497934 200509 0
: 189 Minimum Test error found - save the configuration
: 189 | 5371.37 4973.38 0.00453188 0.000492262 198039 0
: 190 Minimum Test error found - save the configuration
: 190 | 5322.01 4927.61 0.00449059 0.000498434 200393 0
: 191 Minimum Test error found - save the configuration
: 191 | 5273.29 4880.05 0.0045088 0.000523763 200751 0
: 192 Minimum Test error found - save the configuration
: 192 | 5224.46 4835.34 0.00446912 0.000505884 201855 0
: 193 Minimum Test error found - save the configuration
: 193 | 5175.71 4791.29 0.00445079 0.000500603 202522 0
: 194 Minimum Test error found - save the configuration
: 194 | 5128.52 4745.07 0.00457768 0.000526142 197456 0
: 195 Minimum Test error found - save the configuration
: 195 | 5080.79 4701.57 0.00461141 0.000604364 199648 0
: 196 Minimum Test error found - save the configuration
: 196 | 5035.02 4655.77 0.00449332 0.000487715 199720 0
: 197 Minimum Test error found - save the configuration
: 197 | 4987.11 4613.95 0.00445658 0.000500684 202230 0
: 198 Minimum Test error found - save the configuration
: 198 | 4941.46 4570.66 0.00442743 0.000488803 203116 0
: 199 Minimum Test error found - save the configuration
: 199 | 4896.09 4527.92 0.0044788 0.000496823 200905 0
: 200 Minimum Test error found - save the configuration
: 200 | 4851.23 4485.24 0.00452289 0.000500832 198903 0
: 201 Minimum Test error found - save the configuration
: 201 | 4806.81 4442.82 0.00450659 0.000500264 199684 0
: 202 Minimum Test error found - save the configuration
: 202 | 4761.48 4402.04 0.00465578 0.000553263 195002 0
: 203 Minimum Test error found - save the configuration
: 203 | 4717.86 4361.56 0.00447456 0.000498633 201211 0
: 204 Minimum Test error found - save the configuration
: 204 | 4674.92 4321.4 0.00454383 0.000517193 198677 0
: 205 Minimum Test error found - save the configuration
: 205 | 4631.01 4280.5 0.00454487 0.000505673 198059 0
: 206 Minimum Test error found - save the configuration
: 206 | 4588.62 4241.5 0.00442239 0.000482105 203031 0
: 207 Minimum Test error found - save the configuration
: 207 | 4546.9 4201.73 0.00451254 0.000501942 199472 0
: 208 Minimum Test error found - save the configuration
: 208 | 4504.75 4162.32 0.00441953 0.000478493 202992 0
: 209 Minimum Test error found - save the configuration
: 209 | 4463.17 4123.07 0.00445067 0.000513265 203179 0
: 210 Minimum Test error found - save the configuration
: 210 | 4421.99 4085.57 0.00447355 0.000486243 200637 0
: 211 Minimum Test error found - save the configuration
: 211 | 4381.61 4047.25 0.00452696 0.000507384 199026 0
: 212 Minimum Test error found - save the configuration
: 212 | 4341.22 4009.42 0.00448785 0.000487263 199971 0
: 213 Minimum Test error found - save the configuration
: 213 | 4300.74 3973.1 0.00444991 0.000494584 202259 0
: 214 Minimum Test error found - save the configuration
: 214 | 4261.82 3935.75 0.00489174 0.000677244 189821 0
: 215 Minimum Test error found - save the configuration
: 215 | 4222.9 3898.71 0.00518845 0.000660915 176697 0
: 216 Minimum Test error found - save the configuration
: 216 | 4183.99 3862.84 0.00452109 0.000490554 198485 0
: 217 Minimum Test error found - save the configuration
: 217 | 4145.76 3825.76 0.00451365 0.000526824 200661 0
: 218 Minimum Test error found - save the configuration
: 218 | 4107.34 3790.39 0.00445719 0.000504573 202397 0
: 219 Minimum Test error found - save the configuration
: 219 | 4069.67 3757.07 0.00443649 0.000492443 202837 0
: 220 Minimum Test error found - save the configuration
: 220 | 4033.03 3719.33 0.00454783 0.000523693 198800 0
: 221 Minimum Test error found - save the configuration
: 221 | 3995.72 3685.03 0.00451397 0.000504193 199512 0
: 222 Minimum Test error found - save the configuration
: 222 | 3958.93 3651.22 0.00450218 0.000493254 199555 0
: 223 Minimum Test error found - save the configuration
: 223 | 3922.56 3617.39 0.00470135 0.000500693 190446 0
: 224 Minimum Test error found - save the configuration
: 224 | 3886.92 3584.02 0.00453631 0.000537553 200062 0
: 225 Minimum Test error found - save the configuration
: 225 | 3851.41 3550.1 0.00464161 0.000502283 193268 0
: 226 Minimum Test error found - save the configuration
: 226 | 3816.42 3517.06 0.0046854 0.000519633 192041 0
: 227 Minimum Test error found - save the configuration
: 227 | 3782.21 3483.68 0.00459967 0.000509794 195605 0
: 228 Minimum Test error found - save the configuration
: 228 | 3746.65 3450.94 0.00461487 0.000488812 193890 0
: 229 Minimum Test error found - save the configuration
: 229 | 3712.56 3419.28 0.0050748 0.000560943 177232 0
: 230 Minimum Test error found - save the configuration
: 230 | 3678.9 3387.54 0.00493102 0.000535883 182019 0
: 231 Minimum Test error found - save the configuration
: 231 | 3645.58 3355.68 0.00457286 0.000505222 196674 0
: 232 Minimum Test error found - save the configuration
: 232 | 3612.13 3325.18 0.00451751 0.000492984 198781 0
: 233 Minimum Test error found - save the configuration
: 233 | 3579.78 3293.77 0.00454326 0.000521022 198894 0
: 234 Minimum Test error found - save the configuration
: 234 | 3547.42 3262.44 0.004622 0.000496934 193936 0
: 235 Minimum Test error found - save the configuration
: 235 | 3514.46 3232.06 0.0049979 0.000497644 177768 0
: 236 Minimum Test error found - save the configuration
: 236 | 3481.72 3202.81 0.00448282 0.000502803 201004 0
: 237 Minimum Test error found - save the configuration
: 237 | 3451.2 3172.57 0.00447409 0.000499843 201296 0
: 238 Minimum Test error found - save the configuration
: 238 | 3419.16 3144.23 0.00446973 0.000491184 201078 0
: 239 Minimum Test error found - save the configuration
: 239 | 3389.07 3113.6 0.00447728 0.000496623 200972 0
: 240 Minimum Test error found - save the configuration
: 240 | 3357.34 3085.76 0.00444506 0.000499173 202743 0
: 241 Minimum Test error found - save the configuration
: 241 | 3327.54 3056.97 0.00458336 0.000500093 195922 0
: 242 Minimum Test error found - save the configuration
: 242 | 3296.79 3028.57 0.00446613 0.000491252 201264 0
: 243 Minimum Test error found - save the configuration
: 243 | 3267.45 2999.7 0.00451944 0.000518873 199972 0
: 244 Minimum Test error found - save the configuration
: 244 | 3236.87 2972.33 0.00448638 0.000491843 200273 0
: 245 Minimum Test error found - save the configuration
: 245 | 3208.41 2944.98 0.00450526 0.000497102 199593 0
: 246 Minimum Test error found - save the configuration
: 246 | 3178.54 2917.98 0.00447712 0.000518033 202067 0
: 247 Minimum Test error found - save the configuration
: 247 | 3150.14 2890.05 0.0045427 0.000496763 197729 0
: 248 Minimum Test error found - save the configuration
: 248 | 3121.59 2862.83 0.00455824 0.000524533 198329 0
: 249 Minimum Test error found - save the configuration
: 249 | 3092.55 2837.01 0.0048412 0.000536074 185825 0
: 250 Minimum Test error found - save the configuration
: 250 | 3065.37 2810.78 0.00459014 0.000495973 195400 0
: 251 Minimum Test error found - save the configuration
: 251 | 3037.94 2783.94 0.00463784 0.000519094 194234 0
: 252 Minimum Test error found - save the configuration
: 252 | 3008.93 2758.95 0.00465436 0.000509104 192992 0
: 253 Minimum Test error found - save the configuration
: 253 | 2982.23 2733.09 0.00450797 0.000506394 199921 0
: 254 Minimum Test error found - save the configuration
: 254 | 2955.6 2707.42 0.00457334 0.000500732 196434 0
: 255 Minimum Test error found - save the configuration
: 255 | 2928.41 2681.91 0.00450565 0.000502422 199839 0
: 256 Minimum Test error found - save the configuration
: 256 | 2901.24 2657.76 0.00454476 0.000526454 199089 0
: 257 Minimum Test error found - save the configuration
: 257 | 2875.93 2632.83 0.00467734 0.000577013 195106 0
: 258 Minimum Test error found - save the configuration
: 258 | 2849.46 2608.68 0.00473976 0.000523323 189734 0
: 259 Minimum Test error found - save the configuration
: 259 | 2823.14 2584.82 0.00456589 0.000533374 198387 0
: 260 Minimum Test error found - save the configuration
: 260 | 2798.44 2560.77 0.00457686 0.000508964 196662 0
: 261 Minimum Test error found - save the configuration
: 261 | 2772.47 2536.73 0.0045572 0.000489254 196659 0
: 262 Minimum Test error found - save the configuration
: 262 | 2748.14 2513.08 0.00463377 0.000512563 194118 0
: 263 Minimum Test error found - save the configuration
: 263 | 2722.46 2490.66 0.00480682 0.000567524 188710 0
: 264 Minimum Test error found - save the configuration
: 264 | 2698.52 2466.81 0.00476615 0.000525603 188655 0
: 265 Minimum Test error found - save the configuration
: 265 | 2673.65 2444.2 0.0045558 0.000501404 197317 0
: 266 Minimum Test error found - save the configuration
: 266 | 2649.43 2421.96 0.00455923 0.000492423 196714 0
: 267 Minimum Test error found - save the configuration
: 267 | 2625.56 2399.56 0.00463733 0.000491782 192978 0
: 268 Minimum Test error found - save the configuration
: 268 | 2601.39 2377.43 0.00516369 0.000670663 178054 0
: 269 Minimum Test error found - save the configuration
: 269 | 2578.16 2355.43 0.0061819 0.000678904 145375 0
: 270 Minimum Test error found - save the configuration
: 270 | 2555.2 2333.29 0.00491945 0.000546173 182929 0
: 271 Minimum Test error found - save the configuration
: 271 | 2531.78 2312.29 0.00456097 0.000512793 197620 0
: 272 Minimum Test error found - save the configuration
: 272 | 2508.91 2290.85 0.00471455 0.000527053 191045 0
: 273 Minimum Test error found - save the configuration
: 273 | 2485.99 2269.41 0.00463908 0.000499873 193274 0
: 274 Minimum Test error found - save the configuration
: 274 | 2463.41 2248.45 0.00484958 0.000496984 183798 0
: 275 Minimum Test error found - save the configuration
: 275 | 2440.8 2228.39 0.00458654 0.000506203 196062 0
: 276 Minimum Test error found - save the configuration
: 276 | 2419.35 2208.45 0.00450042 0.000493793 199669 0
: 277 Minimum Test error found - save the configuration
: 277 | 2396.45 2188.06 0.0045673 0.000503064 196839 0
: 278 Minimum Test error found - save the configuration
: 278 | 2375.01 2168.35 0.00450209 0.000522444 201023 0
: 279 Minimum Test error found - save the configuration
: 279 | 2353.63 2148.47 0.00611154 0.000735834 148818 0
: 280 Minimum Test error found - save the configuration
: 280 | 2332.4 2128.05 0.00645596 0.000761996 140500 0
: 281 Minimum Test error found - save the configuration
: 281 | 2310.47 2108.72 0.00657241 0.000760045 137637 0
: 282 Minimum Test error found - save the configuration
: 282 | 2289.5 2089.06 0.00647991 0.000717765 138837 0
: 283 Minimum Test error found - save the configuration
: 283 | 2268.8 2069.44 0.00649023 0.000729676 138875 0
: 284 Minimum Test error found - save the configuration
: 284 | 2247.45 2050.92 0.00636919 0.000721045 141639 0
: 285 Minimum Test error found - save the configuration
: 285 | 2227.65 2031.5 0.00640024 0.000723676 140930 0
: 286 Minimum Test error found - save the configuration
: 286 | 2206.2 2013.79 0.00647288 0.000733116 139379 0
: 287 Minimum Test error found - save the configuration
: 287 | 2186.69 1994.89 0.00504481 0.000500575 176047 0
: 288 Minimum Test error found - save the configuration
: 288 | 2166.72 1976.78 0.00443244 0.000496745 203268 0
: 289 Minimum Test error found - save the configuration
: 289 | 2146.76 1958.48 0.00460594 0.000512994 195458 0
: 290 Minimum Test error found - save the configuration
: 290 | 2127.16 1940.11 0.00465355 0.000533353 194165 0
: 291 Minimum Test error found - save the configuration
: 291 | 2107.05 1923.28 0.00448289 0.000482212 199966 0
: 292 Minimum Test error found - save the configuration
: 292 | 2088.23 1904.48 0.00453204 0.000494574 198144 0
: 293 Minimum Test error found - save the configuration
: 293 | 2067.8 1888.11 0.00443597 0.000484444 202453 0
: 294 Minimum Test error found - save the configuration
: 294 | 2049.16 1870.81 0.00444366 0.000492923 202494 0
: 295 Minimum Test error found - save the configuration
: 295 | 2031.11 1852.5 0.00445188 0.000481434 201489 0
: 296 Minimum Test error found - save the configuration
: 296 | 2011.16 1835.95 0.00442731 0.000488772 203121 0
: 297 Minimum Test error found - save the configuration
: 297 | 1992.68 1819.05 0.00450536 0.000505973 200031 0
: 298 Minimum Test error found - save the configuration
: 298 | 1974.11 1802.85 0.00472133 0.000524003 190597 0
: 299 Minimum Test error found - save the configuration
: 299 | 1956.44 1785.89 0.00449324 0.000505753 200628 0
: 300 Minimum Test error found - save the configuration
: 300 | 1937.95 1770.29 0.00450159 0.000495835 199713 0
: 301 Minimum Test error found - save the configuration
: 301 | 1919.51 1753.87 0.00468613 0.000498474 191038 0
: 302 Minimum Test error found - save the configuration
: 302 | 1901.9 1737.82 0.00447383 0.000505243 201583 0
: 303 Minimum Test error found - save the configuration
: 303 | 1884.09 1722.39 0.00436375 0.000474053 205672 0
: 304 Minimum Test error found - save the configuration
: 304 | 1866.66 1706.64 0.00447541 0.000518763 202191 0
: 305 Minimum Test error found - save the configuration
: 305 | 1849.19 1690.2 0.00440325 0.000488083 204334 0
: 306 Minimum Test error found - save the configuration
: 306 | 1831.93 1674.29 0.00451895 0.000517612 199933 0
: 307 Minimum Test error found - save the configuration
: 307 | 1813.99 1659.7 0.00449844 0.000480972 199130 0
: 308 Minimum Test error found - save the configuration
: 308 | 1797.35 1644.67 0.00454481 0.000551094 200315 0
: 309 Minimum Test error found - save the configuration
: 309 | 1780.34 1630.11 0.00455825 0.000490782 196683 0
: 310 Minimum Test error found - save the configuration
: 310 | 1763.68 1615.35 0.00475105 0.000489523 187726 0
: 311 Minimum Test error found - save the configuration
: 311 | 1747.73 1599.54 0.00440223 0.000489924 204483 0
: 312 Minimum Test error found - save the configuration
: 312 | 1730.44 1584.99 0.00435895 0.000482252 206361 0
: 313 Minimum Test error found - save the configuration
: 313 | 1713.99 1570.39 0.00443591 0.000488135 202646 0
: 314 Minimum Test error found - save the configuration
: 314 | 1697.62 1556.44 0.00439087 0.000491313 205152 0
: 315 Minimum Test error found - save the configuration
: 315 | 1682.13 1542.08 0.00434448 0.000485043 207284 0
: 316 Minimum Test error found - save the configuration
: 316 | 1666.07 1527.65 0.00443137 0.000494793 203222 0
: 317 Minimum Test error found - save the configuration
: 317 | 1650.56 1513.11 0.00444532 0.000489382 202228 0
: 318 Minimum Test error found - save the configuration
: 318 | 1634.25 1499.41 0.00439259 0.000481883 204567 0
: 319 Minimum Test error found - save the configuration
: 319 | 1618.53 1486.46 0.00438644 0.000491553 205398 0
: 320 Minimum Test error found - save the configuration
: 320 | 1604.07 1473 0.00443997 0.000480374 202041 0
: 321 Minimum Test error found - save the configuration
: 321 | 1588.15 1458.9 0.00440159 0.000491073 204577 0
: 322 Minimum Test error found - save the configuration
: 322 | 1572.8 1445.66 0.00439122 0.000474484 204252 0
: 323 Minimum Test error found - save the configuration
: 323 | 1557.74 1432.5 0.00441836 0.000515084 204956 0
: 324 Minimum Test error found - save the configuration
: 324 | 1543.15 1419.28 0.00468118 0.000567124 194455 0
: 325 Minimum Test error found - save the configuration
: 325 | 1528.22 1406.05 0.0045259 0.000510163 199216 0
: 326 Minimum Test error found - save the configuration
: 326 | 1513.61 1393.5 0.00440244 0.000478803 203892 0
: 327 Minimum Test error found - save the configuration
: 327 | 1499.17 1380.45 0.0046081 0.000528173 196082 0
: 328 Minimum Test error found - save the configuration
: 328 | 1485.04 1367.59 0.00454079 0.000545214 200221 0
: 329 Minimum Test error found - save the configuration
: 329 | 1470.07 1355.1 0.00458099 0.000494903 195786 0
: 330 Minimum Test error found - save the configuration
: 330 | 1456.68 1342.38 0.00463158 0.000521515 194644 0
: 331 Minimum Test error found - save the configuration
: 331 | 1442.53 1330.29 0.00451206 0.000504865 199641 0
: 332 Minimum Test error found - save the configuration
: 332 | 1429.29 1317.79 0.00445814 0.000494643 201842 0
: 333 Minimum Test error found - save the configuration
: 333 | 1415.25 1305.6 0.00448176 0.000500143 200923 0
: 334 Minimum Test error found - save the configuration
: 334 | 1401.18 1292.99 0.00446575 0.000490432 201242 0
: 335 Minimum Test error found - save the configuration
: 335 | 1387.46 1281.37 0.00453609 0.000483983 197428 0
: 336 Minimum Test error found - save the configuration
: 336 | 1374.39 1269.55 0.00460098 0.000500433 195096 0
: 337 Minimum Test error found - save the configuration
: 337 | 1360.92 1258.01 0.00445428 0.000480705 201330 0
: 338 Minimum Test error found - save the configuration
: 338 | 1347.88 1245.97 0.00447687 0.000508334 201586 0
: 339 Minimum Test error found - save the configuration
: 339 | 1334.96 1234.16 0.00459325 0.000600655 200371 0
: 340 Minimum Test error found - save the configuration
: 340 | 1322.14 1222.57 0.00441585 0.000502764 204442 0
: 341 Minimum Test error found - save the configuration
: 341 | 1309.26 1211.14 0.0044012 0.000474783 203748 0
: 342 Minimum Test error found - save the configuration
: 342 | 1296.46 1200.22 0.0045763 0.000513423 196905 0
: 343 Minimum Test error found - save the configuration
: 343 | 1284.42 1188.46 0.00451315 0.000482144 198462 0
: 344 Minimum Test error found - save the configuration
: 344 | 1271.3 1177.95 0.0044274 0.000495964 203488 0
: 345 Minimum Test error found - save the configuration
: 345 | 1259.42 1167.04 0.00446584 0.000484053 200915 0
: 346 Minimum Test error found - save the configuration
: 346 | 1247.47 1156.25 0.00438663 0.000483173 204947 0
: 347 Minimum Test error found - save the configuration
: 347 | 1235.16 1145.68 0.00456042 0.000519473 197973 0
: 348 Minimum Test error found - save the configuration
: 348 | 1223.39 1134.4 0.00446917 0.000488985 200996 0
: 349 Minimum Test error found - save the configuration
: 349 | 1211.75 1123.54 0.00459233 0.000504862 195720 0
: 350 Minimum Test error found - save the configuration
: 350 | 1199.52 1113.13 0.00540216 0.000677634 169329 0
: 351 Minimum Test error found - save the configuration
: 351 | 1187.85 1103.18 0.00457122 0.000505023 196744 0
: 352 Minimum Test error found - save the configuration
: 352 | 1176.8 1092.61 0.00463218 0.000505564 193863 0
: 353 Minimum Test error found - save the configuration
: 353 | 1165.33 1082.17 0.00454183 0.000491304 197505 0
: 354 Minimum Test error found - save the configuration
: 354 | 1154 1071.63 0.0045394 0.000513033 198690 0
: 355 Minimum Test error found - save the configuration
: 355 | 1142.45 1062 0.00446773 0.000507183 201992 0
: 356 Minimum Test error found - save the configuration
: 356 | 1131.8 1051.65 0.00450781 0.000496025 199412 0
: 357 Minimum Test error found - save the configuration
: 357 | 1120.36 1041.99 0.00445608 0.000485013 201457 0
: 358 Minimum Test error found - save the configuration
: 358 | 1109.85 1031.66 0.00450602 0.000498935 199646 0
: 359 Minimum Test error found - save the configuration
: 359 | 1099.11 1021.9 0.00465661 0.000489204 191966 0
: 360 Minimum Test error found - save the configuration
: 360 | 1088.1 1012.43 0.00479998 0.000494173 185796 0
: 361 Minimum Test error found - save the configuration
: 361 | 1077.76 1002.72 0.00445493 0.000500975 202329 0
: 362 Minimum Test error found - save the configuration
: 362 | 1066.95 993.627 0.00441614 0.000506924 204645 0
: 363 Minimum Test error found - save the configuration
: 363 | 1056.97 983.761 0.0046126 0.000510623 195028 0
: 364 Minimum Test error found - save the configuration
: 364 | 1046.33 974.598 0.00452669 0.000485694 197971 0
: 365 Minimum Test error found - save the configuration
: 365 | 1036.16 964.899 0.00459046 0.000509463 196031 0
: 366 Minimum Test error found - save the configuration
: 366 | 1025.86 956.127 0.0044198 0.000484784 203303 0
: 367 Minimum Test error found - save the configuration
: 367 | 1015.96 946.583 0.00455256 0.000496234 197223 0
: 368 Minimum Test error found - save the configuration
: 368 | 1005.89 937.453 0.00470231 0.000526235 191567 0
: 369 Minimum Test error found - save the configuration
: 369 | 995.969 928.681 0.00439415 0.000477204 204241 0
: 370 Minimum Test error found - save the configuration
: 370 | 986.285 920.526 0.00436 0.000478062 206083 0
: 371 Minimum Test error found - save the configuration
: 371 | 976.764 911.071 0.00439711 0.000502343 205404 0
: 372 Minimum Test error found - save the configuration
: 372 | 967.316 901.71 0.00440622 0.000478154 203663 0
: 373 Minimum Test error found - save the configuration
: 373 | 957.424 892.851 0.00462715 0.000533305 195415 0
: 374 Minimum Test error found - save the configuration
: 374 | 947.726 884.825 0.00443662 0.000481363 202262 0
: 375 Minimum Test error found - save the configuration
: 375 | 938.995 875.824 0.00453211 0.000519344 199364 0
: 376 Minimum Test error found - save the configuration
: 376 | 929.28 867.683 0.00477566 0.000517654 187881 0
: 377 Minimum Test error found - save the configuration
: 377 | 920.389 858.757 0.00461891 0.000497193 194094 0
: 378 Minimum Test error found - save the configuration
: 378 | 910.886 850.539 0.00478407 0.000538343 188425 0
: 379 Minimum Test error found - save the configuration
: 379 | 902.199 842.885 0.00484218 0.000631955 190013 0
: 380 Minimum Test error found - save the configuration
: 380 | 893.463 834.235 0.00488783 0.000520594 183182 0
: 381 Minimum Test error found - save the configuration
: 381 | 884.408 825.675 0.00448136 0.000486395 200252 0
: 382 Minimum Test error found - save the configuration
: 382 | 875.589 817.687 0.00525875 0.000705394 175695 0
: 383 Minimum Test error found - save the configuration
: 383 | 866.949 809.915 0.00448029 0.000479143 199943 0
: 384 Minimum Test error found - save the configuration
: 384 | 858.377 801.828 0.00452584 0.000515294 199474 0
: 385 Minimum Test error found - save the configuration
: 385 | 849.758 794.201 0.00448906 0.000486244 199859 0
: 386 Minimum Test error found - save the configuration
: 386 | 841.492 786.064 0.00473855 0.000513585 189351 0
: 387 Minimum Test error found - save the configuration
: 387 | 832.883 778.187 0.00483252 0.000551684 186879 0
: 388 Minimum Test error found - save the configuration
: 388 | 824.609 770.44 0.00479452 0.000594824 190490 0
: 389 Minimum Test error found - save the configuration
: 389 | 816.31 763.183 0.00501091 0.000529944 178533 0
: 390 Minimum Test error found - save the configuration
: 390 | 808.217 755.606 0.00474962 0.000514154 188881 0
: 391 Minimum Test error found - save the configuration
: 391 | 800.121 748.436 0.00493409 0.000608355 184940 0
: 392 Minimum Test error found - save the configuration
: 392 | 792.429 740.98 0.00483595 0.000489684 184066 0
: 393 Minimum Test error found - save the configuration
: 393 | 784.184 733.144 0.00521048 0.000689624 176958 0
: 394 Minimum Test error found - save the configuration
: 394 | 776.302 726.154 0.0048732 0.000488103 182436 0
: 395 Minimum Test error found - save the configuration
: 395 | 768.682 718.648 0.0044689 0.000507144 201931 0
: 396 Minimum Test error found - save the configuration
: 396 | 761.166 711.192 0.00439866 0.000474363 203858 0
: 397 Minimum Test error found - save the configuration
: 397 | 752.905 704.367 0.004529 0.000511595 199133 0
: 398 Minimum Test error found - save the configuration
: 398 | 745.917 697.288 0.00459336 0.000483572 194657 0
: 399 Minimum Test error found - save the configuration
: 399 | 737.794 691.01 0.00460686 0.000522044 195847 0
: 400 Minimum Test error found - save the configuration
: 400 | 730.753 684.01 0.00478621 0.000524854 187734 0
: 401 Minimum Test error found - save the configuration
: 401 | 723.502 676.244 0.00463036 0.000519475 194605 0
: 402 Minimum Test error found - save the configuration
: 402 | 716.027 669.493 0.00461553 0.000502424 194500 0
: 403 Minimum Test error found - save the configuration
: 403 | 708.781 662.41 0.00441866 0.000481564 203195 0
: 404 Minimum Test error found - save the configuration
: 404 | 701.759 655.966 0.00448869 0.000512923 201219 0
: 405 Minimum Test error found - save the configuration
: 405 | 694.276 649.349 0.00442949 0.000487123 202924 0
: 406 Minimum Test error found - save the configuration
: 406 | 687.656 643.239 0.00455652 0.000549383 199644 0
: 407 Minimum Test error found - save the configuration
: 407 | 680.745 635.852 0.00440618 0.000477693 203641 0
: 408 Minimum Test error found - save the configuration
: 408 | 673.794 630.183 0.00448536 0.000503423 200907 0
: 409 Minimum Test error found - save the configuration
: 409 | 667.142 623.359 0.00454523 0.000492352 197391 0
: 410 Minimum Test error found - save the configuration
: 410 | 660.393 616.325 0.00449885 0.000502653 200190 0
: 411 Minimum Test error found - save the configuration
: 411 | 653.287 610.932 0.00453593 0.000484404 197456 0
: 412 Minimum Test error found - save the configuration
: 412 | 646.568 604.149 0.00445417 0.000499703 202303 0
: 413 Minimum Test error found - save the configuration
: 413 | 640.07 598.163 0.00442394 0.000481554 202923 0
: 414 Minimum Test error found - save the configuration
: 414 | 633.615 591.846 0.00464283 0.000523684 194215 0
: 415 Minimum Test error found - save the configuration
: 415 | 626.799 585.326 0.00450816 0.000510224 200103 0
: 416 Minimum Test error found - save the configuration
: 416 | 620.603 579.614 0.00441651 0.000493544 203927 0
: 417 Minimum Test error found - save the configuration
: 417 | 614.168 573.862 0.00450758 0.000488973 199074 0
: 418 Minimum Test error found - save the configuration
: 418 | 608.036 567.385 0.004466 0.000496024 201513 0
: 419 Minimum Test error found - save the configuration
: 419 | 601.787 561.393 0.00444296 0.000506723 203240 0
: 420 Minimum Test error found - save the configuration
: 420 | 595.517 555.352 0.00444638 0.000496264 202526 0
: 421 Minimum Test error found - save the configuration
: 421 | 589.302 550.098 0.00444797 0.000478652 201546 0
: 422 Minimum Test error found - save the configuration
: 422 | 583.414 544.421 0.00443915 0.000504243 203308 0
: 423 Minimum Test error found - save the configuration
: 423 | 577.324 538.274 0.00443756 0.000482743 202285 0
: 424 Minimum Test error found - save the configuration
: 424 | 571.491 532.771 0.00442125 0.000490724 203535 0
: 425 Minimum Test error found - save the configuration
: 425 | 565.376 527.341 0.0044231 0.000490564 203431 0
: 426 Minimum Test error found - save the configuration
: 426 | 559.716 521.486 0.00445934 0.000485714 201327 0
: 427 Minimum Test error found - save the configuration
: 427 | 553.795 515.877 0.00447772 0.000497564 200997 0
: 428 Minimum Test error found - save the configuration
: 428 | 548.127 510.573 0.00441354 0.000476545 203201 0
: 429 Minimum Test error found - save the configuration
: 429 | 542.212 505.094 0.00719928 0.000615945 121519 0
: 430 Minimum Test error found - save the configuration
: 430 | 536.671 500.067 0.00598474 0.000647356 149886 0
: 431 Minimum Test error found - save the configuration
: 431 | 531.397 494.693 0.00539514 0.000542983 164875 0
: 432 Minimum Test error found - save the configuration
: 432 | 525.585 489.233 0.00504285 0.000519164 176847 0
: 433 Minimum Test error found - save the configuration
: 433 | 520.124 483.926 0.00473321 0.000554844 191462 0
: 434 Minimum Test error found - save the configuration
: 434 | 514.703 478.655 0.00469377 0.000502142 190857 0
: 435 Minimum Test error found - save the configuration
: 435 | 509.305 474.143 0.00480461 0.000522954 186843 0
: 436 Minimum Test error found - save the configuration
: 436 | 504.328 469.643 0.00524404 0.000590564 171915 0
: 437 Minimum Test error found - save the configuration
: 437 | 498.917 463.277 0.00507163 0.000531154 176193 0
: 438 Minimum Test error found - save the configuration
: 438 | 493.711 459.066 0.00488828 0.000555234 184627 0
: 439 Minimum Test error found - save the configuration
: 439 | 488.909 453.401 0.00503911 0.000609105 180587 0
: 440 Minimum Test error found - save the configuration
: 440 | 483.167 448.798 0.00493347 0.000542783 182204 0
: 441 Minimum Test error found - save the configuration
: 441 | 478.36 443.749 0.00473263 0.000511044 189502 0
: 442 Minimum Test error found - save the configuration
: 442 | 473.1 439.584 0.00471511 0.000506844 190102 0
: 443 Minimum Test error found - save the configuration
: 443 | 468.385 434.118 0.00477882 0.000509933 187402 0
: 444 Minimum Test error found - save the configuration
: 444 | 463.531 429.869 0.00465805 0.000495603 192195 0
: 445 Minimum Test error found - save the configuration
: 445 | 458.518 425.433 0.00479614 0.000546354 188245 0
: 446 Minimum Test error found - save the configuration
: 446 | 454.273 420.026 0.00502149 0.000520102 177723 0
: 447 Minimum Test error found - save the configuration
: 447 | 448.866 415.737 0.00477065 0.000543134 189236 0
: 448 Minimum Test error found - save the configuration
: 448 | 444.295 411.35 0.00483662 0.000612245 189377 0
: 449 Minimum Test error found - save the configuration
: 449 | 439.754 407.193 0.00476131 0.000514424 188373 0
: 450 Minimum Test error found - save the configuration
: 450 | 435.529 402.392 0.0048424 0.000551664 186448 0
: 451 Minimum Test error found - save the configuration
: 451 | 431.12 398.271 0.00519316 0.000622354 175024 0
: 452 Minimum Test error found - save the configuration
: 452 | 426.068 393.563 0.00486798 0.000508684 183516 0
: 453 Minimum Test error found - save the configuration
: 453 | 421.588 389.725 0.00506834 0.000574634 178027 0
: 454 Minimum Test error found - save the configuration
: 454 | 417.11 384.808 0.0049555 0.000554664 181783 0
: 455 Minimum Test error found - save the configuration
: 455 | 412.747 380.682 0.00496577 0.000674165 186410 0
: 456 Minimum Test error found - save the configuration
: 456 | 408.417 376.625 0.004733 0.000527473 190226 0
: 457 Minimum Test error found - save the configuration
: 457 | 404.072 371.913 0.00489065 0.000510174 182628 0
: 458 Minimum Test error found - save the configuration
: 458 | 399.753 368.116 0.00487859 0.000563754 185407 0
: 459 Minimum Test error found - save the configuration
: 459 | 395.547 364.32 0.00492994 0.000570883 183526 0
: 460 Minimum Test error found - save the configuration
: 460 | 391.258 359.74 0.00504066 0.000510464 176593 0
: 461 Minimum Test error found - save the configuration
: 461 | 387.01 355.871 0.0049623 0.000548284 181241 0
: 462 Minimum Test error found - save the configuration
: 462 | 383.212 351.616 0.00495376 0.000557383 181968 0
: 463 Minimum Test error found - save the configuration
: 463 | 378.923 348.223 0.0049007 0.000546184 183717 0
: 464 Minimum Test error found - save the configuration
: 464 | 375.05 344.429 0.00480835 0.000593784 189818 0
: 465 Minimum Test error found - save the configuration
: 465 | 370.798 340.271 0.00476283 0.000510223 188120 0
: 466 Minimum Test error found - save the configuration
: 466 | 366.917 336.289 0.00469197 0.000498953 190793 0
: 467 Minimum Test error found - save the configuration
: 467 | 363.172 332.959 0.00501143 0.000542533 179015 0
: 468 Minimum Test error found - save the configuration
: 468 | 359.422 329.354 0.00505005 0.000541914 177457 0
: 469 Minimum Test error found - save the configuration
: 469 | 355.5 325.775 0.00480562 0.000507283 186118 0
: 470 Minimum Test error found - save the configuration
: 470 | 351.399 321.632 0.00484701 0.000530253 185324 0
: 471 Minimum Test error found - save the configuration
: 471 | 348.019 317.62 0.00482988 0.000515793 185439 0
: 472 Minimum Test error found - save the configuration
: 472 | 344.001 314.06 0.00471188 0.000511064 190439 0
: 473 Minimum Test error found - save the configuration
: 473 | 340.859 310.808 0.00482919 0.000531853 186162 0
: 474 Minimum Test error found - save the configuration
: 474 | 336.928 307.371 0.00480408 0.000528763 187121 0
: 475 Minimum Test error found - save the configuration
: 475 | 333.188 303.71 0.00481438 0.000509043 185816 0
: 476 Minimum Test error found - save the configuration
: 476 | 329.672 300.743 0.00473769 0.000498963 188736 0
: 477 Minimum Test error found - save the configuration
: 477 | 325.978 296.722 0.00475118 0.000505444 188424 0
: 478 Minimum Test error found - save the configuration
: 478 | 322.317 293.651 0.00456215 0.000508154 197336 0
: 479 Minimum Test error found - save the configuration
: 479 | 319.369 291.317 0.00471118 0.000512944 190556 0
: 480 Minimum Test error found - save the configuration
: 480 | 315.84 286.653 0.00479466 0.000531884 187671 0
: 481 Minimum Test error found - save the configuration
: 481 | 312.099 283.767 0.00485979 0.000518574 184280 0
: 482 Minimum Test error found - save the configuration
: 482 | 308.96 280.319 0.00461731 0.000492323 193940 0
: 483 Minimum Test error found - save the configuration
: 483 | 305.55 277.257 0.00516681 0.000540023 172906 0
: 484 Minimum Test error found - save the configuration
: 484 | 302.295 274.643 0.00475303 0.000518174 188908 0
: 485 Minimum Test error found - save the configuration
: 485 | 299.085 270.914 0.00493431 0.000537453 181948 0
: 486 Minimum Test error found - save the configuration
: 486 | 295.538 268.256 0.00465355 0.000523603 193707 0
: 487 Minimum Test error found - save the configuration
: 487 | 292.576 264.966 0.00483925 0.000527793 185552 0
: 488 Minimum Test error found - save the configuration
: 488 | 289.327 262.028 0.00477309 0.000508804 187605 0
: 489 Minimum Test error found - save the configuration
: 489 | 286.482 259.042 0.00502359 0.000503773 176998 0
: 490 Minimum Test error found - save the configuration
: 490 | 283.027 255.893 0.00484992 0.000490403 183506 0
: 491 Minimum Test error found - save the configuration
: 491 | 280.203 252.507 0.00501497 0.000515283 177790 0
: 492 Minimum Test error found - save the configuration
: 492 | 276.777 249.704 0.00480809 0.000500803 185732 0
: 493 Minimum Test error found - save the configuration
: 493 | 273.596 247.761 0.00485796 0.000582084 187096 0
: 494 Minimum Test error found - save the configuration
: 494 | 270.881 244.172 0.00496949 0.000537374 180501 0
: 495 Minimum Test error found - save the configuration
: 495 | 267.769 241.193 0.00467128 0.000493124 191472 0
: 496 Minimum Test error found - save the configuration
: 496 | 264.82 237.966 0.00461578 0.000514483 195060 0
: 497 Minimum Test error found - save the configuration
: 497 | 261.946 235.274 0.00532845 0.000533484 166842 0
: 498 Minimum Test error found - save the configuration
: 498 | 259.318 233.029 0.0046488 0.000491483 192432 0
: 499 Minimum Test error found - save the configuration
: 499 | 256.514 229.561 0.00470141 0.000531933 191870 0
: 500 Minimum Test error found - save the configuration
: 500 | 253.543 227.718 0.00467319 0.000520713 192656 0
: 501 Minimum Test error found - save the configuration
: 501 | 251.099 224.875 0.00495861 0.000640565 185269 0
: 502 Minimum Test error found - save the configuration
: 502 | 248.114 222.004 0.00500618 0.000508613 177874 0
: 503 Minimum Test error found - save the configuration
: 503 | 245.524 220.155 0.00472367 0.000553444 191836 0
: 504 Minimum Test error found - save the configuration
: 504 | 242.744 217.406 0.00513973 0.000571804 175134 0
: 505 Minimum Test error found - save the configuration
: 505 | 239.922 215.159 0.00502655 0.000522613 177622 0
: 506 Minimum Test error found - save the configuration
: 506 | 237.372 212.468 0.00477433 0.000513183 187743 0
: 507 Minimum Test error found - save the configuration
: 507 | 234.485 209.819 0.00475362 0.000522273 189065 0
: 508 Minimum Test error found - save the configuration
: 508 | 231.818 207.495 0.00487314 0.000584014 186518 0
: 509 Minimum Test error found - save the configuration
: 509 | 229.497 205.746 0.00473698 0.000522234 189810 0
: 510 Minimum Test error found - save the configuration
: 510 | 226.884 202.58 0.00464632 0.000503144 193088 0
: 511 Minimum Test error found - save the configuration
: 511 | 224.336 201.224 0.00471417 0.000513734 190456 0
: 512 Minimum Test error found - save the configuration
: 512 | 222.013 199.318 0.00471435 0.000508994 190234 0
: 513 Minimum Test error found - save the configuration
: 513 | 219.399 196.575 0.00463261 0.000517993 194429 0
: 514 Minimum Test error found - save the configuration
: 514 | 217.171 194.077 0.00472764 0.000499294 189199 0
: 515 Minimum Test error found - save the configuration
: 515 | 214.63 192.164 0.00466561 0.000510013 192511 0
: 516 Minimum Test error found - save the configuration
: 516 | 212.18 189.14 0.00487492 0.000566124 185667 0
: 517 Minimum Test error found - save the configuration
: 517 | 209.877 187.425 0.00457504 0.000511074 196852 0
: 518 Minimum Test error found - save the configuration
: 518 | 207.623 185.408 0.00482709 0.000581074 188412 0
: 519 Minimum Test error found - save the configuration
: 519 | 205.332 183.69 0.00476307 0.000517953 188452 0
: 520 Minimum Test error found - save the configuration
: 520 | 202.959 181.537 0.00476962 0.000525964 188517 0
: 521 Minimum Test error found - save the configuration
: 521 | 201.01 180.154 0.0048465 0.000533634 185491 0
: 522 Minimum Test error found - save the configuration
: 522 | 198.455 178.415 0.00477537 0.000525973 188262 0
: 523 Minimum Test error found - save the configuration
: 523 | 196.228 175.105 0.00471557 0.000523164 190821 0
: 524 Minimum Test error found - save the configuration
: 524 | 194.183 173.26 0.00469322 0.000534324 192359 0
: 525 | 191.852 173.34 0.00455785 0.000453553 194918 1
: 526 Minimum Test error found - save the configuration
: 526 | 189.825 169.679 0.00475194 0.000599444 192655 0
: 527 Minimum Test error found - save the configuration
: 527 | 187.462 167.69 0.00457028 0.000498583 196478 0
: 528 Minimum Test error found - save the configuration
: 528 | 185.501 166.228 0.00467449 0.000488343 191106 0
: 529 Minimum Test error found - save the configuration
: 529 | 183.511 164.595 0.00488126 0.000511273 183067 0
: 530 Minimum Test error found - save the configuration
: 530 | 181.468 162.642 0.00475672 0.000529814 189264 0
: 531 Minimum Test error found - save the configuration
: 531 | 179.164 159.864 0.00488227 0.000552614 184772 0
: 532 Minimum Test error found - save the configuration
: 532 | 177.13 158.829 0.00478339 0.000521804 187723 0
: 533 Minimum Test error found - save the configuration
: 533 | 175.295 156.866 0.00479768 0.000527893 187363 0
: 534 Minimum Test error found - save the configuration
: 534 | 173.127 155.346 0.00489462 0.000558114 184480 0
: 535 Minimum Test error found - save the configuration
: 535 | 171.39 153.622 0.00464025 0.000524643 194382 0
: 536 Minimum Test error found - save the configuration
: 536 | 169.412 152.529 0.00480242 0.000545503 187929 0
: 537 Minimum Test error found - save the configuration
: 537 | 167.387 149.865 0.00477442 0.000580884 190770 0
: 538 Minimum Test error found - save the configuration
: 538 | 165.415 148.398 0.0047663 0.000507123 187830 0
: 539 Minimum Test error found - save the configuration
: 539 | 163.442 145.679 0.00475209 0.000523764 189200 0
: 540 Minimum Test error found - save the configuration
: 540 | 161.525 144.765 0.00499027 0.000509124 178526 0
: 541 Minimum Test error found - save the configuration
: 541 | 159.594 144.23 0.0047756 0.000567673 190117 0
: 542 Minimum Test error found - save the configuration
: 542 | 157.719 143.198 0.00471456 0.000520424 190742 0
: 543 Minimum Test error found - save the configuration
: 543 | 155.931 140.076 0.00481623 0.000523073 186343 0
: 544 Minimum Test error found - save the configuration
: 544 | 154.054 138.197 0.0050528 0.000596304 179513 0
: 545 Minimum Test error found - save the configuration
: 545 | 152.528 137.751 0.0048923 0.000522033 183055 0
: 546 Minimum Test error found - save the configuration
: 546 | 150.733 136.129 0.00476572 0.000543574 189477 0
: 547 Minimum Test error found - save the configuration
: 547 | 149.008 134.624 0.00493032 0.000527283 181693 0
: 548 Minimum Test error found - save the configuration
: 548 | 147.337 132.67 0.00479438 0.000528394 187530 0
: 549 Minimum Test error found - save the configuration
: 549 | 145.464 131.956 0.004944 0.000571614 182966 0
: 550 Minimum Test error found - save the configuration
: 550 | 143.884 129.92 0.0048714 0.000591854 186936 0
: 551 Minimum Test error found - save the configuration
: 551 | 141.893 127.514 0.00541672 0.000572474 165144 0
: 552 Minimum Test error found - save the configuration
: 552 | 140.522 126.723 0.00527903 0.000579924 170245 0
: 553 Minimum Test error found - save the configuration
: 553 | 138.583 124.397 0.00498235 0.000558824 180851 0
: 554 Minimum Test error found - save the configuration
: 554 | 137.041 123.642 0.00497148 0.000541864 180602 0
: 555 Minimum Test error found - save the configuration
: 555 | 135.318 122.04 0.00512498 0.000576394 175879 0
: 556 Minimum Test error found - save the configuration
: 556 | 133.801 120.192 0.00487198 0.000508974 183360 0
: 557 Minimum Test error found - save the configuration
: 557 | 132.365 120.188 0.0052306 0.000568544 171598 0
: 558 Minimum Test error found - save the configuration
: 558 | 130.789 117.992 0.00494492 0.000577184 183161 0
: 559 Minimum Test error found - save the configuration
: 559 | 129.247 115.715 0.00512078 0.000667894 179659 0
: 560 | 127.721 116.425 0.00510842 0.000517953 174274 1
: 561 Minimum Test error found - save the configuration
: 561 | 126.121 115.22 0.00491522 0.000584754 184737 0
: 562 Minimum Test error found - save the configuration
: 562 | 124.507 112.914 0.00510258 0.000593875 177434 0
: 563 Minimum Test error found - save the configuration
: 563 | 123.036 111.285 0.00530966 0.000613574 170355 0
: 564 Minimum Test error found - save the configuration
: 564 | 121.662 110.389 0.00516411 0.000539014 172970 0
: 565 Minimum Test error found - save the configuration
: 565 | 120.114 108.441 0.00509452 0.000669305 180782 0
: 566 Minimum Test error found - save the configuration
: 566 | 118.916 108.075 0.00494887 0.000532303 181136 0
: 567 Minimum Test error found - save the configuration
: 567 | 117.774 106.859 0.00471235 0.000490194 189477 0
: 568 Minimum Test error found - save the configuration
: 568 | 116.226 105.843 0.00475684 0.000551934 190254 0
: 569 Minimum Test error found - save the configuration
: 569 | 114.62 104.199 0.00476273 0.000516024 188381 0
: 570 Minimum Test error found - save the configuration
: 570 | 113.273 104.166 0.00459992 0.000497994 195030 0
: 571 Minimum Test error found - save the configuration
: 571 | 111.891 101.27 0.00458166 0.000533954 197643 0
: 572 Minimum Test error found - save the configuration
: 572 | 110.342 100.641 0.00479683 0.000550864 188414 0
: 573 Minimum Test error found - save the configuration
: 573 | 109.358 99.9874 0.00503518 0.000503413 176531 0
: 574 Minimum Test error found - save the configuration
: 574 | 107.788 98.8261 0.00490348 0.000558014 184100 0
: 575 Minimum Test error found - save the configuration
: 575 | 106.694 97.0573 0.00499611 0.000601685 182049 0
: 576 Minimum Test error found - save the configuration
: 576 | 105.351 95.6709 0.00477601 0.000545294 189093 0
: 577 | 104.195 95.7672 0.004674 0.000500843 191701 1
: 578 Minimum Test error found - save the configuration
: 578 | 103.074 95.6011 0.00491965 0.000503144 181139 0
: 579 Minimum Test error found - save the configuration
: 579 | 101.824 93.7223 0.00530545 0.000617154 170638 0
: 580 Minimum Test error found - save the configuration
: 580 | 100.341 92.2509 0.00502557 0.000535494 178171 0
: 581 Minimum Test error found - save the configuration
: 581 | 99.1513 91.5345 0.00504783 0.000557633 178166 0
: 582 Minimum Test error found - save the configuration
: 582 | 97.8789 89.6209 0.00502808 0.000528874 177809 0
: 583 Minimum Test error found - save the configuration
: 583 | 96.8004 88.736 0.00472129 0.000493243 189213 0
: 584 Minimum Test error found - save the configuration
: 584 | 95.6602 87.0158 0.00473072 0.000520503 190014 0
: 585 | 94.5997 87.8524 0.00466146 0.000481143 191373 1
: 586 Minimum Test error found - save the configuration
: 586 | 93.5865 84.9698 0.00473473 0.000524543 190015 0
: 587 | 92.3554 85.1789 0.00493287 0.000462063 178938 1
: 588 Minimum Test error found - save the configuration
: 588 | 91.1313 82.876 0.00491429 0.000499633 181214 0
: 589 Minimum Test error found - save the configuration
: 589 | 90.0533 82.4587 0.00481719 0.000550353 187492 0
: 590 Minimum Test error found - save the configuration
: 590 | 89.2019 80.9635 0.00463841 0.000559004 196107 0
: 591 Minimum Test error found - save the configuration
: 591 | 88.1546 80.6686 0.00476052 0.000536403 189389 0
: 592 Minimum Test error found - save the configuration
: 592 | 86.8887 79.3638 0.00493056 0.000554004 182792 0
: 593 Minimum Test error found - save the configuration
: 593 | 85.7267 78.5591 0.00463827 0.000492294 192958 0
: 594 Minimum Test error found - save the configuration
: 594 | 84.818 77.0838 0.00483424 0.000564914 187383 0
: 595 Minimum Test error found - save the configuration
: 595 | 83.7657 76.6913 0.00497499 0.000511693 179240 0
: 596 Minimum Test error found - save the configuration
: 596 | 82.8851 74.8302 0.0049243 0.000546894 182756 0
: 597 Minimum Test error found - save the configuration
: 597 | 82.0608 73.7752 0.00468776 0.000500803 191069 0
: 598 | 80.9932 73.9854 0.00487327 0.000618384 188019 1
: 599 Minimum Test error found - save the configuration
: 599 | 79.8952 72.6125 0.00495457 0.000523553 180545 0
: 600 Minimum Test error found - save the configuration
: 600 | 78.885 71.6898 0.00505464 0.000602435 179686 0
: 601 Minimum Test error found - save the configuration
: 601 | 78.0224 71.1103 0.00489781 0.000519874 182734 0
: 602 Minimum Test error found - save the configuration
: 602 | 77.1985 69.2341 0.00477555 0.000514354 187741 0
: 603 | 76.2973 69.8612 0.00491408 0.000484783 180615 1
: 604 | 75.2642 69.6366 0.00491379 0.000468384 179961 2
: 605 Minimum Test error found - save the configuration
: 605 | 74.443 68.8368 0.005014 0.000529314 178385 0
: 606 Minimum Test error found - save the configuration
: 606 | 73.3891 67.6213 0.00478756 0.000553764 188956 0
: 607 Minimum Test error found - save the configuration
: 607 | 72.6032 66.4513 0.00471418 0.000517994 190649 0
: 608 Minimum Test error found - save the configuration
: 608 | 71.8187 65.6265 0.00512678 0.000543244 174538 0
: 609 Minimum Test error found - save the configuration
: 609 | 70.7925 65.342 0.00497313 0.000549283 180838 0
: 610 Minimum Test error found - save the configuration
: 610 | 69.9863 63.2293 0.00469986 0.000509274 190904 0
: 611 Minimum Test error found - save the configuration
: 611 | 69.048 62.3595 0.00479782 0.000495673 185954 0
: 612 | 68.3396 62.6524 0.00478717 0.000506054 186867 1
: 613 Minimum Test error found - save the configuration
: 613 | 67.5437 61.2983 0.00531975 0.000610144 169866 0
: 614 Minimum Test error found - save the configuration
: 614 | 66.6924 60.9618 0.00610668 0.000635725 146227 0
: 615 Minimum Test error found - save the configuration
: 615 | 65.9383 59.8553 0.00598213 0.000656235 150209 0
: 616 Minimum Test error found - save the configuration
: 616 | 65.0727 58.9064 0.00510922 0.000520403 174337 0
: 617 Minimum Test error found - save the configuration
: 617 | 64.3523 57.4439 0.00483494 0.000533283 185975 0
: 618 | 63.5581 57.6012 0.0046092 0.000469223 193238 1
: 619 | 63.3846 58.9496 0.00493102 0.000544024 182357 2
: 620 | 62.4943 57.9225 0.00510451 0.000547264 175544 3
: 621 Minimum Test error found - save the configuration
: 621 | 61.5991 55.6077 0.00492519 0.000497223 180670 0
: 622 Minimum Test error found - save the configuration
: 622 | 60.5217 55.5405 0.00527881 0.000490493 167073 0
: 623 Minimum Test error found - save the configuration
: 623 | 59.8399 54.9054 0.00503756 0.000654964 182540 0
: 624 Minimum Test error found - save the configuration
: 624 | 59.0718 52.8659 0.00492458 0.000584574 184331 0
: 625 Minimum Test error found - save the configuration
: 625 | 58.4808 51.9636 0.00494754 0.000562004 182418 0
: 626 Minimum Test error found - save the configuration
: 626 | 57.9449 51.7881 0.00486207 0.000511134 183868 0
: 627 Minimum Test error found - save the configuration
: 627 | 57.0514 51.6264 0.00470521 0.000585064 194168 0
: 628 Minimum Test error found - save the configuration
: 628 | 56.4731 51.3883 0.004819 0.000589944 189167 0
: 629 Minimum Test error found - save the configuration
: 629 | 56.1137 49.6108 0.00509483 0.000553444 176157 0
: 630 Minimum Test error found - save the configuration
: 630 | 55.1831 49.0894 0.00510748 0.000517783 174303 0
: 631 Minimum Test error found - save the configuration
: 631 | 54.4777 48.0635 0.00482982 0.000575864 188060 0
: 632 Minimum Test error found - save the configuration
: 632 | 53.6636 47.9905 0.00493941 0.000545404 182066 0
: 633 Minimum Test error found - save the configuration
: 633 | 52.9642 47.2703 0.00485175 0.000584674 187482 0
: 634 | 52.4892 47.9606 0.00476357 0.000485683 187008 1
: 635 Minimum Test error found - save the configuration
: 635 | 51.8386 46.4902 0.00467654 0.000498783 191490 0
: 636 Minimum Test error found - save the configuration
: 636 | 51.0647 45.6953 0.00477808 0.000530224 188330 0
: 637 Minimum Test error found - save the configuration
: 637 | 50.39 44.3734 0.00503718 0.000512463 176806 0
: 638 Minimum Test error found - save the configuration
: 638 | 49.9602 44.1528 0.00482163 0.000513103 185678 0
: 639 | 49.3687 45.4724 0.00485122 0.000566604 186714 1
: 640 Minimum Test error found - save the configuration
: 640 | 48.8717 43.4439 0.0047437 0.000503454 188668 0
: 641 Minimum Test error found - save the configuration
: 641 | 48.14 42.4139 0.00491302 0.000588834 185006 0
: 642 Minimum Test error found - save the configuration
: 642 | 47.4813 41.9285 0.0048034 0.000523944 186940 0
: 643 Minimum Test error found - save the configuration
: 643 | 46.875 41.4104 0.00477798 0.000536114 188596 0
: 644 Minimum Test error found - save the configuration
: 644 | 46.5045 41.2652 0.00491404 0.000503723 181393 0
: 645 Minimum Test error found - save the configuration
: 645 | 45.8157 40.3752 0.00495369 0.000546244 181511 0
: 646 Minimum Test error found - save the configuration
: 646 | 45.2025 39.9094 0.00471357 0.000514554 190521 0
: 647 Minimum Test error found - save the configuration
: 647 | 44.7903 39.2152 0.00518987 0.000577264 173438 0
: 648 | 44.4287 39.6341 0.00465145 0.000494383 192443 1
: 649 Minimum Test error found - save the configuration
: 649 | 43.7647 38.6464 0.00543386 0.000565464 164325 0
: 650 Minimum Test error found - save the configuration
: 650 | 43.1947 38.2731 0.00497972 0.000564194 181179 0
: 651 Minimum Test error found - save the configuration
: 651 | 42.6839 37.4625 0.00511633 0.000576614 176222 0
: 652 Minimum Test error found - save the configuration
: 652 | 42.1012 37.332 0.00497169 0.000541824 180592 0
: 653 | 41.6124 37.5204 0.00485572 0.000519864 184508 1
: 654 Minimum Test error found - save the configuration
: 654 | 41.4113 36.5938 0.00517281 0.000551734 173120 0
: 655 Minimum Test error found - save the configuration
: 655 | 40.6792 35.1299 0.00482769 0.000575044 188118 0
: 656 | 40.0457 35.2377 0.00474694 0.000514783 189029 1
: 657 Minimum Test error found - save the configuration
: 657 | 39.5142 34.8233 0.00481897 0.000488423 184734 0
: 658 Minimum Test error found - save the configuration
: 658 | 39.0604 34.201 0.00508504 0.000584364 177751 0
: 659 | 38.7133 34.7836 0.00501884 0.000554553 179200 1
: 660 Minimum Test error found - save the configuration
: 660 | 38.2428 33.5194 0.00571627 0.000651774 157962 0
: 661 Minimum Test error found - save the configuration
: 661 | 37.7109 33.2183 0.00606559 0.000616424 146811 0
: 662 | 37.2309 33.6759 0.00505619 0.000476523 174685 1
: 663 | 36.8634 33.391 0.0048937 0.000482594 181360 2
: 664 Minimum Test error found - save the configuration
: 664 | 36.4536 31.798 0.00499839 0.000585354 181281 0
: 665 Minimum Test error found - save the configuration
: 665 | 36.0961 31.3074 0.0049437 0.000525024 181050 0
: 666 Minimum Test error found - save the configuration
: 666 | 35.5172 31.1417 0.0052527 0.000553013 170224 0
: 667 | 35.1706 31.5822 0.00500298 0.000494893 177459 1
: 668 | 34.9354 32.1436 0.00487322 0.000485444 182325 2
: 669 Minimum Test error found - save the configuration
: 669 | 34.4562 29.7511 0.0053775 0.000608014 167733 0
: 670 | 34.0339 30.9716 0.0050294 0.000601074 180655 1
: 671 Minimum Test error found - save the configuration
: 671 | 33.3753 29.6294 0.00507128 0.000576164 177971 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.024 28.377 0.00482903 0.000552643 187074 0
: 673 Minimum Test error found - save the configuration
: 673 | 32.7708 28.2617 0.00490153 0.000533174 183135 0
: 674 | 32.3314 29.9526 0.00475006 0.000477323 187234 1
: 675 Minimum Test error found - save the configuration
: 675 | 31.8813 27.7837 0.00483498 0.000526223 185668 0
: 676 Minimum Test error found - save the configuration
: 676 | 31.5587 27.7637 0.00480803 0.000515034 186350 0
: 677 | 30.9286 27.8547 0.00472958 0.000543374 191104 1
: 678 Minimum Test error found - save the configuration
: 678 | 30.5301 27.0456 0.00492104 0.000536394 182455 0
: 679 Minimum Test error found - save the configuration
: 679 | 30.2367 26.781 0.00484546 0.000536534 185661 0
: 680 Minimum Test error found - save the configuration
: 680 | 29.8982 26.1718 0.00502553 0.000527864 177870 0
: 681 | 29.6603 26.2177 0.00482901 0.000493893 184539 1
: 682 Minimum Test error found - save the configuration
: 682 | 29.0697 25.5005 0.00476995 0.000508894 187747 0
: 683 Minimum Test error found - save the configuration
: 683 | 28.8442 24.5521 0.00480683 0.000499563 185733 0
: 684 | 28.4224 24.9555 0.00473321 0.000492404 188643 1
: 685 Minimum Test error found - save the configuration
: 685 | 28.1223 24.501 0.00478501 0.000529793 188004 0
: 686 Minimum Test error found - save the configuration
: 686 | 27.7083 24.2689 0.00474551 0.000504124 188617 0
: 687 | 27.2411 24.7494 0.00484646 0.000493014 183762 1
: 688 | 26.8527 24.2692 0.00462166 0.000458543 192164 2
: 689 Minimum Test error found - save the configuration
: 689 | 26.5182 23.2176 0.00473726 0.000543244 190748 0
: 690 | 26.2845 23.7616 0.00466377 0.000478733 191157 1
: 691 Minimum Test error found - save the configuration
: 691 | 25.9666 22.9947 0.00465372 0.000502803 192728 0
: 692 Minimum Test error found - save the configuration
: 692 | 25.4657 22.9093 0.00466985 0.000498393 191779 0
: 693 Minimum Test error found - save the configuration
: 693 | 25.1793 22.1168 0.00479798 0.000544974 188102 0
: 694 | 24.9749 22.8139 0.00466357 0.000497723 192038 1
: 695 | 24.8492 22.6071 0.0048052 0.000474993 184749 2
: 696 | 24.5058 22.5219 0.00490162 0.000507654 182068 3
: 697 | 24.1201 22.144 0.00483027 0.000490574 184345 4
: 698 Minimum Test error found - save the configuration
: 698 | 23.5513 21.0603 0.0047104 0.000522744 191038 0
: 699 | 23.3381 21.748 0.00488754 0.000495983 182168 1
: 700 | 23.0408 21.9745 0.00472185 0.000461833 187793 2
: 701 Minimum Test error found - save the configuration
: 701 | 22.7138 20.8241 0.00465616 0.000528953 193836 0
: 702 | 22.5459 21.3917 0.00465389 0.000468463 191139 1
: 703 | 22.1929 21.239 0.00465623 0.000462203 190747 2
: 704 Minimum Test error found - save the configuration
: 704 | 22.0184 19.8482 0.0051564 0.000561924 174122 0
: 705 | 21.696 20.2565 0.00481845 0.000499284 185221 1
: 706 | 21.282 20.1916 0.00499104 0.000498553 178075 2
: 707 | 20.9717 20.0068 0.00497026 0.000454843 177171 3
: 708 Minimum Test error found - save the configuration
: 708 | 20.8595 19.3315 0.00515808 0.000559584 173970 0
: 709 Minimum Test error found - save the configuration
: 709 | 20.5448 19.0373 0.00499426 0.000650484 184171 0
: 710 | 20.3454 19.5388 0.00513947 0.000509833 172800 1
: 711 Minimum Test error found - save the configuration
: 711 | 20.1473 18.2624 0.00492506 0.000499003 180748 0
: 712 | 19.623 19.1579 0.00494946 0.000468703 178541 1
: 713 | 19.5176 20.0673 0.00527106 0.000621244 172050 2
: 714 | 19.6072 19.3847 0.00503063 0.000548624 178491 3
: 715 | 18.8483 18.6308 0.0047486 0.000530924 189678 4
: 716 | 18.484 18.3308 0.00477861 0.000463363 185389 5
: 717 Minimum Test error found - save the configuration
: 717 | 18.2147 18.0625 0.00481553 0.000516223 186076 0
: 718 | 18.1084 18.086 0.00479181 0.000471893 185189 1
: 719 | 17.9602 18.9048 0.00487349 0.000468173 181599 2
: 720 | 18.2057 19.0994 0.00477348 0.000477394 186216 3
: 721 Minimum Test error found - save the configuration
: 721 | 17.6709 17.3444 0.00485197 0.000535484 185336 0
: 722 | 17.1744 18.0523 0.00496529 0.000515424 179781 1
: 723 Minimum Test error found - save the configuration
: 723 | 16.9967 17.2576 0.00492578 0.000526703 181856 0
: 724 Minimum Test error found - save the configuration
: 724 | 16.869 16.5843 0.00476059 0.000508864 188159 0
: 725 Minimum Test error found - save the configuration
: 725 | 16.3377 16.2504 0.0046783 0.000501164 191519 0
: 726 | 16.2419 16.4055 0.00467874 0.000483233 190680 1
: 727 Minimum Test error found - save the configuration
: 727 | 16.0182 15.8306 0.00487022 0.000561604 185674 0
: 728 | 15.7456 16.4001 0.00481679 0.000500614 185349 1
: 729 | 15.4074 16.6419 0.00471536 0.000464183 188183 2
: 730 | 15.3186 16.7938 0.00466147 0.000501644 192316 3
: 731 Minimum Test error found - save the configuration
: 731 | 15.1134 15.1263 0.00475174 0.000524494 189248 0
: 732 | 15.017 15.8133 0.00469379 0.000485363 190095 1
: 733 | 14.7322 15.8771 0.00490216 0.000480684 180935 2
: 734 Minimum Test error found - save the configuration
: 734 | 14.4414 14.8004 0.00468259 0.000522134 192287 0
: 735 | 14.3221 15.5048 0.00485723 0.000481074 182809 1
: 736 | 14.0478 15.4094 0.00470144 0.000534324 191979 2
: 737 Minimum Test error found - save the configuration
: 737 | 13.8787 14.6763 0.00494678 0.000526494 180984 0
: 738 | 13.6366 14.7217 0.00476893 0.000474563 186290 1
: 739 | 13.6656 14.9946 0.00475907 0.000548594 190002 2
: 740 Minimum Test error found - save the configuration
: 740 | 13.3602 14.4471 0.0047834 0.000547933 188881 0
: 741 | 13.1642 15.5255 0.00488836 0.000468184 180988 1
: 742 Minimum Test error found - save the configuration
: 742 | 13.0863 13.2478 0.00508691 0.000609134 178660 0
: 743 | 13.0997 15.5926 0.00489593 0.000493384 181713 1
: 744 | 12.8586 13.4215 0.00493413 0.000507394 180720 2
: 745 | 12.6706 14.0339 0.00476165 0.000565014 190629 3
: 746 | 12.4125 13.7627 0.00487263 0.000535483 184453 4
: 747 | 12.183 14.0394 0.00485106 0.000467234 182489 5
: 748 | 12.3098 14.5126 0.0048932 0.000548954 184152 6
: 749 | 12.2504 15.1081 0.00496634 0.000479023 178280 7
: 750 | 11.6868 13.559 0.00484616 0.000536814 185643 8
: 751 | 11.5878 13.4049 0.00505324 0.000473663 174688 9
: 752 Minimum Test error found - save the configuration
: 752 | 11.6156 13.0626 0.00494008 0.000652974 186606 0
: 753 | 11.2204 13.3279 0.00553986 0.000485793 158288 1
: 754 Minimum Test error found - save the configuration
: 754 | 11.1125 12.898 0.00495083 0.000500084 179745 0
: 755 Minimum Test error found - save the configuration
: 755 | 10.8222 12.4122 0.0049084 0.000573234 184537 0
: 756 | 10.6439 13.1786 0.00487795 0.000456473 180935 1
: 757 | 10.5191 13.4022 0.00484441 0.000465034 182674 2
: 758 | 10.371 12.6183 0.00475108 0.000552294 190531 3
: 759 | 10.248 12.4687 0.00510696 0.000471293 172575 4
: 760 | 10.0691 12.4684 0.00489782 0.000476023 180922 5
: 761 | 10.0589 13.0208 0.00482065 0.000505733 185403 6
: 762 | 9.96557 12.4951 0.0047592 0.000523844 188886 7
: 763 Minimum Test error found - save the configuration
: 763 | 9.76211 12.0047 0.00498958 0.000650645 184377 0
: 764 Minimum Test error found - save the configuration
: 764 | 9.72406 11.9988 0.00497106 0.000537804 180454 0
: 765 Minimum Test error found - save the configuration
: 765 | 9.54727 11.5293 0.00510359 0.000517443 174438 0
: 766 | 9.56461 12.6036 0.00472318 0.000467153 187969 1
: 767 | 9.2491 11.9031 0.00517293 0.000481083 170508 2
: 768 | 9.15086 12.2527 0.0051972 0.000555644 172356 3
: 769 | 9.05469 11.743 0.0048479 0.000502093 184085 4
: 770 | 8.83929 11.5932 0.00484649 0.000508004 184396 5
: 771 Minimum Test error found - save the configuration
: 771 | 8.8914 10.9523 0.00507551 0.000614385 179327 0
: 772 | 8.71594 11.6072 0.00479169 0.000491523 186039 1
: 773 | 8.73031 10.9947 0.00492708 0.000507204 181000 2
: 774 Minimum Test error found - save the configuration
: 774 | 8.4644 10.5381 0.0049317 0.000631575 186041 0
: 775 | 8.45244 11.4832 0.00497378 0.000493663 178567 1
: 776 | 8.34055 11.3961 0.00496937 0.000521074 179844 2
: 777 Minimum Test error found - save the configuration
: 777 | 8.1237 10.1595 0.00488154 0.000526484 183694 0
: 778 | 8.33049 10.9428 0.00478131 0.000490972 186465 1
: 779 | 8.14822 10.9551 0.00488941 0.000474493 181204 2
: 780 | 7.95449 10.3395 0.00507223 0.000509423 175331 3
: 781 | 7.75492 10.2766 0.00481705 0.000499803 185303 4
: 782 | 7.6511 11.0374 0.00485632 0.000489083 183182 5
: 783 | 7.71323 10.2179 0.00512039 0.000498552 173091 6
: 784 | 7.45806 10.9251 0.00483583 0.000502893 184632 7
: 785 Minimum Test error found - save the configuration
: 785 | 7.52227 9.87696 0.00482342 0.000535714 186580 0
: 786 Minimum Test error found - save the configuration
: 786 | 7.5093 9.31229 0.00495529 0.000588964 183220 0
: 787 | 7.30599 11.3262 0.00488602 0.000616964 187395 1
: 788 Minimum Test error found - save the configuration
: 788 | 7.29313 8.85754 0.00500664 0.000533054 178827 0
: 789 | 7.11749 12.3157 0.00475273 0.000484134 187415 1
: 790 | 7.01208 10.0083 0.00463723 0.000492183 193001 2
: 791 | 6.79545 10.4081 0.00465869 0.000507173 192701 3
: 792 | 6.7159 10.5134 0.00495564 0.000489744 179135 4
: 793 | 6.7203 10.2872 0.0049371 0.000495853 180129 5
: 794 | 6.7721 9.80421 0.00493214 0.000511664 180976 6
: 795 | 6.51787 9.51756 0.00518324 0.000572364 173503 7
: 796 | 6.4523 9.85772 0.0049391 0.000556404 182536 8
: 797 | 6.4232 10.3854 0.00486625 0.000616304 188238 9
: 798 | 6.28332 10.8778 0.00542115 0.000497303 162475 10
: 799 | 6.26045 8.91659 0.00496215 0.000568964 182100 11
: 800 | 6.36095 9.28789 0.00473288 0.000481093 188156 12
: 801 | 6.1852 9.64692 0.00495586 0.000500712 179567 13
: 802 | 6.13186 8.97726 0.0047762 0.000472043 185867 14
: 803 | 5.94999 9.973 0.00476497 0.000465672 186077 15
: 804 | 5.85907 9.45275 0.00478685 0.000464613 185089 16
: 805 | 5.70864 9.4642 0.00513539 0.000473493 171604 17
: 806 | 5.55628 9.67347 0.00484631 0.000471833 182879 18
: 807 Minimum Test error found - save the configuration
: 807 | 5.53118 8.56309 0.00468358 0.000543472 193232 0
: 808 | 5.66377 10.2558 0.00484435 0.000472613 182993 1
: 809 | 5.44336 9.0449 0.00458425 0.000474524 194660 2
: 810 | 5.39584 8.74738 0.00484332 0.000505854 184439 3
: 811 Minimum Test error found - save the configuration
: 811 | 5.21773 8.53997 0.00480397 0.000517323 186626 0
: 812 | 5.21925 9.20577 0.004714 0.000499424 189817 1
: 813 | 5.16591 8.82799 0.00461382 0.000460303 192608 2
: 814 | 5.22115 8.95273 0.00481925 0.000488373 184720 3
: 815 Minimum Test error found - save the configuration
: 815 | 5.18233 8.39443 0.00508617 0.000520573 175223 0
: 816 | 4.97029 8.88427 0.00475265 0.000468794 186748 1
: 817 | 4.97324 8.45324 0.00502869 0.000487063 176148 2
: 818 Minimum Test error found - save the configuration
: 818 | 4.88056 8.35233 0.00477416 0.000557684 189732 0
: 819 | 4.8772 9.02763 0.00515086 0.000489543 171625 1
: 820 | 4.81539 8.95982 0.00494585 0.000512213 180439 2
: 821 | 4.7296 9.27601 0.00481031 0.000554644 187985 3
: 822 Minimum Test error found - save the configuration
: 822 | 4.74305 8.02711 0.00521112 0.000524073 170683 0
: 823 | 4.69896 9.79041 0.00479062 0.000546284 188486 1
: 824 | 4.74646 8.6943 0.00510843 0.000491814 173287 2
: 825 | 4.61983 9.05682 0.00485794 0.000536164 185109 3
: 826 | 4.52788 8.15679 0.00477999 0.000463995 185357 4
: 827 | 4.43816 8.69398 0.00486315 0.000552934 185605 5
: 828 Minimum Test error found - save the configuration
: 828 | 4.27325 7.54435 0.00473268 0.000511003 189498 0
: 829 | 4.2455 8.50288 0.00464524 0.000473163 191751 1
: 830 | 4.35034 8.15959 0.00474287 0.000480504 187689 2
: 831 | 4.27159 8.4498 0.00491935 0.000510764 181464 3
: 832 | 4.22102 9.24941 0.00456521 0.000489683 196294 4
: 833 | 4.20434 8.94256 0.00492975 0.000512675 181115 5
: 834 | 4.15592 8.78786 0.0049797 0.000486014 178028 6
: 835 | 4.21371 8.32428 0.00523996 0.000517243 169394 7
: 836 | 4.16231 9.07137 0.00511702 0.000488243 172832 8
: 837 | 3.95203 8.72103 0.0046358 0.000486393 192798 9
: 838 | 3.79725 7.6796 0.00482108 0.000520644 186028 10
: 839 | 3.86148 7.91517 0.00506206 0.000503334 175488 11
: 840 | 3.80973 7.57377 0.00498682 0.000521154 179145 12
: 841 | 3.84589 9.6363 0.0048657 0.000598663 187484 13
: 842 | 3.72857 8.4561 0.00467038 0.000512154 192390 14
: 843 | 3.69134 8.11284 0.00498612 0.000504054 178489 15
: 844 | 3.68174 8.11499 0.00496609 0.000484293 178500 16
: 845 | 3.55055 8.41902 0.00468934 0.000458194 189074 17
: 846 | 3.68479 8.35382 0.00477552 0.000475702 186054 18
: 847 | 3.74522 8.31113 0.00470293 0.000487822 189793 19
: 848 | 3.62166 9.04314 0.00485209 0.000512623 184354 20
: 849 | 3.59165 7.78821 0.00503689 0.000500184 176339 21
:
: Elapsed time for training with 1000 events: 4.02 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00672 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.873 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.197 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.27622e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.05494e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0389 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0378 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00168 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0516 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.933 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0231 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00281 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.039 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00455 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0019 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00035 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0506 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00616 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.93 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.102 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.780 0.0327 5.61 1.57 | 3.223 3.235
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.0807 0.0855 2.21 1.11 | 3.349 3.342
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
using namespace TMVA;
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(":");
nnOptions.Append(":");
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
for (int i=1; i<argc; i++) {
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
}
return 0;
}
int main()
Definition Prototype.cxx:12
unsigned int UInt_t
Definition RtypesCore.h:46
double Double_t
Definition RtypesCore.h:59
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
#define gROOT
Definition TROOT.h:414
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
A specialized string object used for TTree selections.
Definition TCut.h:25
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
This is the main MVA steering class.
Definition Factory.h:80
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
static Tools & Instance()
Definition Tools.cxx:71
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
@ kPDEFoam
Definition Types.h:94
Basic string class.
Definition TString.h:139
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
A TTree represents a columnar dataset.
Definition TTree.h:79
create variable transformations
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.