Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.266 sec
: Elapsed time for training with 1000 events: 0.27 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0024 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000733 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00396 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000203 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000313 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31479.4
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33034.2 31097.5 0.00420328 0.000487872 215320 0
: 2 Minimum Test error found - save the configuration
: 2 | 32542.7 30579.4 0.00421834 0.000481772 214100 0
: 3 Minimum Test error found - save the configuration
: 3 | 31913.4 29985.4 0.00437513 0.000488632 205841 0
: 4 Minimum Test error found - save the configuration
: 4 | 31246 29424.2 0.00433482 0.000473382 207177 0
: 5 Minimum Test error found - save the configuration
: 5 | 30581.4 28796.3 0.00431036 0.000482442 208991 0
: 6 Minimum Test error found - save the configuration
: 6 | 29816.8 27948.9 0.00431721 0.000475793 208257 0
: 7 Minimum Test error found - save the configuration
: 7 | 29062.1 27207 0.00419992 0.000447632 213203 0
: 8 Minimum Test error found - save the configuration
: 8 | 28565.7 26813.2 0.00406345 0.000433462 220387 0
: 9 Minimum Test error found - save the configuration
: 9 | 28200.2 26487.6 0.00420336 0.000452752 213299 0
: 10 Minimum Test error found - save the configuration
: 10 | 27875.5 26185.3 0.0040607 0.000449672 221544 0
: 11 Minimum Test error found - save the configuration
: 11 | 27570.5 25899.6 0.00406112 0.000449122 221484 0
: 12 Minimum Test error found - save the configuration
: 12 | 27278.2 25627.3 0.00405004 0.000448002 222097 0
: 13 Minimum Test error found - save the configuration
: 13 | 27000 25361.7 0.00404591 0.000449981 222474 0
: 14 Minimum Test error found - save the configuration
: 14 | 26723.6 25110.7 0.00406916 0.000448312 220943 0
: 15 Minimum Test error found - save the configuration
: 15 | 26464.3 24858.5 0.00405067 0.000439912 221560 0
: 16 Minimum Test error found - save the configuration
: 16 | 26203.6 24616.1 0.00412155 0.000441582 217393 0
: 17 Minimum Test error found - save the configuration
: 17 | 25954.5 24374.5 0.00406784 0.000432672 220073 0
: 18 Minimum Test error found - save the configuration
: 18 | 25706.6 24139 0.00406224 0.000433412 220457 0
: 19 Minimum Test error found - save the configuration
: 19 | 25462.9 23909.3 0.00407032 0.000436012 220125 0
: 20 Minimum Test error found - save the configuration
: 20 | 25222.3 23686.3 0.00405803 0.000433581 220723 0
: 21 Minimum Test error found - save the configuration
: 21 | 24988.6 23464.8 0.00406825 0.000437302 220328 0
: 22 Minimum Test error found - save the configuration
: 22 | 24760.8 23242.2 0.00406012 0.000442371 221132 0
: 23 Minimum Test error found - save the configuration
: 23 | 24529.2 23028.4 0.00413398 0.000456813 217559 0
: 24 Minimum Test error found - save the configuration
: 24 | 24305.9 22815.7 0.00405891 0.000449112 221619 0
: 25 Minimum Test error found - save the configuration
: 25 | 24085.6 22604.3 0.00405526 0.000447971 221773 0
: 26 Minimum Test error found - save the configuration
: 26 | 23864.3 22399.4 0.00406797 0.000449052 221061 0
: 27 Minimum Test error found - save the configuration
: 27 | 23652.2 22191.8 0.00412204 0.000445482 217595 0
: 28 Minimum Test error found - save the configuration
: 28 | 23436.1 21991.2 0.00415519 0.000444372 215586 0
: 29 Minimum Test error found - save the configuration
: 29 | 23226.8 21791 0.00408898 0.000435492 218969 0
: 30 Minimum Test error found - save the configuration
: 30 | 23017.4 21595 0.00405993 0.000434072 220638 0
: 31 Minimum Test error found - save the configuration
: 31 | 22810.7 21402.7 0.00406223 0.000436622 220653 0
: 32 Minimum Test error found - save the configuration
: 32 | 22612.5 21205.3 0.00411758 0.000450682 218168 0
: 33 Minimum Test error found - save the configuration
: 33 | 22407.8 21015.7 0.00410959 0.000448832 218534 0
: 34 Minimum Test error found - save the configuration
: 34 | 22206.6 20831.7 0.00409008 0.000452392 219920 0
: 35 Minimum Test error found - save the configuration
: 35 | 22013.2 20644.8 0.00407091 0.000450192 220951 0
: 36 Minimum Test error found - save the configuration
: 36 | 21816.5 20463.2 0.00412544 0.000489993 220056 0
: 37 Minimum Test error found - save the configuration
: 37 | 21626.5 20279.9 0.00409726 0.000447972 219221 0
: 38 Minimum Test error found - save the configuration
: 38 | 21436 20098.7 0.00419062 0.000461322 214518 0
: 39 Minimum Test error found - save the configuration
: 39 | 21247.7 19919.7 0.00409083 0.000436682 218929 0
: 40 Minimum Test error found - save the configuration
: 40 | 21059.3 19745.3 0.00411068 0.000443382 218144 0
: 41 Minimum Test error found - save the configuration
: 41 | 20876.1 19570.9 0.00419575 0.000471832 214828 0
: 42 Minimum Test error found - save the configuration
: 42 | 20692.6 19399.2 0.00416338 0.000462772 216181 0
: 43 Minimum Test error found - save the configuration
: 43 | 20511.6 19227.8 0.00409785 0.000450422 219333 0
: 44 Minimum Test error found - save the configuration
: 44 | 20332.2 19052.9 0.00419321 0.000450412 213744 0
: 45 Minimum Test error found - save the configuration
: 45 | 20148.2 18883 0.00413882 0.000447592 216730 0
: 46 Minimum Test error found - save the configuration
: 46 | 19970.7 18718.8 0.00421803 0.000467313 213293 0
: 47 Minimum Test error found - save the configuration
: 47 | 19798.2 18550.8 0.00417495 0.000468413 215835 0
: 48 Minimum Test error found - save the configuration
: 48 | 19622.6 18388.4 0.00415064 0.000458672 216687 0
: 49 Minimum Test error found - save the configuration
: 49 | 19449.3 18223.5 0.00415889 0.000457472 216134 0
: 50 Minimum Test error found - save the configuration
: 50 | 19281 18060.4 0.00416844 0.000452552 215292 0
: 51 Minimum Test error found - save the configuration
: 51 | 19107.3 17900 0.00423069 0.000464752 212431 0
: 52 Minimum Test error found - save the configuration
: 52 | 18945.3 17739 0.00420143 0.000463452 214020 0
: 53 Minimum Test error found - save the configuration
: 53 | 18773.7 17588.7 0.00418436 0.000468942 215319 0
: 54 Minimum Test error found - save the configuration
: 54 | 18609.5 17429.7 0.0041958 0.000458952 214084 0
: 55 Minimum Test error found - save the configuration
: 55 | 18444.1 17273.2 0.00419719 0.000452353 213628 0
: 56 Minimum Test error found - save the configuration
: 56 | 18282.3 17115.7 0.00423428 0.000466902 212349 0
: 57 Minimum Test error found - save the configuration
: 57 | 18121.5 16961.4 0.00424257 0.000471372 212134 0
: 58 Minimum Test error found - save the configuration
: 58 | 17957.4 16810.7 0.00423153 0.000463543 212315 0
: 59 Minimum Test error found - save the configuration
: 59 | 17802.1 16654.1 0.00423876 0.000460152 211718 0
: 60 Minimum Test error found - save the configuration
: 60 | 17641.9 16505.4 0.00425184 0.000465112 211264 0
: 61 Minimum Test error found - save the configuration
: 61 | 17485.1 16357.3 0.00430045 0.000475752 209167 0
: 62 Minimum Test error found - save the configuration
: 62 | 17328.1 16209.5 0.00428867 0.000475282 209787 0
: 63 Minimum Test error found - save the configuration
: 63 | 17173.4 16065.9 0.004267 0.000461902 210244 0
: 64 Minimum Test error found - save the configuration
: 64 | 17020.9 15917.5 0.00435445 0.000481303 206550 0
: 65 Minimum Test error found - save the configuration
: 65 | 16868.8 15774.2 0.00427566 0.000469912 210208 0
: 66 Minimum Test error found - save the configuration
: 66 | 16719 15630.3 0.00428298 0.000462371 209391 0
: 67 Minimum Test error found - save the configuration
: 67 | 16567.7 15490 0.00433631 0.000482503 207587 0
: 68 Minimum Test error found - save the configuration
: 68 | 16420.9 15350 0.00427069 0.000469402 210455 0
: 69 Minimum Test error found - save the configuration
: 69 | 16273.8 15211.4 0.00427804 0.000463562 209727 0
: 70 Minimum Test error found - save the configuration
: 70 | 16130.5 15070.9 0.00428742 0.000467802 209445 0
: 71 Minimum Test error found - save the configuration
: 71 | 15983.3 14937.4 0.00430473 0.000476912 208996 0
: 72 Minimum Test error found - save the configuration
: 72 | 15843.2 14799.1 0.00428774 0.000472482 209684 0
: 73 Minimum Test error found - save the configuration
: 73 | 15698 14667.9 0.00427947 0.000462902 209612 0
: 74 Minimum Test error found - save the configuration
: 74 | 15559.9 14534.2 0.00429365 0.000477632 209643 0
: 75 Minimum Test error found - save the configuration
: 75 | 15420.1 14402.9 0.00434991 0.000474702 206441 0
: 76 Minimum Test error found - save the configuration
: 76 | 15281.5 14274 0.00429786 0.000468392 208906 0
: 77 Minimum Test error found - save the configuration
: 77 | 15145.6 14145 0.00434066 0.000483213 207391 0
: 78 Minimum Test error found - save the configuration
: 78 | 15009.5 14018.5 0.00434068 0.000478782 207152 0
: 79 Minimum Test error found - save the configuration
: 79 | 14876.9 13891.1 0.00429228 0.000465331 209044 0
: 80 Minimum Test error found - save the configuration
: 80 | 14743.7 13765.2 0.00430219 0.000467432 208618 0
: 81 Minimum Test error found - save the configuration
: 81 | 14611.3 13640.7 0.00428372 0.000469542 209744 0
: 82 Minimum Test error found - save the configuration
: 82 | 14482.5 13514.6 0.00430577 0.000467232 208413 0
: 83 Minimum Test error found - save the configuration
: 83 | 14350.7 13392.8 0.00435352 0.000480143 206538 0
: 84 Minimum Test error found - save the configuration
: 84 | 14221.9 13272.9 0.00440496 0.000483392 204000 0
: 85 Minimum Test error found - save the configuration
: 85 | 14095.5 13153.1 0.00437753 0.000490413 205808 0
: 86 Minimum Test error found - save the configuration
: 86 | 13969.8 13033.7 0.00441381 0.000488502 203806 0
: 87 Minimum Test error found - save the configuration
: 87 | 13843.1 12917.7 0.00431657 0.000464093 207659 0
: 88 Minimum Test error found - save the configuration
: 88 | 13721.8 12798.9 0.0043102 0.000470342 208341 0
: 89 Minimum Test error found - save the configuration
: 89 | 13598.5 12681.8 0.00429995 0.000477491 209289 0
: 90 Minimum Test error found - save the configuration
: 90 | 13474.3 12569.6 0.00430486 0.000475322 208903 0
: 91 Minimum Test error found - save the configuration
: 91 | 13354.8 12456.5 0.00431221 0.000469782 208202 0
: 92 Minimum Test error found - save the configuration
: 92 | 13236.2 12342.9 0.00436 0.000484562 206428 0
: 93 Minimum Test error found - save the configuration
: 93 | 13117.3 12230.6 0.00470684 0.000486032 189537 0
: 94 Minimum Test error found - save the configuration
: 94 | 12999.6 12119.7 0.00442745 0.000494953 203433 0
: 95 Minimum Test error found - save the configuration
: 95 | 12882.1 12011.4 0.0044173 0.000491642 203788 0
: 96 Minimum Test error found - save the configuration
: 96 | 12766.7 11903.7 0.00443608 0.000501882 203345 0
: 97 Minimum Test error found - save the configuration
: 97 | 12653.6 11794.8 0.0044096 0.000487373 203966 0
: 98 Minimum Test error found - save the configuration
: 98 | 12539 11688.4 0.00454992 0.000494222 197253 0
: 99 Minimum Test error found - save the configuration
: 99 | 12427.4 11581.9 0.00440157 0.000471183 203542 0
: 100 Minimum Test error found - save the configuration
: 100 | 12314.7 11477.7 0.00439927 0.000475192 203870 0
: 101 Minimum Test error found - save the configuration
: 101 | 12204.1 11374.8 0.00438934 0.000479181 204595 0
: 102 Minimum Test error found - save the configuration
: 102 | 12096.2 11270.2 0.00437726 0.000469172 204704 0
: 103 Minimum Test error found - save the configuration
: 103 | 11986.6 11168.3 0.00441596 0.000487053 203619 0
: 104 Minimum Test error found - save the configuration
: 104 | 11877.7 11068.8 0.00441301 0.000473202 203056 0
: 105 Minimum Test error found - save the configuration
: 105 | 11771 10970.2 0.00440818 0.000475482 203423 0
: 106 Minimum Test error found - save the configuration
: 106 | 11667 10869.9 0.00442199 0.000491792 203552 0
: 107 Minimum Test error found - save the configuration
: 107 | 11560.7 10772 0.00444605 0.000500653 202768 0
: 108 Minimum Test error found - save the configuration
: 108 | 11457.6 10674.1 0.00448927 0.000502412 200659 0
: 109 Minimum Test error found - save the configuration
: 109 | 11354.6 10577 0.0044963 0.000500663 200218 0
: 110 Minimum Test error found - save the configuration
: 110 | 11251.9 10481.4 0.00441712 0.000489301 203675 0
: 111 Minimum Test error found - save the configuration
: 111 | 11150.6 10386.8 0.00440137 0.000474082 203703 0
: 112 Minimum Test error found - save the configuration
: 112 | 11049.4 10294.1 0.00444139 0.000489002 202409 0
: 113 Minimum Test error found - save the configuration
: 113 | 10951.4 10199.9 0.00451422 0.000477732 198192 0
: 114 Minimum Test error found - save the configuration
: 114 | 10852.8 10106.2 0.00442711 0.000492232 203310 0
: 115 Minimum Test error found - save the configuration
: 115 | 10754 10015 0.0044232 0.000476053 202678 0
: 116 Minimum Test error found - save the configuration
: 116 | 10658.1 9922.93 0.00444839 0.000505192 202881 0
: 117 Minimum Test error found - save the configuration
: 117 | 10560.9 9833.13 0.00441708 0.000499842 204226 0
: 118 Minimum Test error found - save the configuration
: 118 | 10465.5 9744.74 0.00444411 0.000503502 203014 0
: 119 Minimum Test error found - save the configuration
: 119 | 10370.4 9658.04 0.00444142 0.000497242 202831 0
: 120 Minimum Test error found - save the configuration
: 120 | 10279.2 9568.08 0.00450076 0.000483092 199120 0
: 121 Minimum Test error found - save the configuration
: 121 | 10185 9481.49 0.00440288 0.000486543 204273 0
: 122 Minimum Test error found - save the configuration
: 122 | 10094.4 9393.17 0.00440486 0.000471102 203368 0
: 123 Minimum Test error found - save the configuration
: 123 | 10001.1 9309.11 0.00440516 0.000486762 204165 0
: 124 Minimum Test error found - save the configuration
: 124 | 9910.35 9226.21 0.00440385 0.000470902 203410 0
: 125 Minimum Test error found - save the configuration
: 125 | 9822.49 9141.39 0.00442739 0.000480632 202698 0
: 126 Minimum Test error found - save the configuration
: 126 | 9734.01 9057.01 0.00451 0.000507892 199895 0
: 127 Minimum Test error found - save the configuration
: 127 | 9645.71 8973.45 0.00443983 0.000493972 202744 0
: 128 Minimum Test error found - save the configuration
: 128 | 9558.37 8891.26 0.00449824 0.000562733 203278 0
: 129 Minimum Test error found - save the configuration
: 129 | 9470.62 8811.31 0.00437295 0.000481492 205579 0
: 130 Minimum Test error found - save the configuration
: 130 | 9386.23 8730.38 0.00436475 0.000491021 206519 0
: 131 Minimum Test error found - save the configuration
: 131 | 9300.85 8650.41 0.004355 0.000467112 205767 0
: 132 Minimum Test error found - save the configuration
: 132 | 9216.33 8571.59 0.00438561 0.000478202 204739 0
: 133 Minimum Test error found - save the configuration
: 133 | 9133.3 8492.85 0.00436874 0.000481622 205808 0
: 134 Minimum Test error found - save the configuration
: 134 | 9048.29 8418.34 0.00434373 0.000467773 206401 0
: 135 Minimum Test error found - save the configuration
: 135 | 8969.52 8339.26 0.00443223 0.000540523 205565 0
: 136 Minimum Test error found - save the configuration
: 136 | 8886.72 8263.19 0.00435456 0.000475642 206243 0
: 137 Minimum Test error found - save the configuration
: 137 | 8805.39 8188.4 0.00433103 0.000465193 206941 0
: 138 Minimum Test error found - save the configuration
: 138 | 8726.82 8112.46 0.00444932 0.000493372 202227 0
: 139 Minimum Test error found - save the configuration
: 139 | 8647.44 8037.5 0.00437841 0.000471792 204781 0
: 140 Minimum Test error found - save the configuration
: 140 | 8568.2 7964.13 0.00444042 0.000488861 202452 0
: 141 Minimum Test error found - save the configuration
: 141 | 8490.37 7891.38 0.0043547 0.000474922 206197 0
: 142 Minimum Test error found - save the configuration
: 142 | 8412.57 7820.25 0.00435889 0.000472042 205822 0
: 143 Minimum Test error found - save the configuration
: 143 | 8337.74 7746.82 0.00442556 0.000499832 203784 0
: 144 Minimum Test error found - save the configuration
: 144 | 8261.05 7676.02 0.00434088 0.000478531 207128 0
: 145 Minimum Test error found - save the configuration
: 145 | 8186.1 7605.09 0.00444256 0.000553733 205718 0
: 146 Minimum Test error found - save the configuration
: 146 | 8111.44 7535.03 0.00442326 0.000497542 203784 0
: 147 Minimum Test error found - save the configuration
: 147 | 8037.2 7466.25 0.00437551 0.000486702 205719 0
: 148 Minimum Test error found - save the configuration
: 148 | 7963.59 7398.76 0.00438622 0.000507622 206260 0
: 149 Minimum Test error found - save the configuration
: 149 | 7892.45 7329.63 0.00437326 0.000478112 205384 0
: 150 Minimum Test error found - save the configuration
: 150 | 7819.57 7262.57 0.00438275 0.000477492 204852 0
: 151 Minimum Test error found - save the configuration
: 151 | 7749.64 7194.25 0.00438473 0.000476203 204681 0
: 152 Minimum Test error found - save the configuration
: 152 | 7677.75 7128.06 0.0043903 0.000476023 204380 0
: 153 Minimum Test error found - save the configuration
: 153 | 7607.7 7063.01 0.00437351 0.000494282 206227 0
: 154 Minimum Test error found - save the configuration
: 154 | 7538.35 6998.14 0.00435699 0.000467183 205666 0
: 155 Minimum Test error found - save the configuration
: 155 | 7470.04 6933.04 0.00443611 0.000529902 204802 0
: 156 Minimum Test error found - save the configuration
: 156 | 7401.31 6869.46 0.00440064 0.000477952 203942 0
: 157 Minimum Test error found - save the configuration
: 157 | 7333.93 6806.44 0.00440276 0.000475742 203717 0
: 158 Minimum Test error found - save the configuration
: 158 | 7267.21 6743.3 0.00438808 0.000497322 205616 0
: 159 Minimum Test error found - save the configuration
: 159 | 7200.19 6682.24 0.00438147 0.000481063 205107 0
: 160 Minimum Test error found - save the configuration
: 160 | 7134.85 6620.14 0.00438227 0.000489222 205495 0
: 161 Minimum Test error found - save the configuration
: 161 | 7069.84 6558.95 0.00437876 0.000491563 205804 0
: 162 Minimum Test error found - save the configuration
: 162 | 7004.94 6498.32 0.00438295 0.000483111 205137 0
: 163 Minimum Test error found - save the configuration
: 163 | 6941.11 6438.14 0.00439989 0.000498462 205053 0
: 164 Minimum Test error found - save the configuration
: 164 | 6878.11 6377.82 0.00437648 0.000480202 205324 0
: 165 Minimum Test error found - save the configuration
: 165 | 6813.65 6320.13 0.00440505 0.000478382 203735 0
: 166 Minimum Test error found - save the configuration
: 166 | 6752.37 6261.33 0.0043906 0.000478632 204501 0
: 167 Minimum Test error found - save the configuration
: 167 | 6691.48 6201.9 0.0043851 0.000470532 204365 0
: 168 Minimum Test error found - save the configuration
: 168 | 6628.57 6145.39 0.00439243 0.000482842 204625 0
: 169 Minimum Test error found - save the configuration
: 169 | 6568.47 6088.42 0.00437547 0.000469762 204829 0
: 170 Minimum Test error found - save the configuration
: 170 | 6508.05 6032.14 0.00439457 0.000481002 204417 0
: 171 Minimum Test error found - save the configuration
: 171 | 6448.93 5975.74 0.00439504 0.000478532 204264 0
: 172 Minimum Test error found - save the configuration
: 172 | 6389.16 5920.56 0.00437433 0.000468712 204833 0
: 173 Minimum Test error found - save the configuration
: 173 | 6331.28 5865.11 0.0044051 0.000486323 204145 0
: 174 Minimum Test error found - save the configuration
: 174 | 6271.34 5812.93 0.00440207 0.000487282 204353 0
: 175 Minimum Test error found - save the configuration
: 175 | 6216.36 5757.05 0.004381 0.000491862 205701 0
: 176 Minimum Test error found - save the configuration
: 176 | 6158.45 5702.76 0.00446637 0.000503082 201853 0
: 177 Minimum Test error found - save the configuration
: 177 | 6100.61 5651.23 0.00442694 0.000511273 204308 0
: 178 Minimum Test error found - save the configuration
: 178 | 6045.45 5598.33 0.00448 0.000490702 200537 0
: 179 Minimum Test error found - save the configuration
: 179 | 5989.47 5546.8 0.00439669 0.000470083 203738 0
: 180 Minimum Test error found - save the configuration
: 180 | 5935.26 5495.29 0.00444619 0.000491952 202315 0
: 181 Minimum Test error found - save the configuration
: 181 | 5880.69 5442.7 0.00437768 0.000465942 204513 0
: 182 Minimum Test error found - save the configuration
: 182 | 5826 5392.57 0.00438306 0.000471793 204537 0
: 183 Minimum Test error found - save the configuration
: 183 | 5771.68 5343.96 0.00438257 0.000476853 204828 0
: 184 Minimum Test error found - save the configuration
: 184 | 5720.45 5292.39 0.00438697 0.000471313 204308 0
: 185 Minimum Test error found - save the configuration
: 185 | 5666.46 5243.74 0.00439661 0.000495413 205065 0
: 186 Minimum Test error found - save the configuration
: 186 | 5614.04 5195.62 0.00438971 0.000472402 204222 0
: 187 Minimum Test error found - save the configuration
: 187 | 5562.85 5147.2 0.00440214 0.000488011 204388 0
: 188 Minimum Test error found - save the configuration
: 188 | 5512.18 5098.39 0.00438595 0.000490032 205343 0
: 189 Minimum Test error found - save the configuration
: 189 | 5460.41 5051.32 0.00438954 0.000484942 204887 0
: 190 Minimum Test error found - save the configuration
: 190 | 5411.56 5003.18 0.00440379 0.000505492 205218 0
: 191 Minimum Test error found - save the configuration
: 191 | 5359.73 4958.62 0.00437786 0.000483932 205448 0
: 192 Minimum Test error found - save the configuration
: 192 | 5310.91 4912.6 0.00443059 0.000517293 204431 0
: 193 Minimum Test error found - save the configuration
: 193 | 5262.99 4866.19 0.00456599 0.000478052 195698 0
: 194 Minimum Test error found - save the configuration
: 194 | 5214.46 4820.14 0.00439266 0.000476413 204277 0
: 195 Minimum Test error found - save the configuration
: 195 | 5165.58 4775.62 0.00440056 0.000479602 204032 0
: 196 Minimum Test error found - save the configuration
: 196 | 5118.12 4731.77 0.00438273 0.000472432 204588 0
: 197 Minimum Test error found - save the configuration
: 197 | 5070.96 4687.95 0.00440831 0.000483422 203828 0
: 198 Minimum Test error found - save the configuration
: 198 | 5024.98 4643.55 0.00436649 0.000467273 205169 0
: 199 Minimum Test error found - save the configuration
: 199 | 4977.91 4600.53 0.00440572 0.000497322 204687 0
: 200 Minimum Test error found - save the configuration
: 200 | 4933.06 4557.26 0.00439641 0.000494882 205048 0
: 201 Minimum Test error found - save the configuration
: 201 | 4887.57 4513.49 0.00437396 0.000483621 205638 0
: 202 Minimum Test error found - save the configuration
: 202 | 4841.58 4472.21 0.00441573 0.000500903 204351 0
: 203 Minimum Test error found - save the configuration
: 203 | 4797.19 4431.18 0.00439758 0.000487901 204620 0
: 204 Minimum Test error found - save the configuration
: 204 | 4753.19 4389.81 0.00442212 0.000493421 203630 0
: 205 Minimum Test error found - save the configuration
: 205 | 4709.76 4348.86 0.00439968 0.000490722 204658 0
: 206 Minimum Test error found - save the configuration
: 206 | 4666.73 4308.18 0.00441278 0.000478031 203317 0
: 207 Minimum Test error found - save the configuration
: 207 | 4623.33 4267.9 0.00438671 0.000485252 205052 0
: 208 Minimum Test error found - save the configuration
: 208 | 4580.65 4228.78 0.0044104 0.000471572 203106 0
: 209 Minimum Test error found - save the configuration
: 209 | 4539.69 4188.48 0.00438071 0.000492623 205757 0
: 210 Minimum Test error found - save the configuration
: 210 | 4496.86 4149.65 0.00437095 0.000481932 205708 0
: 211 Minimum Test error found - save the configuration
: 211 | 4456.2 4110.97 0.00440615 0.000476533 203582 0
: 212 Minimum Test error found - save the configuration
: 212 | 4414.33 4073.25 0.00439191 0.000486132 204825 0
: 213 Minimum Test error found - save the configuration
: 213 | 4374.47 4035.77 0.00439573 0.000470052 203787 0
: 214 Minimum Test error found - save the configuration
: 214 | 4334.99 3997.46 0.00438397 0.000476702 204747 0
: 215 Minimum Test error found - save the configuration
: 215 | 4293.98 3961.48 0.00440083 0.000494922 204818 0
: 216 Minimum Test error found - save the configuration
: 216 | 4255.77 3923.63 0.00441591 0.000483461 203436 0
: 217 Minimum Test error found - save the configuration
: 217 | 4215.88 3887.66 0.0044136 0.000495913 204202 0
: 218 Minimum Test error found - save the configuration
: 218 | 4177.45 3852 0.00442745 0.000487302 203038 0
: 219 Minimum Test error found - save the configuration
: 219 | 4139.7 3816.03 0.00444372 0.000512452 203497 0
: 220 Minimum Test error found - save the configuration
: 220 | 4101.8 3779.97 0.00441142 0.000482933 203641 0
: 221 Minimum Test error found - save the configuration
: 221 | 4063.75 3745.19 0.00441894 0.000479592 203079 0
: 222 Minimum Test error found - save the configuration
: 222 | 4027.41 3710.07 0.00444435 0.000481503 201875 0
: 223 Minimum Test error found - save the configuration
: 223 | 3989.89 3675.99 0.00440069 0.000475931 203834 0
: 224 Minimum Test error found - save the configuration
: 224 | 3953.9 3641.12 0.00441357 0.000486532 203716 0
: 225 Minimum Test error found - save the configuration
: 225 | 3917.39 3607.23 0.00442913 0.000472342 202184 0
: 226 Minimum Test error found - save the configuration
: 226 | 3881.91 3573.82 0.00441064 0.000484231 203749 0
: 227 Minimum Test error found - save the configuration
: 227 | 3846.18 3541.09 0.00447801 0.000493102 200758 0
: 228 Minimum Test error found - save the configuration
: 228 | 3811.59 3508.26 0.00441032 0.000509442 205082 0
: 229 Minimum Test error found - save the configuration
: 229 | 3776.34 3476.3 0.00439103 0.000493112 205238 0
: 230 Minimum Test error found - save the configuration
: 230 | 3742.55 3444.2 0.00439694 0.000490512 204791 0
: 231 Minimum Test error found - save the configuration
: 231 | 3708.58 3411.23 0.0043941 0.000506882 205803 0
: 232 Minimum Test error found - save the configuration
: 232 | 3674.63 3378.95 0.00438282 0.000484662 205225 0
: 233 Minimum Test error found - save the configuration
: 233 | 3641.2 3347.84 0.00439522 0.000485552 204621 0
: 234 Minimum Test error found - save the configuration
: 234 | 3608.23 3317.1 0.00439842 0.000478762 204100 0
: 235 Minimum Test error found - save the configuration
: 235 | 3574.97 3286.39 0.00440288 0.000478022 203829 0
: 236 Minimum Test error found - save the configuration
: 236 | 3543.19 3255.52 0.00442359 0.000488822 203316 0
: 237 Minimum Test error found - save the configuration
: 237 | 3510.9 3224.78 0.00438964 0.000472302 204220 0
: 238 Minimum Test error found - save the configuration
: 238 | 3478.32 3195.24 0.004413 0.000484522 203641 0
: 239 Minimum Test error found - save the configuration
: 239 | 3447.29 3165.16 0.00439148 0.000479453 204498 0
: 240 Minimum Test error found - save the configuration
: 240 | 3416.28 3135.16 0.00441475 0.000487092 203684 0
: 241 Minimum Test error found - save the configuration
: 241 | 3384.41 3107.17 0.00440928 0.000492082 204228 0
: 242 Minimum Test error found - save the configuration
: 242 | 3353.72 3078.77 0.00436989 0.000482912 205816 0
: 243 Minimum Test error found - save the configuration
: 243 | 3323.65 3050.29 0.00440263 0.000498802 204927 0
: 244 Minimum Test error found - save the configuration
: 244 | 3293.78 3021.31 0.00439471 0.000486123 204678 0
: 245 Minimum Test error found - save the configuration
: 245 | 3263.17 2993.78 0.00442143 0.000490622 203521 0
: 246 Minimum Test error found - save the configuration
: 246 | 3234.4 2965.14 0.00440287 0.000481652 204018 0
: 247 Minimum Test error found - save the configuration
: 247 | 3203.82 2938.86 0.00438914 0.000474432 204358 0
: 248 Minimum Test error found - save the configuration
: 248 | 3175.74 2911.45 0.00440621 0.000487262 204136 0
: 249 Minimum Test error found - save the configuration
: 249 | 3147.5 2883.53 0.00439204 0.000471883 204074 0
: 250 Minimum Test error found - save the configuration
: 250 | 3117.86 2857.3 0.00441826 0.000481261 203201 0
: 251 Minimum Test error found - save the configuration
: 251 | 3089.78 2831.04 0.00440011 0.000479922 204072 0
: 252 Minimum Test error found - save the configuration
: 252 | 3061.81 2805.22 0.00438954 0.000476732 204457 0
: 253 Minimum Test error found - save the configuration
: 253 | 3034.29 2778.99 0.00439115 0.000489532 205043 0
: 254 Minimum Test error found - save the configuration
: 254 | 3006.46 2753.65 0.00442973 0.000487433 202927 0
: 255 Minimum Test error found - save the configuration
: 255 | 2979.57 2728.58 0.00447688 0.000553643 203913 0
: 256 Minimum Test error found - save the configuration
: 256 | 2952.35 2703 0.00454774 0.000493141 197307 0
: 257 Minimum Test error found - save the configuration
: 257 | 2925.6 2678.17 0.00440917 0.000489692 204109 0
: 258 Minimum Test error found - save the configuration
: 258 | 2899.5 2653.24 0.00440386 0.000478332 203794 0
: 259 Minimum Test error found - save the configuration
: 259 | 2873.33 2628.2 0.00442563 0.000489452 203243 0
: 260 Minimum Test error found - save the configuration
: 260 | 2847.39 2603.47 0.0043891 0.000494392 205407 0
: 261 Minimum Test error found - save the configuration
: 261 | 2820.86 2580.11 0.00440433 0.000485134 204123 0
: 262 Minimum Test error found - save the configuration
: 262 | 2795.76 2556.24 0.00439726 0.000503542 205459 0
: 263 Minimum Test error found - save the configuration
: 263 | 2770.25 2533.06 0.00439844 0.000486702 204513 0
: 264 Minimum Test error found - save the configuration
: 264 | 2745.79 2509.3 0.00438246 0.000477871 204887 0
: 265 Minimum Test error found - save the configuration
: 265 | 2720.97 2485.94 0.00439742 0.000481252 204281 0
: 266 Minimum Test error found - save the configuration
: 266 | 2695.82 2463.34 0.00439101 0.000470891 204076 0
: 267 Minimum Test error found - save the configuration
: 267 | 2671.8 2440.57 0.00441113 0.000485292 203778 0
: 268 Minimum Test error found - save the configuration
: 268 | 2647.5 2418.15 0.00446913 0.000477692 200429 0
: 269 Minimum Test error found - save the configuration
: 269 | 2623.42 2395.65 0.0052846 0.000699973 174496 0
: 270 Minimum Test error found - save the configuration
: 270 | 2599.77 2373.78 0.0059204 0.000699643 153235 0
: 271 Minimum Test error found - save the configuration
: 271 | 2576.3 2351.99 0.00504426 0.000486312 175518 0
: 272 Minimum Test error found - save the configuration
: 272 | 2553.16 2330.18 0.00445985 0.000486303 201331 0
: 273 Minimum Test error found - save the configuration
: 273 | 2530.23 2308.22 0.00446805 0.000481712 200685 0
: 274 Minimum Test error found - save the configuration
: 274 | 2507.51 2286.34 0.00443457 0.000494553 203045 0
: 275 Minimum Test error found - save the configuration
: 275 | 2483.46 2266.67 0.00440432 0.000484101 204070 0
: 276 Minimum Test error found - save the configuration
: 276 | 2461.86 2246.06 0.00443499 0.000499272 203267 0
: 277 Minimum Test error found - save the configuration
: 277 | 2439.06 2226.93 0.00439234 0.000485013 204744 0
: 278 Minimum Test error found - save the configuration
: 278 | 2417.98 2205.06 0.0044287 0.000495303 203387 0
: 279 Minimum Test error found - save the configuration
: 279 | 2395.23 2184.58 0.00444019 0.000490322 202538 0
: 280 Minimum Test error found - save the configuration
: 280 | 2373.68 2164.75 0.00442395 0.000480262 202856 0
: 281 Minimum Test error found - save the configuration
: 281 | 2351.86 2144.92 0.00443037 0.000483343 202684 0
: 282 Minimum Test error found - save the configuration
: 282 | 2331.02 2124.47 0.00443005 0.000476802 202365 0
: 283 Minimum Test error found - save the configuration
: 283 | 2308.76 2105.69 0.0044396 0.000486742 202385 0
: 284 Minimum Test error found - save the configuration
: 284 | 2288.41 2086.24 0.00441355 0.000473023 203019 0
: 285 Minimum Test error found - save the configuration
: 285 | 2266.93 2067.87 0.00443813 0.000504262 203362 0
: 286 Minimum Test error found - save the configuration
: 286 | 2246.98 2048.39 0.00439861 0.000496493 205017 0
: 287 Minimum Test error found - save the configuration
: 287 | 2226.18 2029.36 0.00442943 0.000498712 203525 0
: 288 Minimum Test error found - save the configuration
: 288 | 2205.58 2010.49 0.00442553 0.000493972 203482 0
: 289 Minimum Test error found - save the configuration
: 289 | 2184.91 1992.57 0.00443867 0.000488742 202535 0
: 290 Minimum Test error found - save the configuration
: 290 | 2165.71 1973.65 0.00445306 0.000499473 202348 0
: 291 Minimum Test error found - save the configuration
: 291 | 2145.31 1955.64 0.00441632 0.000473572 202904 0
: 292 Minimum Test error found - save the configuration
: 292 | 2125.92 1937.77 0.00442695 0.000485742 202984 0
: 293 Minimum Test error found - save the configuration
: 293 | 2105.78 1921.08 0.0043869 0.000488141 205194 0
: 294 Minimum Test error found - save the configuration
: 294 | 2087 1903.39 0.00442403 0.000487782 203239 0
: 295 Minimum Test error found - save the configuration
: 295 | 2067.64 1886.04 0.00442827 0.000483162 202783 0
: 296 Minimum Test error found - save the configuration
: 296 | 2048.48 1868.57 0.00444014 0.000492682 202662 0
: 297 Minimum Test error found - save the configuration
: 297 | 2030.12 1850.87 0.00444961 0.000506552 202888 0
: 298 Minimum Test error found - save the configuration
: 298 | 2011.08 1833.49 0.004422 0.000488932 203404 0
: 299 Minimum Test error found - save the configuration
: 299 | 1991.84 1817.16 0.00444125 0.000502653 203118 0
: 300 Minimum Test error found - save the configuration
: 300 | 1973.46 1800.83 0.0044231 0.000475072 202633 0
: 301 Minimum Test error found - save the configuration
: 301 | 1955.47 1784.28 0.00445303 0.000502752 202517 0
: 302 Minimum Test error found - save the configuration
: 302 | 1936.63 1768.86 0.00441955 0.000490082 203590 0
: 303 Minimum Test error found - save the configuration
: 303 | 1919.76 1751.77 0.00441946 0.000482562 203206 0
: 304 Minimum Test error found - save the configuration
: 304 | 1901.1 1736.19 0.0044428 0.000486672 202218 0
: 305 Minimum Test error found - save the configuration
: 305 | 1883.41 1720.51 0.00442997 0.000482402 202656 0
: 306 Minimum Test error found - save the configuration
: 306 | 1866.07 1704.86 0.00444568 0.000505501 203037 0
: 307 Minimum Test error found - save the configuration
: 307 | 1848.84 1688.7 0.00442421 0.000488832 203284 0
: 308 Minimum Test error found - save the configuration
: 308 | 1831.26 1673.36 0.00444028 0.000502942 203183 0
: 309 Minimum Test error found - save the configuration
: 309 | 1814.09 1658.14 0.00442793 0.000490783 203193 0
: 310 Minimum Test error found - save the configuration
: 310 | 1797.44 1642.6 0.00444906 0.000483104 201717 0
: 311 Minimum Test error found - save the configuration
: 311 | 1780.15 1627.64 0.00442553 0.000483882 202961 0
: 312 Minimum Test error found - save the configuration
: 312 | 1763.3 1613.12 0.00442217 0.000478063 202834 0
: 313 Minimum Test error found - save the configuration
: 313 | 1746.79 1598.5 0.0044165 0.000483772 203421 0
: 314 Minimum Test error found - save the configuration
: 314 | 1730.7 1583.98 0.00441627 0.000472702 202862 0
: 315 Minimum Test error found - save the configuration
: 315 | 1714.23 1569.85 0.00443989 0.000493813 202733 0
: 316 Minimum Test error found - save the configuration
: 316 | 1698.17 1555.17 0.00445668 0.000489903 201675 0
: 317 Minimum Test error found - save the configuration
: 317 | 1681.87 1540.95 0.00446971 0.000520802 202588 0
: 318 Minimum Test error found - save the configuration
: 318 | 1666.03 1527.17 0.00443258 0.000489202 202872 0
: 319 Minimum Test error found - save the configuration
: 319 | 1650.36 1512.97 0.00443771 0.000494431 202877 0
: 320 Minimum Test error found - save the configuration
: 320 | 1634.38 1499.4 0.00445675 0.000485322 201439 0
: 321 Minimum Test error found - save the configuration
: 321 | 1619.31 1485.09 0.00441156 0.000477272 203340 0
: 322 Minimum Test error found - save the configuration
: 322 | 1603.26 1472.15 0.00441292 0.000483633 203599 0
: 323 Minimum Test error found - save the configuration
: 323 | 1588.63 1458.3 0.00440088 0.000474382 203744 0
: 324 Minimum Test error found - save the configuration
: 324 | 1573.18 1444.79 0.0044285 0.000486872 202962 0
: 325 Minimum Test error found - save the configuration
: 325 | 1557.93 1431.84 0.00443958 0.000474042 201738 0
: 326 Minimum Test error found - save the configuration
: 326 | 1543.52 1418.48 0.0044482 0.000500452 202647 0
: 327 Minimum Test error found - save the configuration
: 327 | 1528.85 1405.02 0.00440767 0.000499652 204707 0
: 328 Minimum Test error found - save the configuration
: 328 | 1513.65 1392.58 0.00442015 0.000499472 204046 0
: 329 Minimum Test error found - save the configuration
: 329 | 1499.74 1379.59 0.00441017 0.000495692 204370 0
: 330 Minimum Test error found - save the configuration
: 330 | 1484.8 1367.18 0.00441236 0.000488553 203884 0
: 331 Minimum Test error found - save the configuration
: 331 | 1471.05 1354.38 0.00442892 0.000493802 203298 0
: 332 Minimum Test error found - save the configuration
: 332 | 1457.3 1341.21 0.00443022 0.000474802 202254 0
: 333 Minimum Test error found - save the configuration
: 333 | 1442.45 1329.69 0.00443955 0.000485562 202327 0
: 334 Minimum Test error found - save the configuration
: 334 | 1429.23 1317.19 0.00443616 0.000473282 201873 0
: 335 Minimum Test error found - save the configuration
: 335 | 1415.21 1305.57 0.00442866 0.000482313 202719 0
: 336 Minimum Test error found - save the configuration
: 336 | 1401.82 1293.28 0.00441444 0.000483642 203521 0
: 337 Minimum Test error found - save the configuration
: 337 | 1388.61 1280.46 0.00445596 0.000498682 202159 0
: 338 Minimum Test error found - save the configuration
: 338 | 1374.88 1268.83 0.0044326 0.000499162 203385 0
: 339 Minimum Test error found - save the configuration
: 339 | 1361.28 1257.86 0.00454547 0.000542622 199858 0
: 340 Minimum Test error found - save the configuration
: 340 | 1348.53 1246.04 0.00445078 0.000490492 202006 0
: 341 Minimum Test error found - save the configuration
: 341 | 1335.68 1234.33 0.00440289 0.000472712 203553 0
: 342 Minimum Test error found - save the configuration
: 342 | 1322.81 1222.82 0.00439909 0.000486582 204473 0
: 343 Minimum Test error found - save the configuration
: 343 | 1310.32 1211.02 0.00439105 0.000483972 204757 0
: 344 Minimum Test error found - save the configuration
: 344 | 1297.28 1200.28 0.00440245 0.000478962 203900 0
: 345 Minimum Test error found - save the configuration
: 345 | 1284.67 1188.93 0.00440111 0.000482522 204155 0
: 346 Minimum Test error found - save the configuration
: 346 | 1272.29 1178.28 0.00442168 0.000474892 202696 0
: 347 Minimum Test error found - save the configuration
: 347 | 1260.37 1166.76 0.00443758 0.000506891 203527 0
: 348 Minimum Test error found - save the configuration
: 348 | 1248.37 1155.35 0.00441357 0.000489432 203866 0
: 349 Minimum Test error found - save the configuration
: 349 | 1235.52 1145.54 0.00444675 0.000507134 203065 0
: 350 Minimum Test error found - save the configuration
: 350 | 1224.15 1134.75 0.004411 0.000501202 204614 0
: 351 Minimum Test error found - save the configuration
: 351 | 1212.31 1123.8 0.00443559 0.000489482 202731 0
: 352 Minimum Test error found - save the configuration
: 352 | 1200.34 1113.86 0.00443271 0.000482952 202544 0
: 353 Minimum Test error found - save the configuration
: 353 | 1189.24 1103.45 0.00442088 0.000484252 203220 0
: 354 Minimum Test error found - save the configuration
: 354 | 1177.8 1092.62 0.00444168 0.000490272 202460 0
: 355 Minimum Test error found - save the configuration
: 355 | 1166.01 1082.57 0.00441058 0.000475992 203325 0
: 356 Minimum Test error found - save the configuration
: 356 | 1155.65 1073.19 0.00443884 0.000490181 202601 0
: 357 Minimum Test error found - save the configuration
: 357 | 1143.72 1062.74 0.00442067 0.000484902 203264 0
: 358 Minimum Test error found - save the configuration
: 358 | 1132.57 1052.31 0.00442458 0.000495484 203609 0
: 359 Minimum Test error found - save the configuration
: 359 | 1121.76 1042.75 0.00441443 0.000495713 204149 0
: 360 Minimum Test error found - save the configuration
: 360 | 1110.94 1031.76 0.00442825 0.000493722 203328 0
: 361 Minimum Test error found - save the configuration
: 361 | 1099.46 1022.41 0.00441548 0.000508703 204772 0
: 362 Minimum Test error found - save the configuration
: 362 | 1089.19 1012.87 0.00439995 0.000475442 203847 0
: 363 Minimum Test error found - save the configuration
: 363 | 1078.77 1002.95 0.00443253 0.000489612 202895 0
: 364 Minimum Test error found - save the configuration
: 364 | 1067.76 993.582 0.00442643 0.000473192 202366 0
: 365 Minimum Test error found - save the configuration
: 365 | 1057.63 983.779 0.00443114 0.000479602 202453 0
: 366 Minimum Test error found - save the configuration
: 366 | 1047.08 974.684 0.00443978 0.000482832 202176 0
: 367 Minimum Test error found - save the configuration
: 367 | 1036.95 965.383 0.00449798 0.000499282 200065 0
: 368 Minimum Test error found - save the configuration
: 368 | 1026.84 956.771 0.00443219 0.000500863 203494 0
: 369 Minimum Test error found - save the configuration
: 369 | 1017.18 946.923 0.00440719 0.000488072 204128 0
: 370 Minimum Test error found - save the configuration
: 370 | 1006.96 937.875 0.0044393 0.000508422 203517 0
: 371 Minimum Test error found - save the configuration
: 371 | 996.89 929.289 0.00441815 0.000488341 203572 0
: 372 Minimum Test error found - save the configuration
: 372 | 987.309 920.425 0.00443619 0.000487732 202611 0
: 373 Minimum Test error found - save the configuration
: 373 | 977.659 911.365 0.00442087 0.000472662 202624 0
: 374 Minimum Test error found - save the configuration
: 374 | 968.206 902.9 0.00440184 0.000478791 203923 0
: 375 Minimum Test error found - save the configuration
: 375 | 958.926 893.709 0.00440272 0.000480453 203964 0
: 376 Minimum Test error found - save the configuration
: 376 | 949.323 885.343 0.00441602 0.000475852 203037 0
: 377 Minimum Test error found - save the configuration
: 377 | 939.919 876.273 0.00443524 0.000490453 202799 0
: 378 Minimum Test error found - save the configuration
: 378 | 930.524 867.84 0.0044297 0.000497021 203424 0
: 379 Minimum Test error found - save the configuration
: 379 | 921.607 859.531 0.00443294 0.000504783 203658 0
: 380 Minimum Test error found - save the configuration
: 380 | 912.198 851.395 0.00439937 0.000493623 204826 0
: 381 Minimum Test error found - save the configuration
: 381 | 903.138 843.171 0.0044176 0.000494272 203909 0
: 382 Minimum Test error found - save the configuration
: 382 | 894.757 834.952 0.00443253 0.000503152 203595 0
: 383 Minimum Test error found - save the configuration
: 383 | 885.679 827.18 0.00442133 0.000475672 202755 0
: 384 Minimum Test error found - save the configuration
: 384 | 877.247 818.907 0.00443171 0.000491182 203019 0
: 385 Minimum Test error found - save the configuration
: 385 | 867.983 811.091 0.00441368 0.000472392 202979 0
: 386 Minimum Test error found - save the configuration
: 386 | 860.132 802.555 0.00441535 0.000502112 204434 0
: 387 Minimum Test error found - save the configuration
: 387 | 850.772 795.362 0.00441493 0.000485372 203585 0
: 388 Minimum Test error found - save the configuration
: 388 | 842.756 787.23 0.00442964 0.000482992 202704 0
: 389 Minimum Test error found - save the configuration
: 389 | 834.31 779.563 0.00445059 0.000497512 202374 0
: 390 Minimum Test error found - save the configuration
: 390 | 826.397 771.72 0.00443226 0.000495233 203199 0
: 391 Minimum Test error found - save the configuration
: 391 | 817.744 764.55 0.0044661 0.000520602 202763 0
: 392 Minimum Test error found - save the configuration
: 392 | 809.85 757.048 0.00447904 0.000482602 200178 0
: 393 Minimum Test error found - save the configuration
: 393 | 801.787 749.112 0.0044398 0.000492363 202663 0
: 394 Minimum Test error found - save the configuration
: 394 | 793.665 741.724 0.0044126 0.000474792 203159 0
: 395 Minimum Test error found - save the configuration
: 395 | 785.763 734.464 0.00442032 0.000494462 203777 0
: 396 Minimum Test error found - save the configuration
: 396 | 777.768 727.169 0.00441765 0.000482823 203313 0
: 397 Minimum Test error found - save the configuration
: 397 | 770.132 719.598 0.00443699 0.000482912 202323 0
: 398 Minimum Test error found - save the configuration
: 398 | 762.532 712.061 0.00444538 0.000500342 202786 0
: 399 Minimum Test error found - save the configuration
: 399 | 754.439 705.554 0.00443113 0.000494192 203204 0
: 400 Minimum Test error found - save the configuration
: 400 | 746.957 698.798 0.00443258 0.000500872 203474 0
: 401 Minimum Test error found - save the configuration
: 401 | 739.876 691.288 0.00442104 0.000500632 204060 0
: 402 Minimum Test error found - save the configuration
: 402 | 732.094 684.18 0.004435 0.000499992 203303 0
: 403 Minimum Test error found - save the configuration
: 403 | 724.667 677.648 0.00443262 0.000477832 202286 0
: 404 Minimum Test error found - save the configuration
: 404 | 717.728 670.279 0.00447444 0.000491732 200868 0
: 405 Minimum Test error found - save the configuration
: 405 | 710.103 663.87 0.00445007 0.000475132 201261 0
: 406 Minimum Test error found - save the configuration
: 406 | 703.408 657.167 0.00443564 0.000482693 202381 0
: 407 Minimum Test error found - save the configuration
: 407 | 696.09 650.51 0.00442883 0.000484322 202814 0
: 408 Minimum Test error found - save the configuration
: 408 | 689.074 643.947 0.00445552 0.000495002 201994 0
: 409 Minimum Test error found - save the configuration
: 409 | 681.978 637.618 0.00442376 0.000503383 204062 0
: 410 Minimum Test error found - save the configuration
: 410 | 675.219 631.149 0.00444112 0.000489702 202459 0
: 411 Minimum Test error found - save the configuration
: 411 | 668.2 624.711 0.00444075 0.000504052 203216 0
: 412 Minimum Test error found - save the configuration
: 412 | 661.9 617.876 0.00442599 0.000489342 203219 0
: 413 Minimum Test error found - save the configuration
: 413 | 654.745 611.583 0.0044211 0.000485593 203277 0
: 414 Minimum Test error found - save the configuration
: 414 | 648.266 605.045 0.00455876 0.000497192 196968 0
: 415 Minimum Test error found - save the configuration
: 415 | 641.5 599.154 0.00447202 0.000494642 201138 0
: 416 Minimum Test error found - save the configuration
: 416 | 634.919 593.271 0.00442581 0.000486902 203102 0
: 417 Minimum Test error found - save the configuration
: 417 | 628.599 587.019 0.00443824 0.000505402 203415 0
: 418 Minimum Test error found - save the configuration
: 418 | 622.049 580.812 0.00441584 0.000493052 203937 0
: 419 Minimum Test error found - save the configuration
: 419 | 615.913 574.552 0.00444172 0.000496162 202760 0
: 420 Minimum Test error found - save the configuration
: 420 | 609.495 569.232 0.00442765 0.000504813 203934 0
: 421 Minimum Test error found - save the configuration
: 421 | 603.253 562.889 0.00441474 0.000484792 203565 0
: 422 Minimum Test error found - save the configuration
: 422 | 597.215 557.56 0.00442488 0.000488842 203250 0
: 423 Minimum Test error found - save the configuration
: 423 | 590.915 551.18 0.0044136 0.000475993 203169 0
: 424 Minimum Test error found - save the configuration
: 424 | 584.808 545.273 0.0044361 0.000477982 202116 0
: 425 Minimum Test error found - save the configuration
: 425 | 578.584 539.643 0.0044325 0.000484772 202648 0
: 426 Minimum Test error found - save the configuration
: 426 | 572.611 534.011 0.0044403 0.000481682 202091 0
: 427 Minimum Test error found - save the configuration
: 427 | 567.098 528.057 0.00444225 0.000498693 202863 0
: 428 Minimum Test error found - save the configuration
: 428 | 560.684 522.958 0.00443717 0.000491422 202750 0
: 429 Minimum Test error found - save the configuration
: 429 | 555.245 517.543 0.00439559 0.000486922 204673 0
: 430 Minimum Test error found - save the configuration
: 430 | 549.511 511.77 0.00434035 0.000472382 206827 0
: 431 Minimum Test error found - save the configuration
: 431 | 543.755 506.635 0.00436192 0.000476831 205916 0
: 432 Minimum Test error found - save the configuration
: 432 | 538.32 500.796 0.00435565 0.000491922 207054 0
: 433 Minimum Test error found - save the configuration
: 433 | 532.697 495.454 0.00437154 0.000476782 205404 0
: 434 Minimum Test error found - save the configuration
: 434 | 526.991 490.106 0.00434574 0.000477002 206786 0
: 435 Minimum Test error found - save the configuration
: 435 | 521.541 485.14 0.00437604 0.000482622 205475 0
: 436 Minimum Test error found - save the configuration
: 436 | 516.12 480.13 0.00437007 0.000473493 205308 0
: 437 Minimum Test error found - save the configuration
: 437 | 510.943 474.642 0.00443016 0.000510682 204109 0
: 438 Minimum Test error found - save the configuration
: 438 | 505.416 470.384 0.00436276 0.000471992 205615 0
: 439 Minimum Test error found - save the configuration
: 439 | 500.421 464.515 0.0043531 0.000478082 206451 0
: 440 Minimum Test error found - save the configuration
: 440 | 495.08 459.773 0.00436841 0.000479472 205712 0
: 441 Minimum Test error found - save the configuration
: 441 | 489.747 454.99 0.00433231 0.000468752 207063 0
: 442 Minimum Test error found - save the configuration
: 442 | 484.977 450.222 0.0043513 0.000476252 206449 0
: 443 Minimum Test error found - save the configuration
: 443 | 479.807 445.163 0.00434621 0.000480722 206960 0
: 444 Minimum Test error found - save the configuration
: 444 | 475.013 440.077 0.0043434 0.000486293 207409 0
: 445 Minimum Test error found - save the configuration
: 445 | 469.684 436.443 0.00435374 0.000485422 206808 0
: 446 Minimum Test error found - save the configuration
: 446 | 465.345 430.648 0.00432944 0.000476962 207659 0
: 447 Minimum Test error found - save the configuration
: 447 | 459.973 426.827 0.00437337 0.000473232 205121 0
: 448 Minimum Test error found - save the configuration
: 448 | 455.431 421.812 0.00436845 0.000481792 205832 0
: 449 Minimum Test error found - save the configuration
: 449 | 450.588 416.967 0.00439567 0.000472642 203924 0
: 450 Minimum Test error found - save the configuration
: 450 | 445.543 413.23 0.0043635 0.000479162 205955 0
: 451 Minimum Test error found - save the configuration
: 451 | 441.5 407.623 0.0043903 0.000481832 204684 0
: 452 Minimum Test error found - save the configuration
: 452 | 436.297 403.305 0.00436572 0.000471622 205439 0
: 453 Minimum Test error found - save the configuration
: 453 | 431.99 399.166 0.00435051 0.000481562 206775 0
: 454 Minimum Test error found - save the configuration
: 454 | 427.283 394.678 0.00437245 0.000477492 205394 0
: 455 Minimum Test error found - save the configuration
: 455 | 422.794 390.41 0.00434319 0.000471541 206630 0
: 456 Minimum Test error found - save the configuration
: 456 | 418.308 386.764 0.00437236 0.000481292 205599 0
: 457 Minimum Test error found - save the configuration
: 457 | 414.049 381.968 0.00434079 0.000470842 206721 0
: 458 Minimum Test error found - save the configuration
: 458 | 409.928 377.492 0.00436097 0.000477942 206025 0
: 459 Minimum Test error found - save the configuration
: 459 | 405.245 373.314 0.00439054 0.000513792 206359 0
: 460 Minimum Test error found - save the configuration
: 460 | 400.928 369.356 0.00437408 0.000472182 205028 0
: 461 Minimum Test error found - save the configuration
: 461 | 396.962 366.485 0.00443601 0.000492073 202843 0
: 462 Minimum Test error found - save the configuration
: 462 | 392.969 360.748 0.00435211 0.000477661 206481 0
: 463 Minimum Test error found - save the configuration
: 463 | 388.386 357.288 0.00439116 0.000481572 204625 0
: 464 Minimum Test error found - save the configuration
: 464 | 384.234 353.144 0.00435816 0.000483751 206483 0
: 465 Minimum Test error found - save the configuration
: 465 | 380.508 348.894 0.00436557 0.000468572 205286 0
: 466 Minimum Test error found - save the configuration
: 466 | 376.14 345.292 0.00436322 0.000474941 205747 0
: 467 Minimum Test error found - save the configuration
: 467 | 372.339 341.552 0.00436931 0.000490562 206252 0
: 468 Minimum Test error found - save the configuration
: 468 | 368.376 337.787 0.00436143 0.000470442 205603 0
: 469 Minimum Test error found - save the configuration
: 469 | 364.522 334.086 0.00435929 0.000482482 206355 0
: 470 Minimum Test error found - save the configuration
: 470 | 360.605 330.457 0.00438171 0.000478922 204982 0
: 471 Minimum Test error found - save the configuration
: 471 | 356.9 326.115 0.00433618 0.000468582 206847 0
: 472 Minimum Test error found - save the configuration
: 472 | 353.048 322.659 0.00436865 0.000486082 206049 0
: 473 Minimum Test error found - save the configuration
: 473 | 349.37 319.162 0.00434959 0.000468513 206128 0
: 474 Minimum Test error found - save the configuration
: 474 | 345.804 315.38 0.00435928 0.000481963 206328 0
: 475 Minimum Test error found - save the configuration
: 475 | 341.911 312.587 0.0043359 0.000480692 207512 0
: 476 Minimum Test error found - save the configuration
: 476 | 338.337 309.632 0.00431255 0.000466442 208003 0
: 477 Minimum Test error found - save the configuration
: 477 | 335.32 304.719 0.00446062 0.000490653 201513 0
: 478 Minimum Test error found - save the configuration
: 478 | 331.078 302.219 0.00448185 0.000502372 201031 0
: 479 Minimum Test error found - save the configuration
: 479 | 327.407 298.588 0.00437574 0.000480253 205366 0
: 480 Minimum Test error found - save the configuration
: 480 | 324.062 295.381 0.00432996 0.000485483 208091 0
: 481 Minimum Test error found - save the configuration
: 481 | 320.706 291.269 0.0043552 0.000470523 205937 0
: 482 Minimum Test error found - save the configuration
: 482 | 316.837 288.3 0.00437423 0.000483112 205596 0
: 483 Minimum Test error found - save the configuration
: 483 | 313.634 285.597 0.00437702 0.000480332 205303 0
: 484 Minimum Test error found - save the configuration
: 484 | 310.265 281.466 0.00436888 0.000472872 205338 0
: 485 Minimum Test error found - save the configuration
: 485 | 306.633 278.886 0.00436339 0.000481192 206069 0
: 486 Minimum Test error found - save the configuration
: 486 | 303.588 274.985 0.0043654 0.000478852 205838 0
: 487 Minimum Test error found - save the configuration
: 487 | 300.269 271.696 0.00437937 0.000476562 204981 0
: 488 Minimum Test error found - save the configuration
: 488 | 297.037 268.624 0.00437221 0.000487313 205926 0
: 489 Minimum Test error found - save the configuration
: 489 | 293.814 265.285 0.00435574 0.000470543 205910 0
: 490 Minimum Test error found - save the configuration
: 490 | 290.552 262.427 0.00437235 0.000495382 206347 0
: 491 Minimum Test error found - save the configuration
: 491 | 287.356 260.34 0.00436129 0.000478602 206043 0
: 492 Minimum Test error found - save the configuration
: 492 | 284.427 256.794 0.00435243 0.000467413 205919 0
: 493 Minimum Test error found - save the configuration
: 493 | 281.156 253.806 0.00440264 0.000494942 204724 0
: 494 Minimum Test error found - save the configuration
: 494 | 278.022 250.356 0.00434373 0.000478102 206952 0
: 495 Minimum Test error found - save the configuration
: 495 | 274.976 247.782 0.00436565 0.000475562 205651 0
: 496 Minimum Test error found - save the configuration
: 496 | 271.846 245.103 0.00436037 0.000482662 206307 0
: 497 Minimum Test error found - save the configuration
: 497 | 269.012 241.992 0.00435563 0.000483372 206598 0
: 498 Minimum Test error found - save the configuration
: 498 | 266.065 239.285 0.00442339 0.000475732 202652 0
: 499 Minimum Test error found - save the configuration
: 499 | 263.185 236.345 0.00441777 0.000479931 203157 0
: 500 Minimum Test error found - save the configuration
: 500 | 260.257 233.918 0.00436667 0.000470952 205354 0
: 501 Minimum Test error found - save the configuration
: 501 | 257.607 231.159 0.00434915 0.000480812 206807 0
: 502 Minimum Test error found - save the configuration
: 502 | 255.043 228.644 0.00436076 0.000470583 205646 0
: 503 Minimum Test error found - save the configuration
: 503 | 252.22 226.501 0.0043589 0.000474272 205940 0
: 504 Minimum Test error found - save the configuration
: 504 | 249.147 223.266 0.00437054 0.000485693 205928 0
: 505 Minimum Test error found - save the configuration
: 505 | 246.186 220.867 0.00441242 0.000488792 203893 0
: 506 Minimum Test error found - save the configuration
: 506 | 243.828 217.823 0.00438154 0.000483543 205234 0
: 507 Minimum Test error found - save the configuration
: 507 | 240.951 215.078 0.00439973 0.000482312 204216 0
: 508 Minimum Test error found - save the configuration
: 508 | 238.298 213.031 0.00435471 0.000474922 206197 0
: 509 Minimum Test error found - save the configuration
: 509 | 235.863 210.868 0.00441288 0.000489873 203925 0
: 510 Minimum Test error found - save the configuration
: 510 | 233.118 208.536 0.00435622 0.000471312 205925 0
: 511 Minimum Test error found - save the configuration
: 511 | 230.52 205.667 0.0043714 0.000477112 205429 0
: 512 Minimum Test error found - save the configuration
: 512 | 228.047 203.858 0.00435258 0.000480102 206586 0
: 513 Minimum Test error found - save the configuration
: 513 | 225.834 200.961 0.00437701 0.000501522 206426 0
: 514 Minimum Test error found - save the configuration
: 514 | 223.289 198.876 0.00437654 0.000495142 206111 0
: 515 Minimum Test error found - save the configuration
: 515 | 221.468 196.341 0.00435222 0.000491383 207209 0
: 516 Minimum Test error found - save the configuration
: 516 | 218.674 194.164 0.00436627 0.000475412 205610 0
: 517 Minimum Test error found - save the configuration
: 517 | 216.215 193.061 0.00434781 0.000480852 206881 0
: 518 Minimum Test error found - save the configuration
: 518 | 213.761 189.997 0.00436416 0.000473752 205634 0
: 519 Minimum Test error found - save the configuration
: 519 | 211.417 187.597 0.00435278 0.000473052 206200 0
: 520 Minimum Test error found - save the configuration
: 520 | 208.864 184.822 0.00436295 0.000492243 206681 0
: 521 Minimum Test error found - save the configuration
: 521 | 206.793 183.31 0.00434018 0.000468013 206603 0
: 522 Minimum Test error found - save the configuration
: 522 | 204.361 180.639 0.00439169 0.000487853 204927 0
: 523 Minimum Test error found - save the configuration
: 523 | 202.375 178.233 0.00438127 0.000483362 205238 0
: 524 Minimum Test error found - save the configuration
: 524 | 199.747 176.576 0.0043585 0.000473673 205929 0
: 525 Minimum Test error found - save the configuration
: 525 | 197.453 174.338 0.00436025 0.000482642 206313 0
: 526 Minimum Test error found - save the configuration
: 526 | 195.043 173.218 0.00432147 0.000466693 207535 0
: 527 Minimum Test error found - save the configuration
: 527 | 193.126 170.337 0.00437112 0.000477282 205453 0
: 528 Minimum Test error found - save the configuration
: 528 | 191.056 168.454 0.00441701 0.000494183 203935 0
: 529 Minimum Test error found - save the configuration
: 529 | 188.676 166.432 0.00435963 0.000472232 205793 0
: 530 Minimum Test error found - save the configuration
: 530 | 186.542 164.528 0.00441988 0.000501743 204179 0
: 531 Minimum Test error found - save the configuration
: 531 | 184.505 162.32 0.00434884 0.000477642 206654 0
: 532 Minimum Test error found - save the configuration
: 532 | 182.726 161.097 0.00436181 0.000477882 205977 0
: 533 Minimum Test error found - save the configuration
: 533 | 180.436 158.451 0.00435159 0.000481953 206738 0
: 534 Minimum Test error found - save the configuration
: 534 | 178.331 156.488 0.00437289 0.000471612 205061 0
: 535 Minimum Test error found - save the configuration
: 535 | 176.127 155.587 0.00434748 0.000476922 206689 0
: 536 Minimum Test error found - save the configuration
: 536 | 174.325 153.164 0.00434325 0.000480732 207119 0
: 537 Minimum Test error found - save the configuration
: 537 | 172.28 151.403 0.00436906 0.000471922 205279 0
: 538 Minimum Test error found - save the configuration
: 538 | 170.437 149.449 0.00436337 0.000477662 205883 0
: 539 Minimum Test error found - save the configuration
: 539 | 168.772 148.312 0.00436327 0.000477793 205895 0
: 540 Minimum Test error found - save the configuration
: 540 | 166.772 145.785 0.00434468 0.000469212 206427 0
: 541 Minimum Test error found - save the configuration
: 541 | 164.629 144.069 0.00438298 0.000485012 205235 0
: 542 Minimum Test error found - save the configuration
: 542 | 162.869 142.705 0.00435 0.000480102 206724 0
: 543 Minimum Test error found - save the configuration
: 543 | 160.891 140.791 0.00437068 0.000488023 206045 0
: 544 Minimum Test error found - save the configuration
: 544 | 159.018 138.92 0.00435663 0.000480392 206386 0
: 545 Minimum Test error found - save the configuration
: 545 | 157.035 137.922 0.00439011 0.000472903 204227 0
: 546 Minimum Test error found - save the configuration
: 546 | 155.267 136.301 0.00435174 0.000474733 206345 0
: 547 Minimum Test error found - save the configuration
: 547 | 153.377 134.607 0.00434505 0.000475213 206727 0
: 548 Minimum Test error found - save the configuration
: 548 | 151.757 133.909 0.00435263 0.000469983 206045 0
: 549 Minimum Test error found - save the configuration
: 549 | 150.207 131.088 0.00433529 0.000477551 207375 0
: 550 Minimum Test error found - save the configuration
: 550 | 148.451 129.385 0.00432727 0.000484592 208188 0
: 551 Minimum Test error found - save the configuration
: 551 | 146.709 128.454 0.0043906 0.000476502 204389 0
: 552 Minimum Test error found - save the configuration
: 552 | 145.177 126.235 0.00435001 0.000482402 206846 0
: 553 Minimum Test error found - save the configuration
: 553 | 143.44 125.12 0.00437306 0.000471592 205051 0
: 554 Minimum Test error found - save the configuration
: 554 | 141.376 123.198 0.00435208 0.000475293 206357 0
: 555 Minimum Test error found - save the configuration
: 555 | 139.754 121.835 0.00435969 0.000484343 206433 0
: 556 Minimum Test error found - save the configuration
: 556 | 138.198 121.114 0.00437862 0.000476713 205028 0
: 557 Minimum Test error found - save the configuration
: 557 | 136.566 118.669 0.00438879 0.000482532 204800 0
: 558 Minimum Test error found - save the configuration
: 558 | 134.966 117.792 0.00433377 0.000475282 207335 0
: 559 Minimum Test error found - save the configuration
: 559 | 133.449 116.177 0.0043357 0.000466682 206771 0
: 560 Minimum Test error found - save the configuration
: 560 | 131.769 114.885 0.00438505 0.000485221 205137 0
: 561 Minimum Test error found - save the configuration
: 561 | 130.277 113.305 0.0043674 0.000478322 205704 0
: 562 Minimum Test error found - save the configuration
: 562 | 128.99 112.16 0.00437516 0.000475252 205133 0
: 563 Minimum Test error found - save the configuration
: 563 | 127.22 111.589 0.00434981 0.000479632 206709 0
: 564 Minimum Test error found - save the configuration
: 564 | 126.235 109.688 0.00437241 0.000472731 205145 0
: 565 Minimum Test error found - save the configuration
: 565 | 124.417 108.39 0.00435625 0.000475772 206160 0
: 566 Minimum Test error found - save the configuration
: 566 | 123.004 106.944 0.00434963 0.000473202 206376 0
: 567 Minimum Test error found - save the configuration
: 567 | 121.405 105.497 0.00437051 0.000471842 205198 0
: 568 Minimum Test error found - save the configuration
: 568 | 119.911 104.151 0.00435335 0.000478182 206443 0
: 569 Minimum Test error found - save the configuration
: 569 | 118.537 102.515 0.00433192 0.000474652 207401 0
: 570 Minimum Test error found - save the configuration
: 570 | 117.541 101.003 0.00432893 0.000468592 207236 0
: 571 Minimum Test error found - save the configuration
: 571 | 115.929 100.325 0.00434073 0.000483042 207378 0
: 572 Minimum Test error found - save the configuration
: 572 | 114.798 99.6783 0.00433482 0.000475132 207271 0
: 573 Minimum Test error found - save the configuration
: 573 | 113.326 98.2817 0.00434264 0.000467442 206441 0
: 574 Minimum Test error found - save the configuration
: 574 | 111.699 96.6752 0.00443409 0.000500292 203366 0
: 575 Minimum Test error found - save the configuration
: 575 | 110.529 95.1378 0.00434318 0.000464263 206243 0
: 576 Minimum Test error found - save the configuration
: 576 | 109 93.96 0.00439399 0.000482162 204508 0
: 577 Minimum Test error found - save the configuration
: 577 | 107.703 92.5309 0.00435245 0.000476412 206396 0
: 578 Minimum Test error found - save the configuration
: 578 | 106.455 91.4644 0.00435225 0.000470212 206077 0
: 579 Minimum Test error found - save the configuration
: 579 | 105.109 90.2863 0.00433763 0.000472453 206976 0
: 580 Minimum Test error found - save the configuration
: 580 | 103.906 89.0682 0.00435819 0.000491102 206874 0
: 581 Minimum Test error found - save the configuration
: 581 | 102.644 88.6258 0.0043435 0.000464492 206238 0
: 582 Minimum Test error found - save the configuration
: 582 | 101.687 87.777 0.00434091 0.000479272 207166 0
: 583 Minimum Test error found - save the configuration
: 583 | 100.28 86.8221 0.00436512 0.000476021 205703 0
: 584 Minimum Test error found - save the configuration
: 584 | 99.3382 84.6563 0.00436395 0.000471802 205542 0
: 585 Minimum Test error found - save the configuration
: 585 | 97.9191 84.3063 0.00436709 0.000484141 206029 0
: 586 Minimum Test error found - save the configuration
: 586 | 96.9727 83.5467 0.00433978 0.000470722 206769 0
: 587 Minimum Test error found - save the configuration
: 587 | 95.9516 82.1058 0.0043501 0.000472933 206336 0
: 588 Minimum Test error found - save the configuration
: 588 | 94.3769 81.1391 0.00434112 0.000481942 207298 0
: 589 Minimum Test error found - save the configuration
: 589 | 93.7168 79.9005 0.00434474 0.000467973 206358 0
: 590 Minimum Test error found - save the configuration
: 590 | 92.2161 79.5088 0.00436688 0.000476542 205638 0
: 591 Minimum Test error found - save the configuration
: 591 | 91.3079 78.0389 0.00435013 0.000477162 206560 0
: 592 Minimum Test error found - save the configuration
: 592 | 89.9292 76.9509 0.00434683 0.000470192 206364 0
: 593 Minimum Test error found - save the configuration
: 593 | 89.0366 75.595 0.00434938 0.000474313 206448 0
: 594 Minimum Test error found - save the configuration
: 594 | 87.888 74.7182 0.00440117 0.000484482 204254 0
: 595 Minimum Test error found - save the configuration
: 595 | 86.8324 74.3278 0.00434106 0.000465663 206431 0
: 596 | 86.1135 75.1204 0.00430575 0.000449942 207479 1
: 597 Minimum Test error found - save the configuration
: 597 | 85.1828 71.8948 0.00440491 0.000475612 203599 0
: 598 Minimum Test error found - save the configuration
: 598 | 84.1194 71.2685 0.00434951 0.000473631 206405 0
: 599 Minimum Test error found - save the configuration
: 599 | 82.9711 70.013 0.00439343 0.000486362 204757 0
: 600 Minimum Test error found - save the configuration
: 600 | 82.2068 70.0081 0.00432272 0.000465792 207419 0
: 601 Minimum Test error found - save the configuration
: 601 | 81.2126 68.324 0.00435609 0.000474162 206083 0
: 602 Minimum Test error found - save the configuration
: 602 | 80.2465 67.6349 0.00433046 0.000474833 207489 0
: 603 Minimum Test error found - save the configuration
: 603 | 79.2007 67.0438 0.00431617 0.000465113 207735 0
: 604 Minimum Test error found - save the configuration
: 604 | 78.1041 65.6769 0.00438564 0.000489642 205339 0
: 605 Minimum Test error found - save the configuration
: 605 | 77.4 64.9394 0.00437844 0.000483192 205378 0
: 606 Minimum Test error found - save the configuration
: 606 | 76.7303 64.8523 0.00436953 0.000471962 205256 0
: 607 Minimum Test error found - save the configuration
: 607 | 75.949 63.1833 0.00437259 0.000481752 205611 0
: 608 Minimum Test error found - save the configuration
: 608 | 74.6459 62.5728 0.00435343 0.000472132 206117 0
: 609 Minimum Test error found - save the configuration
: 609 | 73.6891 61.5075 0.00434452 0.000473742 206677 0
: 610 Minimum Test error found - save the configuration
: 610 | 72.8146 60.8837 0.00434788 0.000496102 207696 0
: 611 Minimum Test error found - save the configuration
: 611 | 71.9954 59.858 0.00433604 0.000468812 206867 0
: 612 Minimum Test error found - save the configuration
: 612 | 71.3382 59.3089 0.00433375 0.000471123 207113 0
: 613 Minimum Test error found - save the configuration
: 613 | 70.2849 58.421 0.00435278 0.000483062 206733 0
: 614 Minimum Test error found - save the configuration
: 614 | 69.4255 57.5658 0.00433953 0.000469002 206690 0
: 615 Minimum Test error found - save the configuration
: 615 | 68.6302 57.3546 0.00435997 0.000483082 206351 0
: 616 Minimum Test error found - save the configuration
: 616 | 67.8338 56.5266 0.00435262 0.000475292 206328 0
: 617 Minimum Test error found - save the configuration
: 617 | 67.0203 55.3396 0.00434757 0.000483512 207036 0
: 618 Minimum Test error found - save the configuration
: 618 | 66.1687 54.6426 0.00435879 0.000482692 206393 0
: 619 | 65.4431 54.9389 0.00430811 0.000445012 207088 1
: 620 | 64.7881 55.2673 0.0043749 0.000441321 203377 2
: 621 | 64.5397 55.9566 0.0043202 0.000451902 206809 3
: 622 Minimum Test error found - save the configuration
: 622 | 64.0357 53.944 0.00438154 0.000485021 205312 0
: 623 Minimum Test error found - save the configuration
: 623 | 62.8105 52.4379 0.00435428 0.000473852 206163 0
: 624 Minimum Test error found - save the configuration
: 624 | 61.8662 50.8345 0.00436024 0.000486054 206495 0
: 625 Minimum Test error found - save the configuration
: 625 | 61.1489 50.4901 0.00433479 0.000472972 207156 0
: 626 Minimum Test error found - save the configuration
: 626 | 60.4518 49.9632 0.00435429 0.000474223 206182 0
: 627 Minimum Test error found - save the configuration
: 627 | 59.8294 49.4022 0.00436017 0.000478672 206106 0
: 628 Minimum Test error found - save the configuration
: 628 | 59.0394 48.2518 0.00435195 0.000468012 205977 0
: 629 Minimum Test error found - save the configuration
: 629 | 58.5482 47.4627 0.00435611 0.000475802 206169 0
: 630 | 57.5787 47.5932 0.00433778 0.000446273 205576 1
: 631 Minimum Test error found - save the configuration
: 631 | 56.9691 47.2608 0.00436154 0.000472542 205709 0
: 632 Minimum Test error found - save the configuration
: 632 | 56.0703 45.8728 0.00434716 0.000487264 207259 0
: 633 Minimum Test error found - save the configuration
: 633 | 55.3378 44.9065 0.00434384 0.000477402 206909 0
: 634 Minimum Test error found - save the configuration
: 634 | 54.7461 44.5738 0.00450309 0.000480792 198891 0
: 635 Minimum Test error found - save the configuration
: 635 | 53.9294 43.9525 0.00434579 0.000474242 206636 0
: 636 Minimum Test error found - save the configuration
: 636 | 53.3575 43.4203 0.00435259 0.000468922 205991 0
: 637 | 52.9458 43.5065 0.00430695 0.000445002 207149 1
: 638 Minimum Test error found - save the configuration
: 638 | 52.4883 42.3524 0.0043673 0.000479372 205765 0
: 639 Minimum Test error found - save the configuration
: 639 | 51.4665 41.4256 0.00434271 0.000466792 206403 0
: 640 | 50.9751 41.8649 0.00430754 0.000444192 207074 1
: 641 Minimum Test error found - save the configuration
: 641 | 50.4276 40.9575 0.00437603 0.000479052 205287 0
: 642 Minimum Test error found - save the configuration
: 642 | 49.6874 39.946 0.00432447 0.000469652 207533 0
: 643 Minimum Test error found - save the configuration
: 643 | 49.1503 38.779 0.00442664 0.000492472 203347 0
: 644 | 48.6929 39.006 0.00430023 0.000446092 207569 1
: 645 Minimum Test error found - save the configuration
: 645 | 47.7399 37.7447 0.00439019 0.000478073 204493 0
: 646 Minimum Test error found - save the configuration
: 646 | 47.4197 37.7146 0.00438946 0.000492522 205289 0
: 647 Minimum Test error found - save the configuration
: 647 | 46.7865 36.8175 0.00437195 0.000494372 206314 0
: 648 Minimum Test error found - save the configuration
: 648 | 46.1012 36.622 0.00435947 0.000471592 205768 0
: 649 Minimum Test error found - save the configuration
: 649 | 45.6457 35.7059 0.00433385 0.000472463 207179 0
: 650 Minimum Test error found - save the configuration
: 650 | 45.016 35.6013 0.00436231 0.000471502 205613 0
: 651 Minimum Test error found - save the configuration
: 651 | 44.6779 35.1792 0.00434872 0.000479842 206778 0
: 652 Minimum Test error found - save the configuration
: 652 | 43.9455 34.5154 0.00439292 0.000482432 204578 0
: 653 | 43.6869 34.589 0.00431854 0.000436661 206086 1
: 654 Minimum Test error found - save the configuration
: 654 | 42.8788 33.5837 0.00434354 0.000487873 207487 0
: 655 Minimum Test error found - save the configuration
: 655 | 42.4718 33.1346 0.0043046 0.000471332 208699 0
: 656 Minimum Test error found - save the configuration
: 656 | 42.0078 32.7867 0.00430857 0.000465772 208182 0
: 657 Minimum Test error found - save the configuration
: 657 | 41.4672 32.1211 0.00435113 0.000479492 206631 0
: 658 Minimum Test error found - save the configuration
: 658 | 41.217 32.0987 0.00436241 0.000470542 205557 0
: 659 | 41.0032 32.2901 0.0043396 0.000442272 205269 1
: 660 Minimum Test error found - save the configuration
: 660 | 40.0094 30.9454 0.0043532 0.000484352 206780 0
: 661 Minimum Test error found - save the configuration
: 661 | 39.3332 30.1744 0.00435269 0.000470962 206094 0
: 662 Minimum Test error found - save the configuration
: 662 | 39.2032 30.0422 0.00435985 0.000472692 205806 0
: 663 | 38.9993 30.2444 0.00429389 0.000443773 207786 1
: 664 Minimum Test error found - save the configuration
: 664 | 38.2308 29.1022 0.0043218 0.000468972 207640 0
: 665 | 37.9057 29.1822 0.00428894 0.000442721 207997 1
: 666 Minimum Test error found - save the configuration
: 666 | 37.3142 28.3824 0.00437714 0.000491462 205884 0
: 667 | 36.6997 28.3975 0.00428429 0.000436133 207892 1
: 668 Minimum Test error found - save the configuration
: 668 | 36.3477 27.8052 0.00433223 0.000471962 207240 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.8016 26.9493 0.00432956 0.000479632 207796 0
: 670 | 35.3806 27.4789 0.00428936 0.000434872 207550 1
: 671 Minimum Test error found - save the configuration
: 671 | 35.1415 26.2933 0.00433169 0.000474362 207398 0
: 672 | 34.7355 26.3285 0.00429786 0.000449511 207881 1
: 673 Minimum Test error found - save the configuration
: 673 | 34.3728 25.8543 0.004307 0.000465212 208236 0
: 674 Minimum Test error found - save the configuration
: 674 | 33.6146 25.4389 0.00433396 0.000470902 207090 0
: 675 Minimum Test error found - save the configuration
: 675 | 33.1976 24.7347 0.00433951 0.000483052 207444 0
: 676 | 32.814 24.8248 0.0043149 0.000438062 206354 1
: 677 Minimum Test error found - save the configuration
: 677 | 32.4757 24.7204 0.0043463 0.000471722 206474 0
: 678 Minimum Test error found - save the configuration
: 678 | 32.2891 23.5136 0.00432266 0.000477952 208078 0
: 679 Minimum Test error found - save the configuration
: 679 | 31.8929 23.3641 0.00433385 0.000468602 206973 0
: 680 Minimum Test error found - save the configuration
: 680 | 31.4433 23.0441 0.00433729 0.000473732 207063 0
: 681 Minimum Test error found - save the configuration
: 681 | 31.1027 22.5885 0.00432419 0.000482522 208243 0
: 682 Minimum Test error found - save the configuration
: 682 | 30.5999 22.3816 0.00433066 0.000468952 207162 0
: 683 Minimum Test error found - save the configuration
: 683 | 30.0386 22.3099 0.0043365 0.000474402 207141 0
: 684 Minimum Test error found - save the configuration
: 684 | 29.6722 21.636 0.00432865 0.000475662 207631 0
: 685 | 29.4404 21.8217 0.00427923 0.000436151 208166 1
: 686 Minimum Test error found - save the configuration
: 686 | 29.0477 21.2966 0.00431811 0.000472052 208005 0
: 687 | 28.7924 21.5249 0.00429049 0.000447122 208151 1
: 688 Minimum Test error found - save the configuration
: 688 | 28.5122 20.2639 0.00432779 0.000476672 207732 0
: 689 Minimum Test error found - save the configuration
: 689 | 28.129 20.0036 0.0043681 0.000476582 205575 0
: 690 | 27.7914 20.1675 0.00430831 0.000450543 207374 1
: 691 | 27.4185 20.2405 0.00429923 0.000442462 207428 2
: 692 Minimum Test error found - save the configuration
: 692 | 27.0172 19.2827 0.00431953 0.000465381 207569 0
: 693 Minimum Test error found - save the configuration
: 693 | 26.9534 18.6803 0.00434336 0.000480612 207107 0
: 694 | 26.5981 18.9194 0.00430303 0.00044087 207138 1
: 695 | 26.134 19.2057 0.00430844 0.000436162 206597 2
: 696 | 25.6218 19.5578 0.00433158 0.000449672 206084 3
: 697 Minimum Test error found - save the configuration
: 697 | 25.3275 18.2168 0.00434975 0.000477371 206591 0
: 698 Minimum Test error found - save the configuration
: 698 | 25.046 17.6297 0.00434932 0.000472463 206353 0
: 699 Minimum Test error found - save the configuration
: 699 | 24.5739 17.3547 0.00435587 0.000484722 206657 0
: 700 Minimum Test error found - save the configuration
: 700 | 24.389 17.0699 0.00436811 0.000469792 205217 0
: 701 | 24.1135 17.4172 0.00430114 0.000439282 207154 1
: 702 | 23.6485 17.1414 0.00429645 0.000446512 207796 2
: 703 Minimum Test error found - save the configuration
: 703 | 23.4242 16.8052 0.00430935 0.000464672 208080 0
: 704 | 23.1143 17.2888 0.00429037 0.000436972 207609 1
: 705 Minimum Test error found - save the configuration
: 705 | 22.8854 16.0158 0.00435528 0.000486891 206805 0
: 706 | 22.4895 16.7277 0.00430582 0.000436312 206745 1
: 707 Minimum Test error found - save the configuration
: 707 | 22.1792 15.1467 0.00434426 0.000471042 206547 0
: 708 Minimum Test error found - save the configuration
: 708 | 21.8623 14.9061 0.00434837 0.000481292 206875 0
: 709 | 21.4787 15.057 0.0043065 0.000436691 206729 1
: 710 Minimum Test error found - save the configuration
: 710 | 21.2427 14.5714 0.00433919 0.000471811 206859 0
: 711 | 20.8576 14.7716 0.00432105 0.000450152 206670 1
: 712 Minimum Test error found - save the configuration
: 712 | 20.9778 14.149 0.00438855 0.000481892 204779 0
: 713 Minimum Test error found - save the configuration
: 713 | 20.5675 13.9228 0.00435994 0.000472463 205789 0
: 714 Minimum Test error found - save the configuration
: 714 | 20.2993 13.7192 0.00435456 0.000474342 206174 0
: 715 Minimum Test error found - save the configuration
: 715 | 19.8987 13.0542 0.00432274 0.000464022 207323 0
: 716 | 19.5716 13.2043 0.00429187 0.000439353 207656 1
: 717 Minimum Test error found - save the configuration
: 717 | 19.2443 12.9267 0.00432899 0.000478342 207757 0
: 718 Minimum Test error found - save the configuration
: 718 | 19.0454 12.899 0.00432833 0.000469554 207320 0
: 719 Minimum Test error found - save the configuration
: 719 | 18.7087 12.6296 0.00433462 0.000472652 207148 0
: 720 Minimum Test error found - save the configuration
: 720 | 18.6204 12.4993 0.00441574 0.000482551 203397 0
: 721 Minimum Test error found - save the configuration
: 721 | 18.3821 12.3162 0.00440693 0.000477412 203587 0
: 722 Minimum Test error found - save the configuration
: 722 | 18.0019 12.1656 0.00447726 0.000501002 201194 0
: 723 Minimum Test error found - save the configuration
: 723 | 17.884 12.1344 0.00441275 0.000473501 203084 0
: 724 Minimum Test error found - save the configuration
: 724 | 17.595 11.6674 0.00440113 0.000482472 204152 0
: 725 Minimum Test error found - save the configuration
: 725 | 17.4299 11.6359 0.00437084 0.000484382 205843 0
: 726 | 17.2425 11.9633 0.00432317 0.000433702 205684 1
: 727 Minimum Test error found - save the configuration
: 727 | 16.9286 11.1624 0.004396 0.000491892 204912 0
: 728 Minimum Test error found - save the configuration
: 728 | 16.7197 10.8317 0.00438465 0.000471903 204460 0
: 729 | 16.4277 11.0153 0.00433891 0.000443272 205358 1
: 730 | 16.3115 11.2822 0.00431408 0.000444543 206743 2
: 731 | 16.2655 10.8523 0.00430258 0.000436752 206941 3
: 732 Minimum Test error found - save the configuration
: 732 | 15.9265 10.5966 0.00434352 0.000472982 206690 0
: 733 | 15.8657 11.2567 0.00431242 0.000449802 207113 1
: 734 | 15.6087 10.6056 0.00430385 0.000438621 206974 2
: 735 Minimum Test error found - save the configuration
: 735 | 15.5897 10.1863 0.00438512 0.000487862 205273 0
: 736 | 15.0349 10.1905 0.00432677 0.000446342 206163 1
: 737 Minimum Test error found - save the configuration
: 737 | 14.8968 10.1277 0.00434752 0.000469503 206291 0
: 738 | 14.8356 10.1333 0.00431895 0.000443552 206430 1
: 739 | 14.4543 10.1915 0.00432719 0.000446382 206143 2
: 740 Minimum Test error found - save the configuration
: 740 | 14.22 9.43653 0.00434015 0.000468272 206618 0
: 741 Minimum Test error found - save the configuration
: 741 | 14.0385 9.26258 0.00434637 0.000475602 206677 0
: 742 | 13.7896 9.37824 0.00430422 0.000444072 207246 1
: 743 | 13.6797 9.78383 0.00429589 0.000436292 207276 2
: 744 Minimum Test error found - save the configuration
: 744 | 13.4726 9.16982 0.00434002 0.000473932 206928 0
: 745 | 13.2356 9.87373 0.00431434 0.000441343 206558 1
: 746 | 13.3273 9.27314 0.00430081 0.000436601 207028 2
: 747 Minimum Test error found - save the configuration
: 747 | 13.063 8.86644 0.00437993 0.000481022 205186 0
: 748 | 12.9889 9.4941 0.00432229 0.000443902 206271 1
: 749 Minimum Test error found - save the configuration
: 749 | 12.8796 8.77695 0.00433563 0.000469382 206919 0
: 750 | 12.562 9.03145 0.00431434 0.000442062 206597 1
: 751 | 12.3377 8.9324 0.00432325 0.000444762 206266 2
: 752 Minimum Test error found - save the configuration
: 752 | 12.2623 8.66179 0.00467486 0.000495491 191416 0
: 753 | 12.1138 9.70361 0.00456687 0.000523722 197866 1
: 754 Minimum Test error found - save the configuration
: 754 | 11.97 8.40767 0.0044247 0.000494152 203534 0
: 755 Minimum Test error found - save the configuration
: 755 | 11.7891 8.3191 0.00436729 0.000476812 205630 0
: 756 | 11.7633 8.72857 0.00435122 0.000443482 204722 1
: 757 | 11.4856 8.52362 0.00433267 0.000452881 206197 2
: 758 | 11.1043 8.6813 0.00435234 0.000436922 204321 3
: 759 | 10.9917 8.42276 0.00433548 0.000455261 206174 4
: 760 | 11.0964 8.9833 0.00435495 0.000451112 204927 5
: 761 Minimum Test error found - save the configuration
: 761 | 10.9457 8.07741 0.00434248 0.000468882 206526 0
: 762 Minimum Test error found - save the configuration
: 762 | 10.7158 7.88026 0.00436939 0.000472732 205304 0
: 763 | 10.6696 8.15292 0.00430633 0.000450362 207471 1
: 764 | 10.454 8.51665 0.00430835 0.000437022 206648 2
: 765 | 10.7907 8.35929 0.00431629 0.000441663 206471 3
: 766 Minimum Test error found - save the configuration
: 766 | 10.3244 7.33489 0.00433968 0.000480702 207309 0
: 767 Minimum Test error found - save the configuration
: 767 | 10.0556 6.95347 0.00434239 0.000465792 206367 0
: 768 | 9.89259 7.61303 0.00430473 0.000441852 207100 1
: 769 | 9.67137 7.33026 0.00429782 0.000447022 207749 2
: 770 | 9.6173 7.60541 0.00430941 0.000437103 206595 3
: 771 | 9.56707 7.83193 0.00431501 0.000439781 206440 4
: 772 | 9.30608 7.36255 0.00431643 0.000450341 206928 5
: 773 | 9.23229 7.3203 0.00431382 0.000436462 206326 6
: 774 Minimum Test error found - save the configuration
: 774 | 9.08616 6.65069 0.00434439 0.000471261 206551 0
: 775 | 9.30033 6.90925 0.00431888 0.000446542 206594 1
: 776 | 8.89936 7.43559 0.00428328 0.000433011 207778 2
: 777 Minimum Test error found - save the configuration
: 777 | 8.79169 6.4358 0.00431587 0.000466893 207847 0
: 778 | 8.72515 6.45758 0.00429032 0.000447492 208180 1
: 779 | 8.88816 6.93549 0.00428578 0.000442012 208129 2
: 780 | 8.73232 6.62496 0.00430064 0.000435882 206999 3
: 781 | 8.30728 6.76262 0.00435092 0.000458461 205526 4
: 782 | 8.24152 7.25669 0.00432725 0.000444552 206042 5
: 783 | 8.11828 6.94695 0.00429969 0.000437012 207110 6
: 784 Minimum Test error found - save the configuration
: 784 | 8.07891 6.3422 0.00435768 0.000483482 206494 0
: 785 Minimum Test error found - save the configuration
: 785 | 7.79637 6.06371 0.00434536 0.000476272 206767 0
: 786 | 7.73928 6.3477 0.00430283 0.000435911 206883 1
: 787 Minimum Test error found - save the configuration
: 787 | 7.79226 6.05811 0.00434774 0.000476202 206636 0
: 788 | 7.68643 6.68501 0.00430002 0.000444412 207490 1
: 789 Minimum Test error found - save the configuration
: 789 | 7.59766 5.58295 0.00433678 0.000467822 206774 0
: 790 | 7.61354 6.77212 0.00431239 0.000450442 207149 1
: 791 | 7.41425 6.46777 0.00429895 0.000444962 207577 2
: 792 | 7.17692 6.06747 0.00429208 0.000436242 207478 3
: 793 Minimum Test error found - save the configuration
: 793 | 7.05741 5.369 0.00435542 0.000480593 206461 0
: 794 | 7.08675 6.53162 0.00430807 0.000443942 207033 1
: 795 | 6.98306 6.10175 0.00433249 0.000438213 205430 2
: 796 | 6.97824 5.52481 0.00432727 0.000449632 206311 3
: 797 | 6.76187 6.04833 0.00429944 0.000444132 207506 4
: 798 | 6.75692 5.8875 0.00429766 0.000437952 207270 5
: 799 | 6.73669 5.4787 0.00435225 0.000450522 205037 6
: 800 | 6.57262 6.45622 0.00432356 0.000443762 206196 7
: 801 | 6.48205 5.47329 0.00430185 0.000437831 207038 8
: 802 | 6.46132 5.6423 0.0042986 0.000440672 207365 9
: 803 | 6.30021 5.99046 0.00430912 0.000444222 206991 10
: 804 | 6.20894 5.43173 0.00431778 0.000458522 207294 11
: 805 | 6.09554 5.53176 0.0043385 0.000442672 205348 12
: 806 | 6.04457 6.03569 0.00430895 0.000444061 206992 13
: 807 | 6.04756 5.61396 0.00431361 0.000438562 206449 14
: 808 | 6.09556 6.88977 0.00431841 0.000441442 206347 15
: 809 | 5.84974 5.70123 0.00430306 0.000441312 207160 16
: 810 | 5.82537 5.75405 0.00427977 0.000434642 208056 17
: 811 Minimum Test error found - save the configuration
: 811 | 5.82419 5.22045 0.00434973 0.000477282 206588 0
: 812 | 5.72447 5.26614 0.00429115 0.000446332 208072 1
: 813 | 5.73276 5.83606 0.00429466 0.000436673 207362 2
: 814 | 5.53542 5.73411 0.00431835 0.000442832 206424 3
: 815 | 5.54399 6.53513 0.00432064 0.000450082 206689 4
: 816 | 5.49175 6.23271 0.00430499 0.000436602 206805 5
: 817 Minimum Test error found - save the configuration
: 817 | 5.36301 4.9794 0.00434721 0.000475162 206609 0
: 818 | 5.35272 6.34275 0.00431243 0.000449872 207117 1
: 819 | 5.24468 5.36835 0.00430139 0.000438902 207120 2
: 820 | 5.0185 6.38805 0.00431143 0.000441701 206733 3
: 821 | 5.1223 5.46741 0.00431028 0.000450252 207252 4
: 822 | 5.08843 5.44641 0.00429898 0.000444432 207547 5
: 823 | 4.94108 5.57843 0.00432687 0.000433832 205495 6
: 824 | 4.93508 6.10296 0.0042978 0.000446912 207744 7
: 825 | 5.03038 4.99917 0.00428506 0.000444432 208299 8
: 826 | 5.1545 5.88798 0.00430211 0.000434912 206868 9
: 827 | 4.93935 5.84172 0.00427953 0.000438501 208278 10
: 828 | 4.82522 5.37236 0.00434337 0.000441582 205034 11
: 829 | 4.73185 7.35854 0.00428447 0.000433221 207725 12
: 830 | 5.27177 6.03001 0.00429211 0.000441331 207750 13
: 831 | 4.72656 7.0021 0.00428611 0.000441202 208067 14
: 832 | 4.60289 4.99493 0.00428516 0.000433072 207680 15
: 833 | 4.45035 5.90458 0.0042912 0.000440242 207741 16
: 834 | 4.40177 5.05935 0.00431836 0.000451653 206894 17
: 835 | 4.42655 6.14247 0.004303 0.000435712 206863 18
: 836 Minimum Test error found - save the configuration
: 836 | 4.35199 4.9107 0.00434826 0.000480262 206825 0
: 837 | 4.22515 5.43425 0.00432124 0.000445792 206428 1
: 838 | 4.34261 5.58676 0.00430091 0.000436002 206991 2
: 839 | 4.05925 5.60915 0.00429947 0.000436223 207080 3
: 840 | 4.12549 5.35856 0.00430815 0.000448411 207268 4
: 841 | 4.29966 5.36791 0.0042924 0.000440901 207711 5
: 842 | 4.10773 5.42542 0.0042966 0.000433532 207089 6
: 843 | 3.95255 5.0775 0.00431717 0.000450432 206893 7
: 844 | 3.99035 6.13918 0.00430612 0.000444373 207160 8
: 845 | 3.85784 5.64339 0.00430265 0.000437052 206954 9
: 846 | 3.81074 6.49061 0.0043042 0.000441031 207084 10
: 847 | 3.7816 5.90154 0.00430643 0.000443822 207114 11
: 848 | 3.91609 5.94084 0.00430404 0.000435932 206820 12
: 849 | 3.63282 5.35004 0.00429446 0.000437262 207404 13
: 850 | 3.68362 6.10943 0.004295 0.000448402 207976 14
: 851 | 3.75052 5.34216 0.00435227 0.000436141 204283 15
: 852 | 3.73401 6.66165 0.00431928 0.000442702 206368 16
: 853 | 3.75982 5.82427 0.00431571 0.000443352 206593 17
: 854 | 3.62055 5.7303 0.00431996 0.000436782 206017 18
: 855 | 3.5455 5.95347 0.00430855 0.000441992 206902 19
: 856 | 3.51705 5.86767 0.00431546 0.000451722 207053 20
: 857 | 3.63087 7.02702 0.0043073 0.000436782 206691 21
:
: Elapsed time for training with 1000 events: 3.75 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00586 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.831 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.156 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.32098e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.09504e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0333 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0368 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00137 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0482 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.905 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0199 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00266 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0373 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00435 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00211 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000415 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0491 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00565 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.884 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.0998 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.626 0.182 5.54 1.64 | 3.214 3.221
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.0617 0.255 2.07 1.15 | 3.369 3.360
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.