Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.269 sec
: Elapsed time for training with 1000 events: 0.273 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00292 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000832 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00427 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000228 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000429 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31499.5
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33073.9 31180.9 0.00494761 0.000510743 180307 0
: 2 Minimum Test error found - save the configuration
: 2 | 32626.6 30657.5 0.00457882 0.000476073 194991 0
: 3 Minimum Test error found - save the configuration
: 3 | 31967.8 30034.7 0.00470586 0.000489954 189757 0
: 4 Minimum Test error found - save the configuration
: 4 | 31285 29447.4 0.00437033 0.000488032 206064 0
: 5 Minimum Test error found - save the configuration
: 5 | 30617.4 28813.8 0.00453849 0.000483884 197306 0
: 6 Minimum Test error found - save the configuration
: 6 | 29869 27966.7 0.00431301 0.000484014 208932 0
: 7 Minimum Test error found - save the configuration
: 7 | 29124.9 27276.8 0.00436185 0.000507573 207562 0
: 8 Minimum Test error found - save the configuration
: 8 | 28634.9 26873.6 0.00453573 0.000470155 196774 0
: 9 Minimum Test error found - save the configuration
: 9 | 28266.7 26547.7 0.00414984 0.000448254 216124 0
: 10 Minimum Test error found - save the configuration
: 10 | 27937.2 26250.4 0.00508103 0.000556385 176810 0
: 11 Minimum Test error found - save the configuration
: 11 | 27631.8 25967.7 0.00563145 0.000644884 160431 0
: 12 Minimum Test error found - save the configuration
: 12 | 27346.1 25688.9 0.00535445 0.000659384 170392 0
: 13 Minimum Test error found - save the configuration
: 13 | 27062.8 25423.6 0.00560692 0.000557364 158430 0
: 14 Minimum Test error found - save the configuration
: 14 | 26789.1 25168.9 0.00507114 0.000535625 176386 0
: 15 Minimum Test error found - save the configuration
: 15 | 26526.1 24918.7 0.0058362 0.000692605 155533 0
: 16 Minimum Test error found - save the configuration
: 16 | 26265.8 24677.7 0.00613354 0.000694463 147084 0
: 17 Minimum Test error found - save the configuration
: 17 | 26019.3 24433.7 0.0056436 0.000626535 159456 0
: 18 Minimum Test error found - save the configuration
: 18 | 25768.5 24199.5 0.00566729 0.000692503 160811 0
: 19 Minimum Test error found - save the configuration
: 19 | 25525.5 23970 0.00575207 0.000562853 154166 0
: 20 Minimum Test error found - save the configuration
: 20 | 25287.4 23743.5 0.00610854 0.000703885 148021 0
: 21 Minimum Test error found - save the configuration
: 21 | 25051.2 23522.6 0.00616059 0.000702875 146581 0
: 22 Minimum Test error found - save the configuration
: 22 | 24818.2 23307.4 0.00582529 0.000537404 151289 0
: 23 Minimum Test error found - save the configuration
: 23 | 24592.9 23090.7 0.00558248 0.000601564 160613 0
: 24 Minimum Test error found - save the configuration
: 24 | 24368.8 22876 0.00560351 0.000688626 162771 0
: 25 Minimum Test error found - save the configuration
: 25 | 24147 22664.5 0.00612524 0.000671514 146689 0
: 26 Minimum Test error found - save the configuration
: 26 | 23926.7 22458.3 0.00616026 0.000673685 145810 0
: 27 Minimum Test error found - save the configuration
: 27 | 23710.9 22254.2 0.00588497 0.000450443 147207 0
: 28 Minimum Test error found - save the configuration
: 28 | 23500.5 22048.5 0.00413747 0.000442742 216525 0
: 29 Minimum Test error found - save the configuration
: 29 | 23287.3 21849.4 0.00427296 0.000459233 209768 0
: 30 Minimum Test error found - save the configuration
: 30 | 23077.2 21655.3 0.00432841 0.000446314 206074 0
: 31 Minimum Test error found - save the configuration
: 31 | 22874.7 21458.8 0.0043108 0.000499523 209903 0
: 32 Minimum Test error found - save the configuration
: 32 | 22671.4 21264.8 0.00418352 0.000484344 216264 0
: 33 Minimum Test error found - save the configuration
: 33 | 22468.6 21075.4 0.00417404 0.000475354 216293 0
: 34 Minimum Test error found - save the configuration
: 34 | 22270.2 20887.6 0.00436304 0.000442272 204042 0
: 35 Minimum Test error found - save the configuration
: 35 | 22074 20701.3 0.00427582 0.000482463 210895 0
: 36 Minimum Test error found - save the configuration
: 36 | 21879 20517.7 0.00434284 0.000467872 206453 0
: 37 Minimum Test error found - save the configuration
: 37 | 21684.6 20338.8 0.00432385 0.000538413 211336 0
: 38 Minimum Test error found - save the configuration
: 38 | 21496.4 20158.4 0.00412417 0.000449123 217684 0
: 39 Minimum Test error found - save the configuration
: 39 | 21309.7 19977.7 0.00466226 0.000455443 190167 0
: 40 Minimum Test error found - save the configuration
: 40 | 21121.3 19801.7 0.00414336 0.000440574 216054 0
: 41 Minimum Test error found - save the configuration
: 41 | 20934.3 19631.5 0.00415584 0.000486403 218017 0
: 42 Minimum Test error found - save the configuration
: 42 | 20754.2 19459 0.00424458 0.000468394 211854 0
: 43 Minimum Test error found - save the configuration
: 43 | 20573.9 19287.5 0.0041772 0.000501214 217629 0
: 44 Minimum Test error found - save the configuration
: 44 | 20395.9 19116.7 0.00423884 0.000489412 213366 0
: 45 Minimum Test error found - save the configuration
: 45 | 20216 18951.9 0.00412674 0.000435144 216708 0
: 46 Minimum Test error found - save the configuration
: 46 | 20040.6 18788.9 0.00414109 0.000439704 216135 0
: 47 Minimum Test error found - save the configuration
: 47 | 19871.3 18621.1 0.00409354 0.000437923 218841 0
: 48 Minimum Test error found - save the configuration
: 48 | 19695.7 18460.5 0.00415443 0.000461262 216616 0
: 49 Minimum Test error found - save the configuration
: 49 | 19527.4 18298.1 0.00419035 0.000462683 214612 0
: 50 Minimum Test error found - save the configuration
: 50 | 19354.3 18139.4 0.0043316 0.000446653 205923 0
: 51 Minimum Test error found - save the configuration
: 51 | 19186.3 17970.7 0.00412317 0.000444644 217479 0
: 52 Minimum Test error found - save the configuration
: 52 | 19017.1 17811.6 0.00435495 0.000488603 206914 0
: 53 Minimum Test error found - save the configuration
: 53 | 18847.6 17661.4 0.00427403 0.000507014 212370 0
: 54 Minimum Test error found - save the configuration
: 54 | 18682.3 17500.8 0.00432999 0.000487093 208176 0
: 55 Minimum Test error found - save the configuration
: 55 | 18520.5 17348.5 0.00419679 0.000462834 214250 0
: 56 Minimum Test error found - save the configuration
: 56 | 18356.8 17197.6 0.00446653 0.000478542 200602 0
: 57 Minimum Test error found - save the configuration
: 57 | 18197.6 17042.6 0.00433775 0.000457494 206172 0
: 58 Minimum Test error found - save the configuration
: 58 | 18036.9 16890.9 0.00434519 0.000506593 208409 0
: 59 Minimum Test error found - save the configuration
: 59 | 17878 16740.8 0.00430824 0.000498253 209975 0
: 60 Minimum Test error found - save the configuration
: 60 | 17719.4 16585.1 0.00425725 0.000469352 211199 0
: 61 Minimum Test error found - save the configuration
: 61 | 17562.2 16435.9 0.00430727 0.000467644 208354 0
: 62 Minimum Test error found - save the configuration
: 62 | 17406.4 16289.5 0.0042289 0.000474102 213061 0
: 63 Minimum Test error found - save the configuration
: 63 | 17253.9 16138.8 0.00443881 0.000468904 201516 0
: 64 Minimum Test error found - save the configuration
: 64 | 17096.1 15998.1 0.00438316 0.000502853 206169 0
: 65 Minimum Test error found - save the configuration
: 65 | 16947.8 15851.6 0.0044957 0.000504293 200430 0
: 66 Minimum Test error found - save the configuration
: 66 | 16794.3 15706.7 0.00437281 0.000500734 206607 0
: 67 Minimum Test error found - save the configuration
: 67 | 16643.6 15567.4 0.00482288 0.000533034 186487 0
: 68 Minimum Test error found - save the configuration
: 68 | 16497 15423.7 0.00434191 0.000478973 207096 0
: 69 Minimum Test error found - save the configuration
: 69 | 16348.8 15283.5 0.00436123 0.000498853 207126 0
: 70 Minimum Test error found - save the configuration
: 70 | 16201.5 15144.8 0.00441981 0.000468053 202442 0
: 71 Minimum Test error found - save the configuration
: 71 | 16055.2 15007.3 0.00425927 0.000475234 211414 0
: 72 Minimum Test error found - save the configuration
: 72 | 15912.7 14870.2 0.00424587 0.000473244 212054 0
: 73 Minimum Test error found - save the configuration
: 73 | 15768.7 14735.3 0.00423275 0.000455323 211784 0
: 74 Minimum Test error found - save the configuration
: 74 | 15627.2 14602.2 0.0042574 0.000460495 210698 0
: 75 Minimum Test error found - save the configuration
: 75 | 15487.7 14470.5 0.00427651 0.000474734 210428 0
: 76 Minimum Test error found - save the configuration
: 76 | 15350.1 14337.7 0.00430546 0.000472123 208696 0
: 77 Minimum Test error found - save the configuration
: 77 | 15212.5 14207.1 0.0044773 0.000515854 201946 0
: 78 Minimum Test error found - save the configuration
: 78 | 15075.2 14079.7 0.0046891 0.000475843 189877 0
: 79 Minimum Test error found - save the configuration
: 79 | 14940.8 13952.2 0.00471197 0.000531314 191357 0
: 80 Minimum Test error found - save the configuration
: 80 | 14808 13825 0.0044797 0.000469392 199486 0
: 81 Minimum Test error found - save the configuration
: 81 | 14674.2 13700.5 0.00468679 0.000664634 198898 0
: 82 Minimum Test error found - save the configuration
: 82 | 14542.6 13578.1 0.00475863 0.000493872 187584 0
: 83 Minimum Test error found - save the configuration
: 83 | 14413.7 13455.2 0.00444005 0.000548495 205573 0
: 84 Minimum Test error found - save the configuration
: 84 | 14284.1 13333.9 0.00439598 0.000486404 204626 0
: 85 Minimum Test error found - save the configuration
: 85 | 14158 13211.6 0.00444862 0.000482484 201708 0
: 86 Minimum Test error found - save the configuration
: 86 | 14029.8 13092.2 0.00446268 0.000485744 201160 0
: 87 Minimum Test error found - save the configuration
: 87 | 13903.7 12974.9 0.00439579 0.000488623 204752 0
: 88 Minimum Test error found - save the configuration
: 88 | 13781.6 12855.3 0.00461987 0.000501484 194251 0
: 89 Minimum Test error found - save the configuration
: 89 | 13655.7 12741.4 0.00501335 0.000694176 185220 0
: 90 Minimum Test error found - save the configuration
: 90 | 13535.6 12624.2 0.00437669 0.000465853 204560 0
: 91 Minimum Test error found - save the configuration
: 91 | 13412.7 12511.5 0.0042424 0.000461493 211589 0
: 92 Minimum Test error found - save the configuration
: 92 | 13293.4 12398.1 0.0043399 0.000490434 207821 0
: 93 Minimum Test error found - save the configuration
: 93 | 13175.1 12284.5 0.00440558 0.000496215 204637 0
: 94 Minimum Test error found - save the configuration
: 94 | 13056.3 12173.3 0.004382 0.000494963 205812 0
: 95 Minimum Test error found - save the configuration
: 95 | 12938.9 12064 0.00447207 0.000474714 200132 0
: 96 Minimum Test error found - save the configuration
: 96 | 12823.8 11954.2 0.00461055 0.000538942 196482 0
: 97 Minimum Test error found - save the configuration
: 97 | 12709.1 11845.5 0.00568048 0.000529494 155310 0
: 98 Minimum Test error found - save the configuration
: 98 | 12593.2 11740.6 0.00434483 0.000520243 209173 0
: 99 Minimum Test error found - save the configuration
: 99 | 12482.5 11633.6 0.00446141 0.000471372 200499 0
: 100 Minimum Test error found - save the configuration
: 100 | 12369.8 11528.5 0.00437197 0.000494115 206300 0
: 101 Minimum Test error found - save the configuration
: 101 | 12260.2 11422.7 0.0043731 0.000490033 206023 0
: 102 Minimum Test error found - save the configuration
: 102 | 12148.9 11319.6 0.00450028 0.000500344 200003 0
: 103 Minimum Test error found - save the configuration
: 103 | 12040.9 11216.3 0.00517014 0.000660965 177416 0
: 104 Minimum Test error found - save the configuration
: 104 | 11931.5 11115.9 0.00497877 0.000588383 182216 0
: 105 Minimum Test error found - save the configuration
: 105 | 11825 11015.7 0.00524789 0.000497424 168405 0
: 106 Minimum Test error found - save the configuration
: 106 | 11719.1 10915.9 0.00480019 0.000493574 185761 0
: 107 Minimum Test error found - save the configuration
: 107 | 11614.2 10816.4 0.00448514 0.000477084 199598 0
: 108 Minimum Test error found - save the configuration
: 108 | 11508.6 10719.8 0.00470914 0.000512183 190614 0
: 109 Minimum Test error found - save the configuration
: 109 | 11405.6 10623.4 0.00441228 0.000472313 203047 0
: 110 Minimum Test error found - save the configuration
: 110 | 11303.3 10527.2 0.00435062 0.000503474 207946 0
: 111 Minimum Test error found - save the configuration
: 111 | 11201.6 10432 0.00473045 0.000486044 188483 0
: 112 Minimum Test error found - save the configuration
: 112 | 11101.7 10336.5 0.0044194 0.000533763 205887 0
: 113 Minimum Test error found - save the configuration
: 113 | 11001.2 10242.5 0.00437879 0.000472912 204819 0
: 114 Minimum Test error found - save the configuration
: 114 | 10902.6 10149.1 0.00439734 0.000485474 204506 0
: 115 Minimum Test error found - save the configuration
: 115 | 10803.4 10057.7 0.00431019 0.000473025 208487 0
: 116 Minimum Test error found - save the configuration
: 116 | 10706 9967.01 0.00433929 0.000477553 207161 0
: 117 Minimum Test error found - save the configuration
: 117 | 10611.2 9874.94 0.0043459 0.000483862 207145 0
: 118 Minimum Test error found - save the configuration
: 118 | 10513.5 9786.68 0.00432467 0.000467832 207424 0
: 119 Minimum Test error found - save the configuration
: 119 | 10419 9698.87 0.0042671 0.000461493 210216 0
: 120 Minimum Test error found - save the configuration
: 120 | 10325.2 9610.95 0.00430832 0.000484534 209217 0
: 121 Minimum Test error found - save the configuration
: 121 | 10233.1 9522.76 0.00443822 0.000472793 201744 0
: 122 Minimum Test error found - save the configuration
: 122 | 10139.9 9436.07 0.00431805 0.000471612 207985 0
: 123 Minimum Test error found - save the configuration
: 123 | 10048.1 9350.6 0.0043141 0.000484683 208909 0
: 124 Minimum Test error found - save the configuration
: 124 | 9957.44 9265.53 0.00432024 0.000478892 208260 0
: 125 Minimum Test error found - save the configuration
: 125 | 9867.33 9181.35 0.00471151 0.000500665 189985 0
: 126 Minimum Test error found - save the configuration
: 126 | 9778.19 9097.79 0.0042911 0.000479404 209880 0
: 127 Minimum Test error found - save the configuration
: 127 | 9690.54 9014.09 0.00427687 0.000464664 209852 0
: 128 Minimum Test error found - save the configuration
: 128 | 9601.91 8932.15 0.00429273 0.000486534 210184 0
: 129 Minimum Test error found - save the configuration
: 129 | 9514.91 8851.17 0.00427109 0.000476274 210814 0
: 130 Minimum Test error found - save the configuration
: 130 | 9429.8 8769.38 0.00434069 0.000507743 208717 0
: 131 Minimum Test error found - save the configuration
: 131 | 9343.18 8690.03 0.0045483 0.000517883 198491 0
: 132 Minimum Test error found - save the configuration
: 132 | 9258.94 8611.05 0.00441029 0.000485292 203822 0
: 133 Minimum Test error found - save the configuration
: 133 | 9175.6 8531.65 0.00481957 0.000482222 184444 0
: 134 Minimum Test error found - save the configuration
: 134 | 9090.97 8455.26 0.00438808 0.000493272 205402 0
: 135 Minimum Test error found - save the configuration
: 135 | 9009.62 8377.76 0.00441609 0.000489524 203740 0
: 136 Minimum Test error found - save the configuration
: 136 | 8928.14 8300.71 0.00436943 0.000469723 205144 0
: 137 Minimum Test error found - save the configuration
: 137 | 8846.87 8224.34 0.00437789 0.000498884 206238 0
: 138 Minimum Test error found - save the configuration
: 138 | 8765.77 8150.25 0.00438331 0.000475473 204717 0
: 139 Minimum Test error found - save the configuration
: 139 | 8687.36 8074.93 0.00449311 0.000536154 202176 0
: 140 Minimum Test error found - save the configuration
: 140 | 8609.07 7999.36 0.0043405 0.000489724 207750 0
: 141 Minimum Test error found - save the configuration
: 141 | 8528.09 7928.9 0.00459153 0.000644425 202680 0
: 142 Minimum Test error found - save the configuration
: 142 | 8452.08 7856.04 0.00467251 0.000477593 190707 0
: 143 Minimum Test error found - save the configuration
: 143 | 8375.81 7783.68 0.00455867 0.000543694 199254 0
: 144 Minimum Test error found - save the configuration
: 144 | 8298.58 7712.94 0.00485591 0.000552014 185878 0
: 145 Minimum Test error found - save the configuration
: 145 | 8222.89 7643.41 0.00457525 0.000499404 196278 0
: 146 Minimum Test error found - save the configuration
: 146 | 8149.76 7571.62 0.00447698 0.000494233 200866 0
: 147 Minimum Test error found - save the configuration
: 147 | 8074.36 7502.6 0.00530159 0.000576524 169310 0
: 148 Minimum Test error found - save the configuration
: 148 | 8001.35 7433.15 0.00493683 0.000636044 186012 0
: 149 Minimum Test error found - save the configuration
: 149 | 7927.46 7365.84 0.00588013 0.000586604 151128 0
: 150 Minimum Test error found - save the configuration
: 150 | 7856.07 7298.36 0.00516188 0.000582864 174710 0
: 151 Minimum Test error found - save the configuration
: 151 | 7783.65 7231.78 0.00578068 0.000673265 156635 0
: 152 Minimum Test error found - save the configuration
: 152 | 7713.48 7164.86 0.0054271 0.000510333 162709 0
: 153 Minimum Test error found - save the configuration
: 153 | 7642.89 7099.22 0.0055797 0.000709816 164275 0
: 154 Minimum Test error found - save the configuration
: 154 | 7573.17 7034.09 0.00569577 0.000558944 155738 0
: 155 Minimum Test error found - save the configuration
: 155 | 7504.08 6968.99 0.00494939 0.000540064 181433 0
: 156 Minimum Test error found - save the configuration
: 156 | 7436.68 6903.78 0.00523911 0.000620044 173195 0
: 157 Minimum Test error found - save the configuration
: 157 | 7366.65 6840.9 0.00579395 0.000724595 157811 0
: 158 Minimum Test error found - save the configuration
: 158 | 7301.31 6777.83 0.00507953 0.000578255 177728 0
: 159 Minimum Test error found - save the configuration
: 159 | 7233.62 6715.26 0.00528848 0.000571524 169601 0
: 160 Minimum Test error found - save the configuration
: 160 | 7167.27 6655.18 0.00453023 0.000489693 197993 0
: 161 Minimum Test error found - save the configuration
: 161 | 7101.56 6594.47 0.00432095 0.000482502 208418 0
: 162 Minimum Test error found - save the configuration
: 162 | 7038.02 6533.19 0.00438644 0.000472653 204406 0
: 163 Minimum Test error found - save the configuration
: 163 | 6973.91 6471.84 0.00432351 0.000481752 208238 0
: 164 Minimum Test error found - save the configuration
: 164 | 6908.73 6412.2 0.00432175 0.000482923 208397 0
: 165 Minimum Test error found - save the configuration
: 165 | 6847.1 6351.92 0.00500314 0.000581244 180918 0
: 166 Minimum Test error found - save the configuration
: 166 | 6782.68 6294.73 0.00518116 0.000590814 174279 0
: 167 Minimum Test error found - save the configuration
: 167 | 6720.74 6237.44 0.00538658 0.000694925 170516 0
: 168 Minimum Test error found - save the configuration
: 168 | 6660.14 6179.78 0.00538985 0.000602503 167107 0
: 169 Minimum Test error found - save the configuration
: 169 | 6599.33 6121.59 0.005431 0.000689226 168713 0
: 170 Minimum Test error found - save the configuration
: 170 | 6537.97 6065.92 0.00642732 0.000741435 140699 0
: 171 Minimum Test error found - save the configuration
: 171 | 6478.68 6010.27 0.00587657 0.000717485 155066 0
: 172 Minimum Test error found - save the configuration
: 172 | 6418.84 5954.29 0.00557238 0.000517784 158272 0
: 173 Minimum Test error found - save the configuration
: 173 | 6359.94 5899.77 0.0044928 0.000524353 201590 0
: 174 Minimum Test error found - save the configuration
: 174 | 6301.95 5845.65 0.00481761 0.000584034 188965 0
: 175 Minimum Test error found - save the configuration
: 175 | 6244.57 5789.69 0.00606527 0.000743325 150321 0
: 176 Minimum Test error found - save the configuration
: 176 | 6186.13 5736.78 0.00639906 0.000650424 139163 0
: 177 Minimum Test error found - save the configuration
: 177 | 6131.08 5681.98 0.00627151 0.000724925 144233 0
: 178 Minimum Test error found - save the configuration
: 178 | 6072.89 5631.22 0.00487119 0.000503954 183182 0
: 179 Minimum Test error found - save the configuration
: 179 | 6017.04 5578.93 0.00441055 0.000492733 204195 0
: 180 Minimum Test error found - save the configuration
: 180 | 5962.71 5526.95 0.00436018 0.000475363 205930 0
: 181 Minimum Test error found - save the configuration
: 181 | 5908.07 5474.59 0.00470313 0.000762645 203021 0
: 182 Minimum Test error found - save the configuration
: 182 | 5853.05 5424.92 0.00649163 0.000717124 138540 0
: 183 Minimum Test error found - save the configuration
: 183 | 5799.72 5373.43 0.00607095 0.000629836 147029 0
: 184 Minimum Test error found - save the configuration
: 184 | 5746.33 5322.68 0.00609139 0.000712255 148723 0
: 185 Minimum Test error found - save the configuration
: 185 | 5691.92 5275.68 0.00612367 0.000711385 147812 0
: 186 Minimum Test error found - save the configuration
: 186 | 5641.72 5224.66 0.00645959 0.000730336 139634 0
: 187 Minimum Test error found - save the configuration
: 187 | 5588.62 5176.53 0.00587844 0.000535054 149718 0
: 188 Minimum Test error found - save the configuration
: 188 | 5537.59 5129.43 0.00450962 0.000488014 198925 0
: 189 Minimum Test error found - save the configuration
: 189 | 5486.44 5080.98 0.00458911 0.000502714 195771 0
: 190 Minimum Test error found - save the configuration
: 190 | 5435.11 5034.44 0.00456139 0.000539452 198909 0
: 191 Minimum Test error found - save the configuration
: 191 | 5386.34 4988.07 0.00470482 0.000495054 190034 0
: 192 Minimum Test error found - save the configuration
: 192 | 5336.91 4939.26 0.00441562 0.000488374 203705 0
: 193 Minimum Test error found - save the configuration
: 193 | 5286.45 4894.37 0.00453131 0.000483863 197655 0
: 194 Minimum Test error found - save the configuration
: 194 | 5238.5 4848.96 0.00444972 0.000524502 203810 0
: 195 Minimum Test error found - save the configuration
: 195 | 5190.37 4802.15 0.00454651 0.000497753 197591 0
: 196 Minimum Test error found - save the configuration
: 196 | 5141.58 4759.32 0.00445304 0.000491693 201951 0
: 197 Minimum Test error found - save the configuration
: 197 | 5095.31 4714.27 0.00468266 0.000523173 192331 0
: 198 Minimum Test error found - save the configuration
: 198 | 5048.42 4669.51 0.00464198 0.000544053 195221 0
: 199 Minimum Test error found - save the configuration
: 199 | 5002.07 4625.13 0.00471691 0.000506933 190025 0
: 200 Minimum Test error found - save the configuration
: 200 | 4954.39 4583.79 0.00458543 0.000514383 196510 0
: 201 Minimum Test error found - save the configuration
: 201 | 4910.07 4541.03 0.00447463 0.000554384 204069 0
: 202 Minimum Test error found - save the configuration
: 202 | 4864.7 4498.97 0.0049156 0.000523572 182148 0
: 203 Minimum Test error found - save the configuration
: 203 | 4819.64 4456.72 0.00448129 0.000487224 200297 0
: 204 Minimum Test error found - save the configuration
: 204 | 4775.4 4415.6 0.00467743 0.000498403 191432 0
: 205 Minimum Test error found - save the configuration
: 205 | 4732.04 4373.86 0.00449928 0.000512904 200683 0
: 206 Minimum Test error found - save the configuration
: 206 | 4687.77 4333.6 0.0046127 0.000492623 194171 0
: 207 Minimum Test error found - save the configuration
: 207 | 4644.33 4294.29 0.00458426 0.000532244 197432 0
: 208 Minimum Test error found - save the configuration
: 208 | 4602.48 4253.85 0.00466197 0.000591384 196532 0
: 209 Minimum Test error found - save the configuration
: 209 | 4559.97 4213.78 0.00461289 0.000542924 196562 0
: 210 Minimum Test error found - save the configuration
: 210 | 4518.02 4174.79 0.0046007 0.000519103 196002 0
: 211 Minimum Test error found - save the configuration
: 211 | 4476.99 4134.63 0.0046708 0.000496413 191645 0
: 212 Minimum Test error found - save the configuration
: 212 | 4434.55 4097.48 0.00452705 0.000510323 199167 0
: 213 Minimum Test error found - save the configuration
: 213 | 4395.55 4059.12 0.00463575 0.000501263 193494 0
: 214 Minimum Test error found - save the configuration
: 214 | 4354.55 4019.7 0.00455451 0.000511703 197882 0
: 215 Minimum Test error found - save the configuration
: 215 | 4313.87 3983.88 0.00474759 0.000524494 189434 0
: 216 Minimum Test error found - save the configuration
: 216 | 4275.06 3946 0.00468351 0.000514913 191911 0
: 217 Minimum Test error found - save the configuration
: 217 | 4235.52 3910.28 0.00459394 0.000484963 194696 0
: 218 Minimum Test error found - save the configuration
: 218 | 4197.46 3873.26 0.00438152 0.000502664 206246 0
: 219 Minimum Test error found - save the configuration
: 219 | 4158.27 3837.51 0.00442513 0.000520473 204884 0
: 220 Minimum Test error found - save the configuration
: 220 | 4120.71 3800.4 0.0043965 0.000474863 203996 0
: 221 Minimum Test error found - save the configuration
: 221 | 4082.38 3765.89 0.00440158 0.000488784 204457 0
: 222 Minimum Test error found - save the configuration
: 222 | 4045.51 3730.73 0.00443227 0.000476524 202237 0
: 223 Minimum Test error found - save the configuration
: 223 | 4008.24 3696.45 0.00442124 0.000504913 204273 0
: 224 Minimum Test error found - save the configuration
: 224 | 3971.76 3661.76 0.00451687 0.000496994 199011 0
: 225 Minimum Test error found - save the configuration
: 225 | 3935.17 3627.81 0.00439969 0.000494913 204877 0
: 226 Minimum Test error found - save the configuration
: 226 | 3900.57 3593.22 0.00450922 0.000490083 199048 0
: 227 Minimum Test error found - save the configuration
: 227 | 3863.73 3560.31 0.00462351 0.000501743 194091 0
: 228 Minimum Test error found - save the configuration
: 228 | 3828.58 3526.93 0.00437485 0.000473394 205052 0
: 229 Minimum Test error found - save the configuration
: 229 | 3793.82 3494.48 0.00444164 0.000506674 203305 0
: 230 Minimum Test error found - save the configuration
: 230 | 3759.3 3462.17 0.00456632 0.000482773 195908 0
: 231 Minimum Test error found - save the configuration
: 231 | 3725.3 3429.6 0.00446501 0.000501574 201845 0
: 232 Minimum Test error found - save the configuration
: 232 | 3691.26 3397.2 0.00444399 0.000481714 201904 0
: 233 Minimum Test error found - save the configuration
: 233 | 3656.87 3367.14 0.00451509 0.000508864 199689 0
: 234 Minimum Test error found - save the configuration
: 234 | 3624.44 3335.7 0.00450216 0.000487673 199278 0
: 235 Minimum Test error found - save the configuration
: 235 | 3592.13 3303.32 0.00447351 0.000502643 201467 0
: 236 Minimum Test error found - save the configuration
: 236 | 3558.4 3272.76 0.004424 0.000477943 202734 0
: 237 Minimum Test error found - save the configuration
: 237 | 3526.28 3243.06 0.00451822 0.000493414 198767 0
: 238 Minimum Test error found - save the configuration
: 238 | 3494.4 3212.97 0.00438268 0.000522773 207259 0
: 239 Minimum Test error found - save the configuration
: 239 | 3463.31 3181.55 0.00438088 0.000476014 204873 0
: 240 Minimum Test error found - save the configuration
: 240 | 3431.18 3152.74 0.00442518 0.000492104 203403 0
: 241 Minimum Test error found - save the configuration
: 241 | 3400.06 3123.21 0.00459979 0.000499974 195131 0
: 242 Minimum Test error found - save the configuration
: 242 | 3368.88 3094.43 0.00449769 0.000492883 199760 0
: 243 Minimum Test error found - save the configuration
: 243 | 3338.74 3065.87 0.00455162 0.000489044 196919 0
: 244 Minimum Test error found - save the configuration
: 244 | 3308.38 3037.39 0.00459155 0.000505094 195769 0
: 245 Minimum Test error found - save the configuration
: 245 | 3278.58 3008.72 0.00461412 0.000506324 194752 0
: 246 Minimum Test error found - save the configuration
: 246 | 3248.36 2981.29 0.00455211 0.000514144 198119 0
: 247 Minimum Test error found - save the configuration
: 247 | 3219.53 2952.81 0.00447857 0.000556464 203972 0
: 248 Minimum Test error found - save the configuration
: 248 | 3189.6 2925.92 0.00442751 0.000477434 202528 0
: 249 Minimum Test error found - save the configuration
: 249 | 3160.68 2898.85 0.00437808 0.000487333 205616 0
: 250 Minimum Test error found - save the configuration
: 250 | 3132.52 2871.63 0.00445445 0.000483353 201456 0
: 251 Minimum Test error found - save the configuration
: 251 | 3103.86 2845.4 0.00457679 0.000499233 196196 0
: 252 Minimum Test error found - save the configuration
: 252 | 3076.25 2818.17 0.00454166 0.000487334 197320 0
: 253 Minimum Test error found - save the configuration
: 253 | 3047.63 2792.92 0.00456493 0.000524924 198019 0
: 254 Minimum Test error found - save the configuration
: 254 | 3020.32 2766.9 0.00465263 0.000510494 193137 0
: 255 Minimum Test error found - save the configuration
: 255 | 2993.17 2740.78 0.00457882 0.000535144 197840 0
: 256 Minimum Test error found - save the configuration
: 256 | 2965.83 2715.05 0.00456853 0.000578114 200480 0
: 257 Minimum Test error found - save the configuration
: 257 | 2938.27 2690.76 0.00520723 0.000669865 176314 0
: 258 Minimum Test error found - save the configuration
: 258 | 2912.32 2665.62 0.00469999 0.000499624 190459 0
: 259 Minimum Test error found - save the configuration
: 259 | 2886.12 2641.05 0.00462253 0.000513914 194713 0
: 260 Minimum Test error found - save the configuration
: 260 | 2860.05 2616.68 0.00484885 0.000704545 193036 0
: 261 Minimum Test error found - save the configuration
: 261 | 2834.67 2592.73 0.00497967 0.000611925 183161 0
: 262 Minimum Test error found - save the configuration
: 262 | 2808.08 2568.09 0.00530883 0.000570184 168825 0
: 263 Minimum Test error found - save the configuration
: 263 | 2782.72 2544.47 0.00522579 0.000582434 172289 0
: 264 Minimum Test error found - save the configuration
: 264 | 2757.86 2520.86 0.00505747 0.000632334 180785 0
: 265 Minimum Test error found - save the configuration
: 265 | 2732.51 2497.38 0.00525143 0.000521214 169126 0
: 266 Minimum Test error found - save the configuration
: 266 | 2707.52 2474.84 0.00464021 0.000502813 193358 0
: 267 Minimum Test error found - save the configuration
: 267 | 2683.62 2451.59 0.00470488 0.000488713 189746 0
: 268 Minimum Test error found - save the configuration
: 268 | 2658.8 2429.39 0.0048467 0.000697725 192819 0
: 269 Minimum Test error found - save the configuration
: 269 | 2635.18 2406.68 0.00460201 0.000509074 195459 0
: 270 Minimum Test error found - save the configuration
: 270 | 2611.46 2384.04 0.00547306 0.000718805 168270 0
: 271 Minimum Test error found - save the configuration
: 271 | 2587.33 2362.26 0.00460379 0.000519604 195877 0
: 272 Minimum Test error found - save the configuration
: 272 | 2563.76 2340.78 0.00480115 0.000635514 192047 0
: 273 Minimum Test error found - save the configuration
: 273 | 2540.93 2319.41 0.00456999 0.000488983 196030 0
: 274 Minimum Test error found - save the configuration
: 274 | 2517.46 2298.5 0.00443794 0.000501753 203242 0
: 275 Minimum Test error found - save the configuration
: 275 | 2495.7 2276.17 0.00443157 0.000477253 202310 0
: 276 Minimum Test error found - save the configuration
: 276 | 2472.11 2255.45 0.0053615 0.000703865 171761 0
: 277 Minimum Test error found - save the configuration
: 277 | 2449.64 2234.85 0.0050924 0.000544434 175903 0
: 278 Minimum Test error found - save the configuration
: 278 | 2427.21 2215.18 0.0045446 0.000475624 196610 0
: 279 Minimum Test error found - save the configuration
: 279 | 2405.79 2194.04 0.00505679 0.000484544 174969 0
: 280 Minimum Test error found - save the configuration
: 280 | 2383.17 2174.14 0.00468055 0.000593944 195761 0
: 281 Minimum Test error found - save the configuration
: 281 | 2361.79 2154 0.00481065 0.000560094 188210 0
: 282 Minimum Test error found - save the configuration
: 282 | 2340.54 2134.07 0.00453729 0.000509484 198619 0
: 283 Minimum Test error found - save the configuration
: 283 | 2318.39 2114.78 0.0052903 0.000563764 169257 0
: 284 Minimum Test error found - save the configuration
: 284 | 2297.69 2095.29 0.00490632 0.000596575 185626 0
: 285 Minimum Test error found - save the configuration
: 285 | 2277.33 2075.03 0.00592544 0.000530964 148300 0
: 286 Minimum Test error found - save the configuration
: 286 | 2255.73 2056.11 0.00442035 0.000489794 203533 0
: 287 Minimum Test error found - save the configuration
: 287 | 2235.09 2037.6 0.00539156 0.000488663 163169 0
: 288 Minimum Test error found - save the configuration
: 288 | 2214.25 2019.63 0.00508863 0.000641575 179894 0
: 289 Minimum Test error found - save the configuration
: 289 | 2194.76 2000.68 0.005811 0.000724575 157281 0
: 290 Minimum Test error found - save the configuration
: 290 | 2174.16 1981.86 0.00487333 0.000590354 186786 0
: 291 Minimum Test error found - save the configuration
: 291 | 2153.82 1964.58 0.00482618 0.000497304 184805 0
: 292 Minimum Test error found - save the configuration
: 292 | 2134.33 1946.66 0.00508554 0.000564194 176939 0
: 293 Minimum Test error found - save the configuration
: 293 | 2114.88 1928.17 0.00563127 0.000653214 160705 0
: 294 Minimum Test error found - save the configuration
: 294 | 2095.35 1910.01 0.00510812 0.000512634 174084 0
: 295 Minimum Test error found - save the configuration
: 295 | 2075.51 1893.12 0.00455088 0.000503664 197667 0
: 296 Minimum Test error found - save the configuration
: 296 | 2056.64 1875.65 0.00444502 0.000492514 202403 0
: 297 Minimum Test error found - save the configuration
: 297 | 2037.31 1858.97 0.00448776 0.000483023 199763 0
: 298 Minimum Test error found - save the configuration
: 298 | 2018.98 1841.32 0.00443182 0.000493004 203107 0
: 299 Minimum Test error found - save the configuration
: 299 | 2000.2 1824.34 0.00469773 0.000502264 190682 0
: 300 Minimum Test error found - save the configuration
: 300 | 1980.98 1808.07 0.00445408 0.000509334 202801 0
: 301 Minimum Test error found - save the configuration
: 301 | 1962.85 1791.84 0.00436811 0.000481173 205818 0
: 302 Minimum Test error found - save the configuration
: 302 | 1944.75 1775.39 0.00444594 0.000490614 202259 0
: 303 Minimum Test error found - save the configuration
: 303 | 1926.74 1759.12 0.00443265 0.000487634 202787 0
: 304 Minimum Test error found - save the configuration
: 304 | 1908.7 1743.06 0.00445303 0.000490014 201866 0
: 305 Minimum Test error found - save the configuration
: 305 | 1891.41 1726.33 0.00439614 0.000486243 204609 0
: 306 Minimum Test error found - save the configuration
: 306 | 1872.97 1710.89 0.004565 0.000537104 198615 0
: 307 Minimum Test error found - save the configuration
: 307 | 1855.41 1695.67 0.00439054 0.000483994 204784 0
: 308 Minimum Test error found - save the configuration
: 308 | 1838.42 1679.81 0.00450438 0.000527553 201165 0
: 309 Minimum Test error found - save the configuration
: 309 | 1820.58 1665.2 0.0044604 0.000506703 202342 0
: 310 Minimum Test error found - save the configuration
: 310 | 1804.29 1649.44 0.00453567 0.000489144 197700 0
: 311 Minimum Test error found - save the configuration
: 311 | 1787 1634.65 0.00461826 0.000491643 193863 0
: 312 Minimum Test error found - save the configuration
: 312 | 1770.43 1619.2 0.00439214 0.000486324 204823 0
: 313 Minimum Test error found - save the configuration
: 313 | 1753.28 1604.57 0.00440992 0.000489223 204045 0
: 314 Minimum Test error found - save the configuration
: 314 | 1736.5 1590.44 0.00438163 0.000473323 204692 0
: 315 Minimum Test error found - save the configuration
: 315 | 1720.67 1575.89 0.00448323 0.000491633 200421 0
: 316 Minimum Test error found - save the configuration
: 316 | 1704.34 1561.07 0.00448502 0.000481983 199848 0
: 317 Minimum Test error found - save the configuration
: 317 | 1688.62 1546.43 0.00452167 0.000519674 199900 0
: 318 Minimum Test error found - save the configuration
: 318 | 1671.88 1532.36 0.00458001 0.000491564 195673 0
: 319 Minimum Test error found - save the configuration
: 319 | 1656.04 1518.82 0.00446614 0.000490634 201232 0
: 320 Minimum Test error found - save the configuration
: 320 | 1640.37 1504.92 0.00436385 0.000470603 205484 0
: 321 Minimum Test error found - save the configuration
: 321 | 1625 1490.65 0.00435646 0.000480194 206384 0
: 322 Minimum Test error found - save the configuration
: 322 | 1609.7 1476.78 0.00438 0.000473233 204773 0
: 323 Minimum Test error found - save the configuration
: 323 | 1593.94 1463.63 0.00433843 0.000469763 206790 0
: 324 Minimum Test error found - save the configuration
: 324 | 1578.86 1450.14 0.00439073 0.000491653 205177 0
: 325 Minimum Test error found - save the configuration
: 325 | 1563.89 1437.47 0.00438364 0.000474773 204663 0
: 326 Minimum Test error found - save the configuration
: 326 | 1549.18 1423.5 0.00443515 0.000505443 203577 0
: 327 Minimum Test error found - save the configuration
: 327 | 1534.19 1410.32 0.00433583 0.000473784 207144 0
: 328 Minimum Test error found - save the configuration
: 328 | 1519.86 1396.94 0.00435353 0.000494354 207298 0
: 329 Minimum Test error found - save the configuration
: 329 | 1503.88 1385.25 0.00439908 0.000489913 204647 0
: 330 Minimum Test error found - save the configuration
: 330 | 1490.6 1372.08 0.00436007 0.000480383 206202 0
: 331 Minimum Test error found - save the configuration
: 331 | 1476.37 1358.97 0.00437493 0.000477783 205278 0
: 332 Minimum Test error found - save the configuration
: 332 | 1462.05 1346.21 0.00435678 0.000484494 206596 0
: 333 Minimum Test error found - save the configuration
: 333 | 1448.2 1334.73 0.0043593 0.000482553 206359 0
: 334 Minimum Test error found - save the configuration
: 334 | 1433.69 1322.1 0.00436564 0.000485753 206192 0
: 335 Minimum Test error found - save the configuration
: 335 | 1420.2 1309.64 0.00434285 0.000483794 207305 0
: 336 Minimum Test error found - save the configuration
: 336 | 1406.73 1297.04 0.0043629 0.000471523 205583 0
: 337 Minimum Test error found - save the configuration
: 337 | 1392.94 1285.3 0.00436295 0.000482304 206151 0
: 338 Minimum Test error found - save the configuration
: 338 | 1379.78 1272.99 0.00440763 0.000475003 203426 0
: 339 Minimum Test error found - save the configuration
: 339 | 1366.07 1261.97 0.00434227 0.000470923 206646 0
: 340 Minimum Test error found - save the configuration
: 340 | 1353.44 1249.5 0.00442937 0.000513533 204299 0
: 341 Minimum Test error found - save the configuration
: 341 | 1339.78 1238.7 0.00445088 0.000567584 206011 0
: 342 Minimum Test error found - save the configuration
: 342 | 1327.57 1226.69 0.00457976 0.000567704 199399 0
: 343 Minimum Test error found - save the configuration
: 343 | 1314.38 1215.06 0.00440557 0.000477573 203666 0
: 344 Minimum Test error found - save the configuration
: 344 | 1301.76 1203.94 0.00445896 0.000495063 201822 0
: 345 Minimum Test error found - save the configuration
: 345 | 1289.1 1193.14 0.0044054 0.000477084 203650 0
: 346 Minimum Test error found - save the configuration
: 346 | 1276.73 1182.05 0.00437217 0.000484833 205796 0
: 347 Minimum Test error found - save the configuration
: 347 | 1264.17 1171.04 0.00435132 0.000493183 207354 0
: 348 Minimum Test error found - save the configuration
: 348 | 1252.63 1159.29 0.00434231 0.000479174 207086 0
: 349 Minimum Test error found - save the configuration
: 349 | 1239.95 1149.02 0.00440453 0.000488883 204309 0
: 350 Minimum Test error found - save the configuration
: 350 | 1228.34 1137.81 0.00437499 0.000471934 204968 0
: 351 Minimum Test error found - save the configuration
: 351 | 1216.14 1127.25 0.00440472 0.000488753 204292 0
: 352 Minimum Test error found - save the configuration
: 352 | 1204.37 1116.46 0.00437124 0.000490024 206121 0
: 353 Minimum Test error found - save the configuration
: 353 | 1192.45 1106.63 0.00434477 0.000470453 206488 0
: 354 Minimum Test error found - save the configuration
: 354 | 1181.37 1095.97 0.00436975 0.000484344 205899 0
: 355 Minimum Test error found - save the configuration
: 355 | 1169.65 1085.58 0.00434191 0.000489984 207688 0
: 356 Minimum Test error found - save the configuration
: 356 | 1158.05 1075.66 0.00440149 0.000473503 203667 0
: 357 Minimum Test error found - save the configuration
: 357 | 1147.47 1064.98 0.00435043 0.000483804 206899 0
: 358 Minimum Test error found - save the configuration
: 358 | 1135.82 1055.14 0.00444916 0.000498434 202494 0
: 359 Minimum Test error found - save the configuration
: 359 | 1125.02 1045.28 0.00439225 0.000485283 204762 0
: 360 Minimum Test error found - save the configuration
: 360 | 1113.92 1035.18 0.00435333 0.000480774 206582 0
: 361 Minimum Test error found - save the configuration
: 361 | 1103.04 1025.39 0.00441056 0.000476893 203373 0
: 362 Minimum Test error found - save the configuration
: 362 | 1092.41 1015.74 0.00437843 0.000489903 205733 0
: 363 Minimum Test error found - save the configuration
: 363 | 1081.52 1006.05 0.00442761 0.000479574 202632 0
: 364 Minimum Test error found - save the configuration
: 364 | 1071.04 996.588 0.00443658 0.000555544 206130 0
: 365 Minimum Test error found - save the configuration
: 365 | 1060.9 987.749 0.00444383 0.000479544 201802 0
: 366 Minimum Test error found - save the configuration
: 366 | 1050.86 977.575 0.00442575 0.000485403 203028 0
: 367 Minimum Test error found - save the configuration
: 367 | 1040.15 968.034 0.00442473 0.000503933 204040 0
: 368 Minimum Test error found - save the configuration
: 368 | 1029.84 959.45 0.00442497 0.000476633 202617 0
: 369 Minimum Test error found - save the configuration
: 369 | 1019.97 950.467 0.0044369 0.000503184 203370 0
: 370 Minimum Test error found - save the configuration
: 370 | 1010.48 940.587 0.00448472 0.000499013 200717 0
: 371 Minimum Test error found - save the configuration
: 371 | 1000.02 931.495 0.00439318 0.000497464 205354 0
: 372 Minimum Test error found - save the configuration
: 372 | 990.384 922.468 0.00452595 0.000502013 198810 0
: 373 Minimum Test error found - save the configuration
: 373 | 980.48 913.865 0.00442625 0.000489023 203189 0
: 374 Minimum Test error found - save the configuration
: 374 | 970.918 904.977 0.0046991 0.000494514 190268 0
: 375 Minimum Test error found - save the configuration
: 375 | 961.13 896.486 0.00462718 0.000480823 192940 0
: 376 Minimum Test error found - save the configuration
: 376 | 951.794 887.794 0.0043972 0.000490574 204780 0
: 377 Minimum Test error found - save the configuration
: 377 | 942.676 879.141 0.00442653 0.000503474 203923 0
: 378 Minimum Test error found - save the configuration
: 378 | 933.051 870.562 0.00441412 0.000477893 203240 0
: 379 Minimum Test error found - save the configuration
: 379 | 923.981 862.155 0.00444813 0.000491033 202168 0
: 380 Minimum Test error found - save the configuration
: 380 | 914.616 853.842 0.00446009 0.000483703 201188 0
: 381 Minimum Test error found - save the configuration
: 381 | 906.128 845.305 0.00448251 0.000488124 200281 0
: 382 Minimum Test error found - save the configuration
: 382 | 896.845 837.214 0.004359 0.000472903 205862 0
: 383 Minimum Test error found - save the configuration
: 383 | 888.047 828.673 0.0044445 0.000489054 202253 0
: 384 Minimum Test error found - save the configuration
: 384 | 878.957 820.829 0.00443155 0.000490304 202981 0
: 385 Minimum Test error found - save the configuration
: 385 | 870.527 812.787 0.00460838 0.000502684 194851 0
: 386 Minimum Test error found - save the configuration
: 386 | 861.771 805.059 0.00436229 0.000486313 206400 0
: 387 Minimum Test error found - save the configuration
: 387 | 853.14 797.454 0.00443499 0.000475063 202024 0
: 388 Minimum Test error found - save the configuration
: 388 | 844.962 789.507 0.0044426 0.000493803 202593 0
: 389 Minimum Test error found - save the configuration
: 389 | 836.432 781.135 0.00443804 0.000502763 203289 0
: 390 Minimum Test error found - save the configuration
: 390 | 827.714 773.729 0.00441867 0.000493704 203823 0
: 391 Minimum Test error found - save the configuration
: 391 | 819.879 766.111 0.00449551 0.000484063 199429 0
: 392 Minimum Test error found - save the configuration
: 392 | 811.71 759.177 0.00454001 0.000501504 198093 0
: 393 Minimum Test error found - save the configuration
: 393 | 803.322 750.948 0.00457176 0.000541934 198520 0
: 394 Minimum Test error found - save the configuration
: 394 | 795.482 743.278 0.00456709 0.000505723 196978 0
: 395 Minimum Test error found - save the configuration
: 395 | 787.429 736.073 0.00440042 0.000497693 204985 0
: 396 Minimum Test error found - save the configuration
: 396 | 779.568 728.634 0.00448083 0.000502663 201098 0
: 397 Minimum Test error found - save the configuration
: 397 | 771.784 721.766 0.00448169 0.000484464 200139 0
: 398 Minimum Test error found - save the configuration
: 398 | 764.181 713.719 0.00449395 0.000495674 200086 0
: 399 Minimum Test error found - save the configuration
: 399 | 756.18 706.671 0.00437215 0.000472083 205125 0
: 400 Minimum Test error found - save the configuration
: 400 | 748.52 700.126 0.00444248 0.000511823 203528 0
: 401 Minimum Test error found - save the configuration
: 401 | 741.392 692.526 0.00436491 0.000473674 205590 0
: 402 Minimum Test error found - save the configuration
: 402 | 733.886 685.288 0.00435345 0.000468473 205921 0
: 403 Minimum Test error found - save the configuration
: 403 | 726.124 678.771 0.00439923 0.000486314 204451 0
: 404 Minimum Test error found - save the configuration
: 404 | 718.912 672.032 0.00445388 0.000482674 201450 0
: 405 Minimum Test error found - save the configuration
: 405 | 712.205 665.307 0.00441169 0.000514043 205252 0
: 406 Minimum Test error found - save the configuration
: 406 | 704.383 658.637 0.00442228 0.000477883 202819 0
: 407 Minimum Test error found - save the configuration
: 407 | 697.403 652.338 0.00437124 0.000469934 205059 0
: 408 Minimum Test error found - save the configuration
: 408 | 690.455 645.386 0.00448144 0.000493754 200618 0
: 409 Minimum Test error found - save the configuration
: 409 | 683.387 638.636 0.00473716 0.000576444 192274 0
: 410 Minimum Test error found - save the configuration
: 410 | 676.692 632.057 0.00449705 0.000478153 199060 0
: 411 Minimum Test error found - save the configuration
: 411 | 669.459 625.46 0.00447937 0.000536803 202913 0
: 412 Minimum Test error found - save the configuration
: 412 | 662.829 619.32 0.00454707 0.000498153 197584 0
: 413 Minimum Test error found - save the configuration
: 413 | 655.952 613.06 0.00437056 0.000484454 205862 0
: 414 Minimum Test error found - save the configuration
: 414 | 649.727 606.209 0.00446278 0.000481294 200930 0
: 415 Minimum Test error found - save the configuration
: 415 | 642.618 600.157 0.0044848 0.000498724 200699 0
: 416 Minimum Test error found - save the configuration
: 416 | 636.215 594.186 0.0045088 0.000495513 199338 0
: 417 Minimum Test error found - save the configuration
: 417 | 629.679 588.127 0.00449886 0.000506134 200364 0
: 418 Minimum Test error found - save the configuration
: 418 | 623.374 581.691 0.00462559 0.000611894 199317 0
: 419 Minimum Test error found - save the configuration
: 419 | 616.811 575.735 0.00471625 0.000544494 191766 0
: 420 Minimum Test error found - save the configuration
: 420 | 610.547 569.372 0.00505253 0.000555904 177911 0
: 421 Minimum Test error found - save the configuration
: 421 | 604.189 564.113 0.00490003 0.000503583 181965 0
: 422 Minimum Test error found - save the configuration
: 422 | 598.24 557.923 0.00452641 0.000503974 198884 0
: 423 Minimum Test error found - save the configuration
: 423 | 591.918 551.839 0.00446785 0.000489224 201074 0
: 424 Minimum Test error found - save the configuration
: 424 | 585.417 546.023 0.00438898 0.000473953 204341 0
: 425 Minimum Test error found - save the configuration
: 425 | 579.744 540.524 0.00445797 0.000509803 202626 0
: 426 Minimum Test error found - save the configuration
: 426 | 573.667 534.617 0.00437487 0.000470903 204920 0
: 427 Minimum Test error found - save the configuration
: 427 | 567.757 529.307 0.00442026 0.000503794 204266 0
: 428 Minimum Test error found - save the configuration
: 428 | 562.033 523.953 0.00452293 0.000481573 197953 0
: 429 Minimum Test error found - save the configuration
: 429 | 556.167 517.928 0.0047387 0.000503663 188900 0
: 430 Minimum Test error found - save the configuration
: 430 | 550.24 512.411 0.00450585 0.000478774 198655 0
: 431 Minimum Test error found - save the configuration
: 431 | 544.849 506.876 0.00438695 0.000486063 205082 0
: 432 Minimum Test error found - save the configuration
: 432 | 538.753 502.088 0.00440698 0.000481274 203785 0
: 433 Minimum Test error found - save the configuration
: 433 | 533.685 496.791 0.00447734 0.000494384 200856 0
: 434 Minimum Test error found - save the configuration
: 434 | 527.783 491.289 0.00452291 0.000483503 198049 0
: 435 Minimum Test error found - save the configuration
: 435 | 522.39 486.261 0.00443209 0.000537383 205407 0
: 436 Minimum Test error found - save the configuration
: 436 | 517.106 480.45 0.00443657 0.000496883 203062 0
: 437 Minimum Test error found - save the configuration
: 437 | 511.5 475.594 0.00449575 0.000498644 200145 0
: 438 Minimum Test error found - save the configuration
: 438 | 506.376 470.977 0.00449518 0.000514964 200994 0
: 439 Minimum Test error found - save the configuration
: 439 | 501.189 465.546 0.00443986 0.000500794 203094 0
: 440 Minimum Test error found - save the configuration
: 440 | 495.572 460.267 0.00438682 0.000479853 204762 0
: 441 Minimum Test error found - save the configuration
: 441 | 490.681 455.085 0.00446292 0.000477093 200711 0
: 442 Minimum Test error found - save the configuration
: 442 | 485.258 450.5 0.00474537 0.000486784 187856 0
: 443 Minimum Test error found - save the configuration
: 443 | 480.264 446.076 0.00440008 0.000488663 204529 0
: 444 Minimum Test error found - save the configuration
: 444 | 475.441 440.871 0.00446555 0.000482173 200835 0
: 445 Minimum Test error found - save the configuration
: 445 | 470.541 436.247 0.00439572 0.000479313 204269 0
: 446 Minimum Test error found - save the configuration
: 446 | 465.606 431.461 0.00445874 0.000555654 204966 0
: 447 Minimum Test error found - save the configuration
: 447 | 460.404 426.574 0.00461874 0.000536914 195991 0
: 448 Minimum Test error found - save the configuration
: 448 | 455.678 422.028 0.00452717 0.000483154 197823 0
: 449 Minimum Test error found - save the configuration
: 449 | 450.849 417.634 0.00437078 0.000486023 205933 0
: 450 Minimum Test error found - save the configuration
: 450 | 446.291 412.758 0.0046241 0.000480613 193074 0
: 451 Minimum Test error found - save the configuration
: 451 | 441.466 408.265 0.0045032 0.000494614 199572 0
: 452 Minimum Test error found - save the configuration
: 452 | 436.768 404.062 0.00449274 0.000484553 199591 0
: 453 Minimum Test error found - save the configuration
: 453 | 432.484 399.592 0.00443487 0.000489163 202752 0
: 454 Minimum Test error found - save the configuration
: 454 | 427.566 395.135 0.00455649 0.000484634 196471 0
: 455 Minimum Test error found - save the configuration
: 455 | 423.08 390.771 0.00455061 0.000521193 198540 0
: 456 Minimum Test error found - save the configuration
: 456 | 418.748 386.305 0.00450979 0.000491513 199090 0
: 457 Minimum Test error found - save the configuration
: 457 | 414.343 381.934 0.00444048 0.000494294 202727 0
: 458 Minimum Test error found - save the configuration
: 458 | 410.155 377.86 0.00440553 0.000486604 204138 0
: 459 Minimum Test error found - save the configuration
: 459 | 405.573 373.658 0.00438546 0.000476113 204638 0
: 460 Minimum Test error found - save the configuration
: 460 | 401.308 369.533 0.00439815 0.000490674 204736 0
: 461 Minimum Test error found - save the configuration
: 461 | 397.132 365.765 0.00452576 0.000479413 197709 0
: 462 Minimum Test error found - save the configuration
: 462 | 392.796 361.624 0.00444018 0.000492843 202668 0
: 463 Minimum Test error found - save the configuration
: 463 | 388.757 357.377 0.00450231 0.000479984 198890 0
: 464 Minimum Test error found - save the configuration
: 464 | 384.56 353.393 0.0044728 0.000512354 201997 0
: 465 Minimum Test error found - save the configuration
: 465 | 380.527 349.677 0.00458282 0.000492514 195584 0
: 466 Minimum Test error found - save the configuration
: 466 | 376.508 346.052 0.00451783 0.000502533 199238 0
: 467 Minimum Test error found - save the configuration
: 467 | 372.51 342.277 0.00464651 0.000515844 193673 0
: 468 Minimum Test error found - save the configuration
: 468 | 368.901 337.702 0.00445632 0.000474514 200914 0
: 469 Minimum Test error found - save the configuration
: 469 | 364.647 334.008 0.00447506 0.000499894 201249 0
: 470 Minimum Test error found - save the configuration
: 470 | 360.66 330.384 0.00441203 0.000491683 204064 0
: 471 Minimum Test error found - save the configuration
: 471 | 356.783 326.576 0.0043982 0.000477853 204064 0
: 472 Minimum Test error found - save the configuration
: 472 | 353.112 322.433 0.00451975 0.000489824 198515 0
: 473 Minimum Test error found - save the configuration
: 473 | 349.14 319.24 0.00440471 0.000485783 204138 0
: 474 Minimum Test error found - save the configuration
: 474 | 345.85 315.384 0.00449628 0.000505964 200485 0
: 475 Minimum Test error found - save the configuration
: 475 | 341.849 312.06 0.0043917 0.000479313 204479 0
: 476 Minimum Test error found - save the configuration
: 476 | 338.106 308.402 0.00450992 0.000580424 203588 0
: 477 Minimum Test error found - save the configuration
: 477 | 334.411 305.087 0.0048847 0.000572374 185515 0
: 478 Minimum Test error found - save the configuration
: 478 | 330.901 301.824 0.00487082 0.000696565 191651 0
: 479 Minimum Test error found - save the configuration
: 479 | 327.313 298.117 0.00634211 0.000726505 142460 0
: 480 Minimum Test error found - save the configuration
: 480 | 323.706 294.677 0.00542516 0.000695105 169131 0
: 481 Minimum Test error found - save the configuration
: 481 | 320.302 291.687 0.00604173 0.000513544 144713 0
: 482 Minimum Test error found - save the configuration
: 482 | 317.067 288.074 0.00488807 0.000481824 181560 0
: 483 Minimum Test error found - save the configuration
: 483 | 313.27 284.651 0.00447383 0.000544934 203619 0
: 484 Minimum Test error found - save the configuration
: 484 | 310.342 281.522 0.00525722 0.000525984 169089 0
: 485 Minimum Test error found - save the configuration
: 485 | 306.532 278.092 0.00548945 0.000697175 166935 0
: 486 Minimum Test error found - save the configuration
: 486 | 303.224 275.137 0.00634906 0.000725585 142261 0
: 487 Minimum Test error found - save the configuration
: 487 | 299.951 272.401 0.00488898 0.000547434 184266 0
: 488 Minimum Test error found - save the configuration
: 488 | 296.836 269.012 0.004487 0.000476624 199482 0
: 489 Minimum Test error found - save the configuration
: 489 | 293.463 265.259 0.00468369 0.000602154 196005 0
: 490 Minimum Test error found - save the configuration
: 490 | 290.279 262.506 0.00496844 0.000514374 179611 0
: 491 Minimum Test error found - save the configuration
: 491 | 287.136 259.689 0.00466737 0.000542234 193933 0
: 492 Minimum Test error found - save the configuration
: 492 | 284.135 256.487 0.00481786 0.000495754 185095 0
: 493 Minimum Test error found - save the configuration
: 493 | 281.022 253.926 0.00451286 0.000559974 202384 0
: 494 Minimum Test error found - save the configuration
: 494 | 277.936 250.876 0.00465391 0.000509414 193027 0
: 495 Minimum Test error found - save the configuration
: 495 | 274.851 247.947 0.00439616 0.000470923 203809 0
: 496 Minimum Test error found - save the configuration
: 496 | 271.87 244.79 0.00490503 0.000708744 190645 0
: 497 Minimum Test error found - save the configuration
: 497 | 268.903 242.575 0.00453193 0.000494543 198148 0
: 498 Minimum Test error found - save the configuration
: 498 | 266.082 239.278 0.00443385 0.000513424 204059 0
: 499 Minimum Test error found - save the configuration
: 499 | 263.055 236.284 0.00441733 0.000473694 202858 0
: 500 Minimum Test error found - save the configuration
: 500 | 260.204 234.043 0.00439846 0.000500773 205250 0
: 501 Minimum Test error found - save the configuration
: 501 | 257.218 230.696 0.00448034 0.000478143 199890 0
: 502 Minimum Test error found - save the configuration
: 502 | 254.301 228.513 0.00440386 0.000513653 205645 0
: 503 Minimum Test error found - save the configuration
: 503 | 251.603 225.61 0.00450496 0.000484354 198975 0
: 504 Minimum Test error found - save the configuration
: 504 | 248.889 222.704 0.00439993 0.000489353 204573 0
: 505 Minimum Test error found - save the configuration
: 505 | 246.084 220.699 0.00449383 0.000516573 201144 0
: 506 Minimum Test error found - save the configuration
: 506 | 243.519 217.869 0.00443131 0.000489483 202952 0
: 507 Minimum Test error found - save the configuration
: 507 | 240.832 215.416 0.00440262 0.000486443 204281 0
: 508 Minimum Test error found - save the configuration
: 508 | 238.062 212.727 0.00446618 0.000483133 200851 0
: 509 Minimum Test error found - save the configuration
: 509 | 235.667 210.725 0.0043766 0.000492194 205952 0
: 510 Minimum Test error found - save the configuration
: 510 | 233.01 207.758 0.00448332 0.000486444 200156 0
: 511 Minimum Test error found - save the configuration
: 511 | 230.286 205.558 0.0044034 0.000488634 204354 0
: 512 Minimum Test error found - save the configuration
: 512 | 228.273 203.739 0.00444483 0.000476603 201601 0
: 513 Minimum Test error found - save the configuration
: 513 | 225.437 201.029 0.00444559 0.000516143 203591 0
: 514 Minimum Test error found - save the configuration
: 514 | 223.153 199.161 0.0044827 0.000553984 203629 0
: 515 Minimum Test error found - save the configuration
: 515 | 220.84 196.56 0.00455346 0.000499263 197326 0
: 516 Minimum Test error found - save the configuration
: 516 | 217.859 193.778 0.00441136 0.000500543 204561 0
: 517 Minimum Test error found - save the configuration
: 517 | 215.52 191.958 0.00442318 0.000487683 203278 0
: 518 Minimum Test error found - save the configuration
: 518 | 213.247 189.755 0.0043842 0.000485123 205177 0
: 519 Minimum Test error found - save the configuration
: 519 | 210.846 187.205 0.00491301 0.000499864 181276 0
: 520 Minimum Test error found - save the configuration
: 520 | 208.625 186.668 0.00439443 0.000478983 204319 0
: 521 Minimum Test error found - save the configuration
: 521 | 206.105 183.971 0.00448062 0.000516723 201822 0
: 522 Minimum Test error found - save the configuration
: 522 | 204.064 181.174 0.00594612 0.000723185 153171 0
: 523 Minimum Test error found - save the configuration
: 523 | 201.648 178.714 0.00580947 0.000517513 151173 0
: 524 Minimum Test error found - save the configuration
: 524 | 199.522 177.508 0.0044297 0.000508823 204036 0
: 525 Minimum Test error found - save the configuration
: 525 | 197.105 174.711 0.00447375 0.000495223 201079 0
: 526 Minimum Test error found - save the configuration
: 526 | 194.839 173.904 0.00440526 0.000488843 204268 0
: 527 Minimum Test error found - save the configuration
: 527 | 193.001 172.878 0.00435937 0.000473273 205862 0
: 528 Minimum Test error found - save the configuration
: 528 | 190.618 169.063 0.00454689 0.000506523 198002 0
: 529 Minimum Test error found - save the configuration
: 529 | 188.35 166.535 0.00438225 0.000477634 204886 0
: 530 Minimum Test error found - save the configuration
: 530 | 186.359 165.174 0.00443757 0.000500054 203174 0
: 531 Minimum Test error found - save the configuration
: 531 | 184.27 162.704 0.00439928 0.000479083 204071 0
: 532 Minimum Test error found - save the configuration
: 532 | 182.228 161.198 0.0044188 0.000505154 204413 0
: 533 Minimum Test error found - save the configuration
: 533 | 180.009 161.063 0.00445415 0.000497674 202200 0
: 534 Minimum Test error found - save the configuration
: 534 | 178.62 157.723 0.00442402 0.000482013 202942 0
: 535 Minimum Test error found - save the configuration
: 535 | 176.107 155.388 0.0044567 0.000492874 201825 0
: 536 Minimum Test error found - save the configuration
: 536 | 174.24 154.621 0.00491141 0.000633894 187024 0
: 537 Minimum Test error found - save the configuration
: 537 | 172.102 153.604 0.00450737 0.000488444 199058 0
: 538 Minimum Test error found - save the configuration
: 538 | 170.023 150.45 0.00440883 0.000496613 204488 0
: 539 Minimum Test error found - save the configuration
: 539 | 168.069 148.526 0.00478225 0.000502484 186926 0
: 540 Minimum Test error found - save the configuration
: 540 | 165.971 146.931 0.00439535 0.000501213 205437 0
: 541 Minimum Test error found - save the configuration
: 541 | 164.262 146.494 0.00446345 0.000501563 201924 0
: 542 Minimum Test error found - save the configuration
: 542 | 162.34 144.636 0.00442252 0.000498033 203848 0
: 543 Minimum Test error found - save the configuration
: 543 | 160.325 142.381 0.00436992 0.000474194 205353 0
: 544 Minimum Test error found - save the configuration
: 544 | 158.801 141.24 0.00443228 0.000495173 203195 0
: 545 Minimum Test error found - save the configuration
: 545 | 156.724 139.124 0.00435812 0.000487274 206673 0
: 546 Minimum Test error found - save the configuration
: 546 | 154.719 137.409 0.00441114 0.000480343 203521 0
: 547 Minimum Test error found - save the configuration
: 547 | 153.418 136.976 0.00443495 0.000491203 202853 0
: 548 Minimum Test error found - save the configuration
: 548 | 152.043 135.266 0.00442155 0.000505583 204292 0
: 549 Minimum Test error found - save the configuration
: 549 | 149.818 131.742 0.00441065 0.000489464 204020 0
: 550 Minimum Test error found - save the configuration
: 550 | 147.817 130.473 0.00438571 0.000488133 205256 0
: 551 Minimum Test error found - save the configuration
: 551 | 145.83 129.126 0.00446796 0.000492203 201219 0
: 552 Minimum Test error found - save the configuration
: 552 | 144.366 128.537 0.00436397 0.000487734 206386 0
: 553 Minimum Test error found - save the configuration
: 553 | 142.729 126.337 0.00440983 0.000472984 203208 0
: 554 Minimum Test error found - save the configuration
: 554 | 140.944 125.633 0.00438237 0.000485793 205308 0
: 555 Minimum Test error found - save the configuration
: 555 | 139.399 124.582 0.00438407 0.000485274 205191 0
: 556 Minimum Test error found - save the configuration
: 556 | 137.779 122.213 0.0046914 0.000696314 200246 0
: 557 Minimum Test error found - save the configuration
: 557 | 136.033 120.212 0.0043771 0.000472733 204899 0
: 558 | 134.458 120.683 0.00439915 0.000452423 202700 1
: 559 Minimum Test error found - save the configuration
: 559 | 133 119.521 0.00492209 0.000505644 181141 0
: 560 Minimum Test error found - save the configuration
: 560 | 131.352 117.29 0.00443119 0.000489644 202966 0
: 561 Minimum Test error found - save the configuration
: 561 | 129.76 115.559 0.00438794 0.000478894 204654 0
: 562 Minimum Test error found - save the configuration
: 562 | 128.185 115.274 0.00443395 0.000498163 203263 0
: 563 Minimum Test error found - save the configuration
: 563 | 126.881 112.385 0.00443172 0.000480003 202444 0
: 564 Minimum Test error found - save the configuration
: 564 | 125.689 111.197 0.00443248 0.000512514 204083 0
: 565 Minimum Test error found - save the configuration
: 565 | 124.236 111.179 0.00445409 0.000476464 201125 0
: 566 Minimum Test error found - save the configuration
: 566 | 122.709 108.385 0.00439109 0.000485733 204847 0
: 567 Minimum Test error found - save the configuration
: 567 | 120.98 107.37 0.00441111 0.000485773 203804 0
: 568 Minimum Test error found - save the configuration
: 568 | 119.402 106.699 0.00444572 0.000489333 202205 0
: 569 Minimum Test error found - save the configuration
: 569 | 118.044 105.271 0.00471271 0.000588993 194000 0
: 570 Minimum Test error found - save the configuration
: 570 | 116.674 103.79 0.00448006 0.000493323 200665 0
: 571 Minimum Test error found - save the configuration
: 571 | 115.316 103.064 0.00439517 0.000490804 204899 0
: 572 Minimum Test error found - save the configuration
: 572 | 113.659 100.839 0.0046062 0.000492564 194475 0
: 573 | 112.566 101.713 0.00435087 0.000446144 204880 1
: 574 Minimum Test error found - save the configuration
: 574 | 111.249 99.4791 0.00440397 0.000477733 203757 0
: 575 Minimum Test error found - save the configuration
: 575 | 110.05 98.2231 0.00437968 0.000497363 206062 0
: 576 Minimum Test error found - save the configuration
: 576 | 108.632 96.7636 0.00436803 0.000472414 205359 0
: 577 Minimum Test error found - save the configuration
: 577 | 107.276 95.5839 0.00437394 0.000487723 205856 0
: 578 Minimum Test error found - save the configuration
: 578 | 105.926 95.4334 0.00438418 0.000487494 205303 0
: 579 Minimum Test error found - save the configuration
: 579 | 104.825 92.5568 0.0043644 0.000478163 205855 0
: 580 | 103.722 94.6678 0.00478515 0.000592235 190798 1
: 581 Minimum Test error found - save the configuration
: 581 | 102.394 91.5138 0.00505545 0.000499334 175588 0
: 582 Minimum Test error found - save the configuration
: 582 | 100.849 91.0522 0.00446357 0.000502103 201945 0
: 583 Minimum Test error found - save the configuration
: 583 | 99.7376 88.5434 0.0044503 0.000484103 201704 0
: 584 | 98.5149 88.6939 0.00437816 0.000455855 203962 1
: 585 Minimum Test error found - save the configuration
: 585 | 97.4087 87.0976 0.00438891 0.000488932 205129 0
: 586 | 96.0727 87.855 0.00434694 0.000438302 204675 1
: 587 Minimum Test error found - save the configuration
: 587 | 95.2466 84.4216 0.00441102 0.000492523 204160 0
: 588 Minimum Test error found - save the configuration
: 588 | 93.9295 84.0954 0.0045797 0.000494862 195846 0
: 589 Minimum Test error found - save the configuration
: 589 | 92.9501 82.6132 0.00443739 0.000514114 203911 0
: 590 | 91.7287 82.8433 0.00436701 0.000445293 203992 1
: 591 Minimum Test error found - save the configuration
: 591 | 90.9584 80.7076 0.00441372 0.000492053 203995 0
: 592 Minimum Test error found - save the configuration
: 592 | 89.9981 80.2317 0.00442417 0.000486862 203185 0
: 593 Minimum Test error found - save the configuration
: 593 | 88.5435 79.7855 0.00435102 0.000470464 206156 0
: 594 Minimum Test error found - save the configuration
: 594 | 87.4285 78.3163 0.00443964 0.000498843 203005 0
: 595 Minimum Test error found - save the configuration
: 595 | 86.3974 77.8177 0.0044651 0.000481403 200818 0
: 596 Minimum Test error found - save the configuration
: 596 | 85.2525 76.3437 0.00440644 0.000495173 204537 0
: 597 Minimum Test error found - save the configuration
: 597 | 84.2655 75.2999 0.00438502 0.000482793 205011 0
: 598 Minimum Test error found - save the configuration
: 598 | 83.342 74.3249 0.0043726 0.000475363 205274 0
: 599 Minimum Test error found - save the configuration
: 599 | 82.307 73.6741 0.00442186 0.000494384 203693 0
: 600 Minimum Test error found - save the configuration
: 600 | 81.3665 72.8606 0.00439183 0.000475315 204263 0
: 601 Minimum Test error found - save the configuration
: 601 | 80.4462 71.783 0.00445172 0.000497003 202290 0
: 602 Minimum Test error found - save the configuration
: 602 | 79.7455 70.7002 0.00438732 0.000471392 204294 0
: 603 Minimum Test error found - save the configuration
: 603 | 78.5894 69.4122 0.00440422 0.000489934 204379 0
: 604 Minimum Test error found - save the configuration
: 604 | 77.6819 68.4173 0.0043588 0.000484833 206507 0
: 605 Minimum Test error found - save the configuration
: 605 | 76.9064 68.3254 0.00438089 0.000483743 205278 0
: 606 Minimum Test error found - save the configuration
: 606 | 75.6263 67.8287 0.004428 0.000491283 203215 0
: 607 Minimum Test error found - save the configuration
: 607 | 74.8626 66.8196 0.00435298 0.000472705 206171 0
: 608 | 74.1143 67.6431 0.00436185 0.000440834 204029 1
: 609 Minimum Test error found - save the configuration
: 609 | 73.3406 65.2253 0.00458488 0.000499693 195829 0
: 610 Minimum Test error found - save the configuration
: 610 | 72.4397 64.1707 0.00441154 0.000479743 203469 0
: 611 Minimum Test error found - save the configuration
: 611 | 71.2866 63.4845 0.00439977 0.000487543 204487 0
: 612 Minimum Test error found - save the configuration
: 612 | 70.4971 62.7961 0.00441833 0.000474014 202824 0
: 613 Minimum Test error found - save the configuration
: 613 | 69.5758 61.433 0.00439795 0.000507164 205614 0
: 614 Minimum Test error found - save the configuration
: 614 | 68.9072 60.3585 0.00441397 0.000478034 203255 0
: 615 Minimum Test error found - save the configuration
: 615 | 68.0698 60.133 0.00440798 0.000488163 204091 0
: 616 Minimum Test error found - save the configuration
: 616 | 67.3793 58.8728 0.00446205 0.000477223 200761 0
: 617 | 66.4902 59.7203 0.00444609 0.000450433 200217 1
: 618 Minimum Test error found - save the configuration
: 618 | 65.7976 58.5164 0.00441042 0.000502614 204718 0
: 619 Minimum Test error found - save the configuration
: 619 | 65.0052 57.008 0.0044077 0.000474634 203404 0
: 620 Minimum Test error found - save the configuration
: 620 | 64.2255 55.732 0.0045377 0.000508225 198537 0
: 621 Minimum Test error found - save the configuration
: 621 | 63.4392 55.0854 0.00448088 0.000481834 200048 0
: 622 | 62.6728 55.5601 0.00441367 0.000456924 202186 1
: 623 Minimum Test error found - save the configuration
: 623 | 61.7416 54.3324 0.00454507 0.000522643 198885 0
: 624 | 61.0265 54.5685 0.00446876 0.000459183 199522 1
: 625 Minimum Test error found - save the configuration
: 625 | 60.5051 52.6515 0.00440704 0.000495213 204508 0
: 626 Minimum Test error found - save the configuration
: 626 | 59.6795 52.1336 0.0046116 0.000574625 198168 0
: 627 Minimum Test error found - save the configuration
: 627 | 58.835 51.3771 0.00467249 0.000558954 194480 0
: 628 | 58.0778 51.5505 0.00461971 0.000469494 192761 1
: 629 Minimum Test error found - save the configuration
: 629 | 57.4967 50.1076 0.00586219 0.000703425 155076 0
: 630 | 56.7728 50.1678 0.0052059 0.000456303 168435 1
: 631 Minimum Test error found - save the configuration
: 631 | 56.0788 49.6806 0.00447613 0.000498164 201108 0
: 632 Minimum Test error found - save the configuration
: 632 | 55.3537 47.905 0.00444894 0.000488144 201980 0
: 633 Minimum Test error found - save the configuration
: 633 | 54.7388 47.6982 0.00449754 0.000506324 200440 0
: 634 Minimum Test error found - save the configuration
: 634 | 53.9992 46.5791 0.00449251 0.000501392 200445 0
: 635 | 53.4348 46.8359 0.00456391 0.000548844 199249 1
: 636 Minimum Test error found - save the configuration
: 636 | 52.7027 45.1399 0.00479585 0.000542963 188107 0
: 637 Minimum Test error found - save the configuration
: 637 | 52.1144 44.7154 0.00457965 0.000511163 196633 0
: 638 Minimum Test error found - save the configuration
: 638 | 51.3969 44.0153 0.00465027 0.000517393 193570 0
: 639 Minimum Test error found - save the configuration
: 639 | 50.7132 43.8493 0.00462473 0.000519444 194871 0
: 640 Minimum Test error found - save the configuration
: 640 | 50.1706 42.6034 0.00578907 0.000580905 153605 0
: 641 Minimum Test error found - save the configuration
: 641 | 49.5143 42.5357 0.00628865 0.000730605 143935 0
: 642 | 48.9519 42.5811 0.00624646 0.000657065 143128 1
: 643 Minimum Test error found - save the configuration
: 643 | 48.3613 41.5871 0.00633004 0.000699045 142071 0
: 644 Minimum Test error found - save the configuration
: 644 | 47.9641 40.9203 0.00642809 0.000719935 140150 0
: 645 Minimum Test error found - save the configuration
: 645 | 47.3715 40.0904 0.00623933 0.000714234 144794 0
: 646 | 47.2149 41.0083 0.00626102 0.000571293 140604 1
: 647 Minimum Test error found - save the configuration
: 647 | 46.36 39.5445 0.00592903 0.000559745 148996 0
: 648 Minimum Test error found - save the configuration
: 648 | 45.6515 39.5174 0.00467044 0.000517234 192622 0
: 649 Minimum Test error found - save the configuration
: 649 | 45.0519 38.1581 0.0045059 0.000487582 199088 0
: 650 Minimum Test error found - save the configuration
: 650 | 44.8021 37.8034 0.0047519 0.000518443 188971 0
: 651 Minimum Test error found - save the configuration
: 651 | 43.9635 37.3759 0.00454261 0.000515654 198661 0
: 652 Minimum Test error found - save the configuration
: 652 | 43.3201 36.733 0.00458993 0.000494623 195346 0
: 653 Minimum Test error found - save the configuration
: 653 | 42.7991 35.9042 0.00458189 0.000528524 197367 0
: 654 Minimum Test error found - save the configuration
: 654 | 42.3156 35.0963 0.00455775 0.000486694 196509 0
: 655 Minimum Test error found - save the configuration
: 655 | 41.8415 35.0474 0.00449626 0.000508995 200639 0
: 656 Minimum Test error found - save the configuration
: 656 | 41.4561 34.5453 0.00448717 0.000478934 199589 0
: 657 Minimum Test error found - save the configuration
: 657 | 41.0479 34.353 0.00461764 0.000487114 193680 0
: 658 Minimum Test error found - save the configuration
: 658 | 40.3614 33.5855 0.00445232 0.000497144 202267 0
: 659 | 39.9415 33.6573 0.00456621 0.000443173 194032 1
: 660 Minimum Test error found - save the configuration
: 660 | 39.5526 33.2232 0.00459227 0.000506812 195816 0
: 661 Minimum Test error found - save the configuration
: 661 | 39.1664 32.5002 0.00453598 0.000487444 197602 0
: 662 Minimum Test error found - save the configuration
: 662 | 38.6519 32.2502 0.00449545 0.000508243 200642 0
: 663 Minimum Test error found - save the configuration
: 663 | 38.0336 31.5438 0.00465991 0.000541964 194271 0
: 664 | 37.6097 32.2173 0.00460411 0.000489025 194407 1
: 665 Minimum Test error found - save the configuration
: 665 | 37.0874 31.1181 0.00462296 0.000515293 194758 0
: 666 Minimum Test error found - save the configuration
: 666 | 36.6349 30.5979 0.00463778 0.000518943 194229 0
: 667 Minimum Test error found - save the configuration
: 667 | 36.3004 30.5145 0.00447441 0.000513184 201958 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.6816 29.2816 0.00451465 0.000493564 198951 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.1925 29.1278 0.00448743 0.000499733 200617 0
: 670 Minimum Test error found - save the configuration
: 670 | 34.8261 28.3333 0.00446134 0.000490663 201477 0
: 671 | 34.4157 28.6745 0.00451441 0.000468734 197742 1
: 672 | 34.2853 28.5368 0.00440151 0.000445824 202241 2
: 673 Minimum Test error found - save the configuration
: 673 | 33.9123 28.141 0.00444514 0.000506603 203121 0
: 674 Minimum Test error found - save the configuration
: 674 | 33.2081 27.6161 0.00441068 0.000488113 203948 0
: 675 Minimum Test error found - save the configuration
: 675 | 32.7838 27.5001 0.00444519 0.000497983 202675 0
: 676 Minimum Test error found - save the configuration
: 676 | 32.5664 27.411 0.00443633 0.000486203 202525 0
: 677 Minimum Test error found - save the configuration
: 677 | 31.9306 26.4239 0.00440939 0.000477024 203440 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.5608 25.3967 0.00450923 0.000570044 203088 0
: 679 | 31.0727 25.5508 0.00439667 0.000446302 202513 1
: 680 Minimum Test error found - save the configuration
: 680 | 30.645 25.0313 0.00443972 0.000493564 202729 0
: 681 Minimum Test error found - save the configuration
: 681 | 30.3303 24.5435 0.00442595 0.000485214 203008 0
: 682 | 29.9682 24.694 0.00440449 0.000459683 202798 1
: 683 Minimum Test error found - save the configuration
: 683 | 29.5879 23.921 0.00442427 0.000481233 202889 0
: 684 Minimum Test error found - save the configuration
: 684 | 29.3611 23.675 0.00445014 0.000497643 202404 0
: 685 | 29.2799 24.5492 0.0043757 0.000451424 203859 1
: 686 Minimum Test error found - save the configuration
: 686 | 28.576 23.3859 0.00442614 0.000487683 203125 0
: 687 Minimum Test error found - save the configuration
: 687 | 28.0448 22.8658 0.00441816 0.000499003 204126 0
: 688 Minimum Test error found - save the configuration
: 688 | 27.8448 22.6503 0.00440043 0.000477794 203944 0
: 689 Minimum Test error found - save the configuration
: 689 | 27.5902 21.6358 0.00443336 0.000502973 203542 0
: 690 | 26.9852 22.1948 0.00436309 0.000442723 204063 1
: 691 | 26.651 22.3582 0.00438894 0.000443944 202788 2
: 692 Minimum Test error found - save the configuration
: 692 | 26.335 21.4834 0.00442893 0.000504155 203833 0
: 693 Minimum Test error found - save the configuration
: 693 | 25.9442 21.0402 0.00441623 0.000474824 202973 0
: 694 Minimum Test error found - save the configuration
: 694 | 25.6064 20.4175 0.00442983 0.000492394 203178 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.3399 20.2515 0.00444295 0.000487584 202257 0
: 696 | 25.0043 20.4624 0.0044137 0.000463553 202524 1
: 697 Minimum Test error found - save the configuration
: 697 | 24.9151 19.7808 0.00447108 0.000491963 201050 0
: 698 Minimum Test error found - save the configuration
: 698 | 24.6799 19.3878 0.00451067 0.000503412 199638 0
: 699 | 24.0032 19.7861 0.00444821 0.000454573 200319 1
: 700 Minimum Test error found - save the configuration
: 700 | 23.6811 19.3154 0.0044881 0.000509924 201097 0
: 701 | 23.3525 19.7776 0.00444458 0.000442852 199914 1
: 702 Minimum Test error found - save the configuration
: 702 | 23.1705 18.3816 0.00447677 0.000494174 200874 0
: 703 | 22.7506 18.6575 0.00444817 0.000462213 200705 1
: 704 Minimum Test error found - save the configuration
: 704 | 22.3954 18.3597 0.00449224 0.000487803 199778 0
: 705 Minimum Test error found - save the configuration
: 705 | 22.2118 17.6444 0.00448744 0.000506463 200956 0
: 706 Minimum Test error found - save the configuration
: 706 | 21.8818 17.6428 0.00445492 0.000481004 201313 0
: 707 | 21.7109 17.6855 0.00456518 0.000521472 197838 1
: 708 Minimum Test error found - save the configuration
: 708 | 21.2885 17.6392 0.00452557 0.000501074 198783 0
: 709 Minimum Test error found - save the configuration
: 709 | 20.9855 17.0729 0.00452317 0.000502423 198968 0
: 710 Minimum Test error found - save the configuration
: 710 | 20.6504 16.282 0.00447154 0.000491754 201016 0
: 711 Minimum Test error found - save the configuration
: 711 | 20.4368 16.1345 0.00446542 0.000488244 201148 0
: 712 | 20.1353 17.0025 0.00444445 0.000460124 200787 1
: 713 | 19.7964 16.3189 0.00444532 0.000456632 200567 2
: 714 Minimum Test error found - save the configuration
: 714 | 19.5694 15.9502 0.00445595 0.000488734 201653 0
: 715 | 19.5714 16.2211 0.00447529 0.000465133 199493 1
: 716 Minimum Test error found - save the configuration
: 716 | 19.2564 15.4057 0.00459561 0.000509262 195774 0
: 717 | 18.9138 16.4281 0.00590786 0.000627933 151517 1
: 718 Minimum Test error found - save the configuration
: 718 | 18.6942 15.3774 0.00620453 0.000698556 145297 0
: 719 | 18.7724 15.8866 0.00597315 0.000471293 145405 1
: 720 Minimum Test error found - save the configuration
: 720 | 18.3122 14.683 0.00597104 0.000703494 151873 0
: 721 | 18.1033 15.0258 0.00615013 0.000646095 145348 1
: 722 | 17.7896 15.5202 0.00614447 0.000642085 145391 2
: 723 | 17.5453 14.712 0.0061346 0.000632435 145397 3
: 724 Minimum Test error found - save the configuration
: 724 | 17.0817 14.0175 0.00620355 0.000695546 145243 0
: 725 | 16.9899 14.3344 0.00576868 0.000481434 151308 1
: 726 Minimum Test error found - save the configuration
: 726 | 16.9082 13.7698 0.005308 0.000700675 173637 0
: 727 | 16.4262 14.3782 0.00616557 0.000653244 145129 1
: 728 | 16.2653 13.8716 0.00621646 0.000645564 143603 2
: 729 Minimum Test error found - save the configuration
: 729 | 16.0569 13.6401 0.00618878 0.000696864 145669 0
: 730 | 15.7259 14.881 0.0061466 0.000627124 144941 1
: 731 Minimum Test error found - save the configuration
: 731 | 15.8152 13.0576 0.00624106 0.000605214 141948 0
: 732 Minimum Test error found - save the configuration
: 732 | 15.4422 12.4527 0.00503534 0.000511272 176832 0
: 733 | 15.0726 13.6088 0.00608538 0.000650135 147187 1
: 734 | 14.9331 12.9613 0.00619408 0.000650384 144308 2
: 735 | 14.8703 13.0683 0.00507655 0.000648124 180651 3
: 736 Minimum Test error found - save the configuration
: 736 | 14.5472 11.6207 0.00455996 0.000572804 200644 0
: 737 | 14.3004 11.7068 0.00444501 0.000443694 199934 1
: 738 Minimum Test error found - save the configuration
: 738 | 14.1383 11.531 0.00451007 0.000500063 199501 0
: 739 | 14.015 11.9198 0.00442265 0.000464774 202129 1
: 740 | 13.777 11.8455 0.00466392 0.000460253 190310 2
: 741 Minimum Test error found - save the configuration
: 741 | 13.6682 11.0559 0.00465021 0.000501303 192822 0
: 742 | 13.3963 11.1734 0.00464762 0.000456742 190891 1
: 743 Minimum Test error found - save the configuration
: 743 | 13.3594 10.898 0.004617 0.000525702 195537 0
: 744 | 13.1427 11.8554 0.00459124 0.000443514 192877 1
: 745 Minimum Test error found - save the configuration
: 745 | 13.2856 10.8181 0.00470532 0.000497153 190106 0
: 746 | 12.7737 11.3139 0.00448547 0.000498775 200667 1
: 747 Minimum Test error found - save the configuration
: 747 | 12.5601 10.575 0.0047468 0.000500775 188411 0
: 748 Minimum Test error found - save the configuration
: 748 | 12.2452 10.4898 0.00463298 0.000516953 194362 0
: 749 | 12.1371 10.7024 0.00453795 0.000448494 195625 1
: 750 | 11.9087 11.0241 0.00436953 0.000458052 204526 2
: 751 Minimum Test error found - save the configuration
: 751 | 11.7683 10.1564 0.00460297 0.000514944 195693 0
: 752 | 11.7009 10.9475 0.00447058 0.000467243 199833 1
: 753 Minimum Test error found - save the configuration
: 753 | 11.6546 9.55372 0.0045253 0.000528614 200166 0
: 754 | 11.5876 11.9775 0.00476191 0.000471914 186480 1
: 755 | 11.4929 9.61693 0.00462532 0.000576964 197611 2
: 756 Minimum Test error found - save the configuration
: 756 | 10.9598 9.42748 0.00440097 0.000495225 204826 0
: 757 Minimum Test error found - save the configuration
: 757 | 10.9821 9.28229 0.00444149 0.000488252 202366 0
: 758 | 10.7812 9.81251 0.00435077 0.000445333 204843 1
: 759 Minimum Test error found - save the configuration
: 759 | 10.6124 9.18488 0.00452447 0.000500283 198798 0
: 760 Minimum Test error found - save the configuration
: 760 | 10.497 8.88982 0.0044968 0.000484383 199381 0
: 761 | 10.3635 9.32544 0.00469856 0.000501563 190612 1
: 762 Minimum Test error found - save the configuration
: 762 | 10.3589 8.75914 0.00446786 0.000482105 200715 0
: 763 | 10.1067 8.87627 0.00444929 0.000461033 200589 1
: 764 Minimum Test error found - save the configuration
: 764 | 9.94582 8.23287 0.0047003 0.000510532 190941 0
: 765 | 9.85978 9.18047 0.00445693 0.000442803 199296 1
: 766 Minimum Test error found - save the configuration
: 766 | 9.66904 8.01948 0.00463349 0.000501604 193616 0
: 767 | 9.652 9.80388 0.0044757 0.000459283 199182 1
: 768 | 9.54384 8.40993 0.00455364 0.000516844 198177 2
: 769 | 9.47892 9.13881 0.00456454 0.000575414 200545 3
: 770 Minimum Test error found - save the configuration
: 770 | 9.10302 7.93162 0.00449196 0.000510844 200949 0
: 771 | 9.0511 9.28669 0.00437388 0.000442443 203488 1
: 772 | 9.23198 8.18798 0.00443065 0.000454203 201185 2
: 773 Minimum Test error found - save the configuration
: 773 | 8.85979 7.43514 0.00438685 0.000478742 204703 0
: 774 | 8.65009 8.08842 0.00435494 0.000442534 204478 1
: 775 | 8.5544 7.7466 0.00441793 0.000528294 205675 2
: 776 | 8.43591 7.48669 0.00453622 0.000442243 195409 3
: 777 | 8.36451 8.01336 0.00435164 0.000457153 205419 4
: 778 | 8.30846 7.97223 0.0043585 0.000441843 204256 5
: 779 Minimum Test error found - save the configuration
: 779 | 8.2264 7.3096 0.0044644 0.000499074 201749 0
: 780 | 7.99156 8.08462 0.0044444 0.000445563 200058 1
: 781 | 7.8633 7.67581 0.00446647 0.000460384 199696 2
: 782 | 7.87582 7.87435 0.00438826 0.000456854 203489 3
: 783 | 7.90847 7.47016 0.00436108 0.000441873 204123 4
: 784 Minimum Test error found - save the configuration
: 784 | 7.87033 6.49483 0.00445067 0.000515924 203317 0
: 785 | 8.01367 7.53808 0.00437353 0.000441773 203471 1
: 786 | 7.37872 6.96236 0.00445211 0.000506233 202743 2
: 787 | 7.36378 6.87571 0.00450628 0.000455203 197478 3
: 788 | 7.21103 7.07571 0.0044363 0.000458563 201119 4
: 789 | 7.13459 6.88353 0.00470498 0.000532564 191735 5
: 790 | 7.0577 7.24946 0.00444647 0.000502773 202855 6
: 791 | 6.9687 6.54468 0.00453108 0.000455133 196273 7
: 792 Minimum Test error found - save the configuration
: 792 | 6.93705 6.45753 0.0044044 0.000498253 204805 0
: 793 | 6.79832 6.60215 0.00437128 0.000445264 203769 1
: 794 | 6.75663 7.32478 0.00446976 0.000458393 199433 2
: 795 Minimum Test error found - save the configuration
: 795 | 6.74297 6.29499 0.00441432 0.000485785 203638 0
: 796 | 6.94112 7.59076 0.00442841 0.000470835 202144 1
: 797 | 6.62816 6.62168 0.00451734 0.000444994 196447 2
: 798 Minimum Test error found - save the configuration
: 798 | 6.45008 6.15416 0.00460251 0.000563693 198078 0
: 799 Minimum Test error found - save the configuration
: 799 | 6.46829 5.60591 0.00443779 0.000482492 202260 0
: 800 Minimum Test error found - save the configuration
: 800 | 6.30556 5.54141 0.00447728 0.000512504 201777 0
: 801 | 6.15824 5.67203 0.00442818 0.000442224 200705 1
: 802 | 6.11095 6.05833 0.00445241 0.000459832 200372 2
: 803 Minimum Test error found - save the configuration
: 803 | 6.06898 5.22022 0.00445346 0.000483342 201505 0
: 804 | 6.15259 5.7816 0.00438356 0.000444542 203096 1
: 805 | 6.04494 5.69091 0.00447961 0.000498153 200931 2
: 806 | 5.88549 5.88273 0.00447245 0.000472823 200019 3
: 807 | 5.82405 6.99272 0.00437913 0.000455312 203883 4
: 808 | 5.74807 6.00513 0.00454902 0.000442683 194821 5
: 809 | 5.56137 6.09882 0.00439885 0.000460204 203115 6
: 810 Minimum Test error found - save the configuration
: 810 | 5.49651 5.20538 0.00464118 0.000513244 193801 0
: 811 | 5.42477 5.29728 0.00444867 0.000489763 202076 1
: 812 | 5.34895 5.90301 0.00437267 0.000461273 204530 2
: 813 | 5.30797 6.3372 0.00442957 0.000463403 201706 3
: 814 Minimum Test error found - save the configuration
: 814 | 5.27163 4.765 0.00444341 0.000479692 201831 0
: 815 | 5.2618 6.201 0.00444397 0.000462462 200929 1
: 816 | 5.15315 5.78124 0.00439297 0.000443212 202544 2
: 817 | 5.14883 6.04822 0.00453355 0.000461584 196465 3
: 818 | 5.13969 5.21012 0.00443689 0.000443193 200316 4
: 819 | 5.14055 6.28339 0.00454264 0.000538584 199797 5
: 820 | 5.14253 5.94297 0.00473245 0.000443703 186535 6
: 821 | 4.91599 5.74709 0.00441102 0.000453563 202150 7
: 822 | 4.9426 4.80898 0.00434891 0.000442323 204782 8
: 823 | 4.79678 6.73557 0.00439052 0.000460003 203536 9
: 824 | 4.81063 6.32357 0.00434664 0.000442363 204903 10
: 825 | 4.72139 6.634 0.00440032 0.000443583 202187 11
: 826 | 4.79249 6.59883 0.00442078 0.000482904 203155 12
: 827 | 4.64258 6.05768 0.00445111 0.000443823 199636 13
: 828 | 4.48013 6.84913 0.0044079 0.000469663 203137 14
: 829 | 4.57398 5.83748 0.00451568 0.000447185 196633 15
: 830 | 4.43001 6.32756 0.00437875 0.000456314 203955 16
: 831 | 4.45019 6.84074 0.0043504 0.000442154 204695 17
: 832 | 4.39234 5.58431 0.00470886 0.000465262 188519 18
: 833 | 4.37481 5.03462 0.00452555 0.000445214 196062 19
: 834 | 4.1387 6.06383 0.00463314 0.000451623 191318 20
: 835 | 4.24427 6.93696 0.0043928 0.000462723 203558 21
:
: Elapsed time for training with 1000 events: 3.88 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00597 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.863 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.171 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.33282e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.10734e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0431 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0381 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00148 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0533 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.912 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0199 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00257 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.038 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00447 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00189 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000356 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0502 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00586 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.928 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.102 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -1.01 -0.0990 5.93 1.64 | 3.197 3.217
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.251 -0.0142 2.24 1.10 | 3.337 3.327
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.