Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.254 sec
: Elapsed time for training with 1000 events: 0.258 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00255 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000793 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00403 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.00022 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000314 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31538.3
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33124.9 31206.8 0.00436047 0.000494062 206911 0
: 2 Minimum Test error found - save the configuration
: 2 | 32699.3 30704.5 0.00427601 0.000485403 211048 0
: 3 Minimum Test error found - save the configuration
: 3 | 32025.5 30042.7 0.00431585 0.000486713 208924 0
: 4 Minimum Test error found - save the configuration
: 4 | 31249.7 29353.6 0.00434855 0.000476232 206594 0
: 5 Minimum Test error found - save the configuration
: 5 | 30483.7 28589.5 0.00463243 0.000603524 198565 0
: 6 Minimum Test error found - save the configuration
: 6 | 29653 27713.2 0.00431648 0.000473152 208153 0
: 7 Minimum Test error found - save the configuration
: 7 | 28969.4 27165.5 0.00428113 0.000494693 211281 0
: 8 Minimum Test error found - save the configuration
: 8 | 28541.9 26798.4 0.00444165 0.000495673 202738 0
: 9 Minimum Test error found - save the configuration
: 9 | 28190.2 26479.2 0.00426096 0.000457733 210347 0
: 10 Minimum Test error found - save the configuration
: 10 | 27869 26184.1 0.00426156 0.000478563 211473 0
: 11 Minimum Test error found - save the configuration
: 11 | 27572.5 25898.5 0.00436618 0.000496043 206711 0
: 12 Minimum Test error found - save the configuration
: 12 | 27277.3 25633.4 0.00414469 0.000465413 217434 0
: 13 Minimum Test error found - save the configuration
: 13 | 27005.3 25368.7 0.00408182 0.000440283 219687 0
: 14 Minimum Test error found - save the configuration
: 14 | 26735.2 25112.9 0.00424625 0.000528262 215170 0
: 15 Minimum Test error found - save the configuration
: 15 | 26469.4 24868.1 0.00424212 0.000474643 212343 0
: 16 Minimum Test error found - save the configuration
: 16 | 26217.5 24622.8 0.00427563 0.000466222 210006 0
: 17 Minimum Test error found - save the configuration
: 17 | 25959.7 24392.3 0.00448275 0.000447113 198234 0
: 18 Minimum Test error found - save the configuration
: 18 | 25720.3 24155.9 0.00405187 0.000444392 221761 0
: 19 Minimum Test error found - save the configuration
: 19 | 25479.6 23922.9 0.00416563 0.000461362 215967 0
: 20 Minimum Test error found - save the configuration
: 20 | 25235.9 23702.7 0.00416922 0.000499442 217997 0
: 21 Minimum Test error found - save the configuration
: 21 | 25007 23478.9 0.00439747 0.000476823 204048 0
: 22 Minimum Test error found - save the configuration
: 22 | 24777.9 23257.5 0.0043357 0.000472142 207063 0
: 23 Minimum Test error found - save the configuration
: 23 | 24547.7 23044.4 0.00431021 0.000491172 209477 0
: 24 Minimum Test error found - save the configuration
: 24 | 24324.9 22833 0.004407 0.000522854 205966 0
: 25 Minimum Test error found - save the configuration
: 25 | 24105.3 22623 0.00432003 0.000466192 207585 0
: 26 Minimum Test error found - save the configuration
: 26 | 23885.1 22419.1 0.00417818 0.000449342 214544 0
: 27 Minimum Test error found - save the configuration
: 27 | 23673.3 22212.9 0.00407068 0.000447121 220777 0
: 28 Minimum Test error found - save the configuration
: 28 | 23458.7 22012.4 0.00407551 0.000441962 220170 0
: 29 Minimum Test error found - save the configuration
: 29 | 23247.5 21816 0.00430691 0.000462993 208121 0
: 30 Minimum Test error found - save the configuration
: 30 | 23041.7 21619.4 0.00429129 0.000467273 209204 0
: 31 Minimum Test error found - save the configuration
: 31 | 22839.6 21420.9 0.00429277 0.000458063 208621 0
: 32 Minimum Test error found - save the configuration
: 32 | 22631.6 21232.2 0.00441496 0.000470403 202811 0
: 33 Minimum Test error found - save the configuration
: 33 | 22432.6 21043.4 0.00429785 0.000494623 210347 0
: 34 Minimum Test error found - save the configuration
: 34 | 22236.1 20853.8 0.00434663 0.000464962 206097 0
: 35 Minimum Test error found - save the configuration
: 35 | 22037.2 20670.5 0.00527419 0.000687174 174405 0
: 36 Minimum Test error found - save the configuration
: 36 | 21844.9 20486.3 0.00610039 0.000685533 147742 0
: 37 Minimum Test error found - save the configuration
: 37 | 21652.9 20304 0.0061418 0.000676683 146383 0
: 38 Minimum Test error found - save the configuration
: 38 | 21460.9 20126.7 0.00498443 0.000464922 177010 0
: 39 Minimum Test error found - save the configuration
: 39 | 21273.8 19949.6 0.00422111 0.000472063 213387 0
: 40 Minimum Test error found - save the configuration
: 40 | 21090.8 19770.3 0.00455996 0.000665644 205428 0
: 41 Minimum Test error found - save the configuration
: 41 | 20903.2 19597.8 0.00434003 0.000478112 207151 0
: 42 Minimum Test error found - save the configuration
: 42 | 20722.9 19424.3 0.00431648 0.000447633 206780 0
: 43 Minimum Test error found - save the configuration
: 43 | 20541.1 19254.5 0.00425341 0.000477523 211870 0
: 44 Minimum Test error found - save the configuration
: 44 | 20363.1 19085.3 0.00420042 0.000469723 214437 0
: 45 Minimum Test error found - save the configuration
: 45 | 20185.7 18917.9 0.00429506 0.000484373 209936 0
: 46 Minimum Test error found - save the configuration
: 46 | 20006.8 18753 0.00425556 0.000467373 211183 0
: 47 Minimum Test error found - save the configuration
: 47 | 19829.2 18584.1 0.00432558 0.000473963 207705 0
: 48 Minimum Test error found - save the configuration
: 48 | 19660.4 18420.3 0.00439309 0.000492703 205108 0
: 49 Minimum Test error found - save the configuration
: 49 | 19488.8 18261.6 0.00433414 0.000456733 206324 0
: 50 Minimum Test error found - save the configuration
: 50 | 19316.4 18099.1 0.00430067 0.000465162 208577 0
: 51 Minimum Test error found - save the configuration
: 51 | 19143.8 17936.1 0.00431017 0.000491253 209484 0
: 52 Minimum Test error found - save the configuration
: 52 | 18979.3 17778.3 0.00430891 0.000456502 207662 0
: 53 Minimum Test error found - save the configuration
: 53 | 18807.8 17625.7 0.00432257 0.000487322 208591 0
: 54 Minimum Test error found - save the configuration
: 54 | 18646.6 17465 0.00430088 0.000468662 208756 0
: 55 Minimum Test error found - save the configuration
: 55 | 18480.9 17308.9 0.00440063 0.000493163 204736 0
: 56 Minimum Test error found - save the configuration
: 56 | 18322 17154.3 0.00444102 0.000485403 202244 0
: 57 Minimum Test error found - save the configuration
: 57 | 18157.2 17001.1 0.00445388 0.000491272 201887 0
: 58 Minimum Test error found - save the configuration
: 58 | 17996.6 16852.1 0.00443966 0.000492873 202697 0
: 59 Minimum Test error found - save the configuration
: 59 | 17839.1 16694.6 0.00437402 0.000519632 207555 0
: 60 Minimum Test error found - save the configuration
: 60 | 17681.9 16545.2 0.00441868 0.000478153 203019 0
: 61 Minimum Test error found - save the configuration
: 61 | 17523.1 16394.5 0.00442949 0.000484533 202791 0
: 62 Minimum Test error found - save the configuration
: 62 | 17367.8 16249 0.00447422 0.000498944 201244 0
: 63 Minimum Test error found - save the configuration
: 63 | 17214.8 16099.1 0.00441149 0.000508543 204974 0
: 64 Minimum Test error found - save the configuration
: 64 | 17061.1 15958.5 0.00465928 0.000507173 192673 0
: 65 Minimum Test error found - save the configuration
: 65 | 16908.2 15814.2 0.00446155 0.000495114 201693 0
: 66 Minimum Test error found - save the configuration
: 66 | 16758.1 15668.3 0.0043647 0.000511823 207637 0
: 67 Minimum Test error found - save the configuration
: 67 | 16608.1 15526.8 0.00443106 0.000495293 203264 0
: 68 Minimum Test error found - save the configuration
: 68 | 16460 15383.7 0.00443878 0.000471502 201649 0
: 69 Minimum Test error found - save the configuration
: 69 | 16312.6 15244.6 0.00451967 0.000519083 199971 0
: 70 Minimum Test error found - save the configuration
: 70 | 16165.9 15106.5 0.00442386 0.000477352 202711 0
: 71 Minimum Test error found - save the configuration
: 71 | 16019.9 14971.5 0.00459677 0.000503643 195450 0
: 72 Minimum Test error found - save the configuration
: 72 | 15878.2 14835.3 0.00445312 0.000485853 201650 0
: 73 Minimum Test error found - save the configuration
: 73 | 15735.8 14702 0.00440481 0.000521683 206020 0
: 74 Minimum Test error found - save the configuration
: 74 | 15596 14567.3 0.00442862 0.000497373 203498 0
: 75 Minimum Test error found - save the configuration
: 75 | 15456.2 14434.9 0.00446262 0.000484633 201106 0
: 76 Minimum Test error found - save the configuration
: 76 | 15315.9 14307 0.00446646 0.000504283 201909 0
: 77 Minimum Test error found - save the configuration
: 77 | 15180.4 14177.9 0.00443563 0.000475643 202021 0
: 78 Minimum Test error found - save the configuration
: 78 | 15048.1 14046.2 0.0045385 0.000488992 197555 0
: 79 Minimum Test error found - save the configuration
: 79 | 14909.8 13921.2 0.00443108 0.000481502 202553 0
: 80 Minimum Test error found - save the configuration
: 80 | 14776.4 13796.9 0.004434 0.000531373 204990 0
: 81 Minimum Test error found - save the configuration
: 81 | 14646.1 13671.4 0.00447643 0.000531493 202791 0
: 82 Minimum Test error found - save the configuration
: 82 | 14515.2 13547.2 0.00440857 0.000487363 204019 0
: 83 Minimum Test error found - save the configuration
: 83 | 14384.6 13425.7 0.00445618 0.000492533 201834 0
: 84 Minimum Test error found - save the configuration
: 84 | 14256 13305.1 0.00444736 0.000492242 202269 0
: 85 Minimum Test error found - save the configuration
: 85 | 14128.6 13185.5 0.0044565 0.000508323 202625 0
: 86 Minimum Test error found - save the configuration
: 86 | 14001.4 13069.1 0.00487981 0.000511852 183152 0
: 87 Minimum Test error found - save the configuration
: 87 | 13878.8 12949.2 0.00444128 0.000514864 203748 0
: 88 Minimum Test error found - save the configuration
: 88 | 13753.9 12831.4 0.0044682 0.000484053 200796 0
: 89 Minimum Test error found - save the configuration
: 89 | 13631.3 12714.5 0.00449133 0.000474733 199174 0
: 90 Minimum Test error found - save the configuration
: 90 | 13508.4 12600.4 0.00423363 0.000479373 213092 0
: 91 Minimum Test error found - save the configuration
: 91 | 13387.7 12486.5 0.00420416 0.000461873 213773 0
: 92 Minimum Test error found - save the configuration
: 92 | 13267 12375.3 0.00421323 0.000454383 212831 0
: 93 Minimum Test error found - save the configuration
: 93 | 13149.7 12262.9 0.00452083 0.000496213 198777 0
: 94 Minimum Test error found - save the configuration
: 94 | 13031.6 12152 0.00450646 0.000500023 199679 0
: 95 Minimum Test error found - save the configuration
: 95 | 12913.2 12044.8 0.00452762 0.000496203 198442 0
: 96 Minimum Test error found - save the configuration
: 96 | 12798.7 11936.5 0.00454267 0.000481733 196999 0
: 97 Minimum Test error found - save the configuration
: 97 | 12686.2 11825.8 0.00460155 0.000487453 194454 0
: 98 Minimum Test error found - save the configuration
: 98 | 12569 11721.7 0.00466339 0.000503572 192316 0
: 99 Minimum Test error found - save the configuration
: 99 | 12459 11613.9 0.00448186 0.000490103 200413 0
: 100 Minimum Test error found - save the configuration
: 100 | 12346.3 11508.6 0.00447922 0.000514552 201782 0
: 101 Minimum Test error found - save the configuration
: 101 | 12232.8 11408.8 0.00447629 0.000510592 201730 0
: 102 Minimum Test error found - save the configuration
: 102 | 12128.9 11301.1 0.00449573 0.000488552 199641 0
: 103 Minimum Test error found - save the configuration
: 103 | 12015.4 11201 0.00447647 0.000485162 200436 0
: 104 Minimum Test error found - save the configuration
: 104 | 11908.7 11100.4 0.00457842 0.000489194 195636 0
: 105 Minimum Test error found - save the configuration
: 105 | 11802 10999.8 0.00458421 0.000511412 196425 0
: 106 Minimum Test error found - save the configuration
: 106 | 11695.1 10902.2 0.0045356 0.000554433 200946 0
: 107 Minimum Test error found - save the configuration
: 107 | 11590.6 10804.2 0.00448245 0.000479363 199846 0
: 108 Minimum Test error found - save the configuration
: 108 | 11487.8 10705.2 0.0045477 0.000514123 198335 0
: 109 Minimum Test error found - save the configuration
: 109 | 11383.4 10609.5 0.00492068 0.000499733 180957 0
: 110 Minimum Test error found - save the configuration
: 110 | 11281.3 10512.8 0.00450416 0.000535423 201576 0
: 111 Minimum Test error found - save the configuration
: 111 | 11179 10419.7 0.00459536 0.000495973 195151 0
: 112 Minimum Test error found - save the configuration
: 112 | 11079.7 10324.8 0.00448072 0.000483132 200120 0
: 113 Minimum Test error found - save the configuration
: 113 | 10978.8 10232.2 0.00452622 0.000505043 198947 0
: 114 Minimum Test error found - save the configuration
: 114 | 10879.9 10141.8 0.00452423 0.000485592 198087 0
: 115 Minimum Test error found - save the configuration
: 115 | 10784.8 10047 0.00467746 0.000492712 191171 0
: 116 Minimum Test error found - save the configuration
: 116 | 10685.5 9955.88 0.0045008 0.000520663 200998 0
: 117 Minimum Test error found - save the configuration
: 117 | 10587.6 9869.09 0.00473649 0.000486133 188220 0
: 118 Minimum Test error found - save the configuration
: 118 | 10493.9 9779.36 0.00461152 0.000500133 194582 0
: 119 Minimum Test error found - save the configuration
: 119 | 10399.6 9690.7 0.00448651 0.000515132 201441 0
: 120 Minimum Test error found - save the configuration
: 120 | 10303.9 9604.16 0.00450311 0.000480723 198887 0
: 121 Minimum Test error found - save the configuration
: 121 | 10212.6 9517.85 0.0045526 0.000493003 197064 0
: 122 Minimum Test error found - save the configuration
: 122 | 10120.5 9430.2 0.00453386 0.000534973 200056 0
: 123 Minimum Test error found - save the configuration
: 123 | 10027.6 9346.33 0.00446074 0.000482273 201083 0
: 124 Minimum Test error found - save the configuration
: 124 | 9937.96 9261.27 0.0045208 0.000488942 198420 0
: 125 Minimum Test error found - save the configuration
: 125 | 9848.99 9177.11 0.00455849 0.000516173 197906 0
: 126 Minimum Test error found - save the configuration
: 126 | 9759.08 9092.98 0.00445521 0.000487943 201650 0
: 127 Minimum Test error found - save the configuration
: 127 | 9671.05 9011.7 0.00457593 0.000509663 196741 0
: 128 Minimum Test error found - save the configuration
: 128 | 9582.42 8930.61 0.00456915 0.000523333 197735 0
: 129 Minimum Test error found - save the configuration
: 129 | 9496.45 8849.83 0.00450736 0.000494754 199372 0
: 130 Minimum Test error found - save the configuration
: 130 | 9410.07 8771.69 0.00447731 0.000480603 200165 0
: 131 Minimum Test error found - save the configuration
: 131 | 9325.76 8690.41 0.0048383 0.000520623 185285 0
: 132 Minimum Test error found - save the configuration
: 132 | 9241.25 8611.92 0.0045176 0.000493603 198808 0
: 133 Minimum Test error found - save the configuration
: 133 | 9156.96 8534.05 0.00452108 0.000478173 197878 0
: 134 Minimum Test error found - save the configuration
: 134 | 9074.19 8458.28 0.00465115 0.000543623 194765 0
: 135 Minimum Test error found - save the configuration
: 135 | 8991.59 8380.58 0.00452347 0.000473792 197547 0
: 136 Minimum Test error found - save the configuration
: 136 | 8910.39 8305.52 0.00430678 0.000484393 209293 0
: 137 Minimum Test error found - save the configuration
: 137 | 8830.03 8230.37 0.00428604 0.000473303 209823 0
: 138 Minimum Test error found - save the configuration
: 138 | 8748.77 8155.63 0.00433102 0.000474194 207425 0
: 139 Minimum Test error found - save the configuration
: 139 | 8670.58 8082.17 0.00429346 0.000474663 209490 0
: 140 Minimum Test error found - save the configuration
: 140 | 8590.07 8009.98 0.00429794 0.000477133 209380 0
: 141 Minimum Test error found - save the configuration
: 141 | 8512.52 7938.77 0.00429508 0.000464822 208863 0
: 142 Minimum Test error found - save the configuration
: 142 | 8437.41 7863.97 0.00431766 0.000471643 208008 0
: 143 Minimum Test error found - save the configuration
: 143 | 8358.93 7794.54 0.004396 0.000502694 205481 0
: 144 Minimum Test error found - save the configuration
: 144 | 8282.15 7725.91 0.00452343 0.000504413 199054 0
: 145 Minimum Test error found - save the configuration
: 145 | 8207.85 7653.86 0.00452511 0.000493424 198428 0
: 146 Minimum Test error found - save the configuration
: 146 | 8132.62 7589.06 0.00452475 0.000485603 198062 0
: 147 Minimum Test error found - save the configuration
: 147 | 8059.23 7514.85 0.0044633 0.000491163 201403 0
: 148 Minimum Test error found - save the configuration
: 148 | 7986.04 7450.43 0.00454683 0.000512463 198296 0
: 149 Minimum Test error found - save the configuration
: 149 | 7911.79 7381.43 0.00445322 0.000498193 202274 0
: 150 Minimum Test error found - save the configuration
: 150 | 7840.93 7313.26 0.00445511 0.000486373 201576 0
: 151 Minimum Test error found - save the configuration
: 151 | 7768.83 7247.92 0.00456319 0.000546054 199147 0
: 152 Minimum Test error found - save the configuration
: 152 | 7697.98 7182.76 0.00449896 0.000496913 199897 0
: 153 Minimum Test error found - save the configuration
: 153 | 7628.04 7119.17 0.0043577 0.000497942 207267 0
: 154 Minimum Test error found - save the configuration
: 154 | 7558.47 7053.94 0.00472787 0.000520863 190159 0
: 155 Minimum Test error found - save the configuration
: 155 | 7489.47 6989.79 0.00457296 0.000505163 196667 0
: 156 Minimum Test error found - save the configuration
: 156 | 7420.55 6926.03 0.0044944 0.000489123 199736 0
: 157 Minimum Test error found - save the configuration
: 157 | 7354.29 6860.63 0.00452502 0.000534643 200482 0
: 158 Minimum Test error found - save the configuration
: 158 | 7285.99 6801.6 0.00459736 0.000512583 195849 0
: 159 Minimum Test error found - save the configuration
: 159 | 7218.61 6738.14 0.0044797 0.000490562 200544 0
: 160 Minimum Test error found - save the configuration
: 160 | 7153.71 6676.96 0.00453913 0.000520253 199061 0
: 161 Minimum Test error found - save the configuration
: 161 | 7088.01 6617.29 0.00453595 0.000504803 198455 0
: 162 Minimum Test error found - save the configuration
: 162 | 7022.66 6555.75 0.00457183 0.000499922 196468 0
: 163 Minimum Test error found - save the configuration
: 163 | 6959.04 6495.57 0.00450235 0.000507683 200267 0
: 164 Minimum Test error found - save the configuration
: 164 | 6895.33 6437.94 0.00454167 0.000500923 197983 0
: 165 Minimum Test error found - save the configuration
: 165 | 6832.18 6378.38 0.004566 0.000500503 196778 0
: 166 Minimum Test error found - save the configuration
: 166 | 6770.14 6322.92 0.00449176 0.000497133 200269 0
: 167 Minimum Test error found - save the configuration
: 167 | 6707.07 6266.24 0.0045532 0.000503833 197562 0
: 168 Minimum Test error found - save the configuration
: 168 | 6646.49 6204.8 0.00451954 0.000492352 198650 0
: 169 Minimum Test error found - save the configuration
: 169 | 6584.81 6150.22 0.00457304 0.000515414 197160 0
: 170 Minimum Test error found - save the configuration
: 170 | 6524.85 6091.51 0.00446638 0.000488833 201129 0
: 171 Minimum Test error found - save the configuration
: 171 | 6465.07 6032.42 0.00526312 0.000526853 168909 0
: 172 Minimum Test error found - save the configuration
: 172 | 6406.22 5976.04 0.00448531 0.000482061 199838 0
: 173 Minimum Test error found - save the configuration
: 173 | 6346.21 5926.35 0.00454185 0.000518993 198864 0
: 174 Minimum Test error found - save the configuration
: 174 | 6289.4 5861.65 0.00473147 0.000526543 190253 0
: 175 Minimum Test error found - save the configuration
: 175 | 6230.69 5819.24 0.00464457 0.000512594 193612 0
: 176 Minimum Test error found - save the configuration
: 176 | 6173.91 5760.82 0.00496726 0.000520123 179891 0
: 177 Minimum Test error found - save the configuration
: 177 | 6116.95 5703.12 0.00454634 0.000492913 197364 0
: 178 Minimum Test error found - save the configuration
: 178 | 6060.6 5652.42 0.00459094 0.000505713 195828 0
: 179 Minimum Test error found - save the configuration
: 179 | 6004.52 5600.33 0.00455057 0.000540042 199475 0
: 180 Minimum Test error found - save the configuration
: 180 | 5949.79 5546.12 0.00461831 0.000494533 193997 0
: 181 Minimum Test error found - save the configuration
: 181 | 5894.44 5498.08 0.0044378 0.000495554 202930 0
: 182 Minimum Test error found - save the configuration
: 182 | 5841.11 5443.46 0.00446607 0.000485943 200998 0
: 183 Minimum Test error found - save the configuration
: 183 | 5787.11 5394.44 0.00447222 0.000495663 201179 0
: 184 Minimum Test error found - save the configuration
: 184 | 5734.61 5340.89 0.00458939 0.000538003 197463 0
: 185 Minimum Test error found - save the configuration
: 185 | 5680.51 5291.53 0.00464529 0.000536894 194723 0
: 186 Minimum Test error found - save the configuration
: 186 | 5627.85 5240.27 0.00471577 0.000509784 190205 0
: 187 Minimum Test error found - save the configuration
: 187 | 5577.62 5193.14 0.00478285 0.000534703 188318 0
: 188 Minimum Test error found - save the configuration
: 188 | 5525.49 5143.96 0.00464622 0.000488492 192413 0
: 189 Minimum Test error found - save the configuration
: 189 | 5474.26 5100.34 0.00472674 0.000497833 189174 0
: 190 Minimum Test error found - save the configuration
: 190 | 5423.45 5046.88 0.00447017 0.000503052 201657 0
: 191 Minimum Test error found - save the configuration
: 191 | 5374.69 5008.42 0.00437224 0.000491973 206172 0
: 192 Minimum Test error found - save the configuration
: 192 | 5325.55 4951.9 0.00447838 0.000504833 201332 0
: 193 Minimum Test error found - save the configuration
: 193 | 5274.84 4914.04 0.0044491 0.000486503 201888 0
: 194 Minimum Test error found - save the configuration
: 194 | 5226.91 4860.41 0.00444453 0.000483353 201960 0
: 195 Minimum Test error found - save the configuration
: 195 | 5178.47 4819.88 0.004411 0.000489083 203982 0
: 196 Minimum Test error found - save the configuration
: 196 | 5131.28 4774.74 0.00434997 0.000506243 208131 0
: 197 Minimum Test error found - save the configuration
: 197 | 5083.93 4724.99 0.00442718 0.000487123 203043 0
: 198 Minimum Test error found - save the configuration
: 198 | 5036.88 4681.31 0.00443014 0.000485433 202804 0
: 199 Minimum Test error found - save the configuration
: 199 | 4989.79 4643.88 0.00446241 0.000485433 201158 0
: 200 Minimum Test error found - save the configuration
: 200 | 4944.66 4594.55 0.00435971 0.000500673 207305 0
: 201 Minimum Test error found - save the configuration
: 201 | 4898.58 4557.29 0.00456334 0.000518622 197789 0
: 202 Minimum Test error found - save the configuration
: 202 | 4853.11 4508.75 0.00475944 0.000538303 189523 0
: 203 Minimum Test error found - save the configuration
: 203 | 4809.2 4466.8 0.00485745 0.000495823 183418 0
: 204 Minimum Test error found - save the configuration
: 204 | 4764.61 4426.89 0.00459026 0.000491602 195186 0
: 205 Minimum Test error found - save the configuration
: 205 | 4721.26 4383.35 0.00459631 0.000526523 196571 0
: 206 Minimum Test error found - save the configuration
: 206 | 4677.06 4339.52 0.00470004 0.000533833 192021 0
: 207 Minimum Test error found - save the configuration
: 207 | 4634.62 4306.51 0.00486871 0.000533704 184544 0
: 208 Minimum Test error found - save the configuration
: 208 | 4591.22 4267.02 0.00458682 0.000529024 197152 0
: 209 Minimum Test error found - save the configuration
: 209 | 4549.44 4224.91 0.00461355 0.000547054 196730 0
: 210 Minimum Test error found - save the configuration
: 210 | 4507.52 4187.07 0.00456592 0.000498123 196667 0
: 211 Minimum Test error found - save the configuration
: 211 | 4466.97 4139.94 0.00455756 0.000512603 197777 0
: 212 Minimum Test error found - save the configuration
: 212 | 4424.82 4109.75 0.004562 0.000499253 196911 0
: 213 Minimum Test error found - save the configuration
: 213 | 4383.99 4066.42 0.00454365 0.000483772 197050 0
: 214 Minimum Test error found - save the configuration
: 214 | 4344.16 4027.58 0.00459738 0.000511973 195819 0
: 215 Minimum Test error found - save the configuration
: 215 | 4303.92 3992.19 0.00448854 0.000487843 199965 0
: 216 Minimum Test error found - save the configuration
: 216 | 4264.87 3958.25 0.00460627 0.000497313 194697 0
: 217 Minimum Test error found - save the configuration
: 217 | 4225.39 3916.48 0.00472103 0.000538494 191272 0
: 218 Minimum Test error found - save the configuration
: 218 | 4186.29 3881.66 0.0046581 0.000540823 194303 0
: 219 Minimum Test error found - save the configuration
: 219 | 4148.42 3846.58 0.00465948 0.000505243 192575 0
: 220 Minimum Test error found - save the configuration
: 220 | 4110.27 3809.75 0.00496207 0.000522074 180180 0
: 221 Minimum Test error found - save the configuration
: 221 | 4072.58 3776.99 0.00451414 0.000491672 198883 0
: 222 Minimum Test error found - save the configuration
: 222 | 4035.48 3739.36 0.00453878 0.000506693 198409 0
: 223 Minimum Test error found - save the configuration
: 223 | 3998.55 3702.04 0.00452435 0.000497963 198689 0
: 224 Minimum Test error found - save the configuration
: 224 | 3962.46 3667.23 0.00443391 0.000482952 202483 0
: 225 Minimum Test error found - save the configuration
: 225 | 3925.32 3635.27 0.00435493 0.000478183 206358 0
: 226 Minimum Test error found - save the configuration
: 226 | 3890.36 3597.93 0.00447233 0.000585214 205808 0
: 227 Minimum Test error found - save the configuration
: 227 | 3854.49 3563.9 0.0043607 0.000475413 205905 0
: 228 Minimum Test error found - save the configuration
: 228 | 3819.52 3531.37 0.00435352 0.000513573 208336 0
: 229 Minimum Test error found - save the configuration
: 229 | 3783.75 3497.51 0.00469684 0.000586414 194627 0
: 230 Minimum Test error found - save the configuration
: 230 | 3749.39 3465.33 0.0048036 0.000551153 188127 0
: 231 Minimum Test error found - save the configuration
: 231 | 3716.28 3431.4 0.0046939 0.000495143 190533 0
: 232 Minimum Test error found - save the configuration
: 232 | 3681.73 3401.35 0.00455247 0.000486072 196735 0
: 233 Minimum Test error found - save the configuration
: 233 | 3648.8 3369.23 0.00459231 0.000547414 197780 0
: 234 Minimum Test error found - save the configuration
: 234 | 3615.37 3337.28 0.00461823 0.000492443 193903 0
: 235 Minimum Test error found - save the configuration
: 235 | 3582.64 3305.33 0.00457303 0.000489373 195903 0
: 236 Minimum Test error found - save the configuration
: 236 | 3549.83 3274.28 0.00467073 0.000492643 191475 0
: 237 Minimum Test error found - save the configuration
: 237 | 3517.1 3245.01 0.00447792 0.000511104 201673 0
: 238 Minimum Test error found - save the configuration
: 238 | 3486.57 3212.79 0.00447729 0.000499052 201094 0
: 239 Minimum Test error found - save the configuration
: 239 | 3454.34 3182.66 0.00455967 0.000493553 196748 0
: 240 Minimum Test error found - save the configuration
: 240 | 3421.93 3154.4 0.00436327 0.000483161 206180 0
: 241 Minimum Test error found - save the configuration
: 241 | 3392.32 3124.18 0.00433035 0.000473543 207426 0
: 242 Minimum Test error found - save the configuration
: 242 | 3361.04 3094.04 0.00435279 0.000477592 206441 0
: 243 Minimum Test error found - save the configuration
: 243 | 3331.15 3065.15 0.00434977 0.000481563 206814 0
: 244 Minimum Test error found - save the configuration
: 244 | 3299.82 3036.85 0.00440299 0.000480323 203943 0
: 245 Minimum Test error found - save the configuration
: 245 | 3270.12 3009.58 0.00449044 0.000504203 200691 0
: 246 Minimum Test error found - save the configuration
: 246 | 3241.09 2978.94 0.00445147 0.000493433 202121 0
: 247 Minimum Test error found - save the configuration
: 247 | 3210.86 2953.49 0.00448242 0.000515933 201690 0
: 248 Minimum Test error found - save the configuration
: 248 | 3181.77 2924.58 0.00444333 0.000473023 201495 0
: 249 Minimum Test error found - save the configuration
: 249 | 3153.52 2898.35 0.00432997 0.000472442 207386 0
: 250 Minimum Test error found - save the configuration
: 250 | 3124.62 2870.01 0.00442371 0.000499433 203859 0
: 251 Minimum Test error found - save the configuration
: 251 | 3096.73 2843.33 0.00444049 0.000478752 201932 0
: 252 Minimum Test error found - save the configuration
: 252 | 3067.86 2816.86 0.00445513 0.000487303 201621 0
: 253 Minimum Test error found - save the configuration
: 253 | 3040.63 2792.67 0.00465122 0.000532504 194235 0
: 254 Minimum Test error found - save the configuration
: 254 | 3012.76 2765.76 0.00459005 0.000500703 195630 0
: 255 Minimum Test error found - save the configuration
: 255 | 2985.4 2740.31 0.00458744 0.000509293 196168 0
: 256 Minimum Test error found - save the configuration
: 256 | 2958.56 2713.69 0.00460075 0.000544403 197222 0
: 257 Minimum Test error found - save the configuration
: 257 | 2931.74 2688.39 0.00458347 0.000496422 195741 0
: 258 Minimum Test error found - save the configuration
: 258 | 2904.89 2663.45 0.00458319 0.000497673 195813 0
: 259 Minimum Test error found - save the configuration
: 259 | 2878.56 2638.5 0.00461605 0.000543153 196421 0
: 260 Minimum Test error found - save the configuration
: 260 | 2852.92 2614.11 0.00461217 0.000508702 194957 0
: 261 Minimum Test error found - save the configuration
: 261 | 2827.18 2589.28 0.004585 0.000495753 195635 0
: 262 Minimum Test error found - save the configuration
: 262 | 2800.86 2566.66 0.00466407 0.000504582 192332 0
: 263 Minimum Test error found - save the configuration
: 263 | 2776.47 2541.57 0.00465096 0.000539503 194578 0
: 264 Minimum Test error found - save the configuration
: 264 | 2750.27 2518.94 0.00492087 0.000619264 185977 0
: 265 Minimum Test error found - save the configuration
: 265 | 2725.74 2495.44 0.00462273 0.000509313 194486 0
: 266 Minimum Test error found - save the configuration
: 266 | 2701.04 2472.84 0.00466958 0.000528204 193173 0
: 267 Minimum Test error found - save the configuration
: 267 | 2677.27 2449.57 0.00455041 0.000497503 197389 0
: 268 Minimum Test error found - save the configuration
: 268 | 2652.25 2427.28 0.00467065 0.000531683 193285 0
: 269 Minimum Test error found - save the configuration
: 269 | 2628.76 2404.97 0.00489286 0.000516853 182815 0
: 270 Minimum Test error found - save the configuration
: 270 | 2604.97 2382.2 0.00472105 0.000545774 191604 0
: 271 Minimum Test error found - save the configuration
: 271 | 2581.6 2359.69 0.00454211 0.000494773 197661 0
: 272 Minimum Test error found - save the configuration
: 272 | 2557.69 2338.16 0.0046036 0.000486242 194300 0
: 273 Minimum Test error found - save the configuration
: 273 | 2534.84 2316.36 0.00437628 0.000482622 205462 0
: 274 Minimum Test error found - save the configuration
: 274 | 2511.62 2295.88 0.00465013 0.000530554 194195 0
: 275 Minimum Test error found - save the configuration
: 275 | 2488.86 2274.18 0.00461343 0.000498623 194420 0
: 276 Minimum Test error found - save the configuration
: 276 | 2466.64 2253.27 0.00461652 0.000519523 195265 0
: 277 Minimum Test error found - save the configuration
: 277 | 2443.73 2232.29 0.00461004 0.000538553 196489 0
: 278 Minimum Test error found - save the configuration
: 278 | 2421.55 2212.7 0.00459717 0.000496372 195084 0
: 279 Minimum Test error found - save the configuration
: 279 | 2400.03 2191.89 0.00464295 0.000520194 194045 0
: 280 Minimum Test error found - save the configuration
: 280 | 2377.79 2171.78 0.00458101 0.000532344 197596 0
: 281 Minimum Test error found - save the configuration
: 281 | 2356.67 2151.81 0.00452547 0.000486613 198076 0
: 282 Minimum Test error found - save the configuration
: 282 | 2334.45 2132.38 0.00460527 0.000564572 197986 0
: 283 Minimum Test error found - save the configuration
: 283 | 2313.54 2112.35 0.00457715 0.000493243 195891 0
: 284 Minimum Test error found - save the configuration
: 284 | 2292.92 2092.19 0.00456643 0.000514592 197441 0
: 285 Minimum Test error found - save the configuration
: 285 | 2271.37 2073.28 0.00458409 0.000495093 195647 0
: 286 Minimum Test error found - save the configuration
: 286 | 2250.92 2053.94 0.00493388 0.000507823 180748 0
: 287 Minimum Test error found - save the configuration
: 287 | 2229.49 2035.64 0.00455765 0.000492293 196785 0
: 288 Minimum Test error found - save the configuration
: 288 | 2210.1 2016.2 0.00456661 0.000515332 197469 0
: 289 Minimum Test error found - save the configuration
: 289 | 2189.31 1997.41 0.00462004 0.000517483 195000 0
: 290 Minimum Test error found - save the configuration
: 290 | 2168.79 1979.89 0.00477147 0.000589493 191297 0
: 291 Minimum Test error found - save the configuration
: 291 | 2149.12 1961.87 0.00456933 0.000517853 197459 0
: 292 Minimum Test error found - save the configuration
: 292 | 2129.34 1943.95 0.00462384 0.000518182 194853 0
: 293 Minimum Test error found - save the configuration
: 293 | 2109.88 1926.27 0.00453345 0.000496933 198191 0
: 294 Minimum Test error found - save the configuration
: 294 | 2090.65 1908.33 0.00455063 0.000535943 199269 0
: 295 Minimum Test error found - save the configuration
: 295 | 2070.76 1891.3 0.00457893 0.000502063 196229 0
: 296 Minimum Test error found - save the configuration
: 296 | 2052.12 1873.6 0.00460263 0.000515933 195757 0
: 297 Minimum Test error found - save the configuration
: 297 | 2032.85 1856.51 0.00456295 0.000486313 196240 0
: 298 Minimum Test error found - save the configuration
: 298 | 2014.04 1840.04 0.00456872 0.000518563 197523 0
: 299 Minimum Test error found - save the configuration
: 299 | 1995.34 1823.38 0.00460223 0.000518533 195901 0
: 300 Minimum Test error found - save the configuration
: 300 | 1977.46 1805.84 0.00452176 0.000496922 198766 0
: 301 Minimum Test error found - save the configuration
: 301 | 1958.83 1788.79 0.00452896 0.000508633 198989 0
: 302 Minimum Test error found - save the configuration
: 302 | 1940.17 1772.85 0.00460204 0.000531723 196545 0
: 303 Minimum Test error found - save the configuration
: 303 | 1922.56 1756.42 0.00466008 0.000508402 192693 0
: 304 Minimum Test error found - save the configuration
: 304 | 1904.35 1740.26 0.00458717 0.000515003 196456 0
: 305 Minimum Test error found - save the configuration
: 305 | 1886.99 1724.15 0.00461809 0.000515653 195006 0
: 306 Minimum Test error found - save the configuration
: 306 | 1868.66 1708.81 0.00456221 0.000506232 197240 0
: 307 Minimum Test error found - save the configuration
: 307 | 1851.43 1693.68 0.00482951 0.000533112 186203 0
: 308 Minimum Test error found - save the configuration
: 308 | 1834.66 1677.31 0.00511146 0.000529013 174579 0
: 309 Minimum Test error found - save the configuration
: 309 | 1816.85 1663.13 0.00457512 0.000498203 196227 0
: 310 Minimum Test error found - save the configuration
: 310 | 1800.12 1647.4 0.00460338 0.000524563 196135 0
: 311 Minimum Test error found - save the configuration
: 311 | 1783.16 1632.34 0.00458638 0.000557275 198555 0
: 312 Minimum Test error found - save the configuration
: 312 | 1766.07 1617.79 0.00488919 0.000521704 183172 0
: 313 Minimum Test error found - save the configuration
: 313 | 1750.49 1602.28 0.00455612 0.000505793 197515 0
: 314 Minimum Test error found - save the configuration
: 314 | 1732.59 1588.52 0.00458357 0.000501782 195993 0
: 315 Minimum Test error found - save the configuration
: 315 | 1716.86 1573.48 0.00461652 0.000501082 194390 0
: 316 Minimum Test error found - save the configuration
: 316 | 1700.99 1558.97 0.00455618 0.000513733 197900 0
: 317 Minimum Test error found - save the configuration
: 317 | 1684.3 1545.03 0.00459589 0.000530133 196766 0
: 318 Minimum Test error found - save the configuration
: 318 | 1668.64 1531.07 0.00461524 0.000507853 194771 0
: 319 Minimum Test error found - save the configuration
: 319 | 1652.91 1516.73 0.00457138 0.000513073 197127 0
: 320 Minimum Test error found - save the configuration
: 320 | 1637.36 1502.74 0.00460077 0.000542833 197145 0
: 321 Minimum Test error found - save the configuration
: 321 | 1621.23 1489.32 0.00463791 0.000511553 193876 0
: 322 Minimum Test error found - save the configuration
: 322 | 1606.36 1475.21 0.00468635 0.000597914 195674 0
: 323 Minimum Test error found - save the configuration
: 323 | 1590.91 1461.6 0.00458523 0.000520024 196792 0
: 324 Minimum Test error found - save the configuration
: 324 | 1575.78 1448.33 0.00451165 0.000491733 199009 0
: 325 Minimum Test error found - save the configuration
: 325 | 1560.63 1435.35 0.00461656 0.000502874 194473 0
: 326 Minimum Test error found - save the configuration
: 326 | 1546.18 1422.19 0.00459195 0.000497413 195382 0
: 327 Minimum Test error found - save the configuration
: 327 | 1531.17 1409.3 0.00458915 0.000510343 196136 0
: 328 Minimum Test error found - save the configuration
: 328 | 1516.4 1396.01 0.00459069 0.000501993 195661 0
: 329 Minimum Test error found - save the configuration
: 329 | 1502.17 1382.83 0.00455243 0.000525333 198654 0
: 330 Minimum Test error found - save the configuration
: 330 | 1487.7 1369.78 0.00489654 0.000499283 181932 0
: 331 Minimum Test error found - save the configuration
: 331 | 1473.02 1357.34 0.00465562 0.000538893 194329 0
: 332 Minimum Test error found - save the configuration
: 332 | 1459.33 1344.91 0.00457072 0.000494862 196278 0
: 333 Minimum Test error found - save the configuration
: 333 | 1445.1 1332.58 0.0046891 0.000497923 190877 0
: 334 Minimum Test error found - save the configuration
: 334 | 1431.53 1319.96 0.00478529 0.000500933 186726 0
: 335 Minimum Test error found - save the configuration
: 335 | 1417.73 1307.57 0.0050214 0.000673794 184009 0
: 336 Minimum Test error found - save the configuration
: 336 | 1403.53 1296.06 0.00467102 0.000510423 192280 0
: 337 Minimum Test error found - save the configuration
: 337 | 1390.69 1283.98 0.00459245 0.000515492 196225 0
: 338 Minimum Test error found - save the configuration
: 338 | 1376.7 1272.85 0.00458502 0.000503973 196028 0
: 339 Minimum Test error found - save the configuration
: 339 | 1364.4 1259.94 0.00460271 0.000499002 194946 0
: 340 Minimum Test error found - save the configuration
: 340 | 1350.5 1248.71 0.00457981 0.000510552 196596 0
: 341 Minimum Test error found - save the configuration
: 341 | 1337.44 1237.51 0.00464389 0.000531993 194558 0
: 342 Minimum Test error found - save the configuration
: 342 | 1325.18 1225.58 0.0045816 0.000518043 196872 0
: 343 Minimum Test error found - save the configuration
: 343 | 1312.34 1213.92 0.00458012 0.000499673 196057 0
: 344 Minimum Test error found - save the configuration
: 344 | 1299.06 1203.33 0.00469207 0.000545693 192940 0
: 345 Minimum Test error found - save the configuration
: 345 | 1287.06 1191.75 0.00462303 0.000514763 194730 0
: 346 Minimum Test error found - save the configuration
: 346 | 1274.21 1180.9 0.00460527 0.000508422 195272 0
: 347 Minimum Test error found - save the configuration
: 347 | 1262.1 1170.12 0.00459553 0.000516302 196116 0
: 348 Minimum Test error found - save the configuration
: 348 | 1250.18 1158.95 0.00459092 0.000523753 196697 0
: 349 Minimum Test error found - save the configuration
: 349 | 1238.31 1147.87 0.0046207 0.000523362 195249 0
: 350 Minimum Test error found - save the configuration
: 350 | 1225.97 1137.51 0.00460805 0.000505633 195007 0
: 351 Minimum Test error found - save the configuration
: 351 | 1214.27 1126.3 0.00461468 0.000547693 196706 0
: 352 Minimum Test error found - save the configuration
: 352 | 1202.43 1115.69 0.00489086 0.000509072 182574 0
: 353 Minimum Test error found - save the configuration
: 353 | 1190.55 1105.88 0.00464698 0.000543544 194959 0
: 354 Minimum Test error found - save the configuration
: 354 | 1179.55 1095.09 0.004596 0.000489113 194795 0
: 355 Minimum Test error found - save the configuration
: 355 | 1167.93 1084.62 0.00492855 0.000524203 181639 0
: 356 Minimum Test error found - save the configuration
: 356 | 1156.34 1074.86 0.00457985 0.000511053 196618 0
: 357 Minimum Test error found - save the configuration
: 357 | 1145.34 1064.51 0.00483581 0.000524513 185559 0
: 358 Minimum Test error found - save the configuration
: 358 | 1134.32 1054.2 0.00464139 0.000492713 192833 0
: 359 Minimum Test error found - save the configuration
: 359 | 1123.59 1043.94 0.00459356 0.000527372 196745 0
: 360 Minimum Test error found - save the configuration
: 360 | 1112.07 1034.73 0.004576 0.000498183 196184 0
: 361 Minimum Test error found - save the configuration
: 361 | 1101.34 1025.55 0.00456875 0.000497443 196497 0
: 362 Minimum Test error found - save the configuration
: 362 | 1091 1015.07 0.00472895 0.000523663 190237 0
: 363 Minimum Test error found - save the configuration
: 363 | 1080.26 1005.24 0.00462467 0.000515453 194684 0
: 364 Minimum Test error found - save the configuration
: 364 | 1069.32 995.939 0.0045934 0.000518933 196345 0
: 365 Minimum Test error found - save the configuration
: 365 | 1059.32 985.936 0.00456825 0.000496963 196498 0
: 366 Minimum Test error found - save the configuration
: 366 | 1049.15 976.432 0.00463784 0.000539754 195213 0
: 367 Minimum Test error found - save the configuration
: 367 | 1038.4 967.469 0.0046298 0.000521783 194741 0
: 368 Minimum Test error found - save the configuration
: 368 | 1028.38 958.102 0.00461827 0.000503732 194433 0
: 369 Minimum Test error found - save the configuration
: 369 | 1018.32 949.003 0.00460573 0.000515143 195571 0
: 370 Minimum Test error found - save the configuration
: 370 | 1008.21 939.876 0.0047024 0.000544563 192408 0
: 371 Minimum Test error found - save the configuration
: 371 | 998.717 931.055 0.00466271 0.000532433 193692 0
: 372 Minimum Test error found - save the configuration
: 372 | 989.07 922.172 0.00462856 0.000508353 194165 0
: 373 Minimum Test error found - save the configuration
: 373 | 979.221 913.295 0.00505665 0.000605454 179727 0
: 374 Minimum Test error found - save the configuration
: 374 | 969.565 904.754 0.00459704 0.000507073 195601 0
: 375 Minimum Test error found - save the configuration
: 375 | 960.156 896.012 0.00457352 0.000511863 196964 0
: 376 Minimum Test error found - save the configuration
: 376 | 950.684 887.002 0.0045952 0.000514263 196034 0
: 377 Minimum Test error found - save the configuration
: 377 | 941.423 878.159 0.00466042 0.000516213 193041 0
: 378 Minimum Test error found - save the configuration
: 378 | 931.974 869.953 0.00455748 0.000488823 196625 0
: 379 Minimum Test error found - save the configuration
: 379 | 922.794 861.654 0.00464465 0.000529173 194388 0
: 380 Minimum Test error found - save the configuration
: 380 | 913.615 853.179 0.00459216 0.000516303 196278 0
: 381 Minimum Test error found - save the configuration
: 381 | 904.693 844.652 0.00458396 0.000495473 195672 0
: 382 Minimum Test error found - save the configuration
: 382 | 895.549 836.883 0.00463073 0.000546963 195898 0
: 383 Minimum Test error found - save the configuration
: 383 | 887.017 828.448 0.00461611 0.000487802 193784 0
: 384 Minimum Test error found - save the configuration
: 384 | 878.387 820.018 0.00461926 0.000564043 197277 0
: 385 Minimum Test error found - save the configuration
: 385 | 869.244 812.497 0.00457933 0.000495713 195905 0
: 386 Minimum Test error found - save the configuration
: 386 | 861.212 804.135 0.00462707 0.000505862 194118 0
: 387 Minimum Test error found - save the configuration
: 387 | 852.033 796.661 0.00465363 0.000559024 195379 0
: 388 Minimum Test error found - save the configuration
: 388 | 843.725 789.242 0.00459926 0.000495302 194934 0
: 389 Minimum Test error found - save the configuration
: 389 | 835.822 780.874 0.00462135 0.000501493 194182 0
: 390 Minimum Test error found - save the configuration
: 390 | 827.249 773.573 0.00455554 0.000495043 197020 0
: 391 Minimum Test error found - save the configuration
: 391 | 818.787 766.105 0.00452466 0.000501252 198836 0
: 392 Minimum Test error found - save the configuration
: 392 | 811.242 757.675 0.00460729 0.000524903 195964 0
: 393 Minimum Test error found - save the configuration
: 393 | 802.298 750.793 0.00455606 0.000495513 197018 0
: 394 Minimum Test error found - save the configuration
: 394 | 795.018 743.185 0.00457614 0.000514963 196987 0
: 395 Minimum Test error found - save the configuration
: 395 | 787.042 735.694 0.00492088 0.000558323 183379 0
: 396 Minimum Test error found - save the configuration
: 396 | 778.799 728.564 0.00458744 0.000499833 195714 0
: 397 Minimum Test error found - save the configuration
: 397 | 771.728 721.417 0.0045753 0.000498902 196252 0
: 398 Minimum Test error found - save the configuration
: 398 | 763.399 713.814 0.00481355 0.000509062 185853 0
: 399 Minimum Test error found - save the configuration
: 399 | 755.512 707.163 0.00458031 0.000521332 197094 0
: 400 Minimum Test error found - save the configuration
: 400 | 748.368 699.869 0.00460636 0.000505013 195058 0
: 401 Minimum Test error found - save the configuration
: 401 | 740.891 692.746 0.00457297 0.000495283 196190 0
: 402 Minimum Test error found - save the configuration
: 402 | 733.364 685.822 0.00461391 0.000502033 194558 0
: 403 Minimum Test error found - save the configuration
: 403 | 725.897 678.698 0.00453639 0.000503393 198364 0
: 404 Minimum Test error found - save the configuration
: 404 | 718.57 671.864 0.00460236 0.000497843 194907 0
: 405 Minimum Test error found - save the configuration
: 405 | 711.257 665.198 0.00465513 0.000509603 192979 0
: 406 Minimum Test error found - save the configuration
: 406 | 704.226 658.665 0.00465907 0.000599364 197059 0
: 407 Minimum Test error found - save the configuration
: 407 | 697.238 652.111 0.00465833 0.000577483 196038 0
: 408 Minimum Test error found - save the configuration
: 408 | 690.138 645.4 0.00474729 0.000509893 188795 0
: 409 Minimum Test error found - save the configuration
: 409 | 683.482 638.166 0.0044207 0.000485853 203312 0
: 410 Minimum Test error found - save the configuration
: 410 | 676.109 632.139 0.00441296 0.000486403 203741 0
: 411 Minimum Test error found - save the configuration
: 411 | 669.19 625.738 0.00445388 0.000483822 201509 0
: 412 Minimum Test error found - save the configuration
: 412 | 662.601 619.636 0.00459153 0.000504033 195719 0
: 413 Minimum Test error found - save the configuration
: 413 | 655.56 612.707 0.00477182 0.000583145 190991 0
: 414 Minimum Test error found - save the configuration
: 414 | 648.922 606.638 0.00503637 0.000503403 176485 0
: 415 Minimum Test error found - save the configuration
: 415 | 642.472 600.036 0.00496147 0.000497993 179233 0
: 416 Minimum Test error found - save the configuration
: 416 | 635.818 593.846 0.00434483 0.000474293 206689 0
: 417 Minimum Test error found - save the configuration
: 417 | 629.172 587.958 0.00434275 0.000476034 206894 0
: 418 Minimum Test error found - save the configuration
: 418 | 623.037 581.639 0.00439224 0.000483623 204676 0
: 419 Minimum Test error found - save the configuration
: 419 | 616.41 576.67 0.00435928 0.000473362 205871 0
: 420 Minimum Test error found - save the configuration
: 420 | 610.583 569.672 0.00450103 0.000489033 199402 0
: 421 Minimum Test error found - save the configuration
: 421 | 603.914 563.949 0.0044202 0.000471743 202611 0
: 422 Minimum Test error found - save the configuration
: 422 | 597.816 558.33 0.00465876 0.000501853 192451 0
: 423 Minimum Test error found - save the configuration
: 423 | 591.894 551.762 0.00441982 0.000481853 203151 0
: 424 Minimum Test error found - save the configuration
: 424 | 585.739 546.31 0.00442429 0.000502453 203986 0
: 425 Minimum Test error found - save the configuration
: 425 | 579.619 541.326 0.00445165 0.000479154 201385 0
: 426 Minimum Test error found - save the configuration
: 426 | 573.694 535.163 0.00459065 0.000485592 194882 0
: 427 Minimum Test error found - save the configuration
: 427 | 567.492 529.992 0.00439406 0.000473383 204046 0
: 428 Minimum Test error found - save the configuration
: 428 | 562.193 523.77 0.00436076 0.000473983 205826 0
: 429 Minimum Test error found - save the configuration
: 429 | 555.925 518.227 0.00444924 0.000488152 201965 0
: 430 Minimum Test error found - save the configuration
: 430 | 550.377 512.97 0.00439385 0.000482022 204508 0
: 431 Minimum Test error found - save the configuration
: 431 | 544.837 507.414 0.00442401 0.000493343 203528 0
: 432 Minimum Test error found - save the configuration
: 432 | 539.194 501.687 0.0046949 0.000512453 191276 0
: 433 Minimum Test error found - save the configuration
: 433 | 533.152 497.067 0.0044901 0.000488373 199914 0
: 434 Minimum Test error found - save the configuration
: 434 | 527.915 491.32 0.00446549 0.000483473 200903 0
: 435 Minimum Test error found - save the configuration
: 435 | 522.428 485.955 0.00440618 0.000482092 203869 0
: 436 Minimum Test error found - save the configuration
: 436 | 516.896 481.152 0.00446496 0.000495503 201539 0
: 437 Minimum Test error found - save the configuration
: 437 | 511.37 476.17 0.00451399 0.000498013 199205 0
: 438 Minimum Test error found - save the configuration
: 438 | 506.623 471.018 0.00444053 0.000482352 202113 0
: 439 Minimum Test error found - save the configuration
: 439 | 501.085 466.274 0.00453846 0.000501563 198172 0
: 440 Minimum Test error found - save the configuration
: 440 | 495.949 460.651 0.00444147 0.000494643 202695 0
: 441 Minimum Test error found - save the configuration
: 441 | 490.649 456.103 0.00473764 0.000492123 188434 0
: 442 Minimum Test error found - save the configuration
: 442 | 485.61 450.888 0.0044327 0.000491273 202972 0
: 443 Minimum Test error found - save the configuration
: 443 | 480.748 446.021 0.00438125 0.000478133 204964 0
: 444 Minimum Test error found - save the configuration
: 444 | 475.336 441.03 0.00438969 0.000481952 204722 0
: 445 Minimum Test error found - save the configuration
: 445 | 470.531 436.564 0.00441713 0.000481733 203283 0
: 446 Minimum Test error found - save the configuration
: 446 | 465.607 431.706 0.00442444 0.000476221 202623 0
: 447 Minimum Test error found - save the configuration
: 447 | 460.927 427.011 0.00456131 0.000500843 197022 0
: 448 Minimum Test error found - save the configuration
: 448 | 456.008 422.175 0.00448776 0.000490313 200128 0
: 449 Minimum Test error found - save the configuration
: 449 | 451.18 418.097 0.00443726 0.000493933 202875 0
: 450 Minimum Test error found - save the configuration
: 450 | 446.744 413.336 0.00445365 0.000480843 201369 0
: 451 Minimum Test error found - save the configuration
: 451 | 441.71 408.843 0.00442719 0.000494353 203416 0
: 452 Minimum Test error found - save the configuration
: 452 | 437.309 404.342 0.00439831 0.000481693 204258 0
: 453 Minimum Test error found - save the configuration
: 453 | 432.933 399.697 0.00472222 0.000535253 191069 0
: 454 Minimum Test error found - save the configuration
: 454 | 427.924 395.867 0.00474713 0.000497643 188258 0
: 455 Minimum Test error found - save the configuration
: 455 | 423.732 391.571 0.00457121 0.000505673 196776 0
: 456 Minimum Test error found - save the configuration
: 456 | 419.244 387.19 0.0047948 0.000504282 186458 0
: 457 Minimum Test error found - save the configuration
: 457 | 414.729 382.962 0.00438203 0.000475842 204804 0
: 458 Minimum Test error found - save the configuration
: 458 | 410.369 379.113 0.00438936 0.000500702 205727 0
: 459 Minimum Test error found - save the configuration
: 459 | 406.276 374.374 0.0043593 0.000476493 206037 0
: 460 Minimum Test error found - save the configuration
: 460 | 402.124 370.172 0.00436889 0.000479313 205678 0
: 461 Minimum Test error found - save the configuration
: 461 | 397.539 366.335 0.00466779 0.000680614 200643 0
: 462 Minimum Test error found - save the configuration
: 462 | 393.466 362.321 0.00574309 0.000520643 153185 0
: 463 Minimum Test error found - save the configuration
: 463 | 389.324 358.097 0.00455716 0.000523783 198345 0
: 464 Minimum Test error found - save the configuration
: 464 | 385.304 353.784 0.00458561 0.000499373 195779 0
: 465 Minimum Test error found - save the configuration
: 465 | 380.968 350.295 0.0046246 0.000499253 193923 0
: 466 Minimum Test error found - save the configuration
: 466 | 376.985 346.14 0.0046176 0.000492533 193936 0
: 467 Minimum Test error found - save the configuration
: 467 | 372.969 342.291 0.00443147 0.000494862 203220 0
: 468 Minimum Test error found - save the configuration
: 468 | 369.104 338.586 0.0044295 0.000490453 203095 0
: 469 Minimum Test error found - save the configuration
: 469 | 365.206 334.71 0.00469722 0.000512013 191150 0
: 470 Minimum Test error found - save the configuration
: 470 | 361.188 330.859 0.00447341 0.000528763 202806 0
: 471 Minimum Test error found - save the configuration
: 471 | 357.572 327.389 0.00462919 0.000517323 194559 0
: 472 Minimum Test error found - save the configuration
: 472 | 353.685 323.739 0.00449604 0.000489783 199688 0
: 473 Minimum Test error found - save the configuration
: 473 | 349.896 319.946 0.00474817 0.000495602 188122 0
: 474 Minimum Test error found - save the configuration
: 474 | 346.413 316.485 0.00446896 0.000498733 201500 0
: 475 Minimum Test error found - save the configuration
: 475 | 342.673 313.657 0.00455659 0.000531543 198756 0
: 476 Minimum Test error found - save the configuration
: 476 | 339.078 309.879 0.00455737 0.000492833 196825 0
: 477 Minimum Test error found - save the configuration
: 477 | 335.516 306.267 0.00453327 0.000500062 198353 0
: 478 Minimum Test error found - save the configuration
: 478 | 331.685 303.083 0.00452601 0.000500163 198716 0
: 479 Minimum Test error found - save the configuration
: 479 | 328.384 299.251 0.00456238 0.000547003 199234 0
: 480 Minimum Test error found - save the configuration
: 480 | 324.548 295.968 0.00474421 0.000626263 194272 0
: 481 Minimum Test error found - save the configuration
: 481 | 321.189 292.211 0.00460432 0.000495683 194712 0
: 482 Minimum Test error found - save the configuration
: 482 | 317.514 288.776 0.0045566 0.000487453 196602 0
: 483 Minimum Test error found - save the configuration
: 483 | 314.121 285.576 0.00446674 0.000489102 201125 0
: 484 Minimum Test error found - save the configuration
: 484 | 310.767 282.241 0.00452171 0.000495813 198714 0
: 485 Minimum Test error found - save the configuration
: 485 | 307.782 278.767 0.00447084 0.000492903 201110 0
: 486 Minimum Test error found - save the configuration
: 486 | 304.099 275.782 0.00451189 0.000498213 199319 0
: 487 Minimum Test error found - save the configuration
: 487 | 300.773 272.841 0.00511176 0.000499063 173434 0
: 488 Minimum Test error found - save the configuration
: 488 | 297.611 269.574 0.00448471 0.000517352 201646 0
: 489 Minimum Test error found - save the configuration
: 489 | 294.575 266.524 0.00440523 0.000479223 203770 0
: 490 Minimum Test error found - save the configuration
: 490 | 291.364 263.572 0.00438798 0.000482753 204854 0
: 491 Minimum Test error found - save the configuration
: 491 | 288.515 260.521 0.00494543 0.000702664 188556 0
: 492 Minimum Test error found - save the configuration
: 492 | 285.061 257.321 0.00497487 0.000495403 178593 0
: 493 Minimum Test error found - save the configuration
: 493 | 282.12 254.489 0.00462021 0.000511942 194729 0
: 494 Minimum Test error found - save the configuration
: 494 | 279.001 251.9 0.00459965 0.000521742 196179 0
: 495 Minimum Test error found - save the configuration
: 495 | 275.646 248.657 0.00457404 0.000501552 196440 0
: 496 Minimum Test error found - save the configuration
: 496 | 272.817 245.773 0.00456283 0.000491123 196478 0
: 497 Minimum Test error found - save the configuration
: 497 | 269.924 243.115 0.00479352 0.000647144 192940 0
: 498 Minimum Test error found - save the configuration
: 498 | 266.958 240.154 0.00569978 0.000732125 161042 0
: 499 Minimum Test error found - save the configuration
: 499 | 263.925 237.287 0.00640335 0.000712703 140582 0
: 500 Minimum Test error found - save the configuration
: 500 | 260.913 234.649 0.00637856 0.000697134 140810 0
: 501 Minimum Test error found - save the configuration
: 501 | 258.082 231.963 0.00637124 0.000709334 141295 0
: 502 Minimum Test error found - save the configuration
: 502 | 255.432 229.278 0.00634215 0.000699965 141789 0
: 503 Minimum Test error found - save the configuration
: 503 | 252.552 226.541 0.00622515 0.000710225 145061 0
: 504 Minimum Test error found - save the configuration
: 504 | 249.749 223.829 0.00561296 0.000480412 155868 0
: 505 Minimum Test error found - save the configuration
: 505 | 246.966 221.856 0.0054903 0.000594363 163401 0
: 506 Minimum Test error found - save the configuration
: 506 | 244.751 218.775 0.00450944 0.000500003 199529 0
: 507 Minimum Test error found - save the configuration
: 507 | 241.608 216.067 0.00456474 0.000564974 200012 0
: 508 Minimum Test error found - save the configuration
: 508 | 239.118 213.583 0.00449564 0.000537932 202137 0
: 509 Minimum Test error found - save the configuration
: 509 | 236.529 211.523 0.00500307 0.000518702 178398 0
: 510 Minimum Test error found - save the configuration
: 510 | 233.749 208.845 0.00447901 0.000512613 201695 0
: 511 Minimum Test error found - save the configuration
: 511 | 231.293 206.757 0.00450463 0.000493953 199468 0
: 512 Minimum Test error found - save the configuration
: 512 | 228.665 204.627 0.00450095 0.000502222 200063 0
: 513 Minimum Test error found - save the configuration
: 513 | 226.532 201.336 0.00453942 0.000527863 199424 0
: 514 Minimum Test error found - save the configuration
: 514 | 223.875 199.825 0.00484765 0.000655534 190835 0
: 515 Minimum Test error found - save the configuration
: 515 | 221.46 197.617 0.00468923 0.000506653 191270 0
: 516 Minimum Test error found - save the configuration
: 516 | 219.01 195.778 0.00475792 0.000508323 188253 0
: 517 Minimum Test error found - save the configuration
: 517 | 216.314 192.78 0.00567766 0.000704234 160855 0
: 518 Minimum Test error found - save the configuration
: 518 | 214.003 190.468 0.00471019 0.000509033 190424 0
: 519 Minimum Test error found - save the configuration
: 519 | 211.653 188.096 0.00446971 0.000485802 200808 0
: 520 Minimum Test error found - save the configuration
: 520 | 209.263 185.922 0.00451054 0.000521232 200536 0
: 521 Minimum Test error found - save the configuration
: 521 | 206.966 183.875 0.00487352 0.000511414 183398 0
: 522 Minimum Test error found - save the configuration
: 522 | 204.769 181.431 0.00490476 0.000581353 185039 0
: 523 Minimum Test error found - save the configuration
: 523 | 202.39 179.399 0.00464533 0.000486842 192378 0
: 524 Minimum Test error found - save the configuration
: 524 | 200.461 178.094 0.00467941 0.000555643 193998 0
: 525 Minimum Test error found - save the configuration
: 525 | 198.128 175.928 0.00467377 0.000525683 192860 0
: 526 Minimum Test error found - save the configuration
: 526 | 195.882 173.3 0.00481404 0.000503693 185600 0
: 527 Minimum Test error found - save the configuration
: 527 | 193.505 171.611 0.00438281 0.000473353 204632 0
: 528 Minimum Test error found - save the configuration
: 528 | 191.347 169.923 0.00471439 0.000507193 190150 0
: 529 Minimum Test error found - save the configuration
: 529 | 189.172 167.866 0.00525195 0.000705293 175953 0
: 530 Minimum Test error found - save the configuration
: 530 | 187.048 165.463 0.00534632 0.000557274 167048 0
: 531 Minimum Test error found - save the configuration
: 531 | 184.995 163.368 0.00501728 0.000619533 181911 0
: 532 Minimum Test error found - save the configuration
: 532 | 182.88 161.23 0.00503927 0.000497342 176137 0
: 533 Minimum Test error found - save the configuration
: 533 | 180.944 159.428 0.00441802 0.000484643 203388 0
: 534 Minimum Test error found - save the configuration
: 534 | 179.046 157.51 0.00441219 0.000482292 203567 0
: 535 Minimum Test error found - save the configuration
: 535 | 176.741 155.772 0.00440701 0.000485412 203999 0
: 536 Minimum Test error found - save the configuration
: 536 | 174.483 154.394 0.00439076 0.000475493 204328 0
: 537 Minimum Test error found - save the configuration
: 537 | 172.87 151.722 0.00440546 0.000483243 203966 0
: 538 Minimum Test error found - save the configuration
: 538 | 170.675 150.395 0.00440612 0.000478313 203676 0
: 539 Minimum Test error found - save the configuration
: 539 | 168.582 148.256 0.00442799 0.000490542 203177 0
: 540 Minimum Test error found - save the configuration
: 540 | 166.847 146.685 0.00440378 0.000486973 204248 0
: 541 Minimum Test error found - save the configuration
: 541 | 164.905 144.924 0.00440054 0.000482182 204167 0
: 542 Minimum Test error found - save the configuration
: 542 | 163.078 142.909 0.00440513 0.000487274 204194 0
: 543 Minimum Test error found - save the configuration
: 543 | 161.003 141.136 0.00440001 0.000485303 204358 0
: 544 Minimum Test error found - save the configuration
: 544 | 159.238 139.52 0.00440814 0.000481863 203755 0
: 545 Minimum Test error found - save the configuration
: 545 | 157.289 138.696 0.00439918 0.000484372 204352 0
: 546 Minimum Test error found - save the configuration
: 546 | 155.71 136.77 0.00441382 0.000480403 203385 0
: 547 Minimum Test error found - save the configuration
: 547 | 154.048 135.567 0.00439863 0.000489782 204664 0
: 548 Minimum Test error found - save the configuration
: 548 | 152.227 133.304 0.0044006 0.000475653 203825 0
: 549 Minimum Test error found - save the configuration
: 549 | 150.156 131.097 0.00439229 0.000482522 204616 0
: 550 Minimum Test error found - save the configuration
: 550 | 148.533 129.691 0.00441256 0.000486363 203760 0
: 551 Minimum Test error found - save the configuration
: 551 | 146.779 128.664 0.00439024 0.000481973 204695 0
: 552 Minimum Test error found - save the configuration
: 552 | 145.137 126.643 0.00439514 0.000478962 204281 0
: 553 Minimum Test error found - save the configuration
: 553 | 143.462 125.904 0.00439935 0.000478173 204021 0
: 554 Minimum Test error found - save the configuration
: 554 | 141.873 124.938 0.00446056 0.000504702 202232 0
: 555 Minimum Test error found - save the configuration
: 555 | 140.114 123.698 0.0044104 0.000494744 204308 0
: 556 Minimum Test error found - save the configuration
: 556 | 138.36 120.644 0.00439898 0.000479433 204105 0
: 557 Minimum Test error found - save the configuration
: 557 | 136.458 119.2 0.00442016 0.000482453 203164 0
: 558 Minimum Test error found - save the configuration
: 558 | 134.732 117.993 0.0044019 0.000477073 203831 0
: 559 Minimum Test error found - save the configuration
: 559 | 133.428 116.602 0.00440089 0.000485152 204304 0
: 560 Minimum Test error found - save the configuration
: 560 | 131.827 114.901 0.00441862 0.000483913 203319 0
: 561 Minimum Test error found - save the configuration
: 561 | 130.249 113.561 0.00439868 0.000481132 204210 0
: 562 Minimum Test error found - save the configuration
: 562 | 128.686 112.011 0.00443453 0.000493593 202998 0
: 563 Minimum Test error found - save the configuration
: 563 | 127.359 111.568 0.00440631 0.000478412 203671 0
: 564 Minimum Test error found - save the configuration
: 564 | 125.895 110.021 0.00440862 0.000484423 203863 0
: 565 Minimum Test error found - save the configuration
: 565 | 124.503 108.379 0.0044252 0.000473301 202434 0
: 566 Minimum Test error found - save the configuration
: 566 | 122.83 107.218 0.00442455 0.000493694 203518 0
: 567 Minimum Test error found - save the configuration
: 567 | 121.643 105.781 0.00440442 0.000487323 204233 0
: 568 Minimum Test error found - save the configuration
: 568 | 120.351 104.587 0.00440443 0.000485142 204119 0
: 569 Minimum Test error found - save the configuration
: 569 | 118.77 103.405 0.00444931 0.000490993 202106 0
: 570 Minimum Test error found - save the configuration
: 570 | 117.392 103.113 0.00441478 0.000484973 203573 0
: 571 Minimum Test error found - save the configuration
: 571 | 115.769 101.447 0.00447628 0.000491463 200762 0
: 572 Minimum Test error found - save the configuration
: 572 | 114.367 99.4181 0.0044328 0.000481343 202457 0
: 573 Minimum Test error found - save the configuration
: 573 | 113.053 97.8368 0.004463 0.000519143 202847 0
: 574 Minimum Test error found - save the configuration
: 574 | 111.705 96.9765 0.00441694 0.000478843 203144 0
: 575 Minimum Test error found - save the configuration
: 575 | 110.457 95.9944 0.00452917 0.000514693 199279 0
: 576 Minimum Test error found - save the configuration
: 576 | 108.753 93.9769 0.00447077 0.000475703 200247 0
: 577 Minimum Test error found - save the configuration
: 577 | 107.693 93.8652 0.00450398 0.000503283 199965 0
: 578 Minimum Test error found - save the configuration
: 578 | 106.598 92.2263 0.00449126 0.000500982 200487 0
: 579 Minimum Test error found - save the configuration
: 579 | 105.211 91.3639 0.00449942 0.000503693 200214 0
: 580 Minimum Test error found - save the configuration
: 580 | 103.852 89.767 0.00449839 0.000500002 200081 0
: 581 Minimum Test error found - save the configuration
: 581 | 102.564 88.5319 0.00453185 0.000492863 198070 0
: 582 | 101.43 89.2991 0.00444726 0.000438903 199583 1
: 583 Minimum Test error found - save the configuration
: 583 | 100.181 86.4267 0.0044919 0.000515233 201174 0
: 584 Minimum Test error found - save the configuration
: 584 | 98.8721 85.9044 0.00451096 0.000505042 199705 0
: 585 Minimum Test error found - save the configuration
: 585 | 97.7331 84.4677 0.00451609 0.000496563 199029 0
: 586 Minimum Test error found - save the configuration
: 586 | 96.6377 83.2584 0.00453532 0.000511903 198836 0
: 587 Minimum Test error found - save the configuration
: 587 | 95.5624 82.5014 0.00453457 0.000509203 198740 0
: 588 Minimum Test error found - save the configuration
: 588 | 94.3666 82.3105 0.00491709 0.000745635 191780 0
: 589 Minimum Test error found - save the configuration
: 589 | 93.2448 80.1364 0.00634989 0.000729095 142329 0
: 590 Minimum Test error found - save the configuration
: 590 | 91.9164 79.4184 0.00621287 0.000689434 144837 0
: 591 Minimum Test error found - save the configuration
: 591 | 90.7803 78.5438 0.00516507 0.000600243 175253 0
: 592 Minimum Test error found - save the configuration
: 592 | 89.7979 77.1972 0.00531615 0.000524074 166942 0
: 593 | 88.753 77.4065 0.00449936 0.000469073 198497 1
: 594 Minimum Test error found - save the configuration
: 594 | 87.6833 76.5716 0.00459088 0.000497553 195440 0
: 595 Minimum Test error found - save the configuration
: 595 | 86.6357 75.2675 0.00479812 0.000510723 186593 0
: 596 Minimum Test error found - save the configuration
: 596 | 85.6219 74.3425 0.00545959 0.000602724 164715 0
: 597 Minimum Test error found - save the configuration
: 597 | 84.6833 73.2898 0.004612 0.000488983 194033 0
: 598 Minimum Test error found - save the configuration
: 598 | 83.6251 72.1489 0.00449678 0.000489443 199634 0
: 599 Minimum Test error found - save the configuration
: 599 | 82.6493 71.9919 0.00565824 0.000658114 159996 0
: 600 Minimum Test error found - save the configuration
: 600 | 81.5806 69.8069 0.00561978 0.000723904 163403 0
: 601 | 80.5438 70.2895 0.00585088 0.000558873 151171 1
: 602 Minimum Test error found - save the configuration
: 602 | 79.8435 68.3885 0.00484482 0.000539273 185807 0
: 603 | 78.8492 68.6573 0.00464174 0.000500052 193158 1
: 604 Minimum Test error found - save the configuration
: 604 | 77.9947 67.0449 0.0056075 0.000709885 163345 0
: 605 | 76.9551 67.0734 0.00616295 0.000540973 142299 1
: 606 Minimum Test error found - save the configuration
: 606 | 76.0448 64.9589 0.00459123 0.000494632 195284 0
: 607 Minimum Test error found - save the configuration
: 607 | 75.0392 64.9258 0.00438845 0.000485912 204995 0
: 608 Minimum Test error found - save the configuration
: 608 | 74.4794 63.8944 0.00444285 0.000484533 202106 0
: 609 Minimum Test error found - save the configuration
: 609 | 73.5085 63.2559 0.00453708 0.000531453 199719 0
: 610 Minimum Test error found - save the configuration
: 610 | 72.4519 61.9743 0.00470215 0.000536143 192031 0
: 611 | 71.9334 62.2977 0.00433806 0.000464082 206506 1
: 612 Minimum Test error found - save the configuration
: 612 | 70.97 60.1508 0.00480606 0.000528233 187011 0
: 613 Minimum Test error found - save the configuration
: 613 | 69.9121 59.2146 0.00444615 0.000485373 201981 0
: 614 | 68.9809 59.5624 0.0043859 0.000458313 203688 1
: 615 Minimum Test error found - save the configuration
: 615 | 68.4953 58.5905 0.00438299 0.000485763 205274 0
: 616 Minimum Test error found - save the configuration
: 616 | 67.6386 57.4827 0.00439914 0.000479103 204079 0
: 617 Minimum Test error found - save the configuration
: 617 | 66.7057 56.9706 0.00442202 0.000477332 202804 0
: 618 Minimum Test error found - save the configuration
: 618 | 65.7581 55.7762 0.00438063 0.000476183 204894 0
: 619 Minimum Test error found - save the configuration
: 619 | 65.1222 54.9595 0.00547822 0.000592324 163736 0
: 620 Minimum Test error found - save the configuration
: 620 | 64.2626 54.562 0.00542991 0.000528853 163230 0
: 621 Minimum Test error found - save the configuration
: 621 | 63.6407 53.9297 0.00528716 0.000703124 174519 0
: 622 Minimum Test error found - save the configuration
: 622 | 62.7512 52.5687 0.00558497 0.000519963 157946 0
: 623 | 62.0691 52.6271 0.00465894 0.000466123 190803 1
: 624 Minimum Test error found - save the configuration
: 624 | 61.227 51.6128 0.00445087 0.000490552 202004 0
: 625 Minimum Test error found - save the configuration
: 625 | 60.4983 50.8566 0.00492234 0.000709214 189883 0
: 626 Minimum Test error found - save the configuration
: 626 | 59.6912 50.3601 0.00518539 0.000496513 170617 0
: 627 Minimum Test error found - save the configuration
: 627 | 58.9045 49.7913 0.00459786 0.000498352 195146 0
: 628 Minimum Test error found - save the configuration
: 628 | 58.3487 48.68 0.00478848 0.000507502 186873 0
: 629 Minimum Test error found - save the configuration
: 629 | 57.696 48.3274 0.00495837 0.000713313 188455 0
: 630 Minimum Test error found - save the configuration
: 630 | 56.9147 47.6695 0.00588393 0.000504983 148728 0
: 631 Minimum Test error found - save the configuration
: 631 | 56.322 46.7074 0.00465392 0.000525223 193766 0
: 632 Minimum Test error found - save the configuration
: 632 | 55.5459 46.3318 0.0055392 0.000510383 159083 0
: 633 | 54.8065 46.6604 0.00492177 0.000502633 181031 1
: 634 Minimum Test error found - save the configuration
: 634 | 54.3494 45.3155 0.00468973 0.000551942 193340 0
: 635 | 53.6871 45.5644 0.00478447 0.000502222 186818 1
: 636 Minimum Test error found - save the configuration
: 636 | 52.9054 43.6567 0.00476333 0.000486883 187071 0
: 637 Minimum Test error found - save the configuration
: 637 | 52.2278 43.2085 0.00444782 0.000494633 202368 0
: 638 Minimum Test error found - save the configuration
: 638 | 51.7048 42.7233 0.00443128 0.000489073 202932 0
: 639 Minimum Test error found - save the configuration
: 639 | 51.206 42.2581 0.00445972 0.000492643 201660 0
: 640 Minimum Test error found - save the configuration
: 640 | 50.3081 41.9595 0.00443059 0.000484962 202756 0
: 641 | 49.8161 42.3901 0.00435916 0.000454922 204905 1
: 642 Minimum Test error found - save the configuration
: 642 | 49.4267 40.5767 0.00438553 0.000495393 205649 0
: 643 | 48.7121 40.9578 0.00432833 0.000447061 206118 1
: 644 Minimum Test error found - save the configuration
: 644 | 48.1326 39.3787 0.0044653 0.000483883 200934 0
: 645 Minimum Test error found - save the configuration
: 645 | 47.3757 38.9597 0.0044074 0.000479702 203681 0
: 646 | 46.7654 39.2818 0.00437303 0.000443632 203594 1
: 647 Minimum Test error found - save the configuration
: 647 | 46.5372 38.0931 0.00443022 0.000512503 204201 0
: 648 Minimum Test error found - save the configuration
: 648 | 46.1244 37.3288 0.00449313 0.000491512 199919 0
: 649 Minimum Test error found - save the configuration
: 649 | 45.3806 36.9074 0.00438331 0.000494943 205742 0
: 650 | 44.7286 37.0462 0.00437967 0.000476183 204945 1
: 651 Minimum Test error found - save the configuration
: 651 | 44.2766 35.6365 0.00440024 0.000482312 204189 0
: 652 | 43.6722 35.7551 0.00436468 0.000451423 204434 1
: 653 | 43.0727 36.1818 0.00437835 0.000438572 203057 2
: 654 Minimum Test error found - save the configuration
: 654 | 42.5787 34.961 0.00444615 0.000497863 202620 0
: 655 Minimum Test error found - save the configuration
: 655 | 42.1472 34.8886 0.00450262 0.000506843 200211 0
: 656 Minimum Test error found - save the configuration
: 656 | 41.5275 33.5467 0.00443323 0.000497152 203248 0
: 657 Minimum Test error found - save the configuration
: 657 | 40.9102 32.9519 0.00444365 0.000479853 201827 0
: 658 Minimum Test error found - save the configuration
: 658 | 40.3666 32.6525 0.00442327 0.000485363 203153 0
: 659 Minimum Test error found - save the configuration
: 659 | 39.9403 32.2825 0.00443138 0.000485933 202766 0
: 660 Minimum Test error found - save the configuration
: 660 | 39.6769 31.5782 0.0043788 0.000480483 205217 0
: 661 | 39.1371 31.8638 0.00435227 0.000453683 205203 1
: 662 Minimum Test error found - save the configuration
: 662 | 38.5597 31.0097 0.00435421 0.000477113 206340 0
: 663 Minimum Test error found - save the configuration
: 663 | 38.1685 30.6001 0.00436425 0.000476622 205781 0
: 664 Minimum Test error found - save the configuration
: 664 | 37.5862 30.5653 0.00436771 0.000478842 205716 0
: 665 Minimum Test error found - save the configuration
: 665 | 37.1628 30.1054 0.00436922 0.000473162 205336 0
: 666 Minimum Test error found - save the configuration
: 666 | 36.7917 29.0461 0.00436795 0.000479693 205748 0
: 667 | 36.1625 29.6694 0.00433927 0.000447183 205546 1
: 668 Minimum Test error found - save the configuration
: 668 | 35.6965 28.5523 0.00436255 0.000473892 205726 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.3319 28.2924 0.00437093 0.000483183 205775 0
: 670 Minimum Test error found - save the configuration
: 670 | 34.9435 27.8567 0.00437245 0.000487462 205921 0
: 671 Minimum Test error found - save the configuration
: 671 | 34.6794 27.6672 0.00438026 0.000478693 205046 0
: 672 Minimum Test error found - save the configuration
: 672 | 34.1166 27.5235 0.00436581 0.000487633 206282 0
: 673 Minimum Test error found - save the configuration
: 673 | 33.6953 26.5456 0.00435106 0.000469693 206113 0
: 674 Minimum Test error found - save the configuration
: 674 | 33.36 25.82 0.00438256 0.000481903 205093 0
: 675 | 32.8186 25.9737 0.0043552 0.000450103 204860 1
: 676 | 32.4838 25.883 0.00435106 0.000452263 205192 2
: 677 Minimum Test error found - save the configuration
: 677 | 32.1577 25.7377 0.00438883 0.000485123 204933 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.801 24.7739 0.00438047 0.000481073 205160 0
: 679 Minimum Test error found - save the configuration
: 679 | 31.1751 24.7516 0.00437666 0.000475163 205050 0
: 680 Minimum Test error found - save the configuration
: 680 | 30.7954 24.3527 0.00442205 0.000489763 203444 0
: 681 Minimum Test error found - save the configuration
: 681 | 30.5337 23.9026 0.00460966 0.000543522 196747 0
: 682 Minimum Test error found - save the configuration
: 682 | 30.2192 23.2915 0.00480203 0.000603104 190525 0
: 683 Minimum Test error found - save the configuration
: 683 | 29.7915 22.4059 0.00492395 0.000530093 182072 0
: 684 | 29.5058 23.0379 0.00482532 0.000507253 185268 1
: 685 | 29.0461 22.4412 0.00435869 0.000445142 204418 2
: 686 Minimum Test error found - save the configuration
: 686 | 28.5427 22.1791 0.00438762 0.000481433 204804 0
: 687 Minimum Test error found - save the configuration
: 687 | 28.2737 21.3511 0.00455378 0.000577034 201170 0
: 688 Minimum Test error found - save the configuration
: 688 | 27.8204 21.0396 0.00448291 0.000495523 200633 0
: 689 Minimum Test error found - save the configuration
: 689 | 27.3167 20.445 0.00443017 0.000483673 202711 0
: 690 | 27.0805 21.2317 0.00437127 0.000450403 204037 1
: 691 | 26.6938 20.4571 0.0043202 0.000439173 206131 2
: 692 Minimum Test error found - save the configuration
: 692 | 26.366 20.2151 0.00440004 0.000503243 205297 0
: 693 Minimum Test error found - save the configuration
: 693 | 26.1136 19.8038 0.00436437 0.000482243 206073 0
: 694 Minimum Test error found - save the configuration
: 694 | 25.8402 19.7416 0.00442592 0.000510743 204333 0
: 695 | 25.6004 20.9868 0.00432869 0.000454643 206502 1
: 696 Minimum Test error found - save the configuration
: 696 | 25.2316 19.2181 0.00440309 0.000484883 204175 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.6849 18.366 0.00443088 0.000483234 202653 0
: 698 | 24.5371 18.569 0.00431688 0.000448782 206820 1
: 699 | 24.3262 18.7337 0.00430557 0.000440034 206957 2
: 700 Minimum Test error found - save the configuration
: 700 | 23.9754 17.8305 0.00436555 0.000478692 205822 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.4824 16.6446 0.00439845 0.000482033 204268 0
: 702 | 23.1919 17.4644 0.00431241 0.000438072 206487 1
: 703 | 22.7394 16.8003 0.00433753 0.000444083 205473 2
: 704 | 22.5273 16.8041 0.00436851 0.000449483 204132 3
: 705 Minimum Test error found - save the configuration
: 705 | 22.4077 16.3935 0.00465263 0.000489823 192178 0
: 706 | 21.9117 16.3994 0.00448153 0.000493863 200619 1
: 707 Minimum Test error found - save the configuration
: 707 | 21.659 16.2333 0.00458966 0.000498064 195523 0
: 708 Minimum Test error found - save the configuration
: 708 | 21.3545 15.4519 0.00442508 0.000473673 202460 0
: 709 Minimum Test error found - save the configuration
: 709 | 21.1221 15.396 0.00439623 0.000503723 205523 0
: 710 Minimum Test error found - save the configuration
: 710 | 20.8143 15.29 0.00436531 0.000478342 205816 0
: 711 Minimum Test error found - save the configuration
: 711 | 20.6241 15.247 0.00465721 0.000489533 191954 0
: 712 | 20.507 15.4488 0.00455209 0.000439713 194535 1
: 713 Minimum Test error found - save the configuration
: 713 | 20.2574 14.0054 0.0043907 0.000482914 204719 0
: 714 | 19.7333 14.2508 0.00437023 0.000447673 203949 1
: 715 | 19.4499 14.207 0.00447927 0.000509114 201504 2
: 716 Minimum Test error found - save the configuration
: 716 | 19.1749 13.9799 0.00450116 0.000493543 199620 0
: 717 | 19.1534 14.0152 0.00449368 0.000466473 198649 1
: 718 Minimum Test error found - save the configuration
: 718 | 18.5773 13.6758 0.00456582 0.000512003 197345 0
: 719 Minimum Test error found - save the configuration
: 719 | 18.2704 12.8213 0.0046113 0.000501803 194671 0
: 720 Minimum Test error found - save the configuration
: 720 | 18.0428 12.6756 0.00463093 0.000503113 193807 0
: 721 | 17.957 12.8572 0.00444863 0.000454894 200314 1
: 722 | 17.7529 13.44 0.00436163 0.000441893 204096 2
: 723 | 17.5207 12.8288 0.00440975 0.000473183 203222 3
: 724 Minimum Test error found - save the configuration
: 724 | 17.2754 12.5628 0.00499947 0.000548762 179747 0
: 725 Minimum Test error found - save the configuration
: 725 | 17.0712 11.9753 0.00541226 0.000684913 169228 0
: 726 Minimum Test error found - save the configuration
: 726 | 16.7221 11.7871 0.00570264 0.000541603 155008 0
: 727 Minimum Test error found - save the configuration
: 727 | 16.5804 10.7613 0.00457814 0.000498893 196115 0
: 728 | 16.3267 11.3503 0.00452042 0.000466403 197335 1
: 729 | 16.1246 11.4736 0.00472957 0.000445573 186742 2
: 730 | 15.9117 10.9189 0.00441112 0.000465203 202741 3
: 731 | 15.766 11.4553 0.00443657 0.000451063 200727 4
: 732 Minimum Test error found - save the configuration
: 732 | 15.7202 10.7597 0.00458449 0.000509173 196304 0
: 733 Minimum Test error found - save the configuration
: 733 | 15.337 10.5776 0.00460694 0.000529242 196189 0
: 734 Minimum Test error found - save the configuration
: 734 | 14.9275 10.4565 0.00497549 0.000613374 183397 0
: 735 Minimum Test error found - save the configuration
: 735 | 14.7847 9.90521 0.00475402 0.000515853 188761 0
: 736 | 14.6222 10.0201 0.00478364 0.000444883 184385 1
: 737 Minimum Test error found - save the configuration
: 737 | 14.392 9.29948 0.00446282 0.000519293 202864 0
: 738 | 14.2091 9.51083 0.004371 0.000441853 203606 1
: 739 | 13.9193 9.73719 0.00435114 0.000449382 205036 2
: 740 | 13.764 9.59274 0.0043491 0.000445423 204935 3
: 741 | 13.6752 9.79569 0.00430575 0.000438332 206856 4
: 742 | 13.4544 10.0727 0.00432369 0.000443333 206166 5
: 743 Minimum Test error found - save the configuration
: 743 | 13.1738 9.05768 0.00437267 0.000480773 205555 0
: 744 | 13.0744 9.28449 0.00430705 0.000441453 206954 1
: 745 Minimum Test error found - save the configuration
: 745 | 12.7544 8.99109 0.00439867 0.000481213 204214 0
: 746 | 12.6811 9.15714 0.0043722 0.000473761 205210 1
: 747 | 12.5421 9.46661 0.00542245 0.000645853 167483 2
: 748 Minimum Test error found - save the configuration
: 748 | 12.4727 8.52251 0.00548444 0.000493024 160275 0
: 749 Minimum Test error found - save the configuration
: 749 | 12.2562 8.14056 0.00439668 0.000479923 204251 0
: 750 | 12.1144 9.07665 0.00500799 0.000641064 183195 1
: 751 | 12.0885 9.53117 0.00610973 0.000614564 145582 2
: 752 Minimum Test error found - save the configuration
: 752 | 11.8734 7.90072 0.00630171 0.000713385 143156 0
: 753 | 11.5329 8.45807 0.00633534 0.000651413 140748 1
: 754 | 11.3041 8.29182 0.00627658 0.000635394 141814 2
: 755 | 11.3358 8.34669 0.00630472 0.000651964 141524 3
: 756 | 11.1417 8.61147 0.00636934 0.000654174 139979 4
: 757 | 11.0965 9.51959 0.0062818 0.000619493 141285 5
: 758 | 10.9849 9.48801 0.00630263 0.000656964 141702 6
: 759 | 11.3191 8.16115 0.00628628 0.000647944 141886 7
: 760 Minimum Test error found - save the configuration
: 760 | 10.9179 7.42695 0.00589843 0.000536084 149188 0
: 761 | 10.5904 8.30073 0.00451404 0.000462922 197477 1
: 762 Minimum Test error found - save the configuration
: 762 | 10.2637 7.17402 0.00449375 0.000511253 200879 0
: 763 | 10.0955 7.46255 0.00466609 0.000501593 192100 1
: 764 Minimum Test error found - save the configuration
: 764 | 9.96557 7.04014 0.00451554 0.000494113 198935 0
: 765 | 9.81762 7.19643 0.00452337 0.000473103 197518 1
: 766 Minimum Test error found - save the configuration
: 766 | 9.61985 6.98543 0.0046797 0.000487522 190832 0
: 767 Minimum Test error found - save the configuration
: 767 | 9.61559 6.57311 0.00440938 0.000486443 203929 0
: 768 | 9.39253 6.81002 0.00442622 0.000446863 201038 1
: 769 Minimum Test error found - save the configuration
: 769 | 9.20764 6.24967 0.00446359 0.000490282 201343 0
: 770 | 9.07444 7.14351 0.00434518 0.000442983 205012 1
: 771 | 9.04675 6.7431 0.00434548 0.000448063 205264 2
: 772 Minimum Test error found - save the configuration
: 772 | 8.95303 6.08504 0.00441992 0.000512574 204743 0
: 773 Minimum Test error found - save the configuration
: 773 | 8.87466 5.96065 0.00463123 0.000490063 193182 0
: 774 | 8.78208 6.11915 0.00441502 0.000449674 201748 1
: 775 | 8.57992 6.65176 0.00437608 0.000444673 203490 2
: 776 | 8.51171 6.11395 0.00434266 0.000446143 205311 3
: 777 Minimum Test error found - save the configuration
: 777 | 8.34923 5.74351 0.00445766 0.000482643 201257 0
: 778 Minimum Test error found - save the configuration
: 778 | 8.29021 5.54593 0.00448201 0.000491073 200454 0
: 779 | 8.17425 6.23305 0.00436186 0.000439701 203969 1
: 780 | 8.18763 5.58055 0.00438695 0.000446743 203035 2
: 781 Minimum Test error found - save the configuration
: 781 | 7.97198 5.17502 0.00453874 0.000487093 197451 0
: 782 | 7.90961 6.50013 0.00445333 0.000465093 200590 1
: 783 | 7.80414 6.78729 0.0044457 0.000464182 200929 2
: 784 Minimum Test error found - save the configuration
: 784 | 8.02668 4.96639 0.00446548 0.000491594 201314 0
: 785 | 7.64221 5.68799 0.0044414 0.000462153 201043 1
: 786 | 7.54654 5.48425 0.00451769 0.000468923 197591 2
: 787 | 7.38711 5.4244 0.0045116 0.000466733 197782 3
: 788 | 7.51654 6.31427 0.00447245 0.000448832 198826 4
: 789 Minimum Test error found - save the configuration
: 789 | 7.3151 4.96059 0.00441368 0.000487893 203781 0
: 790 | 7.07605 6.01872 0.00443766 0.000465932 201424 1
: 791 | 6.99793 5.04931 0.00439011 0.000448502 202963 2
: 792 Minimum Test error found - save the configuration
: 792 | 6.87276 4.44156 0.00446033 0.000480813 201030 0
: 793 | 6.84779 5.02991 0.00471279 0.000471811 188635 1
: 794 | 6.75864 5.92119 0.00441976 0.000447243 201384 2
: 795 | 6.64299 5.52197 0.0043707 0.000451572 204127 3
: 796 | 6.7182 5.1874 0.00434749 0.000441032 204789 4
: 797 | 6.57441 4.5491 0.00436257 0.000464993 205255 5
: 798 Minimum Test error found - save the configuration
: 798 | 6.48305 4.3027 0.00441157 0.000487282 203859 0
: 799 | 6.25706 5.30516 0.00437807 0.000444572 203381 1
: 800 | 6.31478 4.57258 0.00432662 0.000454632 206612 2
: 801 | 6.22734 5.02252 0.00430793 0.000447053 207207 3
: 802 | 6.14127 4.56452 0.00445365 0.000450422 199838 4
: 803 | 5.97497 4.6668 0.0044541 0.000454363 200013 5
: 804 | 6.01792 4.96528 0.00434423 0.000444913 205164 6
: 805 Minimum Test error found - save the configuration
: 805 | 5.76375 4.22586 0.00435722 0.000493453 207052 0
: 806 | 5.77249 5.06536 0.00435068 0.000453232 205262 1
: 807 | 5.7826 4.92437 0.0043539 0.000445393 204681 2
: 808 | 5.69633 4.36628 0.0044264 0.000454423 201411 3
: 809 | 5.62239 4.67391 0.00438718 0.000440223 202688 4
: 810 Minimum Test error found - save the configuration
: 810 | 5.72403 3.70437 0.00439503 0.000508782 205854 0
: 811 | 5.77304 4.5028 0.00462635 0.000449083 191513 1
: 812 | 5.64337 4.95115 0.00442969 0.000460782 201567 2
: 813 | 5.58287 4.3261 0.00437249 0.000443062 203592 3
: 814 | 5.28238 4.34662 0.00458003 0.000461693 194253 4
: 815 | 5.26371 4.3701 0.0044463 0.000454473 200410 5
: 816 | 5.19251 4.02388 0.00440281 0.000464353 203125 6
: 817 | 5.08962 4.45641 0.00448596 0.000448142 198127 7
: 818 | 5.07541 4.40033 0.00436309 0.000448784 204378 8
: 819 | 5.02027 4.5279 0.00437199 0.000450243 203991 9
: 820 | 5.05698 5.08461 0.00449808 0.000501233 200158 10
: 821 Minimum Test error found - save the configuration
: 821 | 4.99278 3.57912 0.00453754 0.000497542 198020 0
: 822 | 4.85968 4.24328 0.00440336 0.000447443 202229 1
: 823 | 4.72796 4.47833 0.00433865 0.000454012 205940 2
: 824 | 4.72894 4.11925 0.00433637 0.000448523 205770 3
: 825 | 4.68767 3.65267 0.0043923 0.000449623 202908 4
: 826 | 4.75017 3.9479 0.0044053 0.000451172 202320 5
: 827 | 4.57374 4.0903 0.00434515 0.000439322 204822 6
: 828 | 4.52579 4.48994 0.00444334 0.000455553 200613 7
: 829 | 4.64365 4.15057 0.00432681 0.000446853 206188 8
: 830 | 4.49742 3.73871 0.00439406 0.000445633 202612 9
: 831 | 4.43709 3.81978 0.00451811 0.000454312 196860 10
: 832 | 4.13314 3.82637 0.00438339 0.000444162 203085 11
: 833 Minimum Test error found - save the configuration
: 833 | 4.09429 3.48142 0.00451339 0.000489792 198827 0
: 834 | 4.20828 3.71218 0.00443456 0.000453472 200950 1
: 835 Minimum Test error found - save the configuration
: 835 | 4.22331 3.42872 0.00441661 0.000518243 205214 0
: 836 | 4.17722 3.6594 0.0045056 0.000492493 199347 1
: 837 | 4.10067 4.08532 0.00446536 0.000476883 200578 2
: 838 | 4.08094 3.4956 0.00470121 0.000478923 189471 3
: 839 | 3.95824 3.87429 0.0046009 0.000576684 198797 4
: 840 | 3.8983 3.75802 0.00450631 0.000447392 197097 5
: 841 | 3.8375 3.61694 0.00448912 0.000466973 198899 6
: 842 | 4.0711 3.8327 0.00446669 0.000502043 201783 7
: 843 Minimum Test error found - save the configuration
: 843 | 3.85359 3.38635 0.00444793 0.000488733 202061 0
: 844 | 3.86329 3.80804 0.00440078 0.000448312 202405 1
: 845 | 3.88626 4.51638 0.00442338 0.000464513 202078 2
: 846 | 3.79679 4.05453 0.00443668 0.000450283 200683 3
: 847 | 3.79388 3.62118 0.00443152 0.000461313 201501 4
: 848 | 3.70767 5.11374 0.00444012 0.000439162 199952 5
: 849 | 3.92312 3.61382 0.00434348 0.000444583 205186 6
: 850 Minimum Test error found - save the configuration
: 850 | 3.63428 3.09411 0.00447632 0.000485232 200446 0
: 851 Minimum Test error found - save the configuration
: 851 | 3.62606 3.03336 0.00437013 0.000476463 205462 0
: 852 | 3.36779 3.52067 0.00434669 0.000450333 205320 1
: 853 | 3.34672 3.88982 0.00436032 0.000442672 204204 2
: 854 | 3.22626 3.59073 0.00435658 0.000454642 205026 3
: 855 | 3.38674 4.32526 0.00444545 0.000447682 200112 4
: 856 | 3.21687 3.44697 0.00476503 0.000492503 187243 5
: 857 | 3.16977 4.00069 0.00471913 0.000531783 191052 6
: 858 | 3.0636 4.06604 0.00463711 0.000440422 190627 7
: 859 | 3.09265 3.51517 0.00440422 0.000480772 203902 8
: 860 | 3.09259 3.33252 0.00451078 0.000441363 196589 9
: 861 | 3.02262 3.19744 0.00440951 0.000450783 202085 10
: 862 | 3.06304 3.21443 0.00448541 0.000470212 199243 11
: 863 | 3.04203 3.96887 0.00436314 0.000444133 204133 12
: 864 | 2.93295 3.36216 0.00435168 0.000450153 205048 13
: 865 | 3.17768 3.6858 0.00437541 0.000448062 203700 14
: 866 | 3.02718 3.70582 0.00444459 0.000446693 200105 15
: 867 | 3.04851 3.52976 0.00437028 0.000458962 204534 16
: 868 | 3.07965 4.22648 0.0044397 0.000456852 200861 17
: 869 | 2.88094 4.04847 0.00444482 0.000451223 200321 18
: 870 | 2.74986 3.7949 0.00489268 0.000660354 189021 19
: 871 | 2.73709 3.27354 0.00524451 0.000455393 167045 20
: 872 | 2.78472 3.67252 0.00437986 0.000446813 203405 21
:
: Elapsed time for training with 1000 events: 4.01 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00597 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.849 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.16 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.32658e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.10401e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0448 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.039 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00142 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0507 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.934 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0209 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00268 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0377 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00429 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00236 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00043 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0532 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00607 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.928 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.102 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.404 0.445 5.63 1.54 | 3.220 3.245
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.300 0.458 1.84 1.12 | 3.395 3.388
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.