Implement measures for analyzing algorithm behavior

[jkarder]

r8161: initial commit

[jkarder]

r8162: fixed PreBuildEvent.cmd

[jkarder]

r8191: added BuildingBlockAnalyzer

[jkarder]

r8216:

• added SchemaAnalyzer
• added BrokenInteritanceSchemaAnalyzer

[ascheibe]

r8217 added more analyzers

[ascheibe]

r8218 added an analyzer for calculating all subtours of the best solution

[jkarder]

r8227:

• added BrokenInheritanceWildcardAnalyzer
• separated analyzers and data structure creators
• fixed CalculateBrokenInheritanceOccurrences method

[ascheibe]

r8229 worked on an analyzer for the best found solution

[ascheibe]

r8230 fixed a bug

[ascheibe]

r8234 updated graph from evolutionary tracking branch

[ascheibe]

r8237 added ranks list to nodes in graph

[jkarder]

r8239: added BeforeMutatorOperator to update the trace map accordingly before mutation

[jkarder]

r8247: removed unnecessary pattern matching in CalculateBrokenInheritanceOccurrences method

[jkarder]

r8250: added BestIndividualSchemataAnalyzer

[ascheibe]

r8267 added wild card analyzer for the best individual

[ascheibe]

r8268 added an analyzer for the edges of the best found solution

[ascheibe]

r8269 added convergence analyzer

[ascheibe]

r8277 added distinct solution analyzer

[ascheibe]

r8278 fixed a bug in the distinct solution analyzer

[ascheibe]

r8279 save distinct solutions in a data table

[ascheibe]

r8281 added datatable to convergence speed analyzer

[ascheibe]

r8287 worked on analyzers

[ascheibe]

r8336 worked on crossover performance analyzer

[ascheibe]

r8337 worked on crossover performance analyzer

[ascheibe]

r8352 added mutation performance analyzer

[ascheibe]

r8382 added more plots for crossover performance analysis

[ascheibe]

r8410 added an operator to clone variables

[ascheibe]

r8411 worked on mutation performance analyzer

[ascheibe]

r8415 added an analyzer for tracking duplicate solutions

[ascheibe]

r8447 removed external evaluation from HL solution

[ascheibe]

r8496 removed deprecated code and cleaned up plugin dependencies

[ascheibe]

r8498 added helper classes for generating charts

[ascheibe]

r8499 improved crossover analyzer and added duplicate parent counting

[ascheibe]

r8501 fixed cloning and made helper classes items

[ascheibe]

r8502 added a run collection view that shows statistical information for data table rows

[ascheibe]

r8503 switched rows and columns of statistical tabular view

[ascheibe]

r8505 fixed cloning and storing

[ascheibe]

r8511 added an option so that the scatter plot helper can now also produce data tables

[ascheibe]

r8515 fixed cloning and resetting of the scatter plot helper

[ascheibe]

r8521 added gradient to statistical tabular view

[ascheibe]

r8522 added relative error and possibility to add fitted line to charts

[ascheibe]

r8558 runs can now be opened in the statistical tabular view

[ascheibe]

r8569 added functionality so that calculated values can be stored in the results of the runs

[ascheibe]

r8570 fixed a small bug

[ascheibe]

r8661 adapted operators so that they can be used with Scatter Search

[ascheibe]

r8663 added an performance analyzer for Path Relinkers

[ascheibe]

r8709 added an operator that combines all operators that need to be executed after crossover

[ascheibe]

r8711 added a combined operator for mutation

[ascheibe]

r8722 improved the DuplicateSolutionsAnalyzer

[ascheibe]

r8739 removed static method calls to similarity calculators

[ascheibe]

r8797 added a comparison factor parameter to the crossover analyzer so that it can be defined what a successful crossover is

[ascheibe]

r8864 added more analyzers for crossover performance

[ascheibe]

r8865 fixed crossover performance operator initialization

[ascheibe]

r8866 further improvements for the crossover performance analyzer

[ascheibe]

r8867 improved mutation analyzer

[ascheibe]

r9020 added an analyzer for unwanted mutation for the TSP

[ascheibe]

r9032 added a crossover analyzer for the QAP

[ascheibe]

r9042 added mutation performance analyzer for the QAP

[ascheibe]

r9044

• improved unwanted mutation analyzer
• added test functions crossover performance analyzer

[ascheibe]

r9045 added mutation performance analyzer for test functions

[ascheibe]

r9050 added performance analyzers for the VRP

[ascheibe]

r9053 added a dialog for adding operators as successors to other operators

[ascheibe]

r9054 added an analyzer for comparing the current solution to the rest of the population

[ascheibe]

r9058 also track quality of solutions

[ascheibe]

r9059 track min and max quality values for scaling

[ascheibe]

r9060 cleaned up plugin dependencies

[ascheibe]

r9061 added average of first, last, upper and lower 25% to statistical tabular view

[ascheibe]

r9087 added coloring of the rows in the statistical view

[ascheibe]

r9095 added a project for views

[ascheibe]

r9150 fixed successor configuration and added successful mutation chart

[ascheibe]

r9185 fixed scaling of qualities

[ascheibe]

r9189 fixed unwanted mutations analyzer

[ascheibe]

r9192 RunCollectionStatisticalTabularView now respects RunCollectionFilters

[ascheibe]

r9196

• fixed a cloning bug
• fixed forgotten event handler deregistration
• added a run collection view for analyzing parameter influences

[ascheibe]

r9197 don't do testing if there aren't enough groups

[ascheibe]

r9198 added calculation of the overall parameter influence

[ascheibe]

r9210 added view for displaying result correlations

[ascheibe]

r9252 automatically calculate statistical values for each run

[ascheibe]

r9316 implemented Kruskal-Wallis Test

[ascheibe]

r9317 started working on a statistical testing run collection view

[ascheibe]

r9318 added test for normality and pairwise statistical testing

[ascheibe]

r9319 improved view and added documentation

[ascheibe]

r9320 some more improvements for the statistical testing view

[ascheibe]

r9328

• fixed a bug in the ResultCorrelationView
• added sample size determination by estimating means, Cohen's D and Hedges' G

[ascheibe]

r9329 calculate Cohen's D and Hedges' G for pairwise comparison and updated documentation

[ascheibe]

r9330 added a view for sample size determination

[ascheibe]

r9331 added analyzer for selection pressure

[ascheibe]

r9333 improved run collection views

[ascheibe]

r9336 added ttest and sample size determination for the ttest

[ascheibe]

r9337 fixed bugs in TTest

[ascheibe]

r9341 some minor AB fixes

[ascheibe]

r9354 removed views that went into the statistical hypothesis testing branch (#2031)

[ascheibe]

r9361 adapted create experiment dialog so that it can generate random configurations

[ascheibe]

r9364 added repetitions for random parameter configurations

[ascheibe]

r9384 added calculation of selection intensity

[ascheibe]

r9412 added GA with evaluated solutions as a stopping criteria

[gkronber]

r9412: I'm not sure it is necessary to add a GA variant with evaluated solutions as stopping criterion (this is almost the same as pop-size * generations)

[ascheibe]

Replying to gkronber:

r9412: I'm not sure it is necessary to add a GA variant with evaluated solutions as stopping criterion (this is almost the same as pop-size * generations)

Yes, that's true, but it makes creating experiments simpler as I can fix the evaluated solutions and just vary the population size. Generations are not varied and are then simply a result. Because I want to define ranges for parameters and then draw random samples it would be more complicated to check if a drawn configuration has the correct amount of evaluated solutions (or only calculated configurations where this is the case).

[ascheibe]

r9418

• changed duplicate solutions analyzer to also track avg. diversity as the standard diversity analyzer needs too much memory
• fixed project references of eslGA

[ascheibe]

r9431 added configuration of frequency with which the ab measures are calculated

[ascheibe]

r9711 started working on a solution cache

[ascheibe]

r9723 worked on solution caching

[ascheibe]

r9728 worked on solution caching

[ascheibe]

r9729 fixed serialization bug in solution caching

[ascheibe]

r9730 added a library that calculates convex hulls

[ascheibe]

r9731 cleaned up references

[ascheibe]

r9754 added a caching analyzer for crossover

[ascheibe]

r9757 fixed a bug and improved PermutationInformation

[ascheibe]

r9789 fixed alglib reference and updated year and version information

[ascheibe]

r9791 removed useless resource file

[ascheibe]

r9945

• added new convex hull algorithm based on SMO/SVM
• added unit test and a visualization
• updated MIConvexHull

[ascheibe]

r10007 started working on volume calculation

[ascheibe]

r10008 added volume calculation for convex d-polytopes

[ascheibe]

r10023

• moved solution caching to an own plugin
• added initial support for real vector encoding

[ascheibe]

r10024 added views project for solution caching

[ascheibe]

r10025 added support for permutation encoding for solution caching

[ascheibe]

r10026

• removed old caching code
• adapted convex hull view and some other minor improvements

[ascheibe]

r10027 adapted convex hull view to work with real vectors and permutations

[ascheibe]

r10060

• added point calculation from distance matrices
• added convex hull algorithm based on LP (work in progress)
• added unit tests

[ascheibe]

r10077 fixed a bug in the point calculation from distance matrices

[ascheibe]

r10078 another bugfix in the point calculation from distance matrices

[ascheibe]

r10081 fixed LPHull, seems to work now

[ascheibe]

r10082 correction of LPHull Func

[ascheibe]

r10090 added an algorithm that executes analyzers on a solution cache

[ascheibe]

r10091 renamed analyzers to collectors to avoid confusion

[ascheibe]

r10092 fixed volume calculation of polytopes

[ascheibe]

r10096 started working on crossover wrappers that can execute analyzers for crossovers

[ascheibe]

r10097 added metric mds for testing purposes

[ascheibe]

r10098 added method for converting similarity-based measures to euclidean distances

[ascheibe]

r10101 added PermutationPointcut and refactored pointcut code

[ascheibe]

r10102 added mutation pointcuts for realvector and permutation encodings

[ascheibe]

r10104 fixed RealVectorEqualityComparer and added unit tests for caches

[ascheibe]

r10105 renamed some properties in SolutionInformation as suggested by swagner

[ascheibe]

r10108 fixed metric MDS and updated unit test

[ascheibe]

r10109 fixed other MDS and added more unit tests

[ascheibe]

r10111 created a new Hive task that runs RunCollectionModifiers in Hive

[ascheibe]

r10112 added constant adding for metric mds

[ascheibe]

r10113 added basic dialog for configuring a RunCollectionModifierTask

[ascheibe]

r10114 added tasks and hive tasks for RunCollectionModifiers

[ascheibe]

r10115 some improvements in the RunCollectionModifierExecutable

[ascheibe]

r10116 added convex hull RunCollectionModifiers

[ascheibe]

r10117 made RunCollectionModifierHiveTask distributable

[ascheibe]

r10118 added another unit test for permutations

[ascheibe]

r10119 improved RealVectorConvexHullModifier

[ascheibe]

r10120 fixed a bug in RunCollectionModifierExecutable

[ascheibe]

r10121 improved RunCollectionModifierExecutable and added a new view for it

[ascheibe]

r10127 fixed a bug in metric mds and added another unit test

[ascheibe]

r10128 cleaned up Hive RunCollection Modifier Task classes

[ascheibe]

r10129 added a view for the RunCollectionModifierHiveTask

[ascheibe]

r10131 adapted the RunCollectionModifierTask to the changes of r10130

[ascheibe]

r10132 updated unit test to take account for rounding errors

[ascheibe]

r10133 updated the PermutationConvexHullModifier to collect the same results as the RealVectorConvexHullModifier

[ascheibe]

r10139 fixed a bug in the PermutationConvexHullModifier

[ascheibe]

r10141

• renamed MenuItem for the HiveRunCollectionModifier
• deactivated calculation of complete convex hull for permutations

[ascheibe]

r10151 just a small change to go along with the changes of r10150

[ascheibe]

r10198

• added liblrs and c# wrapper for vertex enumeration/volume calculation
• use MIConvexHull for triangulation and volume calculation
• fixed vertex conversion code for MIConvexHull lib
• added a unit test for measuring performance of convex hull/volume calculation

[ascheibe]

r10200

• moved lrs code into analyzer project
• added lrs performance test
• moved performance tests into an own project
• don't use 64 bit number format of lrs as it does not work correctly

[ascheibe]

r10201 fixed a small bug in volume calculation

[ascheibe]

r10207 added a unit test for volume calculation and the qhull library

[ascheibe]

r10208

• added x64 configurations for qhull
• added a wrapper for qhull volume calculation
• removed old volume calculation code

[ascheibe]

r10209 missed a file in last commit (r10208)

[ascheibe]

r10210 removed unnecessary qhull projects

[ascheibe]

r10211 added a wrapper for calculating the convex hull using qhull

[ascheibe]

r10222

• improved qhull wrapper
• cleaned up unit tests

[ascheibe]

r10223 removed lrs code from the main solution as this did not work out as expected

[ascheibe]

r10224

• added more performance tests
• tried to mute qhull

[ascheibe]

r10262 also allow unsafe code for release configurations

[ascheibe]

r10272 improved convex hull modifier for test functions

[ascheibe]

r10274 added calculation of the centroid of a convex hull and measures for motion characteristics

[ascheibe]

r10275 added calculation of diameter and updated convex hull modifier to calculate the new measures

[ascheibe]

r10279 added calculation of the ratio between the convex hull volume and the max. hypercube volume

[ascheibe]

r10283 added volume ratios for incremental convex hull building over generations

[ascheibe]

r10284 added missing plugin dependencies

[ascheibe]

r10286 added support for calculating big volumes

[ascheibe]

r10287 adapted convex hull modifier to use fractions for big volumes

[ascheibe]

r10288 fixed ratio calculation

[ascheibe]

r10289 fixed another bug

[ascheibe]

r10301 fixed hypercube volume calculation

[ascheibe]

r10416 adapted branch to changes of #2119

[ascheibe]

r11180 added unit test

[ascheibe]

r11181 small change in view

[ascheibe]

r11182 added another unit test

[ascheibe]

r11613 deleted algorithm behavior branch as this has been moved to another repository