Opened 9 years ago
Last modified 5 years ago
#2431 assigned feature request
Algorithm performance comparison by ECDF — at Initial Version
Reported by: | abeham | Owned by: | abeham |
---|---|---|---|
Priority: | medium | Milestone: | HeuristicLab 3.3.17 |
Component: | Analysis | Version: | branch |
Keywords: | Cc: |
Description
The empirical cumulative distribution function can be calculated from several runs of an optimization algorithm. From a first-hit graph several targets will be defined in the objective function and it will be measured when a target is hit by an algorithm. The proportion of all these hits forms the empirical cumulative distribution function (ECDF).
Necessary tasks:
- Create analyzers that calculate the quality progress with respect to function evaluations and also with respect to wall-clock time
- Create a run collection view that will calculate and compare the ECDF in one chart
Note: See
TracTickets for help on using
tickets.