Opened 13 years ago
Closed 13 years ago
#1607 closed enhancement (done)
Implement an operator that calculates quality difference according to a linear interpolation between a given min and max value
| Reported by: | abeham | Owned by: | abeham |
|---|---|---|---|
| Priority: | medium | Milestone: | HeuristicLab 3.3.6 |
| Component: | Analysis | Version: | 3.3.6 |
| Keywords: | Cc: |
Description
The QualityDifferenceCalculator scales the difference by the deviation to the BestKnownQuality. This measure is often used to compare algorithm performance between different problem instances. However if the range of these instances is different, even an identical performance would result in different relative differences.
A better comparison can be made when also using some kind of worst quality and calculate the difference by linear interpolation in that quality range. A good value for a worst quality could be to take an average of randomly selected quality values which form the baseline for measuring fitness improvement.
Change History (8)
comment:1 Changed 13 years ago by abeham
- Owner changed from swagner to abeham
- Status changed from new to assigned
comment:2 Changed 13 years ago by abeham
- Status changed from assigned to accepted
comment:3 Changed 13 years ago by abeham
comment:4 Changed 13 years ago by abeham
- fixed a bug in the ScaledQualityDifferenceAnalyzer
comment:5 Changed 13 years ago by abeham
- Owner changed from abeham to swagner
- Status changed from accepted to reviewing
- Version changed from branch to 3.3.5
- merged to trunk
comment:6 Changed 13 years ago by abeham
- Adding results with the parameter's translated name instead of the actual name
comment:7 Changed 13 years ago by swagner
- Owner changed from swagner to abeham
- Status changed from reviewing to readytorelease
Thanks for implementing this operator. I reviewed the changes and have no additional comments.
comment:8 Changed 13 years ago by swagner
- Resolution set to done
- Status changed from readytorelease to closed
- Version changed from 3.3.5 to 3.3.6
r6615