Opened 6 years ago

Closed 5 years ago

#1607 closed enhancement (done)

Implement an operator that calculates quality difference according to a linear interpolation between a given min and max value

Reported by: abeham Owned by: abeham
Priority: medium Milestone: HeuristicLab 3.3.6
Component: Analysis Version: 3.3.6
Keywords: Cc:

Description

The QualityDifferenceCalculator scales the difference by the deviation to the BestKnownQuality. This measure is often used to compare algorithm performance between different problem instances. However if the range of these instances is different, even an identical performance would result in different relative differences.

A better comparison can be made when also using some kind of worst quality and calculate the difference by linear interpolation in that quality range. A good value for a worst quality could be to take an average of randomly selected quality values which form the baseline for measuring fitness improvement.

Change History (8)

comment:1 Changed 6 years ago by abeham

  • Owner changed from swagner to abeham
  • Status changed from new to assigned

comment:2 Changed 6 years ago by abeham

  • Status changed from assigned to accepted

comment:3 Changed 6 years ago by abeham

r6615

  • Added ScaledQualityDifferenceAnalyzer

comment:4 Changed 6 years ago by abeham

r6616

  • fixed a bug in the ScaledQualityDifferenceAnalyzer

comment:5 Changed 6 years ago by abeham

  • Owner changed from abeham to swagner
  • Status changed from accepted to reviewing
  • Version changed from branch to 3.3.5

r6628

  • merged to trunk

comment:6 Changed 5 years ago by abeham

r7245

  • Adding results with the parameter's translated name instead of the actual name

comment:7 Changed 5 years ago by swagner

  • Owner changed from swagner to abeham
  • Status changed from reviewing to readytorelease

Thanks for implementing this operator. I reviewed the changes and have no additional comments.

comment:8 Changed 5 years ago by swagner

  • Resolution set to done
  • Status changed from readytorelease to closed
  • Version changed from 3.3.5 to 3.3.6
Note: See TracTickets for help on using tickets.