Opened 3 years ago

Closed 3 years ago

#2278 closed enhancement (done)

New quality measures for ClassificationSolutions

Reported by: mkommend Owned by: mkommend
Priority: medium Milestone: HeuristicLab 3.3.11
Component: Problems.DataAnalysis Version: 3.3.10
Keywords: Cc:

Description

The sensitivity and specificity should be calculated for classification solutions. Further interesting measures would be the precision, negative predictive value, false positive rate, or the false discovery rate.

http://en.wikipedia.org/wiki/Sensitivity_and_specificity

Change History (30)

comment:1 Changed 3 years ago by mkommend

  • Status changed from new to accepted
  • Version changed from 3.3.10 to branch

comment:2 Changed 3 years ago by mkommend

r11603: Branched HL.Problems.DataAnalysis to implement the new quality measures for classification solutions.

comment:3 Changed 3 years ago by mkommend

r11604: Adapted solution and project settings in ClassificationExtensions branch.

comment:4 Changed 3 years ago by mkommend

  • Owner changed from mkommend to epitzer
  • Status changed from accepted to assigned

r11606: Added the possibility to specify a positive class in ClassificationProblemData.

comment:5 Changed 3 years ago by mkommend

r11607: Adapted IClassificationProblemData interface (added positive class name).

comment:6 Changed 3 years ago by mkommend

  • Owner changed from epitzer to ehopf

comment:7 Changed 3 years ago by ehopf

  • Status changed from assigned to accepted

comment:8 Changed 3 years ago by ehopf

r11622: Implemented classification quality measures

  • true positive rate
  • true negative rate
  • positive predictive value
  • negative predictive value
  • false positive rate
  • false discovery rate
Last edited 3 years ago by ehopf (previous) (diff)

comment:9 Changed 3 years ago by mkommend

r11643: Merged trunk changes (update to .NET 4.5)

comment:10 Changed 3 years ago by ehopf

r11683:

  • Classification performance measures improvements in terms of readablity of the code.
  • Added positive class value to the classification performance measures result collection.
  • Fixed bug: classification performance measures will now be calculated after loading from files with non serialized performance measures results.

comment:11 Changed 3 years ago by ehopf

r11684: Encapsulated the classification performance measures to the ClassificationPerformanceMeasuresResultCollection

comment:12 Changed 3 years ago by ehopf

r11685: Improvements on the classification performance measures encapsulation

comment:13 Changed 3 years ago by ehopf

r11686: Added missing Exception descriptions.

comment:14 Changed 3 years ago by ehopf

r11687: Branched HeuristicLab.Optimization

comment:15 Changed 3 years ago by ehopf

r11688: Adapted project and solution settings in ClassificationExtensions branch.

comment:16 Changed 3 years ago by ehopf

r11689: Added methods to collect result values to the ResultCollection-class.

comment:17 Changed 3 years ago by ehopf

  • Owner changed from ehopf to mkommend
  • Status changed from accepted to reviewing

comment:18 Changed 3 years ago by ehopf

r11718: Replaced the collect result values method in the ResultCollection-class.

comment:19 Changed 3 years ago by ehopf

r11719: Changed the used collect results values method to the new method in the Algorithm-class.

comment:20 Changed 3 years ago by ehopf

r11720: Fixed infinite loop.

comment:21 Changed 3 years ago by mkommend

r11761: Minor code cleanup in classification extensions.

comment:22 Changed 3 years ago by mkommend

r11762: Merged changes in HL.Optimization into the trunk. r11763: Merged changes in HL.Problems.DataAnalysis into the trunk.

For a stable release the two changesets above must be merged into stable.

r11764 must also be included in the stable release.

Last edited 3 years ago by mkommend (previous) (diff)

comment:23 Changed 3 years ago by mkommend

  • Status changed from reviewing to readytorelease

r11764: Deleted branch for classification extensions.

comment:24 Changed 3 years ago by mkommend

  • Version changed from branch to 3.3.10

comment:25 Changed 3 years ago by mkommend

  • Status changed from readytorelease to assigned

comment:26 Changed 3 years ago by mkommend

r11766: Renamed positive class parameter to satisfy the parameter visibility unit test and fixed cloning of classification performance measures.

comment:27 Changed 3 years ago by mkommend

  • Status changed from assigned to reviewing

comment:28 Changed 3 years ago by mkommend

  • Status changed from reviewing to readytorelease

comment:29 Changed 3 years ago by mkommend

r11872: Merged r11762, r11763, r11764 and r11766 into stable.

comment:30 Changed 3 years ago by mkommend

  • Resolution set to done
  • Status changed from readytorelease to closed
Note: See TracTickets for help on using tickets.