Free cookie consent management tool by TermsFeed Policy Generator

Opened 6 years ago

Closed 5 years ago

#2910 closed defect (done)

ImpactCalculation for IDiscriminantClassificationSolutions is wrong

Reported by: mkommend Owned by: mkommend
Priority: medium Milestone: HeuristicLab 3.3.16
Component: Problems.DataAnalysis Version: trunk
Keywords: Cc:

Description (last modified by mkommend)

The reason therefore is that the model parameters (threshold and class values) are not updated during modification of the model. As a result suboptimal node and variable impacts are calculated.

Change History (8)

comment:1 Changed 6 years ago by mkommend

  • Status changed from new to accepted
  • Version set to trunk

comment:2 Changed 6 years ago by mkommend

  • Description modified (diff)

comment:3 Changed 6 years ago by mkommend

  • Owner changed from mkommend to abeham
  • Status changed from accepted to reviewing

r15871: Added recalculation of thresholds for IDiscriminantClassificationModels during impact calculation.

I tested these changes with an existing SymbolicClassificationModel. However, I am unsure about the side effects of cloning the models that are introduced (GaussianProcesses, GradientBoostedTrees, ...).

comment:4 Changed 5 years ago by abeham

  • Owner changed from abeham to mkommend
  • Status changed from reviewing to assigned

I noticed that in the Simplifier when you move the threshold line, it constantly updates the UI on the model side and recalculates parameters. This may probably be somewhat expensive. I don't know if this is a problem.

comment:5 Changed 5 years ago by mkommend

  • Status changed from assigned to readytorelease

Thank you for reporting this issue. It should not pose a problem, because the calculation is aborted (AFAIK), when the model is updated in the mean time.

comment:6 Changed 5 years ago by gkronber

Tried to merge r15871 but this fails.

#2884 and #2871 also have changes on ClassificationSolutionVariableImpactsCalculator and must be merged first.

comment:7 Changed 5 years ago by mkommend

r16434: Merged r15871 into stable.

comment:8 Changed 5 years ago by mkommend

  • Resolution set to done
  • Status changed from readytorelease to closed
Note: See TracTickets for help on using tickets.