Opened 8 years ago

Closed 8 years ago

#1635 closed defect (done)

Symbolic regression variable impact calculation does not work for cross-validation runs

Reported by: gkronber Owned by: gkronber
Priority: medium Milestone: HeuristicLab 3.3.6
Component: Problems.DataAnalysis.Symbolic.Views Version: 3.3.6
Keywords: Cc:

Description


Change History (11)

comment:1 Changed 8 years ago by gkronber

  • Status changed from new to accepted

comment:2 Changed 8 years ago by gkronber

  • Owner changed from gkronber to mkommend
  • Status changed from accepted to reviewing

r6709:

  • symbolic regression variable impacts can be calculated for each fold separately for cross-validation runs.
  • Added a drop down box in the variable impact view to choose the fold.
  • Minor change: variable impacts are rounded to 3 decimal digits.

comment:3 Changed 8 years ago by gkronber

  • Milestone changed from HeuristicLab 3.3.x Backlog to HeuristicLab 3.3.6

comment:4 Changed 8 years ago by gkronber

r6766: added possibility to calculate impacts over all folds for cross validation runs.

comment:5 Changed 8 years ago by gkronber

r6775: fixed a crash when trying to calculate variable impacts for runs that did not collect statistics about variable frequency.

comment:6 Changed 8 years ago by gkronber

r6783: fixed a bug leading to incorrectly sorted row names in the variable impact view.

comment:7 Changed 8 years ago by mkommend

  • Owner changed from mkommend to gkronber
  • Status changed from reviewing to assigned

Comments:

  • An exception occurs if a run does not contain results for all folds (e.g.,it has been stopped before the execution was finished).
  • If a RunCollection contains CV runs with a different number of folds, no variable impacts can be shown.
  • The fold combo box should be invisible, when no CV runs are analyzed.
  • If CV runs are mixed with 'normal' runs in a RunCollection, the results for the 'normal' runs are not shown.
  • The labeling of the runs changes when the value of the folds combo box gets changed.

comment:8 Changed 8 years ago by gkronber

r7179: fixed the problems highlighted by the review of mkommend.

  • cleaned up code
  • added a check if there is a mix of normal and CV runs
  • added a check if all runs contain a variable impact result
  • added a check if all runs contain variable impacts for the same input variables
  • added code to hide and show the folds combobox and its label
  • changed the column names to show the same names when all folds are selected and when only specific folds are selected.

comment:9 Changed 8 years ago by gkronber

  • Owner changed from gkronber to mkommend
  • Status changed from assigned to reviewing

comment:10 Changed 8 years ago by mkommend

  • Owner changed from mkommend to gkronber
  • Status changed from reviewing to readytorelease

Thx for correcting these issues.

comment:11 Changed 8 years ago by swagner

  • Resolution set to done
  • Status changed from readytorelease to closed
  • Version changed from 3.3.5 to 3.3.6
Note: See TracTickets for help on using tickets.