Opened 6 years ago

Closed 6 years ago

#1600 closed enhancement (done)

Ensemble solutions are evaluated twice on creation

Reported by: mkommend Owned by: gkronber
Priority: high Milestone: HeuristicLab 3.3.6
Component: Problems.DataAnalysis Version: 3.3.6
Keywords: Cc:

Description (last modified by gkronber)

RegressionEnsembleSolutions and ClassificationEnsembleSolutions are derived from the according base class (RegressionSolution or ClassificationSolution) and their results are calculated in the base class constructor. As the evaluation works differently in ensemble solutions the results must be recalculated which leads to another evaluation of the training and test samples that can be quite costly.

Change History (17)

comment:1 Changed 6 years ago by mkommend

  • Summary changed from Ensemble solution are evaluated twice on creation to Ensemble solutions are evaluated twice on creation

comment:2 Changed 6 years ago by mkommend

  • Status changed from new to accepted

comment:3 Changed 6 years ago by mkommend

r6588:

  • Corrected result descriptions in DataAnalysisSolution.
  • Added NMSE results in IRegressionSolution.
  • Split RegressionSolution into a concrete implementation class and an abstract base class RegressionSolutionBase that could also be used for RegressionEnsembleSolutions or CachingRegressionSolutions.
  • Moved calculation of results in specific regression solution implementations (e.g. SymbolicRegressionSolution).

comment:4 Changed 6 years ago by mkommend

r6589: Adapted classification solutions to the same design as used by regression solutions.

comment:5 Changed 6 years ago by mkommend

r6590: Corrected typo in ensemble solutions (paritions => partitions).

comment:6 Changed 6 years ago by mkommend

r6591: Corrected compilation error in DiscriminantFunctionClassificeationSolutionEstimatedValuesView.

comment:7 Changed 6 years ago by mkommend

r6592: Changed ensemble solutions to sealed classed.

comment:8 Changed 6 years ago by mkommend

  • Owner changed from mkommend to gkronber
  • Status changed from accepted to reviewing

comment:9 Changed 6 years ago by mkommend

  • Owner changed from gkronber to mkommend
  • Status changed from reviewing to assigned

comment:10 Changed 6 years ago by mkommend

  • Status changed from assigned to accepted

comment:11 Changed 6 years ago by mkommend

r6602: Moved implementation of RecalculateResults into abstract base class RegressionSolution.

comment:12 Changed 6 years ago by mkommend

r6603: Added possibility to create regression solutions from regression models.

comment:13 Changed 6 years ago by mkommend

r6604: Added possibility to create classification solutions from classification models.

comment:14 Changed 6 years ago by mkommend

  • Owner changed from mkommend to gkronber
  • Status changed from accepted to reviewing

This ticket includes several changes to the overall design of solution and models, so please take a detailed look at the source changes.

comment:15 Changed 6 years ago by gkronber

  • Description modified (diff)

comment:16 Changed 6 years ago by gkronber

  • Status changed from reviewing to readytorelease

Reviewed r6588:6592 and r6602:6604 everything seems alright.

comment:17 Changed 6 years ago by swagner

  • Resolution set to done
  • Status changed from readytorelease to closed
  • Version changed from 3.3.5 to 3.3.6
Note: See TracTickets for help on using tickets.