Ticket #1665 (assigned defect)

Opened 19 months ago

Last modified 9 months ago

If the random seed is specified for a cross-validation then the same seed is used for each fold

Reported by: gkronber Owned by: gkronber
Priority: medium Milestone: HeuristicLab 3.3.x Backlog
Component: Algorithms.DataAnalysis Version: 3.3.5
Keywords: Cc:

Description


Change History

comment:1 Changed 19 months ago by gkronber

  • Status changed from new to accepted

comment:2 Changed 19 months ago by gkronber

  • Owner changed from gkronber to mkommend
  • Priority changed from highest to medium
  • Summary changed from Cross-validation does not initialize the random seed randomly to If the random seed is specified for a cross-validation then the same seed is used for each fold
  • Status changed from accepted to readytorelease
  • Milestone changed from HeuristicLab 3.3.6 to HeuristicLab 3.3.x Backlog

When debugging this it has become clear that actually the seed is initialized correctly but the parameter value stored in the cross-validation run is not updated. This is only to be expected because a separate instance of the algorithm is created and executed for each fold. So for each fold a different random seed is used.

I'm renaming this ticket because we do not have a way to set the random seed for the CV run explicitly. Either the random seed is initialized randomly or the same seed is used for each fold. This is a different problem than the one for which the ticket has been created initially and it has a lower priority.

comment:3 Changed 19 months ago by gkronber

Not yet 100% sure if the random seed is updated for each fold. Please investigate this.

comment:4 Changed 18 months ago by mkommend

  • Status changed from readytorelease to assigned

comment:5 Changed 9 months ago by gkronber

  • Owner changed from mkommend to gkronber
Note: See TracTickets for help on using tickets.