Opened 5 years ago

Last modified 5 years ago

#1665 assigned defect

If the random seed is specified for a cross-validation then the same seed is used for each fold

Reported by: gkronber Owned by: gkronber
Priority: medium Milestone: HeuristicLab 3.3.x Backlog
Component: Algorithms.DataAnalysis Version: 3.3.5
Keywords: Cc:

Description


Change History (5)

comment:1 Changed 5 years ago by gkronber

  • Status changed from new to accepted

comment:2 Changed 5 years ago by gkronber

  • Milestone changed from HeuristicLab 3.3.6 to HeuristicLab 3.3.x Backlog
  • Owner changed from gkronber to mkommend
  • Priority changed from highest to medium
  • Status changed from accepted to readytorelease
  • Summary changed from Cross-validation does not initialize the random seed randomly to If the random seed is specified for a cross-validation then the same seed is used for each fold

When debugging this it has become clear that actually the seed is initialized correctly but the parameter value stored in the cross-validation run is not updated. This is only to be expected because a separate instance of the algorithm is created and executed for each fold. So for each fold a different random seed is used.

I'm renaming this ticket because we do not have a way to set the random seed for the CV run explicitly. Either the random seed is initialized randomly or the same seed is used for each fold. This is a different problem than the one for which the ticket has been created initially and it has a lower priority.

comment:3 Changed 5 years ago by gkronber

Not yet 100% sure if the random seed is updated for each fold. Please investigate this.

comment:4 Changed 5 years ago by mkommend

  • Status changed from readytorelease to assigned

comment:5 Changed 5 years ago by gkronber

  • Owner changed from mkommend to gkronber
Note: See TracTickets for help on using tickets.