Checked operator information is lost in run

[abeham]

The information which operator is checked in a CheckedMultiOperator<T> is lost in the run as the checked information is not collected. Related to #1695 that changed parameter collection.

[gkronber]

This issue has been discussed in the architects meeting. And it was decided that we do not fix this for milestone 3.3.7.

[gkronber]

Should not be too much effort to implement this.

[abeham]

r9838: changed parameter collection for runs, so that the "checked" information is available.

There will be problems should an operator ever contain a value parameter called "Checked", that is to be collected and that operator is included in a checked multi operator. Currently, the string "Checked" doesn't appear in our solution anywhere.

Overall, I'm not that happy with how MultiOperators are collected. Keys such as "Crossover.0" are not helpful in the run analysis at all. Using the name of the operator (e.g. OrderCrossover2) instead of the parameter (e.g. 0) would make more sense, but unfortunately could lead to clashes when the same operator is added to a CheckedMultiOperator multiple times (e.g. in different parameterizations). Also the way the probabilities are collected (as array) is not suitable for analysis. What do you think?

[gkronber]

Reviewed r9838.

The order of operators in the list is sometimes relevant. Therefore, it would not be useful to use the operator name as key in the results.

Further considerations:

• unchecked operators do not have an effect so it would be sufficient to store only checked operators in the results. In this case we don't need to store the 'checked' flag separately
• maybe we should not split the list of operators into separate results at all. Similarly to the list of probabilities, it could be sufficient to use only at the combination of (checked) operators in analyses. E.g., if a single crossover should be analysed the algorithm should be configured to use only that single operator. Instead if pairs of operators should be analysed in combination, then runs with different operator pairs should be executed, and it would be sufficient to have the operator combination as string in the results.

[abeham]

r9934:

• Changed behavior to output results only of those operators that have been checked
• Removed additional "Checked" result

[gkronber]

Reviewed and tested r9934. This can be merged into stable.

[abeham]

r9942: merged into stable branch