Support changing of constants and variable weights in the simplifier for symbolic data analysis models

[bburlacu]

The SymbolicDataAnalysisExpressionTreeSimplifier should offer users the possibility of interactively changing constant values or variable weights.

Additionally, the tree model in the simplifier view should support the following operations:

• inserting an intermediate symbol between two nodes (ideally by selection or drag&drop from the available grammar)
• removing nodes/sub-trees (removing intermediate symbols or whole branches)
• "moving" nodes/sub-trees (manual simplification/collapsing or just some kind of copy/paste operation)

[bburlacu]

r7361: Updated project references, added build and solution files.

[bburlacu]

r7388: Added a new context option for leaf nodes (ConstantTreeNode or VariableTreeNode) to change the value or variable weight respectively.

• Added new dialog: SymbolicExpressionTreeNodeChangeValueDialog
• Added new SymbolicExpressionTreeNodeChanged event and handler
• Changed the double click behavior to account for node value/weight changes

Overall the behavior has been slightly changed: if a node was folded(replaced by a ConstantTreeNode), then it is possible to change its value via the context menu. For all changed nodes the original value is kept in a dictionary, so the first double click will restore it. After that, a second double click will unfold the node.

[bburlacu]

r7411: Improved ValueChangeDialog and overall behavior. Implemented pruning operation on background thread. TODO: Test, improve. This is a work-in-progress.

[bburlacu]

r7422: The simplifier view now uses a clone of the current model, on which the actual simplification or tree pruning is applied. This fixes a crash when the user clicks on the Symbolic Regression Model while the background thread is pruning the tree (because it was trying to display the tree while it was being changed). Also took out the display part from the CalculateReplacementNodesAndNodeImpacts method and put it in a separate method.

[bburlacu]

r7784: Moved replacement and impact values calculation code from view to separate files. Implemented simplifier actions: copy, cut, delete, insert node/subtree.

[gkronber]

In this ticket there are no commits on the trunk. Should we move it to milestone 3.3.8?

[bburlacu]

r8388: Rebranched the TreeSimplifier project to fix merging errors. Added functionality to insert symbols into the tree, fixed bug when deleting tree nodes.

[mkommend]

r8390: Removed outdated branch HeuristicLab.TreeSimplifierView.

[mkommend]

r8391: Removed unnecessary Plugin.cs files from repository.

[mkommend]

r8392: Merged trunk changes into HeuristicLab.TreeSimplifier branch.

[mkommend]

r8395: Removed unnecessary PreBuildEvent.cmd in projects.

[mkommend]

r8915: merged changes from trunk into the simplifier branch.

[bburlacu]

r8916: Added HeuristicLab.Problems.DataAnalysis.Symbolic.Classification.Views and HeuristicLab.Problems.DataAnalysis.Symbolic.Regression.Views to the branch. Removed prune button, minor functionality improvements.

[mkommend]

Review Comments:

• The view flickers when the tree is modified.
• Changing the variable / constant value does only react on enter (missing validated logic).
• Changing the variable does only react on enter.
• Remove the closing cross (upper right corner of the dialog) and add an OK and Cancel button.
• Delete node results in an exception if the tree consists only of one node.
• Add license header to all created source files
• TreeEditDialogs
  • Do not use _ as prefix for private members
  • Remove properties which just change the name of a member (e.g., NewValueTextBox, Caption)
  • Do not call events directly. Always add OnEvent methods which include a null check before the event is called.
  • Use OnEventName methods for event firing instead of registering to an event
• Use designer file for control configuration as much as possible (e.g., InteractiveSymbolicExpressionTreeChart context menu strip is configured in the ctor).
• Get rid of DisableTreeEditingMenuItems in InteractiveSymbolicExpressionTreeChart (just do not open den context menu if no entries should be displayed).
• Use using blocks for dialogs (e.g., using(var dialog = new Dialog())) for automatic disposing of allocated resources.
• Implement / remove TODO entries and commented code.
• Prepare the SymbolicExpressionTreeChart consistently for sub-classing.
• Refactor impact value calculation.

[bburlacu]

r8935: Bugfixes and refactoring as suggested in the comments above.

[mkommend]

r8937: Merged recent trunk changes into the branch.

[mkommend]

r8942: Merged changes from TreeSimplifier branch to Encodings.symbolicExpressionTreeEncoding.Views.

[mkommend]

r8946: Merged remaining changes from the TreeSimplifier branch in the trunk and refactored impact values calculators.

[mkommend]

r8947: Deleted obsolete tree node change dialog.

[mkommend]

r8950: Forgot to update the corresponding project file in r8947.

[mkommend]

r8960: Removed scaling in SymbolicRegressionSolutionImpactValuesCalculator as this does does not have any effect as long as the impact is calculated on the basis of the R².

[bburlacu]

r8980: Refactored the tree simplifier. Improved tree/node edit operations.

[bburlacu]

r8981: Forgot to set DialogResult in the InsertNodeDialog, fixed two omissions in the InteractiveSymbolicExpressionTreeChart.

[bburlacu]

r8986: Surrounded disposable graphics objects with using blocks.

[mkommend]

r8990: Minor improvements and code simplification in symbolic data analysis simplifier.

[bburlacu]

r8991: Fixed bug when displaying an invalid tree. Simplified operation set and renamed actions (delete -> remove, edit -> change).

[bburlacu]

r9006: Refactored the tree simplifier again: moved tree editing functionality into the view, fixed minor display bugs.

[bburlacu]

r9043: Fixed tree chart visual node coloring issues and some corner-case tree editing bugs.

[bburlacu]

r9046: Removed branch since the changes have already been integrated into the trunk.

[bburlacu]

r9052: Very minor change in the CalculateImpactValue method for symbolic regression (renamed internal variable).

[mkommend]

r9055: Minor refactoring in tree simplifier and according views. Additionally model updates are displayed in the according views.

[bburlacu]

r9056: Disabled paste option when attempting to cut/paste a subtree into itself.

[bburlacu]

r9057: Fixed bug in subtree cut/paste introduced with previous commit, simplified code.

[bburlacu]

r9445: We found a bug in the InteractiveSymbolicDataAnalysisSolutionSimplifierView: when the user removes one of the linear scaling nodes from the tree (using the new tree editing functionality) then clicks optimize, an exception is raised by the constants optimizer.

We removed the tree editing functionality from the trunk, to be added again and fixed after the release.

[gkronber]

Please accept this ticket before working on it.

[bburlacu]

r9930: Removed empty unused folder in the HeuristicLab.Problems.DataAnalysis.Symbolic.Views project.

[gkronber]

This seems to be almost ready for release. If possible we could plan to release these changes with 3.3.10.

[bburlacu]

Branched this functionality into branches/HeuristicLab.InteractiveTreeSimplifier

[bburlacu]

r10957: Added a special arity check for multiplication and addition symbols that invalidates the tree when the node has less than 2 subtrees. Disabled right-hand side details box when the tree is invalid.

[bburlacu]

r11010: Added solution containing the HeuristicLab.Problems.DataAnalysis.Symbolic.Views project. Updated folder structure. Added PreBuildEvent.cmd.

[bburlacu]

r11086: Introduced tree editing functionality directly into the trunk code, with minor changes: simplified drawing (eg when highlighting subtrees from the clipboard), fixed small bug in MinArity function. The branch can be deleted.

[mkommend]

r11101: Removed branch for interactive tree simplifier.

[mkommend]

The source code looks fine. However, there are three things that must be fixed before this ticket could be released:

• The design of the insert / change node dialogs must be improved (spacing, ...)
• It should not be possible to insert group symbols (e.g., terminals) in the tree. If a group symbol is chosen for insertion an exception is thrown.
• The label for the tree status should only be displayed if the tree is invalid. Maybe it would be better to display it within the tree chart in the lower left corner.

[bburlacu]

r11111: Improved alignment of node edit dialogs. Removed GroupSymbols from the list of available symbols when inserting new nodes. Added additional condition disallowing paste operations when it exceeds a symbols max arity. Moved tree status indicator to lower left and changed visibility to appear only when the tree is invalid.

[bburlacu]

r11112: InteractiveSimplifierView: Fixed image resources in the designer file.

[bburlacu]

r11115: Fixed width of variable weight text box in the InsertNodeDialog.

[mkommend]

r11123: Adapted size of tree chart in simplifier view.

[mkommend]

r11150: Merged r9930, r11086, r11111, r11112, r11115, r11123 into stable (all other changes were already merged to the stable branch.