Implement basic infrastructure for optimization networks

[swagner]

To Do:

• check handling of locked and read-only state of controls
• executable networks

Topics for Discussion:

• design in general
  • how much logic should be included in a port?
  • problem of generic view types
  • exception handling
  • how to bridge the gap between internal and external ports of networks?
  • declarative definition of results
• port-to-port communication
  • clone value?
  • how to switch threads?
  • should ports propagate their values immediately when they are connected?
• data types
  • POCOs vs. IItems
  • generic vs. non-generic types (e.g. ports)
• AlgorithmNode
  • port updates due to result changes (speed, events)

This ticket has to be merged into stable after #1265

[swagner]

Created branch OptimizationNetworks in r11062.

[swagner]

Added new empty plugins (HeuristicLab.Modeler, HeuristicLab.Optimization.Networks) in r11063.

[swagner]

Added new empty plugin HeuristicLab.Optimization.Networks.Views in r11069.

[swagner]

Worked on optimization networks in r11177.

[swagner]

Worked on optimization networks in r11401.

[swagner]

Worked on optimization networks in r11406.

[swagner]

Worked on optimization networks in r11409.

[swagner]

Worked on optimization networks in r11412.

[swagner]

Worked on optimization networks in r11421.

[swagner]

Worked on optimization networks in r11423.

[swagner]

Worked on optimization networks in r11431.

[swagner]

Worked on optimization networks in r11438.

[swagner]

Worked on optimization networks in r11449.

[swagner]

Worked on optimization networks in r11451.

[swagner]

Worked on optimization networks in r11452.

[swagner]

Worked on optimization networks in r11454.

[swagner]

Worked on optimization networks in r11463.

[swagner]

Worked on optimization networks in r11465.

[swagner]

Worked on optimization networks in r11468.

[swagner]

Worked on optimization networks in r11481.

[swagner]

Worked on optimization networks in r11489.

[swagner]

Worked on optimization networks in r11490.

[swagner]

Worked on optimization networks in r11500.

[swagner]

Worked on optimization networks in r11501.

[swagner]

Worked on optimization networks in r11519.

[swagner]

Worked on optimization networks in r11520.

[swagner]

Worked on optimization networks in r11526.

[swagner]

Worked on optimization networks in r11527.

[swagner]

Results of code review with abeham, mkommend, ascheibe:

• check item descriptions and item images (done)
• check access modifiers (public, protected, private)
• change formatting of multi-line LINQ queries (indentation, points should be at the beginning and not at the end of a line) (done)
• IEntity, Entity
  • rename to INetworkItem and NetworkItem (done)
  • remove the Path property and the PathChanged event (done)
  • add a generic way for error handling to propagate errors through multiple network items (e.g. if a node contains a port with an invalid port connection, the node itself should also show an error)
• Node
  • should be abstract (done)
  • add additional checks in the setter of the Parent property to reduce the danger of invalid values when the setter is accidentally called directly
• IGenericNode, GenericNode (done)
  • rename to IUserDefinedNode and UserDefinedNode or find an even better name (done)
  • should be sealed (done)
• Network (done)
  • should be abstract (done)
  • Nodes should not be changeable by default (similar to Ports in Node) (done)
  • derive sealed IUserDefinedNetwork and UserDefinedNetwork (find an even better name?) (done)
• Port
  • add additional checks in the setter of the Parent property to reduce the danger of invalid values when the setter is accidentally called directly
• ParameterizedPort (done)
  • Parameters should not be changeable by default (similar to Ports in Node) (done)
• IGenericPort, GenericPort (done)
  • rename to IMessagePort and MessagePort (done)
  • only store the last message and not all messages (done)
  • refactor CanConnectToPort as there might occur a NullReferenceException and to avoid code duplication (done)
  • refactor PrepareMessage to avoid code duplication (done)
  • remove IConnectedPort (done)
  • add IConnectablePort to enable generic port connection handling in the GUI (done)
  • IMessagePort should implement IParameterizedPort and IConnectablePort (done)
• PortParameter
  • add additional checks in the setter of the Parent property to reduce the danger of invalid values when the setter is accidentally called directly
• PortParameterType (done)
  • remove None (done)
• AlgorithmNode (done)
  • replace algorithm.Runs.Clear() and algorithm.Prepare() by algorithm.Prepare(true) (done)
• HookOperator (done)
  • check if there is an operator parameter for each port parameter (done)
  • clone Port by default and prevent cloning when necessary by registering the port as its own clone (e.g. in AlgorithmNode when cloning the algorithm before its execution) (done)
• EntityView
  • increase the gap between the name label and the name textbox so that there is enough space to show the error icon if the name is not valid

[swagner]

r11528: Implemented review comments

• adapted formatting of multi-line LINQ queries
• renamed Entity to NetworkItem

[swagner]

r11529: Implemented review comments

• made Node and Network abstract
• renamed GenericNode to UserDefinedNode and sealed it
• added sealed UserDefinedNetwork
• made Nodes in Network not changeable by default
• made Parameters in ParameterizedPort not changeable by default
• removed value None in PortParameterType
• refactored call algorithm.PrepareMessage() in AlgorithmNode

[swagner]

r11530: Implemented review comments

• renamed GenericPort to MessagePort
• refactored CanConnectToPort
• refactored PrepareMessage
• removed IConnectedPort

Additional changes:

• added UserDefinedMessagePort
• refactored CloneConnectedPortParameters to CloneParametersFromPort and moved it to ParameterizedPort
• added ports to NetworkView

[swagner]

r11538: Implemented review comments:

• added IConnectablePort
• replaced MessagePort.Messages by MessagePort.LastMessage
• removed Path and PathChanged in NetworkItem

Additional changes:

• refactored CanConnectToPort
• refactored cloning of port parameters in MessagePortView

[swagner]

r11539: Small UI tweaks and bug fixes

[swagner]

r11554: Implemented review comments:

• added cloning of Port in HookOperator and prevented cloning of hook operator ports in AlgorithmNode instead
• added additional checks that port parameters of a hook operator port match with parameters of hook operator

[swagner]

r11562: Started working on programmable network items.

[swagner]

r11563: Continued working on programmable network items:

• implemented view and some refactoring

[swagner]

r11564: Continued working on programmable network items

[swagner]

r11565: Continued working on programmable network items

• allowed code changes only in user-defined nodes and networks
• added manual initialization of compiled programmable network items

[swagner]

r11576: Merged changes r11062:11557 from trunk/sources into branches/OptimizationNetworks

[swagner]

r11577: Restructured solution and projects and switched all projects to .NET 4.5

[swagner]

r11602: Continued working on programmable network items

• added VariableStore to all programmable network items

[swagner]

r11682: Worked on cancellation

• added throwing of OperationCanceledException in MessagePort.ReceiveMessage
• tweaked AlgorithmNode to get rid of exceptions when the algorithm is aborted

[swagner]

r11712: Implemented review comments:

• checked and adapted item images

[swagner]

r11713: Implemented review comments:

• checked and adapted item descriptions

[swagner]

r11714: Enabled port parameter changes in ConfigurationPort and ExecutionPort

[abeham]

r11823:

• Added cosolving KSPTSP network
• Fixed output path in projects for release target
• Fixed penalty in seqsolving KSPTSP network (would produce infeasible solutions)
• Added some additional references

[abeham]

r12232:

• changed branch to build to trunk
• Reintegrated distributed additions to Core, Operators, etc. into Networks plugin

[mkommend]

r12323: Added simple optimization network for solving features selection problems.

[gkronber]

r12324: renamed classes and files (hard coded network and connector)

[gkronber]

r12325: added solution cache

[gkronber]

r12326: derived SelectionProblem from BinaryProblem (now PPP can be used as feature selection algorithm)

[gkronber]

r12327: removed hard coded string for the retrieval of the regression solution to allow using other regression algorithms (e.g. RF)

[jkarder]

r12943: fixed deserialization of ProgrammableNetwork

[jkarder]

r12944: added code resources

[jkarder]

r12945: disabled compiler warning cs0436 for all code resources

[jkarder]

r13077: worked on optimization networks

• added first version of network visualization
• updated frame files

[jkarder]

r13135: worked on optimization networks

• refactored network visualization

[ascheibe]

r13459

• fixed another deserialization bug
• AlgorithmNode: made locker object protected so that inherited classes that override the Execute method can use it
• Improved responsiveness of ProgrammableItemView

[ascheibe]

r13467 fixed a bug in ProgrammableItemView introduced in r13459

[jkarder]

r13799: worked on optimization networks

• improved network visualization

[jkarder]

r13833: worked on optimization networks

• added layout algorithm prototype
• fixed bug in LoadVisualProperties methods

[jkarder]

r13839: worked on optimization networks

• added layout calculation for ports

[jkarder]

r13873: worked on optimization networks

• improved network visualization

[jkarder]

r14586: worked on optimization networks

• added projects for integrated optimization (orchestration)

[abeham]

r14587: Added FLP (facility location problem) for use within a network that solves the location routing problem (LRP)

[abeham]

r14595: Added OPL model for for the capacitated FLP (by vhauder) and a HeuristicLab algorithm to solve the model through CPLEX

[abeham]

r14596: unversioned Plugin.cs and AssemblyInfo.cs

[jkarder]

r14598: worked on optimization networks

• switched from IConfigurationPorts to IMessagePorts
• removed option to clone algorithms in OrchestratedAlgorithmNodes
• made properties of TourProfitProblem storable
• fixed event handler registration

[jkarder]

r14601: worked on optimization networks

• created separate project for ttp optimization
• removed some unused classes

[jkarder]

r14604: worked on optimization networks

• updated ttp networks (1, 2, 3)
• added lrp network (1)
• fixed plugin dependencies

[jkarder]

r14605: worked on optimization networks

• fixed vrp variegation in LrpOrchestratorNode1

[jkarder]

r14606: worked on optimization networks

[abeham]

r14607: added GetSolution() method to FLP

[jkarder]

r14610: worked on optimization networks

• added abstract base classes for ttp networks/orchestrators
• removed ttp networks/orchestrators from HeuristicLab.Networks.IntegratedOptimization
• runs can now be cleared when preparing OrchestratedAlgorithmNodes

[jkarder]

r14611: worked on optimization networks

[jkarder]

r14613: worked on optimization networks

• fixed event handler registration

[jkarder]

r14616: worked on optimization networks

[jkarder]

r14617: worked on optimization networks

[mkommend]

r14618: Corrected minor mistake in Layout.Vector struct (maybe connected to C# compiler version).

[mkommend]

r14619: Corrected project files for TTP networks.

[mkommend]

r14620: Corrected project files for NetworkVisulization.

[jkarder]

r14621: worked on optimization networks

• added lrp network 2
• minor code changes

[mkommend]

r14624: Refactored messages in orchestrated algorithm node.

[mkommend]

r14625: Added network for integrated machine learning.

[jkarder]

r14628: worked on optimization networks

• added variegation problem for minimization and maximization
• refactored some classes

[jkarder]

r14629: worked on optimization networks

• fixed bugs in ttp network/orchestrator 3

[mkommend]

r14631: Updated OrchestratedAlgorithmNode to work with problems as well.

[jkarder]

r14632: worked on optimization networks

• fixed project references

[jkarder]

r14633: worked on optimization networks

[jkarder]

r14635: worked on optimization networks

• created default parameters for orchestration and evaluation ports
• adapted FeatureSelectionNetwork

[jkarder]

r14639: worked on optimization networks

• fixed output paths

[abeham]

r14642: added disposal of errorhandler and datasource

[abeham]

r14646: Added version of FLP that minimizes opening costs only

[jkarder]

r14649: worked on optimization networks

• added lrp network 3
• fixed bug in distance calculation
• renamed FLP.mod to FLP_1.mod
• activated cma analyzer per default

[jkarder]

r14653: worked on optimization networks

• improved ttp evaluation

[jkarder]

r14671: worked on optimization networks

• added ttp as basic problem for baseline comparison

[mkommend]

r14675: Worked on optimization networks for integrated machine learning.

[abeham]

r14676: branched VRP and VRP.Views plugin

• adapted project files output path and references

[abeham]

r14677: added results tab to solution view to analyze vrp solution in more detail

• reorganized insertion infos and adapted some evaluators and instances

[abeham]

r14677 should be released (if at all) together with ticket #2733

[mkommend]

r14686: Updated FeatureSelectionOrchestrator.

[mkommend]

r14686: Updated FeatureSelectionOrchestrator.

[jkarder]

r14895: worked on optimization networks

• added lrp networks (4, 5)
• fixed lrp evaluation
• updated flp models
• updated to cplex 12.7

[jkarder]

r14896: worked on optimization networks

• fixed bug in lrp network 5

[jkarder]

r15894: fixed output paths and project references

[jkarder]

r15895: renamed branch according to guidelines

[jkarder]

r15896: added surrogate modeling network

[jkarder]

r15897: fixed svn:ignore properties