AutoDiff support for interval calculation

[gkronber]

Support for interval arithmetic has been added in #2966.

This allows us to calculate an approximation for the value range when expressions are evaluated. We want to consider the output interval also within optimization of numeric parameters of models. Therefore, we need to be able to calculate gradients for intervals.

Changes in this ticket include our own implementation of automatic differentiation (AutoDiff) for symbolic expressions with support for the BatchInterpreter and the IntervalInterpreter.

(Depends on #2966, #2958, #2435 (alglib 3.15.0), #2971)

[gkronber]

r16671: created branch for ticket.

[gkronber]

r16673: merged r16672 from trunk to branch

[gkronber]

r16674: worked on AutoDiff implementation based on BatchInterpreter

[gkronber]

r16682: worked on auto diff for intervals and vectors

[gkronber]

To work with this branch you first need to build trunk and then build the branch #2435 and the branch #2971 (override selected dlls in bin with new features from branches)

[gkronber]

r16686: changed Double -> double

[mkommend]

What about prefixing each algebraic type with algebraic to have a clear indication of which types can be used in interpreters?

e.g. Double -> AlgebraicDouble

[gkronber]

r16693: worked on implementations of remaining methods for IAlgebraicType

[gkronber]

r16694: implemented remaining methods for IAlgebraicType and changed formatting

[gkronber]

r16695: renamed classes Algebraic..., added DebuggerDisplay attributes to simplify debugging. Fixed bugs in static methods for Algebraic

[gkronber]

r16696: added a separate plugin with an algorithm for constrained non-linear regression

[gkronber]

r16697: missing files for r16696 (+ svn:ignore)

[gkronber]

r16698: fixed version of HeuristicLab.Random plugin

[gkronber]

r16727: added a unit test and made some minor improvements to interpretation of trees

[gkronber]

r16738: another unit test, smaller fixes and checks for invalid parameters

[gkronber]

r16739: merged r16670:16737 from trunk to branch

[gkronber]

r16742: fix for compatibility with #2971

[gkronber]

r16744: slightly changed calculation of integer powers for intervals and added unit tests.

[gkronber]

r16829: merged changesets r16740:16822 from trunk to branch

[gkronber]

r16831: made required changes to work with current trunk

[gkronber]

r16911: merged r16839:16910 from trunk to branch

[gkronber]

r16912: added a new plugin for extension classes based on new functionality in this branch and added an evaluator that uses new AutoDiff

[gkronber]

r16913: svn:ignore

[gkronber]

r16914: implemented a first version of an evaluator with const opt and constraints for intervals

[gkronber]

r16915: add boundary constraints and threshold for epsx hoping to prevent endless loop in alglib, add optimization of variable weights

[gkronber]

r16941: make branch compile with NamedIntervals branch, disable alglib optguard, copylocal = false

[gkronber]

r16943: merge r16933:16942 from trunk to branch

[gkronber]

r17120: merged r17007:17118 from trunk to branch

[gkronber]

r17130: merged r17121:17128 from trunk to branch

[gkronber]

r17131: added support for tanh symbol in new interpreters

[gkronber]

r18163: push of old local changes