Hyperbolic functions for symbolic regression

[bwerth]

Since the integrals of some hyperbolic functions are already included but not the functions themselves, and the hyperbolic tangent / logistic function is a widely used symbol in regression, they should be made available for non-linear/symbolic-regression.

[gkronber]

Please see the changes that were necessary for the integration of Abs(), AQ(), cube() and cuberoot() in ticket #2915 and add tanh() as a new symbol for symbolic regression.

[msemenki]

r16375: Add support for hyperbolic tangent symbol.

[gkronber]

I reviewed the changes in r16375.

Please, also add support for the new symbol to the NativeInterpreter, BatchedInterpreter, and TreeToAutoDiffTermConverter.

[msemenki]

Support of new symbol to the BatchedInterpreter and TreeToAutoDiffTermConverter has added in r16531

[gkronber]

r16654: merged r16364:16653 from trunk to branch to prepare for trunk reintegration (resolving conflicts in the project file)

[gkronber]

r16655: converted class HyperbolicTangent for new persistence

[gkronber]

r16656: merged r16375, r16531, r16655 from branch to trunk (using "Merge two different trees" because I was not able to automatically merge changesets)

[gkronber]

@msemenki: if you have further local changes for the branch in your working copy please commit to the branch so we can merge remaining changes to the trunk. I'm going to delete the branch once the changes are merged to stable.

[gkronber]

r16668: added support for tanh to the remaining interpreters (native is missing)

[gkronber]

r16670: bugfixes for r16668

[bburlacu]

r16701: Support hyperbolic tangent in native interpreter.

[mkommend]

I have accidentally tested this new symbol yesterday because I have modeled a problem with all trigonometric functions enabled and was not aware that the hyperbolic tangent is already included. An issue exists that the excel exporter does not work. It exits without producing a file, displaying an error or an exception if a model containing a hyperbolic tangent should be exported.

[gkronber]

Ok, we should check all formatters / exporters. Should be straight-forward to add tanh.

[bburlacu]

r16702: Add tanh to all formatters except the TSQLExpressionFormatter, since TSQL does not have a TANH function (could be approximated but ugly).

[gkronber]

Reviewed r16701. The only minor comment I have is that the macro hl_inv(x) = 1./x can be improved to 1./(x)

[gkronber]

Reviewed r16702.

[gkronber]

merge together with: #2966

[gkronber]

Replying to mkommend:

I have accidentally tested this new symbol yesterday because I have modeled a problem with all trigonometric functions enabled and was not aware that the hyperbolic tangent is already included. An issue exists that the excel exporter does not work. It exits without producing a file, displaying an error or an exception if a model containing a hyperbolic tangent should be exported.

I tested all formatters, interpreters and the Excel export after r16702 and found no more issues.

[mkommend]

r17101: Merge 16656, 16668, 16670, 16701, 16702 into stable

[gkronber]

r17285: delete branch for closed ticket