Opened 4 years ago

Closed 4 years ago

#2088 closed task (done)

Restructure Unit Tests

Reported by: abeham Owned by: mkommend
Priority: medium Milestone: HeuristicLab 3.3.9
Component: Tests Version: 3.3.8
Keywords: Cc:

Description

Unit Tests are to be renamed according to the naming convention and to be categorized according to the dimensions.

Change History (22)

comment:1 Changed 4 years ago by abeham

  • Status changed from new to accepted

comment:2 Changed 4 years ago by abeham

r9764: Renamed namespaces (removed _33 and _34 postfixes)

comment:3 Changed 4 years ago by mkommend

r9765:9775: Removed useless brackets in the TestMethod attribute and added test categories and properties for SymExpTreeEncoding unit test.

Sorry for the separated changesets.

Last edited 4 years ago by abeham (previous) (diff)

comment:4 Changed 4 years ago by abeham

r9777: Added test attributes and cleaned up tests of the encodings

comment:5 Changed 4 years ago by abeham

r9778: Added test attributes to persistence unit tests

comment:6 Changed 4 years ago by abeham

r9782: Added test attributes to further tests

comment:7 Changed 4 years ago by mkommend

r9783: Adapted HL-3.3.Tests, Algorithms.DataAnalysis.Tests, and Collections.Test.

r9784: Forgot to commit unit test project.

comment:8 Changed 4 years ago by abeham

r9785: Added test attributes for Problems.DataAnalysis

comment:9 Changed 4 years ago by abeham

r9786: Added essential attribute to plugin infrastructure tests

comment:10 Changed 4 years ago by abeham

r9792:

  • Removed bin folder as a DeploymentItem and added it as a path to search for assemblies
    • Start of unit tests is greatly sped up
  • Changed PluginLoader to use AppDomain.CurrentDomain.BaseDirectory as directory for loading plugins
  • Pruned references in .csproj and set CopyLocal to false for all referenced HL assemblies

comment:11 Changed 4 years ago by mkommend

r9803: Removed unused testContextInstance fields in the unit tests.

comment:12 Changed 4 years ago by mkommend

r9806: Changed unit tests to be executable on the builder.

comment:13 Changed 4 years ago by mkommend

r9807: Fixed test list

comment:14 Changed 4 years ago by mkommend

r9810: Removed assembly base directory attribute.

comment:15 Changed 4 years ago by mkommend

  • Milestone changed from HeuristicLab 3.3.x Backlog to HeuristicLab 3.3.9
  • Owner changed from abeham to gkronber
  • Status changed from accepted to reviewing

comment:16 Changed 4 years ago by abeham

Please also review the changes to the developer guidelines.

comment:17 Changed 4 years ago by gkronber

Reviewed changes to developer guidelines and r9810, r9806:9807, r9803, r9792, r9782:9786, r9777:9778, r9764:9775.

One drawback of the changes is that the test history on the builder has been lost. Please give a reason why the number of unit tests executed by the builder is now smaller:

  • stable: Release: 322, Debug: 9
  • trunk: Release: 306, Debug: 13
Last edited 4 years ago by gkronber (previous) (diff)

comment:18 Changed 4 years ago by gkronber

  • Owner changed from gkronber to abeham

comment:19 Changed 4 years ago by abeham

  • Owner changed from abeham to mkommend
  • Status changed from reviewing to readytorelease

Several tests were removed as they were not really necessary:

  • BlendAlphaBetaCrossoverConstructorTest
  • BlendAlphaCrossoverConstructorTest
  • DiscreteCrossoverConstructorTest (2x)
  • LocalCrossoverConstructorTest
  • MichalewiczNonUniformAllPositionsManipulatorConstructorTest
  • MichalewiczNonUniformOnePositionManipulatorConstructorTest
  • PolynomialAllPositionManipulatorConstructorTest
  • PolynomialOnePositionManipulatorConstructorTest
  • RandomConvexCrossoverConstructorTest
  • SimulatedBinaryCrossoverConstructorTest
  • SinglePointCrossoverConstructorTest (3x)
  • SinglePositionBitflipManipulatorConstructorTest
  • SomePositionsBitflipManipulatorConstructorTest
  • UniformOnePositionManipulatorConstructorTest (2x)
  • etc.

In the debug builds 4 tests have been added:

  • CollectGASample
  • NamedItemTestNameNotEmpty
  • BuildTypeTest
  • IsSubTypeOfTest

These are quick to compute requiring less than 6 seconds.

comment:20 Changed 4 years ago by mkommend

r9885: Merged all changesets regarding the unit test restructuring in the stable branch.

comment:21 Changed 4 years ago by mkommend

I leave this ticket open to correct potential build fails.

comment:22 Changed 4 years ago by mkommend

  • Resolution set to done
  • Status changed from readytorelease to closed

Everything works as expected.

Note: See TracTickets for help on using tickets.