Free cookie consent management tool by TermsFeed Policy Generator
wiki:Documentation/Howto/SetupHiveServer

Version 31 (modified by ascheibe, 9 years ago) (diff)

--

How to ... setup a Hive server

This page gives you instructions about how to setup and run a Hive server.

Certificate and Authentication

  • Follow the documentation on service development
  • Notes on using SQL Server 2008 R2:
    • In the connection string the .\SQLEXPRESS should be changed to . . For example in the command to create the ASP.NET authentication database: aspnet_regsql.exe -C "data source=.;Integrated Security=SSPI" -A all -d HeuristicLab.Authentication.
    • If the above mentioned command fails with a timeout, the error could be a compatibility problem between the 2005 and 2008R2 SQL Server versions. SQL Server Management Studio offers the option in the database properties to set the compatibility level to SQL Server 2005 and this should fix the problem.
  • Goto Windows Services > start Distributed Transaction Coordinator service (needed to use transactions over multiple databases)

Setup IIS

  • In the Server Manager (or on Windows 8 and beyond in Programs and Features and then Turn Windows features on or off) add
    • Non-HTTP Activation under .NET Framework 3.5.1 Features
    • ASP.NET 4.5 and WCF-Services from .NET Framework 4.5 Advanced Series
    • Web Management Tools and World Wide Web Services from Internet Information Services
  • Go to Windows Services and start NetTcpActivator and NetTcpPortSharing services
  • Open IIS Manager
  • Create an application pool (Hive-3.3, .net 4.x, integrated)
    • Open advanced settings of the application pool and select NetworkService as identity (if you don't have your own identities for IIS AppPools)
    • Set Disable Overlapping Recycle to true. This avoids that multiple AppDomains are created which causes problems in Hive-3.3.
  • Create a new website (or use an existing one)
  • Go to bindings of the website.
    • Add a http-binding with port 80.
    • Add a net.tcp-binding with port 808 (Binding information: 808:*)
  • Create a new application within the website and call it Hive-3.3 and use the already created appPool Hive-3.3
  • Open advanced settings of the application and enter http, net.tcp as enabled protocols
  • Grant the usergroup IIS_IUSRS read-permissions on the application directory
  • Grant the NETWORK SERVICE group read access to the certificate you created in UsersHowtosDevelopServices
  • For the charting to work in the Status.aspx page, a folder for caching the images has to be created. The default, as configured in the Web.config, is C:\TempImageFiles\. Note that Network Service must have read and write permissions to this folder.
  • Allow port 808 in Firewall
    • For Windows Firewall enable Windows Communication Foundation Net.TCP Listener Adapter (TCP-In) Rule in Inbound Rules

Add groups and users to the authentication db

  • Open the Hive Visual Studio solution
  • Click on the Hive-3.3 Web project. In the solution explorer the ASP.NET Configuration button shows up. As mentioned in Documentation/DevelopmentCenter/Develop Services this allows to configure users and groups. On the configuration website, first add the groups:
    • Hive Administrator
    • Hive Slave
    • Hive User
    • Hive IsAllowedPrivileged
  • Users can now be added to the appropriate groups.
  • A special user for hive slaves must be added. This user has to be in the Hive Slave group. The default configuration is
    • User: hiveslave
    • Password: hiveslave

Webservice client setup

  • All clients (slave, administration, experiment manager) have an app.config file which contains a certificate tag under <identity>. To get this value for the local server execute svcutil.exe http://localhost/Hive-3.3/HiveService.svc?wsdl. This generates the client stub for the hive webservice. In the output.config file you will find the certificate tag with the right value. Replace all keys in the hive clients with this key of your machine.

Setup Hive database

  • Open the SQL Server Configuration Manager.
  • Right click the SQL Server (MSSQLSERVER) and select properties.
  • In the Filestream Tab enable Filestream for Transact-SQL access and Filestream for file I/O streaming access.
  • Restart the service.
  • Open the SQL Server Management Studio and create a new database called HeuristicLab.Hive-3.3
  • Open a new Query and enter the commands: 
    EXEC sp_configure filestream_access_level, 2
GO
RECONFIGURE
GO
  • Go to the Properties of the new Database.
    • Select the Filegroup page and add a new Filestream called FileStream and use it as default.
    • Go to the Files page and add a new file HeuristicLab.Hive-3.3_FileStream with type Filestream and the Filegroup FileStream you created in the previous step. Set the Path where HeuristicLab.Hive-3.3 database is located.
    • In the Options page set Recovery model(at the top) to Simple and Auto Shrink to True.
  • Use the SQL Server Management Studio to open and execute the following two scripts in this order:
    • Initialize Hive Database.sql
    • Prepare Hive Database.sql
    • If you have already installed an older Hive-Server version (< 3.3.x) and want to keep your data while updating to a newer version, execute Migrate to Filestream.sql instead. You have to execute the previous steps to enable the Filestream before executing the migration script.
  • All scripts can be found in HeuristicLab.Services.Hive.DataAccess\3.3\SQL Scripts\
  • Use the SQL Server Management Studio to create a new login for the NETWORK SERVICE group (or the identity you defined when creating the application pool): In Object Explorer: Security -> Logins -> right click (New Login...). Next you have to add the login to the two created HeuristicLab databases (HeuristicLab.Hive-3.3, HeuristicLab.Authentication) in the Users section (in Object Explorer: Databases -> HeuristicLab.* -> Security -> Users -> right click (New User...)).

Setup Access Service database

Hive uses HeuristicLab's Access Service. This service is a wrapper around ASP.NET's authentication service and provides besides user management also client management functionality. Hive directly uses the Access Service's assemblies, so you don't have to set up the Access service, but you need to create the database:

  • Use the SQL Server Management Studio to open and execute the following three scripts in this order (located in HeuristicLab.Services.Access.DataAccess\3.3\SQL Scripts\):
    • Create AccessServiceDB.sql
    • Initialize AccessServiceDB.sql
    • Create Initial Values.sql
  • Add the user NETWORK SERVICE (or the identity you defined when creating the application pool) to the database: in the Users section (in Object Explorer: Databases -> HeuristicLab.AccessService -> Security -> Users -> right click (New User...) give the new user at least read and write access.

Setup Access and Hive Service

Deployment of both services is done by compiling the HeuristicLab 3.3 Services solution (checkout the HeuristicLab trunk sources) and then copying the assemblies and configuration files to the web server:

  • For Hive: Copy the content from folder sources\HeuristicLab.Services.Hive.Web\Hive-3.3\Bin\ to the server to path ...\Hive-3.3\bin\
  • Copy sources\HeuristicLab.Services.Hive.Web\Hive-3.3\HiveService.svc and sources\HeuristicLab.Services.Hive.Web\Hive-3.3\Web.config to the server to path ...\Hive-3.3\
  • For the AccessService, the files from the bin folder (e.g. in \sources\HeuristicLab.Services.Access\3.3\bin\Debug) and the 2 configuration files also have to be copied to the server to ...\AccessService-3.3\.

Install the Janitor Service

There are some tasks on the server that have to be executed periodically. Previously this logic was executed with the heartbeats that the slaves sent. Because this lead to performance problems there is now an own windows service with an installer. The installer is created with the NSIS (Nullsoft Scriptable Install System). Download and install NSIS from ​http://nsis.sourceforge.net/. The installer scripts are located in the Installers directory in the source tree. Right-click on the file HiveJanitorServiceInstaller.nsi and select Compile NSIS Script. If everything works, you get, in the same directory, a file called HeuristicLab Hive Janitor Service Installer.exe. You can now copy and install this file on your server. Please note that you have to compile the HeuristicLab Services solution before as the installer just takes the binaries and creates the installer out of them. You can open *.nsi files with a text editor to see what's actually happening. You can also find there, at the beginning of the file, that BUILDCONFIGURATION is set to Debug. If you want to package Release binaries change this in the nsi file and rebuild the Services solution using Release mode.

Problems and solutions

  • Exception Could Not Load Type System.ServiceModel.Activation.HttpModule
    • run aspnet_regiis.exe -iru
  • "HTTP-Fehler 500.19 - Internal Server Error: Dieser Konfigurationsabschnitt kann in diesem Pfad nicht verwendet werden. Dies ist der Fall, wenn der Abschnitt auf übergeordneter Ebene gesperrt ist. Die Sperrung erfolgt standardmäßig (overrideModeDefault="Deny") oder wird explizit mit einem location-Tag mit overrideMode="Deny" oder der Legacyeinstellung allowOverride="false" festgelegt." 
    Konfigurationsquelle
  139:   <system.webServer>
  140:     <modules runAllManagedModulesForAllRequests="true">
  141:       <add name="HiveServerModule" type="HeuristicLab.Hive.Server.Core.IISModules.HiveServerModule"/>
    • Open Visual Studio command prompt as administrator and go to %windir%\system32\inetsrv\config
    • Enter "notepad applicationHost.config"
    • Search for the line 
      <section name="modules" allowDefinition="MachineToApplication" overrideModeDefault="Deny" />
    • Change overrideModeDefault to Allow.

How to update Hive server

Updating the server is as simple as copying the new binaries into the "/bin" folder of the website. Of course changes to the database need to be done accordingly. It is no problem if there are slaves calculating during the update if it takes only a few seconds. If the update lasts longer than one minute ("SlaveHeartbeatTimeout") the slaves will be identified to be timed out as the server goes online again and their jobs will be lost.

Changing the URL of the Hive server

The default URL for Hive is ​http://services.heuristiclab.com/Hive-3.3/HiveService.svc. If you are building your own Hive server, you need to change this URL as well as the certificate string in all configuration files. This has to be done for

  • the server in the Web.config
  • for the HeuristicLab.Clients.Hive-3.3 project in the app.config (client endpoint)
  • and the HeuristicLab.Clients.Hive.Slave-3.3 project in the app.config (client endpoint)

After this change you have to recompile everything. The slave as well as the Job Manager and Administrator should now connect to your Hive server.

Hive Web Site

You can setup a web site (WebApp) that can show you more information about Hive's state (which jobs are currently calculting, how many jobs are in the queue,...). For more information have a look at Hive Statistics Setup.