Implement project management for Hive

[jkarder]

Hive jobs should be assigned to projects instead of resources. We could better track resource usage per project and introduce some kind of credit system. Furthermore, this would allow us to assign one resource to different projects, which is currently not possible using resource groups.

fHolzing: In the "Select Project"-View, changing the selection of HiveSlaves via up/down arrow won't update the "Computing Resources"-Details.
By checking the Checkbox besides the Project (in my case HEAL), the slaves cannot be unchecked independently.
By Right-clicking on any Slave, the "Computing Resources" are updated, just like the selection (for a fraction of a second). The selection gets reverted und jumps back to the previously selected item, but the "Computing Resources" still displays the information about the now unselected item.

[jkarder]

r15377: created branch for hive project management

[jkarder]

r15378: worked on database model

[jkarder]

r15379:

• added Project and ProjectPermission DAOs and service methods
• made Project.EndDate nullable

[jkarder]

r15380: worked on Project and ProjectPermission service methods

[jkarder]

r15399: worked on database model

[jkarder]

r15401:

• worked on hive administrator view
• updated service clients

[jkarder]

r15411: worked on database model

[jkarder]

r15412:

• worked on resources and projects views
• changed resource selector to be able to select projects and assigned resources
• updated service clients

[jkarder]

r15422: worked on resources and projects views

[jzenisek]

r15496: Added Dao for ResourcePermission entity

[jzenisek]

r15497: worked on permission check at AddTask

[jzenisek]

r15500: worked on resource permission checks (v2 = accelerated version)

[jzenisek]

r15503: added ResourcePermission handling (still in progress)

[jzenisek]

r15508: finalized permission checks in AddTask and revised implementation of ResourcePermission methods

[jzenisek]

r15523: worked on db model and updated dbml

[jzenisek]

r15526: reverted changes from last revision (r15523)

[jzenisek]

r15527:

• updated dbml (removed ResourcePermission and ResourceIds in Job-Table)
• updated Resource and Project Daos

[jzenisek]

r15528: added AssignedJobResource to dbml and Daos

[jzenisek]

r15530:

• worked on Job operations add&update
• worked on ProjectPermission handling
• worked on Project-Resource assignment

[jzenisek]

r15540: added checks for the administration of project-resource assignments

[jzenisek]

r15546: worked on ProjectResource assignment: (cascading) assigning & unassigning

[jzenisek]

r15547: worked on ProjectResource assignment: (cascading) assigning & unassigning (reverted changes of config files from r15546)

[jzenisek]

r15552: worked on permission checks in listing methods

[jzenisek]

r15557: fixed tree building routine in ResourcesView

[jzenisek]

r15559: worked on views for Projects and ProjectResources

[jzenisek]

r15567: worked on views for project and resource administration

[jzenisek]

r15576: worked on client side mgmt of project-resource assignments and project-user permissions

[jzenisek]

r15577: worked on service side mgmt of project-resource assignments and project-user permissions

[jzenisek]

r15580:

• minor bugfix in HiveService.cs
• corrected behavior of ProjectPermissionsView

[jzenisek]

r15627: worked on Hive Job Manager: improved project/resource selector to show existent assignments and preserve selections

[jzenisek]

r15628:

• updated TaskDao towards independency of the formerly used Task-Resource assignment entity
• updated several permission/assignment handling service methods for client
• added AssignedJobResource DTO

[jzenisek]

r15630:

• updated Heartbeat processing (regarding: checking against AssignedJobResources and handling of the updated Job deletion routine)
• updated Job deletion routine (still in progress at GenerateStatistics)

[jzenisek]

r15641: finished implementation of job deletion routine

[jzenisek]

r15642:

• adapted handling of cascading revocations of project-user permissions and project-resource assignments: from deleting all AssignedJobResource (formerly) to deleting only entries which are effected by the previously mentioned revocations (now)
• implemented job update (client side)
• corrected & improved stateful project/resource selection dialog
• corrected resource statistic calculation in project/resource selection dialog

[jzenisek]

r15643:

• worked on UpdateJob(..)
• adapted permission and assignment handling methods
• adpated dbml of HiveDataContext using the designer (added delete rules and onNull-handling)

[jzenisek]

r15644: removed AssignedTaskResource entity

[jzenisek]

r15658:

• worked on (restricted) accessibility of hive's administration area for non-admin roles
• adapted HiveClient & HiveAdminClient entity loading (client- & service-side)

[jzenisek]

r15659:

• added DimProject and FactProjectInfo entities to statistics generation
• implemented tracking for projects

[jzenisek]

r15666: implemented project facts-logging in HiveStatisticsGenerator

[jzenisek]

r15671:

• adapted computation of DimClient and FactClientInfo stats
• adapted web app according to new stats computation

[jzenisek]

r15715: improved permission checking of HiveService methods

[jzenisek]

r15716: worked on stats generation

[jzenisek]

r15737:

• updated sql scripts (necessary foreign key option alterations & introduction of statistic tables)
• updated HiveService according to changed client side (deletion-routine, permission checking,...)

[jzenisek]

r15742: worked on HiveAdministrator:

• corrected and modified CRUD operations
• improved usability by providing detailed state information, adding dialogs etc.

[jzenisek]

r15760:

• minor changes regarding project- & resource selection
• adapted DeleteOnNull rules in dbml

[jzenisek]

r15761: renamed branch according to guidelines

[jzenisek]

r15767: fixed cyclic-relation bug in projects- and resources-view by preventing parents from being dragged onto descendants

[jzenisek]

r15768: fixed cyclic-relation bug (part 2: HiveAdminClient)

[jzenisek]

r15777: improved project- & resource selection handling

[jzenisek]

r15792: preliminary integration of several HiveAdministrator related improvements from #2877 (full merge pending)

• slaves and slave groups are sorted by name
• slave state is indicated by different colors
• number of contained slaves is shown for each group
• CPU utilization is shown for each calculating slave
• last heartbeat date is shown for each offline slave

[jzenisek]

r15813: improved HiveAdmin interactions:

• collaps groups with slaves only
• update scheduleView only if currently visible
• made schedule scrollable for non-admins
• changed selection backcolor
• fixed add/delete project permission bug for non-admins

[jzenisek]

r15819: implemented refreshing list of available (i.e. for non-admins assignable) resources depending on currently selected project

[pfleck]

I would also like to have some additional features (mainly GUI wise) for the "Nr. of needed cores" for the Hive tasks.

• Currently, the combobox to set the nr of cores is not working (no event registered), although, the rest of Hive already propagates the nr of needed cores correctly.

• For a scenario where a batch run of algorithms should be distributed, setting the nr of cores needed for all tasks is quite tedious. Maybe, setting the nr of cores needed on the batch run propagates the demand to its children.

• An option for Nr of needed cores that represents "all cores" could be useful (also with respect to executing ParallelEngines in Hive). Such a tasks should only be scheduled on a slave where no other tasks are currently running and the task will use up all available cores.

[jkarder]

r15908: worked on hive project management

• fixed some bugs
• cleaned up

[jzenisek]

r15913: updated genealogy computation for hive job administrator

[jzenisek]

r15914: fixed several bugs in resource selector

[jzenisek]

r15920: fixed several bugs in JobAdmin:

• disabled play button if no project or resource is selected
• extract stats for selected or alternatively for checked resources
• collapse slaves-only groups if no slave is assigned explicitly
• prevent unnecessary resource tree rebuilds (reset and style instead)
• suppress double clicks in resource tree (i.e. prevent win forms check-error)

...

[jzenisek]

r15922:

• replaced use of TreeView with NoDoubleClickTreeView everywhere allegedly reasonable for Hive
• updated genealogy computation for HiveAdminClient and corresponding views (ResourcesView & ProjectResourcesView)

[jzenisek]

r15925: fixed bug in HeartbeatManager (more specific: corrected check if a task via its parenting job is still granted for a certain resource)

[jzenisek]

r15933: several fixes:

• rebuilt run in hive
• adapted numeric selector (added FixedNumericUpDown.cs)

[jzenisek]

r15953: Several changes and fixes:

• added button tooltips
• changed position of buttons
• added refresh functionality to view of lightweight users ...

[jzenisek]

r15954: updated behavior of permission assignment for project owners (client and server side)

[jzenisek]

r15955:

• fixed refresh in resource view
• fixed assignment/include behavior in permission view

[jzenisek]

r15956:

• fixed project/resource selector in HiveJobManager
• added error provider to project/resource selector
• changed datetime pickers in HiveAdmin...

[jzenisek]

r15966: Fixed several bugs and added project duration handling

• fixed project duration handling (client- & service-side)
• fixed tagging in HiveJobAdmin
• added ProjectJobs view (under construction)
• added necessary service methods

[jzenisek]

r15969: finalized ProjectJobsView

[jzenisek]

r15978: applied several fixes:

• show full project-path in project/resource selector
• handle lost of project-ownership by not withdrawing permissions
• update automatically after hand-down save
• lock jobs for which statistics/deletion is pending
• lock the disabled checkbox in ProjectResourcesView...

[jzenisek]

r15992: fixed couple of minor issues:

• changed tags in resource selector
• added project information in job list and adapted sortation
• fixed hand-down save by withdrawing additional offset-rights (permissions, resources),...

[jzenisek]

r15995: adapted illustration of project and resource ancestry in HiveAdministrator and HiveJobAdministrator

[jzenisek]

r16040: fixed handling of project related updates for project owners, who are no admins and do not own parent projects

[jzenisek]

r16043: adapted handling of project start/end boundaries for non-admins

[jzenisek]

r16044:

• adapted icons: replaced ".PublishToWeb" with ".Save"
• pre-select project with all resources for new jobs, if it is the only available

[jkarder]

r16050: fixed connection string

[jkarder]

r16057:

• merged [15377-15681/trunk/sources] into branch
• merged [15683-16056/trunk] into branch

[jkarder]

r16060: worked on hive project management

• added .ToList() calls within some service methods to prevent TransactionExceptions
• added check for InvokeRequired
• improved RunInHiveMenuItem
• removed .resx files from projects

[jkarder]

r16062: worked on hive project management

• removed .resx file from project

[jkarder]

r16064: worked on hive project management

• fixed bug in StyleTreeNode

[jkarder]

r16066: worked on hive project management

• improved RunInHiveMenuItem

[jkarder]

r16068: worked on hive project management

• derived UserListView, UserGroupListView and RoleListView from ItemCollectionView<T>

[jzenisek]

r16072: worked on HiveProjectMgmt:

• adapted enabled state of buttons

[jzenisek]

r16089: updated setting enabled state of controls in project view

[jkarder]

r16091: worked on hive project management

• updated app/web configs and settings

[jkarder]

r16092: merged [16057-16091/trunk] into branch

[jkarder]

r16093: worked on hive project management

• removed usage of null-conditional operator

[jkarder]

r16094: worked on hive project management

• removed usage inline out variables and string interpolation

[jkarder]

r16095: worked on hive project management

• removed usage of null-conditional operator

[jkarder]

r16116: worked on hive project management

• fixed plugin dependencies
• fixed NullReferenceException in HiveTaskView
• added cloning ctor for AssignedJobResource and AssignedProjectResource

[jkarder]

r16117: merged [15377-16116/branches/2839_HiveProjectManagement] into trunk

[jkarder]

r16122: worked on hive project management

• fixed handling of enabled states in ResourcesView