Resource Management Specification
Overview
Resource Management focuses on the optimal exploitation of software and hardware resources. Software resources include a range of entities from packages ready to be deployed to already activated services, while hardware resources model anything hosting a service suitable to be exploited by the e-infrastructure.
Resource Management covers the entire lifecycle of such resources through a set of services and libraries. This document outlines their design rationale, key features, and high-level architecture as well as the opportunities they collectively offer.
Key features
- Dynamic Deployment
- First-class features for deploying gCube software and external software packaged following the gCube policies
- Optimal Resource Allocation
- ...
- Node management and Monitoring
- Tools for monitoring and managing nodes of the infrastructure are part of the resource management facilities. Local information are collected and published in the Information System as well as returned on demand. Web Service interfaces exposed by locally hosted services allow to remotely reconfigure the node upon the needs of the infrastructure.
- Scalability
- ...
- Extensible Bridging over Virtual Platforms
- A flexible model, named Virtual Platform, for transparently interfacing a potentially unlimited number of hosting environments. By extending this model, new platforms can be easily integrated in the existing management facilities and new software resources added to the infrastructure. An extension is also provided to manage Web Applications on Apache Tomcat 6.x.
- Maven Integration
- ...
- Coordination and Elastic Management
- ...
- Cloud-orientation
- Gateway to Cloud platforms with Java support
Design
Philosophy
The Data e-Infrastructure requires dynamic allocation of services and nodes and a strong capability to adapt itself to changes occurring during its operation. Components of Resource Management subsystem address these requirements by providing a robust ground for the overall infrastructure lifetime.
Software has different externalizations at different level, ranging from a tarball of binaries to an activated instance hosted on a platform. Resource management has to deal with such different forms and the designed architecture respect this view.
Different components have different perceptions of the resources. There are components operating at a logical level (VO and VRE) that only matter about how to optimize the VO/VRE delivered functionality by replicating/duplicating services when they see this need. These components do not obviously care of the physical form of the software and will never change if it will. Other components work at service level (the constituents of the VO/VRE) and know how to optimize their allocation. Finally, there exist components that operates at local level (node) and manage only local deployed software.
Other principle on which the design of the presented architecture is piled are:
- components must be generic with respect to the resource managed
- fault recovery is a crucial feature: nodes and services have always to be in a consistent state
- external software has to be as transparently as possible managed in the same way of the gCube software
Architecture
- Resource-Manager
- Resource-Broker
- Resource-Broker-Serialization
- Software-Gateway
- VRE-Modeler
- gHN-Manager
- Deployer
- Virtual-Platform
- Virtual-Platform for Tomcat6
- RainyCloud
Deployment
Usually, a subsystem consists of a number of number of components. This section describes the setting governing components deployment, e.g. the hardware components where software components are expected to be deployed. In particular, two deployment scenarios should be discussed, i.e. Large deployment and Small deployment if appropriate. If it not appropriate, one deployment diagram has to be produced.
Large deployment
A deployment diagram suggesting the deployment schema that maximizes scalability should be described here.
Small deployment
A deployment diagram suggesting the "minimal" deployment schema should be described here.
Use Cases
The subsystem has been conceived to support a number of use cases moreover it will be used to serve a number of scenarios. This area will collect these "success stories".
