Difference between revisions of "Data Transfer Scheduler & Agent components"

From Gcube Wiki
Jump to: navigation, search
(Overview)
(Overview)
Line 3: Line 3:
 
== Overview ==
 
== Overview ==
  
This class of components manages transfer capabilities among  gCube infrastructure nodes, in particular it can handles data transfer between Data Sources and Data Storages exploiting the interfaces  and the services implemented under the [[Data Access and Storage Facilities]] subsystem.  
+
This class of components manages transfer capabilities among  gCube infrastructure nodes, in particular but not only it can handles data transfer between Data Sources and Data Storages exploiting the interfaces  and the services implemented under the [[Data Access and Storage Facilities]] subsystem.  
  
 
This document outlines the  design rationale, key features, and high-level architecture,  the options for their deployment and as well some use cases.
 
This document outlines the  design rationale, key features, and high-level architecture,  the options for their deployment and as well some use cases.
  
 
=== Key features ===
 
=== Key features ===
 +
 +
The components belonging to this class are responsible for:
 +
 +
;reliable data transfer between Data Source and Data Storages
 +
 +
;structured and unstructured Data Transfer
 +
 +
;transfers to local nodes
 +
 +
;advanced transfer schedules and transfer optimization
  
 
== Design ==
 
== Design ==

Revision as of 15:51, 18 April 2012

Intro

Overview

This class of components manages transfer capabilities among gCube infrastructure nodes, in particular but not only it can handles data transfer between Data Sources and Data Storages exploiting the interfaces and the services implemented under the Data Access and Storage Facilities subsystem.

This document outlines the design rationale, key features, and high-level architecture, the options for their deployment and as well some use cases.

Key features

The components belonging to this class are responsible for:

reliable data transfer between Data Source and Data Storages
structured and unstructured Data Transfer
transfers to local nodes
advanced transfer schedules and transfer optimization

Design

Philosophy

Architecture

fugyre

Deployment

Large Deployment

figure

Small Deployment

figure

Use Cases

Well suited use cases

Less well suited use cases