Data Transfer Scheduler & Agent components

Intro

Overview

This class of components manages transfer capabilities among gCube infrastructure nodes, in particular but not only it can handles data transfer between Data Sources and Data Storages exploiting the interfaces and the services implemented under the Data Access and Storage Facilities subsystem.

This document outlines the design rationale, key features, and high-level architecture, the options for their deployment and as well some use cases.

Key features

The components belonging to this class are responsible for:

reliable data transfer between Data Source and Data Storages

by exploiting the access interfaces provided by gCube and the

structured and unstructured Data Transfer

it guarantees both Tree based and

transfers to local nodes

advanced transfer schedules and transfer optimization

Design

Architecture

fugyre

Deployment

Large Deployment

figure

Small Deployment

figure