Difference between revisions of "Data Transfer Agent"
From Gcube Wiki
Andrea.manzi (Talk | contribs) (→Data Transfer Agent Library) |
Andrea.manzi (Talk | contribs) (→Data Transfer Agent Service) |
||
| Line 8: | Line 8: | ||
* Tree based data transfer from a remote Data Source to a remote Tree-Based Storage. | * Tree based data transfer from a remote Data Source to a remote Tree-Based Storage. | ||
| − | The service make use of gRS to implement Local Transfer, Tree based Data Transfer and delivery of Transfer Outcomes to clients. | + | The service make use of gRS to implement Local Transfer, Tree based Data Transfer and delivery of Transfer Outcomes to clients. |
| + | |||
| + | In addition the service exploit the Messaging infrastructure in order to publish transfer statistics, that can be consumed by: | ||
* Accounting statistics consumers | * Accounting statistics consumers | ||
| Line 14: | Line 16: | ||
In order to get more information about the whole Data Transfer Architecture please check .. | In order to get more information about the whole Data Transfer Architecture please check .. | ||
| − | |||
== Data Transfer Agent Library == | == Data Transfer Agent Library == | ||
The Data Transfer Agent Library is the CL implementing the API for Data Transfer. In particular the Library implement the API to contact the [[#Data Transfer Agent Service|Data Transfer Agent Service]] | The Data Transfer Agent Library is the CL implementing the API for Data Transfer. In particular the Library implement the API to contact the [[#Data Transfer Agent Service|Data Transfer Agent Service]] | ||
Revision as of 15:39, 31 May 2012
Data Transfer Agent Service
The Data Transfer Agent Service has been implemented with the aim of facilitating the transfer of data ( both structured and unstructured ) for the following use cases:
- Transfer of Local files from an external/internal client to a remote GHN
- File Transfer from a remote Data Source to a remote GHN using standard protocol ( HTTP, FTP, BitTorrent) thanks to the integration with the URLResolution Library.
- File Transfer from a remote Data Source to the gCube Storage Manager ( MongoDB) using standard protocol ( HTTP, FTP, BitTorrent) thanks to the integration with the URLResolution Library.
- Tree based data transfer from a remote Data Source to a remote Tree-Based Storage.
The service make use of gRS to implement Local Transfer, Tree based Data Transfer and delivery of Transfer Outcomes to clients.
In addition the service exploit the Messaging infrastructure in order to publish transfer statistics, that can be consumed by:
- Accounting statistics consumers
- the Data Transfer Scheduler Service, which use messaging in order to consume Agent transfer results.
In order to get more information about the whole Data Transfer Architecture please check ..
Data Transfer Agent Library
The Data Transfer Agent Library is the CL implementing the API for Data Transfer. In particular the Library implement the API to contact the Data Transfer Agent Service
