Data Retrieval Facilities
From Gcube Wiki
Overview
gCube provides Information Retrieval facilities over large heterogeneous environments. Sources of information that use different technologies, data representation and semantics can be integrated and exploited by gCube's Data Retrieval framework. The architecture and mechanisms provided by the framework ensure flexibility, scalability, high performance and availability.
The gCube Data Retrieval Framework aims at hiding the complexity of the underlying environment by:
- providing a declarative approach for querying the hosted information
- scaling to the number of hosted information sources
- Integrating dynamically external sources of information
Key Features
- Declarative Query Language over a heterogeneous environment
- gCube Data Retrieval framework unifies Data Sources that use different data representation and semantics through the CQL standard.
- On the fly Integration of Data Sources
- A Data Source that publishes its Information Retrieval capabilities can be on-the-fly involved in the IR process.
- Scalability in the number of Data Sources
- Planning and Optimization mechanisms detect the minimum number of Sources needed to be involved during query answering, along with an optimal plan for execution.
- Direct Integration of External Information Providers
- Through the OpenSearch standard, external Information Providers can be queried dynamically. The results they provide can be aggregated with the rest of results during query answering.
- Indexing Capabilities for Replication and High Availability
- Multidimensional and Full-text indexing capabilites using an architecture that efficiently supports replication and high availability.
- Distributed Execution Environment offering High Performance and Flexibility
- Efficient execution of search plans over a large heterogeneous environment.
Subsystems
Data Retrieval framework comprises the following two subsystems: