Data Sublayer

Introduction

The Data Sublayer is responsible for the Open Information life cycle management, which includes indexing, transformation, storage, dissemination, and consumption. In this section, we introduce the DSL and its fundamental components.

A topology of the Data Sublayer.

A topology of the Data Sublayer.

RSS3 Protocol

The RSS3 Protocol is used to structure Open Information for interoperability.

Open Information, indexed from multiple Permissionless Data Sources (PDSs), is structured by Nodes (Nodes) into the Protocol format for interoperability.

PDSs use different data structures; Within a PDS, there might be multiple products, services, and protocols that leverage different data structures to suit their needs. This lack of standardization means limited interoperability, limiting the creation of scalable applications.

The Protocol addresses this issue by offering a unified set of data structures that serve as an abstraction. This abstraction simplifies the integration process, making it more manageable and scalable for developers to work with data across various PDSs.

RSS3 Node

An RSS3 Node is responsible for indexing, transforming, storing, and ultimately serving Open Information to the end users. Each Node then operates a number of Workers to cover different data sources available on the Open Web.

See Node.

RSS3 Global Indexer

A GI is responsible for facilitating coordination among Nodes and engaging with the VSL and performs critical functions to ensure the DSL is robust and reliable.

See 🧭 Global Indexer.