Data Processing Introduction
The ONE platform flexibly processes and transforms externally integrated data through data streams, integrating and correlating data from various types and sources to achieve observability of business systems. It serves as the core component for building business observability within the ONE platform.
Prerequisites
- Ingestion tasks has been created in Data Integration.
Key Terms
| Key Term | Description |
|---|---|
| Data Source | The origin of observable data, such as Prometheus or Zabbix. |
| Data Tasks | A task for processing data sources, created through the Data Integration page. |
| Data stream | The processing pipeline for source data. Each task can have only one deployed data stream, and data stream can be quickly constructed using a drag-and-drop approach. |
Data Processing Stream
After the data ingestion task is created, the received data will undergo data stream processing and complete data storage. With powerful data processing components and flexible data stream configurations, any data processing can be accomplished. Introduction to the Data Stream Editing Page.
Integration Tasks
Manage tasks created through data integration. Data received by tasks will be processed sequentially according to the components in the deployed data stream, ultimately aggregating the data into the ONE platform to achieve business observability.