Skip to main content

Overview

This Overview page provides a dashboard view of data collection, processing, and delivery metrics across the DataStream deployment. Use it to monitor pipeline throughput, resource utilization, and performance at the Director, Cluster, or global level.

Accessing Stats

Navigate to Stats > Overview from the main navigation.

Filters

The page header provides two filter controls that affect all dashboard sections.

Time Range

Select a time period using the Presets tab or specify a custom range with the Date & Time Range tab.

Presets:

PresetPeriod
TodayCurrent calendar day
This WeekCurrent calendar week
This MonthCurrent calendar month
Last 3 MonthsRolling 3-month window

Date & Time Range: Set a custom start and end date with time selection. The maximum allowed range is 3 months.

Entity Selection

Filter metrics by scope using the entity dropdown.

OptionScope
All DirectorsAggregated metrics across all Directors and Clusters
Director nameMetrics for a single Director instance
Cluster name (Cluster)Metrics for a specific Cluster

The header displays three summary values for the selected entity and time period:

MetricDescription
Data CollectedTotal raw data volume received from devices
Data ProcessedTotal data volume after pipeline processing
Data Sent to TargetsTotal data volume delivered to target destinations

Data Overview

Three cards display data flow metrics from collection through delivery.

Collected Raw Data

Displays a pie chart of collected data volume broken down by device type. The card header shows total data size and event count for the selected period.

Click See All Devices to open a modal with a detailed table listing each device, its collected data volume, and event count.

Processed Data

Displays a grouped bar chart showing the top 5 pipelines processing the most data. Each pipeline shows Logs In and Logs Out volumes side by side, revealing the data reduction achieved by each pipeline. The card header shows total data size and event count.

Data Sent to Targets

Displays a gauge chart showing the distribution of processed data across target destinations, split between SIEM and other target types. The card header shows total data size and event count.

Data Collection and Transformation

Two cards provide operational health and performance metrics.

Director Stats

Displays the status of Directors, Agent Devices, and Stream Devices with enabled and disabled counts for each. When components have connection errors, a warning indicator appears with a Manage link to the relevant Directors management page.

When a single Director is selected, a Resource Utilization panel appears showing:

MetricDescription
CPU UtilizationCurrent CPU usage percentage
RAM UtilizationCurrent RAM usage percentage

Resource Utilization is only available for individual Director selection, not for All Directors or Cluster views.

When a Cluster is selected, the Director count label changes to the cluster name and displays member counts. Resource Utilization is not shown.

Pipeline Performance

Displays a line chart plotting latency, errors, and dropped logs over time for the selected period. The card header shows three summary values:

MetricDescription
LatencyAverage pipeline processing latency in milliseconds, with a status tag
Pipeline ErrorsTotal error events during the selected period
Dropped LogsTotal dropped log events during the selected period

Latency status thresholds:

TagRange
Normal0--20 ms
Higher20--35 ms
Critical35+ ms