Key Machine Data Lake terms

Learn the terms that describe Machine Data Lake routing, landing, discovery, raw search, promotion, sharing, analytics search, and Spark access.

Use these terms as the Machine Data Lake terminology source of truth while you prepare a source, land and validate data, discover and query datasets, promote selected data, and govern access after onboarding.

Land

Raw table

A raw table stores logs and events that land through a supported Machine Data Lake workflow. It becomes available in the Catalog automatically to users who have permission to discover it. Use the raw table as the retained source for raw search, promotion, supported Open Sharing, and retention controls.

Data landing

Data landing selects which incoming events are written to a raw table and how matching and nonmatching events are routed. In Create raw table or Edit data landing, define conditions using supported metadata such as source, sourcetype, and host.

Machine Data Lake-only routing

Machine Data Lake-only routing sends matching events to a raw table without continuing to an existing Splunk index. Use this routing model when current searches, dashboards, alerts, Enterprise Security content, or rollback plans do not require the index route.

Dual routing

Dual routing sends matching events to Machine Data Lake and also preserves an existing Splunk index path. Use dual routing when current searches, dashboards, alerts, Enterprise Security content, or rollback plans must continue using the existing index while matching events also land in Machine Data Lake, where supported.

Landing-time processing

Landing-time processing applies supported transformations before matching events are written to a raw table. Use only actions documented for the selected GA landing workflow. Preview and validate filtering, masking, and other supported transformations before saving because they change the retained data.

Discover and query

Catalog

The Catalog is the inventory and decision surface for Machine Data Lake datasets. Use the Catalog to inspect available metadata, start raw search or promotion, and open the management actions allowed for the dataset type and your access.

Raw search

Raw search uses SPL2 to query data directly in a raw table without first creating a promotion. Use a bounded time range and supported source metadata or raw-text criteria for landing validation and focused exploration.

Splunk search

Splunk search queries data in a Splunk index. Use Splunk search for operational search, dashboards, alerts, correlation, and Enterprise Security workflows that depend on existing or promoted Splunk indexes.

Analytics search

Analytics search queries a promoted analytics table. Use analytics search for structured analysis, reporting, notebooks, business intelligence, machine learning, or other supported analytics workflows.

Promotion

Promotion

Promotion sends selected data from a raw table to a supported destination. Promotion does not remove the source data from the raw table.

Static promotion

Static promotion creates a promotion target from a selected historical time range. Use static promotion when you need a fixed set of raw data in a Splunk index or analytics table.

Streaming promotion

Streaming promotion sends matching events that arrive after the promotion job becomes Active to a Splunk index. It does not backfill data that is already stored in the raw table; use a separate static promotion when you need historical data.

Promotion target

A promotion target is the dataset created by a promotion. Machine Data Lake supports Splunk index and analytics table targets. Static and streaming describe the promotion mode, not different target types.

Splunk index

A Splunk index is a promotion target for data that needs Splunk search, dashboards, alerts, correlation, or Enterprise Security workflows. Machine Data Lake can create static Splunk index promotions and streaming Splunk index promotions where supported.

Analytics table

An analytics table is a structured promotion target created from selected raw data. Query the resulting table through analytics search for reporting, notebooks, business intelligence, machine learning, or other supported structured-analysis workflows.

Promotion-time processing

Promotion-time processing configures the supported filters, masking, extraction, or transformations applied to a promotion target. For an analytics table promotion, define the output schema and use custom SPL2 when needed to extract fields or shape the schema.

Govern and operate

Dataset access

Dataset access determines which datasets a user can discover and which actions are available for each dataset type. Access is based on the user capabilities and the dataset-specific access configuration.

Retention

Retention controls how long data remains available in a raw table or destination. Configure raw table retention and destination retention according to the controls available for each dataset type.

Open Sharing

Open Sharing provides authorized, read-only access to a raw table or analytics table for supported external clients such as business intelligence tools, notebooks, and machine learning platforms. Open Sharing uses Delta Sharing profiles that can expire or be revoked. Splunk indexes do not use this access path.