Overview of the federated search options for the Splunk platform
Federated search, in its most broad definition, is a tool that allows you to search remote datasets throughout your data ecosystem from a single Splunk platform search interface. With federated search, you can break down your data collection silos and get cross-functional insights into data patterns and correlations that previously were unavailable to you, while managing security requirements with role-based data access controls.
The Splunk platform currently offers 9 federated search options:
- Federated Search for Splunk
- Federated Search for Amazon S3
- Federated Search for Microsoft Azure
- Federated Search for Azure Databricks
- Federated Search for DDSS
- Federated Search for Snowflake
- Federated Search for Cisco Security Analytics and Logging
- Federated Search for CloudWatch Unified Data Store
- Federated Analytics for Amazon Security Lake
Federated Search for Splunk is available for users of Splunk Enterprise and Splunk Cloud Platform. The other federated search options are available only for users of Splunk Cloud Platform.
Federated Search for Splunk
Federated Search for Splunk grants you a unified view of the Splunk platform data stored across your entire organization. With a single search you can efficiently return events from any Splunk Cloud Platform or Splunk Enterprise environment to which you have access.
Federated Search for Splunk is a feature that is available to users of Splunk Cloud Platform and Splunk Enterprise. You can configure Federated Search for Splunk between any combination of those two environment types (Enterprise to Enterprise, Cloud to Cloud, Enterprise to Cloud, and Cloud to Enterprise). You can also use Federated Search for Splunk to search multiple remote Splunk environments from the same local search head.
You can set up Federated Search for Splunk with just a few steps. To get started, see About federated search for Splunk.
Workload management (WLM) and federated search
Workload management (WLM) provides controls for managing searches and system resources on Splunk Enterprise and Splunk Cloud Platform deployments. For Federated Search for Splunk, administrators can use admission rules on a remote search head to filter federated searches before they run, helping protect resources on that deployment. To identify federated searches or scheduled federated searches, use the following predicates in admission rules configured on a remote search head that supports these predicates:
is_federated_search_on_rshis_scheduled_federated_search_on_rsh
For more information, see Specify predicate values.
Splunk Virtual Compute (SVC) and federated search
Federated searches in Splunk Cloud Platform use compute resources on the remote search head. If your Splunk Cloud Platform subscription is workload-based, use the Cloud Monitoring Console (CMC) to review federated search workload on the remote stack.
To review SVC usage for Federated Search for Splunk searches, in the CMC:
- Select License Usage, then Workload metrics.
- Select Search workload
- In the Search workload panel, select Estimated SVCs from the View by options.
- From the Split by menu, select Search type, and then select federated search:splunk-to-splunk.
This view shows SVC usage for federated searches and attributes usage to the user who initiated each search on the federated search head. For more information, see Monitor current SVC usage of your workload-based subscription.
For information about how workload management applies to federated searches, see "Workload management (WLM) and federated search".
Federated Search for Amazon S3
Federated Search for Amazon S3 lets you search remote datasets in your Amazon S3 buckets, allowing you to retrieve the search results directly in your Splunk Cloud Platform instance for correlation, enrichment, and analysis, all without ever having to ingest or index that data beforehand. When you run these federated searches, you use SPL2 search commands and syntax.
Possible uses of Federated Search for Amazon S3 include, but are certainly not limited to the following scenarios:
- Threat hunting over historical data
- Provision of as-needed dataset access for compliance
- Creation of statistical reports and analytical searches that leverage historical data
- Exploration of stored Amazon S3 data, in the interest of locating data to ingest to Splunk
Go to Catalog to set up your Federated Search for Amazon S3 experience through the definition of connections and datasets.
Federated Search for Amazon S3 is available only for Splunk Cloud Platform deployments. To activate Federated Search for Amazon S3, you must contact your Splunk sales representative.
For more information, see Overview of Federated Search for Amazon S3.
Federated Search for Microsoft Azure
A brief overview of federated search for Microsoft Azure.
Federated Search for Microsoft Azure lets you run federated searches from your Splunk platform deployment over datasets located in Microsoft Azure Data Lake Storage (ADLS) and Azure Blob Storage (ABS) containers. When you run these federated searches, you use SPL2 search commands and syntax.
Go to Catalog to set up your Federated Search for Microsoft Azure experience through the definition of connections and datasets.
Federated Search for Microsoft Azure is available only for Splunk Cloud Platform deployments. To activate Federated Search for Microsoft Azure, you must contact your Splunk sales representative.
For more information see About Federated Search for Microsoft Azure.
Federated Search for Databricks
A brief overview of Federated Search for Databricks.
Federated Search for Databricks lets you run federated searches from your Splunk platform deployment over Microsoft Azure or Amazon Web Services (AWS) Databricks tables stored remotely in Unity Catalog. When you run these federated searches, you'll use SPL2 search commands and syntax.
Go to Catalog to set up your Federated Search for Databricks experience through the definition of connections and datasets.
Federated Search for Databricks is available only for Splunk Cloud Platform deployments. To activate Federated Search for Databricks, you must contact your Splunk sales representative.
For more information, see About Federated Search for Databricks.
Federated Search for DDSS
A brief overview of Federated Search for DDSS.
Federated Search for DDSS is available only for Splunk Cloud Platform deployments. To activate Federated Search for DDSS, contact your Splunk sales representative.
For more information, see About Federated Search for DDSS.
Federated Search for Snowflake
A brief overview of Federated Search for Snowflake.
Federated Search for Snowflake lets you run federated searches from your Splunk Cloud Platform deployment over datasets located in Snowflake tables and views. When you run these federated searches, you use familiar SPL2 search commands and syntax.
Go to Catalog to set up your Federated Search for Snowflake experience through the definition of connections and datasets.
Federated Search for Snowflake is available only for Splunk Cloud Platform deployments. To activate Federated Search for Snowflake, contact your Splunk sales representative.
For more information, see About Federated Search for Snowflake.
Federated Search for Cisco Security Analytics and Logging
A brief overview of Federated Search for Cisco Security Analytics and Logging
Federated Search for Cisco Security Analytics and Logging (SAL) gives you visibility into Cisco Firewall events stored in your Cisco Security Analytics and Logging tenant without requiring you to ingest those events into your Splunk Cloud Platform deployment. After you set it up, you and your security operations teams can run remote searches for a variety of security use cases, including threat hunting, threat reporting, breach investigation, network troubleshooting, compliance auditing, dashboard monitoring, and data enrichment through correlation.
Go to Catalog to set up your Federated Search for Cisco Security Analytics and Logging experience by defining a dataset to run federated searches over. Each dataset represents a collection of Cisco Security Analytics and Logging firewall event logs stored in Amazon Web Services (AWS).
Federated Search for Cisco Security Analytics and Logging is available only for Splunk Cloud Platform deployments. To activate Federated Search for Cisco Security Analytics and Logging, you must contact your Splunk sales representative.
For more information, see About Federated Search for Cisco Security Analytics and Logging.
Federated Search for CloudWatch Unified Data Store
A brief description of Federated Search for CloudWatch Unified Data Store.
Amazon CloudWatch Unified Data Store is an AWS Cloud service that centralizes metrics, logs, and traces from AWS services and third-party sources into a single location to simplify observability, security, and compliance analytics.
Federated Search for CloudWatch Unified Data Store lets you search CloudWatch log data from your Splunk Cloud Platform deployment, without indexing or ingesting it first, using familiar SPL2 search commands and syntax.
Use the results of your CloudWatch queries to investigate activity in your AWS environment, explore historical logs, and correlate CloudWatch data and telemetry with data already available in your local Splunk indexes.
Go to Catalog to set up your Federated Search for CloudWatch Unified Data Store experience through the definition of connections and datasets.
Federated Search for CloudWatch Unified Data Store is available only for Splunk Cloud Platform deployments. To activate Federated Search for CloudWatch Unified Data Store, you must contact your Splunk sales representative.
For more information, see About Federated Search for CloudWatch Unified Data Store.
Federated Analytics for Amazon Security Lake
A brief overview of Federated Analytics for Amazon Security Lake.
-
For threat detection, you can ingest recent Amazon Security Lake data into local indexes on your Splunk Cloud Platform deployment, and then apply high-frequency scheduled searches and alerts to that data.
-
For threat hunting, you can run infrequent ad hoc federated searches over long time-range Amazon Security Lake datasets where they live in Amazon S3
Federated Analytics is available only for Splunk Cloud Platform deployments. To activate Federated Analytics, you must contact your Splunk sales representative.
For more information, see About Federated Analytics.