Create an Ingest Processor pipeline that sends matching events to a Splunk index while a raw table landing definition routes the same matching events to Machine Data Lake.
-
Events already reach Splunk Cloud Platform through a supported HEC, Universal Forwarder, or Heavy Forwarder path.
-
You have a Machine Data Lake raw table and permission to edit its data landing definition.
-
You have permission to create, save, and activate Ingest Processor pipelines.
-
You know the Splunk index that must continue receiving matching events.
This procedure configures a separate Ingest Processor pipeline for the preserved Splunk index route. When Divert data to raw table is selected, events that match a partition such as sourcetype="cisco:asa" are redirected from the existing index route to the raw table. Use Ingest Processor for the separate-pipeline procedure.
To preserve the existing index route by using the built-in landing control, select Duplicate data to raw table. For configuration steps, see Create a Machine Data Lake raw table or Inspect and edit raw tables.
- Open the raw table and edit the data landing definition.
Use Edit data landing to select the matching events that must land in Machine Data Lake.
- Add or confirm the landing partition for the matching events.
For example, add a partition that matches sourcetype="cisco:asa". Add source or host conditions if the raw table must receive a narrower subset.
- Preview the landing definition with representative matching and non-matching events.
Confirm that matching events are selected for the raw table and representative non-matching events are not selected.
- Save the data landing definition.
After the landing definition is active, matching events land in the Machine Data Lake raw table.
- Create an Ingest Processor pipeline for the preserved Splunk index path.
Create an Ingest Processor pipeline, not an Edge Processor pipeline. Use the same matching condition that you used in the raw table landing definition, such as sourcetype="cisco:asa".
- Set the Ingest Processor pipeline destination to the preserved Splunk index.
Select a Splunk index destination and choose the index that must continue receiving matching events. Keep the condition aligned with the raw table landing definition so both routes handle the same matching events.
- Save and activate the Ingest Processor pipeline.
- Send a uniquely identifiable test event through the existing input path.
Use a value that is not already present in production data, such as mdl_test_id=<unique_id>, and make sure the event matches the partition condition.
- Validate the test event in the raw table and the preserved Splunk index.
mdl_test_id="<unique_id>" sourcetype="cisco:asa"
index=<preserved_index> mdl_test_id="<unique_id>" sourcetype="cisco:asa" earliest=-30m latest=now
- Verify that non-matching events still follow the intended route.
Send or identify a representative event that does not match the landing partition. Confirm that it does not land in the raw table and that it follows the expected default or preserved destination.
Matching events land in the Machine Data Lake raw table and continue to the preserved Splunk index through the Ingest Processor pipeline. Non-matching events do not land in the raw table and continue to follow the intended route.