Manage data configuration for Stream forwarders

At installation time, Splunk Stream automatically configures universal forwarders to send data from the Splunk App for Stream splunk_TA_stream to your index over the Splunk Stream TA for Wire Data Splunk_TA_stream_wire_data.

Manage The Splunk Add-on for Stream Forwarder Splunk_TA_stream stats data

The Splunk Add-on for Stream Forwarder sends operational statistics and log data to _internal index. Splunk App for Stream uses this data to populate built-in dashboards, including the Stream Estimate dashboard.

Splunk_TA_stream sends three event types to _internalindex:

  • stream:stats
  • stream:log
  • streamfwd*

The streamfwd* event type comes from the Stream forwarder's local log file. The forwarder monitors that log file along with other files in the $SPLUNK_HOME/var/log/splunk/ directory. The data that streamfwd* contains is the same data found in stream:log. You can safely block the streamfwd* event type to avoid indexing duplicate data.

For more information, see Include or exclude specific incoming data in the Getting Data In manual.

Modify universal forwarder data limits

By default, the Splunk universal forwarder sends a maximum of 256 Kbps of data to indexers. Depending on your streamfwd configuration, your deployment might generate more data than this.

To modify or remove the default universal forwarder limit:

1. Edit $SPLUNK_HOME/etc/apps/SplunkUniversalForwarder/local/limits.conf.

2. Modify the [thruput] stanza. For example: 

[thruput]
maxKBps = 0