AppDynamics Application Performance Monitoring for VMware Tanzu Workflow

This topic describes the steps required to instrument VMWare Tanzu applications with Splunk AppDynamics agents using the marketplace service published by the Splunk AppDynamics APM tile. For all but the Java buildpack, the multi-buildpack approach is used, which requires the Splunk AppDynamics extension buildpack appdbuildpack published by the tile, in addition to the language-specific buildpack. The Java buildpack has the Splunk AppDynamics agent support directly integrated and does not require the use of the Splunk AppDynamics buildpack.

Before You Start

Do the following:

Create a Broadcom account if you do not have one.
Install the Cloud Foundry Command Line Interface (cf CLI).
See Installing the cf CLI.

Note: This document contains references to Cloud Foundry™ documentation. Splunk AppDynamics does not own any rights and assumes no responsibility for the accuracy or completeness of such third-party documentation.

Create a Splunk AppDynamics Service Instance

To create a service instance:

Open a cf CLI or command-prompt window.
Identify your Pivotal API endpoint and version and enter the following command:
$ cf api
The following output appears:
```
api endpoint: https<scan>:</scan>//api.my.pivotal.io
api version: 2.103.0
```
Log in to the Pivotal endpoint:
cf login
Enter your email address and Pivotal password when prompted.

Verify the appdynamics service is present in the cf environment.

$ cf marketplace -s appdynamics
service plan                   description                    free or paid
pcf-appd                       pcf-appd                       free
pcf-appd-test                  pcf-appd-test                  free

Create a service instance of the appdynamics service of your choice.
$ cf create-service appdynamics pcf-appd appd
Follow the workflow for the corresponding language of the application mentioned below.

Splunk AppDynamics Instrumentation Workflows

Sample Applications

You can find sample applications demonstrating the multi-buildpack approach in this GitHub repository.

.NET Framework Applications (Multi-Build Pack)

.Net Framework applications are pushed using the multi-buildpack approach where the appdbuildpack buildpack is used in tandem with the standard hwc_buildpack buildpack.

Edit the following sections of your application’s manifest.yml.
Include appdbuildpack in the buildpacks section.
Set the application environment variable APPD_AGENT to dotnet.
Set the app and tier environment variables.

Bind the application to the Splunk AppDynamics service instance in the services section of the application manifest.

---
applications:
- name: cf-net
memory: 2G
buildpacks:
- appdbuildpack
- hwc_buildpack
stack: windows2016
env:
APPD_AGENT: dotnet
APPDYNAMICS_AGENT_APPLICATION_NAME: my-cf-net-app
APPDYNAMICS_AGENT_TIER_NAME: cf-net-app
services:
- appd

Push the application using the cf push command.
```
$ cf push
```

For Advanced Configurations:

The appdbuildpack provides APPD_AGENT_HTTP_URL and APPD_CONF_HTTP_URL environment variables to customize agent binary downloads and extend agents advanced configuration respectively. See Splunk AppDynamics Extension Buildpack for details.

.NET Core for Linux Applications (Multi-Buildpack)

.Net Core applications are pushed using the multi-buildpack approach where the appdbuildpack buildpack is used in tandem with the standard dotnet_core_buildpack buildpack.

Edit the following sections of your application’s manifest.yml.
Include appdbuildpack in the buildpacks section.
Set the application environment variable APPD_AGENT to dotnet-linux.
Set the app and tier environment variables.
Set the application environment variable APPD_AGENT_HTTP_URL to a custom http url where the Splunk AppDynamics .NET Agent for Linux is hosted.
This is necessary because the agent is not currently available in NuGet. See Cisco AppDynamics Extension Buildpack for more information.
Set the APPD_CONF_HTTP_URL to a custom url where the agent configuration file AppDynamicsConfig.json is hosted in the location ${APPD_CONF_HTTP_URL}/dotnet-linux/AppDynamicsConfig.json
```
{
"feature": [
"FULL_AGENT"
],
"log": [
{
"outputtype": "console"
}
]
}
```

Bind the application to the Splunk AppDynamics service instance in the services section of the application manifest.

----
applications:
- name: cf-net-linux
memory: 2G
buildpacks:
- appdbuildpack
- dotnet_core_buildpack
env:
APPD_AGENT: dotnet-linux
APPDYNAMICS_AGENT_APPLICATION_NAME: my-dotnet-linux-app
APPDYNAMICS_AGENT_TIER_NAME: cf-net-linux
APPD_AGENT_HTTP_URL: http://CUSTOM_REPO/AppDynamics-DotNetCore-linux-x64-VERSION.zip
APPD_CONF_HTTP_URL: http://CUSTOM_REPO
services:
- appd

Push the application using the cf push command.
```
$ cf push
```

For Advanced Configurations:

.NET Core Windows Applications (Multi-Buildpack)

.Net Core applications for Windows are pushed using the multi-buildpack approach where the appdbuildpack buildpack is used in tandem with the standard binary_buildpack buildpack.

Edit the following sections of your application’s manifest.yml.
Include appdbuildpack in the buildpacks section.
Set the application environment variable APPD_AGENT to dotnet-windows.
Set the app and tier environment variables.

Bind the application to the Splunk AppDynamics service instance in the services section of the application manifest.

---
applications:
- name: cf-net-windows
random-route: true
memory: 512M
path: app.zip
command: dotnetHelloWorld.exe
stack: windows2016
buildpacks:
- appdbuildpack
- binary_buildpack
env:
APPD_AGENT: dotnet-windows
APPDYNAMICS_AGENT_APPLICATION_NAME: my-dotnet-windows-app
APPDYNAMICS_AGENT_TIER_NAME: cf-net-windows
DOTNET_CLI_TELEMETRY_OPTOUT: 1
DOTNET_SKIP_FIRST_TIME_EXPERIENCE: true
services:
- appd

Push the application using the cf push.
```
cf push
```

For Advanced Configurations:

Python Applications (Multi-Buildpack)

Python applications are pushed using the multi-buildpack approach where the appdbuildpack python_buildpack

Edit the following sections of your application’s manifest.yml.
Include appdbuildpack in the buildpacks section of application manifest.
Set the application environment variable APPD_AGENT to python.
Set the app and tier environment variables.

Bind the application to the Splunk AppDynamics service instance in the services section of the application manifest.

---
applications:
- name: cf-python
memory: 500M
buildpacks:
- appdbuildpack
- python_buildpack
env:
APPD_AGENT: python
APPD_APP_NAME: my-python-app
APPD_TIER_NAME: cf-python
services:
- appd

Push the application.
```
$ cf push
```

For Advanced Configurations:

The appdbuildpack provides the APPD_CONF_HTTP_URL environment variable to customize agent binary downloads and extend agents advanced configuration respectively. See Splunk AppDynamics Extension Buildpack for details.

GoLang Applications (Multi-Buildpack)

Go applications are pushed using the multi-buildpack approach where the appdbuildpack buildpack is used in tandem with the standard go_buildpack buildpack. Splunk AppDynamics provides an SDK to instrument such applications. The configuration needed to start the Go agent via the SDK APIs is consumed via environment variables.

Edit the following sections of your application’s manifest.yml.
Include appdbuildpack in the buildpacks section of application manifest.
Set the application environment variable APPD_AGENT to golang.
Set the LD_LIBRARY_PATH environment variable to the folder containing libappdynamics.so.
Set the app and tier environment variables based on what’s read by the application using os.Getenv("...").

Bind the application to the Splunk AppDynamics service instance in the services section of the application manifest..

---
applications:
- name: cf-go
memory: 500M
buildpacks:
- appdbuildpack
- go_buildpack
env:
APPD_AGENT: golang
APPD_APPLICATION_NAME: my-go-app
APPD_TIER_NAME: go-tier
LD_LIBRARY_PATH: /app/vendor/appdynamics/lib
services:
- appd

Copy paste the snippet below to initialize the go agent.

package main
import (
...
appd "appdynamics"
)
...
cfg := appd.Config{}
cfg.AppName = os.Getenv("APPD_APPLICATION_NAME")
cfg.TierName = os.Getenv("APPD_TIER_NAME")
cfg.NodeName = os.Getenv("APPD_NODE_NAME")
cfg.NodeName = os.Getenv("APPD_NODE_NAME") + ":" + os.Getenv("CF_INSTANCE_INDEX")
/* Controller Configuration */
cfg.Controller.Host = os.Getenv("APPD_CONTROLLER_HOST")
port, err := strconv.ParseInt(os.Getenv("APPD_CONTROLLER_HOST"), 10, 16)
if err != nil {
return err
}
cfg.Controller.Port = uint16(port)
cfg.Controller.Account = os.Getenv("APPD_ACCOUNT_NAME")
cfg.Controller.AccessKey = os.Getenv("APPD_ACCOUNT_ACCESS_KEY")
cfg.InitTimeoutMs = 1000
err = appd.InitSDK(&cfg)
if err != nil {
fmt.Println(err)
}
...

The necessary configuration to start Splunk AppDynamics Golang Agent is consumed via environment variables APPD_APPLICATION_NAME, APPD_TIER_NAME, APPD_NODE_NAME, APPD_CONTROLLER_HOST, APPD_ACCOUNT_NAME, APPD_ACCOUNT_ACCESS_KEY.

Push the application.
```
$ cf push
```

For Advanced Configurations:

Java Applications

Java applications are instrumented by Splunk AppDynamics using the standard java_buildpack_offline buildpack. The multi-buildpack approach is not used as this is not supported by the Java buildpack.

Edit the following sections of your application’s manifest.yml.
Set the app and tier environment variables.
Optional: Set the APPD_CONF_HTTP_URL environment variable to a URL where advanced agent configuration files are hosted.
See Extending Agent Configuration documentation for more information. Also see the cf-java-sample and cf-configuration-static applications in the sample app repository for an example of how to override the log4j2.xml file to redirect agent output to STDOUT.
Optional: Set the APPD_CF_NODE_PREFIX environment variable to prepend a string to the node name assigned by the buildpack.

Bind the application to the Splunk AppDynamics service instance in the services section of the application manifest.

---
applications:
- name: cf-java-app
memory: 1G
random-route: true
path: build/libs/cf-java-sample-1.0.jar
buildpacks:
- java_buildpack_offline
env:
APPDYNAMICS_AGENT_APPLICATION_NAME: my-java-app
APPDYNAMICS_AGENT_TIER_NAME: cf-java-app
APPD_CONF_HTTP_URL: http://custom-http-server.com
APPD_CF_NODE_PREFIX: my-node-prefix
services:
- appd

Push the application.
```
$ cf push
```

Because Splunk AppDynamics instrumentation of VMWare Tanzu Java applications does not use appdbuildpack, the configuration is managed by java_buildpack directly. Refer to the standard java_buildpack documentation.

Node.js Applications (Multi-Buildpack)

Node.js applications are pushed using the multi-buildpack approach where the appdbuildpack buildpack is used in tandem with the standard nodejs_buildpack buildpack.

Edit the following sections of your application’s manifest.yml.
Include appdbuildpack in the buildpacks section.
Set the application environment variable APPD_AGENT to nodejs.
Set the app and tier environment variables.
Optional: Set the environment variable APPDYNAMICS_LOGGER_OUTPUT_TYPE to console to stream agent logs.
Optional: Set the environment variable APPD_CDN_BASE_URL to point to an internal repo where the Node.js Agent package is hosted. This overrides the default Splunk AppDynamics repo that is hosted on the public internet and typically not available in a VMWare Tanzu environment.

Bind the application to the Splunk AppDynamics service instance in the services section of the application manifest.

applications:
- name: cf-node
memory: 500M
env:
APPD_AGENT: nodejs
APPDYNAMICS_AGENT_APPLICATION_NAME: my-nodejs-app
APPDYNAMICS_AGENT_TIER_NAME: cf-nodejs
APPDYNAMICS_LOGGER_OUTPUT_TYPE: console
APPD_CDN_BASE_URL: http://internalrepo.com
services:
- appd

Optional: Provide the environment variables for configuring the agent.

Below is the list of supported environment variables.


ENV VARIABLE	DESCRIPTION
APPDYNAMICS_AGENT_APPLICATION_NAME	Application Name to be reported to Cisco AppDynamics Controller
APPDYNAMICS_AGENT_TIER_NAME	Tier Name for the Application to be reported to Cisco AppDynamics Controller
APPD_AGENT_DEBUG	Set to true to enable debug level logging for the agent. The default is false.
APPD_AGENT_LIBAGENT	Controls the proxyless version of the agent. The default is true. Set to false if you want to use the proxy version of the Node.js agent.
APPD_LOG_CONFIG	The location, level, and other settings related to agent logging. See Node.js Agent Logging.

Push the application.
```
$ cf push
```

Extending Default Proxy Configuration

If you are using a proxy server, the consumer application should specify the http_proxy or https_proxy as an environment variable for the application running on VMware Tanzu to communicate with the proxy server. Do the following:

Set the environment variable for the application and the Controller.
- For an HTTP proxy: cf set-env http_proxy http://user@password:myproxy....:8080/
- For an HTTPS proxy: cf set-env https_proxy https://user@password:myproxy....:8080/
Restage the application:
cf restage <app-name>
Log in to the Controller web UI, navigate to the Metric Browser, and verify that the application is being detected and monitored.

Using Splunk AppDynamics User-Provided Service

In addition to the procedure above using the service broker tile, operators can also use user provided service with the name appdynamics to instrument applications on Splunk AppDynamics.

Use the cf cups command below with the JSON fields specified.

The name of the user provided service must be appdynamics, and its JSON credentials must have account-access-key, account-name, host-name, port, and ssl-enabled fields.

$ cf cups appdynamics -p '{"account-access-key":"acce$$key", "account-name":"customer1", "host-name":"demo.appdynamics.com", "port":"8090", "ssl-enabled":false}'

See the Cloud Foundry CLI Reference for details.

Deploying the Machine Agent on VMware Tanzu

This topic helps you deploy the Machine Agent on the VMware Tanzu(VMware Tanzu) platform.

Acquire admin or space developer access on Cloud Foundry to deploy, run, and manage applications. For more information on access rights see the Cloud Foundry Documentation.
Download the Machine Agent.

Set up the Machine Agent.

Set up the GitHub repository.

git clone https://github.com/Appdynamics/cloudfoundry-apps
cd cloudfoundry-apps/cf-machine-agent

Ensure that the Machine Agent is downloaded from the Download Portal into the current directory.

MachineAgent-4.5.11.2163.zip
cd MachineAgent-4.5.11.2163
(master)$ ls
bin			local-scripts		monitorsLibs
conf		machineagent.jar	readme.txt
extensions	machineagent.jar.asc	readme.txt.asc
lib			monitors		scripts

Copy the Machine Agent extensions, if any, to the cloudfoundry-apps/cf-machine-agent extensions directory.
Note that extensions must be of .zip format, containing extension_folder/{.jar, *.monitor.xml}. For example:
```
$ cp ~/Downloads/rabbitmqmonitor-2.0.2.zip extensions/
```

Edit the JAVA_OPTS section in the manifest.yml to add the Controller information.

For example, the manifest.ymlis similar to the following after filling in the details:

---
applications:
- name: appdynamics-machine-agent
memory: 1G
health-check-type: process
no-route: true
buildpack: java_buildpack_offline
path: MachineAgent.zip
env:
JAVA_OPTS: '-Dappdynamics.agent.accountAccessKey=accessKey -Dappdynamics.agent.accountName=customer1 -Dappdynamics.controller.hostName=mycontroller.com -Dappdynamics.controller.port=<port> -Dappdynamics.agent.applicationName=myAppName -Dappdynamics.agent.uniqueHostId=myUniqueHostId -Dappdynamics.controller.ssl.enabled=false'

Run package.sh.

This script packages the extension zip files into the Machine Agent monitor directory, cleans the Machine Agent, and adjusts the permissions of files per requirements from VMware Tanzu.

$ ./package.sh
Creating workdir tmp
Moving MachineAgent to tmp dir
Unzipping MachineAgent
Unzipping Extensions from ../extensions to ./monitors Directory
Cleaning MachineAgent - removing *.asc files
Adjusting permissions as per requirement from CloudFoundry
Packaging MachineAgent

Deploy the Machine Agent using cf push.
```
$ cf push
```
Verify the app is running using cf apps and check the app logs on the container (home/vcap/app) to validate the extension is working.
```
$ cf apps
Getting apps in org appdynamics-org / space appdynamics-space as admin...
OK
appdynamics-machine-agent   started           1/1         1G       1G
```
Note: The conf/logging/log4j.xml file in MachineAgent.zip can be configured to log to the console (by default it logs to the file system).

Documentation

AppDynamics Application Performance Monitoring for VMware Tanzu Workflow

Before You Start

Create a Splunk AppDynamics Service Instance

Splunk AppDynamics Instrumentation Workflows

Sample Applications

.NET Framework Applications (Multi-Build Pack)

.NET Core for Linux Applications (Multi-Buildpack)

.NET Core Windows Applications (Multi-Buildpack)

Python Applications (Multi-Buildpack)

GoLang Applications (Multi-Buildpack)

Java Applications

Node.js Applications (Multi-Buildpack)

Extending Default Proxy Configuration

Using Splunk AppDynamics User-Provided Service

Deploying the Machine Agent on VMware Tanzu