Administer the Hybrid Virtual Appliance Deployment

Perform the following steps to administer the Virtual Appliance nodes in your Hybrid Deployment:

Disable the AIOps Service

If you are using Virtual Appliance Hybrid Deployment, you require to disable the AIOps service in your Controller. Follow the steps to disable Anomaly Detection service in Administration Console:

Log in to the admin.jsp page and set the below properties to false:
- anomaly.detection.enabled
- anomaly.detection.deployed.onprem
Click Save.

After setting these properties to false, the Anomaly Detection service in the Controller is temporarily disabled. This action interrupts communication between the Controller and the Virtual Appliance.

Stop the Services on Virtual Appliance

Complete the following steps to stop the Virtual Appliance services:

Stop the Anomaly Detection, Secure Application, ATD, and OpenTelemetry services.
```
appdcli stop aiops|secapp|atd|otis
```
Run the following command to stop Virtual Appliance services:
```
appdcli stop appd
```
Note: Wait until all the pods are terminated.
Run the following command to stop operators, then wait till all the pods are terminated:
```
appdcli stop operators
```
Run the following command on all the Virtual Appliance nodes:
```
sudo microk8s stop
```

Start the Virtual Appliance Services

Complete the following steps to start the Virtual Appliance services:

Start all the virtual machines.
Run the following command to start microk8s.
```
sudo microk8s start
```

Verify the status of virtual machines.

appdcli show boot

Note: Ensure that the status of the services in each node appears as Success.

Sample Output:

NAME             | STATUS    | ERROR
------------------+-----------+-------
 enable-time-sync | Succeeded | --
 firewall-setup   | Succeeded | --
 hostname         | Succeeded | --
 microk8s-setup   | Succeeded | --
 ssh-setup        | Succeeded | --
 storage-setup    | Succeeded | --
 cert-setup       | Succeeded | --

Start the Virtual Appliance services.

appdcli start appd <profile>
appdcli start aiops <profile>
appdcli start secapp <profile>
appdcli start atd <profile>
appdcli start otis <profile>

Enable the AIOps Service

After you successfully start the services, enable the Anomaly Detection service to restore the communication between the Controller and the Virtual Appliance.

Log in to the admin.jsp page and set the below properties to true:
- anomaly.detection.enabled
- anomaly.detection.deployed.onprem
Click Save.

Generate the Hybrid Configuration File

You require to generate hybrid configuration file only if you are not using custom certificates for Ingress and Kafka clusters.

Ensure that you have the latest CA certificates obtained after installing services. If not, update the CA certificates and regenerate the hybrid configuration file after restarting the service.

Run the script to connect the Kafka node ports with the standalone Controller:

~/appd-charts/utils$ bash prepare-hybrid.sh

Sample output:

Writing Kafka CA Cert
Writing Schema registry CA Cert
Writing AnomalyDetectionKafkaSSLProducer
Writing AnomalyDetectionKafkaConsumerSSL
Writing configure script
Creating archive of hybrid config
hybrid-config/
hybrid-config/kafka-ca.crt
hybrid-config/AnomalyDetectionKafkaConsumerSSL
hybrid-config/configure.sh
hybrid-config/schema-registry-ca.crt
hybrid-config/AnomalyDetectionKafkaSSLProducer
Completed

This script generates the hybrid-config.tar file that includes the required configuration files.

Copy the hybrid-config.tar file to your standalone Controller instance.
Log in to the standalone Controller.
1. Locate and extract the hybrid-config.tar file contents.
```
tar -xvf hybrid-config.tar
```
2. Run the configure.sh script to provision the Controller with certificates and secrets to connect to the Kubernetes cluster:
  The following script is extracted from the hybrid-config.tar file.
```
$ bash configure.sh
Usage: configure.sh <controller-home> <keystore-passwd>
Using controller home as /opt/appdynamics and keystore password as changeit
Do you want to proceed? (y/n): y
Creating Kafka truststore
Certificate was added to keystore
Creating schema registry truststore
Certificate was added to keystore
Writing obfuscated producer config
Writing obfuscated consumer config
Completed
```
Note:
Certificates in the Virtual Appliance expire after 60 days. To maintain connectivity, you must copy the updated certificates from the Virtual Appliance to your Splunk AppDynamics オンプレミス Classic Controller. To do this, regenerate the hybrid configuration file on the Virtual Appliance and then copy it to your Standalone Controller.