Install and Configure Oracle GoldenGate Veridata 12.2 on ...€¦ · Install and Configure Oracle GoldenGate Veridata 12.2 on Linux using an Oracle Database Oracle GoldenGate Veridata

INSTALLING AND CONFIGURING VERIDATA ON WINDOWS 1

Install and Configure Oracle GoldenGate Veridata 12.2 on Linux using an Oracle Database

Oracle GoldenGate Veridata is used to assist in maintaining data consistency within an Oracle GoldenGate environment by comparing data on both source and target systems and reporting and/or fixing inconsistencies. Veridata is a Java application that runs within the Oracle WebLogic server.

Veridata runs in many different environments and platforms. For Unix/Linux platforms it is very straight-forward to configure and install. In Windows / SQL Server environments it can be a little tricky. This paper walks through the steps to install and configure Oracle Veridata 12.2 on Linux using an Oracle database.

Installing and Configuring Veridata The following steps describe how to install and configure the Oracle Veridata server.

1. Prepare the systema. Validate or install java JDK 1.8 or laterb. Copy and install JDK-8u241-linux-x64.tar

i. This will install both the JRE and JDK. The JRE is accessed by default.ii. In this installation process the JDK is used explicitly.

iii. I use /u01/app/oracle/Java/jdkc. Edit .bashrc to include JAVA_HOME and PATH.

Export PATH=$PATH:$JAVA_HOME/bin.d. $ java -version

Install WebLogic and Veridata 2. Install Weblogic server

a. Download from https://www.oracle.com/middleware/technologies/weblogic-server-installers-downloads.html

b. Choose Fusion Middleware Infrastructure Installerc. Download filed. Change directory to the Middleware software location directory.e. Install WebLogic using the explicit path to the JDK

i. “ JAVA_HOME/bin/java –jar fmw_12.2.1.4.0_infrastructure.jar “f. The Oracle Home directory is /u01/app/oracle/product/Middleware

i. The Welcome page



ii. Auto Updates


iii. Installation Location


iv. Installation Type


v. Prerequisite Checks


vi. Installation Summary


vii. Click Install to begin the installation.


viii. Installation Complete

ix. 3. Install Veridata Service into the Weblogic Server

a. Change directory to the Veridata software location directory. b. Install WebLogic using the explicit path to the JDK

i. “$JAVA_HOME/bin/java –jar fmw_12.2.1.4.0_ogg.jar“ c. Choose the Oracle Home directory where the Middleware was installed. d. Choosing to install Veridata Server and Agent.

i. Screen 1



ii. Screen 2


iii. Screen 3: Installation Location This is the location where WebLogic was installed. Click the View button to verify.


iv. Screen 4: Installation Type Choose Complete Install


v. Screen 5


vi. Screen 6


vii. Screen 7


viii. When completed, click Finish.

Install and Configure the Veridata Repository 4. Install an Oracle database on Veridata system.

a. Create a Veridata account. b. Create a Veridata database. Must use AL32UTF8.

5. Run the Repository Configuration Utility from the directory /u01/app/oracle/product/Middleware/Oracle_Home/oracle_common/bin

a. cd /u01/app/oracle/product/Middleware/Oracle_Home/oracle_common/bin

b. Run rcu i. Screen 1: Welcome


ii. Screen 2: Choose Create Repository -> System Load and Product Load


iii. Screen 3: Choose Database Setup as shown here: 1. Use the actual server name. 2. Use sys. 3. Ignore pop-up about version.


iv. Screen 3: A popup checks the pre-requisites.

v. Screen 4: Select Components. Check GoldenGate. Uncheck Monitor Server. 1. Change Prefix to OGG.


i. Screen 4: A popup checks the pre-requisites.


ii. Screen 5: Passwords. Set the passwords for the schemas.


iii. Screen 6: Summary

iv. A tablespace confirmation popup will appear.


v. Click Create to execute. A create tablespace popup will appear.

vi. Screen 7: Click okay and you will get a validation screen.


vii. Click Create to create the repository.


viii. Screen 7: Finished

This concludes setting up the Veridata Repository.


Configure WebLogic The next step is to setup Veridata Domain in Weblogic.

a. Run the WebLogic Configuration Utility from the directory /u01/app/oracle/product/Middleware/Oracle_Home/oracle_common/common_bin cd / u01/app/oracle/product/Middleware/Oracle_Home/oracle_common/common_bin

b. $ ./config.sh i. Screen 1: Select Create a New Domain


ii. Screen 2: Select GoldenGate from Template Category and Veridata Server from Templates.


iii. Screen 3: Create Administrator Account: Supply password for weblogic user.


iv. Screen 4: Select Domain Mode and JDK. Choose Production.


v. Screen 5: Database Configuration. 1. Select Oracle 2. Select Oracle Driver (Thin) 3. Select Veridata database, hostname and port 4. Change schema owner to PROD_STB and provide the password you

used in the RCU. 5. Click on get RCU configuration. 6. If everything is correct it should show OK as the results of the queries.


vi. Screen 6: JDBC Component Schema 1. All requirements should already be set. Click Next >.


vii. Screen 7: JDBC Tests. The JDBC tests should automatically run and succeed. If any tests fail, go back and fix the problem.


viii. Screen 8: Keystore. Leave as is and click Next >.


ix. Screen 9: Advanced Configuration. Select Administration Server, Node Manager and Managed Servers, Clusters and Coherence.


x. Configure the Admin Server. Here you can set the port number and SSL.


xi. Node Manager. You can setup the Node Manager, account, etc.. Set the username and password.


xii. Managed Servers. Select VERIDATA-MANAGED-SERVERS from the dropdown and make changes if you desire.


xiii. Clusters. Configure if desired.


xiv. Server Templates


xv. Coherence Clusters. Configure Coherence Clusters as needed.


xvi. Machines. Add machines as needed.


xvii. Virtual Targets


xviii. Partitions


xix. Screen 10: Configuration Summary. Review the configuration and click Create to continue.


xx. Configuration Processing


xxi. Completion. You should see a screen showing a successful installation.


xxii. End of configuration


Configure the Admin Server and Veridata Server 6. Start the Admin Server and create a User for Veridata.

a. Run startWeblogic.cmd from the DOMAIN_HOME/bin directory. b. In our case, DOMAIN_HOME is

/u01/app/oracle/product/Middleware/Oracle_Home/user_projects/ domains/base_domain

c. Cd to that directory and run startWeblogic. d. Run startWeblogic.sh e. This will start Weblogic Admin Server f. It will require a username and password.

7. Start the Veridata domain using the VeridataServer.sh script located in DOMAIN_HOME/veridata/bin

a. cd to DOMAIN_HOME/veridata/bin b. cd /u01/app/oracle/product/MiddlewareOracle_Home/user_projects/

domains/base_domain/veridata/bin c. Run VeridataServer.sh start d. It will require a username and password that you created.

8. Make sure that the firewall is disabled on the Veridata server or configure it to allow the proper ports through.

9. Connect to the Weblogic Admin Server a. http://<name>:7001/console


b. Login with username weblogic and the password you provided when you created it.

c. Select Security Realms


d. Click Lock & Edit until it is unlocked (grey as shown). Click on myrealm.

e. Click on Users and Groups


f. Click New. Fill in Name:, Description and Password.

10. Click on the Veridata user and add the Veridata user to the Veridata groups. First click on the Veridata user.


11. Next select Groups. Add Veridata to the appropriate groups and click Save.

12. Click Release Configuration

This completes the base (minimal) configuration needed.


Login to the Veridata Server.

13. In a browser connect to http://<server>:8830/veridata


14. Login with the username/password that you just created

15. At this point Veridata is functional. The next step is to configure the Veridata processes as Linux systemd Services.


Configuring WLS as a Linux Service This section shows how to configure the WebLogic Admin server and managed server to run as a Linux service. This is always necessary for Veridata to operate.

Setup for automatic login. For both the Admin Server and Veridata server you must setup a boot.properties file to avoid the process prompting for a username and password.

Create a file in the base_domain\servers\<Server Name>\security directory called boot.properties. In this file add two lines

username=weblogic password=weblogic123

There will be two files; one for AdminServer and one for Veridata and the exact paths are shown here:

/u01/app/oracle/product/Middleware/Oracle_Home/user_projects/domains/ base_domain/servers/AdminServer/security/boot.properties

/u01/app/oracle/product/Middleware/Oracle_Home/user_projects/domains/ base_domain/servers/veridata/security/boot.properties

Create a file called /etc/systemd/system/weblogic.service.

The contents of /etc/systemd/system/weblogic.service should contain the following:

[Unit] Description=Run Weblogic as Oracle User [Service] Type=simple WorkingDirectory=/u01/app/oracle/product/Middleware/Oracle_Home/user_projects/domains/base_domain ExecStart=/u01/app/oracle/product/Middleware/Oracle_Home/user_projects/domains/base_domain/startWebLogic.sh User=oracle Group=oinstall KillMode=process LimitNOFILE=65535 [Install] WantedBy=multi-user.target

Once you have created the service file startup weblogic by running the following:

$ systemctl start weblogic

$ systemctl status weblogic


Test the weblogic console and make sure that it is running.

Create a file called /etc/systemd/system/veridata.service.

The contents of /etc/systemd/system/veridata.service should contain the following:

[Unit] Description=Run Weblogic as Oracle User Wants=weblogic.service After=network.target weblogic.service [Service] Type=simple WorkingDirectory=/u01/app/oracle/product/Middleware/Oracle_Home/user_projects/domains/base_domain/veridata/bin ExecStart=/u01/app/oracle/product/Middleware/Oracle_Home/user_projects/domains/base_domain/veridata/bin/veridataServer.sh start User=oracle Group=oinstall KillMode=process LimitNOFILE=65535 [Install] WantedBy=multi-user.targetWantedBy=default.target

Once you have created the service file startup Veridata by running the following:

$ systemctl start Veridata

$ systemctl status Veridata

Verify by connecting to the Admin and Veridata servers:

http://<server>:7001/console

http://<server>:8830/veridata

You should be able to log into both of these.


Securing the Veridata Server to use SSL It is often required to use SSL for processing requests from the browser to the Veridata application. This is done via the Admin Server and modifications to the services.

1. Login to the Admin Server (port 7001).

2. Expand the Environment selection under Domain Structure in the application.


3. Select Servers.

4. First select the AdminServer (admin)


5. In order to make a change click the Lock & Edit button on the top left-hand side of the screen. 6. Scroll down until you see the server ports. Uncheck Listen Port Enabled and check SSL Listen

Port Enabled. Note the SSL port is 7002.

7. Click Save. Save is located at the top and bottom of the screen. 8. Click Servers button again. 9. Select VERIDATA_server1.


10. Scroll down to ports.

11. Uncheck Listen Port Enabled and check SSL Listen Port Enabled. Change SSL Listen Port to 8831.


12. Click Save. Save is located at the top and bottom of the screen. 13. Click Activate All Changes. This is located at the top left hand side of the screen. 14. Exit the AdminServer. Once the AdminService and Veridata services are restarted SSL is enabled

and non-SSL login is prohibited.

Now login with the following URLs:

https://<server>:7002/console

https://<server>:8831/veridata

At this point Veridata is installed and running on secure (https) ports. You could have enabled SSL during the initial setup, but this provided an instructional way of showing how to change ports.


Deploying the Veridata Agent Deploying the Veridata agent uses the same jar file that you used to install the Veridata Server. This time you do not need to deploy Weblogic. However, you do have to deploy the Java JDK.

Note: You can install the JDK in the /u01/app/oracle/Java directory and create a symbolic link from LATEST to the JDK directory. This way you can update java without having to change the JAVA_HOME parameter.

The following steps describe how to install and configure the Oracle Veridata agent.

1. Prepare the system a. Validate or install java JDK 1.8 or later b. Copy and install JDK-8u241-linux-x64.tar

i. This will install both the JRE and JDK. The JRE is accessed by default. ii. In this installation process the JDK is used explicitly.

iii. I use /u01/app/oracle/Java/jdk…. iv. Create a symbolic link from LATEST to JDK….

c. Edit .bashrc to include JAVA_HOME and PATH. Export PATH=$PATH:$JAVA_HOME/bin. d. $ java -version

Install Veridata Agent 1. Install Weblogic agent

a. Download from https://www.oracle.com/middleware/technologies/weblogic-server-installers-downloads.html

b. Choose Fusion Middleware Infrastructure Installer c. Download file d. Change directory to the Middleware software location directory. e. Install WebLogic using the explicit path to the JDK

i. “$JAVA_HOME/bin/java –jar fmw_12.2.1.4.0_infrastructure.jar” f. The Oracle Home directory is /u01/app/oracle/product/Middleware

i. The Welcome page



ii. Auto Updates


iii. Set the agent installation directory. I use /u01/app/oracle/product/veridata-agent


iv. Installation Type. Set the installation type to Veridata Agent


v. Prerequisite Checks


vi. Installation Summary. Here you can also save a response file.


vii. Install. Click Install to start the installation.


viii. Installation Complete.


ix. Click Finish.

Create the Veridata Agent Instance Once the Veridata Agent software has been installed you will have to create a Veridata instance. Each instance can connect to one database. If you are connecting to multiple databases you need multiple instances.

Change directory to the <Veridata agent>/veridata/agent directory and run the agent_config.sh script. This script is run and points to the Veridata instance directory.

$ cd /u01/app/oracle/product/veridata-agent/veridata/agent

$ ./agent_config.sh /u01/app/oracle/product/veridata-inst-0

[oracle@test00 agent]$ ./agent_config.sh /u01/app/oracle/product/veridata-inst-0

Successfully deployed the agent.

Configure the Veridata Agent Instance agent.properties File Next edit the <Veridata Instance>/agent.properties file. Create the file from the agent.properties.sample file that is provided.

$ cp agent.properties.sample agent.properties

Edit the agent.properties file:

Set the following parameters:

server.port=<port> The default is 7850. This is fine, but you can only use one port per server of the same number.

database.url= jdbc:oracle:thin:@<localhost or database host name>:1521: <service name> This can be either local or remote.

server.jdbcDriver=<server.jdbcDriver> This is taken from the example for each database.

Sample:

server.port=7850 database.url=jdbc:oracle:thin:@localhost:1521:test00db server.jdbcDriver=ojdbc7.jar oracle.xdb.jar

Note: If you are running Oracle 19c the JDBC library should be changed to ojdbc8.jar

These are all of the required parameters.


Start the Veridata Agent Start the Veridata agent from that directory using the following syntax.

$ ./agent.sh start agent.properties

You can verify that the agent is running with a ps | grep veridata.

oracle 15408 1 13 15:04 pts/2 00:00:00 /u01/app/oracle/Java/LATEST/bin/java -Djava.util.logging.config.class=oracle.core.ojdl.logging.LoggingConfiguration -Doracle.core.ojdl.logging.config.file=/u01/app/oracle/product/veridata-inst-0/config/odl.xml -Dhome=/u01/app/oracle/product/veridata-agent/veridata/agent -DagentHome=/u01/app/oracle/product/veridata-inst-0 -XX:+UseParallelGC -Xmx1024M -Xms1024M -Dagent-manifest.jar=/u01/app/oracle/product/veridata-agent/veridata/agent/agent-manifest.jar -jar /u01/app/oracle/product/veridata-agent/veridata/agent/JavaAgent.jar agent.properties

Once the agent is running, you can test it from the Veridata Console.


Configure Veridata Data Source

If you set up both Veridata and the Veridata Agent are running as Services. If a server were to restart, the Veridata processes will restart as services. This is invaluable for Veridata and GoldenGate in general. The final step is to setup connectivity to Veridata.

1. Login to the Veridata application as the administrator:


2. You will see the initial screen.


3. Select Connection Configuration link under the Configuration heading on the left side of the screen.


4. Click the New… button. In the pop-up fill in and click Next>>


5. In the pop-up fill in the IP address.


6. Click on the Verify button. This will verify connectivity, agent status and Datasource Type.


7. Click Next. Enter username and password. Click Test Connection to verify connectivity to the database.


8. Click Finish when completed. At this point you can select to create a group or add another connection.


9. Follow steps 4 – 7 to add another connection. Continue until you have created all of the connections then select to create a new group.


10. Select the source and target systems from the dropdown menus.


11. Click Finish. From the final page click the box to continue to Compare Configuration.


12. The Group Compare Pair screen is displayed.


13. Select the Pattern Mapping Screen.


14. Fill in the Datasource Information from the dropdowns. Select the database and “dbo” as the schema.


15. Scroll down and select the Pattern Compare Pair Mapping. Select the appropriate selection for your database.


16. Select Generate Mappings.

17. Once the mappings have been reviewed, Save the configuration.

GoldenGate Veridata is now ready to begin the process of comparing data. This document is designed to cover the installation and configuration of Veridata. Subsequent documents will cover the operation of Veridata including setting up comparison jobs, viewing reports and setting up repair jobs.

Documents

Install and Configure Oracle GoldenGate Veridata 12.2 on ...€¦ · Install and Configure Oracle GoldenGate Veridata 12.2 on Linux using an Oracle Database Oracle GoldenGate Veridata