Configure DataImporter

  1. Go to the
    <DataView_HOME>\FTADataView\dataimporter\config
     folder and open the
    dataimporterproperties.properties
    file in a text editor.
    Config Folder
  2. Change the following properties in the
    dataimporterproperties.properties
    file:
    NOTE:
    For Multi node, write the hostname of each node with comma (,) separator.
    Database configuration:
    1. Configure the PostgreSQL database server:
      bds.cidb.url = jdbc:postgresql://<HostName>:5432/FTADataView
      (Format: jdbc:postgresql://<<Database Host Address>>: <<Database Port>>/<<Database name>>)
    2. Configure the username, which User created in PostgreSQL:
      bds.cidb.username = postgres
      (Database username)
    3. Configure the password, which User created while installing PostgreSQL:
      bds.cidb.password = <password string in clear text>
      (Database password will be encrypted once the data importer service is started or restarted)
    4. Configure password encryption:
      bds.cidb.password.encryption.required=true
      (It is recommended to set the password encryption to true)
    Elasticsearch node Configuration:
    IMPORTANT:
    It is recommended to leave the default configurations unchanged.
    1. Configure Elasticsearch service port and http port:
      bds.cies.esPort= 9300
      bds.cies.esHttpPort= 9200
      (Must match with the ports defined during installation)
    2. Configure Elasticsearch host:
      bds.cies.host=localhost
    Dataimporter Distributed Environment:
    1. Configure for Distributed Environment:
      bds.cies.isDistributedEnvironment= false
      (for Multi node configure change it to
      True
      .
      By default it is set to False for single node deployment)
    2. Configure Eventbus Port:
      bds.cies.eventbusport = 6702
    Eventbus SSL
    1. Configure Eventbus SSL for Distributed Environment:
      bds.cies.iseventbusSLLenabled = false
      (If True SSL is enabled and system will use below provided certificate)
    2. Configure Eventbus Keystore:
      bds.cies.eventbusKey Store = <host1.acme-int.com.jks>
    3. Configure Eventbus Keystore Password:
      bds.cies.eventbusKeyStorePassword =<password for keystore>
    4. Configure Eventbus TrustStore:
      bds.cies.eventbusTrustStore =<fta_truststore.jks>
    5. Configure Eventbus TrustStore Password:
      bds.cies.eventbusTrustStorePassword =<TrustStore password>
    Scheduler Thread
    1. Configure Scheduler Thread count:
      bds.schedulerParallelThread=3
      The
      bds.schedulerParallelThread
       is added to
      dataimporterproperties.properties
       file to maximize the use of core for scheduling threads, which is currently at 33-40% provided the CPU is of 8 core. By default, the
      bds.schedulerParalledThreads
       count is set to 3. This will result in maximum thread for scheduler to be 3 running in parallel while other threads for which sync needs to happen will wait in queue. This way CPU will not be utilized to 100%. If there is a requirement to sync more number of datasets simultaneously, then dataimporter can be installed on multiple nodes. For more information refer to Appendix A, “Simultaneously Sync up more Number of Datasets”
      Configure DataImporter Properties File
      NOTE:
      To configure DataImporter in distributed system or on multiple machines. Refer to Appendix A, “Clustered Environment Configuration” section for steps to configure DataImporter.
  3. Save and close the file.
  4. After configuring the DataImporter properties, open a Command Prompt window with administrator privileges.
  5. Change the working directory to the
    <DataView_HOME>\FTADataView\dataimporter
     folder.
    DataImporter Folder
  6. Execute the following command:
    installimporterservice.bat
    Install DataImporter Service
  7. Once the service is installed, the Command Prompt window displays “
    The service ‘FTAnalyticsDataImporter’ has been installed.
    ” message.
    DataImporter Service Installed
    The installation and configuration of the DataImporter as a service has been completed.
  8. Open the Windows Service management console. Ensure that
    FTAnalyticsDataImporter
     service is available and running.
    DataImporter Services
  9. Start the
    FTAnalyticsDataImporter
    . Review the d
    ataimporterproperties.properties
     file to ensure that the password phrases are encrypted.
    NOTE:
    Upon every start or restart of FTAnalyticsDataImporter the application checks whether the passwords in the property file are encrypted or a plain text password and encrypts the plain-text password only.
    DataImporter Properties File
  10. Open a web browser, type http://<FQDN-HostName>:5007 to verify that DataImporter is running.
    DataImporter Verification
Provide Feedback
Have questions or feedback about this documentation? Please submit your feedback here.