How to configure logstash to transfer data from MS-SQL server to elasticsearch

Question

I am trying to copy my table data from MSSQL server to elasticsearch, after going through some documents i wrote my config file for logstash, when i run the file from command prompt , i get this message :

"J_3a_.ELK.logstash_minus_6_dot_6_dot_2.logstash_minus_core.lib.logstash.pipeline.block in start_input" I have the MSSQL database in aws-RDS.

This is my conf file

input {
    jdbc {
        jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
        jdbc_driver_library => "J:\Java\sqljdbc_4.2\enu\jre8\sqljdbc42.jar"
        jdbc_connection_string => 
       "jdbc:sqlserver://skunestdevdb.czdnys4mper2.ap-southeast- 
         2.rds.amazonaws.com;database=skudevusr;user= 
       <my_username>;password=<my_password>"
        jdbc_user => "<my_username>"
        jdbc_password => "<myPassword>#"
        statement => "select * from product"
    }
}
output{
    elasticsearch{
      hosts => ["localhost:9200"]
      index => ["skunest_qa"]
    }
}

I cant seem to get what is wrong here, i have provided necessary details in the conf file, the command line stucks showing above message. I have tried removing the username and password from the connection string. Help!!

You shouldn't provide username and password in jdbc connectron string when you additionally provide fields jdbc_user and jdbc_password. Can you also start Logsatsh in debug mode --debug and then send logs? — Michael Dz
– Michael Dz, Commented Apr 2, 2019 at 10:08
@MichaelDz i removed the username and password from the connection string and it still result in the same situation. — jungNitesh
– jungNitesh, Commented Apr 2, 2019 at 10:26

Coder · Accepted Answer · 2019-04-03 07:28:41Z

2

Try this:

input {  
jdbc {
    # SqlServer jdbc connection string to your database, productdb
    #  "jdbc:sqlserver://HostName\instanceName;database=DBName;user=UserName;password=Password" 
    jdbc_connection_string => "jdbc:sqlserver://localhost\SQLExpress;database=productdb;user=sa;password=test@123"
    # The user you want to execute your statement as
    jdbc_user => nil
    # The path to your downloaded jdbc driver
    jdbc_driver_library => "C:/Program Files/sqljdbc_6.0/enu/jre8/sqljdbc42.jar"
    # The name of the driver class for SqlServer
    jdbc_driver_class => "com.microsoft.sqlserver.jdbc.SQLServerDriver"
    # Query for testing purpose
    statement => "SELECT * from product"
}
}
output {  
    elasticsearch {
     hosts => ["localhost:9200"]
     index => "logstash-%{+YYYY.MM.dd}"
 }

   }

edited Apr 3, 2019 at 7:28

answered Apr 3, 2019 at 7:20

Coder

5291 gold badge6 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Rajesh Ranjan Over a year ago

Can I put multiple SQL statements here? if yes, then how?

Collectives™ on Stack Overflow

How to configure logstash to transfer data from MS-SQL server to elasticsearch

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related