960 questions
0
votes
1
answer
63
views
How to sync Elasticsearch index updates to database?
I want to sync/update a table database(RDBMS) whenever there is a change in the ES index. I have seen example like jdbc input plugin for Logstash, however that plugin mentions about database to ES and ...
- 454
0
votes
0
answers
25
views
Can i use kibana users and role management without xpack enabled on elasticseaech nodes?
I'm running elasticsearch on 3 nodes with kibana on a seperate node. The OS is ubuntu.
version 8.11.1
I want to eliminate the headache of renewing the certificate on the servers thus i created a 2 LB ...
- 1
1
vote
0
answers
99
views
ElasticSearch BM25 retriever returns empty "id" field
I'm using the ElasticSearchBM25Retriever library on elasticsearch database to search for relevant documents, but the ElasticSearchBM25Retriever when called "invoke" returns only "...
- 21
1
vote
0
answers
297
views
How to Enable Mutual TLS (mTLS) for Elasticsearch and Fluent Bit?
I'm currently working on securing communication between Elasticsearch and Fluent Bit in my Kubernetes environment. I want to implement Mutual TLS (mTLS) to enhance the security of the communication ...
0
votes
1
answer
65
views
Elastic Search Query to filter records where value in 2 columns of the record are equal
I am working with Elastic Search Version 6.8.22 and have an index where I have 2 columns: Column A and Column B. I want to filter out all records where values for Column A is equal to Column B. How ...
0
votes
1
answer
50
views
Elasticsearch7.x plug-in failed to load local so library file。
I developed an analyzer plug-in. The plug-in uses a C language so library file, but when I call the plug-in word segmentation, the local library link fails.
Caused by:
java.lang.UnsatisfiedLinkError:...
- 1
0
votes
1
answer
797
views
Unable to configure plugins: (ArgumentError) Cannot determine timezone from nil\n(secs
[2023-08-21T20:43:58,795][ERROR][logstash.agent ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"Java::JavaLang::...
- 15
1
vote
0
answers
948
views
How to pass the keyword argument to es.indices.exists_alias() in elastic search using python
enter code herewhen i try using below code got errors Like:
if es_client.indices.exists_alias(index_alias):
print("#########################################")
current_index = ...
- 31
1
vote
0
answers
69
views
Can we apply TTL functionality on ES version 7.17.6?
Use Case:
Our use case requires Elasticsearch to automatically delete documents older than a specific time period on a regular basis. For instance, if we have 200 documents and 75 of them are older ...
0
votes
0
answers
689
views
Elasticsearch Java Client create query for field with list of values
String searchText = "TEST";
.query(q -> q.bool(b -> b .must(c-> c .match(t -> t .field("FIELD NAME").query(searchText) ))
I need to pass String Array to query. Whats ...
0
votes
1
answer
438
views
Elasticsearch word_delimiter_graph split token on specific delimiter only
I want to use an Elasticsearch's Token filter that act like word_delimiter_graph but split tokens on specific delimiter only (if I am not wrong, default word_delimiter_graph does not allow to use ...
- 25
1
vote
0
answers
169
views
Elasticsearch search by substring in array
I have the following object in the elastic search and I am trying to find any tags.name that contains a substring. I've tried getting all the tags first and then putting in an aggregate and filter, ...
0
votes
0
answers
122
views
ElasticSearch exclude with if condition
I am trying to write a query that gives me results with the following condition:
get all user data with multiple statues but on certain status, only get it if another filed equals some value.
user ...
0
votes
1
answer
678
views
How to create and use Ingest pipeline with Spring data elastic search
I need to upload pdf file in elastic search for searching content inside the pdf file. I used ingest pipeline curl APIs through postman it works fine but, i am unable integrate and use in my spring ...
- 21
0
votes
1
answer
360
views
Errors: [Could not extract [elasticsearch.version] from [plugin-descriptor.properties] of the given plugin file.] on Elastic cloud
When I install custom plugin to elastic cloud (https://cloud.elastic.co/deployment-features/extensions).
I got this error . I am uploading a zip which contains plugin-descriptor.properties which has ...
- 6,379
0
votes
2
answers
1k
views
How do I combine multiple filter query and should of Elastic Search using Java Library (QueryBuilder)
I have a query like below :
{
"query": {
"bool": {
"filter": [
{
"range": {
"age": {
...
- 31
0
votes
1
answer
45
views
elasticsearch: problema al consultar a un rango de tiempo definido
I would like to know if there is a way to define a time range as follows.
With a watcher I am looking for records with a certain message within a field. The problem is that I want it to find the ...
1
vote
1
answer
2k
views
NoSuchFileException: plugin-descriptor.properties for custom plugin
I'm creating a Java plugin for Elasticsearch version 7.17.6.
The zip file is built using:
gradle distZip
When the generated zip file is unzipped all files, including plugin-descriptor.properties, are ...
- 178
0
votes
1
answer
883
views
Unable to Boot up ElasticSearch
I am unable to start Elastic Search on my Linux Machine.
When I run ./elasticsearch command, the process exits within 20 seconds with below error.
$ ./elasticsearch -v
Skipping security auto ...
- 85
3
votes
1
answer
192
views
Implementing Trending in Elasticsearch
I'm building a project that indexes celebrity-related content across sites (tmz, people, etc) because I always thought that it would be funny to "bet" on people (and maybe shows, directors, ...
- 43
4
votes
1
answer
1k
views
Stream elasticsearch data to kafka
I have a requirement to stream the data from Elasticsearch to Kafka. I'm looking at a any connectors between Elasticsearch and Kafka (Python implementation) that could either automatically identified ...
- 2,571
1
vote
2
answers
1k
views
ElasticSearch: Fetch records from nested Array that "only" include given element/s and filter-out the rest with mixed values
I am stuck on one of my tasks.
Overview:
There are some records on elastic search. Which includes information about the candidates and their employment.
There is a field that stores information about ...
0
votes
2
answers
67
views
ElasticSearch 8 SearchScript deprecated
I am trying to migrate "SearchScript" java class for elasticsearch existing in version 6 to version 8. But this class is deprecated in version 8.
what class could replace it?
thank you in ...
- 11
0
votes
1
answer
311
views
Is it possible to set new field value when analyzing document being indexed in Elasticsearch?
For example:
when indexing one document into elasticsearch;
i want to analyze a field named description in the document by uax_url_email tokenizer/analyzer;
if description does have any url, put the ...
- 1,250
1
vote
1
answer
3k
views
New elasticsearch-java API `CreateIndexRequest` using `.withJson` causes `co.elastic.clients.util.MissingRequiredPropertyException`
I am having a hard time on using the new elasticsearch-java api client.
I am migrating from HLRC to the new elasticsearch java api.
When I create an index, I used CreateIndexRequest and load it with ...
- 485
0
votes
1
answer
145
views
Elassandra installing ingest-attachment plugin
When running
bin/elasticsearch-plugin install ingest-attachment
I see:
org.elasticsearch.plugins.PluginCli.main(PluginCli.java:48) Caused by: java.lang.IllegalStateException: jar hell! class: org....
- 111
0
votes
1
answer
424
views
Elasticsearch: Filter the records based on nested field with nested field containing only the filtered object
I am trying to filter the records based on nested field and want only the matching object in that array to be shown as part of the record.
Below is the detailed explanation of my requirement.
So, I ...
0
votes
0
answers
214
views
Writing a plugin to make a query using the response of another query in elasticsearch
What are you trying to do?
I want to:
Make a geo-query to get device-IDs in a location - in device-location index.
Use the list of device-IDs to get device logs - in device-logs index.
What have you ...
- 193
-1
votes
1
answer
925
views
Elasticsearch couldn't start in windows
warning: ignoring JAVA_HOME=C:\Program Files\Java\jdk-11.0.15; using bundled JDK
Installing service : "elasticsearch-service-x64"
Using ES_JAVA_HOME (64-bit): "C:\Program Files\...
- 11
1
vote
1
answer
838
views
Remote ElasticSearch cluster azure cloud connection using Python Client using http
I'am having a trouble to connect the Python API to Elasticsearch.
The Elasticsearch cluster is in azure cloud environment.
This is what I tried:
from elasticsearch import Elasticsearch
es = ...
- 31
10
votes
4
answers
26k
views
elastic_transport.TlsError: TLS error caused by:TlsError(TLS error caused by: SSLError([SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:852)))
Getting this error Trying to connect elasticsearch docker container with elasticsearch-python client.
/home/raihan/dev/aims_lab/ai_receptionist/env/lib/python3.6/site-packages/elasticsearch/_sync/...
- 135
0
votes
1
answer
269
views
modifying tokens generated through standard tokenizer
I was trying to understand the working of standard tokenizer. Below is the code inside my tokenizerFactory file:
package pl.allegro.tech.elasticsearch.index.analysis.pl;
import org.apache.lucene....
- 61
0
votes
1
answer
623
views
removing special characters and words from a url elasticsearch
I was looking for a way to generate words and special characters as tokens from a url.
eg. I have a url https://www.google.com/
I want to generate tokens in elastic as https, www,google, com, :, /, /, ...
- 61
0
votes
1
answer
173
views
How to get total records with pagination in Elasticsearch
In my product index I have 60K records, I'm running a match query with from, size params. by default, ES support a 10k record search so I have increased it to 60k.
My issue is I'm already passing size ...
- 1,626
0
votes
1
answer
2k
views
elasticsearch unknown setting index.include_type_name
I'm in really weird situations, I need to create indexes in elasticsearch that contain typeless fields. I have a rails application that sends any data per second to my elasticsearch. about my ...
- 424
0
votes
1
answer
1k
views
Using Ingest Attachment Plugin within elastic search index template
I am trying to update my current elastic search schema which is on 1.3.2 to the latest one. For one of the indexes, the current schema looks something like the below:
curl -XPOST localhost:9200/...
2
votes
0
answers
8k
views
Using insecure protocols with repositories, without explicit opt-in, is unsupported
I am using gradle 4.8. I want to create an elasticsearch plugin. I am using jdk9. The elasticsearch version, I am using is 5.6.16. When I clicked on the build button inside intellij idea, It is giving ...
1
vote
1
answer
2k
views
Elasticsearch snapshot to Azure blob storage - Can not find an azure client for account
I want to update the Azure storage account that we upload snapshots to but I get the below error:
"Can not find an azure client for account [null]]" this is only happening when I change the ...
- 43
0
votes
0
answers
273
views
Approximate aggregation results in elasticsearch
I have an index with 10M documents with nearly 1M unique names and 20 shards, when I use terms aggregation it produces an approximate aggregation result as an CURL request, but when I try to replicate ...
- 13
1
vote
1
answer
129
views
How to transfer data to a host with a username and password
I have a problem. Current problem is that I want to transfer some data to a host with an username and password, but I keep getting the same error message. I would be very happy if you help.
My conf ...
- 65
0
votes
1
answer
966
views
elasticsearch : How can i tell _reindex api in to continue indexing docs while source index still receiving new docs?
I have daily created indices, these indices are filled by an agent which collects a logs every second of the day, and i'am reindexing them (by field) to new indices using _reindex api.
How can i tell ...
- 273
2
votes
0
answers
159
views
Fetch index name from alias during ingest in elasticsearch ingest plugin java
I am using Elasticsearch v7.9 and need to get index name during ingest instead of alias name.
Alias name = employees_prod and Index Name = employees
POST /employees_prod/_doc?pipeline=test-pipeline&...
- 6,379
0
votes
0
answers
515
views
How to prevent duplicate documents to Logstash
my csv file =>
name,surname,age,email,phone
Harry,Potter,18,NULL,NULL
Harry,Potter,NULL,[email protected],05369564466
Harry,Potter,NULL,[email protected],NULL
Harry,Potter,NULL,NULL,...
- 65
0
votes
0
answers
123
views
Logstash Elasticsearch plugin. Compare results from two sources
I have two deployed Elasticsearch clusters. Data "surpassingly" should be the same in both clusters. My main aim is to compare _source field for each elasticsearch document from source and ...
- 923
0
votes
1
answer
440
views
Collect Elasticsearch Access Log
I want to collect elasticsearch access logs, but the official method is not free. Is there an open source and free method that can meet my situation? I am using es7
0
votes
1
answer
302
views
score script plugin in Elasticsearch
I implemented a scoring plug-in to skip some documents in the search results, and the actual business is to skip the user's read. Plug-in address https://github.com/yzlq99/ElasticsearchPlugin
Problem: ...
- 11
2
votes
0
answers
565
views
how to restrict access to documents in elasticsearch?
I'm designing a solution and want to leverage some of Elasticsearch's query capabilities (version 7.x). We are expected to have around 10M documents per index.
Documents might have different '...
- 122
0
votes
1
answer
431
views
Elasticsearch Filter Dynamically Aggregated Fields
I am trying to serach/filter results based on front-end selections in available acategories:
I am able to get data in hits, and aggreagation as well, which gives me all available productCategory, ...
- 1,461
0
votes
1
answer
1k
views
How to index a csv document in elasticsearch?
I'm trying to upload some csv files in elastic search. I don't want to mess it up , so I'm writing for some guidance. Can someone help with a video/tutorial/documentation , of how to index a document ...
- 1
0
votes
1
answer
45
views
Datasweet Metric on Amazon Kibana
We have AWS elastic search and Amazon Kibana. Do we have Datasweet metric available on Amazon Kibana
Datasweet is the external plugin. I'm not sure if we can import external plugins to Amazon Kibana.
...
- 1