How to use Elasticsearch Ingest Attachment Processor Plugin in Java

Question

I am looking for a way to use the Ingest Attachment Processor Plugin from the Java High-level REST client.

It seems that you need to do two steps, i.e., first you define a pipeline containing the attachment processor (e.g., referring to a field data and using a pipeline id attachment)

PUT _ingest/pipeline/attachment
{
  "description" : "Extract attachment information",
  "processors" : [
    {
      "attachment" : {
        "field" : "data"
      }
    }
 ]
}

then you PUT data referring to the field (here data) and the pipeline (here attachment)

PUT my_index/my_type/my_id?pipeline=attachment
{
  "data": "e1xydGYxXGFuc2kNCkxvcmVtIGlwc3VtIGRvbG9yIHNpdCBhbWV0DQpccGFyIH0="
}

Now I want to execute these two steps from the Java High-level REST client. It seems that I can execute the first step (definition of the pipeline) with the Put Pipeline API, but I could not find a Java mechanisms for the second part, i.e., writing the actual data while referring to the pipeline.

Mysterion · Accepted Answer · 2020-04-08 11:25:47Z

1

In a Java high-level REST client there is a method to index using IndexRequest, during the creation of it, you could set pipeline via Java method.

JavaDoc reference for it - https://artifacts.elastic.co/javadoc/org/elasticsearch/elasticsearch/7.6.2/org/elasticsearch/action/index/IndexRequest.html?is-external=true#setPipeline(java.lang.String)

I would expect to have code like this:

RestHighLevelClient client = new RestHighLevelClient(
        RestClient.builder(new HttpHost("localhost", 9200, "http")));

final IndexRequest indexRequest = new IndexRequest("index-name", "index-type");
indexRequest.setPipeline("pipeline-name");

Map<String, Object> jsonMap = new HashMap<>();
jsonMap.put("data", "e1xydGYxXGFuc2kNCkxvcmVtIGlwc3VtIGRvbG9yIHNpdCBhbWV0DQpccGFyIH0=");

indexRequest.source(jsonMap);
final IndexResponse indexResponse = client.index(indexRequest);

edited Apr 8, 2020 at 11:25

answered Jan 12, 2019 at 14:06

Mysterion

9,3303 gold badges33 silver badges54 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Shanmuka Chowdary Over a year ago

Looking for this answer from 2 days. Thanks. It worked, Can you tell me how to upload bulk documents at a time

Mysterion Over a year ago

@ShanmukaChowdary take a look at artifacts.elastic.co/javadoc/org/elasticsearch/elasticsearch/…

Collectives™ on Stack Overflow

How to use Elasticsearch Ingest Attachment Processor Plugin in Java

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related