Newest 'elasticsearch' Questions - Stack Overflow

Questions tagged [elasticsearch]

Elasticsearch is an Open Source (Apache 2), Distributed, RESTful, Search Engine based on Lucene.

1
vote
0answers
12 views

parsing apache airflow logs using grok or regex

My main goal is to parse apache airflow logs into particular fields using logstash, feed it into elasticsearch and visualise them using kibana. There is no particular grok pattern available for ...
0
votes
0answers
5 views

How to solve error while running 'yarn kbn bootstrap' [on hold]

I am trying to set up developer environment for Kibana. While running 'yarn kbn bootstrap' I am getting this error. [bootstrap] failed: Error: Command failed: yarn run kbn:bootstrap Error: spawn git ...
1
vote
1answer
21 views

TypeError: search() got an unexpected keyword argument 'doc_type' for elastic search version 5.6

I want to read the documents from a specific index and a specific type from elastic search. I construct the query: es.search(index="document_index, doc_type="document_type", body={"query": {"...
1
vote
1answer
19 views

How to upgrade elastic search from 1.7.x to 7.0?

I am in need of a solution to upgrade/migrate elasticsearch from 1.7.6 to 7.0 with all the data and the reports. Is there any way to do it? Thanks in advance.
0
votes
0answers
8 views

Logstash : Trigger python script from inout or putput section

I have logstash and elasticsearch working and gets data from filebeats from different server. I have a requirement where I want to execute a python script when a field is equal to certain value. for ...
0
votes
0answers
16 views

Elasticsearch c# datetime gets datetime default value

I'm currently facing an issue with my elasticsearch, when i'm trying to fetch data from it. I have a timestamp value that gets saved like the following: Timestamp = DateTime.UtcNow; And the ...
0
votes
0answers
12 views

ElasticSearch / Node : delete items by match

I am trying to delete only the indexes with "datastorage.clientID" : "00001" but it deletes all the items, do you see any error in this code? deleteAllByClientID: function (clientID,callback) { ...
0
votes
0answers
23 views

How to implement full text search on encrypted document having several pages?

I have hundreds of documents and each document has several pages. A user can search within a document for a word or sentence. Now I am expecting all the files in return which contain the searched text....
0
votes
1answer
10 views

Elasticsearch sort results from several indexes so that one index has priority

I have 6 websites, lets call them A, B, C, D, E & M. M is the master website because from it you can search the contents of others, this I've done easily by using putting all indexes separated by ...
0
votes
1answer
13 views

ElasticSearch use match_phrase and multi_match together

I use ES 7.1, I want to query using multi match to grab result from several fields, but I want to grab results with match_phrase on a specific field. I tried a lot of things, this is the version the ...
-3
votes
0answers
9 views

Loading data from azure database to elasticsearch using logstash

[‎19.‎06.‎2019 18:01] Mouhamed Chaker: i have an SQL SERVER database hosted on azure, i want to migrate data to elastik stack here is my logstash config file , and its doesnt work, i have installed ...
1
vote
1answer
17 views

Elasticsearch edge ngram tokenizer returns less relevant items

I have edge ngram tokenizer which make tokens like this: x sport => x s sp spo spor sport sport active => s sp spo spor sport a ac act acti activ active xin xin sro => x xi xin x xi xin s sr sro If ...
0
votes
0answers
8 views

Was there any way to configure properties of elastic search from DB instead of elasticsearch.yml file?

I want to know that was there any way that we can configure the elasticsearch.yml file from DB? Basically, I want to start my elastic search without elasticSearch.yml file. I need to get the ...
0
votes
0answers
7 views

How to enable Elastic-Search Security on one node Single cluster

I'm currently following these two tutorial to enable elasticsearch security which is now free, but in these two tutorials, it's specified only for two node-cluster and i only have one, my default ...
0
votes
0answers
15 views

Spark Not able to connect to Elasticsearch2.4 thru HTTPs and Load Balancer

Our elasticsearch runs behind a load balancer. the url for load balancer is https://es.mycomp.com. I can post document to it from both postman and curl. So the firewall is open for my dev box. But ...
0
votes
0answers
6 views

How to return data from the document tree

I would like to ask you how to return data from the document tree. University => Faculty => Departments => Subjects => Annotation + syllabus. The document is stored in the ES "index": "university" => "...
1
vote
0answers
14 views

How to increase performance using wildcard *word*?

I use wildcard query someting like : *someWord* executing time for 5 000 000 docs is almost 26 seconds what can I do to increase performance?
0
votes
0answers
7 views

Elasticsearch delete old data

I 've seen tons of posts stating that the best way to handle data on Elasticsearch is to have one index each day/week/month and then just delete the old ones. But for my use case, this does not apply ...
0
votes
0answers
11 views

fluentd remove empty nested key

I have some fluentd agents which are sending data to ElasticSearch now i have an issue because for same tag some of the data are not reaching elastic search after debugging i found that the reason is ...
0
votes
1answer
13 views

Elasticsearch GROUP BY column HAVING COUNT > x

In SQL if I have an example table my_site_visits showing which pages users of my website have visited: user_id,url 1,index.html 1,index.html 1,foobar.html 1,index.js 2,a.html 2,b.html 2,index.html 3,...
0
votes
2answers
13 views

ElasticSearch 7.x NEST client compatibility with ES 6.x

We have some code that will shortly need to query both ElasticSearch 6.x and 7.x indexes. We are currently using NEST to talk to our ES instances, however from looking on the web it seems that the v6 ...
0
votes
0answers
13 views

how to set exact size of Elastic Search pagination in version 7.x?

In Elastic Search version 2.4 we can create a pagination with combination of from and size parameters in which size parameter is the exact size of search result documents. But in Elastic Search 7.x ...
0
votes
1answer
16 views

Elasticsearch not finding JAVA_HOME or Java, even when both of these are existing

I'm currently trying to setup a computer with elasticsearch. However, I am currently encountering a problem when doing so : It seems that elasticsearch can't find my Java installation, even when said ...
-3
votes
0answers
22 views

Histogram on a field values

I need a search query on a value of a field that will return: the number of times a value is matched 1 time, the number of times a value is matched 2 time, the number of times a value is matched 3 ...
0
votes
1answer
21 views

How to get all data of elasticsearch in format of json? [on hold]

I want to get all data of elasticsearch in format of json. This I need in my c++ code.Searching in the web I have found a command: curl -XGET 'localhost:9200/ But I need to get data in json format,...
0
votes
1answer
15 views

Find docs where field value does not exists in other docs using ElasticSearch query

I have a problem retrieving all the docs, that do not have corresponding other logs by field value. I would appreciate any help given. The easiest to explain is with an example: I have the following ...
0
votes
1answer
14 views

using logstash with elastic cloudid

There instructions on how to configure logstash with elastic cloud using the cloud.id are not complete. Specifically the instructions do not say what to put into the output section in the *.conf file ...
1
vote
1answer
17 views

Filter on TOP aggregation - elasticsearch 5.6

Note: This kind of query has been asked previously 2 or 3 times years ago but did not have any satisfactory answer. I am posting my specific problem here. Hope, someone suggests some good solution. I ...
0
votes
1answer
26 views

How do prioritize matches in the beginning of strings in Elasticsearch?

I have an Elasticsearch instance full of documents containing movie and series titles. When I run this: { "query": { "bool": { "must": [ { "multi_match": { ...
0
votes
1answer
22 views

How to create a sub object in Elastic-search 7.x

Earlier I was using 1.x version and was creating the sub objects mapping using below syntax. "foo": { "type": "integer", "doc_values": true }, "foo.bar": { ...
0
votes
1answer
35 views

Re-indexing in elasticsearch

In my project, the index command is taking around 5 hours to complete the indexing of entire records in the database. If I want to re-index the data it would take the same amount of time and with the ...
1
vote
1answer
15 views

MongoDB 4.x Real Time Sync to ElasticSearch 6.x +

I'm trying to find an easy way to sync data in mongoDB 4.x, to elasticsearch 6.x . My use case is for partial text search that is supported by elasticsearch but no supported by mongodb. MongoDB is the ...
0
votes
0answers
11 views

How to use a trailing space in a query with elasticsearch?

I'm currently trying to match trailing/leading spaces in searches such as: "de " "het " "een " " baan" the field that im searching on is of type "text" with a search_analyzer "simple" Example ...
1
vote
1answer
13 views

What actually norms store in Elasticsearch

I came across a mapping where, on some fields, which uses custom analyzer, norms are disabled. Then I read about Norms and https://www.elastic.co/guide/en/elasticsearch/reference/current/norms.html ...
0
votes
0answers
18 views

Elasticsearch: sort by script with children field

I have data as below: { "name": "Data 1", "ancestor" : { "parent" : { "name" : "Apple", "date" : ISODate("2016-04-21T03:28:08.493Z") } } }, { "...
0
votes
0answers
10 views

What is the right approach to implement a functionality like search/filter within starred projects in Github?

I have a problem which is similar to the github's starred repo search functionality so I will use it as analogy. I have not yet found an efficient implementation but here are my preliminary thoughts: ...
1
vote
1answer
19 views

How to get geo-location based on list of ip addresses in Elasticsearch

I have a bunch of log files that are already Indexed in Elastic. Is there a way I can create a new field within each JSON document of my index and run something to get the geo-location of each IP ...
0
votes
0answers
14 views

How update specific element of the array inside the a object in elasticsearch

I need to update only one element of a list within an object in elasticsearch Example: { name: "anything", docs: [ { id: "1", prop: "test", prop1: "test1" }, ...
0
votes
2answers
23 views

Elasticsearch: get all the messages (more than 10000) in python3

I have ElasticSearch 5.2 and using python 3.5 to retrieve the messages (only get no updates). The search criteria which I have has total messages more than 10000. I explored the scroll, however the ...
0
votes
0answers
15 views

How to aggregate user logs based on email domain name in ElasticSearch

I have a Json field called UserId in each document. I would like to create a new field that contains only the email domain. Example: { "FirstName" : "John", "LastName" : "Smith", "...
0
votes
1answer
17 views

ElasticSearch massive purge of deleted documents reasons? (AWS ES service)

Is there any info when and why ES may trigger automatically purge of documents marked for deletion? Where can be found logs with possible info about trigger? The service in question is actually AWS ...
1
vote
1answer
22 views

Search and join two indices in Elastic Search

How to join two separated indexes after matching query in elastic search? For instance, I have two index called all_products and SourceTable. I want to combine two indexes based on product_id { "...
0
votes
0answers
8 views

Logstash is not writing latest value in jdbc Sincedb

I am using 5.x version of Logstash and 7.x version of Elasticsearch and Kibana, the issue I am facing is even after setting the path for the sincedb, logstash is not writing the timestamp till the ...
0
votes
0answers
32 views

Elasticsearch Java API Create Index with Mapping fails

I am attempting to create new indices in Elasticsearch 7 leveraging the java api. I am able to create a new index just fine, expect when I try to either create it with a mapping, or try to add the ...
1
vote
0answers
24 views

unindex elasticsearch element with a deleted_at not empty

I'm looking to remove element with a deleted_at field not empty from the search area of my application. The product unindex properly because if I try to display it a 404 is return. But what I don't ...
0
votes
0answers
10 views

How to test Elasticsearch automatically in BBD fashion in Java?

I'm writing a microservice in Java using Spring Boot 2.0, that based on some input data executes calls to Elasticsearch. To achieve good quality we introduced component tests (in this case by ...
0
votes
0answers
20 views

Is there any mechanism to join documents by some field in elasticsearch?

In my java app I'm trying to avoid multiple calls to elastic when first I need to get one object and then search through all objects with the same sessionId. Is there any mechanism to implement such ...
1
vote
1answer
35 views

How to sort Nulls Last with Elastic?

How I can sort String field in elastic search. I need to take it last, but cannot do that. I try some sorting by ASC but it is not working Example: [ {"url":"https://amazon"}, {"url":"https://...
0
votes
1answer
18 views

Elasticsearch DSL: filter, then aggregate in python

I need to filter documents in an Elasticsearch index and then aggregate them by field. Here is the code of what I am trying to do: import elasticsearch from elasticsearch_dsl import Search, Q, Index, ...