javascript - Multi-language elastic search mapping setup - Stack Overflow

admin管理员组

文章数量:1428993

I have documents stored in MongoDB like so:

const demoArticle = {
  created: new Date(),
  title: [{
    language: 'english',
    value: 'This is the english title'
  }, {
    language: 'dutch',
    value: 'Dit is de nederlandse titel'
  }]
}

I want to add analyzers to specific languages, which is normally specified like so:

"mappings": {
   "article": {
      "properties": {
         "created": {
            "type": "date"
         },
         "title.value": {
           "type": "text",
           "analyzer": "english"
         }
      }
   }
}

The problem is however: depending on the language set on the child level, it should have an analyzer set according to that same language.

I've stumbled upon Dynamic Templates in ElasticSearch but I was not quite convinced this is suited for this use-case.

Any suggestions?

I have documents stored in MongoDB like so:

const demoArticle = {
  created: new Date(),
  title: [{
    language: 'english',
    value: 'This is the english title'
  }, {
    language: 'dutch',
    value: 'Dit is de nederlandse titel'
  }]
}

I want to add analyzers to specific languages, which is normally specified like so:

"mappings": {
   "article": {
      "properties": {
         "created": {
            "type": "date"
         },
         "title.value": {
           "type": "text",
           "analyzer": "english"
         }
      }
   }
}

The problem is however: depending on the language set on the child level, it should have an analyzer set according to that same language.

I've stumbled upon Dynamic Templates in ElasticSearch but I was not quite convinced this is suited for this use-case.

Any suggestions?

• javascript
• elasticsearch
• mapper

Share Improve this question Follow edited Aug 9, 2018 at 11:52 Bharata 14.2k66 gold badges4343 silver badges5353 bronze badges asked Jul 25, 2018 at 7:39 randomKekrandomKek 1,12833 gold badges1818 silver badges3434 bronze badges 5

• 1 Depending on the number of languages you need to support, you could have one sub-field per language, i.e. title_en.value, title_du.value, etc each with its own language analyzer. – Val Commented Jul 30, 2018 at 7:46
• 3 To be honest, I don't understand the question. You are offering a second bounty but, in my opinion, you should provide way more details. @Val did offer you an idea above. You care explaining why that would or wouldn't work? Just throwing a bounty out there wouldn't magically giving you the perfect solution. Do answer questions and explain further. As it is now, this is a poorly detailed question imo and the upvotes it got are not deserved. – Andrei Stefan Commented Aug 7, 2018 at 11:18
• 1 I Agree with @AndreiStefan. Going by best practices either use Val's suggestion or create one index per language and then you can search across indices. Is you requirement to have all languages in one field i.e. title? You can hack your way into it by writing custom analyzer to create inverted index based on some separator between the langauges. – Polynomial Proton Commented Aug 7, 2018 at 22:05
• 1 @randomKek any input? – Val Commented Aug 10, 2018 at 3:51
• @randomKek Yeah makes sense, thanks for everybody's input. – randomKek Commented Aug 10, 2018 at 10:10

Add a ment  | 

1 Answer 1

Sorted by: Reset to default 10 +25

If you match MongoDB object language property to the exact name of the ES language analyzers all you would be needing than as per the remended by Elastic way you would just add:

{
  "mappings": {
    "article": {
      "properties": {
        "created": {
          "type": "date"
        },
        "title": {
          "type": "text",
          "fields": {
            "english": {
              "type": "text",
              "analyzer": "english"
            },
            "dutch": {
              "type": "text",
              "analyzer": "dutch"
            },
            "bulgarian": {
              "type": "text",
              "analyzer": "bulgarian"
            }
          }
        }
      }
    }
  }

This way you have nice match on the language/analyzer field between MongoDB and ES.

本文标签： javascriptMultilanguage elastic search mapping setupStack Overflow