Duplicate suggest terms

[nasko25]

Querying for common terms like and results in multiple suggestions.
http://localhost:8983/solr/querty/suggest?q=text%3Aand results in:

{
  "responseHeader":{
    "zkConnected":true,
    "status":0,
    "QTime":5},
  "suggest":{"mySuggester":{
      "text:and":{
        "numFound":2,
        "suggestions":[{
            "term":"and",
            "weight":398245770157805504,
            "payload":""},
          {
            "term":"and",
            "weight":72057594037927936,
            "payload":""}]
         }}
    }
}

[nasko25]

This is a very well known solr issue (the most promising thread: https://issues.apache.org/jira/browse/LUCENE-6336)

For now filtering on the rust server (or even maybe on the frontend) by using a set that does not allow duplicates seems like the best solution. BUT the suggest.count needs to be increased to account for possible duplicates. (done in 06368cf -> suggest.count = 50)

ALSO, stop words need to be filtered from the suggestions. (done in 93344ac)

[nasko25]

At some point in the future solr's /spell can also be used if there are no suggestions returned by /suggest (or maybe the output of /spell and /suggest can be concatenated?)