Skip to content

Elasticsearch migration July 2019 codesprint

François Prunayre edited this page Jul 19, 2019 · 40 revisions

Where?

Address:

  • Monday: Olivier, Florent in camptocamp / Jose, Francois at the farm
  • Tuesday/Wednesday: at the farm, 321, Route de la Mollière, Saint-Pierre-de-Genebroz, Chambéry, Savoie, Auvergne-Rhône-Alpes, France
  • Thursday: All in camptocamp
  • Friday: Olivier, Florent in camptocamp / Jose, Francois at the farm

Map: https://www.openstreetmap.org/search?query=321%20route%20de%20la%20molli%C3%A8re%2073360#map=19/45.46277/5.75553

Who?

  • Florent
  • Olivier
  • Jose
  • Francois
  • Pierre ?

Agenda

  • UI & search (Florent & Olivier)
    • Facet / Improve CSS
    • Facet / Support tree
    • Facet / Support negative switch
    • Search / Return in _source only the field required by the UI (performance)
    • Related records
  • Indexing & search
    • Synonyms
  • Core
    • CSW (Jose)
    • Wire all the apps (Francois): select all, getTitleFromIndex eg. buildMetadataStatusResponses, retrieveMetadataIndexField
    • GN Harvester
  • Tests https://www.elastic.co/guide/en/elasticsearch/reference/current/integration-tests.html
  • Install
    • Docker setup (Pierre?)

Summary

Details

Facet / Support tree

  • Index a field with a separator eg "Hydrologie/Salinité" (could be resourceType/(serviceType|spatialRepType)/(format)
  • Define field in index
"settings": {
    "analysis": {
      "analyzer": {
        "pathAnalyzer": {
          "tokenizer": "pathTokenizer"
        }
      },
      "tokenizer": {
        "pathTokenizer": {
          "type": "path_hierarchy",
          "delimiter": "/",
          "replacement": "/",
          "skip": 0,
          "reverse": false
        }
      }
    }
  },
...
  "mappings": {
    "dynamic_templates": [
        {
          "stringPathType": {
            "match": "ft_*_s_tree",
            "mapping": {
              "type":     "keyword",
              "fielddata": true,
              "analyzer": "pathAnalyzer",
              "search_analyzer": "keyword"
            }
          }
        },

Facet / Support negative switch

Eg.

Clone this wiki locally