-
-
Notifications
You must be signed in to change notification settings - Fork 493
Elasticsearch migration July 2019 codesprint
François Prunayre edited this page Jul 24, 2019
·
40 revisions
Address:
- Monday: Olivier, Florent in camptocamp / Jose, Francois at the farm
- Tuesday/Wednesday: at the farm, 321, Route de la Mollière, Saint-Pierre-de-Genebroz, Chambéry, Savoie, Auvergne-Rhône-Alpes, France
- Thursday: All in camptocamp
- Friday: Olivier, Florent in camptocamp / Jose, Francois at the farm
- Florent
- Olivier
- Jose
- Francois
- Pierre ?
- Michel ?
PR: https://github.com/geonetwork/core-geonetwork/pull/2830
- UI & search (Florent & Olivier)
- Facet / Improve CSS
- Facet / Support tree
- Facet / Support negative switch
- Facet / More values https://www.elastic.co/guide/en/elasticsearch/reference/current/search-aggregations-bucket-terms-aggregation.html#search-aggregations-bucket-terms-aggregation-size
- Facet / Config UI
- Search / Return in _source only the field required by the UI (performance)
- Search / Map / Restore bbox
- Related records
- Indexing & search
- Synonyms
- Core (Jose & Francois)
- CSW (Jose)
- Paging,
- Select all,
- MEF2 export,
- PDF export,
- CSV export,
- Update field in index (instead of reindex all)
- Index related
- ... onlyMyRecord, getTitleFromIndex eg. buildMetadataStatusResponses, retrieveMetadataIndexField
- GN Harvester
- Tests https://www.elastic.co/guide/en/elasticsearch/reference/current/integration-tests.html
- Install
- Docker setup (Pierre?)
- Index a field with a separator eg "Hydrologie/Salinité" (could be resourceType/(serviceType|spatialRepType)/(format)
- Define field in index
"settings": {
"analysis": {
"analyzer": {
"pathAnalyzer": {
"tokenizer": "pathTokenizer"
}
},
"tokenizer": {
"pathTokenizer": {
"type": "path_hierarchy",
"delimiter": "/",
"replacement": "/",
"skip": 0,
"reverse": false
}
}
}
},
...
"mappings": {
"dynamic_templates": [
{
"stringPathType": {
"match": "ft_*_s_tree",
"mapping": {
"type": "keyword",
"fielddata": true,
"analyzer": "pathAnalyzer",
"search_analyzer": "keyword"
}
}
},
- https://github.com/geonetwork/core-geonetwork/blob/master/core/src/main/java/org/fao/geonet/kernel/search/classifier/AbstractTerm.java#L73-L79
- https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-pathhierarchy-tokenizer.html
- No native aggregation on this - check what has been done in Sextant, https://stackoverflow.com/questions/52940790/elasticsearch-aggregation-with-hierarchical-category-subcategory-limit-the-lev
Eg.
If you have some comments, start a discussion, raise an issue or use one of our other communication channels to talk to us.